2024-09-17T03:24:04.414 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T03:24:04.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T03:24:04.519 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/sessionmap} email: pdonnell@redhat.com first_in_suite: false job_id: '7908451' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - client session with non-allowable root sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPy4VSLZROstzoSW5dOhG5bPy/PH4GjMrjKIiDvijlDmboXxrGYwuoq7kJKNaoXxef23Vy2HZqpRRLUuNoqU5PI= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFaMLCDD0H3yGOHXATpcJClIJHdq+UgExnjGB+ENWx0HPU4B+wSJ0/Dmmvn7hWfMeeMuzuTSG7JOQESeMHm9MXo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_sessionmap teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T03:24:04.519 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T03:24:04.520 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T03:24:04.520 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T03:24:04.522 INFO:teuthology.task.internal:Checking packages... 2024-09-17T03:24:04.543 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T03:24:04.543 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T03:24:04.543 INFO:teuthology.packaging:ref: None 2024-09-17T03:24:04.543 INFO:teuthology.packaging:tag: None 2024-09-17T03:24:04.543 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T03:24:04.543 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:24:04.543 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T03:24:04.685 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T03:24:04.687 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T03:24:04.693 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T03:24:04.693 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T03:24:04.719 INFO:teuthology.task.internal:Saving configuration 2024-09-17T03:24:04.736 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T03:24:04.748 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T03:24:04.773 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 03:19:05.910533', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPy4VSLZROstzoSW5dOhG5bPy/PH4GjMrjKIiDvijlDmboXxrGYwuoq7kJKNaoXxef23Vy2HZqpRRLUuNoqU5PI='} 2024-09-17T03:24:04.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 03:19:05.912017', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFaMLCDD0H3yGOHXATpcJClIJHdq+UgExnjGB+ENWx0HPU4B+wSJ0/Dmmvn7hWfMeeMuzuTSG7JOQESeMHm9MXo='} 2024-09-17T03:24:04.796 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T03:24:04.808 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T03:24:04.808 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T03:24:04.808 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T03:24:04.875 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f243e1c3ac0>, signals=[15]) 2024-09-17T03:24:04.876 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T03:24:04.886 INFO:teuthology.task.internal:Opening connections... 2024-09-17T03:24:04.887 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:24:04.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:24:04.963 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:24:04.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:24:05.039 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T03:24:05.052 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-09-17T03:24:05.070 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-09-17T03:24:05.071 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-09-17T03:24:05.128 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-09-17T03:24:05.128 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-09-17T03:24:05.128 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-09-17T03:24:05.128 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-09-17T03:24:05.128 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-09-17T03:24:05.128 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-09-17T03:24:05.129 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T03:24:05.129 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-09-17T03:24:05.129 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-09-17T03:24:05.129 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T03:24:05.129 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-09-17T03:24:05.129 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T03:24:05.129 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T03:24:05.129 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T03:24:05.130 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-09-17T03:24:05.158 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-09-17T03:24:05.176 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-09-17T03:24:05.176 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-09-17T03:24:05.234 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-09-17T03:24:05.234 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-09-17T03:24:05.234 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-09-17T03:24:05.234 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-09-17T03:24:05.234 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-09-17T03:24:05.234 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-09-17T03:24:05.234 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T03:24:05.234 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-09-17T03:24:05.234 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-09-17T03:24:05.235 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T03:24:05.235 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-09-17T03:24:05.235 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T03:24:05.235 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T03:24:05.235 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T03:24:05.235 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-09-17T03:24:05.259 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T03:24:05.276 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T03:24:05.287 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T03:24:05.287 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-09-17T03:24:05.291 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-09-17T03:24:05.308 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T03:24:05.319 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T03:24:05.319 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-09-17T03:24:05.348 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-09-17T03:24:05.602 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T03:24:05.662 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T03:24:05.680 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T03:24:05.680 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-17T03:24:05.680 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-17T03:24:05.681 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T03:24:05.681 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T03:24:05.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:24:05.698 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-17T03:24:05.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:24:05.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-17T03:24:05.869 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:24:05.869 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-17T03:24:05.869 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-09-17T03:24:05.880 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:24:05.880 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-17T03:24:05.880 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-17T03:24:05.887 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-503.el9.x86_64 2024-09-17T03:24:05.887 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:24:05.888 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-17T03:24:05.888 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum upgrade -y linux-firmware 2024-09-17T03:24:05.898 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-503.el9.x86_64 2024-09-17T03:24:05.898 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:24:05.898 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-17T03:24:05.898 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum upgrade -y linux-firmware 2024-09-17T03:24:08.535 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.3 MB 00:00 2024-09-17T03:24:10.430 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.3 MB 00:02 2024-09-17T03:24:10.744 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-17T03:24:12.114 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-17T03:24:16.744 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.5 MB 00:02 2024-09-17T03:24:17.640 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-17T03:24:18.493 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-17T03:24:19.273 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-17T03:24:19.447 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-17T03:24:20.277 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-17T03:24:24.894 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T03:24:25.707 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T03:24:26.960 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-17T03:24:26.971 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 1 Package 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 388 M 2024-09-17T03:24:26.972 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-17T03:24:27.710 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-17T03:24:27.717 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-17T03:24:27.717 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-09-17T03:24:27.717 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-17T03:24:27.717 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-09-17T03:24:27.717 INFO:teuthology.orchestra.run.smithi121.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-17T03:24:27.717 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:24:27.717 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-17T03:24:27.717 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-17T03:24:27.717 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 1 Package 2024-09-17T03:24:27.717 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:24:27.718 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 388 M 2024-09-17T03:24:27.718 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-17T03:24:32.163 INFO:teuthology.orchestra.run.smithi176.stdout:linux-firmware-20240905-146.el9.noarch.rpm 77 MB/s | 388 MB 00:05 2024-09-17T03:24:32.163 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:24:32.163 INFO:teuthology.orchestra.run.smithi176.stdout:Total 75 MB/s | 388 MB 00:05 2024-09-17T03:24:35.276 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-17T03:24:35.378 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-17T03:24:35.378 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-17T03:24:38.662 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-17T03:24:38.662 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-17T03:24:40.082 INFO:teuthology.orchestra.run.smithi121.stdout:linux-firmware-20240905-146.el9.noarch.rpm 31 MB/s | 388 MB 00:12 2024-09-17T03:24:40.083 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:24:40.083 INFO:teuthology.orchestra.run.smithi121.stdout:Total 31 MB/s | 388 MB 00:12 2024-09-17T03:24:43.207 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-17T03:24:43.430 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-17T03:24:43.431 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-17T03:24:46.729 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-17T03:24:46.729 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-17T03:24:47.812 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-17T03:24:48.477 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T03:24:48.550 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:24:49.328 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:24:49.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T03:24:50.098 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:24:50.098 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:24:50.098 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2024-09-17T03:24:50.098 INFO:teuthology.orchestra.run.smithi176.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-17T03:24:50.098 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:24:50.098 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-17T03:24:50.433 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-17T03:24:50.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:24:50.581 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-17T03:24:50.582 DEBUG:teuthology.orchestra.run.smithi176:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-17T03:24:50.584 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi176.front.sepia.ceph.com to complete... 2024-09-17T03:24:56.363 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-17T03:24:56.670 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T03:24:56.750 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:24:57.423 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:24:57.423 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T03:24:58.128 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T03:24:58.128 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:24:58.128 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-09-17T03:24:58.128 INFO:teuthology.orchestra.run.smithi121.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-17T03:24:58.128 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:24:58.128 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-17T03:24:58.448 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-17T03:24:58.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T03:24:58.590 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-17T03:24:58.591 DEBUG:teuthology.orchestra.run.smithi121:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-17T03:24:58.593 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi121.front.sepia.ceph.com to complete... 2024-09-17T03:24:59.357 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17 03:24:59 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-17T03:24:59.357 INFO:teuthology.orchestra.run.smithi176.stderr:FINISHED --2024-09-17 03:24:59-- 2024-09-17T03:24:59.357 INFO:teuthology.orchestra.run.smithi176.stderr:Total wall clock time: 8.7s 2024-09-17T03:24:59.358 INFO:teuthology.orchestra.run.smithi176.stderr:Downloaded: 1 files, 343M in 8.3s (41.2 MB/s) 2024-09-17T03:24:59.360 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-17T03:24:59.361 DEBUG:teuthology.orchestra.run.smithi176:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-17T03:25:01.417 INFO:teuthology.orchestra.run.smithi176.stdout:Verifying... ######################################## 2024-09-17T03:25:01.470 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing... ######################################## 2024-09-17T03:25:01.529 INFO:teuthology.orchestra.run.smithi176.stdout:Updating / installing... 2024-09-17T03:25:05.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17 03:25:05 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-17T03:25:05.375 INFO:teuthology.orchestra.run.smithi121.stderr:FINISHED --2024-09-17 03:25:05-- 2024-09-17T03:25:05.375 INFO:teuthology.orchestra.run.smithi121.stderr:Total wall clock time: 6.8s 2024-09-17T03:25:05.376 INFO:teuthology.orchestra.run.smithi121.stderr:Downloaded: 1 files, 343M in 6.4s (53.5 MB/s) 2024-09-17T03:25:05.378 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-17T03:25:05.379 DEBUG:teuthology.orchestra.run.smithi121:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-17T03:25:07.434 INFO:teuthology.orchestra.run.smithi121.stdout:Verifying... ######################################## 2024-09-17T03:25:07.496 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing... ######################################## 2024-09-17T03:25:07.555 INFO:teuthology.orchestra.run.smithi121.stdout:Updating / installing... 2024-09-17T03:25:09.505 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-17T03:25:15.500 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-17T03:25:49.452 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi176.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-17T03:25:49.452 DEBUG:teuthology.orchestra.run.smithi176:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-17T03:25:49.540 INFO:teuthology.orchestra.run.smithi176.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:49.540 INFO:teuthology.orchestra.run.smithi176.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:49.540 INFO:teuthology.orchestra.run.smithi176.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:49.540 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:49.540 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-17T03:25:49.541 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-17T03:25:49.542 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-17T03:25:49.543 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-17T03:25:49.544 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-17T03:25:49.545 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-17T03:25:49.546 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-17T03:25:49.547 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-17T03:25:49.548 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-17T03:25:49.549 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-17T03:25:49.550 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-17T03:25:49.551 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-17T03:25:49.552 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-17T03:25:49.553 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-17T03:25:49.554 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-17T03:25:49.555 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-17T03:25:49.556 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-17T03:25:49.557 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-17T03:25:49.558 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-17T03:25:49.559 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-17T03:25:49.560 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-17T03:25:49.561 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-17T03:25:49.562 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-17T03:25:49.563 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-17T03:25:49.564 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-17T03:25:49.565 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-17T03:25:49.566 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-17T03:25:49.567 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-17T03:25:49.568 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-17T03:25:49.569 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-17T03:25:49.570 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-17T03:25:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-17T03:25:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-17T03:25:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-17T03:25:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-17T03:25:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-17T03:25:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-17T03:25:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-17T03:25:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-17T03:25:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-17T03:25:49.571 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-17T03:25:49.572 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-17T03:25:49.573 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-17T03:25:49.574 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-17T03:25:49.575 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-17T03:25:49.575 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-17T03:25:49.575 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-17T03:25:49.575 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-17T03:25:49.575 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-17T03:25:49.575 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-17T03:25:49.575 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-17T03:25:49.575 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-17T03:25:49.575 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-17T03:25:49.576 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-17T03:25:49.577 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-17T03:25:49.578 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-17T03:25:49.579 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-17T03:25:49.580 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-17T03:25:49.581 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-17T03:25:49.582 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-17T03:25:49.583 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-17T03:25:49.584 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-17T03:25:49.585 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-17T03:25:49.586 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-17T03:25:49.587 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-17T03:25:49.587 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-17T03:25:49.587 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-17T03:25:49.587 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-17T03:25:49.587 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-17T03:25:49.587 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-17T03:25:49.587 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-17T03:25:49.587 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-17T03:25:49.587 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-17T03:25:49.587 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-17T03:25:49.588 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-17T03:25:49.589 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-17T03:25:49.590 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-17T03:25:49.591 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-17T03:25:49.592 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-17T03:25:49.593 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-17T03:25:49.594 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-17T03:25:49.595 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-17T03:25:49.596 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-17T03:25:49.597 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-17T03:25:49.598 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-17T03:25:49.599 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-17T03:25:49.600 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-17T03:25:49.601 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-17T03:25:49.602 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-17T03:25:49.603 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-17T03:25:49.604 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-17T03:25:49.605 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-17T03:25:49.606 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-17T03:25:49.607 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-17T03:25:49.608 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-17T03:25:49.609 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-17T03:25:49.610 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-17T03:25:49.611 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-17T03:25:49.612 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-17T03:25:49.613 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-17T03:25:49.614 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-17T03:25:49.615 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-17T03:25:49.616 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-17T03:25:49.617 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-17T03:25:49.618 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-17T03:25:49.619 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-17T03:25:49.620 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-17T03:25:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-17T03:25:49.622 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-17T03:25:49.623 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-17T03:25:49.624 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-17T03:25:49.625 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-17T03:25:49.626 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-17T03:25:49.627 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-17T03:25:49.628 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-17T03:25:49.629 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-17T03:25:49.630 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-17T03:25:49.631 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-17T03:25:49.632 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-17T03:25:49.633 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-17T03:25:49.634 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-17T03:25:49.635 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-17T03:25:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-17T03:25:49.637 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-17T03:25:49.638 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-17T03:25:49.639 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-17T03:25:49.640 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-17T03:25:49.641 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-17T03:25:49.642 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-17T03:25:49.643 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-17T03:25:49.644 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-17T03:25:49.645 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-17T03:25:49.646 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-17T03:25:49.647 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-17T03:25:49.648 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-17T03:25:49.649 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-17T03:25:49.650 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-17T03:25:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-17T03:25:49.652 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-17T03:25:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-17T03:25:49.654 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-17T03:25:49.655 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-17T03:25:49.656 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-17T03:25:49.657 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-17T03:25:49.658 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-17T03:25:49.659 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-17T03:25:49.660 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-17T03:25:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-17T03:25:49.662 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-17T03:25:49.663 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-17T03:25:49.664 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-17T03:25:49.665 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-17T03:25:49.666 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-17T03:25:49.667 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-17T03:25:49.668 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-17T03:25:49.669 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-17T03:25:49.670 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-17T03:25:49.671 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-17T03:25:49.672 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-17T03:25:49.673 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-17T03:25:49.674 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-17T03:25:49.675 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-17T03:25:49.675 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-17T03:25:49.675 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-17T03:25:49.675 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-17T03:25:49.675 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-17T03:25:49.675 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-17T03:25:49.675 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-17T03:25:49.675 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-17T03:25:49.675 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-17T03:25:49.675 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-17T03:25:49.676 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-17T03:25:49.677 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-17T03:25:49.678 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-17T03:25:49.679 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-17T03:25:49.680 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-17T03:25:49.681 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-17T03:25:49.682 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-17T03:25:49.683 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-17T03:25:49.684 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-17T03:25:49.685 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-17T03:25:49.686 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-17T03:25:49.686 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-17T03:25:49.686 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-17T03:25:49.686 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-17T03:25:49.686 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-17T03:25:49.686 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-17T03:25:49.686 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-17T03:25:49.686 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-17T03:25:49.686 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T03:25:49.691 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:49.691 DEBUG:teuthology.orchestra.run.smithi176:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-17T03:25:49.715 INFO:teuthology.orchestra.run.smithi176.stdout:postinstall scriptlet (using /bin/sh): 2024-09-17T03:25:49.715 INFO:teuthology.orchestra.run.smithi176.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout:fi 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout:for file in vmlinuz System.map config; do 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout: fi 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout:done 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout:fi 2024-09-17T03:25:49.716 INFO:teuthology.orchestra.run.smithi176.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-17T03:25:49.717 INFO:teuthology.orchestra.run.smithi176.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:49.717 INFO:teuthology.orchestra.run.smithi176.stdout:fi 2024-09-17T03:25:49.717 INFO:teuthology.orchestra.run.smithi176.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-17T03:25:49.717 INFO:teuthology.orchestra.run.smithi176.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T03:25:49.717 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:49.717 INFO:teuthology.orchestra.run.smithi176.stdout:fi 2024-09-17T03:25:49.718 DEBUG:teuthology.orchestra.run.smithi176:> sudo rpm -qi grub2-tools 2024-09-17T03:25:49.792 INFO:teuthology.orchestra.run.smithi176.stdout:Name : grub2-tools 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Epoch : 1 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Version : 2.06 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Release : 82.el9 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: x86_64 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Group : Unspecified 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Size : 8274670 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:License : GPLv3+ 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Packager : builder@centos.org 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:Vendor : CentOS 2024-09-17T03:25:49.793 INFO:teuthology.orchestra.run.smithi176.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T03:25:49.794 INFO:teuthology.orchestra.run.smithi176.stdout:Summary : Support tools for GRUB. 2024-09-17T03:25:49.794 INFO:teuthology.orchestra.run.smithi176.stdout:Description : 2024-09-17T03:25:49.794 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:25:49.794 INFO:teuthology.orchestra.run.smithi176.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T03:25:49.794 INFO:teuthology.orchestra.run.smithi176.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T03:25:49.794 INFO:teuthology.orchestra.run.smithi176.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T03:25:49.794 INFO:teuthology.orchestra.run.smithi176.stdout:hardware devices. 2024-09-17T03:25:49.794 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:25:49.794 INFO:teuthology.orchestra.run.smithi176.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T03:25:49.795 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T03:25:49.795 INFO:teuthology.task.kernel:Updating grub on smithi176 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:49.795 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T03:25:50.410 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-09-17T03:25:51.809 INFO:teuthology.orchestra.run.smithi176.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T03:25:51.824 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-09-17T03:25:51.827 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-17T03:25:51.842 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.PhwxA1idno 2024-09-17T03:25:51.843 DEBUG:teuthology.orchestra.run.smithi176:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PhwxA1idno 2024-09-17T03:25:51.910 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.PhwxA1idno 2024-09-17T03:25:52.058 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.PhwxA1idno is 6KB 2024-09-17T03:25:52.107 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.PhwxA1idno 2024-09-17T03:25:52.121 DEBUG:teuthology.orchestra.run.smithi176:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T03:25:52.184 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T03:25:52.184 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T03:25:52.185 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T03:25:52.185 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-17T03:25:52.186 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:52.343 DEBUG:teuthology.orchestra.run.smithi176:> sudo shutdown -r now 2024-09-17T03:25:55.822 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-17T03:25:55.822 DEBUG:teuthology.orchestra.run.smithi121:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-17T03:25:55.906 INFO:teuthology.orchestra.run.smithi121.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:55.906 INFO:teuthology.orchestra.run.smithi121.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:55.906 INFO:teuthology.orchestra.run.smithi121.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:55.906 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:55.906 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-17T03:25:55.906 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-17T03:25:55.907 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-17T03:25:55.907 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-17T03:25:55.907 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-17T03:25:55.907 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-17T03:25:55.907 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-17T03:25:55.907 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-17T03:25:55.907 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-17T03:25:55.907 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-17T03:25:55.908 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-17T03:25:55.909 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-17T03:25:55.910 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-17T03:25:55.911 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-17T03:25:55.912 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-17T03:25:55.913 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-17T03:25:55.914 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-17T03:25:55.915 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-17T03:25:55.916 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-17T03:25:55.917 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-17T03:25:55.918 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-17T03:25:55.919 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-17T03:25:55.920 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-17T03:25:55.921 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-17T03:25:55.922 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-17T03:25:55.923 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-17T03:25:55.924 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-17T03:25:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-17T03:25:55.926 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-17T03:25:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-17T03:25:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-17T03:25:55.929 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-17T03:25:55.930 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-17T03:25:55.931 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-17T03:25:55.932 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-17T03:25:55.933 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-17T03:25:55.934 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-17T03:25:55.935 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-17T03:25:55.936 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-17T03:25:55.937 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-17T03:25:55.938 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-17T03:25:55.939 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-17T03:25:55.939 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-17T03:25:55.939 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-17T03:25:55.939 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-17T03:25:55.939 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-17T03:25:55.939 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-17T03:25:55.939 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-17T03:25:55.939 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-17T03:25:55.939 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-17T03:25:55.940 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-17T03:25:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-17T03:25:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-17T03:25:55.943 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-17T03:25:55.944 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-17T03:25:55.945 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-17T03:25:55.946 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-17T03:25:55.947 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-17T03:25:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-17T03:25:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-17T03:25:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-17T03:25:55.951 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-17T03:25:55.952 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-17T03:25:55.953 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-17T03:25:55.954 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-17T03:25:55.954 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-17T03:25:55.954 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-17T03:25:55.954 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-17T03:25:55.954 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-17T03:25:55.954 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-17T03:25:55.954 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-17T03:25:55.955 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-17T03:25:55.956 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-17T03:25:55.957 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-17T03:25:55.958 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-17T03:25:55.959 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-17T03:25:55.960 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-17T03:25:55.961 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-17T03:25:55.962 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-17T03:25:55.963 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-17T03:25:55.964 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-17T03:25:55.965 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-17T03:25:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-17T03:25:55.967 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-17T03:25:55.968 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-17T03:25:55.969 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-17T03:25:55.970 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-17T03:25:55.971 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-17T03:25:55.972 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-17T03:25:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-17T03:25:55.974 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-17T03:25:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-17T03:25:55.976 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-17T03:25:55.977 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-17T03:25:55.978 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-17T03:25:55.979 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-17T03:25:55.980 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-17T03:25:55.981 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-17T03:25:55.982 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-17T03:25:55.983 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-17T03:25:55.984 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-17T03:25:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-17T03:25:55.986 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-17T03:25:55.987 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-17T03:25:55.988 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-17T03:25:55.989 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-17T03:25:55.990 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-17T03:25:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-17T03:25:55.992 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-17T03:25:55.993 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-17T03:25:55.994 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-17T03:25:55.995 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-17T03:25:55.996 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-17T03:25:55.997 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-17T03:25:55.998 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-17T03:25:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-17T03:25:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-17T03:25:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-17T03:25:56.002 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-17T03:25:56.003 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-17T03:25:56.004 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-17T03:25:56.005 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-17T03:25:56.006 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-17T03:25:56.007 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-17T03:25:56.008 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-17T03:25:56.009 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-17T03:25:56.010 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-17T03:25:56.011 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-17T03:25:56.012 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-17T03:25:56.013 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-17T03:25:56.014 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-17T03:25:56.015 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-17T03:25:56.016 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-17T03:25:56.017 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-17T03:25:56.018 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-17T03:25:56.019 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-17T03:25:56.020 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-17T03:25:56.021 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-17T03:25:56.022 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-17T03:25:56.023 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-17T03:25:56.024 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-17T03:25:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-17T03:25:56.026 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-17T03:25:56.027 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-17T03:25:56.028 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-17T03:25:56.029 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-17T03:25:56.030 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-17T03:25:56.031 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-17T03:25:56.032 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-17T03:25:56.033 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-17T03:25:56.034 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-17T03:25:56.035 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-17T03:25:56.036 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-17T03:25:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-17T03:25:56.038 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-17T03:25:56.039 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-17T03:25:56.039 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-17T03:25:56.039 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-17T03:25:56.039 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-17T03:25:56.039 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-17T03:25:56.039 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-17T03:25:56.039 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-17T03:25:56.039 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-17T03:25:56.039 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-17T03:25:56.039 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-17T03:25:56.040 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-17T03:25:56.041 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-17T03:25:56.042 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-17T03:25:56.043 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-17T03:25:56.044 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-17T03:25:56.045 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-17T03:25:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-17T03:25:56.047 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-17T03:25:56.048 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-17T03:25:56.049 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-17T03:25:56.050 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-17T03:25:56.051 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-17T03:25:56.051 INFO:teuthology.orchestra.run.smithi121.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T03:25:56.054 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:56.054 DEBUG:teuthology.orchestra.run.smithi121:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-17T03:25:56.078 INFO:teuthology.orchestra.run.smithi121.stdout:postinstall scriptlet (using /bin/sh): 2024-09-17T03:25:56.078 INFO:teuthology.orchestra.run.smithi121.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T03:25:56.078 INFO:teuthology.orchestra.run.smithi121.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T03:25:56.078 INFO:teuthology.orchestra.run.smithi121.stdout:fi 2024-09-17T03:25:56.078 INFO:teuthology.orchestra.run.smithi121.stdout:for file in vmlinuz System.map config; do 2024-09-17T03:25:56.078 INFO:teuthology.orchestra.run.smithi121.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-17T03:25:56.078 INFO:teuthology.orchestra.run.smithi121.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:25:56.078 INFO:teuthology.orchestra.run.smithi121.stdout: fi 2024-09-17T03:25:56.078 INFO:teuthology.orchestra.run.smithi121.stdout:done 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout:fi 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout:fi 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:56.079 INFO:teuthology.orchestra.run.smithi121.stdout:fi 2024-09-17T03:25:56.080 DEBUG:teuthology.orchestra.run.smithi121:> sudo rpm -qi grub2-tools 2024-09-17T03:25:56.161 INFO:teuthology.orchestra.run.smithi121.stdout:Name : grub2-tools 2024-09-17T03:25:56.161 INFO:teuthology.orchestra.run.smithi121.stdout:Epoch : 1 2024-09-17T03:25:56.161 INFO:teuthology.orchestra.run.smithi121.stdout:Version : 2.06 2024-09-17T03:25:56.161 INFO:teuthology.orchestra.run.smithi121.stdout:Release : 82.el9 2024-09-17T03:25:56.161 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: x86_64 2024-09-17T03:25:56.161 INFO:teuthology.orchestra.run.smithi121.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:Group : Unspecified 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:Size : 8274670 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:License : GPLv3+ 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:Packager : builder@centos.org 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:Vendor : CentOS 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:Summary : Support tools for GRUB. 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout:Description : 2024-09-17T03:25:56.162 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:25:56.163 INFO:teuthology.orchestra.run.smithi121.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T03:25:56.163 INFO:teuthology.orchestra.run.smithi121.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T03:25:56.163 INFO:teuthology.orchestra.run.smithi121.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T03:25:56.163 INFO:teuthology.orchestra.run.smithi121.stdout:hardware devices. 2024-09-17T03:25:56.163 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:25:56.163 INFO:teuthology.orchestra.run.smithi121.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T03:25:56.164 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T03:25:56.164 INFO:teuthology.task.kernel:Updating grub on smithi121 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:56.164 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T03:25:56.705 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2024-09-17T03:25:58.031 INFO:teuthology.orchestra.run.smithi121.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T03:25:58.063 INFO:teuthology.orchestra.run.smithi121.stderr:done 2024-09-17T03:25:58.065 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-09-17T03:25:58.080 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.pgBLSTWAfD 2024-09-17T03:25:58.081 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pgBLSTWAfD 2024-09-17T03:25:58.150 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.pgBLSTWAfD 2024-09-17T03:25:58.289 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.pgBLSTWAfD is 6KB 2024-09-17T03:25:58.339 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.pgBLSTWAfD 2024-09-17T03:25:58.354 DEBUG:teuthology.orchestra.run.smithi121:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T03:25:58.423 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T03:25:58.423 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T03:25:58.423 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T03:25:58.424 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-17T03:25:58.425 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:25:58.584 DEBUG:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2024-09-17T03:26:22.370 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T03:26:22.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T03:26:22.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:26:28.593 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T03:26:28.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-17T03:26:28.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:26:40.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-17T03:26:47.101 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-09-17T03:26:49.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T03:26:49.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:26:52.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-17T03:26:56.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-17T03:26:56.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:26:59.165 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-09-17T03:27:04.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T03:27:04.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:27:11.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-17T03:27:11.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:27:23.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-17T03:27:38.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T03:27:38.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:27:38.640 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-17T03:27:39.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T03:27:39.129 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-17T03:27:39.130 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-17T03:27:39.164 INFO:teuthology.orchestra.run.smithi176.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:27:39.165 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:27:39.165 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T03:27:39.165 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T03:27:40.168 DEBUG:teuthology.parallel:result is None 2024-09-17T03:27:42.996 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-17T03:27:43.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-17T03:27:43.672 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-17T03:27:43.673 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-09-17T03:27:43.706 INFO:teuthology.orchestra.run.smithi121.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:27:43.707 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T03:27:43.707 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T03:27:43.707 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T03:27:44.710 DEBUG:teuthology.parallel:result is None 2024-09-17T03:27:44.710 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T03:27:44.716 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T03:27:44.717 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T03:27:44.721 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T03:27:44.759 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T03:27:44.787 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T03:27:44.795 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T03:27:44.795 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T03:27:44.799 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T03:27:44.850 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T03:27:44.856 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T03:27:44.856 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T03:27:44.860 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T03:27:44.986 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:27:45.053 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:27:45.086 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:27:45.105 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:27:45.110 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T03:27:45.116 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T03:27:45.117 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T03:27:45.120 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T03:27:45.177 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T03:27:45.186 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T03:27:45.186 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T03:27:45.190 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T03:27:45.225 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:27:45.323 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:27:45.400 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:27:45.464 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:27:45.533 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:27:45.533 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T03:27:45.587 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:27:45.652 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:27:45.732 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:27:45.792 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:27:45.868 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:27:45.868 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T03:27:45.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-09-17T03:27:45.928 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-09-17T03:27:46.009 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:27:46.077 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:27:46.420 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T03:27:46.428 INFO:teuthology.task.internal:Starting timer... 2024-09-17T03:27:46.428 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T03:27:46.438 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T03:27:46.447 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-09-17T03:27:46.532 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-09-17T03:27:46.536 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2024-09-17T03:27:46.615 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2024-09-17T03:27:46.618 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T03:27:46.619 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-09-17T03:27:46.667 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-09-17T03:27:46.667 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2024-09-17T03:27:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2024-09-17T03:27:46.710 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi121.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2024-09-17T03:27:46.710 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:27:46.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:27:46.769 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:27:46.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:27:46.826 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T03:27:46.827 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-09-17T03:27:46.886 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2024-09-17T03:27:46.950 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T03:27:46.959 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T03:27:46.974 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T03:27:46.975 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi121.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T03:32:26.640 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-09-17T03:32:26.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-17T03:32:26.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:32:26.749 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-17T03:32:26.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-17T03:32:26.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T03:32:26.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:32:26.944 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-17T03:32:27.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-17T03:32:27.059 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T03:32:27.070 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T03:32:27.071 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T03:32:27.071 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:32:27.076 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T03:32:27.076 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:32:27.133 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T03:32:27.160 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T03:32:27.162 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T03:32:27.190 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T03:32:27.213 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-09-17T03:32:27.237 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-09-17T03:32:27.241 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2024-09-17T03:32:27.264 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2024-09-17T03:32:27.266 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T03:32:27.293 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T03:32:27.295 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T03:32:27.322 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T03:32:27.403 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:32:27.409 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:32:27.410 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-17T03:32:27.410 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:32:27.410 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:32:27.410 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:32:27.410 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:32:27.413 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:32:27.420 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:32:27.420 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-17T03:32:27.420 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:32:27.420 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:32:27.420 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:32:27.420 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:32:27.421 INFO:teuthology.run_tasks:Running task install... 2024-09-17T03:32:27.430 DEBUG:teuthology.task.install:project ceph 2024-09-17T03:32:27.430 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T03:32:27.430 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T03:32:27.430 INFO:teuthology.task.install:Using flavor: default 2024-09-17T03:32:27.436 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T03:32:27.436 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T03:32:27.437 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T03:32:27.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:32:27.440 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T03:32:27.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:32:27.579 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T03:32:27.580 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T03:32:27.590 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T03:32:27.590 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T03:32:27.692 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T03:32:27.692 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:32:27.692 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T03:32:27.701 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T03:32:27.701 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:32:27.701 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T03:32:27.748 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T03:32:27.749 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T03:32:27.757 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T03:32:27.758 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T03:32:27.847 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T03:32:27.854 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T03:32:27.925 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T03:32:27.932 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T03:32:27.979 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-09-17T03:32:27.982 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-09-17T03:32:27.986 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2024-09-17T03:32:27.989 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2024-09-17T03:32:28.262 INFO:teuthology.orchestra.run.smithi121.stdout:45 files removed 2024-09-17T03:32:28.286 INFO:teuthology.orchestra.run.smithi176.stdout:45 files removed 2024-09-17T03:32:28.295 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T03:32:28.319 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T03:32:28.977 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 293 kB/s | 84 kB 00:00 2024-09-17T03:32:29.001 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 289 kB/s | 84 kB 00:00 2024-09-17T03:32:29.286 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 92 kB/s | 24 kB 00:00 2024-09-17T03:32:29.301 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-17T03:32:29.570 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-17T03:32:29.585 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-17T03:32:31.461 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.3 MB 00:01 2024-09-17T03:32:32.636 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.3 MB 00:03 2024-09-17T03:32:35.878 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 20 MB 00:03 2024-09-17T03:32:36.577 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-09-17T03:32:41.371 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 6.5 MB 00:00 2024-09-17T03:32:41.637 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-17T03:32:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 19 kB 00:00 2024-09-17T03:32:43.546 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-17T03:32:44.386 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-17T03:32:45.336 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-17T03:32:50.773 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T03:32:51.655 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-17T03:32:53.155 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:32:53.156 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:32:53.170 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T03:32:53.171 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T03:32:53.172 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T03:32:53.173 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T03:32:53.175 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T03:32:53.178 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T03:32:53.179 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T03:32:53.246 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-17T03:32:53.284 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-09-17T03:32:53.284 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-17T03:32:53.284 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-09-17T03:32:53.284 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T03:32:53.285 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T03:32:53.286 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T03:32:53.287 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T03:32:53.288 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T03:32:53.289 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T03:32:53.290 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T03:32:53.291 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T03:32:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T03:32:53.293 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T03:32:53.294 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T03:32:53.295 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T03:32:53.296 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout:Install 149 Packages 2024-09-17T03:32:53.297 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 8 Packages 2024-09-17T03:32:53.298 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:32:53.298 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 228 M 2024-09-17T03:32:53.298 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-17T03:32:53.649 INFO:teuthology.orchestra.run.smithi121.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 56 kB/s | 6.6 kB 00:00 2024-09-17T03:32:53.824 INFO:teuthology.orchestra.run.smithi121.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-17T03:32:53.900 INFO:teuthology.orchestra.run.smithi121.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.9 MB/s | 148 kB 00:00 2024-09-17T03:32:53.993 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:32:53.994 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:32:54.000 INFO:teuthology.orchestra.run.smithi121.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-17T03:32:54.005 INFO:teuthology.orchestra.run.smithi176.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T03:32:54.006 INFO:teuthology.orchestra.run.smithi176.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T03:32:54.007 INFO:teuthology.orchestra.run.smithi176.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T03:32:54.007 INFO:teuthology.orchestra.run.smithi176.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T03:32:54.009 INFO:teuthology.orchestra.run.smithi176.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T03:32:54.012 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T03:32:54.012 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T03:32:54.077 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-17T03:32:54.091 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-17T03:32:54.092 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-17T03:32:54.092 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-17T03:32:54.092 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-17T03:32:54.092 INFO:teuthology.orchestra.run.smithi176.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T03:32:54.092 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T03:32:54.092 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T03:32:54.092 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T03:32:54.092 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T03:32:54.092 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T03:32:54.092 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T03:32:54.093 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T03:32:54.093 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T03:32:54.093 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T03:32:54.093 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T03:32:54.093 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T03:32:54.093 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T03:32:54.093 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T03:32:54.093 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T03:32:54.093 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T03:32:54.094 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T03:32:54.094 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T03:32:54.094 INFO:teuthology.orchestra.run.smithi176.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T03:32:54.094 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T03:32:54.094 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T03:32:54.094 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T03:32:54.094 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T03:32:54.094 INFO:teuthology.orchestra.run.smithi176.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T03:32:54.094 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T03:32:54.095 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-17T03:32:54.096 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T03:32:54.097 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T03:32:54.098 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T03:32:54.098 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T03:32:54.098 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T03:32:54.098 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T03:32:54.098 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T03:32:54.098 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T03:32:54.098 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T03:32:54.098 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T03:32:54.098 INFO:teuthology.orchestra.run.smithi176.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T03:32:54.099 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T03:32:54.100 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T03:32:54.101 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T03:32:54.102 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T03:32:54.103 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T03:32:54.104 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T03:32:54.105 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T03:32:54.105 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T03:32:54.105 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T03:32:54.105 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T03:32:54.105 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T03:32:54.105 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T03:32:54.105 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T03:32:54.105 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T03:32:54.106 INFO:teuthology.orchestra.run.smithi176.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T03:32:54.106 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T03:32:54.106 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T03:32:54.106 INFO:teuthology.orchestra.run.smithi176.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T03:32:54.106 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T03:32:54.106 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T03:32:54.106 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2024-09-17T03:32:54.106 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T03:32:54.107 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:32:54.107 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-17T03:32:54.107 INFO:teuthology.orchestra.run.smithi176.stdout:======================================================================================= 2024-09-17T03:32:54.107 INFO:teuthology.orchestra.run.smithi176.stdout:Install 149 Packages 2024-09-17T03:32:54.107 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 8 Packages 2024-09-17T03:32:54.107 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:32:54.108 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 228 M 2024-09-17T03:32:54.108 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-17T03:32:54.133 INFO:teuthology.orchestra.run.smithi121.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 9.8 MB/s | 2.3 MB 00:00 2024-09-17T03:32:54.175 INFO:teuthology.orchestra.run.smithi121.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-09-17T03:32:54.676 INFO:teuthology.orchestra.run.smithi121.stdout:(7/157): ceph-common-19.3.0-4989.gce1b342b.el9. 17 MB/s | 20 MB 00:01 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi121.stdout:(8/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 7.9 MB/s | 5.0 MB 00:00 2024-09-17T03:32:54.826 INFO:teuthology.orchestra.run.smithi121.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 378 kB/s | 25 kB 00:00 2024-09-17T03:32:55.109 INFO:teuthology.orchestra.run.smithi176.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-09-17T03:32:55.292 INFO:teuthology.orchestra.run.smithi176.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-17T03:32:55.337 INFO:teuthology.orchestra.run.smithi121.stdout:(10/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 15 MB/s | 18 MB 00:01 2024-09-17T03:32:55.367 INFO:teuthology.orchestra.run.smithi176.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.9 MB/s | 148 kB 00:00 2024-09-17T03:32:55.485 INFO:teuthology.orchestra.run.smithi121.stdout:(11/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 13 MB/s | 10 MB 00:00 2024-09-17T03:32:55.510 INFO:teuthology.orchestra.run.smithi121.stdout:(12/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 1.3 MB/s | 225 kB 00:00 2024-09-17T03:32:55.561 INFO:teuthology.orchestra.run.smithi121.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 359 kB/s | 27 kB 00:00 2024-09-17T03:32:55.586 INFO:teuthology.orchestra.run.smithi121.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 421 kB/s | 32 kB 00:00 2024-09-17T03:32:55.601 INFO:teuthology.orchestra.run.smithi176.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 6.7 MB/s | 5.5 MB 00:00 2024-09-17T03:32:55.651 INFO:teuthology.orchestra.run.smithi176.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 8.1 MB/s | 2.3 MB 00:00 2024-09-17T03:32:55.661 INFO:teuthology.orchestra.run.smithi121.stdout:(15/157): libcephsqlite-19.3.0-4989.gce1b342b.e 2.1 MB/s | 159 kB 00:00 2024-09-17T03:32:55.720 INFO:teuthology.orchestra.run.smithi121.stdout:(16/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 4.7 MB/s | 766 kB 00:00 2024-09-17T03:32:55.820 INFO:teuthology.orchestra.run.smithi121.stdout:(17/157): libradosstriper1-19.3.0-4989.gce1b342 5.0 MB/s | 507 kB 00:00 2024-09-17T03:32:56.187 INFO:teuthology.orchestra.run.smithi121.stdout:(18/157): librados-devel-19.3.0-4989.gce1b342b. 241 kB/s | 127 kB 00:00 2024-09-17T03:32:56.254 INFO:teuthology.orchestra.run.smithi121.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 680 kB/s | 45 kB 00:00 2024-09-17T03:32:56.293 INFO:teuthology.orchestra.run.smithi176.stdout:(6/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 7.7 MB/s | 5.0 MB 00:00 2024-09-17T03:32:56.321 INFO:teuthology.orchestra.run.smithi121.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 2.1 MB/s | 143 kB 00:00 2024-09-17T03:32:56.335 INFO:teuthology.orchestra.run.smithi176.stdout:(7/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-09-17T03:32:56.463 INFO:teuthology.orchestra.run.smithi121.stdout:(21/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 8.2 MB/s | 5.3 MB 00:00 2024-09-17T03:32:56.488 INFO:teuthology.orchestra.run.smithi121.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 972 kB/s | 162 kB 00:00 2024-09-17T03:32:56.572 INFO:teuthology.orchestra.run.smithi121.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 2.9 MB/s | 321 kB 00:00 2024-09-17T03:32:56.664 INFO:teuthology.orchestra.run.smithi121.stdout:(24/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.1 MB/s | 99 kB 00:00 2024-09-17T03:32:56.739 INFO:teuthology.orchestra.run.smithi121.stdout:(25/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.1 MB/s | 86 kB 00:00 2024-09-17T03:32:56.794 INFO:teuthology.orchestra.run.smithi176.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 9.9 MB/s | 20 MB 00:02 2024-09-17T03:32:56.894 INFO:teuthology.orchestra.run.smithi176.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 252 kB/s | 25 kB 00:00 2024-09-17T03:32:57.281 INFO:teuthology.orchestra.run.smithi121.stdout:(26/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 5.7 MB/s | 3.1 MB 00:00 2024-09-17T03:32:57.373 INFO:teuthology.orchestra.run.smithi121.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 1.8 MB/s | 170 kB 00:00 2024-09-17T03:32:57.456 INFO:teuthology.orchestra.run.smithi121.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4989.g 411 kB/s | 34 kB 00:00 2024-09-17T03:32:57.482 INFO:teuthology.orchestra.run.smithi121.stdout:(29/157): python3-rbd-19.3.0-4989.gce1b342b.el9 307 kB/s | 305 kB 00:00 2024-09-17T03:32:57.486 INFO:teuthology.orchestra.run.smithi176.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 9.1 MB/s | 10 MB 00:01 2024-09-17T03:32:57.532 INFO:teuthology.orchestra.run.smithi121.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 2.0 MB/s | 154 kB 00:00 2024-09-17T03:32:57.586 INFO:teuthology.orchestra.run.smithi176.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 2.2 MB/s | 225 kB 00:00 2024-09-17T03:32:57.678 INFO:teuthology.orchestra.run.smithi176.stdout:(12/157): cephfs-shell-19.3.0-4989.gce1b342b.el 295 kB/s | 27 kB 00:00 2024-09-17T03:32:57.770 INFO:teuthology.orchestra.run.smithi176.stdout:(13/157): libcephfs-devel-19.3.0-4989.gce1b342b 346 kB/s | 32 kB 00:00 2024-09-17T03:32:58.029 INFO:teuthology.orchestra.run.smithi176.stdout:(14/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 2.9 MB/s | 766 kB 00:00 2024-09-17T03:32:58.129 INFO:teuthology.orchestra.run.smithi176.stdout:(15/157): libcephsqlite-19.3.0-4989.gce1b342b.e 1.6 MB/s | 159 kB 00:00 2024-09-17T03:32:58.221 INFO:teuthology.orchestra.run.smithi176.stdout:(16/157): librados-devel-19.3.0-4989.gce1b342b. 1.4 MB/s | 127 kB 00:00 2024-09-17T03:32:58.388 INFO:teuthology.orchestra.run.smithi176.stdout:(17/157): libradosstriper1-19.3.0-4989.gce1b342 3.0 MB/s | 507 kB 00:00 2024-09-17T03:32:58.907 INFO:teuthology.orchestra.run.smithi121.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 5.4 MB/s | 7.4 MB 00:01 2024-09-17T03:32:59.016 INFO:teuthology.orchestra.run.smithi121.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 2.6 MB/s | 291 kB 00:00 2024-09-17T03:32:59.116 INFO:teuthology.orchestra.run.smithi121.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 493 kB/s | 49 kB 00:00 2024-09-17T03:32:59.208 INFO:teuthology.orchestra.run.smithi121.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4989.gc 179 kB/s | 16 kB 00:00 2024-09-17T03:32:59.280 INFO:teuthology.orchestra.run.smithi176.stdout:(18/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 5.9 MB/s | 5.3 MB 00:00 2024-09-17T03:32:59.300 INFO:teuthology.orchestra.run.smithi121.stdout:(35/157): ceph-volume-19.3.0-4989.gce1b342b.el9 3.0 MB/s | 285 kB 00:00 2024-09-17T03:32:59.433 INFO:teuthology.orchestra.run.smithi121.stdout:(36/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 5.8 MB/s | 784 kB 00:00 2024-09-17T03:32:59.455 INFO:teuthology.orchestra.run.smithi176.stdout:(19/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 5.6 MB/s | 18 MB 00:03 2024-09-17T03:32:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:(20/157): python3-ceph-argparse-19.3.0-4989.gce 226 kB/s | 45 kB 00:00 2024-09-17T03:32:59.531 INFO:teuthology.orchestra.run.smithi176.stdout:(21/157): python3-ceph-common-19.3.0-4989.gce1b 1.9 MB/s | 143 kB 00:00 2024-09-17T03:32:59.556 INFO:teuthology.orchestra.run.smithi176.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 2.1 MB/s | 162 kB 00:00 2024-09-17T03:32:59.631 INFO:teuthology.orchestra.run.smithi176.stdout:(23/157): python3-rbd-19.3.0-4989.gce1b342b.el9 4.0 MB/s | 305 kB 00:00 2024-09-17T03:32:59.664 INFO:teuthology.orchestra.run.smithi176.stdout:(24/157): python3-rados-19.3.0-4989.gce1b342b.e 2.3 MB/s | 321 kB 00:00 2024-09-17T03:32:59.681 INFO:teuthology.orchestra.run.smithi176.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.9 MB/s | 99 kB 00:00 2024-09-17T03:32:59.723 INFO:teuthology.orchestra.run.smithi176.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-17T03:32:59.815 INFO:teuthology.orchestra.run.smithi176.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 1.8 MB/s | 170 kB 00:00 2024-09-17T03:32:59.874 INFO:teuthology.orchestra.run.smithi176.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4989.g 590 kB/s | 34 kB 00:00 2024-09-17T03:32:59.875 INFO:teuthology.orchestra.run.smithi121.stdout:(37/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 7.9 MB/s | 40 MB 00:05 2024-09-17T03:32:59.892 INFO:teuthology.orchestra.run.smithi121.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 40 kB/s | 18 kB 00:00 2024-09-17T03:32:59.957 INFO:teuthology.orchestra.run.smithi176.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 1.8 MB/s | 154 kB 00:00 2024-09-17T03:33:00.026 INFO:teuthology.orchestra.run.smithi121.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 533 kB/s | 80 kB 00:00 2024-09-17T03:33:00.033 INFO:teuthology.orchestra.run.smithi176.stdout:(30/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 8.8 MB/s | 3.1 MB 00:00 2024-09-17T03:33:00.110 INFO:teuthology.orchestra.run.smithi121.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-17T03:33:00.143 INFO:teuthology.orchestra.run.smithi121.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-17T03:33:00.177 INFO:teuthology.orchestra.run.smithi121.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-17T03:33:00.227 INFO:teuthology.orchestra.run.smithi121.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-17T03:33:00.261 INFO:teuthology.orchestra.run.smithi121.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-17T03:33:00.278 INFO:teuthology.orchestra.run.smithi121.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-17T03:33:00.312 INFO:teuthology.orchestra.run.smithi121.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-17T03:33:00.337 INFO:teuthology.orchestra.run.smithi121.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-17T03:33:00.471 INFO:teuthology.orchestra.run.smithi121.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 689 kB 00:00 2024-09-17T03:33:00.529 INFO:teuthology.orchestra.run.smithi121.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-17T03:33:00.571 INFO:teuthology.orchestra.run.smithi121.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-17T03:33:00.588 INFO:teuthology.orchestra.run.smithi121.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-17T03:33:00.673 INFO:teuthology.orchestra.run.smithi121.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-17T03:33:00.697 INFO:teuthology.orchestra.run.smithi121.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-17T03:33:00.730 INFO:teuthology.orchestra.run.smithi121.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 555 kB/s | 18 kB 00:00 2024-09-17T03:33:00.789 INFO:teuthology.orchestra.run.smithi121.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-09-17T03:33:00.806 INFO:teuthology.orchestra.run.smithi121.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-17T03:33:00.831 INFO:teuthology.orchestra.run.smithi121.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 4.0 MB/s | 171 kB 00:00 2024-09-17T03:33:00.857 INFO:teuthology.orchestra.run.smithi121.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-17T03:33:00.874 INFO:teuthology.orchestra.run.smithi121.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-17T03:33:00.908 INFO:teuthology.orchestra.run.smithi121.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-09-17T03:33:00.941 INFO:teuthology.orchestra.run.smithi121.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-17T03:33:00.958 INFO:teuthology.orchestra.run.smithi121.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 490 kB/s | 24 kB 00:00 2024-09-17T03:33:00.975 INFO:teuthology.orchestra.run.smithi121.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-17T03:33:00.992 INFO:teuthology.orchestra.run.smithi176.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 7.7 MB/s | 7.4 MB 00:00 2024-09-17T03:33:01.025 INFO:teuthology.orchestra.run.smithi121.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-17T03:33:01.050 INFO:teuthology.orchestra.run.smithi121.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-17T03:33:01.075 INFO:teuthology.orchestra.run.smithi176.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 3.4 MB/s | 291 kB 00:00 2024-09-17T03:33:01.076 INFO:teuthology.orchestra.run.smithi121.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-17T03:33:01.159 INFO:teuthology.orchestra.run.smithi176.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 593 kB/s | 49 kB 00:00 2024-09-17T03:33:01.184 INFO:teuthology.orchestra.run.smithi121.stdout:(67/157): openblas-openmp-0.3.26-2.el9.x86_64.r 37 MB/s | 4.9 MB 00:00 2024-09-17T03:33:01.234 INFO:teuthology.orchestra.run.smithi176.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4989.gc 219 kB/s | 16 kB 00:00 2024-09-17T03:33:01.268 INFO:teuthology.orchestra.run.smithi121.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-17T03:33:01.310 INFO:teuthology.orchestra.run.smithi121.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-17T03:33:01.344 INFO:teuthology.orchestra.run.smithi121.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-17T03:33:01.369 INFO:teuthology.orchestra.run.smithi121.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-17T03:33:01.428 INFO:teuthology.orchestra.run.smithi121.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-17T03:33:01.511 INFO:teuthology.orchestra.run.smithi121.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-09-17T03:33:01.536 INFO:teuthology.orchestra.run.smithi121.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 807 kB/s | 87 kB 00:00 2024-09-17T03:33:01.595 INFO:teuthology.orchestra.run.smithi121.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-17T03:33:01.618 INFO:teuthology.orchestra.run.smithi176.stdout:(35/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 8.4 MB/s | 40 MB 00:04 2024-09-17T03:33:01.643 INFO:teuthology.orchestra.run.smithi176.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 698 kB/s | 285 kB 00:00 2024-09-17T03:33:01.687 INFO:teuthology.orchestra.run.smithi121.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-09-17T03:33:01.712 INFO:teuthology.orchestra.run.smithi121.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-17T03:33:01.737 INFO:teuthology.orchestra.run.smithi121.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-17T03:33:01.763 INFO:teuthology.orchestra.run.smithi121.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-17T03:33:01.768 INFO:teuthology.orchestra.run.smithi176.stdout:(37/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 146 kB/s | 18 kB 00:00 2024-09-17T03:33:01.788 INFO:teuthology.orchestra.run.smithi121.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-17T03:33:01.810 INFO:teuthology.orchestra.run.smithi176.stdout:(38/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 4.0 MB/s | 784 kB 00:00 2024-09-17T03:33:01.813 INFO:teuthology.orchestra.run.smithi121.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-17T03:33:01.830 INFO:teuthology.orchestra.run.smithi121.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 831 kB/s | 35 kB 00:00 2024-09-17T03:33:01.872 INFO:teuthology.orchestra.run.smithi121.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-17T03:33:01.919 INFO:teuthology.orchestra.run.smithi176.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-17T03:33:01.964 INFO:teuthology.orchestra.run.smithi121.stdout:(84/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-09-17T03:33:01.990 INFO:teuthology.orchestra.run.smithi121.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-17T03:33:02.003 INFO:teuthology.orchestra.run.smithi176.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 191 kB 00:00 2024-09-17T03:33:02.015 INFO:teuthology.orchestra.run.smithi121.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-17T03:33:02.032 INFO:teuthology.orchestra.run.smithi121.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-17T03:33:02.036 INFO:teuthology.orchestra.run.smithi176.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-17T03:33:02.057 INFO:teuthology.orchestra.run.smithi121.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 6.2 MB/s | 269 kB 00:00 2024-09-17T03:33:02.070 INFO:teuthology.orchestra.run.smithi176.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-17T03:33:02.083 INFO:teuthology.orchestra.run.smithi121.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T03:33:02.108 INFO:teuthology.orchestra.run.smithi121.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-17T03:33:02.120 INFO:teuthology.orchestra.run.smithi176.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-17T03:33:02.125 INFO:teuthology.orchestra.run.smithi121.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-17T03:33:02.154 INFO:teuthology.orchestra.run.smithi176.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-17T03:33:02.173 INFO:teuthology.orchestra.run.smithi121.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 831 kB/s | 54 kB 00:00 2024-09-17T03:33:02.179 INFO:teuthology.orchestra.run.smithi176.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-17T03:33:02.196 INFO:teuthology.orchestra.run.smithi176.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-17T03:33:02.209 INFO:teuthology.orchestra.run.smithi121.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-17T03:33:02.238 INFO:teuthology.orchestra.run.smithi176.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-17T03:33:02.242 INFO:teuthology.orchestra.run.smithi121.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-17T03:33:02.272 INFO:teuthology.orchestra.run.smithi176.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 9.0 MB/s | 689 kB 00:00 2024-09-17T03:33:02.284 INFO:teuthology.orchestra.run.smithi121.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-17T03:33:02.313 INFO:teuthology.orchestra.run.smithi176.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-17T03:33:02.355 INFO:teuthology.orchestra.run.smithi176.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 7.9 MB/s | 943 kB 00:00 2024-09-17T03:33:02.381 INFO:teuthology.orchestra.run.smithi176.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-17T03:33:02.414 INFO:teuthology.orchestra.run.smithi176.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-09-17T03:33:02.435 INFO:teuthology.orchestra.run.smithi121.stdout:(96/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 2.9 MB/s | 14 MB 00:04 2024-09-17T03:33:02.439 INFO:teuthology.orchestra.run.smithi176.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 563 kB/s | 33 kB 00:00 2024-09-17T03:33:02.452 INFO:teuthology.orchestra.run.smithi121.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 215 kB/s | 36 kB 00:00 2024-09-17T03:33:02.494 INFO:teuthology.orchestra.run.smithi121.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-17T03:33:02.498 INFO:teuthology.orchestra.run.smithi176.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 314 kB/s | 18 kB 00:00 2024-09-17T03:33:02.557 INFO:teuthology.orchestra.run.smithi176.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-09-17T03:33:02.582 INFO:teuthology.orchestra.run.smithi176.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-17T03:33:02.607 INFO:teuthology.orchestra.run.smithi176.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.4 MB/s | 171 kB 00:00 2024-09-17T03:33:02.633 INFO:teuthology.orchestra.run.smithi176.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-17T03:33:02.650 INFO:teuthology.orchestra.run.smithi176.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-17T03:33:02.660 INFO:teuthology.orchestra.run.smithi121.stdout:(99/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-17T03:33:02.677 INFO:teuthology.orchestra.run.smithi121.stdout:(100/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 196 kB/s | 47 kB 00:00 2024-09-17T03:33:02.692 INFO:teuthology.orchestra.run.smithi176.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-17T03:33:02.694 INFO:teuthology.orchestra.run.smithi121.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 289 kB/s | 58 kB 00:00 2024-09-17T03:33:02.750 INFO:teuthology.orchestra.run.smithi121.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-17T03:33:02.770 INFO:teuthology.orchestra.run.smithi121.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 596 kB/s | 45 kB 00:00 2024-09-17T03:33:02.787 INFO:teuthology.orchestra.run.smithi121.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 583 kB/s | 64 kB 00:00 2024-09-17T03:33:02.834 INFO:teuthology.orchestra.run.smithi176.stdout:(61/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 4.9 MB/s | 14 MB 00:02 2024-09-17T03:33:02.854 INFO:teuthology.orchestra.run.smithi121.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-17T03:33:02.859 INFO:teuthology.orchestra.run.smithi176.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 147 kB/s | 24 kB 00:00 2024-09-17T03:33:02.870 INFO:teuthology.orchestra.run.smithi121.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 186 kB/s | 22 kB 00:00 2024-09-17T03:33:02.893 INFO:teuthology.orchestra.run.smithi176.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 2.3 MB/s | 581 kB 00:00 2024-09-17T03:33:02.913 INFO:teuthology.orchestra.run.smithi121.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 5.1 MB/s | 308 kB 00:00 2024-09-17T03:33:02.918 INFO:teuthology.orchestra.run.smithi176.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-17T03:33:02.929 INFO:teuthology.orchestra.run.smithi121.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-17T03:33:02.943 INFO:teuthology.orchestra.run.smithi176.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-17T03:33:02.968 INFO:teuthology.orchestra.run.smithi176.stdout:(66/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 355 kB/s | 47 kB 00:00 2024-09-17T03:33:02.971 INFO:teuthology.orchestra.run.smithi121.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-09-17T03:33:02.993 INFO:teuthology.orchestra.run.smithi176.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-17T03:33:02.997 INFO:teuthology.orchestra.run.smithi121.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-09-17T03:33:03.039 INFO:teuthology.orchestra.run.smithi121.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 725 kB/s | 49 kB 00:00 2024-09-17T03:33:03.072 INFO:teuthology.orchestra.run.smithi121.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 897 kB/s | 67 kB 00:00 2024-09-17T03:33:03.094 INFO:teuthology.orchestra.run.smithi176.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-17T03:33:03.098 INFO:teuthology.orchestra.run.smithi121.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-17T03:33:03.136 INFO:teuthology.orchestra.run.smithi176.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-17T03:33:03.173 INFO:teuthology.orchestra.run.smithi121.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 7.2 MB/s | 548 kB 00:00 2024-09-17T03:33:03.177 INFO:teuthology.orchestra.run.smithi176.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-17T03:33:03.203 INFO:teuthology.orchestra.run.smithi176.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-17T03:33:03.206 INFO:teuthology.orchestra.run.smithi121.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-17T03:33:03.248 INFO:teuthology.orchestra.run.smithi121.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 776 kB/s | 32 kB 00:00 2024-09-17T03:33:03.282 INFO:teuthology.orchestra.run.smithi121.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-09-17T03:33:03.303 INFO:teuthology.orchestra.run.smithi176.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-17T03:33:03.327 INFO:teuthology.orchestra.run.smithi121.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 179 kB/s | 14 kB 00:00 2024-09-17T03:33:03.336 INFO:teuthology.orchestra.run.smithi176.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-17T03:33:03.379 INFO:teuthology.orchestra.run.smithi176.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-17T03:33:03.399 INFO:teuthology.orchestra.run.smithi121.stdout:(119/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-09-17T03:33:03.425 INFO:teuthology.orchestra.run.smithi121.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2024-09-17T03:33:03.458 INFO:teuthology.orchestra.run.smithi121.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-17T03:33:03.479 INFO:teuthology.orchestra.run.smithi176.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-17T03:33:03.486 INFO:teuthology.orchestra.run.smithi121.stdout:(122/157): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-09-17T03:33:03.504 INFO:teuthology.orchestra.run.smithi176.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 491 kB/s | 61 kB 00:00 2024-09-17T03:33:03.520 INFO:teuthology.orchestra.run.smithi121.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.3 MB/s | 220 kB 00:00 2024-09-17T03:33:03.529 INFO:teuthology.orchestra.run.smithi176.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-17T03:33:03.545 INFO:teuthology.orchestra.run.smithi121.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-17T03:33:03.555 INFO:teuthology.orchestra.run.smithi176.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-17T03:33:03.562 INFO:teuthology.orchestra.run.smithi121.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-09-17T03:33:03.579 INFO:teuthology.orchestra.run.smithi121.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 530 kB/s | 18 kB 00:00 2024-09-17T03:33:03.580 INFO:teuthology.orchestra.run.smithi176.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-17T03:33:03.596 INFO:teuthology.orchestra.run.smithi121.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 691 kB/s | 23 kB 00:00 2024-09-17T03:33:03.605 INFO:teuthology.orchestra.run.smithi176.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-17T03:33:03.613 INFO:teuthology.orchestra.run.smithi121.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 583 kB/s | 19 kB 00:00 2024-09-17T03:33:03.630 INFO:teuthology.orchestra.run.smithi121.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2024-09-17T03:33:03.630 INFO:teuthology.orchestra.run.smithi176.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-17T03:33:03.648 INFO:teuthology.orchestra.run.smithi121.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-17T03:33:03.655 INFO:teuthology.orchestra.run.smithi176.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-17T03:33:03.672 INFO:teuthology.orchestra.run.smithi121.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T03:33:03.689 INFO:teuthology.orchestra.run.smithi121.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-17T03:33:03.706 INFO:teuthology.orchestra.run.smithi176.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-17T03:33:03.722 INFO:teuthology.orchestra.run.smithi121.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 9.3 MB/s | 1.0 MB 00:00 2024-09-17T03:33:03.739 INFO:teuthology.orchestra.run.smithi121.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 975 kB/s | 16 kB 00:00 2024-09-17T03:33:03.765 INFO:teuthology.orchestra.run.smithi121.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-17T03:33:03.790 INFO:teuthology.orchestra.run.smithi176.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-17T03:33:03.798 INFO:teuthology.orchestra.run.smithi121.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-17T03:33:03.815 INFO:teuthology.orchestra.run.smithi176.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-17T03:33:03.815 INFO:teuthology.orchestra.run.smithi121.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-17T03:33:03.832 INFO:teuthology.orchestra.run.smithi121.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 917 kB/s | 31 kB 00:00 2024-09-17T03:33:03.840 INFO:teuthology.orchestra.run.smithi176.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-17T03:33:03.857 INFO:teuthology.orchestra.run.smithi121.stdout:(139/157): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-09-17T03:33:03.865 INFO:teuthology.orchestra.run.smithi176.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-17T03:33:03.891 INFO:teuthology.orchestra.run.smithi176.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-17T03:33:03.916 INFO:teuthology.orchestra.run.smithi176.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T03:33:03.924 INFO:teuthology.orchestra.run.smithi121.stdout:(140/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-09-17T03:33:03.941 INFO:teuthology.orchestra.run.smithi176.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-17T03:33:03.950 INFO:teuthology.orchestra.run.smithi121.stdout:(141/157): python3-rsa-4.9-2.el9.noarch.rpm 505 kB/s | 59 kB 00:00 2024-09-17T03:33:03.966 INFO:teuthology.orchestra.run.smithi176.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T03:33:03.975 INFO:teuthology.orchestra.run.smithi121.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 305 kB/s | 36 kB 00:00 2024-09-17T03:33:03.992 INFO:teuthology.orchestra.run.smithi176.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T03:33:04.000 INFO:teuthology.orchestra.run.smithi121.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-09-17T03:33:04.034 INFO:teuthology.orchestra.run.smithi121.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-17T03:33:04.059 INFO:teuthology.orchestra.run.smithi121.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-17T03:33:04.067 INFO:teuthology.orchestra.run.smithi176.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-17T03:33:04.085 INFO:teuthology.orchestra.run.smithi121.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-17T03:33:04.092 INFO:teuthology.orchestra.run.smithi176.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-17T03:33:04.110 INFO:teuthology.orchestra.run.smithi121.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T03:33:04.118 INFO:teuthology.orchestra.run.smithi176.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-09-17T03:33:04.143 INFO:teuthology.orchestra.run.smithi176.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-17T03:33:04.144 INFO:teuthology.orchestra.run.smithi121.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-17T03:33:04.168 INFO:teuthology.orchestra.run.smithi176.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-17T03:33:04.194 INFO:teuthology.orchestra.run.smithi176.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-17T03:33:04.219 INFO:teuthology.orchestra.run.smithi176.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-17T03:33:04.244 INFO:teuthology.orchestra.run.smithi121.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-17T03:33:04.244 INFO:teuthology.orchestra.run.smithi176.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T03:33:04.265 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] NetworkManager-1.51.0-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:33:04.303 INFO:teuthology.orchestra.run.smithi176.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-17T03:33:04.328 INFO:teuthology.orchestra.run.smithi176.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 64 kB 00:00 2024-09-17T03:33:04.345 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] NetworkManager-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:33:04.353 INFO:teuthology.orchestra.run.smithi176.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-17T03:33:04.428 INFO:teuthology.orchestra.run.smithi176.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-17T03:33:04.487 INFO:teuthology.orchestra.run.smithi176.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-17T03:33:04.529 INFO:teuthology.orchestra.run.smithi176.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.3 MB/s | 308 kB 00:00 2024-09-17T03:33:04.563 INFO:teuthology.orchestra.run.smithi176.stdout:(107/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-17T03:33:04.588 INFO:teuthology.orchestra.run.smithi176.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 334 kB/s | 19 kB 00:00 2024-09-17T03:33:04.594 INFO:teuthology.orchestra.run.smithi121.stdout:(150/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 7.0 MB/s | 3.2 MB 00:00 2024-09-17T03:33:04.616 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:33:04.622 INFO:teuthology.orchestra.run.smithi176.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-17T03:33:04.638 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:33:04.647 INFO:teuthology.orchestra.run.smithi176.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-17T03:33:04.672 INFO:teuthology.orchestra.run.smithi176.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-17T03:33:04.706 INFO:teuthology.orchestra.run.smithi176.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-17T03:33:04.764 INFO:teuthology.orchestra.run.smithi176.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-17T03:33:04.794 INFO:teuthology.orchestra.run.smithi121.stdout:(151/157): librados2-19.3.0-4989.gce1b342b.el9. 5.0 MB/s | 3.4 MB 00:00 2024-09-17T03:33:04.816 INFO:teuthology.orchestra.run.smithi121.stdout:[MIRROR] NetworkManager-team-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-team-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:33:04.931 INFO:teuthology.orchestra.run.smithi176.stdout:(114/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-17T03:33:04.973 INFO:teuthology.orchestra.run.smithi176.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-09-17T03:33:04.998 INFO:teuthology.orchestra.run.smithi176.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-17T03:33:05.023 INFO:teuthology.orchestra.run.smithi176.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-09-17T03:33:05.049 INFO:teuthology.orchestra.run.smithi176.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-17T03:33:05.082 INFO:teuthology.orchestra.run.smithi176.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-17T03:33:05.125 INFO:teuthology.orchestra.run.smithi176.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-17T03:33:05.178 INFO:teuthology.orchestra.run.smithi121.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 107 kB/s | 41 kB 00:00 2024-09-17T03:33:05.183 INFO:teuthology.orchestra.run.smithi176.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-09-17T03:33:05.209 INFO:teuthology.orchestra.run.smithi176.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-17T03:33:05.242 INFO:teuthology.orchestra.run.smithi176.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-17T03:33:05.268 INFO:teuthology.orchestra.run.smithi176.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-17T03:33:05.293 INFO:teuthology.orchestra.run.smithi176.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-17T03:33:05.318 INFO:teuthology.orchestra.run.smithi176.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-17T03:33:05.343 INFO:teuthology.orchestra.run.smithi176.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-17T03:33:05.369 INFO:teuthology.orchestra.run.smithi176.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 800 kB/s | 20 kB 00:00 2024-09-17T03:33:05.453 INFO:teuthology.orchestra.run.smithi121.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 1.9 MB/s | 2.3 MB 00:01 2024-09-17T03:33:05.469 INFO:teuthology.orchestra.run.smithi176.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2024-09-17T03:33:05.494 INFO:teuthology.orchestra.run.smithi176.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T03:33:05.544 INFO:teuthology.orchestra.run.smithi176.stdout:(131/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-17T03:33:05.572 INFO:teuthology.orchestra.run.smithi176.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-09-17T03:33:05.587 INFO:teuthology.orchestra.run.smithi176.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-09-17T03:33:05.595 INFO:teuthology.orchestra.run.smithi121.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:01 2024-09-17T03:33:05.620 INFO:teuthology.orchestra.run.smithi176.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-09-17T03:33:05.637 INFO:teuthology.orchestra.run.smithi176.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-17T03:33:05.637 INFO:teuthology.orchestra.run.smithi121.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 7.4 MB/s | 1.4 MB 00:00 2024-09-17T03:33:05.654 INFO:teuthology.orchestra.run.smithi176.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-17T03:33:05.662 INFO:teuthology.orchestra.run.smithi121.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 514 kB/s | 249 kB 00:00 2024-09-17T03:33:05.679 INFO:teuthology.orchestra.run.smithi176.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-17T03:33:05.705 INFO:teuthology.orchestra.run.smithi176.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-17T03:33:05.730 INFO:teuthology.orchestra.run.smithi176.stdout:(139/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-17T03:33:05.755 INFO:teuthology.orchestra.run.smithi176.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-17T03:33:05.781 INFO:teuthology.orchestra.run.smithi176.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 706 kB/s | 36 kB 00:00 2024-09-17T03:33:05.807 INFO:teuthology.orchestra.run.smithi176.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-17T03:33:05.829 INFO:teuthology.orchestra.run.smithi121.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-09-17T03:33:05.831 INFO:teuthology.orchestra.run.smithi176.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 982 kB/s | 74 kB 00:00 2024-09-17T03:33:05.836 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:33:05.836 INFO:teuthology.orchestra.run.smithi121.stdout:Total 18 MB/s | 228 MB 00:12 2024-09-17T03:33:05.865 INFO:teuthology.orchestra.run.smithi176.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-17T03:33:05.890 INFO:teuthology.orchestra.run.smithi176.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-17T03:33:05.916 INFO:teuthology.orchestra.run.smithi176.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 401 kB/s | 20 kB 00:00 2024-09-17T03:33:05.941 INFO:teuthology.orchestra.run.smithi176.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T03:33:05.966 INFO:teuthology.orchestra.run.smithi176.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-17T03:33:06.017 INFO:teuthology.orchestra.run.smithi176.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T03:33:06.038 INFO:teuthology.orchestra.run.smithi176.stdout:[MIRROR] NetworkManager-1.51.0-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:33:06.121 INFO:teuthology.orchestra.run.smithi176.stdout:[MIRROR] NetworkManager-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:33:06.300 INFO:teuthology.orchestra.run.smithi176.stdout:(150/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 9.5 MB/s | 3.2 MB 00:00 2024-09-17T03:33:06.322 INFO:teuthology.orchestra.run.smithi176.stdout:[MIRROR] NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:33:06.344 INFO:teuthology.orchestra.run.smithi176.stdout:[MIRROR] NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:33:06.417 INFO:teuthology.orchestra.run.smithi176.stdout:(151/157): librados2-19.3.0-4989.gce1b342b.el9. 7.1 MB/s | 3.4 MB 00:00 2024-09-17T03:33:06.439 INFO:teuthology.orchestra.run.smithi176.stdout:[MIRROR] NetworkManager-team-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-team-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T03:33:06.526 INFO:teuthology.orchestra.run.smithi176.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 377 kB/s | 41 kB 00:00 2024-09-17T03:33:06.626 INFO:teuthology.orchestra.run.smithi176.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.4 MB/s | 249 kB 00:00 2024-09-17T03:33:06.685 INFO:teuthology.orchestra.run.smithi176.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.7 MB/s | 1.8 MB 00:00 2024-09-17T03:33:06.743 INFO:teuthology.orchestra.run.smithi176.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.2 MB/s | 2.3 MB 00:00 2024-09-17T03:33:07.052 INFO:teuthology.orchestra.run.smithi176.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 1.4 MB 00:00 2024-09-17T03:33:07.486 INFO:teuthology.orchestra.run.smithi176.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.0 MB/s | 2.4 MB 00:00 2024-09-17T03:33:07.491 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:33:07.491 INFO:teuthology.orchestra.run.smithi176.stdout:Total 17 MB/s | 228 MB 00:13 2024-09-17T03:33:07.896 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-17T03:33:08.077 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-17T03:33:08.078 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-17T03:33:09.518 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-17T03:33:09.699 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-17T03:33:09.699 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-17T03:33:10.448 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-17T03:33:10.449 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-17T03:33:12.178 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-17T03:33:12.178 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-17T03:33:17.273 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-17T03:33:17.400 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T03:33:17.583 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T03:33:17.674 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T03:33:17.718 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T03:33:17.751 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T03:33:17.810 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T03:33:18.184 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T03:33:18.309 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:33:18.442 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:33:18.469 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:33:18.573 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:33:18.634 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:33:18.673 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T03:33:18.857 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-17T03:33:18.905 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T03:33:18.955 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T03:33:18.991 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:33:18.999 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T03:33:19.117 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:33:19.141 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:33:19.241 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:33:19.267 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:33:19.273 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T03:33:19.307 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:33:19.372 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T03:33:19.417 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T03:33:19.449 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T03:33:19.508 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T03:33:19.539 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:33:19.726 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:33:19.903 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T03:33:19.911 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T03:33:20.008 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:33:20.027 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:33:20.140 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:33:20.143 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:33:20.168 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:33:20.263 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:33:20.289 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:33:20.330 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T03:33:20.437 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:33:20.550 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T03:33:20.574 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T03:33:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T03:33:20.612 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T03:33:20.639 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:33:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T03:33:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T03:33:20.750 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:33:20.781 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:33:20.795 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T03:33:20.834 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T03:33:20.859 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:33:20.888 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T03:33:20.891 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:33:20.927 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T03:33:20.935 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:33:20.978 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T03:33:21.066 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T03:33:21.130 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T03:33:21.165 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T03:33:21.172 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:33:21.205 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T03:33:21.309 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T03:33:21.352 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T03:33:21.352 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:33:21.395 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T03:33:21.424 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T03:33:21.506 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T03:33:21.522 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T03:33:21.568 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T03:33:21.629 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:33:21.658 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T03:33:21.732 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:33:21.818 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T03:33:21.887 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T03:33:22.008 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:33:22.146 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T03:33:22.215 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T03:33:22.257 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T03:33:22.339 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T03:33:22.401 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T03:33:22.440 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T03:33:22.494 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T03:33:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T03:33:22.533 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T03:33:22.567 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T03:33:22.628 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T03:33:22.654 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T03:33:22.718 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T03:33:22.754 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T03:33:22.804 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T03:33:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T03:33:22.890 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T03:33:22.925 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T03:33:22.935 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T03:33:22.968 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T03:33:22.974 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T03:33:22.996 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T03:33:23.031 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T03:33:23.086 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T03:33:23.148 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T03:33:23.216 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T03:33:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T03:33:23.285 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T03:33:23.390 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T03:33:23.400 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T03:33:23.460 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T03:33:23.478 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T03:33:23.563 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T03:33:23.603 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T03:33:23.639 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T03:33:23.699 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T03:33:23.738 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T03:33:23.784 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T03:33:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T03:33:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T03:33:24.062 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T03:33:24.089 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T03:33:24.105 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T03:33:24.185 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T03:33:24.222 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T03:33:24.223 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T03:33:24.265 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T03:33:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T03:33:24.304 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T03:33:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T03:33:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T03:33:24.357 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T03:33:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T03:33:24.486 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T03:33:24.529 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T03:33:24.598 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T03:33:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T03:33:24.703 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T03:33:24.751 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T03:33:24.775 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T03:33:24.788 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T03:33:24.822 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T03:33:24.860 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T03:33:24.862 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T03:33:24.902 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T03:33:24.925 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T03:33:24.939 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T03:33:24.961 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T03:33:24.973 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T03:33:25.020 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T03:33:25.030 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T03:33:25.060 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T03:33:25.075 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T03:33:25.106 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T03:33:25.108 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T03:33:25.164 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T03:33:25.206 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T03:33:25.258 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T03:33:25.297 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T03:33:25.332 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T03:33:25.381 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T03:33:25.419 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T03:33:25.423 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T03:33:25.485 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T03:33:25.541 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T03:33:25.593 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T03:33:25.635 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T03:33:25.665 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T03:33:25.689 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T03:33:25.807 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T03:33:25.964 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T03:33:26.006 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T03:33:26.042 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T03:33:26.077 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T03:33:26.117 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T03:33:26.157 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T03:33:26.194 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T03:33:26.228 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T03:33:26.262 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T03:33:26.314 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T03:33:26.346 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T03:33:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T03:33:26.429 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T03:33:26.447 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T03:33:26.462 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T03:33:26.512 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T03:33:26.550 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T03:33:26.578 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T03:33:26.662 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T03:33:26.669 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T03:33:26.724 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T03:33:26.738 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T03:33:26.820 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T03:33:26.865 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T03:33:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T03:33:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T03:33:27.245 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T03:33:27.646 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T03:33:27.708 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T03:33:27.742 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T03:33:27.857 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T03:33:27.916 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T03:33:27.969 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T03:33:28.057 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T03:33:28.066 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T03:33:28.111 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T03:33:28.198 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T03:33:28.341 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T03:33:28.374 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T03:33:28.465 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T03:33:29.260 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T03:33:29.394 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T03:33:29.776 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T03:33:29.885 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T03:33:29.922 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T03:33:29.954 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T03:33:30.307 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T03:33:30.349 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:33:30.462 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:33:30.497 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T03:33:30.555 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T03:33:30.953 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T03:33:31.045 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T03:33:31.081 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T03:33:31.108 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T03:33:31.114 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T03:33:31.144 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:33:31.235 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:33:31.262 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T03:33:31.483 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T03:33:31.526 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:33:31.645 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:33:31.682 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T03:33:31.736 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T03:33:32.277 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T03:33:32.304 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:33:32.394 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:33:32.466 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T03:33:33.809 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:33:33.850 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:33:34.517 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:33:34.570 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:33:34.712 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:33:34.713 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T03:33:34.713 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T03:33:34.713 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:34.763 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:33:35.211 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:33:35.251 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:33:35.913 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:33:35.955 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:33:36.090 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:33:36.091 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T03:33:36.091 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T03:33:36.091 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:33:36.139 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:33:47.309 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:33:47.309 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-09-17T03:33:47.310 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-09-17T03:33:47.310 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-09-17T03:33:47.310 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-09-17T03:33:47.310 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-09-17T03:33:47.310 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-09-17T03:33:47.310 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-09-17T03:33:47.311 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:47.517 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:33:47.554 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:33:47.554 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:47.554 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T03:33:47.554 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:33:49.320 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:33:49.320 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:49.320 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T03:33:49.320 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:33:49.320 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:33:49.320 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:49.527 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:33:49.527 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2024-09-17T03:33:49.528 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2024-09-17T03:33:49.528 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2024-09-17T03:33:49.528 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2024-09-17T03:33:49.528 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2024-09-17T03:33:49.528 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /root 2024-09-17T03:33:49.528 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2024-09-17T03:33:49.528 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:33:49.579 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:33:49.631 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:33:49.632 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:49.632 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T03:33:49.632 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:33:49.632 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:33:49.632 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:49.727 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:33:49.762 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:33:49.762 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:49.762 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T03:33:49.762 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:33:50.177 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:33:50.228 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:33:50.228 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:50.229 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T03:33:50.229 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:33:50.229 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:33:50.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:50.363 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T03:33:50.424 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T03:33:50.487 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T03:33:50.713 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T03:33:50.793 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T03:33:50.886 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T03:33:50.996 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T03:33:51.171 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T03:33:51.241 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T03:33:51.298 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T03:33:51.324 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T03:33:51.496 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:33:51.554 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:33:51.554 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:51.554 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T03:33:51.554 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:33:51.555 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:33:51.555 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:33:51.814 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:33:51.857 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:33:51.864 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:33:51.865 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:51.865 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T03:33:51.865 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:33:51.865 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:33:51.865 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:33:51.899 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:33:51.932 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T03:33:52.013 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T03:33:52.046 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:33:52.381 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:33:52.432 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:33:52.432 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:52.432 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T03:33:52.432 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:33:52.432 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:33:52.432 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:33:52.556 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T03:33:52.641 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T03:33:52.713 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T03:33:52.939 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T03:33:52.994 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T03:33:53.080 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T03:33:53.189 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T03:33:53.356 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T03:33:53.416 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T03:33:53.458 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T03:33:53.517 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T03:33:54.025 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:33:54.057 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:33:54.091 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T03:33:54.173 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T03:33:54.205 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:33:55.709 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:33:55.777 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:33:56.860 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:33:56.894 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:33:57.046 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:33:57.230 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T03:33:57.262 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:33:57.313 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:33:57.314 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:57.314 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T03:33:57.314 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:33:57.314 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:33:57.314 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:57.371 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:33:57.397 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:33:57.506 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T03:33:57.574 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T03:33:57.854 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:33:57.928 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:33:58.629 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T03:33:58.657 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:33:58.709 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:33:58.709 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:58.709 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T03:33:58.709 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:33:58.709 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:33:58.709 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:58.766 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:33:58.817 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:33:58.817 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:58.817 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T03:33:58.817 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:58.875 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:33:58.926 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:33:58.927 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:58.927 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T03:33:58.927 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:33:58.927 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:33:58.927 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:59.006 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:33:59.037 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:33:59.186 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:33:59.285 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:33:59.336 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:33:59.336 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:59.336 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T03:33:59.336 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:33:59.336 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:33:59.336 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:33:59.364 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T03:33:59.396 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:33:59.447 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:33:59.447 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:33:59.447 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T03:33:59.447 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:33:59.447 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:33:59.448 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:33:59.505 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:33:59.531 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:33:59.631 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T03:33:59.697 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T03:34:00.728 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T03:34:00.758 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:34:00.821 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:34:00.822 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:34:00.822 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T03:34:00.822 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:34:00.822 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:34:00.822 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:00.875 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:34:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:34:00.926 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:34:00.926 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T03:34:00.926 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:00.984 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:34:01.035 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:34:01.035 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:34:01.035 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T03:34:01.035 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:34:01.035 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:34:01.036 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:01.385 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:34:01.440 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:34:01.440 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:34:01.440 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T03:34:01.441 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:34:01.441 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:34:01.441 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:03.714 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T03:34:03.756 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T03:34:03.799 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T03:34:03.828 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T03:34:03.864 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T03:34:04.127 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T03:34:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T03:34:04.239 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T03:34:04.271 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T03:34:04.315 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T03:34:05.112 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:34:05.163 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:34:05.205 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:34:05.757 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T03:34:05.798 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T03:34:05.841 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T03:34:05.870 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T03:34:05.905 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T03:34:06.171 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T03:34:06.231 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T03:34:06.265 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T03:34:06.297 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T03:34:06.340 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T03:34:06.491 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T03:34:06.604 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T03:34:06.657 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T03:34:06.785 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T03:34:06.823 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T03:34:06.857 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T03:34:06.894 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T03:34:06.894 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:34:06.993 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:34:06.993 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:34:07.000 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:34:07.047 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:34:07.085 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:34:07.087 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:34:07.109 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T03:34:07.125 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:34:07.125 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:34:07.370 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:34:07.371 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:34:07.480 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:34:07.552 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:34:07.755 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:34:07.756 INFO:teuthology.orchestra.run.smithi121.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-17T03:34:07.756 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:08.369 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T03:34:08.479 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T03:34:08.528 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T03:34:08.642 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T03:34:08.681 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T03:34:08.727 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T03:34:08.768 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T03:34:08.768 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:34:08.869 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:34:08.869 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:34:08.959 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:34:08.983 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T03:34:08.999 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:34:08.999 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:34:09.236 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:34:09.236 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:34:09.354 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:34:09.428 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:34:09.631 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:34:09.631 INFO:teuthology.orchestra.run.smithi176.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-17T03:34:09.631 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:14.038 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T03:34:14.038 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T03:34:14.038 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T03:34:14.038 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T03:34:14.038 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T03:34:14.038 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T03:34:14.038 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T03:34:14.038 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T03:34:14.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T03:34:14.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T03:34:14.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T03:34:14.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T03:34:14.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T03:34:14.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T03:34:14.052 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T03:34:14.052 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T03:34:14.052 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T03:34:14.052 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T03:34:14.052 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T03:34:14.052 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T03:34:14.052 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T03:34:14.052 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T03:34:14.053 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T03:34:14.054 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T03:34:14.055 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T03:34:14.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T03:34:14.057 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T03:34:14.058 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T03:34:14.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T03:34:14.060 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T03:34:14.061 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T03:34:14.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T03:34:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T03:34:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T03:34:14.063 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T03:34:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T03:34:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T03:34:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T03:34:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T03:34:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T03:34:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T03:34:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T03:34:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:34:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:34:15.489 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T03:34:15.490 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T03:34:15.491 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T03:34:15.492 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T03:34:15.493 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T03:34:15.494 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T03:34:15.495 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T03:34:15.496 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T03:34:15.497 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T03:34:15.498 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T03:34:15.499 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T03:34:15.500 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T03:34:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T03:34:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T03:34:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T03:34:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T03:34:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T03:34:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T03:34:15.501 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T03:34:16.312 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:34:16.312 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:16.312 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-09-17T03:34:16.312 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T03:34:16.312 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T03:34:16.312 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T03:34:16.312 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T03:34:16.312 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.312 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.314 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T03:34:16.315 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T03:34:16.316 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T03:34:16.317 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T03:34:16.318 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T03:34:16.319 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T03:34:16.320 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T03:34:16.321 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T03:34:16.321 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T03:34:16.321 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T03:34:16.321 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T03:34:16.321 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T03:34:16.321 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T03:34:16.321 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T03:34:16.321 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T03:34:16.321 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T03:34:16.321 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.322 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T03:34:16.323 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T03:34:16.324 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T03:34:16.325 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T03:34:16.325 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:16.325 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-17T03:34:16.940 DEBUG:teuthology.parallel:result is None 2024-09-17T03:34:17.720 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:34:17.720 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:17.720 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2024-09-17T03:34:17.720 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T03:34:17.720 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T03:34:17.720 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T03:34:17.720 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T03:34:17.720 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.721 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.722 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T03:34:17.723 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T03:34:17.724 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T03:34:17.724 INFO:teuthology.orchestra.run.smithi176.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T03:34:17.724 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T03:34:17.724 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T03:34:17.724 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T03:34:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T03:34:17.726 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T03:34:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T03:34:17.728 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T03:34:17.729 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T03:34:17.730 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T03:34:17.731 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.732 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.733 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:34:17.733 INFO:teuthology.orchestra.run.smithi176.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T03:34:17.733 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T03:34:17.733 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T03:34:17.733 INFO:teuthology.orchestra.run.smithi176.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T03:34:17.733 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T03:34:17.733 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T03:34:17.733 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T03:34:17.734 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:17.734 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-17T03:34:18.341 DEBUG:teuthology.parallel:result is None 2024-09-17T03:34:18.341 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:34:18.484 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T03:34:18.529 INFO:teuthology.orchestra.run.smithi121.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T03:34:18.530 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T03:34:18.530 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T03:34:18.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:34:18.671 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T03:34:18.717 INFO:teuthology.orchestra.run.smithi176.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T03:34:18.717 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T03:34:18.717 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T03:34:18.719 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T03:34:18.719 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:18.719 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T03:34:18.778 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:18.778 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T03:34:18.843 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T03:34:18.843 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:18.844 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T03:34:18.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T03:34:18.997 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:18.997 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T03:34:19.054 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T03:34:19.158 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T03:34:19.158 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:19.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T03:34:19.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T03:34:19.312 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:19.312 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T03:34:19.368 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T03:34:19.465 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T03:34:19.465 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:19.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T03:34:19.525 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T03:34:19.622 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:19.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T03:34:19.680 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T03:34:19.778 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T03:34:19.852 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T03:34:19.852 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2024-09-17T03:34:19.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2024-09-17T03:34:19.912 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T03:34:19.912 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T03:34:19.916 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T03:34:19.974 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T03:34:19.975 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T03:34:19.979 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T03:34:20.041 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T03:34:20.041 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T03:34:20.041 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T03:34:20.042 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:20.042 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T03:34:20.076 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T03:34:20.247 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T03:34:20.302 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:20.303 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T03:34:20.338 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T03:34:20.510 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T03:34:20.575 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T03:34:20.575 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T03:34:20.576 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/sessionmap}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908451', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPy4VSLZROstzoSW5dOhG5bPy/PH4GjMrjKIiDvijlDmboXxrGYwuoq7kJKNaoXxef23Vy2HZqpRRLUuNoqU5PI=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFaMLCDD0H3yGOHXATpcJClIJHdq+UgExnjGB+ENWx0HPU4B+wSJ0/Dmmvn7hWfMeeMuzuTSG7JOQESeMHm9MXo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'client session with non-allowable root'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_sessionmap']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T03:34:20.576 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T03:34:20.580 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T03:34:20.615 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T03:34:20.656 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T03:34:20.714 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:20.714 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T03:34:20.749 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T03:34:20.750 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-09-17T03:34:20.824 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T03:34:20.825 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:34:20.825 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-17T03:34:20.825 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:34:20.825 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:34:20.825 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-17 03:34:08.118570517 +0000 2024-09-17T03:34:20.825 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-17 03:32:02.786749741 +0000 2024-09-17T03:34:20.825 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-17 03:32:02.786749741 +0000 2024-09-17T03:34:20.825 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-17 03:32:02.786749741 +0000 2024-09-17T03:34:20.825 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T03:34:20.917 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-17T03:34:20.917 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-17T03:34:20.917 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000282492 s, 1.8 MB/s 2024-09-17T03:34:20.919 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T03:34:20.956 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-09-17T03:34:21.031 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T03:34:21.031 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:34:21.031 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-17T03:34:21.032 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:34:21.032 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:34:21.032 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-17 03:34:08.118570517 +0000 2024-09-17T03:34:21.032 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-17 03:32:03.250743489 +0000 2024-09-17T03:34:21.032 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-17 03:32:03.250743489 +0000 2024-09-17T03:34:21.032 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-17 03:32:03.250743489 +0000 2024-09-17T03:34:21.032 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T03:34:21.124 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-17T03:34:21.124 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-17T03:34:21.124 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000270315 s, 1.9 MB/s 2024-09-17T03:34:21.127 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T03:34:21.163 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-09-17T03:34:21.239 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T03:34:21.239 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:34:21.239 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-09-17T03:34:21.239 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:34:21.240 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:34:21.240 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-17 03:34:08.119570503 +0000 2024-09-17T03:34:21.240 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-17 03:32:03.782736321 +0000 2024-09-17T03:34:21.240 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-17 03:32:03.782736321 +0000 2024-09-17T03:34:21.240 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-17 03:32:03.782736321 +0000 2024-09-17T03:34:21.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T03:34:21.332 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-17T03:34:21.332 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-17T03:34:21.332 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000298441 s, 1.7 MB/s 2024-09-17T03:34:21.335 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T03:34:21.370 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-09-17T03:34:21.445 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T03:34:21.445 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:34:21.445 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-17T03:34:21.445 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:34:21.445 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:34:21.445 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-17 03:34:08.119570503 +0000 2024-09-17T03:34:21.446 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-17 03:32:04.242730122 +0000 2024-09-17T03:34:21.446 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-17 03:32:04.242730122 +0000 2024-09-17T03:34:21.446 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-17 03:32:04.242730122 +0000 2024-09-17T03:34:21.446 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T03:34:21.537 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-17T03:34:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-17T03:34:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.00027482 s, 1.9 MB/s 2024-09-17T03:34:21.540 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T03:34:21.576 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:34:21.576 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:21.576 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T03:34:21.611 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T03:34:21.612 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-09-17T03:34:21.687 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T03:34:21.687 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:34:21.687 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-17T03:34:21.687 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:34:21.688 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:34:21.688 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-17 03:34:09.984975500 +0000 2024-09-17T03:34:21.688 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-17 03:32:03.635988310 +0000 2024-09-17T03:34:21.688 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-17 03:32:03.635988310 +0000 2024-09-17T03:34:21.688 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-17 03:32:03.635988310 +0000 2024-09-17T03:34:21.688 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T03:34:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-17T03:34:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-17T03:34:21.779 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000341858 s, 1.5 MB/s 2024-09-17T03:34:21.782 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T03:34:21.818 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-09-17T03:34:21.894 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T03:34:21.894 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:34:21.894 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-09-17T03:34:21.894 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:34:21.894 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:34:21.894 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-17 03:34:09.985975489 +0000 2024-09-17T03:34:21.895 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-17 03:32:04.102983276 +0000 2024-09-17T03:34:21.895 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-17 03:32:04.102983276 +0000 2024-09-17T03:34:21.895 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-17 03:32:04.102983276 +0000 2024-09-17T03:34:21.895 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T03:34:21.986 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-17T03:34:21.986 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-17T03:34:21.986 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000277217 s, 1.8 MB/s 2024-09-17T03:34:21.989 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T03:34:22.025 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-09-17T03:34:22.099 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T03:34:22.100 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:34:22.100 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-17T03:34:22.100 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:34:22.100 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:34:22.100 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-17 03:34:09.985975489 +0000 2024-09-17T03:34:22.100 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-17 03:32:04.586978059 +0000 2024-09-17T03:34:22.100 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-17 03:32:04.586978059 +0000 2024-09-17T03:34:22.100 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-17 03:32:04.586978059 +0000 2024-09-17T03:34:22.100 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T03:34:22.192 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-17T03:34:22.192 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-17T03:34:22.192 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000324793 s, 1.6 MB/s 2024-09-17T03:34:22.195 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T03:34:22.230 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-09-17T03:34:22.307 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T03:34:22.307 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:34:22.307 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-17T03:34:22.307 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:34:22.308 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:34:22.308 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-17 03:34:09.986975478 +0000 2024-09-17T03:34:22.308 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-17 03:32:05.041973154 +0000 2024-09-17T03:34:22.308 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-17 03:32:05.041973154 +0000 2024-09-17T03:34:22.308 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-17 03:32:05.041973154 +0000 2024-09-17T03:34:22.308 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T03:34:22.401 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-17T03:34:22.401 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-17T03:34:22.401 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000285414 s, 1.8 MB/s 2024-09-17T03:34:22.404 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T03:34:22.440 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:34:22.440 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T03:34:22.441 INFO:tasks.ceph:Generating config... 2024-09-17T03:34:22.442 INFO:tasks.ceph:[client] pid file = 2024-09-17T03:34:22.442 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T03:34:22.442 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T03:34:22.442 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T03:34:22.442 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T03:34:22.442 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T03:34:22.442 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T03:34:22.442 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T03:34:22.442 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T03:34:22.443 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T03:34:22.443 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T03:34:22.444 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T03:34:22.597 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T03:34:22.610 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T03:34:22.763 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:34:22.817 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.121'), ('mon.b', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]')] 2024-09-17T03:34:22.818 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.121,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-17T03:34:22.819 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:22.819 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T03:34:22.853 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.121 --add b 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:23.031 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:23.032 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: generated fsid f24b1682-8755-41b1-8124-cbd8f88939a2 2024-09-17T03:34:23.032 INFO:teuthology.orchestra.run.smithi121.stdout:setting min_mon_release = quincy 2024-09-17T03:34:23.032 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 0 2024-09-17T03:34:23.032 INFO:teuthology.orchestra.run.smithi121.stdout:fsid f24b1682-8755-41b1-8124-cbd8f88939a2 2024-09-17T03:34:23.032 INFO:teuthology.orchestra.run.smithi121.stdout:last_changed 2024-09-17T03:34:23.032958+0000 2024-09-17T03:34:23.032 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-09-17T03:34:23.032958+0000 2024-09-17T03:34:23.032 INFO:teuthology.orchestra.run.smithi121.stdout:min_mon_release 17 (quincy) 2024-09-17T03:34:23.032 INFO:teuthology.orchestra.run.smithi121.stdout:election_strategy: 1 2024-09-17T03:34:23.032 INFO:teuthology.orchestra.run.smithi121.stdout:0: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.a 2024-09-17T03:34:23.033 INFO:teuthology.orchestra.run.smithi121.stdout:1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.b 2024-09-17T03:34:23.033 INFO:teuthology.orchestra.run.smithi121.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2024-09-17T03:34:23.033 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T03:34:23.041 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T03:34:23.075 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f24b1682-8755-41b1-8124-cbd8f88939a2... 2024-09-17T03:34:23.127 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:34:23.132 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:34:23.228 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-09-17T03:34:23.228 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-09-17T03:34:23.228 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:34:23.228 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-09-17T03:34:23.228 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:34:23.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-09-17T03:34:23.230 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.121,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on skipped message = False 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = f24b1682-8755-41b1-8124-cbd8f88939a2 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-09-17T03:34:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.232 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-09-17T03:34:23.233 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 20 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 20 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 10 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:34:23.234 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:34:23.235 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:34:23.236 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout: mon down mkfs grace = 300 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = "" 2024-09-17T03:34:23.237 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-09-17T03:34:23.238 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2024-09-17T03:34:23.238 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2024-09-17T03:34:23.238 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-09-17T03:34:23.238 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-09-17T03:34:23.238 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-09-17T03:34:23.238 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-09-17T03:34:23.238 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.239 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-17T03:34:23.240 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.121,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = f24b1682-8755-41b1-8124-cbd8f88939a2 2024-09-17T03:34:23.241 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-17T03:34:23.242 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-17T03:34:23.243 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 20 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 20 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 10 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-17T03:34:23.244 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:34:23.245 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:34:23.246 INFO:teuthology.orchestra.run.smithi176.stdout: mon down mkfs grace = 300 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-17T03:34:23.247 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-17T03:34:23.263 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T03:34:23.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T03:34:23.430 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T03:34:23.430 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:23.430 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T03:34:23.464 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:23.465 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T03:34:23.538 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:34:23.538 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:23.538 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T03:34:23.539 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:34:23.655 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:23.655 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:23.730 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:34:23.730 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:23.730 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T03:34:23.730 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:34:23.809 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:23.809 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:23.884 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T03:34:23.884 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T03:34:23.885 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T03:34:24.049 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T03:34:24.061 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T03:34:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T03:34:24.269 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T03:34:24.269 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T03:34:24.435 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T03:34:24.446 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T03:34:24.502 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T03:34:24.668 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T03:34:24.679 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T03:34:24.734 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T03:34:24.901 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T03:34:24.913 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T03:34:24.970 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T03:34:25.134 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T03:34:25.147 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T03:34:25.202 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T03:34:25.202 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T03:34:25.346 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T03:34:25.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T03:34:25.523 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T03:34:25.556 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T03:34:25.700 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T03:34:25.733 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T03:34:25.876 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T03:34:25.910 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T03:34:25.910 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T03:34:25.910 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T03:34:25.968 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:34:25.968 INFO:tasks.ceph:role: osd.0 2024-09-17T03:34:25.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:34:25.968 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T03:34:26.030 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:34:26.030 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:34:26.030 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:34:26.031 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:34:26.031 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:34:26.031 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:34:26.031 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:34:26.031 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:34:26.031 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:34:26.031 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:34:26.447 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-17T03:34:26.451 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-17T03:34:26.451 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T03:34:26.599 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T03:34:26.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T03:34:26.722 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:34:26.722 INFO:tasks.ceph:role: osd.1 2024-09-17T03:34:26.722 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:34:26.723 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T03:34:26.785 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:34:26.785 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:34:26.785 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:34:26.785 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:34:26.785 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:34:26.786 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:34:26.786 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:34:26.786 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:34:26.786 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:34:26.786 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:34:27.147 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-17T03:34:27.151 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-17T03:34:27.151 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T03:34:27.235 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T03:34:27.297 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T03:34:27.352 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:34:27.352 INFO:tasks.ceph:role: osd.2 2024-09-17T03:34:27.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:34:27.352 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T03:34:27.414 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:34:27.414 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:34:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:34:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:34:27.415 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:34:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:34:27.415 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:34:27.415 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:34:27.415 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:34:27.415 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:34:27.811 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-17T03:34:27.814 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-17T03:34:27.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T03:34:27.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T03:34:27.982 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T03:34:28.037 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:34:28.037 INFO:tasks.ceph:role: osd.3 2024-09-17T03:34:28.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:34:28.037 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T03:34:28.099 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:34:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:34:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:34:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:34:28.100 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:34:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:34:28.100 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:34:28.100 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:34:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:34:28.100 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:34:28.530 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-17T03:34:28.534 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-17T03:34:28.535 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T03:34:28.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T03:34:28.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:28.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:28.893+0000 7fb426db2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T03:34:28.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:28.895+0000 7fb426db2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T03:34:28.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:28.895+0000 7fb426db2640 -1 bdev(0x5593cd3d7900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T03:34:28.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:28.895+0000 7fb426db2640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T03:34:31.930 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T03:34:31.990 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:32.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:32.146+0000 7fd898cef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T03:34:32.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:32.146+0000 7fd898cef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T03:34:32.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:32.146+0000 7fd898cef640 -1 bdev(0x557b1392b900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T03:34:32.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:32.147+0000 7fd898cef640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T03:34:35.386 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T03:34:35.445 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:35.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:35.602+0000 7f8db1483640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T03:34:35.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:35.602+0000 7f8db1483640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T03:34:35.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:35.602+0000 7f8db1483640 -1 bdev(0x55a400b55900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T03:34:35.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:35.603+0000 7f8db1483640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T03:34:38.662 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T03:34:38.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:38.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:38.875+0000 7f9d04b1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T03:34:38.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:38.875+0000 7f9d04b1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T03:34:38.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:38.875+0000 7f9d04b1e640 -1 bdev(0x559d5bd15900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T03:34:38.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:34:38.875+0000 7f9d04b1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T03:34:42.154 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T03:34:42.211 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T03:34:42.273 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:34:42.273 INFO:tasks.ceph:role: osd.4 2024-09-17T03:34:42.274 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:34:42.274 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T03:34:42.338 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:34:42.338 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:34:42.338 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:34:42.338 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:34:42.338 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:34:42.339 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:34:42.339 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:34:42.339 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:34:42.339 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:34:42.339 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:34:42.742 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-17T03:34:42.746 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-17T03:34:42.746 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T03:34:42.864 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T03:34:42.931 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T03:34:42.988 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:34:42.988 INFO:tasks.ceph:role: osd.5 2024-09-17T03:34:42.988 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:34:42.988 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T03:34:43.052 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:34:43.052 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:34:43.052 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:34:43.052 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:34:43.052 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:34:43.053 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:34:43.053 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:34:43.053 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:34:43.053 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:34:43.053 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:34:43.413 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-17T03:34:43.417 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-17T03:34:43.418 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T03:34:43.503 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T03:34:43.565 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T03:34:43.623 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:34:43.623 INFO:tasks.ceph:role: osd.6 2024-09-17T03:34:43.623 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:34:43.623 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T03:34:43.689 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:34:43.689 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:34:43.689 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:34:43.689 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:34:43.689 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:34:43.689 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:34:43.689 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:34:43.689 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:34:43.689 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:34:43.689 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:34:44.088 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-17T03:34:44.092 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-17T03:34:44.092 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T03:34:44.192 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T03:34:44.256 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T03:34:44.311 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:34:44.311 INFO:tasks.ceph:role: osd.7 2024-09-17T03:34:44.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:34:44.311 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T03:34:44.374 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:34:44.374 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:34:44.374 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:34:44.374 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:34:44.374 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:34:44.374 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:34:44.374 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:34:44.374 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:34:44.374 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:34:44.374 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:34:44.772 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-17T03:34:44.776 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-17T03:34:44.776 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T03:34:44.910 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T03:34:44.975 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:45.144 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:45.144+0000 7fbb2bc0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T03:34:45.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:45.149+0000 7fbb2bc0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T03:34:45.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:45.150+0000 7fbb2bc0b640 -1 bdev(0x55bf03497900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T03:34:45.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:45.150+0000 7fbb2bc0b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T03:34:48.177 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T03:34:48.235 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:48.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:48.389+0000 7f893d610640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T03:34:48.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:48.390+0000 7f893d610640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T03:34:48.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:48.390+0000 7f893d610640 -1 bdev(0x560276887900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T03:34:48.390 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:48.390+0000 7f893d610640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T03:34:50.577 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:34:50.582 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:34:51.479 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T03:34:51.535 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:51.690 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:51.689+0000 7f0a89a33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T03:34:51.690 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:51.690+0000 7f0a89a33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T03:34:51.690 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:51.690+0000 7f0a89a33640 -1 bdev(0x56405eba5900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T03:34:51.691 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:51.690+0000 7f0a89a33640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T03:34:54.719 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T03:34:54.774 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:34:54.929 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:54.928+0000 7f7723639640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T03:34:54.929 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:54.929+0000 7f7723639640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T03:34:54.929 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:54.929+0000 7f7723639640 -1 bdev(0x56331a401900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T03:34:54.930 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:34:54.929+0000 7f7723639640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T03:34:58.192 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T03:34:58.253 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T03:34:58.253 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:58.253 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T03:34:58.316 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:58.316 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T03:34:58.414 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:58.414 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T03:34:58.511 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:58.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T03:34:58.606 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:58.606 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T03:34:58.702 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:58.702 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T03:34:58.798 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:58.798 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T03:34:58.895 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:58.895 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T03:34:58.957 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:58.957 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T03:34:59.055 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:59.055 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T03:34:59.151 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:59.151 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T03:34:59.247 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:59.247 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T03:34:59.343 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:59.343 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T03:34:59.438 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:59.438 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T03:34:59.533 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:59.533 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T03:34:59.569 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:34:59.569 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T03:34:59.645 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:59.645 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T03:34:59.680 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:34:59.680 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T03:34:59.754 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T03:34:59.754 DEBUG:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T03:34:59.759 DEBUG:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T03:34:59.808 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.y] 2024-09-17T03:34:59.808 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDA+OhmQfYJAxAA6Mc5PiIb5VDamVU5Vhx3aQ== 2024-09-17T03:34:59.808 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-09-17T03:34:59.808 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDA+Ohm64sFGhAAJDdFwMDkudwacQaLfvbAdg== 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDA+OhmV/btJxAAmhL4jXk0LVdzCPaNi9Hzhg== 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDE+OhmBxJKNRAAGxPaH7R2JtcFVO5kR/Qh2A== 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDI+OhmRtvFCBAAOG/1XD75Atl6ztUGPw3PKA== 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDL+OhmwzDzIxAA9Z/IIRphtZK1jbS2sIXeJQ== 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.3] 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDO+Ohm94g0NBAAmxtHPev4OOM0YfOQt7N5Jg== 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDA+Ohmsn9CDxAAzjtaZG1qe4XTnBge+t3vlA== 2024-09-17T03:34:59.809 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-09-17T03:34:59.810 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDA+OhmIGvPNRAAvE+tovzn5WadGa9C/P/A3A== 2024-09-17T03:34:59.810 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-09-17T03:34:59.810 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+OhmeQccCBAAtTfeUysbtoqrKjwaKRWyvg== 2024-09-17T03:34:59.810 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.4] 2024-09-17T03:34:59.810 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDV+Ohmj7OoCBAA/Hrj9dHVT98lURPWJE3r/g== 2024-09-17T03:34:59.810 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.5] 2024-09-17T03:34:59.810 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDY+Ohmc29QFxAAGsMy0+9MviYohok8JpL+ZA== 2024-09-17T03:34:59.810 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.6] 2024-09-17T03:34:59.810 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDb+OhmDO8tKRAAq6bn/I54WKTdN6XiviHNsQ== 2024-09-17T03:34:59.810 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.7] 2024-09-17T03:34:59.811 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDe+OhmUuFwNxAAgAeDJiL/TIGDuDAC+dXCyA== 2024-09-17T03:34:59.811 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-17T03:34:59.811 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw== 2024-09-17T03:34:59.811 INFO:teuthology.orchestra.run.smithi121.stdout:[client.2] 2024-09-17T03:34:59.811 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+Ohme/hCHxAAdP8DjxaXWMGi/Fw+85zUFA== 2024-09-17T03:34:59.811 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2024-09-17T03:34:59.811 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+Ohmec7LKRAAl5nAqPEncglNL2FbRlD0oA== 2024-09-17T03:34:59.811 INFO:teuthology.orchestra.run.smithi121.stdout:[client.3] 2024-09-17T03:34:59.811 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+OhmivFTNBAA5f47Lq5CE+iXt3i+5fUJGA== 2024-09-17T03:34:59.846 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2024-09-17T03:34:59.846 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDA+OhmQfYJAxAA6Mc5PiIb5VDamVU5Vhx3aQ== 2024-09-17T03:34:59.846 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-17T03:34:59.846 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDA+Ohm64sFGhAAJDdFwMDkudwacQaLfvbAdg== 2024-09-17T03:34:59.846 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-17T03:34:59.846 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDA+OhmV/btJxAAmhL4jXk0LVdzCPaNi9Hzhg== 2024-09-17T03:34:59.846 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2024-09-17T03:34:59.846 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDE+OhmBxJKNRAAGxPaH7R2JtcFVO5kR/Qh2A== 2024-09-17T03:34:59.846 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2024-09-17T03:34:59.846 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDI+OhmRtvFCBAAOG/1XD75Atl6ztUGPw3PKA== 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDL+OhmwzDzIxAA9Z/IIRphtZK1jbS2sIXeJQ== 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDO+Ohm94g0NBAAmxtHPev4OOM0YfOQt7N5Jg== 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDA+Ohmsn9CDxAAzjtaZG1qe4XTnBge+t3vlA== 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDA+OhmIGvPNRAAvE+tovzn5WadGa9C/P/A3A== 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDB+OhmeQccCBAAtTfeUysbtoqrKjwaKRWyvg== 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDV+Ohmj7OoCBAA/Hrj9dHVT98lURPWJE3r/g== 2024-09-17T03:34:59.847 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDY+Ohmc29QFxAAGsMy0+9MviYohok8JpL+ZA== 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDb+OhmDO8tKRAAq6bn/I54WKTdN6XiviHNsQ== 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDe+OhmUuFwNxAAgAeDJiL/TIGDuDAC+dXCyA== 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw== 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout:[client.2] 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDB+Ohme/hCHxAAdP8DjxaXWMGi/Fw+85zUFA== 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDB+Ohmec7LKRAAl5nAqPEncglNL2FbRlD0oA== 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout:[client.3] 2024-09-17T03:34:59.848 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDB+OhmivFTNBAA5f47Lq5CE+iXt3i+5fUJGA== 2024-09-17T03:34:59.849 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:34:59.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:35:00.054 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:35:00.058 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:35:00.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:35:00.226 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:35:00.393 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:00.397 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:00.559 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:00.563 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:00.724 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:00.729 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:00.890 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:00.894 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:01.057 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:35:01.062 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:35:01.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:35:01.228 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:35:01.392 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:35:01.396 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:35:01.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:01.565 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:01.726 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:01.730 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:01.893 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:01.897 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:02.060 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:02.064 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:35:02.224 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:35:02.228 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:35:02.393 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:35:02.397 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:35:02.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:35:02.565 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:35:02.728 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:35:02.732 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:35:02.900 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T03:35:02.900 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T03:35:02.956 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:35:03.136 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T03:35:03.194 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T03:35:03.250 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:35:03.428 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T03:35:03.484 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T03:35:03.539 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:35:03.717 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T03:35:03.773 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:35:03.777 DEBUG:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:35:03.812 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T03:35:03.812 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T03:35:03.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T03:35:03.852 INFO:tasks.ceph.mon.a:Started 2024-09-17T03:35:03.852 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T03:35:03.853 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T03:35:03.856 INFO:tasks.ceph.mon.b:Started 2024-09-17T03:35:03.856 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T03:35:03.857 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T03:35:03.860 INFO:tasks.ceph.mon.c:Started 2024-09-17T03:35:03.860 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T03:35:03.861 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T03:35:03.861 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T03:35:03.864 INFO:tasks.ceph.mgr.y:Started 2024-09-17T03:35:03.865 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T03:35:03.865 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T03:35:03.869 INFO:tasks.ceph.mgr.x:Started 2024-09-17T03:35:03.872 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T03:35:03.872 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T03:35:03.875 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T03:35:03.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T03:35:03.921 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T03:35:03.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T03:35:03.967 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T03:35:03.967 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T03:35:04.013 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T03:35:04.014 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T03:35:04.063 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T03:35:04.063 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T03:35:04.110 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T03:35:04.111 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T03:35:04.157 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T03:35:04.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T03:35:04.206 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T03:35:04.207 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T03:35:04.257 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T03:35:04.258 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T03:35:04.307 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T03:35:04.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T03:35:04.357 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T03:35:04.358 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T03:35:04.411 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T03:35:04.411 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T03:35:04.459 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T03:35:04.460 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T03:35:04.542 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T03:35:04.542 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T03:35:04.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.549+0000 7f42acc00640 1 -- 172.21.15.121:0/3760068852 <== mon.2 v2:172.21.15.176:3301/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v4)=0 v4) ==== 109+0+0 (secure 0 0 0) 0x7f42a80145e0 con 0x7f42b00aef90 2024-09-17T03:35:04.565 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T03:35:04.565 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T03:35:04.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.566+0000 7f42b6000640 1 -- 172.21.15.121:0/3760068852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b00aef90 msgr2=0x7f42b015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.581 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T03:35:04.582 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T03:35:04.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.566+0000 7f42b6000640 1 --2- 172.21.15.121:0/3760068852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b00aef90 0x7f42b015d7d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f42a800b6c0 tx=0x7f42a800bb80 comp rx=0 tx=0).stop 2024-09-17T03:35:04.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.574+0000 7f42b6000640 1 -- 172.21.15.121:0/3760068852 shutdown_connections 2024-09-17T03:35:04.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.574+0000 7f42b6000640 1 --2- 172.21.15.121:0/3760068852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b0155780 0x7f42b015dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.574+0000 7f42b6000640 1 --2- 172.21.15.121:0/3760068852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b00aef90 0x7f42b015d7d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.574+0000 7f42b6000640 1 --2- 172.21.15.121:0/3760068852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b0070050 0x7f42b0161d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.574+0000 7f42b6000640 1 -- 172.21.15.121:0/3760068852 >> 172.21.15.121:0/3760068852 conn(0x7f42b00cfec0 msgr2=0x7f42b00b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:04.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.574+0000 7f42b6000640 1 -- 172.21.15.121:0/3760068852 shutdown_connections 2024-09-17T03:35:04.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.574+0000 7f42b6000640 1 -- 172.21.15.121:0/3760068852 wait complete. 2024-09-17T03:35:04.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.600+0000 7f38bfe00640 1 -- 172.21.15.121:0/817611318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38c00b2e60 msgr2=0x7f38c015b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.600+0000 7f38bfe00640 1 --2- 172.21.15.121:0/817611318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38c00b2e60 0x7f38c015b380 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38c0072620 tx=0x7f38ac02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.615 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T03:35:04.615 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T03:35:04.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.608+0000 7f38bfe00640 1 -- 172.21.15.121:0/817611318 shutdown_connections 2024-09-17T03:35:04.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.608+0000 7f38bfe00640 1 --2- 172.21.15.121:0/817611318 >> v2:172.21.15.121:3300/0 conn(0x7f38c00734c0 0x7f38c00cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.608+0000 7f38bfe00640 1 --2- 172.21.15.121:0/817611318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38c00b2e60 0x7f38c015b380 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.608+0000 7f38bfe00640 1 -- 172.21.15.121:0/817611318 >> 172.21.15.121:0/817611318 conn(0x7f38c006cde0 msgr2=0x7f38c006d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.608+0000 7f38bfe00640 1 -- 172.21.15.121:0/817611318 shutdown_connections 2024-09-17T03:35:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.609+0000 7f38bfe00640 1 -- 172.21.15.121:0/817611318 wait complete. 2024-09-17T03:35:04.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.622+0000 7f38bfe00640 1 Processor -- start 2024-09-17T03:35:04.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.622+0000 7f38bfe00640 1 -- start start 2024-09-17T03:35:04.634 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T03:35:04.635 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T03:35:04.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.629+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38c00b2e60 0x7f38c01f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:04.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.629+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38c00cd9f0 0x7f38c0151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:04.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.629+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38c014e150 0x7f38c014d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:04.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.630+0000 7f38bea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38c00b2e60 0x7f38c01f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:04.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.630+0000 7f38bea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38c00b2e60 0x7f38c01f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:36864/0 (socket says 172.21.15.121:36864) 2024-09-17T03:35:04.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.635+0000 7f38bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38c014e150 0x7f38c014d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:04.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.635+0000 7f38bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38c014e150 0x7f38c014d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53788/0 (socket says 172.21.15.121:53788) 2024-09-17T03:35:04.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.635+0000 7f38bea00640 1 -- 172.21.15.121:0/3670138173 learned_addr learned my addr 172.21.15.121:0/3670138173 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:04.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.635+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f38c006f600 con 0x7f38c014e150 2024-09-17T03:35:04.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.635+0000 7f38be000640 1 --2- 172.21.15.121:0/3670138173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38c00cd9f0 0x7f38c0151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:04.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.635+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38c006f480 con 0x7f38c00b2e60 2024-09-17T03:35:04.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.635+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f38c006f780 con 0x7f38c00cd9f0 2024-09-17T03:35:04.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.639+0000 7f87c3a00640 1 -- 172.21.15.121:0/221521179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f87bc0cb2d0 con 0x7f87bc0cf2b0 2024-09-17T03:35:04.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.637+0000 7f38bea00640 1 -- 172.21.15.121:0/3670138173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38c00cd9f0 msgr2=0x7f38c0151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.637+0000 7f38bea00640 1 --2- 172.21.15.121:0/3670138173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38c00cd9f0 0x7f38c0151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.637+0000 7f38bea00640 1 -- 172.21.15.121:0/3670138173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38c014e150 msgr2=0x7f38c014d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.637+0000 7f38bea00640 1 --2- 172.21.15.121:0/3670138173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38c014e150 0x7f38c014d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.638+0000 7f38bea00640 1 -- 172.21.15.121:0/3670138173 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c0153aa0 con 0x7f38c00b2e60 2024-09-17T03:35:04.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.638+0000 7f38bf400640 1 --2- 172.21.15.121:0/3670138173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38c014e150 0x7f38c014d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:04.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.638+0000 7f38be000640 1 --2- 172.21.15.121:0/3670138173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38c00cd9f0 0x7f38c0151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:04.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.638+0000 7f38bea00640 1 --2- 172.21.15.121:0/3670138173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38c00b2e60 0x7f38c01f5a50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009920 tx=0x7f38ac033ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:04.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.639+0000 7f38b6a00640 1 -- 172.21.15.121:0/3670138173 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac031b50 con 0x7f38c00b2e60 2024-09-17T03:35:04.651 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T03:35:04.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T03:35:04.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.639+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c0153d80 con 0x7f38c00b2e60 2024-09-17T03:35:04.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.639+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c01f5530 con 0x7f38c00b2e60 2024-09-17T03:35:04.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.642+0000 7f38b6a00640 1 -- 172.21.15.121:0/3670138173 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f38ac031cf0 con 0x7f38c00b2e60 2024-09-17T03:35:04.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.642+0000 7f38b6a00640 1 -- 172.21.15.121:0/3670138173 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac005280 con 0x7f38c00b2e60 2024-09-17T03:35:04.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.656+0000 7f87b8c00640 1 -- 172.21.15.121:0/221521179 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f87bc0b3b40 con 0x7f87bc0cf2b0 2024-09-17T03:35:04.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.656+0000 7f87b8c00640 1 -- 172.21.15.121:0/221521179 <== mon.0 v2:172.21.15.121:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f87b400a970 con 0x7f87bc0cf2b0 2024-09-17T03:35:04.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.654+0000 7f38b6a00640 1 -- 172.21.15.121:0/3670138173 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38ac0047a0 con 0x7f38c00b2e60 2024-09-17T03:35:04.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.654+0000 7f38b6a00640 1 -- 172.21.15.121:0/3670138173 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f38ac033300 con 0x7f38c00b2e60 2024-09-17T03:35:04.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.655+0000 7f38b6a00640 1 -- 172.21.15.121:0/3670138173 <== mon.1 v2:172.21.15.176:3300/0 6 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f38ac0335d0 con 0x7f38c00b2e60 2024-09-17T03:35:04.673 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T03:35:04.673 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T03:35:04.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.665+0000 7f87c3a00640 1 -- 172.21.15.121:0/221521179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87bc0cf2b0 msgr2=0x7f87bc0c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.665+0000 7f87c3a00640 1 --2- 172.21.15.121:0/221521179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87bc0cf2b0 0x7f87bc0c85b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f87b400c8b0 tx=0x7f87b400cd70 comp rx=0 tx=0).stop 2024-09-17T03:35:04.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.665+0000 7f87c3a00640 1 -- 172.21.15.121:0/221521179 shutdown_connections 2024-09-17T03:35:04.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.665+0000 7f87c3a00640 1 --2- 172.21.15.121:0/221521179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87bc0cf2b0 0x7f87bc0c85b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.665+0000 7f87c3a00640 1 --2- 172.21.15.121:0/221521179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87bc0b9ad0 0x7f87bc0c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.665+0000 7f87c3a00640 1 --2- 172.21.15.121:0/221521179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87bc0b6920 0x7f87bc154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.665+0000 7f87c3a00640 1 -- 172.21.15.121:0/221521179 >> 172.21.15.121:0/221521179 conn(0x7f87bc09d830 msgr2=0x7f87bc0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:04.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.665+0000 7f87c3a00640 1 -- 172.21.15.121:0/221521179 shutdown_connections 2024-09-17T03:35:04.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.665+0000 7f87c3a00640 1 -- 172.21.15.121:0/221521179 wait complete. 2024-09-17T03:35:04.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.658+0000 7f3a78c00640 1 -- 172.21.15.121:0/2263552850 <== mon.2 v2:172.21.15.176:3301/0 8 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f3a7401d6f0 con 0x7f3a7c15f590 2024-09-17T03:35:04.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.666+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3894005290 con 0x7f38c00b2e60 2024-09-17T03:35:04.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.676+0000 7f38b6a00640 1 -- 172.21.15.121:0/3670138173 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f38ac03f030 con 0x7f38c00b2e60 2024-09-17T03:35:04.695 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T03:35:04.695 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T03:35:04.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.718+0000 7f6ce2e00640 1 -- 172.21.15.121:0/1443952277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc167410 msgr2=0x7f6cdc06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.718+0000 7f6ce2e00640 1 --2- 172.21.15.121:0/1443952277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc167410 0x7f6cdc06ddf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8005fd0 tx=0x7f6cc802a410 comp rx=0 tx=0).stop 2024-09-17T03:35:04.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.719+0000 7f6ce2e00640 1 -- 172.21.15.121:0/1443952277 shutdown_connections 2024-09-17T03:35:04.727 DEBUG:tasks.ceph:set 22 configs 2024-09-17T03:35:04.727 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi121') 2024-09-17T03:35:04.728 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi121') 2024-09-17T03:35:04.728 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi121') 2024-09-17T03:35:04.728 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi121') 2024-09-17T03:35:04.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.719+0000 7f6ce2e00640 1 --2- 172.21.15.121:0/1443952277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc06e330 0x7f6cdc162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.719+0000 7f6ce2e00640 1 --2- 172.21.15.121:0/1443952277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc167410 0x7f6cdc06ddf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.719+0000 7f6ce2e00640 1 -- 172.21.15.121:0/1443952277 >> 172.21.15.121:0/1443952277 conn(0x7f6cdc0b1b90 msgr2=0x7f6cdc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:04.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.722+0000 7f6ce2e00640 1 -- 172.21.15.121:0/1443952277 shutdown_connections 2024-09-17T03:35:04.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.732+0000 7f6ce2e00640 1 -- 172.21.15.121:0/1443952277 wait complete. 2024-09-17T03:35:04.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.745+0000 7f6ce2e00640 1 Processor -- start 2024-09-17T03:35:04.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.748+0000 7f6ce2e00640 1 -- start start 2024-09-17T03:35:04.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.751+0000 7f6ce2e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc06e330 0x7f6cdc1f9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:04.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.752+0000 7f6ce2e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc0ceb60 0x7f6cdc0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:04.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.752+0000 7f6cdbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc06e330 0x7f6cdc1f9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:04.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.752+0000 7f6cdbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc06e330 0x7f6cdc1f9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:55156/0 (socket says 172.21.15.121:55156) 2024-09-17T03:35:04.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.752+0000 7f6cdbe00640 1 -- 172.21.15.121:0/2116616200 learned_addr learned my addr 172.21.15.121:0/2116616200 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:04.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.753+0000 7f6cdb400640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc0ceb60 0x7f6cdc0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:04.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.754+0000 7f6ce2e00640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cdc167410 0x7f6cdc0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:04.756 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi121') 2024-09-17T03:35:04.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.755+0000 7f6ce0e00640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cdc167410 0x7f6cdc0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:04.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.755+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc163750 con 0x7f6cdc167410 2024-09-17T03:35:04.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.755+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc1635d0 con 0x7f6cdc0ceb60 2024-09-17T03:35:04.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.756+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6cdc1638d0 con 0x7f6cdc06e330 2024-09-17T03:35:04.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.757+0000 7f6ce0e00640 1 -- 172.21.15.121:0/2116616200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc06e330 msgr2=0x7f6cdc1f9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.757+0000 7f6ce0e00640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc06e330 0x7f6cdc1f9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.757+0000 7f6ce0e00640 1 -- 172.21.15.121:0/2116616200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc0ceb60 msgr2=0x7f6cdc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.757+0000 7f6ce0e00640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc0ceb60 0x7f6cdc0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.757+0000 7f6ce0e00640 1 -- 172.21.15.121:0/2116616200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc09ba40 con 0x7f6cdc167410 2024-09-17T03:35:04.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.758+0000 7f6ce0e00640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cdc167410 0x7f6cdc0b3720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4005fd0 tx=0x7f6cd400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:04.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.759+0000 7f6cdb400640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc0ceb60 0x7f6cdc0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:04.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.759+0000 7f6cd3e00640 1 -- 172.21.15.121:0/2116616200 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4004d20 con 0x7f6cdc167410 2024-09-17T03:35:04.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.760+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cdc1fa230 con 0x7f6cdc167410 2024-09-17T03:35:04.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.760+0000 7f6cd3e00640 1 -- 172.21.15.121:0/2116616200 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f6cd400ca60 con 0x7f6cdc167410 2024-09-17T03:35:04.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.760+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cdc1faad0 con 0x7f6cdc167410 2024-09-17T03:35:04.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.761+0000 7f6cd3e00640 1 -- 172.21.15.121:0/2116616200 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4004d20 con 0x7f6cdc167410 2024-09-17T03:35:04.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.764+0000 7f6cd3e00640 1 -- 172.21.15.121:0/2116616200 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6cd400cc10 con 0x7f6cdc167410 2024-09-17T03:35:04.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.764+0000 7f6cd3e00640 1 -- 172.21.15.121:0/2116616200 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6cd4005200 con 0x7f6cdc167410 2024-09-17T03:35:04.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.776+0000 7f3a81600640 1 -- 172.21.15.121:0/2263552850 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f3a4c005310 con 0x7f3a7c15f590 2024-09-17T03:35:04.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.785+0000 7f93d3e00640 1 -- 172.21.15.121:0/1851951327 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0037070 con 0x7f93d415c270 2024-09-17T03:35:04.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.788+0000 7f93d3e00640 1 -- 172.21.15.121:0/1851951327 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93c0032780 con 0x7f93d415c270 2024-09-17T03:35:04.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.788+0000 7f93dac00640 1 -- 172.21.15.121:0/1851951327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93d415c270 msgr2=0x7f93d406cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.788+0000 7f93dac00640 1 --2- 172.21.15.121:0/1851951327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93d415c270 0x7f93d406cde0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009830 tx=0x7f93c002a480 comp rx=0 tx=0).stop 2024-09-17T03:35:04.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.786+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cdc1fa620 con 0x7f6cdc167410 2024-09-17T03:35:04.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.789+0000 7f38b6a00640 1 -- 172.21.15.121:0/3670138173 <== mon.1 v2:172.21.15.176:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38ac0317a0 con 0x7f38c00b2e60 2024-09-17T03:35:04.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.789+0000 7f93dac00640 1 -- 172.21.15.121:0/1851951327 shutdown_connections 2024-09-17T03:35:04.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.789+0000 7f93dac00640 1 --2- 172.21.15.121:0/1851951327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93d415c270 0x7f93d406cde0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.789+0000 7f93dac00640 1 --2- 172.21.15.121:0/1851951327 >> v2:172.21.15.121:3300/0 conn(0x7f93d406e600 0x7f93d415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.789+0000 7f93dac00640 1 -- 172.21.15.121:0/1851951327 >> 172.21.15.121:0/1851951327 conn(0x7f93d40cfec0 msgr2=0x7f93d40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:04.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.788+0000 7f3a78c00640 1 -- 172.21.15.121:0/2263552850 <== mon.2 v2:172.21.15.176:3301/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a7401d6f0 con 0x7f3a7c15f590 2024-09-17T03:35:04.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.791+0000 7f93dac00640 1 -- 172.21.15.121:0/1851951327 shutdown_connections 2024-09-17T03:35:04.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.791+0000 7f93dac00640 1 -- 172.21.15.121:0/1851951327 wait complete. 2024-09-17T03:35:04.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.798+0000 7f3a78c00640 1 -- 172.21.15.121:0/2263552850 <== mon.2 v2:172.21.15.176:3301/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f3a7c1fa7a0 con 0x7f3a7c15f590 2024-09-17T03:35:04.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.801+0000 7f6cd3e00640 1 -- 172.21.15.121:0/2116616200 <== mon.0 v2:172.21.15.121:3300/0 6 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cd40054b0 con 0x7f6cdc167410 2024-09-17T03:35:04.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.804+0000 7f3a81600640 1 -- 172.21.15.121:0/2263552850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a7c15f590 msgr2=0x7f3a7c0ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.804+0000 7f3a81600640 1 --2- 172.21.15.121:0/2263552850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a7c15f590 0x7f3a7c0ab7f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400b6d0 tx=0x7f3a7400bb90 comp rx=0 tx=0).stop 2024-09-17T03:35:04.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.804+0000 7f3a81600640 1 -- 172.21.15.121:0/2263552850 shutdown_connections 2024-09-17T03:35:04.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.804+0000 7f3a81600640 1 --2- 172.21.15.121:0/2263552850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a7c15f590 0x7f3a7c0ab7f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.804+0000 7f3a81600640 1 --2- 172.21.15.121:0/2263552850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c070770 0x7f3a7c1fa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.804+0000 7f3a81600640 1 --2- 172.21.15.121:0/2263552850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a7c06dc40 0x7f3a7c1570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.804+0000 7f3a81600640 1 -- 172.21.15.121:0/2263552850 >> 172.21.15.121:0/2263552850 conn(0x7f3a7c0cfec0 msgr2=0x7f3a7c0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:04.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.804+0000 7f3a81600640 1 -- 172.21.15.121:0/2263552850 shutdown_connections 2024-09-17T03:35:04.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.804+0000 7f3a81600640 1 -- 172.21.15.121:0/2263552850 wait complete. 2024-09-17T03:35:04.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.809+0000 7f93dac00640 1 Processor -- start 2024-09-17T03:35:04.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.813+0000 7f93dac00640 1 -- start start 2024-09-17T03:35:04.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.823+0000 7f93dac00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d4152300 0x7f93d41513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:04.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.823+0000 7f93dac00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93d415c270 0x7f93d4151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:04.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.824+0000 7f93d9800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d4152300 0x7f93d41513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:04.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.824+0000 7f93d8e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93d415c270 0x7f93d4151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:04.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.824+0000 7f93d8e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93d415c270 0x7f93d4151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:36898/0 (socket says 172.21.15.121:36898) 2024-09-17T03:35:04.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.824+0000 7f93d9800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d4152300 0x7f93d41513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53816/0 (socket says 172.21.15.121:53816) 2024-09-17T03:35:04.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.824+0000 7f93d8e00640 1 -- 172.21.15.121:0/3374343458 learned_addr learned my addr 172.21.15.121:0/3374343458 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:04.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.824+0000 7f93dac00640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93d414ab00 0x7f93d4152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:04.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.825+0000 7f93da200640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93d414ab00 0x7f93d4152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:04.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.828+0000 7f6cd3e00640 1 -- 172.21.15.121:0/2116616200 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6cd4016030 con 0x7f6cdc167410 2024-09-17T03:35:04.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.828+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f93d406d6b0 con 0x7f93d4152300 2024-09-17T03:35:04.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.828+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f93d406d530 con 0x7f93d415c270 2024-09-17T03:35:04.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.828+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f93d406d830 con 0x7f93d414ab00 2024-09-17T03:35:04.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.837+0000 7f93da200640 1 -- 172.21.15.121:0/3374343458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93d415c270 msgr2=0x7f93d4151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.837+0000 7f93da200640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93d415c270 0x7f93d4151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.837+0000 7f93da200640 1 -- 172.21.15.121:0/3374343458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d4152300 msgr2=0x7f93d41513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.837+0000 7f93da200640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d4152300 0x7f93d41513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:04.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.837+0000 7f93da200640 1 -- 172.21.15.121:0/3374343458 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d4153c30 con 0x7f93d414ab00 2024-09-17T03:35:04.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.837+0000 7f93d9800640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d4152300 0x7f93d41513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:04.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.838+0000 7f93d8e00640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93d415c270 0x7f93d4151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:04.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.842+0000 7f93da200640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93d414ab00 0x7f93d4152970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93d4070d10 tx=0x7f93c00038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.843+0000 7f93d1600640 1 -- 172.21.15.121:0/3374343458 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c003f020 con 0x7f93d414ab00 2024-09-17T03:35:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.843+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d414ea80 con 0x7f93d414ab00 2024-09-17T03:35:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.845+0000 7f93d1600640 1 -- 172.21.15.121:0/3374343458 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93c0032e40 con 0x7f93d414ab00 2024-09-17T03:35:04.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.845+0000 7f93d1600640 1 -- 172.21.15.121:0/3374343458 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c003f020 con 0x7f93d414ab00 2024-09-17T03:35:04.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.845+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d414f040 con 0x7f93d414ab00 2024-09-17T03:35:04.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.865+0000 7f93d1600640 1 -- 172.21.15.121:0/3374343458 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f93c0042020 con 0x7f93d414ab00 2024-09-17T03:35:04.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.866+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b0005290 con 0x7f93d414ab00 2024-09-17T03:35:04.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.873+0000 7f93d1600640 1 -- 172.21.15.121:0/3374343458 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f93c003ba50 con 0x7f93d414ab00 2024-09-17T03:35:04.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.882+0000 7f93d1600640 1 -- 172.21.15.121:0/3374343458 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f93c0049070 con 0x7f93d414ab00 2024-09-17T03:35:04.917 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi121') 2024-09-17T03:35:04.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.997+0000 7f5c26e00640 1 -- 172.21.15.121:0/8642548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c18035cd0 msgr2=0x7f5c180e0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:04.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:04.997+0000 7f5c26e00640 1 --2- 172.21.15.121:0/8642548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c18035cd0 0x7f5c180e0e80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009830 tx=0x7f5c1402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.002+0000 7f5c26e00640 1 -- 172.21.15.121:0/8642548 shutdown_connections 2024-09-17T03:35:05.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.002+0000 7f5c26e00640 1 --2- 172.21.15.121:0/8642548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c18006310 0x7f5c18031670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.002+0000 7f5c26e00640 1 --2- 172.21.15.121:0/8642548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c18035cd0 0x7f5c180e0e80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.002+0000 7f5c26e00640 1 -- 172.21.15.121:0/8642548 >> 172.21.15.121:0/8642548 conn(0x7f5c1801d9a0 msgr2=0x7f5c18039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.004+0000 7f3597200640 1 -- 172.21.15.121:0/1527095129 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358803b070 con 0x7f35980ad2b0 2024-09-17T03:35:05.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.007+0000 7f5c26e00640 1 -- 172.21.15.121:0/8642548 shutdown_connections 2024-09-17T03:35:05.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.010+0000 7f359d000640 1 -- 172.21.15.121:0/1527095129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35980ad2b0 msgr2=0x7f35980ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.010+0000 7f359d000640 1 --2- 172.21.15.121:0/1527095129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35980ad2b0 0x7f35980ad6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3588005fd0 tx=0x7f358802e830 comp rx=0 tx=0).stop 2024-09-17T03:35:05.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.011+0000 7f359d000640 1 -- 172.21.15.121:0/1527095129 shutdown_connections 2024-09-17T03:35:05.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.011+0000 7f359d000640 1 --2- 172.21.15.121:0/1527095129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35980ad2b0 0x7f35980ad6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.011+0000 7f359d000640 1 --2- 172.21.15.121:0/1527095129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f359815e840 0x7f359815ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.011+0000 7f359d000640 1 -- 172.21.15.121:0/1527095129 >> 172.21.15.121:0/1527095129 conn(0x7f35980d0010 msgr2=0x7f35980d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.015+0000 7f5c26e00640 1 -- 172.21.15.121:0/8642548 wait complete. 2024-09-17T03:35:05.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.018+0000 7f359d000640 1 -- 172.21.15.121:0/1527095129 shutdown_connections 2024-09-17T03:35:05.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.019+0000 7f359d000640 1 -- 172.21.15.121:0/1527095129 wait complete. 2024-09-17T03:35:05.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.031+0000 7f359d000640 1 Processor -- start 2024-09-17T03:35:05.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.031+0000 7f359d000640 1 -- start start 2024-09-17T03:35:05.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.034+0000 7f359d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35980ad2b0 0x7f35981f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.035+0000 7f359d000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35980cdbe0 0x7f35981f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.035+0000 7f3595400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35980ad2b0 0x7f35981f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.035+0000 7f3595400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35980ad2b0 0x7f35981f11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:55172/0 (socket says 172.21.15.121:55172) 2024-09-17T03:35:05.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.035+0000 7f3595400640 1 -- 172.21.15.121:0/3037524584 learned_addr learned my addr 172.21.15.121:0/3037524584 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.035+0000 7f359d000640 1 --2- 172.21.15.121:0/3037524584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f359815e840 0x7f35981f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.035+0000 7f359d000640 1 -- 172.21.15.121:0/3037524584 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f35980acfe0 con 0x7f359815e840 2024-09-17T03:35:05.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.035+0000 7f359d000640 1 -- 172.21.15.121:0/3037524584 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35980ace60 con 0x7f35980cdbe0 2024-09-17T03:35:05.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.035+0000 7f359d000640 1 -- 172.21.15.121:0/3037524584 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f359806ece0 con 0x7f35980ad2b0 2024-09-17T03:35:05.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.036+0000 7f3594a00640 1 --2- 172.21.15.121:0/3037524584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35980cdbe0 0x7f35981f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.037+0000 7f5c26e00640 1 Processor -- start 2024-09-17T03:35:05.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.037+0000 7f5c26e00640 1 -- start start 2024-09-17T03:35:05.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.043+0000 7f3595e00640 1 --2- 172.21.15.121:0/3037524584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f359815e840 0x7f35981f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.043+0000 7f3594a00640 1 -- 172.21.15.121:0/3037524584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35980ad2b0 msgr2=0x7f35981f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.043+0000 7f3594a00640 1 --2- 172.21.15.121:0/3037524584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35980ad2b0 0x7f35981f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.043+0000 7f3594a00640 1 -- 172.21.15.121:0/3037524584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f359815e840 msgr2=0x7f35981f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.043+0000 7f3594a00640 1 --2- 172.21.15.121:0/3037524584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f359815e840 0x7f35981f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.043+0000 7f3594a00640 1 -- 172.21.15.121:0/3037524584 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35981f1fa0 con 0x7f35980cdbe0 2024-09-17T03:35:05.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.045+0000 7f5c26e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c18006310 0x7f5c180d7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.045+0000 7f5c26e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c180072e0 0x7f5c180e3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.045+0000 7f5c26e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c18035cd0 0x7f5c180df460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.045+0000 7f5c26e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18032190 con 0x7f5c180072e0 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.045+0000 7f5c26e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18032010 con 0x7f5c18035cd0 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.045+0000 7f5c26e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5c18032310 con 0x7f5c18006310 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.048+0000 7f5c25000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c180072e0 0x7f5c180e3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.048+0000 7f5c25000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c180072e0 0x7f5c180e3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53852/0 (socket says 172.21.15.121:53852) 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.048+0000 7f5c25000640 1 -- 172.21.15.121:0/1048185551 learned_addr learned my addr 172.21.15.121:0/1048185551 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.049+0000 7f5c25a00640 1 --2- 172.21.15.121:0/1048185551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c18006310 0x7f5c180d7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.049+0000 7f5c26400640 1 --2- 172.21.15.121:0/1048185551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c18035cd0 0x7f5c180df460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.049+0000 7f5c25000640 1 -- 172.21.15.121:0/1048185551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c18006310 msgr2=0x7f5c180d7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.049+0000 7f5c25000640 1 --2- 172.21.15.121:0/1048185551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c18006310 0x7f5c180d7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.049+0000 7f5c25000640 1 -- 172.21.15.121:0/1048185551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c18035cd0 msgr2=0x7f5c180df460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.049+0000 7f5c25000640 1 --2- 172.21.15.121:0/1048185551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c18035cd0 0x7f5c180df460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.049+0000 7f5c25000640 1 -- 172.21.15.121:0/1048185551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c180d95f0 con 0x7f5c180072e0 2024-09-17T03:35:05.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.044+0000 7f3594a00640 1 --2- 172.21.15.121:0/3037524584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35980cdbe0 0x7f35981f1720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3584007830 tx=0x7f3584007cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.050+0000 7f358e000640 1 -- 172.21.15.121:0/3037524584 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584017020 con 0x7f35980cdbe0 2024-09-17T03:35:05.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.051+0000 7f358e000640 1 -- 172.21.15.121:0/3037524584 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f358400dab0 con 0x7f35980cdbe0 2024-09-17T03:35:05.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.051+0000 7f358e000640 1 -- 172.21.15.121:0/3037524584 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584007e20 con 0x7f35980cdbe0 2024-09-17T03:35:05.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.051+0000 7f359d000640 1 -- 172.21.15.121:0/3037524584 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3598153e20 con 0x7f35980cdbe0 2024-09-17T03:35:05.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.051+0000 7f359d000640 1 -- 172.21.15.121:0/3037524584 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35981543e0 con 0x7f35980cdbe0 2024-09-17T03:35:05.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.053+0000 7f3583400640 1 -- 172.21.15.121:0/3037524584 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356c005290 con 0x7f35980cdbe0 2024-09-17T03:35:05.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.054+0000 7f358e000640 1 -- 172.21.15.121:0/3037524584 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f358401a020 con 0x7f35980cdbe0 2024-09-17T03:35:05.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.056+0000 7f358e000640 1 -- 172.21.15.121:0/3037524584 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f35840134f0 con 0x7f35980cdbe0 2024-09-17T03:35:05.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.067+0000 7f5c25000640 1 --2- 172.21.15.121:0/1048185551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c180072e0 0x7f5c180e3fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009950 tx=0x7f5c14003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.067+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f3894005580 con 0x7f38c00b2e60 2024-09-17T03:35:05.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.068+0000 7f358e000640 1 -- 172.21.15.121:0/3037524584 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3584021020 con 0x7f35980cdbe0 2024-09-17T03:35:05.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.068+0000 7f5c1d600640 1 -- 172.21.15.121:0/1048185551 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c140317b0 con 0x7f5c180072e0 2024-09-17T03:35:05.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.075+0000 7f5c26e00640 1 -- 172.21.15.121:0/1048185551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c180d98d0 con 0x7f5c180072e0 2024-09-17T03:35:05.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.075+0000 7f5c26e00640 1 -- 172.21.15.121:0/1048185551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c180d9e90 con 0x7f5c180072e0 2024-09-17T03:35:05.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.075+0000 7f5c1d600640 1 -- 172.21.15.121:0/1048185551 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c14031a40 con 0x7f5c180072e0 2024-09-17T03:35:05.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.075+0000 7f5c1d600640 1 -- 172.21.15.121:0/1048185551 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c140317b0 con 0x7f5c180072e0 2024-09-17T03:35:05.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.077+0000 7f5c12a00640 1 -- 172.21.15.121:0/1048185551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf4005290 con 0x7f5c180072e0 2024-09-17T03:35:05.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.085+0000 7f5c1d600640 1 -- 172.21.15.121:0/1048185551 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c14031c10 con 0x7f5c180072e0 2024-09-17T03:35:05.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.085+0000 7f5c1d600640 1 -- 172.21.15.121:0/1048185551 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5c14043400 con 0x7f5c180072e0 2024-09-17T03:35:05.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.119+0000 7f38b6a00640 1 -- 172.21.15.121:0/3670138173 <== mon.1 v2:172.21.15.176:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f38ac033780 con 0x7f38c00b2e60 2024-09-17T03:35:05.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.122+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f6cdc162bd0 con 0x7f6cdc167410 2024-09-17T03:35:05.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.122+0000 7f5c1d600640 1 -- 172.21.15.121:0/1048185551 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5c14052080 con 0x7f5c180072e0 2024-09-17T03:35:05.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.122+0000 7fac31200640 1 -- 172.21.15.121:0/3904894342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac2c06e460 msgr2=0x7fac2c06ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.122+0000 7fac31200640 1 --2- 172.21.15.121:0/3904894342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac2c06e460 0x7fac2c06ece0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fac2c06b270 tx=0x7fac1c02c840 comp rx=0 tx=0).stop 2024-09-17T03:35:05.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.127+0000 7fac31200640 1 -- 172.21.15.121:0/3904894342 shutdown_connections 2024-09-17T03:35:05.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.130+0000 7fac31200640 1 --2- 172.21.15.121:0/3904894342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac2c06e460 0x7fac2c06ece0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.130+0000 7fac31200640 1 --2- 172.21.15.121:0/3904894342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac2c0ae0f0 0x7fac2c06df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.130+0000 7fac31200640 1 --2- 172.21.15.121:0/3904894342 >> v2:172.21.15.176:3300/0 conn(0x7fac2c154df0 0x7fac2c0cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.130+0000 7fac31200640 1 -- 172.21.15.121:0/3904894342 >> 172.21.15.121:0/3904894342 conn(0x7fac2c0cca90 msgr2=0x7fac2c0ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.134+0000 7f6cd3e00640 1 -- 172.21.15.121:0/2116616200 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f6cd40056c0 con 0x7f6cdc167410 2024-09-17T03:35:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.134+0000 7fac31200640 1 -- 172.21.15.121:0/3904894342 shutdown_connections 2024-09-17T03:35:05.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.134+0000 7fac31200640 1 -- 172.21.15.121:0/3904894342 wait complete. 2024-09-17T03:35:05.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.140+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cdc167410 msgr2=0x7f6cdc0b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.140+0000 7f6ce2e00640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cdc167410 0x7f6cdc0b3720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4005fd0 tx=0x7f6cd400ed30 comp rx=0 tx=0).stop 2024-09-17T03:35:05.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.141+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 shutdown_connections 2024-09-17T03:35:05.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.142+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38c00b2e60 msgr2=0x7f38c01f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.142+0000 7f38bfe00640 1 --2- 172.21.15.121:0/3670138173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38c00b2e60 0x7f38c01f5a50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009920 tx=0x7f38ac033ba0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.141+0000 7f6ce2e00640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cdc167410 0x7f6cdc0b3720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.141+0000 7f6ce2e00640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc0ceb60 0x7f6cdc0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.141+0000 7f6ce2e00640 1 --2- 172.21.15.121:0/2116616200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc06e330 0x7f6cdc1f9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.142+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 >> 172.21.15.121:0/2116616200 conn(0x7f6cdc0b1b90 msgr2=0x7f6cdc165ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.142+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 shutdown_connections 2024-09-17T03:35:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.142+0000 7f38bfe00640 1 --2- 172.21.15.121:0/3670138173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38c014e150 0x7f38c014d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.142+0000 7f38bfe00640 1 --2- 172.21.15.121:0/3670138173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38c00cd9f0 0x7f38c0151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.142+0000 7f38bfe00640 1 --2- 172.21.15.121:0/3670138173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38c00b2e60 0x7f38c01f5a50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.142+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 >> 172.21.15.121:0/3670138173 conn(0x7f38c006cde0 msgr2=0x7f38c006e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.142+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 shutdown_connections 2024-09-17T03:35:05.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.142+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 shutdown_connections 2024-09-17T03:35:05.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.143+0000 7f38bfe00640 1 -- 172.21.15.121:0/3670138173 wait complete. 2024-09-17T03:35:05.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.143+0000 7f6ce2e00640 1 -- 172.21.15.121:0/2116616200 wait complete. 2024-09-17T03:35:05.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.146+0000 7fac31200640 1 Processor -- start 2024-09-17T03:35:05.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.146+0000 7fac31200640 1 -- start start 2024-09-17T03:35:05.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.148+0000 7fac31200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac2c06e460 0x7fac2c15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.148+0000 7fac31200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac2c0ae0f0 0x7fac2c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.151+0000 7fac29400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac2c06e460 0x7fac2c15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.151+0000 7fac29400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac2c06e460 0x7fac2c15c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:36928/0 (socket says 172.21.15.121:36928) 2024-09-17T03:35:05.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.151+0000 7fac28a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac2c0ae0f0 0x7fac2c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.151+0000 7fac28a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac2c0ae0f0 0x7fac2c156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:55190/0 (socket says 172.21.15.121:55190) 2024-09-17T03:35:05.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.151+0000 7fac31200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac2c154df0 0x7fac2c0ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.151+0000 7fac29e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac2c154df0 0x7fac2c0ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.151+0000 7fac29e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac2c154df0 0x7fac2c0ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53870/0 (socket says 172.21.15.121:53870) 2024-09-17T03:35:05.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.151+0000 7fac29400640 1 -- 172.21.15.121:0/1809644451 learned_addr learned my addr 172.21.15.121:0/1809644451 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.152+0000 7fac31200640 1 -- 172.21.15.121:0/1809644451 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c06f3a0 con 0x7fac2c154df0 2024-09-17T03:35:05.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.152+0000 7fac31200640 1 -- 172.21.15.121:0/1809644451 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c06f220 con 0x7fac2c06e460 2024-09-17T03:35:05.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.152+0000 7fac31200640 1 -- 172.21.15.121:0/1809644451 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac2c06f520 con 0x7fac2c0ae0f0 2024-09-17T03:35:05.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.153+0000 7fac29e00640 1 -- 172.21.15.121:0/1809644451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac2c0ae0f0 msgr2=0x7fac2c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.153+0000 7fac29e00640 1 --2- 172.21.15.121:0/1809644451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac2c0ae0f0 0x7fac2c156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.153+0000 7fac29e00640 1 -- 172.21.15.121:0/1809644451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac2c06e460 msgr2=0x7fac2c15c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.153+0000 7fac29e00640 1 --2- 172.21.15.121:0/1809644451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac2c06e460 0x7fac2c15c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.153+0000 7fac29e00640 1 -- 172.21.15.121:0/1809644451 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2c1f9a20 con 0x7fac2c154df0 2024-09-17T03:35:05.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.154+0000 7fac29400640 1 --2- 172.21.15.121:0/1809644451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac2c06e460 0x7fac2c15c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:05.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.154+0000 7fac29e00640 1 --2- 172.21.15.121:0/1809644451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac2c154df0 0x7fac2c0ace60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0cdb10 tx=0x7fac1c00a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.155+0000 7fac22000640 1 -- 172.21.15.121:0/1809644451 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c039040 con 0x7fac2c154df0 2024-09-17T03:35:05.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.155+0000 7fac31200640 1 -- 172.21.15.121:0/1809644451 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2c1f9d00 con 0x7fac2c154df0 2024-09-17T03:35:05.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.155+0000 7fac31200640 1 -- 172.21.15.121:0/1809644451 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2c1fa2c0 con 0x7fac2c154df0 2024-09-17T03:35:05.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.157+0000 7fac17400640 1 -- 172.21.15.121:0/1809644451 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2c15d030 con 0x7fac2c154df0 2024-09-17T03:35:05.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.158+0000 7fac22000640 1 -- 172.21.15.121:0/1809644451 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac1c00a0d0 con 0x7fac2c154df0 2024-09-17T03:35:05.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.159+0000 7fac22000640 1 -- 172.21.15.121:0/1809644451 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c039040 con 0x7fac2c154df0 2024-09-17T03:35:05.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.161+0000 7fac22000640 1 -- 172.21.15.121:0/1809644451 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fac1c0043d0 con 0x7fac2c154df0 2024-09-17T03:35:05.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.164+0000 7fac22000640 1 -- 172.21.15.121:0/1809644451 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fac1c00a620 con 0x7fac2c154df0 2024-09-17T03:35:05.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.166+0000 7fac22000640 1 -- 172.21.15.121:0/1809644451 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fac1c04b020 con 0x7fac2c154df0 2024-09-17T03:35:05.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.214+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f93b0005580 con 0x7f93d414ab00 2024-09-17T03:35:05.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.245+0000 7f93d1600640 1 -- 172.21.15.121:0/3374343458 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f93c0049070 con 0x7f93d414ab00 2024-09-17T03:35:05.251 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.251+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93d414ab00 msgr2=0x7f93d4152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.252+0000 7f93dac00640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93d414ab00 0x7f93d4152970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93d4070d10 tx=0x7f93c00038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.252+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 shutdown_connections 2024-09-17T03:35:05.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.252+0000 7f93dac00640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93d414ab00 0x7f93d4152970 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.252+0000 7f93dac00640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93d415c270 0x7f93d4151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.252+0000 7f93dac00640 1 --2- 172.21.15.121:0/3374343458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93d4152300 0x7f93d41513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.252+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 >> 172.21.15.121:0/3374343458 conn(0x7f93d40cfec0 msgr2=0x7f93d40ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.254+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 shutdown_connections 2024-09-17T03:35:05.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.254+0000 7f93dac00640 1 -- 172.21.15.121:0/3374343458 wait complete. 2024-09-17T03:35:05.267 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.280+0000 7f7d36800640 1 -- 172.21.15.121:0/489589262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300aee70 msgr2=0x7f7d30072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.280+0000 7f7d36800640 1 --2- 172.21.15.121:0/489589262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300aee70 0x7f7d30072f90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7d300b26b0 tx=0x7f7d1802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.283+0000 7f7d36800640 1 -- 172.21.15.121:0/489589262 shutdown_connections 2024-09-17T03:35:05.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.283+0000 7f7d36800640 1 --2- 172.21.15.121:0/489589262 >> v2:172.21.15.121:3300/0 conn(0x7f7d30162450 0x7f7d30162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.283+0000 7f7d36800640 1 --2- 172.21.15.121:0/489589262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300aee70 0x7f7d30072f90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.283+0000 7f7d36800640 1 -- 172.21.15.121:0/489589262 >> 172.21.15.121:0/489589262 conn(0x7f7d300b1b90 msgr2=0x7f7d300b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.287+0000 7f7d36800640 1 -- 172.21.15.121:0/489589262 shutdown_connections 2024-09-17T03:35:05.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.287+0000 7f7d36800640 1 -- 172.21.15.121:0/489589262 wait complete. 2024-09-17T03:35:05.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.295+0000 7f7d36800640 1 Processor -- start 2024-09-17T03:35:05.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.296+0000 7f7d36800640 1 -- start start 2024-09-17T03:35:05.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.300+0000 7fdd36800640 1 -- 172.21.15.121:0/2312141059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd3006def0 msgr2=0x7fdd3006e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.300+0000 7fdd36800640 1 --2- 172.21.15.121:0/2312141059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd3006def0 0x7fdd3006e300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdd3006eab0 tx=0x7fdd2802a910 comp rx=0 tx=0).stop 2024-09-17T03:35:05.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.301+0000 7fdd36800640 1 -- 172.21.15.121:0/2312141059 shutdown_connections 2024-09-17T03:35:05.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.301+0000 7fdd36800640 1 --2- 172.21.15.121:0/2312141059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd3006def0 0x7fdd3006e300 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.301+0000 7fdd36800640 1 --2- 172.21.15.121:0/2312141059 >> v2:172.21.15.176:3300/0 conn(0x7fdd300b33f0 0x7fdd3015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.301+0000 7fdd36800640 1 -- 172.21.15.121:0/2312141059 >> 172.21.15.121:0/2312141059 conn(0x7fdd3006f920 msgr2=0x7fdd300b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.306+0000 7fdd36800640 1 -- 172.21.15.121:0/2312141059 shutdown_connections 2024-09-17T03:35:05.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.306+0000 7fdd36800640 1 -- 172.21.15.121:0/2312141059 wait complete. 2024-09-17T03:35:05.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.311+0000 7f7d36800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300aee70 0x7f7d3015df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.311+0000 7fac17400640 1 -- 172.21.15.121:0/1809644451 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fac2c06df20 con 0x7fac2c154df0 2024-09-17T03:35:05.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.313+0000 7f7d36800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300cc160 0x7f7d301fb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.314+0000 7f7d36800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d30162450 0x7f7d301fba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.314+0000 7f7d2f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300aee70 0x7f7d3015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.317+0000 7fdd36800640 1 Processor -- start 2024-09-17T03:35:05.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.317+0000 7fdd36800640 1 -- start start 2024-09-17T03:35:05.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.315+0000 7f7d2f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300aee70 0x7f7d3015df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:55202/0 (socket says 172.21.15.121:55202) 2024-09-17T03:35:05.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.318+0000 7f7d2f400640 1 -- 172.21.15.121:0/2746012966 learned_addr learned my addr 172.21.15.121:0/2746012966 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.318+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3006df70 con 0x7f7d30162450 2024-09-17T03:35:05.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.318+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3006ddf0 con 0x7f7d300cc160 2024-09-17T03:35:05.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.318+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3006e0f0 con 0x7f7d300aee70 2024-09-17T03:35:05.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.319+0000 7f7d26a00640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300cc160 0x7f7d301fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.320+0000 7f7d2fe00640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d30162450 0x7f7d301fba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.321+0000 7f7d2f400640 1 -- 172.21.15.121:0/2746012966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300cc160 msgr2=0x7f7d301fb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.321+0000 7f7d2f400640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300cc160 0x7f7d301fb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.322+0000 7f7d2f400640 1 -- 172.21.15.121:0/2746012966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d30162450 msgr2=0x7f7d301fba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.322+0000 7fac22000640 1 -- 172.21.15.121:0/1809644451 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fac1c0083a0 con 0x7fac2c154df0 2024-09-17T03:35:05.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.324+0000 7fdd36800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3006def0 0x7fdd30153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.324+0000 7fdd36800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd300b33f0 0x7fdd301f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.324+0000 7fdd35400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3006def0 0x7fdd30153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.324+0000 7fdd35400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3006def0 0x7fdd30153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:36968/0 (socket says 172.21.15.121:36968) 2024-09-17T03:35:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.325+0000 7fdd36800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd300cdf50 0x7fdd30152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.325+0000 7fdd34a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd300b33f0 0x7fdd301f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.325+0000 7fdd34a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd300b33f0 0x7fdd301f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:55218/0 (socket says 172.21.15.121:55218) 2024-09-17T03:35:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.325+0000 7fdd35400640 1 -- 172.21.15.121:0/3246953400 learned_addr learned my addr 172.21.15.121:0/3246953400 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.325+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3006d440 con 0x7fdd300cdf50 2024-09-17T03:35:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.325+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3006d2c0 con 0x7fdd3006def0 2024-09-17T03:35:05.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.325+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3006d5c0 con 0x7fdd300b33f0 2024-09-17T03:35:05.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.322+0000 7f7d2f400640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d30162450 0x7f7d301fba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.326+0000 7fdd34a00640 1 -- 172.21.15.121:0/3246953400 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3006def0 msgr2=0x7fdd30153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.326+0000 7fdd34a00640 1 --2- 172.21.15.121:0/3246953400 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3006def0 0x7fdd30153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.326+0000 7fdd34a00640 1 -- 172.21.15.121:0/3246953400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd300cdf50 msgr2=0x7fdd30152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.325+0000 7f7d2f400640 1 -- 172.21.15.121:0/2746012966 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3009f590 con 0x7f7d300aee70 2024-09-17T03:35:05.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.325+0000 7f7d2fe00640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d30162450 0x7f7d301fba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:05.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.326+0000 7f7d26a00640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300cc160 0x7f7d301fb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:05.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.326+0000 7fdd34a00640 1 --2- 172.21.15.121:0/3246953400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd300cdf50 0x7fdd30152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.326+0000 7f7d2f400640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300aee70 0x7f7d3015df10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009910 tx=0x7f7d18005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.327+0000 7fac17400640 1 -- 172.21.15.121:0/1809644451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac2c154df0 msgr2=0x7fac2c0ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.327+0000 7fac17400640 1 --2- 172.21.15.121:0/1809644451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac2c154df0 0x7fac2c0ace60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0cdb10 tx=0x7fac1c00a4b0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.327+0000 7fac17400640 1 -- 172.21.15.121:0/1809644451 shutdown_connections 2024-09-17T03:35:05.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.327+0000 7fac17400640 1 --2- 172.21.15.121:0/1809644451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac2c154df0 0x7fac2c0ace60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.327+0000 7fac17400640 1 --2- 172.21.15.121:0/1809644451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac2c0ae0f0 0x7fac2c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.327+0000 7fac17400640 1 --2- 172.21.15.121:0/1809644451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac2c06e460 0x7fac2c15c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.327+0000 7fac17400640 1 -- 172.21.15.121:0/1809644451 >> 172.21.15.121:0/1809644451 conn(0x7fac2c0cca90 msgr2=0x7fac2c0b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.328+0000 7f7d27e00640 1 -- 172.21.15.121:0/2746012966 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1803f070 con 0x7f7d300aee70 2024-09-17T03:35:05.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.328+0000 7fac17400640 1 -- 172.21.15.121:0/1809644451 shutdown_connections 2024-09-17T03:35:05.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.328+0000 7f7d27e00640 1 -- 172.21.15.121:0/2746012966 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d18004320 con 0x7f7d300aee70 2024-09-17T03:35:05.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.328+0000 7f7d27e00640 1 -- 172.21.15.121:0/2746012966 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d18031bb0 con 0x7f7d300aee70 2024-09-17T03:35:05.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.329+0000 7fac17400640 1 -- 172.21.15.121:0/1809644451 wait complete. 2024-09-17T03:35:05.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.330+0000 7fdd34a00640 1 -- 172.21.15.121:0/3246953400 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd301f1db0 con 0x7fdd300b33f0 2024-09-17T03:35:05.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.329+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3009f870 con 0x7f7d300aee70 2024-09-17T03:35:05.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.329+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d301fc5d0 con 0x7f7d300aee70 2024-09-17T03:35:05.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.336+0000 7f7d27e00640 1 -- 172.21.15.121:0/2746012966 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d18042070 con 0x7f7d300aee70 2024-09-17T03:35:05.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.336+0000 7f7d27e00640 1 -- 172.21.15.121:0/2746012966 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7d180047a0 con 0x7f7d300aee70 2024-09-17T03:35:05.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.339+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d08005290 con 0x7f7d300aee70 2024-09-17T03:35:05.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.343+0000 7f7d27e00640 1 -- 172.21.15.121:0/2746012966 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7d18031770 con 0x7f7d300aee70 2024-09-17T03:35:05.351 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.363+0000 7fdd34a00640 1 --2- 172.21.15.121:0/3246953400 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd300b33f0 0x7fdd301f1870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00b3e0 tx=0x7fdd1c00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.363+0000 7fdd2d600640 1 -- 172.21.15.121:0/3246953400 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c015030 con 0x7fdd300b33f0 2024-09-17T03:35:05.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.364+0000 7fdd2d600640 1 -- 172.21.15.121:0/3246953400 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd1c004020 con 0x7fdd300b33f0 2024-09-17T03:35:05.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.364+0000 7fdd2d600640 1 -- 172.21.15.121:0/3246953400 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c004470 con 0x7fdd300b33f0 2024-09-17T03:35:05.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.376+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd30152f50 con 0x7fdd300b33f0 2024-09-17T03:35:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.376+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd30153510 con 0x7fdd300b33f0 2024-09-17T03:35:05.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.378+0000 7fdd2d600640 1 -- 172.21.15.121:0/3246953400 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdd1c018070 con 0x7fdd300b33f0 2024-09-17T03:35:05.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.384+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3006db00 con 0x7fdd300b33f0 2024-09-17T03:35:05.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.385+0000 7fdd2d600640 1 -- 172.21.15.121:0/3246953400 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdd1c01a460 con 0x7fdd300b33f0 2024-09-17T03:35:05.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.387+0000 7fdd2d600640 1 -- 172.21.15.121:0/3246953400 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdd301f1db0 con 0x7fdd300b33f0 2024-09-17T03:35:05.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.422+0000 7f549cc00640 1 -- 172.21.15.121:0/1281922986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54980cf6b0 msgr2=0x7f549815f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.422+0000 7f549cc00640 1 --2- 172.21.15.121:0/1281922986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54980cf6b0 0x7f549815f5b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5480009860 tx=0x7f548002a3b0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.428+0000 7f549cc00640 1 -- 172.21.15.121:0/1281922986 shutdown_connections 2024-09-17T03:35:05.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.428+0000 7f549cc00640 1 --2- 172.21.15.121:0/1281922986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54980cf6b0 0x7f549815f5b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.428+0000 7f549cc00640 1 -- 172.21.15.121:0/1281922986 >> 172.21.15.121:0/1281922986 conn(0x7f54980b1b90 msgr2=0x7f54980b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.435+0000 7fc1c6a00640 1 -- 172.21.15.121:0/2861973515 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8031600 con 0x7fc1c80d3180 2024-09-17T03:35:05.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.438+0000 7f549cc00640 1 -- 172.21.15.121:0/1281922986 shutdown_connections 2024-09-17T03:35:05.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.438+0000 7f549cc00640 1 -- 172.21.15.121:0/1281922986 wait complete. 2024-09-17T03:35:05.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.438+0000 7f139d400640 1 -- 172.21.15.121:0/1005608008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13900e8410 msgr2=0x7f1390050f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.438+0000 7f139d400640 1 --2- 172.21.15.121:0/1005608008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13900e8410 0x7f1390050f90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1384005fd0 tx=0x7f138402a560 comp rx=0 tx=0).stop 2024-09-17T03:35:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.438+0000 7fc1cee00640 1 -- 172.21.15.121:0/2861973515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1c80d3180 msgr2=0x7fc1c80d3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.438+0000 7fc1cee00640 1 --2- 172.21.15.121:0/2861973515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1c80d3180 0x7fc1c80d3590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009830 tx=0x7fc1b802a560 comp rx=0 tx=0).stop 2024-09-17T03:35:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.438+0000 7fc1cee00640 1 -- 172.21.15.121:0/2861973515 shutdown_connections 2024-09-17T03:35:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.438+0000 7fc1cee00640 1 --2- 172.21.15.121:0/2861973515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1c80d3180 0x7fc1c80d3590 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.438+0000 7fc1cee00640 1 --2- 172.21.15.121:0/2861973515 >> v2:172.21.15.121:3300/0 conn(0x7fc1c806e8c0 0x7fc1c80cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.439+0000 7fc1cee00640 1 -- 172.21.15.121:0/2861973515 >> 172.21.15.121:0/2861973515 conn(0x7fc1c80d1930 msgr2=0x7fc1c80d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.439+0000 7fc1cee00640 1 -- 172.21.15.121:0/2861973515 shutdown_connections 2024-09-17T03:35:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.439+0000 7fc1cee00640 1 -- 172.21.15.121:0/2861973515 wait complete. 2024-09-17T03:35:05.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.443+0000 7f549cc00640 1 Processor -- start 2024-09-17T03:35:05.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.443+0000 7f549cc00640 1 -- start start 2024-09-17T03:35:05.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.443+0000 7fc1cee00640 1 Processor -- start 2024-09-17T03:35:05.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.433+0000 7f5c12a00640 1 -- 172.21.15.121:0/1048185551 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f5bf4005580 con 0x7f5c180072e0 2024-09-17T03:35:05.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.443+0000 7fc1cee00640 1 -- start start 2024-09-17T03:35:05.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.446+0000 7fc1cee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1c806d9d0 0x7fc1c814cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.446+0000 7f549cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5498073000 0x7f54980cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.446+0000 7fc1cee00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c806e8c0 0x7fc1c814c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.446+0000 7f549cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54980cf6b0 0x7f54981f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.446+0000 7f549cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54980cfac0 0x7f549809cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.446+0000 7f5495e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5498073000 0x7f54980cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7f549cc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f549806ddf0 con 0x7f54980cfac0 2024-09-17T03:35:05.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7f549cc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f549815fd90 con 0x7f5498073000 2024-09-17T03:35:05.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7f549cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f549806df70 con 0x7f54980cf6b0 2024-09-17T03:35:05.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7f5495e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5498073000 0x7f54980cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:36986/0 (socket says 172.21.15.121:36986) 2024-09-17T03:35:05.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7f5496800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54980cfac0 0x7f549809cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7f548d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54980cf6b0 0x7f54981f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7f548d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54980cf6b0 0x7f54981f53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:55260/0 (socket says 172.21.15.121:55260) 2024-09-17T03:35:05.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7f548d400640 1 -- 172.21.15.121:0/616917418 learned_addr learned my addr 172.21.15.121:0/616917418 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7fc1c7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c806e8c0 0x7fc1c814c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7fc1c7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c806e8c0 0x7fc1c814c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53930/0 (socket says 172.21.15.121:53930) 2024-09-17T03:35:05.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7fc1c7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1c806d9d0 0x7fc1c814cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7fc1c7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1c806d9d0 0x7fc1c814cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:55256/0 (socket says 172.21.15.121:55256) 2024-09-17T03:35:05.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7fc1c7400640 1 -- 172.21.15.121:0/3539935240 learned_addr learned my addr 172.21.15.121:0/3539935240 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.447+0000 7fc1cee00640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1c80d3180 0x7fc1c81fd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.448+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8159b90 con 0x7fc1c806e8c0 2024-09-17T03:35:05.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.448+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8159a10 con 0x7fc1c80d3180 2024-09-17T03:35:05.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.448+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c8159d10 con 0x7fc1c806d9d0 2024-09-17T03:35:05.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.448+0000 7fc1cce00640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1c80d3180 0x7fc1c81fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.448+0000 7f139d400640 1 -- 172.21.15.121:0/1005608008 shutdown_connections 2024-09-17T03:35:05.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.448+0000 7f139d400640 1 --2- 172.21.15.121:0/1005608008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13900e8410 0x7f1390050f90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.448+0000 7f139d400640 1 --2- 172.21.15.121:0/1005608008 >> v2:172.21.15.176:3300/0 conn(0x7f13900570c0 0x7f1390035c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.448+0000 7f139d400640 1 -- 172.21.15.121:0/1005608008 >> 172.21.15.121:0/1005608008 conn(0x7f139001fbe0 msgr2=0x7f1390056940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.452+0000 7fc1c7e00640 1 -- 172.21.15.121:0/3539935240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1c80d3180 msgr2=0x7fc1c81fd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.452+0000 7fc1c7e00640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1c80d3180 0x7fc1c81fd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.452+0000 7fc1c7e00640 1 -- 172.21.15.121:0/3539935240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c806e8c0 msgr2=0x7fc1c814c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.452+0000 7fc1c7e00640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c806e8c0 0x7fc1c814c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.452+0000 7fc1c7e00640 1 -- 172.21.15.121:0/3539935240 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c80ce5a0 con 0x7fc1c806d9d0 2024-09-17T03:35:05.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.452+0000 7f139d400640 1 -- 172.21.15.121:0/1005608008 shutdown_connections 2024-09-17T03:35:05.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.453+0000 7f5c1d600640 1 -- 172.21.15.121:0/1048185551 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v11)=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f5c1403f030 con 0x7f5c180072e0 2024-09-17T03:35:05.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.453+0000 7f139d400640 1 -- 172.21.15.121:0/1005608008 wait complete. 2024-09-17T03:35:05.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.454+0000 7f5c12a00640 1 -- 172.21.15.121:0/1048185551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c180072e0 msgr2=0x7f5c180e3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.454+0000 7f5c12a00640 1 --2- 172.21.15.121:0/1048185551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c180072e0 0x7f5c180e3fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009950 tx=0x7f5c14003b90 comp rx=0 tx=0).stop 2024-09-17T03:35:05.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.455+0000 7f5c12a00640 1 -- 172.21.15.121:0/1048185551 shutdown_connections 2024-09-17T03:35:05.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.455+0000 7f5c12a00640 1 --2- 172.21.15.121:0/1048185551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c18035cd0 0x7f5c180df460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.455+0000 7f5c12a00640 1 --2- 172.21.15.121:0/1048185551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c180072e0 0x7f5c180e3fc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.455+0000 7f5c12a00640 1 --2- 172.21.15.121:0/1048185551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c18006310 0x7f5c180d7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.455+0000 7f5c12a00640 1 -- 172.21.15.121:0/1048185551 >> 172.21.15.121:0/1048185551 conn(0x7f5c1801d9a0 msgr2=0x7f5c18032ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.456+0000 7f5c12a00640 1 -- 172.21.15.121:0/1048185551 shutdown_connections 2024-09-17T03:35:05.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.456+0000 7f5c12a00640 1 -- 172.21.15.121:0/1048185551 wait complete. 2024-09-17T03:35:05.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.453+0000 7fc1c7e00640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1c806d9d0 0x7fc1c814cc70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400c3f0 tx=0x7fc1b400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.456+0000 7fc1c7400640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c806e8c0 0x7fc1c814c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:05.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.456+0000 7fc1cce00640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1c80d3180 0x7fc1c81fd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:05.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.463+0000 7fc1bfe00640 1 -- 172.21.15.121:0/3539935240 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4011790 con 0x7fc1c806d9d0 2024-09-17T03:35:05.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.463+0000 7fc1bfe00640 1 -- 172.21.15.121:0/3539935240 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1b4017070 con 0x7fc1c806d9d0 2024-09-17T03:35:05.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.463+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c81fe7a0 con 0x7fc1c806d9d0 2024-09-17T03:35:05.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.463+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c80ceb20 con 0x7fc1c806d9d0 2024-09-17T03:35:05.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.465+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c8157950 con 0x7fc1c806d9d0 2024-09-17T03:35:05.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.467+0000 7f139d400640 1 Processor -- start 2024-09-17T03:35:05.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.467+0000 7f139d400640 1 -- start start 2024-09-17T03:35:05.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.469+0000 7f6e96e00640 1 -- 172.21.15.121:0/1662373554 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e9015ac20 msgr2=0x7f6e90070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.469+0000 7f139d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1390049910 0x7f13900e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7f6e96e00640 1 --2- 172.21.15.121:0/1662373554 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e9015ac20 0x7f6e90070070 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c005fd0 tx=0x7f6e7c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7fc1bfe00640 1 -- 172.21.15.121:0/3539935240 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4011c60 con 0x7fc1c806d9d0 2024-09-17T03:35:05.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7fc1bfe00640 1 -- 172.21.15.121:0/3539935240 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc1b401c460 con 0x7fc1c806d9d0 2024-09-17T03:35:05.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7f6e96e00640 1 -- 172.21.15.121:0/1662373554 shutdown_connections 2024-09-17T03:35:05.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7f6e96e00640 1 --2- 172.21.15.121:0/1662373554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e90072d90 0x7f6e900731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7f6e96e00640 1 --2- 172.21.15.121:0/1662373554 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e9015ac20 0x7f6e90070070 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c005fd0 tx=0x7f6e7c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7f6e96e00640 1 -- 172.21.15.121:0/1662373554 >> 172.21.15.121:0/1662373554 conn(0x7f6e900b1b90 msgr2=0x7f6e900b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.469+0000 7f139d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13900570c0 0x7f1390039a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.467+0000 7f5495e00640 1 -- 172.21.15.121:0/616917418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54980cf6b0 msgr2=0x7f54981f53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.467+0000 7f5495e00640 1 --2- 172.21.15.121:0/616917418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54980cf6b0 0x7f54981f53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.472+0000 7f6e96e00640 1 -- 172.21.15.121:0/1662373554 shutdown_connections 2024-09-17T03:35:05.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7fc1bfe00640 1 -- 172.21.15.121:0/3539935240 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc1b4012810 con 0x7fc1c806d9d0 2024-09-17T03:35:05.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7fc1bfe00640 1 -- 172.21.15.121:0/3539935240 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc1c80b7fb0 con 0x7fc1c806d9d0 2024-09-17T03:35:05.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.467+0000 7f5495e00640 1 -- 172.21.15.121:0/616917418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54980cfac0 msgr2=0x7f549809cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.471+0000 7f5495e00640 1 --2- 172.21.15.121:0/616917418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54980cfac0 0x7f549809cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.471+0000 7f5495e00640 1 -- 172.21.15.121:0/616917418 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5498151050 con 0x7f5498073000 2024-09-17T03:35:05.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.471+0000 7f5496800640 1 --2- 172.21.15.121:0/616917418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54980cfac0 0x7f549809cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:05.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.472+0000 7f5495e00640 1 --2- 172.21.15.121:0/616917418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5498073000 0x7f54980cf000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f548800c7a0 tx=0x7f548800cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.472+0000 7f3583400640 1 -- 172.21.15.121:0/3037524584 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f356c005850 con 0x7f35980cdbe0 2024-09-17T03:35:05.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.469+0000 7f139d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13900e8410 0x7f13900ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.469+0000 7f139d400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1390053a30 con 0x7f13900570c0 2024-09-17T03:35:05.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.469+0000 7f139d400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f13900538b0 con 0x7f13900e8410 2024-09-17T03:35:05.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.469+0000 7f139d400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1390053bb0 con 0x7f1390049910 2024-09-17T03:35:05.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7f1397200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13900e8410 0x7f13900ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7f1397200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13900e8410 0x7f13900ea580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:37006/0 (socket says 172.21.15.121:37006) 2024-09-17T03:35:05.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.470+0000 7f1397200640 1 -- 172.21.15.121:0/2953938725 learned_addr learned my addr 172.21.15.121:0/2953938725 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.471+0000 7f1397200640 1 -- 172.21.15.121:0/2953938725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1390049910 msgr2=0x7f13900e3d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:35:05.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.471+0000 7f1397200640 1 --2- 172.21.15.121:0/2953938725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1390049910 0x7f13900e3d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.472+0000 7f1397200640 1 -- 172.21.15.121:0/2953938725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13900570c0 msgr2=0x7f1390039a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:35:05.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.473+0000 7f548ea00640 1 -- 172.21.15.121:0/616917418 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5488003da0 con 0x7f5498073000 2024-09-17T03:35:05.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f54eaa00640 1 -- 172.21.15.121:0/1634890534 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e402ba60 con 0x7f54d00053a0 2024-09-17T03:35:05.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.473+0000 7f548ea00640 1 -- 172.21.15.121:0/616917418 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5488005070 con 0x7f5498073000 2024-09-17T03:35:05.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f54f0e00640 1 -- 172.21.15.121:0/1634890534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00053a0 msgr2=0x7f54d000ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f54f0e00640 1 --2- 172.21.15.121:0/1634890534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00053a0 0x7f54d000ba20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f54e400a7b0 tx=0x7f54d0005830 comp rx=0 tx=0).stop 2024-09-17T03:35:05.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.473+0000 7f548ea00640 1 -- 172.21.15.121:0/616917418 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54880054a0 con 0x7f5498073000 2024-09-17T03:35:05.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f54ebe00640 1 -- 172.21.15.121:0/1634890534 reap_dead start 2024-09-17T03:35:05.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f54f0e00640 1 -- 172.21.15.121:0/1634890534 shutdown_connections 2024-09-17T03:35:05.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f54f0e00640 1 -- 172.21.15.121:0/1634890534 >> 172.21.15.121:0/1634890534 conn(0x7f54ec0d1960 msgr2=0x7f54ec0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f549cc00640 1 -- 172.21.15.121:0/616917418 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5498151330 con 0x7f5498073000 2024-09-17T03:35:05.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f549cc00640 1 -- 172.21.15.121:0/616917418 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54981518f0 con 0x7f5498073000 2024-09-17T03:35:05.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.476+0000 7f54f0e00640 1 -- 172.21.15.121:0/1634890534 shutdown_connections 2024-09-17T03:35:05.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.476+0000 7f54f0e00640 1 -- 172.21.15.121:0/1634890534 wait complete. 2024-09-17T03:35:05.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.472+0000 7f6e96e00640 1 -- 172.21.15.121:0/1662373554 wait complete. 2024-09-17T03:35:05.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.480+0000 7f548ea00640 1 -- 172.21.15.121:0/616917418 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5488005640 con 0x7f5498073000 2024-09-17T03:35:05.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.481+0000 7f548ea00640 1 -- 172.21.15.121:0/616917418 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f548801ba30 con 0x7f5498073000 2024-09-17T03:35:05.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.481+0000 7f549cc00640 1 -- 172.21.15.121:0/616917418 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f549806e4a0 con 0x7f5498073000 2024-09-17T03:35:05.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.482+0000 7f54f0e00640 1 Processor -- start 2024-09-17T03:35:05.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f1395e00640 1 --2- 172.21.15.121:0/2953938725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13900570c0 0x7f1390039a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f1397200640 1 --2- 172.21.15.121:0/2953938725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13900570c0 0x7f1390039a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.474+0000 7f1397200640 1 -- 172.21.15.121:0/2953938725 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13900e9710 con 0x7f13900e8410 2024-09-17T03:35:05.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.475+0000 7f1395e00640 1 --2- 172.21.15.121:0/2953938725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13900570c0 0x7f1390039a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:05.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.482+0000 7f54f0e00640 1 -- start start 2024-09-17T03:35:05.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.483+0000 7f1397200640 1 --2- 172.21.15.121:0/2953938725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13900e8410 0x7f13900ea580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1398052910 tx=0x7f1398069d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.484+0000 7f138ea00640 1 -- 172.21.15.121:0/2953938725 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13980753c0 con 0x7f13900e8410 2024-09-17T03:35:05.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.484+0000 7f138ea00640 1 -- 172.21.15.121:0/2953938725 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1398076270 con 0x7f13900e8410 2024-09-17T03:35:05.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.484+0000 7f138ea00640 1 -- 172.21.15.121:0/2953938725 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13980766e0 con 0x7f13900e8410 2024-09-17T03:35:05.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.484+0000 7f548ea00640 1 -- 172.21.15.121:0/616917418 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f548800a640 con 0x7f5498073000 2024-09-17T03:35:05.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.484+0000 7f54f0e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54ec155ac0 0x7f54ec158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.484+0000 7f54f0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54ec0ca4c0 0x7f54ec1507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.485+0000 7f54f0e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54ec0ca8d0 0x7f54ec150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.485+0000 7f54f0e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec162560 con 0x7f54ec0ca4c0 2024-09-17T03:35:05.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.485+0000 7f54f0e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1623e0 con 0x7f54ec155ac0 2024-09-17T03:35:05.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.485+0000 7f54f0e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f54ec1555b0 con 0x7f54ec0ca8d0 2024-09-17T03:35:05.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.486+0000 7f139d400640 1 -- 172.21.15.121:0/2953938725 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1390036cb0 con 0x7f13900e8410 2024-09-17T03:35:05.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.486+0000 7f358e000640 1 -- 172.21.15.121:0/3037524584 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f35840137b0 con 0x7f35980cdbe0 2024-09-17T03:35:05.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.487+0000 7f54ebe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54ec0ca8d0 0x7f54ec150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.487+0000 7f139d400640 1 -- 172.21.15.121:0/2953938725 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13900e9c90 con 0x7f13900e8410 2024-09-17T03:35:05.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.487+0000 7f138ea00640 1 -- 172.21.15.121:0/2953938725 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1398093400 con 0x7f13900e8410 2024-09-17T03:35:05.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.487+0000 7f54ebe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54ec0ca8d0 0x7f54ec150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:55302/0 (socket says 172.21.15.121:55302) 2024-09-17T03:35:05.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.487+0000 7f54ebe00640 1 -- 172.21.15.121:0/923125828 learned_addr learned my addr 172.21.15.121:0/923125828 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.487+0000 7f138ea00640 1 -- 172.21.15.121:0/2953938725 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1398093a30 con 0x7f13900e8410 2024-09-17T03:35:05.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.489+0000 7f6e96e00640 1 Processor -- start 2024-09-17T03:35:05.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.490+0000 7f6e96e00640 1 -- start start 2024-09-17T03:35:05.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.495+0000 7f3583400640 1 -- 172.21.15.121:0/3037524584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35980cdbe0 msgr2=0x7f35981f1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.495+0000 7f3583400640 1 --2- 172.21.15.121:0/3037524584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35980cdbe0 0x7f35981f1720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3584007830 tx=0x7f3584007cf0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.492+0000 7f0076200640 1 -- 172.21.15.121:0/799296990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007016f040 msgr2=0x7f0070074b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.492+0000 7f0076200640 1 --2- 172.21.15.121:0/799296990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007016f040 0x7f0070074b40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f00600098e0 tx=0x7f006002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.495+0000 7f3583400640 1 -- 172.21.15.121:0/3037524584 shutdown_connections 2024-09-17T03:35:05.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.495+0000 7f3583400640 1 --2- 172.21.15.121:0/3037524584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f359815e840 0x7f35981f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.495+0000 7f3583400640 1 --2- 172.21.15.121:0/3037524584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35980cdbe0 0x7f35981f1720 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3584007830 tx=0x7f3584007cf0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.496+0000 7f0076200640 1 -- 172.21.15.121:0/799296990 shutdown_connections 2024-09-17T03:35:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.496+0000 7f0076200640 1 --2- 172.21.15.121:0/799296990 >> v2:172.21.15.121:3300/0 conn(0x7f00700cc5a0 0x7f007006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.496+0000 7f0076200640 1 --2- 172.21.15.121:0/799296990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007016f040 0x7f0070074b40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.496+0000 7f0076200640 1 -- 172.21.15.121:0/799296990 >> 172.21.15.121:0/799296990 conn(0x7f00700b1b90 msgr2=0x7f00700b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.495+0000 7f3583400640 1 --2- 172.21.15.121:0/3037524584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35980ad2b0 0x7f35981f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.496+0000 7f0076200640 1 -- 172.21.15.121:0/799296990 shutdown_connections 2024-09-17T03:35:05.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.495+0000 7f3583400640 1 -- 172.21.15.121:0/3037524584 >> 172.21.15.121:0/3037524584 conn(0x7f35980d0010 msgr2=0x7f35980b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.496+0000 7f3583400640 1 -- 172.21.15.121:0/3037524584 shutdown_connections 2024-09-17T03:35:05.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.496+0000 7f3583400640 1 -- 172.21.15.121:0/3037524584 wait complete. 2024-09-17T03:35:05.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.497+0000 7f0076200640 1 -- 172.21.15.121:0/799296990 wait complete. 2024-09-17T03:35:05.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.489+0000 7f54eb400640 1 --2- 172.21.15.121:0/923125828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54ec155ac0 0x7f54ec158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.490+0000 7f54e2a00640 1 --2- 172.21.15.121:0/923125828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54ec0ca4c0 0x7f54ec1507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e96e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9006ddf0 0x7f6e90146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e96e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e90072d90 0x7f6e901f9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e96e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e901588f0 0x7f6e90158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e96e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900707a0 con 0x7f6e90072d90 2024-09-17T03:35:05.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e96e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90071090 con 0x7f6e901588f0 2024-09-17T03:35:05.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e96e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e900736e0 con 0x7f6e9006ddf0 2024-09-17T03:35:05.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e8fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9006ddf0 0x7f6e90146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e8f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e90072d90 0x7f6e901f9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e94e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e901588f0 0x7f6e90158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e8fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9006ddf0 0x7f6e90146540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:55324/0 (socket says 172.21.15.121:55324) 2024-09-17T03:35:05.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e8f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e90072d90 0x7f6e901f9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53990/0 (socket says 172.21.15.121:53990) 2024-09-17T03:35:05.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.498+0000 7f6e8fe00640 1 -- 172.21.15.121:0/2267320277 learned_addr learned my addr 172.21.15.121:0/2267320277 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.500+0000 7f6e8f400640 1 -- 172.21.15.121:0/2267320277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9006ddf0 msgr2=0x7f6e90146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.501+0000 7f1383e00640 1 -- 172.21.15.121:0/2953938725 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13900eac80 con 0x7f13900e8410 2024-09-17T03:35:05.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.490+0000 7f54eb400640 1 -- 172.21.15.121:0/923125828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54ec0ca8d0 msgr2=0x7f54ec150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.490+0000 7f54eb400640 1 --2- 172.21.15.121:0/923125828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54ec0ca8d0 0x7f54ec150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.490+0000 7f54eb400640 1 -- 172.21.15.121:0/923125828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54ec0ca4c0 msgr2=0x7f54ec1507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.490+0000 7f54eb400640 1 --2- 172.21.15.121:0/923125828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54ec0ca4c0 0x7f54ec1507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.490+0000 7f54eb400640 1 -- 172.21.15.121:0/923125828 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec1f41b0 con 0x7f54ec155ac0 2024-09-17T03:35:05.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.490+0000 7f54e2a00640 1 --2- 172.21.15.121:0/923125828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54ec0ca4c0 0x7f54ec1507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:05.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.491+0000 7f54eb400640 1 --2- 172.21.15.121:0/923125828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54ec155ac0 0x7f54ec158620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f54ec08cbc0 tx=0x7f54dc00b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.502+0000 7f0076200640 1 Processor -- start 2024-09-17T03:35:05.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.492+0000 7f54e3e00640 1 -- 172.21.15.121:0/923125828 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc015020 con 0x7f54ec155ac0 2024-09-17T03:35:05.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.492+0000 7f54e3e00640 1 -- 172.21.15.121:0/923125828 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54dc011920 con 0x7f54ec155ac0 2024-09-17T03:35:05.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.492+0000 7f54e3e00640 1 -- 172.21.15.121:0/923125828 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc011d70 con 0x7f54ec155ac0 2024-09-17T03:35:05.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.492+0000 7f54f0e00640 1 -- 172.21.15.121:0/923125828 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec1f4490 con 0x7f54ec155ac0 2024-09-17T03:35:05.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.492+0000 7f54f0e00640 1 -- 172.21.15.121:0/923125828 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ec1f4a50 con 0x7f54ec155ac0 2024-09-17T03:35:05.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.494+0000 7f54e3e00640 1 -- 172.21.15.121:0/923125828 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f54dc018020 con 0x7f54ec155ac0 2024-09-17T03:35:05.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.494+0000 7f54e3e00640 1 -- 172.21.15.121:0/923125828 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f54dc0199c0 con 0x7f54ec155ac0 2024-09-17T03:35:05.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.496+0000 7f54f0e00640 1 -- 172.21.15.121:0/923125828 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ec0cf300 con 0x7f54ec155ac0 2024-09-17T03:35:05.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.502+0000 7f0076200640 1 -- start start 2024-09-17T03:35:05.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.503+0000 7f54e3e00640 1 -- 172.21.15.121:0/923125828 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f54dc01f020 con 0x7f54ec155ac0 2024-09-17T03:35:05.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.500+0000 7f6e8f400640 1 --2- 172.21.15.121:0/2267320277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9006ddf0 0x7f6e90146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.500+0000 7f6e8f400640 1 -- 172.21.15.121:0/2267320277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e901588f0 msgr2=0x7f6e90158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.500+0000 7f6e8f400640 1 --2- 172.21.15.121:0/2267320277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e901588f0 0x7f6e90158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.500+0000 7f6e8f400640 1 -- 172.21.15.121:0/2267320277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e90159240 con 0x7f6e90072d90 2024-09-17T03:35:05.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.504+0000 7f6e8f400640 1 --2- 172.21.15.121:0/2267320277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e90072d90 0x7f6e901f9a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000b460 tx=0x7f6e8000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.504+0000 7f6e87e00640 1 -- 172.21.15.121:0/2267320277 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80015020 con 0x7f6e90072d90 2024-09-17T03:35:05.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.505+0000 7ff17fe00640 1 -- 172.21.15.121:0/336493559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18006d2b0 msgr2=0x7ff1801621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.505+0000 7f0076200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00700cc190 0x7f0070169a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.505+0000 7f138ea00640 1 -- 172.21.15.121:0/2953938725 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f139808f030 con 0x7f13900e8410 2024-09-17T03:35:05.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.506+0000 7f006f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00700cc190 0x7f0070169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.506+0000 7f006f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00700cc190 0x7f0070169a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54006/0 (socket says 172.21.15.121:54006) 2024-09-17T03:35:05.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.506+0000 7f006f400640 1 -- 172.21.15.121:0/2509609038 learned_addr learned my addr 172.21.15.121:0/2509609038 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.506+0000 7f0076200640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00700cc5a0 0x7f00700b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.507+0000 7f0076200640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007016f040 0x7f007016a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.507+0000 7f006ea00640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00700cc5a0 0x7f00700b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.507+0000 7f0076200640 1 -- 172.21.15.121:0/2509609038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f007006e330 con 0x7f00700cc190 2024-09-17T03:35:05.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.507+0000 7f0076200640 1 -- 172.21.15.121:0/2509609038 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0070072fa0 con 0x7f00700cc5a0 2024-09-17T03:35:05.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.508+0000 7f006fe00640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007016f040 0x7f007016a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.508+0000 7f0076200640 1 -- 172.21.15.121:0/2509609038 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f007006e4b0 con 0x7f007016f040 2024-09-17T03:35:05.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.508+0000 7ff17d600640 1 -- 172.21.15.121:0/336493559 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178011790 con 0x7ff18006d2b0 2024-09-17T03:35:05.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.508+0000 7ff17fe00640 1 --2- 172.21.15.121:0/336493559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18006d2b0 0x7ff1801621d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff178005fd0 tx=0x7ff178032bd0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.508+0000 7fc24e000640 1 -- 172.21.15.121:0/2430916538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c003a70 msgr2=0x7fc22c003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.508+0000 7fc246000640 1 -- 172.21.15.121:0/2430916538 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24000a400 con 0x7fc22c003a70 2024-09-17T03:35:05.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.508+0000 7fc24e000640 1 --2- 172.21.15.121:0/2430916538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c003a70 0x7fc22c003f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc24000a7e0 tx=0x7fc22c005830 comp rx=0 tx=0).stop 2024-09-17T03:35:05.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7fc24e000640 1 -- 172.21.15.121:0/2430916538 shutdown_connections 2024-09-17T03:35:05.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7fc24e000640 1 --2- 172.21.15.121:0/2430916538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c003a70 0x7fc22c003f00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7fc24e000640 1 -- 172.21.15.121:0/2430916538 >> 172.21.15.121:0/2430916538 conn(0x7fc2480b1b90 msgr2=0x7fc2480b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7fc24e000640 1 -- 172.21.15.121:0/2430916538 shutdown_connections 2024-09-17T03:35:05.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7ff17fe00640 1 -- 172.21.15.121:0/336493559 shutdown_connections 2024-09-17T03:35:05.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7ff17fe00640 1 --2- 172.21.15.121:0/336493559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1800cfa10 0x7ff180154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7ff17fe00640 1 --2- 172.21.15.121:0/336493559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18006d2b0 0x7ff1801621d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7ff17fe00640 1 -- 172.21.15.121:0/336493559 >> 172.21.15.121:0/336493559 conn(0x7ff1800d1960 msgr2=0x7ff1800d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7fc24e000640 1 -- 172.21.15.121:0/2430916538 wait complete. 2024-09-17T03:35:05.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.505+0000 7f6e87e00640 1 -- 172.21.15.121:0/2267320277 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e80011940 con 0x7f6e90072d90 2024-09-17T03:35:05.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.505+0000 7f6e87e00640 1 -- 172.21.15.121:0/2267320277 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80011d90 con 0x7f6e90072d90 2024-09-17T03:35:05.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.511+0000 7f006f400640 1 -- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007016f040 msgr2=0x7f007016a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.511+0000 7f006f400640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007016f040 0x7f007016a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.511+0000 7f006f400640 1 -- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00700cc5a0 msgr2=0x7f00700b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.511+0000 7f006f400640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00700cc5a0 0x7f00700b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.511+0000 7f006f400640 1 -- 172.21.15.121:0/2509609038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0070168550 con 0x7f00700cc190 2024-09-17T03:35:05.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.511+0000 7f006fe00640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007016f040 0x7f007016a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:05.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.512+0000 7f006f400640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00700cc190 0x7f0070169a60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f006002aa90 tx=0x7f00600055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.513+0000 7f0067400640 1 -- 172.21.15.121:0/2509609038 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060033e60 con 0x7f00700cc190 2024-09-17T03:35:05.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.513+0000 7f0067400640 1 -- 172.21.15.121:0/2509609038 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0060004310 con 0x7f00700cc190 2024-09-17T03:35:05.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.513+0000 7f0067400640 1 -- 172.21.15.121:0/2509609038 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060031bb0 con 0x7f00700cc190 2024-09-17T03:35:05.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.513+0000 7f0076200640 1 -- 172.21.15.121:0/2509609038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00701689c0 con 0x7f00700cc190 2024-09-17T03:35:05.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.513+0000 7f0076200640 1 -- 172.21.15.121:0/2509609038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0070168f80 con 0x7f00700cc190 2024-09-17T03:35:05.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.515+0000 7f0067400640 1 -- 172.21.15.121:0/2509609038 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0060033460 con 0x7f00700cc190 2024-09-17T03:35:05.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.515+0000 7f0067400640 1 -- 172.21.15.121:0/2509609038 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0060004b00 con 0x7f00700cc190 2024-09-17T03:35:05.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.515+0000 7f0064c00640 1 -- 172.21.15.121:0/2509609038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0070169fa0 con 0x7f00700cc190 2024-09-17T03:35:05.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.519+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f7d08005580 con 0x7f7d300aee70 2024-09-17T03:35:05.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.512+0000 7f6e96e00640 1 -- 172.21.15.121:0/2267320277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e90146d70 con 0x7f6e90072d90 2024-09-17T03:35:05.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.512+0000 7f6e96e00640 1 -- 172.21.15.121:0/2267320277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e90147330 con 0x7f6e90072d90 2024-09-17T03:35:05.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7ff17fe00640 1 -- 172.21.15.121:0/336493559 shutdown_connections 2024-09-17T03:35:05.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.509+0000 7ff17fe00640 1 -- 172.21.15.121:0/336493559 wait complete. 2024-09-17T03:35:05.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.513+0000 7ff17fe00640 1 Processor -- start 2024-09-17T03:35:05.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.513+0000 7ff17fe00640 1 -- start start 2024-09-17T03:35:05.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7ff17fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18006d2b0 0x7ff180202f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7ff17fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1800cfa10 0x7ff1800c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7ff17fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff180162710 0x7ff1800ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7ff17fe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff180155850 con 0x7ff1800cfa10 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7ff17ea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18006d2b0 0x7ff180202f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7ff17fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1801556d0 con 0x7ff18006d2b0 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7ff17fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1801559d0 con 0x7ff180162710 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7ff17ea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18006d2b0 0x7ff180202f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:37076/0 (socket says 172.21.15.121:37076) 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7ff17ea00640 1 -- 172.21.15.121:0/2666915354 learned_addr learned my addr 172.21.15.121:0/2666915354 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.517+0000 7ff17e000640 1 --2- 172.21.15.121:0/2666915354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1800cfa10 0x7ff1800c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.517+0000 7ff17ea00640 1 -- 172.21.15.121:0/2666915354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff180162710 msgr2=0x7ff1800ca100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.517+0000 7ff17ea00640 1 --2- 172.21.15.121:0/2666915354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff180162710 0x7ff1800ca100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.517+0000 7ff17ea00640 1 -- 172.21.15.121:0/2666915354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1800cfa10 msgr2=0x7ff1800c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.517+0000 7ff17ea00640 1 --2- 172.21.15.121:0/2666915354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1800cfa10 0x7ff1800c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.517+0000 7ff17ea00640 1 -- 172.21.15.121:0/2666915354 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1800c9220 con 0x7ff18006d2b0 2024-09-17T03:35:05.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.517+0000 7ff17e000640 1 --2- 172.21.15.121:0/2666915354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1800cfa10 0x7ff1800c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:05.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.518+0000 7ff17ea00640 1 --2- 172.21.15.121:0/2666915354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18006d2b0 0x7ff180202f60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff1780133a0 tx=0x7ff1780337a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.519+0000 7ff176a00640 1 -- 172.21.15.121:0/2666915354 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178033da0 con 0x7ff18006d2b0 2024-09-17T03:35:05.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.519+0000 7ff176a00640 1 -- 172.21.15.121:0/2666915354 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff178003a80 con 0x7ff18006d2b0 2024-09-17T03:35:05.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.519+0000 7ff176a00640 1 -- 172.21.15.121:0/2666915354 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17800f070 con 0x7ff18006d2b0 2024-09-17T03:35:05.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.520+0000 7fc24e000640 1 Processor -- start 2024-09-17T03:35:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.519+0000 7ff17fe00640 1 -- 172.21.15.121:0/2666915354 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18014dd70 con 0x7ff18006d2b0 2024-09-17T03:35:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.520+0000 7ff17fe00640 1 -- 172.21.15.121:0/2666915354 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18014e330 con 0x7ff18006d2b0 2024-09-17T03:35:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7f6e87e00640 1 -- 172.21.15.121:0/2267320277 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6e80018020 con 0x7f6e90072d90 2024-09-17T03:35:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.516+0000 7f6e87e00640 1 -- 172.21.15.121:0/2267320277 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6e80019890 con 0x7f6e90072d90 2024-09-17T03:35:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.519+0000 7f6e96e00640 1 -- 172.21.15.121:0/2267320277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e90146ab0 con 0x7f6e90072d90 2024-09-17T03:35:05.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.522+0000 7ff176a00640 1 -- 172.21.15.121:0/2666915354 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff178043060 con 0x7ff18006d2b0 2024-09-17T03:35:05.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.522+0000 7ff176a00640 1 -- 172.21.15.121:0/2666915354 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff1780046f0 con 0x7ff18006d2b0 2024-09-17T03:35:05.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.522+0000 7ff17fe00640 1 -- 172.21.15.121:0/2666915354 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff158005290 con 0x7ff18006d2b0 2024-09-17T03:35:05.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.522+0000 7fc24e000640 1 -- start start 2024-09-17T03:35:05.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.525+0000 7ff176a00640 1 -- 172.21.15.121:0/2666915354 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff178003ed0 con 0x7ff18006d2b0 2024-09-17T03:35:05.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.524+0000 7fc24e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c003a70 0x7fc2481e7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.524+0000 7fc24e000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2481e5ca0 0x7fc2481e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.524+0000 7fc24e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2481e65f0 0x7fc2480a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.524+0000 7fc24e000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc24806e200 con 0x7fc2481e65f0 2024-09-17T03:35:05.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.524+0000 7fc24e000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc248071090 con 0x7fc22c003a70 2024-09-17T03:35:05.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.524+0000 7fc24e000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc24806e380 con 0x7fc2481e5ca0 2024-09-17T03:35:05.528 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.529 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.525+0000 7fc246a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2481e5ca0 0x7fc2481e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.525+0000 7fc247e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2481e65f0 0x7fc2480a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.525+0000 7fc246a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2481e5ca0 0x7fc2481e60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:55338/0 (socket says 172.21.15.121:55338) 2024-09-17T03:35:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.525+0000 7fc246a00640 1 -- 172.21.15.121:0/4018099011 learned_addr learned my addr 172.21.15.121:0/4018099011 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.525+0000 7fc247400640 1 --2- 172.21.15.121:0/4018099011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c003a70 0x7fc2481e7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.526+0000 7fc247e00640 1 -- 172.21.15.121:0/4018099011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2481e5ca0 msgr2=0x7fc2481e60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.526+0000 7fc247e00640 1 --2- 172.21.15.121:0/4018099011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2481e5ca0 0x7fc2481e60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.526+0000 7fc247e00640 1 -- 172.21.15.121:0/4018099011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c003a70 msgr2=0x7fc2481e7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.526+0000 7fc247e00640 1 --2- 172.21.15.121:0/4018099011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c003a70 0x7fc2481e7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.526+0000 7fc247e00640 1 -- 172.21.15.121:0/4018099011 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24809c9f0 con 0x7fc2481e65f0 2024-09-17T03:35:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.526+0000 7fc247e00640 1 --2- 172.21.15.121:0/4018099011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2481e65f0 0x7fc2480a0290 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc2480d1160 tx=0x7fc238001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.532+0000 7fc23f400640 1 -- 172.21.15.121:0/4018099011 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238011630 con 0x7fc2481e65f0 2024-09-17T03:35:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.532+0000 7fc23f400640 1 -- 172.21.15.121:0/4018099011 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2380117d0 con 0x7fc2481e65f0 2024-09-17T03:35:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.532+0000 7fc23f400640 1 -- 172.21.15.121:0/4018099011 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238011c00 con 0x7fc2481e65f0 2024-09-17T03:35:05.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.533+0000 7f0067400640 1 -- 172.21.15.121:0/2509609038 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f006003f030 con 0x7f00700cc190 2024-09-17T03:35:05.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.535+0000 7f6e87e00640 1 -- 172.21.15.121:0/2267320277 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6e8001f020 con 0x7f6e90072d90 2024-09-17T03:35:05.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.533+0000 7fc24e000640 1 -- 172.21.15.121:0/4018099011 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24809ddf0 con 0x7fc2481e65f0 2024-09-17T03:35:05.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.533+0000 7fc24e000640 1 -- 172.21.15.121:0/4018099011 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24809fa90 con 0x7fc2481e65f0 2024-09-17T03:35:05.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.544+0000 7fc23f400640 1 -- 172.21.15.121:0/4018099011 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc23801d800 con 0x7fc2481e65f0 2024-09-17T03:35:05.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.544+0000 7fc23f400640 1 -- 172.21.15.121:0/4018099011 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc2380103c0 con 0x7fc2481e65f0 2024-09-17T03:35:05.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.545+0000 7fda44e00640 1 -- 172.21.15.121:0/2568132348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda400aee70 msgr2=0x7fda40072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.546+0000 7f7d27e00640 1 -- 172.21.15.121:0/2746012966 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f7d18033110 con 0x7f7d300aee70 2024-09-17T03:35:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.546+0000 7fda44e00640 1 --2- 172.21.15.121:0/2568132348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda400aee70 0x7fda40072f90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009850 tx=0x7fda2c02a4f0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.546+0000 7fda44e00640 1 -- 172.21.15.121:0/2568132348 shutdown_connections 2024-09-17T03:35:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.546+0000 7fda44e00640 1 --2- 172.21.15.121:0/2568132348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda400aee70 0x7fda40072f90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.546+0000 7fda44e00640 1 -- 172.21.15.121:0/2568132348 >> 172.21.15.121:0/2568132348 conn(0x7fda400b1b90 msgr2=0x7fda400b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.547+0000 7fda44e00640 1 -- 172.21.15.121:0/2568132348 shutdown_connections 2024-09-17T03:35:05.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.547+0000 7fda44e00640 1 -- 172.21.15.121:0/2568132348 wait complete. 2024-09-17T03:35:05.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.550+0000 7fda44e00640 1 Processor -- start 2024-09-17T03:35:05.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.553+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300aee70 msgr2=0x7f7d3015df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.553+0000 7f7d36800640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300aee70 0x7f7d3015df10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009910 tx=0x7f7d18005270 comp rx=0 tx=0).stop 2024-09-17T03:35:05.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.553+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 shutdown_connections 2024-09-17T03:35:05.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.553+0000 7f7d36800640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d30162450 0x7f7d301fba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.553+0000 7f7d36800640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300cc160 0x7f7d301fb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.553+0000 7f7d36800640 1 --2- 172.21.15.121:0/2746012966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300aee70 0x7f7d3015df10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.553+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 >> 172.21.15.121:0/2746012966 conn(0x7f7d300b1b90 msgr2=0x7f7d300b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.554+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 shutdown_connections 2024-09-17T03:35:05.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.554+0000 7f7d36800640 1 -- 172.21.15.121:0/2746012966 wait complete. 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.551+0000 7fda44e00640 1 -- start start 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.554+0000 7fda44e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda400aee70 0x7fda400b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.554+0000 7fda44e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda400cc160 0x7fda400b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.554+0000 7fda44e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda40162450 0x7fda400b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.554+0000 7fda44e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fda401629e0 con 0x7fda400aee70 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.554+0000 7fda44e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fda40162860 con 0x7fda40162450 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.554+0000 7fda44e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fda40162b60 con 0x7fda400cc160 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.555+0000 7fda3e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda40162450 0x7fda400b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.555+0000 7fda3de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda400aee70 0x7fda400b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.555+0000 7fda3de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda400aee70 0x7fda400b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54048/0 (socket says 172.21.15.121:54048) 2024-09-17T03:35:05.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.555+0000 7fda3de00640 1 -- 172.21.15.121:0/2111430046 learned_addr learned my addr 172.21.15.121:0/2111430046 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:05.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.556+0000 7fda3d400640 1 --2- 172.21.15.121:0/2111430046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda400cc160 0x7fda400b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:05.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.556+0000 7fda3e800640 1 -- 172.21.15.121:0/2111430046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda400cc160 msgr2=0x7fda400b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.556+0000 7fda3e800640 1 --2- 172.21.15.121:0/2111430046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda400cc160 0x7fda400b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.556+0000 7fda3e800640 1 -- 172.21.15.121:0/2111430046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda400aee70 msgr2=0x7fda400b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.556+0000 7fda3e800640 1 --2- 172.21.15.121:0/2111430046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda400aee70 0x7fda400b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.556+0000 7fda3e800640 1 -- 172.21.15.121:0/2111430046 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda401fd5f0 con 0x7fda40162450 2024-09-17T03:35:05.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.556+0000 7fda3de00640 1 --2- 172.21.15.121:0/2111430046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda400aee70 0x7fda400b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:05.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.557+0000 7fda3e800640 1 --2- 172.21.15.121:0/2111430046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda40162450 0x7fda400b5140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fda3800c700 tx=0x7fda3800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:05.560 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.559+0000 7fc24e000640 1 -- 172.21.15.121:0/4018099011 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc24809db60 con 0x7fc2481e65f0 2024-09-17T03:35:05.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.566+0000 7fc23f400640 1 -- 172.21.15.121:0/4018099011 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc238011da0 con 0x7fc2481e65f0 2024-09-17T03:35:05.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.561+0000 7fda36000640 1 -- 172.21.15.121:0/2111430046 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38003b70 con 0x7fda40162450 2024-09-17T03:35:05.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.561+0000 7fda36000640 1 -- 172.21.15.121:0/2111430046 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda38003d10 con 0x7fda40162450 2024-09-17T03:35:05.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.561+0000 7fda36000640 1 -- 172.21.15.121:0/2111430046 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38003b70 con 0x7fda40162450 2024-09-17T03:35:05.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.561+0000 7fda44e00640 1 -- 172.21.15.121:0/2111430046 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda401fd8d0 con 0x7fda40162450 2024-09-17T03:35:05.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.561+0000 7fda44e00640 1 -- 172.21.15.121:0/2111430046 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda401fde90 con 0x7fda40162450 2024-09-17T03:35:05.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.561+0000 7fda36000640 1 -- 172.21.15.121:0/2111430046 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fda380050d0 con 0x7fda40162450 2024-09-17T03:35:05.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.561+0000 7fda36000640 1 -- 172.21.15.121:0/2111430046 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fda38012760 con 0x7fda40162450 2024-09-17T03:35:05.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.569+0000 7fda44e00640 1 -- 172.21.15.121:0/2111430046 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda40072f90 con 0x7fda40162450 2024-09-17T03:35:05.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.579+0000 7fda36000640 1 -- 172.21.15.121:0/2111430046 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fda3800ac20 con 0x7fda40162450 2024-09-17T03:35:05.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.585+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fdd301584c0 con 0x7fdd300b33f0 2024-09-17T03:35:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.604+0000 7fdd2d600640 1 -- 172.21.15.121:0/3246953400 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v14)=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7fdd1c0035f0 con 0x7fdd300b33f0 2024-09-17T03:35:05.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.613+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd300b33f0 msgr2=0x7fdd301f1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.613+0000 7fdd36800640 1 --2- 172.21.15.121:0/3246953400 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd300b33f0 0x7fdd301f1870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00b3e0 tx=0x7fdd1c00b8a0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.616+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 shutdown_connections 2024-09-17T03:35:05.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.616+0000 7fdd36800640 1 --2- 172.21.15.121:0/3246953400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd300cdf50 0x7fdd30152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.616+0000 7fdd36800640 1 --2- 172.21.15.121:0/3246953400 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd300b33f0 0x7fdd301f1870 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.616+0000 7fdd36800640 1 --2- 172.21.15.121:0/3246953400 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd3006def0 0x7fdd30153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.616+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 >> 172.21.15.121:0/3246953400 conn(0x7fdd3006f920 msgr2=0x7fdd301594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.616+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 shutdown_connections 2024-09-17T03:35:05.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.616+0000 7fdd36800640 1 -- 172.21.15.121:0/3246953400 wait complete. 2024-09-17T03:35:05.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.636+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fc1c80b6c70 con 0x7fc1c806d9d0 2024-09-17T03:35:05.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.650+0000 7fc1bfe00640 1 -- 172.21.15.121:0/3539935240 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7fc1b4011e00 con 0x7fc1c806d9d0 2024-09-17T03:35:05.656 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.656 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.660+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1c806d9d0 msgr2=0x7fc1c814cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.660+0000 7fc1cee00640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1c806d9d0 0x7fc1c814cc70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400c3f0 tx=0x7fc1b400c8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.660+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 shutdown_connections 2024-09-17T03:35:05.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.660+0000 7fc1cee00640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1c80d3180 0x7fc1c81fd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.660+0000 7fc1cee00640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c806e8c0 0x7fc1c814c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.660+0000 7fc1cee00640 1 --2- 172.21.15.121:0/3539935240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1c806d9d0 0x7fc1c814cc70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.660+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 >> 172.21.15.121:0/3539935240 conn(0x7fc1c80d1930 msgr2=0x7fc1c8157b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.660+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 shutdown_connections 2024-09-17T03:35:05.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.661+0000 7fc1cee00640 1 -- 172.21.15.121:0/3539935240 wait complete. 2024-09-17T03:35:05.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.663+0000 7f549cc00640 1 -- 172.21.15.121:0/616917418 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f54980b6020 con 0x7f5498073000 2024-09-17T03:35:05.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.676+0000 7f548ea00640 1 -- 172.21.15.121:0/616917418 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7f548800a640 con 0x7f5498073000 2024-09-17T03:35:05.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.685+0000 7f549cc00640 1 -- 172.21.15.121:0/616917418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5498073000 msgr2=0x7f54980cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.685+0000 7f549cc00640 1 --2- 172.21.15.121:0/616917418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5498073000 0x7f54980cf000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f548800c7a0 tx=0x7f548800cc60 comp rx=0 tx=0).stop 2024-09-17T03:35:05.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.685+0000 7f549cc00640 1 -- 172.21.15.121:0/616917418 shutdown_connections 2024-09-17T03:35:05.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.685+0000 7f549cc00640 1 --2- 172.21.15.121:0/616917418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54980cfac0 0x7f549809cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.685+0000 7f549cc00640 1 --2- 172.21.15.121:0/616917418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54980cf6b0 0x7f54981f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.685+0000 7f549cc00640 1 --2- 172.21.15.121:0/616917418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5498073000 0x7f54980cf000 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.685+0000 7f549cc00640 1 -- 172.21.15.121:0/616917418 >> 172.21.15.121:0/616917418 conn(0x7f54980b1b90 msgr2=0x7f54980ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.686+0000 7f549cc00640 1 -- 172.21.15.121:0/616917418 shutdown_connections 2024-09-17T03:35:05.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.686+0000 7f549cc00640 1 -- 172.21.15.121:0/616917418 wait complete. 2024-09-17T03:35:05.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.692+0000 7f1383e00640 1 -- 172.21.15.121:0/2953938725 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f13900008d0 con 0x7f13900e8410 2024-09-17T03:35:05.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.702+0000 7f6e96e00640 1 -- 172.21.15.121:0/2267320277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f6e90073b80 con 0x7f6e90072d90 2024-09-17T03:35:05.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.703+0000 7f138ea00640 1 -- 172.21.15.121:0/2953938725 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7f1398093c30 con 0x7f13900e8410 2024-09-17T03:35:05.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.705+0000 7f1383e00640 1 -- 172.21.15.121:0/2953938725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13900e8410 msgr2=0x7f13900ea580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.705+0000 7f1383e00640 1 --2- 172.21.15.121:0/2953938725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13900e8410 0x7f13900ea580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1398052910 tx=0x7f1398069d10 comp rx=0 tx=0).stop 2024-09-17T03:35:05.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.705+0000 7f1383e00640 1 -- 172.21.15.121:0/2953938725 shutdown_connections 2024-09-17T03:35:05.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.705+0000 7f1383e00640 1 --2- 172.21.15.121:0/2953938725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13900e8410 0x7f13900ea580 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.705+0000 7f1383e00640 1 --2- 172.21.15.121:0/2953938725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13900570c0 0x7f1390039a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.705+0000 7f1383e00640 1 --2- 172.21.15.121:0/2953938725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1390049910 0x7f13900e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.705+0000 7f1383e00640 1 -- 172.21.15.121:0/2953938725 >> 172.21.15.121:0/2953938725 conn(0x7f139001fbe0 msgr2=0x7f13900527a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.705+0000 7f1383e00640 1 -- 172.21.15.121:0/2953938725 shutdown_connections 2024-09-17T03:35:05.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.706+0000 7f1383e00640 1 -- 172.21.15.121:0/2953938725 wait complete. 2024-09-17T03:35:05.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.710+0000 7f6e87e00640 1 -- 172.21.15.121:0/2267320277 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v18)=0 v18) ==== 108+0+0 (secure 0 0 0) 0x7f6e90159240 con 0x7f6e90072d90 2024-09-17T03:35:05.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.713+0000 7f6e96e00640 1 -- 172.21.15.121:0/2267320277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e90072d90 msgr2=0x7f6e901f9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.713+0000 7f6e96e00640 1 --2- 172.21.15.121:0/2267320277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e90072d90 0x7f6e901f9a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000b460 tx=0x7f6e8000b920 comp rx=0 tx=0).stop 2024-09-17T03:35:05.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.714+0000 7f6e96e00640 1 -- 172.21.15.121:0/2267320277 shutdown_connections 2024-09-17T03:35:05.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.714+0000 7f6e96e00640 1 --2- 172.21.15.121:0/2267320277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e901588f0 0x7f6e90158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.714+0000 7f6e96e00640 1 --2- 172.21.15.121:0/2267320277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e90072d90 0x7f6e901f9a60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.714+0000 7f6e96e00640 1 --2- 172.21.15.121:0/2267320277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e9006ddf0 0x7f6e90146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.714+0000 7f6e96e00640 1 -- 172.21.15.121:0/2267320277 >> 172.21.15.121:0/2267320277 conn(0x7f6e900b1b90 msgr2=0x7f6e900c3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.719+0000 7f6e96e00640 1 -- 172.21.15.121:0/2267320277 shutdown_connections 2024-09-17T03:35:05.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.719+0000 7f6e96e00640 1 -- 172.21.15.121:0/2267320277 wait complete. 2024-09-17T03:35:05.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.719+0000 7f0064c00640 1 -- 172.21.15.121:0/2509609038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f007006ddf0 con 0x7f00700cc190 2024-09-17T03:35:05.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.722+0000 7f54f0e00640 1 -- 172.21.15.121:0/923125828 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f54ec0cc510 con 0x7f54ec155ac0 2024-09-17T03:35:05.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.725+0000 7f0067400640 1 -- 172.21.15.121:0/2509609038 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f007016f450 con 0x7f00700cc190 2024-09-17T03:35:05.728 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.729+0000 7f0064c00640 1 -- 172.21.15.121:0/2509609038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00700cc190 msgr2=0x7f0070169a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.729+0000 7f0064c00640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00700cc190 0x7f0070169a60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f006002aa90 tx=0x7f00600055e0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.731+0000 7f0064c00640 1 -- 172.21.15.121:0/2509609038 shutdown_connections 2024-09-17T03:35:05.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.731+0000 7f0064c00640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f007016f040 0x7f007016a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.731+0000 7f0064c00640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00700cc5a0 0x7f00700b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.731+0000 7f0064c00640 1 --2- 172.21.15.121:0/2509609038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00700cc190 0x7f0070169a60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.731+0000 7f0064c00640 1 -- 172.21.15.121:0/2509609038 >> 172.21.15.121:0/2509609038 conn(0x7f00700b1b90 msgr2=0x7f00700cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.732+0000 7f0064c00640 1 -- 172.21.15.121:0/2509609038 shutdown_connections 2024-09-17T03:35:05.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.732+0000 7f0064c00640 1 -- 172.21.15.121:0/2509609038 wait complete. 2024-09-17T03:35:05.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.733+0000 7f54e3e00640 1 -- 172.21.15.121:0/923125828 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7f54dc0193b0 con 0x7f54ec155ac0 2024-09-17T03:35:05.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.736+0000 7f54f0e00640 1 -- 172.21.15.121:0/923125828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54ec155ac0 msgr2=0x7f54ec158620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.736+0000 7f54f0e00640 1 --2- 172.21.15.121:0/923125828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54ec155ac0 0x7f54ec158620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f54ec08cbc0 tx=0x7f54dc00b820 comp rx=0 tx=0).stop 2024-09-17T03:35:05.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.736+0000 7f54f0e00640 1 -- 172.21.15.121:0/923125828 shutdown_connections 2024-09-17T03:35:05.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.736+0000 7f54f0e00640 1 --2- 172.21.15.121:0/923125828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54ec0ca8d0 0x7f54ec150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.736+0000 7f54f0e00640 1 --2- 172.21.15.121:0/923125828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54ec0ca4c0 0x7f54ec1507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.736+0000 7f54f0e00640 1 --2- 172.21.15.121:0/923125828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54ec155ac0 0x7f54ec158620 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.736+0000 7f54f0e00640 1 -- 172.21.15.121:0/923125828 >> 172.21.15.121:0/923125828 conn(0x7f54ec0d1960 msgr2=0x7f54ec0b92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.737+0000 7f54f0e00640 1 -- 172.21.15.121:0/923125828 shutdown_connections 2024-09-17T03:35:05.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.737+0000 7f54f0e00640 1 -- 172.21.15.121:0/923125828 wait complete. 2024-09-17T03:35:05.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.748+0000 7ff17fe00640 1 -- 172.21.15.121:0/2666915354 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7ff158005580 con 0x7ff18006d2b0 2024-09-17T03:35:05.752 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.754+0000 7ff176a00640 1 -- 172.21.15.121:0/2666915354 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v21)=0 v21) ==== 125+0+0 (secure 0 0 0) 0x7ff17800f6e0 con 0x7ff18006d2b0 2024-09-17T03:35:05.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.755+0000 7fda44e00640 1 -- 172.21.15.121:0/2111430046 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fda401fd310 con 0x7fda40162450 2024-09-17T03:35:05.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.756+0000 7ff17fe00640 1 -- 172.21.15.121:0/2666915354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18006d2b0 msgr2=0x7ff180202f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.756+0000 7ff17fe00640 1 --2- 172.21.15.121:0/2666915354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18006d2b0 0x7ff180202f60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff1780133a0 tx=0x7ff1780337a0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.757+0000 7ff17fe00640 1 -- 172.21.15.121:0/2666915354 shutdown_connections 2024-09-17T03:35:05.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.757+0000 7ff17fe00640 1 --2- 172.21.15.121:0/2666915354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff180162710 0x7ff1800ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.757+0000 7ff17fe00640 1 --2- 172.21.15.121:0/2666915354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1800cfa10 0x7ff1800c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.757+0000 7ff17fe00640 1 --2- 172.21.15.121:0/2666915354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff18006d2b0 0x7ff180202f60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.757+0000 7ff17fe00640 1 -- 172.21.15.121:0/2666915354 >> 172.21.15.121:0/2666915354 conn(0x7ff1800d1960 msgr2=0x7ff180154690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.757+0000 7ff17fe00640 1 -- 172.21.15.121:0/2666915354 shutdown_connections 2024-09-17T03:35:05.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.757+0000 7ff17fe00640 1 -- 172.21.15.121:0/2666915354 wait complete. 2024-09-17T03:35:05.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.760+0000 7fda36000640 1 -- 172.21.15.121:0/2111430046 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v22)=0 v22) ==== 106+0+0 (secure 0 0 0) 0x7fda3800ae00 con 0x7fda40162450 2024-09-17T03:35:05.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.761+0000 7fda44e00640 1 -- 172.21.15.121:0/2111430046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda40162450 msgr2=0x7fda400b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.761+0000 7fda44e00640 1 --2- 172.21.15.121:0/2111430046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda40162450 0x7fda400b5140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fda3800c700 tx=0x7fda3800cbc0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.761+0000 7fda44e00640 1 -- 172.21.15.121:0/2111430046 shutdown_connections 2024-09-17T03:35:05.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.761+0000 7fda44e00640 1 --2- 172.21.15.121:0/2111430046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda40162450 0x7fda400b5140 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.762+0000 7fda44e00640 1 --2- 172.21.15.121:0/2111430046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda400cc160 0x7fda400b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.762+0000 7fda44e00640 1 --2- 172.21.15.121:0/2111430046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda400aee70 0x7fda400b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.762+0000 7fda44e00640 1 -- 172.21.15.121:0/2111430046 >> 172.21.15.121:0/2111430046 conn(0x7fda400b1b90 msgr2=0x7fda40161510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.762+0000 7fda44e00640 1 -- 172.21.15.121:0/2111430046 shutdown_connections 2024-09-17T03:35:05.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.762+0000 7fda44e00640 1 -- 172.21.15.121:0/2111430046 wait complete. 2024-09-17T03:35:05.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.774+0000 7fc24e000640 1 -- 172.21.15.121:0/4018099011 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fc2480af7e0 con 0x7fc2481e65f0 2024-09-17T03:35:05.776 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.778+0000 7fc23f400640 1 -- 172.21.15.121:0/4018099011 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v23)=0 v23) ==== 111+0+0 (secure 0 0 0) 0x7fc23801c3d0 con 0x7fc2481e65f0 2024-09-17T03:35:05.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.779+0000 7fc24e000640 1 -- 172.21.15.121:0/4018099011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2481e65f0 msgr2=0x7fc2480a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:05.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.779+0000 7fc24e000640 1 --2- 172.21.15.121:0/4018099011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2481e65f0 0x7fc2480a0290 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc2480d1160 tx=0x7fc238001630 comp rx=0 tx=0).stop 2024-09-17T03:35:05.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.779+0000 7fc24e000640 1 -- 172.21.15.121:0/4018099011 shutdown_connections 2024-09-17T03:35:05.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.779+0000 7fc24e000640 1 --2- 172.21.15.121:0/4018099011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2481e65f0 0x7fc2480a0290 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.779+0000 7fc24e000640 1 --2- 172.21.15.121:0/4018099011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2481e5ca0 0x7fc2481e60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.779+0000 7fc24e000640 1 --2- 172.21.15.121:0/4018099011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c003a70 0x7fc2481e7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:05.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.779+0000 7fc24e000640 1 -- 172.21.15.121:0/4018099011 >> 172.21.15.121:0/4018099011 conn(0x7fc2480b1b90 msgr2=0x7fc248068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:05.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.779+0000 7fc24e000640 1 -- 172.21.15.121:0/4018099011 shutdown_connections 2024-09-17T03:35:05.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:05.779+0000 7fc24e000640 1 -- 172.21.15.121:0/4018099011 wait complete. 2024-09-17T03:35:05.804 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.804 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.804 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.804 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.804 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi121') 2024-09-17T03:35:05.804 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config dump 2024-09-17T03:35:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.062+0000 7f0b6dc00640 1 -- 172.21.15.121:0/696598656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b6806e500 msgr2=0x7f0b680cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.062+0000 7f0b6dc00640 1 --2- 172.21.15.121:0/696598656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b6806e500 0x7f0b680cc020 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0b60005fd0 tx=0x7f0b6002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.062+0000 7f0b6dc00640 1 -- 172.21.15.121:0/696598656 shutdown_connections 2024-09-17T03:35:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.062+0000 7f0b6dc00640 1 --2- 172.21.15.121:0/696598656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b6806e500 0x7f0b680cc020 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.062+0000 7f0b6dc00640 1 --2- 172.21.15.121:0/696598656 >> v2:172.21.15.176:3300/0 conn(0x7f0b68074cb0 0x7f0b68073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.062+0000 7f0b6dc00640 1 -- 172.21.15.121:0/696598656 >> 172.21.15.121:0/696598656 conn(0x7f0b680cca40 msgr2=0x7f0b680cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.062+0000 7f0b6dc00640 1 -- 172.21.15.121:0/696598656 shutdown_connections 2024-09-17T03:35:06.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.062+0000 7f0b6dc00640 1 -- 172.21.15.121:0/696598656 wait complete. 2024-09-17T03:35:06.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.064+0000 7f0b6dc00640 1 Processor -- start 2024-09-17T03:35:06.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.064+0000 7f0b6dc00640 1 -- start start 2024-09-17T03:35:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b6dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68074cb0 0x7f0b680b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b6dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b680cbc10 0x7f0b681e63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b6dc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b6809e140 0x7f0b681e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b6dc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6806f3f0 con 0x7f0b6809e140 2024-09-17T03:35:06.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b6dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6806f270 con 0x7f0b680cbc10 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b6dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b6806f570 con 0x7f0b68074cb0 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b67400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b6809e140 0x7f0b681e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b67400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b6809e140 0x7f0b681e6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54052/0 (socket says 172.21.15.121:54052) 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b66a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68074cb0 0x7f0b680b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b67400640 1 -- 172.21.15.121:0/3523357420 learned_addr learned my addr 172.21.15.121:0/3523357420 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b66000640 1 --2- 172.21.15.121:0/3523357420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b680cbc10 0x7f0b681e63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b66a00640 1 -- 172.21.15.121:0/3523357420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b680cbc10 msgr2=0x7f0b681e63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b66a00640 1 --2- 172.21.15.121:0/3523357420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b680cbc10 0x7f0b681e63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b66a00640 1 -- 172.21.15.121:0/3523357420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b6809e140 msgr2=0x7f0b681e6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b66a00640 1 --2- 172.21.15.121:0/3523357420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b6809e140 0x7f0b681e6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.066+0000 7f0b66a00640 1 -- 172.21.15.121:0/3523357420 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6815a230 con 0x7f0b68074cb0 2024-09-17T03:35:06.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.067+0000 7f0b66a00640 1 --2- 172.21.15.121:0/3523357420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68074cb0 0x7f0b680b1350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0b6815a730 tx=0x7f0b5800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.067+0000 7f0b5ea00640 1 -- 172.21.15.121:0/3523357420 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58004440 con 0x7f0b68074cb0 2024-09-17T03:35:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.067+0000 7f0b5ea00640 1 -- 172.21.15.121:0/3523357420 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b5800c8f0 con 0x7f0b68074cb0 2024-09-17T03:35:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.067+0000 7f0b5ea00640 1 -- 172.21.15.121:0/3523357420 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800cd20 con 0x7f0b68074cb0 2024-09-17T03:35:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.067+0000 7f0b6dc00640 1 -- 172.21.15.121:0/3523357420 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b68146e20 con 0x7f0b68074cb0 2024-09-17T03:35:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.067+0000 7f0b6dc00640 1 -- 172.21.15.121:0/3523357420 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b681473a0 con 0x7f0b68074cb0 2024-09-17T03:35:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.067+0000 7f0b5ea00640 1 -- 172.21.15.121:0/3523357420 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0b580053b0 con 0x7f0b68074cb0 2024-09-17T03:35:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.067+0000 7f0b5ea00640 1 -- 172.21.15.121:0/3523357420 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0b58003b00 con 0x7f0b68074cb0 2024-09-17T03:35:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.069+0000 7f0b6dc00640 1 -- 172.21.15.121:0/3523357420 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b681475e0 con 0x7f0b68074cb0 2024-09-17T03:35:06.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.071+0000 7f0b5ea00640 1 -- 172.21.15.121:0/3523357420 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0b681475e0 con 0x7f0b68074cb0 2024-09-17T03:35:06.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.134+0000 7f0b6dc00640 1 -- 172.21.15.121:0/3523357420 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f0b6806fa90 con 0x7f0b68074cb0 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.136+0000 7f0b5ea00640 1 -- 172.21.15.121:0/3523357420 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f0b6815a230 con 0x7f0b68074cb0 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_client 20/20 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds 20/20 2024-09-17T03:35:06.136 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_ms 2/2 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_frag true 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_verify_scatter true 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced client_mount_timeout 600 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_client 20/20 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_ms 1/1 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:35:06.137 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:35:06.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.136+0000 7f0b6dc00640 1 -- 172.21.15.121:0/3523357420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68074cb0 msgr2=0x7f0b680b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:06.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.136+0000 7f0b6dc00640 1 --2- 172.21.15.121:0/3523357420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68074cb0 0x7f0b680b1350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0b6815a730 tx=0x7f0b5800ee50 comp rx=0 tx=0).stop 2024-09-17T03:35:06.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.136+0000 7f0b6dc00640 1 -- 172.21.15.121:0/3523357420 shutdown_connections 2024-09-17T03:35:06.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.136+0000 7f0b6dc00640 1 --2- 172.21.15.121:0/3523357420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b6809e140 0x7f0b681e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.136+0000 7f0b6dc00640 1 --2- 172.21.15.121:0/3523357420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b680cbc10 0x7f0b681e63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.136+0000 7f0b6dc00640 1 --2- 172.21.15.121:0/3523357420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b68074cb0 0x7f0b680b1350 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.136+0000 7f0b6dc00640 1 -- 172.21.15.121:0/3523357420 >> 172.21.15.121:0/3523357420 conn(0x7f0b680cca40 msgr2=0x7f0b6815b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:06.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.136+0000 7f0b6dc00640 1 -- 172.21.15.121:0/3523357420 shutdown_connections 2024-09-17T03:35:06.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.136+0000 7f0b6dc00640 1 -- 172.21.15.121:0/3523357420 wait complete. 2024-09-17T03:35:06.157 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T03:35:06.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T03:35:06.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.380+0000 7f69b1400640 1 -- 172.21.15.121:0/2373527429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ac162710 msgr2=0x7f69ac0cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:06.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.380+0000 7f69b1400640 1 --2- 172.21.15.121:0/2373527429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ac162710 0x7f69ac0cf300 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f69ac08cea0 tx=0x7f699802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.380+0000 7f69b1400640 1 -- 172.21.15.121:0/2373527429 shutdown_connections 2024-09-17T03:35:06.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.380+0000 7f69b1400640 1 --2- 172.21.15.121:0/2373527429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ac162710 0x7f69ac0cf300 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.381+0000 7f69b1400640 1 --2- 172.21.15.121:0/2373527429 >> v2:172.21.15.176:3300/0 conn(0x7f69ac06d2b0 0x7f69ac1621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.381+0000 7f69b1400640 1 -- 172.21.15.121:0/2373527429 >> 172.21.15.121:0/2373527429 conn(0x7f69ac0d1960 msgr2=0x7f69ac0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:06.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.381+0000 7f69b1400640 1 -- 172.21.15.121:0/2373527429 shutdown_connections 2024-09-17T03:35:06.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.381+0000 7f69b1400640 1 -- 172.21.15.121:0/2373527429 wait complete. 2024-09-17T03:35:06.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.383+0000 7f69b1400640 1 Processor -- start 2024-09-17T03:35:06.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.383+0000 7f69b1400640 1 -- start start 2024-09-17T03:35:06.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.384+0000 7f69b1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac06d2b0 0x7f69ac1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:06.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.384+0000 7f69b1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ac0cf840 0x7f69ac1f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:06.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69b1400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ac162710 0x7f69ac0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:06.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69b1400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac155940 con 0x7f69ac0cf840 2024-09-17T03:35:06.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69b1400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac1557c0 con 0x7f69ac06d2b0 2024-09-17T03:35:06.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69b1400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f69ac155ac0 con 0x7f69ac162710 2024-09-17T03:35:06.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69ab400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ac0cf840 0x7f69ac1f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:06.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69abe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac06d2b0 0x7f69ac1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:06.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69ab400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ac0cf840 0x7f69ac1f63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54072/0 (socket says 172.21.15.121:54072) 2024-09-17T03:35:06.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69ab400640 1 -- 172.21.15.121:0/894717513 learned_addr learned my addr 172.21.15.121:0/894717513 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:06.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69b0a00640 1 --2- 172.21.15.121:0/894717513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ac162710 0x7f69ac0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:06.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69ab400640 1 -- 172.21.15.121:0/894717513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ac162710 msgr2=0x7f69ac0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:06.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69ab400640 1 --2- 172.21.15.121:0/894717513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ac162710 0x7f69ac0ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69ab400640 1 -- 172.21.15.121:0/894717513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac06d2b0 msgr2=0x7f69ac1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:06.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69ab400640 1 --2- 172.21.15.121:0/894717513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac06d2b0 0x7f69ac1577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69ab400640 1 -- 172.21.15.121:0/894717513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac1f6900 con 0x7f69ac0cf840 2024-09-17T03:35:06.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.385+0000 7f69abe00640 1 --2- 172.21.15.121:0/894717513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac06d2b0 0x7f69ac1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:06.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.386+0000 7f69ab400640 1 --2- 172.21.15.121:0/894717513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ac0cf840 0x7f69ac1f63c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6998034040 tx=0x7f6998003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:06.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.386+0000 7f69a3e00640 1 -- 172.21.15.121:0/894717513 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699803e030 con 0x7f69ac0cf840 2024-09-17T03:35:06.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.386+0000 7f69a3e00640 1 -- 172.21.15.121:0/894717513 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6998003d10 con 0x7f69ac0cf840 2024-09-17T03:35:06.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.386+0000 7f69a3e00640 1 -- 172.21.15.121:0/894717513 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998035040 con 0x7f69ac0cf840 2024-09-17T03:35:06.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.386+0000 7f69b1400640 1 -- 172.21.15.121:0/894717513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ac1561d0 con 0x7f69ac0cf840 2024-09-17T03:35:06.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.386+0000 7f69b1400640 1 -- 172.21.15.121:0/894717513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ac1569e0 con 0x7f69ac0cf840 2024-09-17T03:35:06.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.386+0000 7f69a3e00640 1 -- 172.21.15.121:0/894717513 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6998041030 con 0x7f69ac0cf840 2024-09-17T03:35:06.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.386+0000 7f69a3e00640 1 -- 172.21.15.121:0/894717513 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6998031400 con 0x7f69ac0cf840 2024-09-17T03:35:06.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.387+0000 7f69b1400640 1 -- 172.21.15.121:0/894717513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ac156470 con 0x7f69ac0cf840 2024-09-17T03:35:06.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.389+0000 7f69a3e00640 1 -- 172.21.15.121:0/894717513 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6998004f30 con 0x7f69ac0cf840 2024-09-17T03:35:06.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.457+0000 7f69b1400640 1 -- 172.21.15.121:0/894717513 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f69ac0b96a0 con 0x7f69ac0cf840 2024-09-17T03:35:06.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.459+0000 7f69a3e00640 1 -- 172.21.15.121:0/894717513 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f6998043410 con 0x7f69ac0cf840 2024-09-17T03:35:06.460 INFO:teuthology.orchestra.run.smithi121.stderr:adjusted tunables profile to default 2024-09-17T03:35:06.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.460+0000 7f69b1400640 1 -- 172.21.15.121:0/894717513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ac0cf840 msgr2=0x7f69ac1f63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:06.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.460+0000 7f69b1400640 1 --2- 172.21.15.121:0/894717513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ac0cf840 0x7f69ac1f63c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6998034040 tx=0x7f6998003820 comp rx=0 tx=0).stop 2024-09-17T03:35:06.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.460+0000 7f69b1400640 1 -- 172.21.15.121:0/894717513 shutdown_connections 2024-09-17T03:35:06.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.460+0000 7f69b1400640 1 --2- 172.21.15.121:0/894717513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69ac162710 0x7f69ac0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.460+0000 7f69b1400640 1 --2- 172.21.15.121:0/894717513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ac0cf840 0x7f69ac1f63c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.460+0000 7f69b1400640 1 --2- 172.21.15.121:0/894717513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69ac06d2b0 0x7f69ac1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:06.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.460+0000 7f69b1400640 1 -- 172.21.15.121:0/894717513 >> 172.21.15.121:0/894717513 conn(0x7f69ac0d1960 msgr2=0x7f69ac154d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:06.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.460+0000 7f69b1400640 1 -- 172.21.15.121:0/894717513 shutdown_connections 2024-09-17T03:35:06.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:06.460+0000 7f69b1400640 1 -- 172.21.15.121:0/894717513 wait complete. 2024-09-17T03:35:06.481 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T03:35:06.481 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T03:35:06.481 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:35:06.481 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T03:35:06.537 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:35:06.538 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T03:35:06.634 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:35:06.634 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T03:35:06.730 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:35:06.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T03:35:06.827 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:35:06.827 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T03:35:06.884 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:35:06.884 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T03:35:06.981 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:35:06.981 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T03:35:07.077 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:35:07.077 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T03:35:07.174 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92 0 2024-09-17T03:35:07.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.433+0000 7f94b3200640 1 -- 172.21.15.176:0/3210451803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94ac15e4d0 msgr2=0x7f94ac0b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:07.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.433+0000 7f94b3200640 1 --2- 172.21.15.176:0/3210451803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94ac15e4d0 0x7f94ac0b7720 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009900 tx=0x7f94a002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.433+0000 7f94b3200640 1 -- 172.21.15.176:0/3210451803 shutdown_connections 2024-09-17T03:35:07.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.433+0000 7f94b3200640 1 --2- 172.21.15.176:0/3210451803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94ac15e4d0 0x7f94ac0b7720 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.433+0000 7f94b3200640 1 -- 172.21.15.176:0/3210451803 >> 172.21.15.176:0/3210451803 conn(0x7f94ac0d1980 msgr2=0x7f94ac0d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:07.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.434+0000 7f94b3200640 1 -- 172.21.15.176:0/3210451803 shutdown_connections 2024-09-17T03:35:07.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.434+0000 7f94b3200640 1 -- 172.21.15.176:0/3210451803 wait complete. 2024-09-17T03:35:07.436 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.436+0000 7f94b3200640 1 Processor -- start 2024-09-17T03:35:07.436 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.436+0000 7f94b3200640 1 -- start start 2024-09-17T03:35:07.438 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.437+0000 7f94b3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94ac0b7c60 0x7f94ac0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:07.438 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.437+0000 7f94b3200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ac15e4d0 0x7f94ac0b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:07.438 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.437+0000 7f94b3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94ac1620c0 0x7f94ac149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:07.438 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.437+0000 7f94b3200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac06e0a0 con 0x7f94ac15e4d0 2024-09-17T03:35:07.438 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.437+0000 7f94b3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac06df20 con 0x7f94ac1620c0 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.437+0000 7f94b3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f94ac06e220 con 0x7f94ac0b7c60 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94ac1620c0 0x7f94ac149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b1e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94ac0b7c60 0x7f94ac0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b1e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94ac0b7c60 0x7f94ac0ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:50580/0 (socket says 172.21.15.176:50580) 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ac15e4d0 0x7f94ac0b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94ac1620c0 0x7f94ac149d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:46736/0 (socket says 172.21.15.176:46736) 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b1e00640 1 -- 172.21.15.176:0/1432564506 learned_addr learned my addr 172.21.15.176:0/1432564506 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b1e00640 1 -- 172.21.15.176:0/1432564506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94ac1620c0 msgr2=0x7f94ac149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b1e00640 1 --2- 172.21.15.176:0/1432564506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94ac1620c0 0x7f94ac149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b1e00640 1 -- 172.21.15.176:0/1432564506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ac15e4d0 msgr2=0x7f94ac0b93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b1e00640 1 --2- 172.21.15.176:0/1432564506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ac15e4d0 0x7f94ac0b93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b1e00640 1 -- 172.21.15.176:0/1432564506 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ac0c8ee0 con 0x7f94ac0b7c60 2024-09-17T03:35:07.439 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.438+0000 7f94b2800640 1 --2- 172.21.15.176:0/1432564506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94ac1620c0 0x7f94ac149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:07.440 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.439+0000 7f94b1e00640 1 --2- 172.21.15.176:0/1432564506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94ac0b7c60 0x7f94ac0ca890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94a0006010 tx=0x7f94a00038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:07.440 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.439+0000 7f94a6000640 1 -- 172.21.15.176:0/1432564506 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a003e030 con 0x7f94ac0b7c60 2024-09-17T03:35:07.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.439+0000 7f94a6000640 1 -- 172.21.15.176:0/1432564506 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94a0003ca0 con 0x7f94ac0b7c60 2024-09-17T03:35:07.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.439+0000 7f94a6000640 1 -- 172.21.15.176:0/1432564506 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a0035040 con 0x7f94ac0b7c60 2024-09-17T03:35:07.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.439+0000 7f94b3200640 1 -- 172.21.15.176:0/1432564506 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ac0c91c0 con 0x7f94ac0b7c60 2024-09-17T03:35:07.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.439+0000 7f94b3200640 1 -- 172.21.15.176:0/1432564506 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ac0c9ca0 con 0x7f94ac0b7c60 2024-09-17T03:35:07.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.439+0000 7f94a6000640 1 -- 172.21.15.176:0/1432564506 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f94a0041030 con 0x7f94ac0b7c60 2024-09-17T03:35:07.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.439+0000 7f94a6000640 1 -- 172.21.15.176:0/1432564506 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f94a0043bd0 con 0x7f94ac0b7c60 2024-09-17T03:35:07.441 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.440+0000 7f94b3200640 1 -- 172.21.15.176:0/1432564506 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ac0b7720 con 0x7f94ac0b7c60 2024-09-17T03:35:07.442 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.442+0000 7f94a6000640 1 -- 172.21.15.176:0/1432564506 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f94a0004f20 con 0x7f94ac0b7c60 2024-09-17T03:35:07.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.514+0000 7f94b3200640 1 -- 172.21.15.176:0/1432564506 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92", "id": 0} v 0) -- 0x7f94ac150e30 con 0x7f94ac0b7c60 2024-09-17T03:35:07.520 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.520+0000 7f94a6000640 1 -- 172.21.15.176:0/1432564506 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f94a004d480 con 0x7f94ac0b7c60 2024-09-17T03:35:07.520 INFO:teuthology.orchestra.run.smithi176.stdout:0 2024-09-17T03:35:07.521 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.521+0000 7f94b3200640 1 -- 172.21.15.176:0/1432564506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94ac0b7c60 msgr2=0x7f94ac0ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:07.521 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.521+0000 7f94b3200640 1 --2- 172.21.15.176:0/1432564506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94ac0b7c60 0x7f94ac0ca890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94a0006010 tx=0x7f94a00038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.521 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.521+0000 7f94b3200640 1 -- 172.21.15.176:0/1432564506 shutdown_connections 2024-09-17T03:35:07.521 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.521+0000 7f94b3200640 1 --2- 172.21.15.176:0/1432564506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94ac1620c0 0x7f94ac149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.521 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.521+0000 7f94b3200640 1 --2- 172.21.15.176:0/1432564506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ac15e4d0 0x7f94ac0b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.522 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.521+0000 7f94b3200640 1 --2- 172.21.15.176:0/1432564506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94ac0b7c60 0x7f94ac0ca890 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.522 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.521+0000 7f94b3200640 1 -- 172.21.15.176:0/1432564506 >> 172.21.15.176:0/1432564506 conn(0x7f94ac0d1980 msgr2=0x7f94ac0b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:07.522 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.521+0000 7f94b3200640 1 -- 172.21.15.176:0/1432564506 shutdown_connections 2024-09-17T03:35:07.522 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.521+0000 7f94b3200640 1 -- 172.21.15.176:0/1432564506 wait complete. 2024-09-17T03:35:07.541 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new e2d49e14-74ce-4e74-a18d-45269ee48a91 1 2024-09-17T03:35:07.755 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.754+0000 7fbb27e00640 1 -- 172.21.15.176:0/1822102006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2806d2b0 msgr2=0x7fbb281621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:07.756 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.754+0000 7fbb27e00640 1 --2- 172.21.15.176:0/1822102006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2806d2b0 0x7fbb281621d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009860 tx=0x7fbb1802a510 comp rx=0 tx=0).stop 2024-09-17T03:35:07.756 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.755+0000 7fbb27e00640 1 -- 172.21.15.176:0/1822102006 shutdown_connections 2024-09-17T03:35:07.756 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.755+0000 7fbb27e00640 1 --2- 172.21.15.176:0/1822102006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2806d2b0 0x7fbb281621d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.756 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.755+0000 7fbb27e00640 1 -- 172.21.15.176:0/1822102006 >> 172.21.15.176:0/1822102006 conn(0x7fbb280d1960 msgr2=0x7fbb280d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:07.756 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.755+0000 7fbb27e00640 1 -- 172.21.15.176:0/1822102006 shutdown_connections 2024-09-17T03:35:07.756 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.755+0000 7fbb27e00640 1 -- 172.21.15.176:0/1822102006 wait complete. 2024-09-17T03:35:07.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.757+0000 7fbb27e00640 1 Processor -- start 2024-09-17T03:35:07.757 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.757+0000 7fbb27e00640 1 -- start start 2024-09-17T03:35:07.760 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb27e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2806d2b0 0x7fbb281f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:07.760 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb27e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb280cfa10 0x7fbb280ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:07.760 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb27e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb28162710 0x7fbb28150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb27e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28155730 con 0x7fbb280cfa10 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb27e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbb281555b0 con 0x7fbb28162710 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb27e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbb281558b0 con 0x7fbb2806d2b0 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb26a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2806d2b0 0x7fbb281f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb26a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2806d2b0 0x7fbb281f8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:50608/0 (socket says 172.21.15.176:50608) 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb26a00640 1 -- 172.21.15.176:0/105291991 learned_addr learned my addr 172.21.15.176:0/105291991 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb27400640 1 --2- 172.21.15.176:0/105291991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb28162710 0x7fbb28150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb26000640 1 --2- 172.21.15.176:0/105291991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb280cfa10 0x7fbb280ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb26a00640 1 -- 172.21.15.176:0/105291991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb28162710 msgr2=0x7fbb28150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb26a00640 1 --2- 172.21.15.176:0/105291991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb28162710 0x7fbb28150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb26a00640 1 -- 172.21.15.176:0/105291991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb280cfa10 msgr2=0x7fbb280ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb26a00640 1 --2- 172.21.15.176:0/105291991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb280cfa10 0x7fbb280ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.759+0000 7fbb26a00640 1 -- 172.21.15.176:0/105291991 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb281f7190 con 0x7fbb2806d2b0 2024-09-17T03:35:07.761 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.760+0000 7fbb26a00640 1 --2- 172.21.15.176:0/105291991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2806d2b0 0x7fbb281f8230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009980 tx=0x7fbb18033d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:07.762 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.760+0000 7fbb1ea00640 1 -- 172.21.15.176:0/105291991 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18031d60 con 0x7fbb2806d2b0 2024-09-17T03:35:07.762 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.760+0000 7fbb1ea00640 1 -- 172.21.15.176:0/105291991 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb180330d0 con 0x7fbb2806d2b0 2024-09-17T03:35:07.762 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.760+0000 7fbb27e00640 1 -- 172.21.15.176:0/105291991 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb281f7470 con 0x7fbb2806d2b0 2024-09-17T03:35:07.762 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.760+0000 7fbb1ea00640 1 -- 172.21.15.176:0/105291991 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18033520 con 0x7fbb2806d2b0 2024-09-17T03:35:07.762 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.760+0000 7fbb27e00640 1 -- 172.21.15.176:0/105291991 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb281f7a30 con 0x7fbb2806d2b0 2024-09-17T03:35:07.762 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.760+0000 7fbb1ea00640 1 -- 172.21.15.176:0/105291991 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbb180035f0 con 0x7fbb2806d2b0 2024-09-17T03:35:07.762 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.761+0000 7fbb1ea00640 1 -- 172.21.15.176:0/105291991 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fbb1803b7c0 con 0x7fbb2806d2b0 2024-09-17T03:35:07.762 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.761+0000 7fbb27e00640 1 -- 172.21.15.176:0/105291991 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb281621d0 con 0x7fbb2806d2b0 2024-09-17T03:35:07.764 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.764+0000 7fbb1ea00640 1 -- 172.21.15.176:0/105291991 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbb18051020 con 0x7fbb2806d2b0 2024-09-17T03:35:07.836 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.835+0000 7fbb27e00640 1 -- 172.21.15.176:0/105291991 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e2d49e14-74ce-4e74-a18d-45269ee48a91", "id": 1} v 0) -- 0x7fbb2815f740 con 0x7fbb2806d2b0 2024-09-17T03:35:07.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.840+0000 7fbb1ea00640 1 -- 172.21.15.176:0/105291991 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2d49e14-74ce-4e74-a18d-45269ee48a91", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fbb1803f030 con 0x7fbb2806d2b0 2024-09-17T03:35:07.841 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:35:07.842 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.842+0000 7fbb27e00640 1 -- 172.21.15.176:0/105291991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2806d2b0 msgr2=0x7fbb281f8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:07.843 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.842+0000 7fbb27e00640 1 --2- 172.21.15.176:0/105291991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2806d2b0 0x7fbb281f8230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009980 tx=0x7fbb18033d60 comp rx=0 tx=0).stop 2024-09-17T03:35:07.843 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.842+0000 7fbb27e00640 1 -- 172.21.15.176:0/105291991 shutdown_connections 2024-09-17T03:35:07.843 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.842+0000 7fbb27e00640 1 --2- 172.21.15.176:0/105291991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb28162710 0x7fbb28150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.843 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.842+0000 7fbb27e00640 1 --2- 172.21.15.176:0/105291991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb280cfa10 0x7fbb280ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.843 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.842+0000 7fbb27e00640 1 --2- 172.21.15.176:0/105291991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2806d2b0 0x7fbb281f8230 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:07.843 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.842+0000 7fbb27e00640 1 -- 172.21.15.176:0/105291991 >> 172.21.15.176:0/105291991 conn(0x7fbb280d1960 msgr2=0x7fbb280cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:07.843 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.842+0000 7fbb27e00640 1 -- 172.21.15.176:0/105291991 shutdown_connections 2024-09-17T03:35:07.843 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:07.842+0000 7fbb27e00640 1 -- 172.21.15.176:0/105291991 wait complete. 2024-09-17T03:35:07.863 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new d41decb9-527a-4210-a5e1-4dc306c86f92 2 2024-09-17T03:35:08.079 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.078+0000 7f141b000640 1 -- 172.21.15.176:0/3511689908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14140b7c60 msgr2=0x7f14140d3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.079 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.078+0000 7f141b000640 1 --2- 172.21.15.176:0/3511689908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14140b7c60 0x7f14140d3420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f14140d2750 tx=0x7f140002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.079 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.078+0000 7f141b000640 1 -- 172.21.15.176:0/3511689908 shutdown_connections 2024-09-17T03:35:08.079 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.078+0000 7f141b000640 1 --2- 172.21.15.176:0/3511689908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14140b7c60 0x7f14140d3420 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.079 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.078+0000 7f141b000640 1 --2- 172.21.15.176:0/3511689908 >> v2:172.21.15.121:3300/0 conn(0x7f141415e4d0 0x7f14140b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.079 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.078+0000 7f141b000640 1 -- 172.21.15.176:0/3511689908 >> 172.21.15.176:0/3511689908 conn(0x7f14140d1980 msgr2=0x7f14140d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:08.079 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.078+0000 7f141b000640 1 -- 172.21.15.176:0/3511689908 shutdown_connections 2024-09-17T03:35:08.079 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.078+0000 7f141b000640 1 -- 172.21.15.176:0/3511689908 wait complete. 2024-09-17T03:35:08.082 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.082+0000 7f141b000640 1 Processor -- start 2024-09-17T03:35:08.082 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.082+0000 7f141b000640 1 -- start start 2024-09-17T03:35:08.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.084+0000 7f141b000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14140b7c60 0x7f14141f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:08.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.084+0000 7f141b000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14140d3960 0x7f14140b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:08.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.084+0000 7f141b000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f141415e4d0 0x7f14140b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:08.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.084+0000 7f141b000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f141406e020 con 0x7f141415e4d0 2024-09-17T03:35:08.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.084+0000 7f141b000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f141406dea0 con 0x7f14140d3960 2024-09-17T03:35:08.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.084+0000 7f141b000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f141406e1a0 con 0x7f14140b7c60 2024-09-17T03:35:08.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.085+0000 7f1419c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14140b7c60 0x7f14141f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:08.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.085+0000 7f1419c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14140b7c60 0x7f14141f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:50618/0 (socket says 172.21.15.176:50618) 2024-09-17T03:35:08.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.085+0000 7f1419c00640 1 -- 172.21.15.176:0/727017743 learned_addr learned my addr 172.21.15.176:0/727017743 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T03:35:08.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.085+0000 7f1419200640 1 --2- 172.21.15.176:0/727017743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14140d3960 0x7f14140b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:08.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.085+0000 7f141a600640 1 --2- 172.21.15.176:0/727017743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f141415e4d0 0x7f14140b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:08.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.085+0000 7f1419c00640 1 -- 172.21.15.176:0/727017743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14140d3960 msgr2=0x7f14140b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.085+0000 7f1419c00640 1 --2- 172.21.15.176:0/727017743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14140d3960 0x7f14140b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.085+0000 7f1419c00640 1 -- 172.21.15.176:0/727017743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f141415e4d0 msgr2=0x7f14140b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.085+0000 7f1419c00640 1 --2- 172.21.15.176:0/727017743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f141415e4d0 0x7f14140b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.085+0000 7f1419c00640 1 -- 172.21.15.176:0/727017743 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14140b50a0 con 0x7f14140b7c60 2024-09-17T03:35:08.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.086+0000 7f1419c00640 1 --2- 172.21.15.176:0/727017743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14140b7c60 0x7f14141f64d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f140800ea20 tx=0x7f140800eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:08.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.086+0000 7f1411600640 1 -- 172.21.15.176:0/727017743 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140800ce40 con 0x7f14140b7c60 2024-09-17T03:35:08.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.086+0000 7f1411600640 1 -- 172.21.15.176:0/727017743 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1408004020 con 0x7f14140b7c60 2024-09-17T03:35:08.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.086+0000 7f141b000640 1 -- 172.21.15.176:0/727017743 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14140b5380 con 0x7f14140b7c60 2024-09-17T03:35:08.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.086+0000 7f1411600640 1 -- 172.21.15.176:0/727017743 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408004470 con 0x7f14140b7c60 2024-09-17T03:35:08.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.086+0000 7f141b000640 1 -- 172.21.15.176:0/727017743 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f14140b5940 con 0x7f14140b7c60 2024-09-17T03:35:08.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.086+0000 7f1411600640 1 -- 172.21.15.176:0/727017743 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1408004b50 con 0x7f14140b7c60 2024-09-17T03:35:08.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.086+0000 7f1411600640 1 -- 172.21.15.176:0/727017743 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f1408009490 con 0x7f14140b7c60 2024-09-17T03:35:08.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.087+0000 7f141b000640 1 -- 172.21.15.176:0/727017743 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14140d3420 con 0x7f14140b7c60 2024-09-17T03:35:08.090 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.089+0000 7f1411600640 1 -- 172.21.15.176:0/727017743 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1408027080 con 0x7f14140b7c60 2024-09-17T03:35:08.161 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.161+0000 7f141b000640 1 -- 172.21.15.176:0/727017743 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d41decb9-527a-4210-a5e1-4dc306c86f92", "id": 2} v 0) -- 0x7f1414076180 con 0x7f14140b7c60 2024-09-17T03:35:08.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.165+0000 7f1411600640 1 -- 172.21.15.176:0/727017743 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d41decb9-527a-4210-a5e1-4dc306c86f92", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f1408005020 con 0x7f14140b7c60 2024-09-17T03:35:08.165 INFO:teuthology.orchestra.run.smithi176.stdout:2 2024-09-17T03:35:08.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.166+0000 7f141b000640 1 -- 172.21.15.176:0/727017743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14140b7c60 msgr2=0x7f14141f64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.166+0000 7f141b000640 1 --2- 172.21.15.176:0/727017743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14140b7c60 0x7f14141f64d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f140800ea20 tx=0x7f140800eee0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.166+0000 7f141b000640 1 -- 172.21.15.176:0/727017743 shutdown_connections 2024-09-17T03:35:08.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.166+0000 7f141b000640 1 --2- 172.21.15.176:0/727017743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f141415e4d0 0x7f14140b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.166+0000 7f141b000640 1 --2- 172.21.15.176:0/727017743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14140d3960 0x7f14140b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.166+0000 7f141b000640 1 --2- 172.21.15.176:0/727017743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14140b7c60 0x7f14141f64d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.166+0000 7f141b000640 1 -- 172.21.15.176:0/727017743 >> 172.21.15.176:0/727017743 conn(0x7f14140d1980 msgr2=0x7f14140b92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:08.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.167+0000 7f141b000640 1 -- 172.21.15.176:0/727017743 shutdown_connections 2024-09-17T03:35:08.167 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.167+0000 7f141b000640 1 -- 172.21.15.176:0/727017743 wait complete. 2024-09-17T03:35:08.190 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 9c0e6583-17d1-4b41-86da-1ddee08c995e 3 2024-09-17T03:35:08.406 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.405+0000 7f3593e00640 1 -- 172.21.15.176:0/3140487281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35940cf660 msgr2=0x7f3594162090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.407 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.405+0000 7f3593e00640 1 --2- 172.21.15.176:0/3140487281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35940cf660 0x7f3594162090 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3580009830 tx=0x7f358002a510 comp rx=0 tx=0).stop 2024-09-17T03:35:08.407 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.406+0000 7f3593e00640 1 -- 172.21.15.176:0/3140487281 shutdown_connections 2024-09-17T03:35:08.407 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.406+0000 7f3593e00640 1 --2- 172.21.15.176:0/3140487281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35940cf660 0x7f3594162090 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.407 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.406+0000 7f3593e00640 1 --2- 172.21.15.176:0/3140487281 >> v2:172.21.15.121:3300/0 conn(0x7f359415c210 0x7f359406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.407 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.406+0000 7f3593e00640 1 -- 172.21.15.176:0/3140487281 >> 172.21.15.176:0/3140487281 conn(0x7f35940d0c50 msgr2=0x7f35940d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:08.408 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.406+0000 7f3593e00640 1 -- 172.21.15.176:0/3140487281 shutdown_connections 2024-09-17T03:35:08.408 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.406+0000 7f3593e00640 1 -- 172.21.15.176:0/3140487281 wait complete. 2024-09-17T03:35:08.409 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.408+0000 7f3593e00640 1 Processor -- start 2024-09-17T03:35:08.409 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.408+0000 7f3593e00640 1 -- start start 2024-09-17T03:35:08.414 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.409+0000 7f3593e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35940cf660 0x7f35941f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:08.414 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.409+0000 7f3593e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35940cfa70 0x7f35940b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:08.415 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3593e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35940b6050 0x7f35940b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:08.415 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3593e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f35940b3400 con 0x7f35940cfa70 2024-09-17T03:35:08.415 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3593e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35940b3280 con 0x7f35940b6050 2024-09-17T03:35:08.415 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3593e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f35940b3580 con 0x7f35940cf660 2024-09-17T03:35:08.415 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3592a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35940cf660 0x7f35941f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:08.415 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3592a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35940cf660 0x7f35941f8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:50638/0 (socket says 172.21.15.176:50638) 2024-09-17T03:35:08.416 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3592a00640 1 -- 172.21.15.176:0/3789377221 learned_addr learned my addr 172.21.15.176:0/3789377221 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T03:35:08.416 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3593400640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35940b6050 0x7f35940b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:08.416 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3592000640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35940cfa70 0x7f35940b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:08.416 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3592a00640 1 -- 172.21.15.176:0/3789377221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35940b6050 msgr2=0x7f35940b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.416 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3592a00640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35940b6050 0x7f35940b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.416 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3592a00640 1 -- 172.21.15.176:0/3789377221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35940cfa70 msgr2=0x7f35940b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.417 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3592a00640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35940cfa70 0x7f35940b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.417 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3592a00640 1 -- 172.21.15.176:0/3789377221 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35940c9d10 con 0x7f35940cf660 2024-09-17T03:35:08.417 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3592000640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35940cfa70 0x7f35940b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:08.417 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.410+0000 7f3593400640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35940b6050 0x7f35940b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:08.417 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.411+0000 7f3592a00640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35940cf660 0x7f35941f8050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f358400d770 tx=0x7f358400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:08.417 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.411+0000 7f358aa00640 1 -- 172.21.15.176:0/3789377221 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584017070 con 0x7f35940cf660 2024-09-17T03:35:08.417 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.411+0000 7f358aa00640 1 -- 172.21.15.176:0/3789377221 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3584009d20 con 0x7f35940cf660 2024-09-17T03:35:08.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.411+0000 7f358aa00640 1 -- 172.21.15.176:0/3789377221 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35840106c0 con 0x7f35940cf660 2024-09-17T03:35:08.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.411+0000 7f3593e00640 1 -- 172.21.15.176:0/3789377221 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35940c9ff0 con 0x7f35940cf660 2024-09-17T03:35:08.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.411+0000 7f3593e00640 1 -- 172.21.15.176:0/3789377221 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35940cb2b0 con 0x7f35940cf660 2024-09-17T03:35:08.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.411+0000 7f358aa00640 1 -- 172.21.15.176:0/3789377221 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f358401a070 con 0x7f35940cf660 2024-09-17T03:35:08.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.412+0000 7f358aa00640 1 -- 172.21.15.176:0/3789377221 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3584010cf0 con 0x7f35940cf660 2024-09-17T03:35:08.418 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.412+0000 7f3593e00640 1 -- 172.21.15.176:0/3789377221 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359415c210 con 0x7f35940cf660 2024-09-17T03:35:08.419 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.415+0000 7f358aa00640 1 -- 172.21.15.176:0/3789377221 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3584010860 con 0x7f35940cf660 2024-09-17T03:35:08.486 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.486+0000 7f3593e00640 1 -- 172.21.15.176:0/3789377221 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9c0e6583-17d1-4b41-86da-1ddee08c995e", "id": 3} v 0) -- 0x7f35940c7a50 con 0x7f35940cf660 2024-09-17T03:35:08.491 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.491+0000 7f358aa00640 1 -- 172.21.15.176:0/3789377221 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c0e6583-17d1-4b41-86da-1ddee08c995e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f3584010ac0 con 0x7f35940cf660 2024-09-17T03:35:08.491 INFO:teuthology.orchestra.run.smithi176.stdout:3 2024-09-17T03:35:08.493 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.492+0000 7f3593e00640 1 -- 172.21.15.176:0/3789377221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35940cf660 msgr2=0x7f35941f8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.493 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.492+0000 7f3593e00640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35940cf660 0x7f35941f8050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f358400d770 tx=0x7f358400dc30 comp rx=0 tx=0).stop 2024-09-17T03:35:08.494 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.492+0000 7f3593e00640 1 -- 172.21.15.176:0/3789377221 shutdown_connections 2024-09-17T03:35:08.494 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.492+0000 7f3593e00640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35940b6050 0x7f35940b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.494 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.492+0000 7f3593e00640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35940cfa70 0x7f35940b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.494 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.492+0000 7f3593e00640 1 --2- 172.21.15.176:0/3789377221 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35940cf660 0x7f35941f8050 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.494 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.492+0000 7f3593e00640 1 -- 172.21.15.176:0/3789377221 >> 172.21.15.176:0/3789377221 conn(0x7f35940d0c50 msgr2=0x7f359415d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:08.494 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.492+0000 7f3593e00640 1 -- 172.21.15.176:0/3789377221 shutdown_connections 2024-09-17T03:35:08.495 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.492+0000 7f3593e00640 1 -- 172.21.15.176:0/3789377221 wait complete. 2024-09-17T03:35:08.513 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 3ae2d4c6-e00f-4132-8f96-f661be564aee 4 2024-09-17T03:35:08.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.728+0000 7fa9a0e00640 1 -- 172.21.15.176:0/3989182407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c0d3420 msgr2=0x7fa99c0d3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.728+0000 7fa9a0e00640 1 --2- 172.21.15.176:0/3989182407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c0d3420 0x7fa99c0d3830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0cff30 tx=0x7fa98402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.728+0000 7fa9a0e00640 1 -- 172.21.15.176:0/3989182407 shutdown_connections 2024-09-17T03:35:08.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.728+0000 7fa9a0e00640 1 --2- 172.21.15.176:0/3989182407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c0d3420 0x7fa99c0d3830 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.728+0000 7fa9a0e00640 1 -- 172.21.15.176:0/3989182407 >> 172.21.15.176:0/3989182407 conn(0x7fa99c0d1980 msgr2=0x7fa99c0d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:08.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.728+0000 7fa9a0e00640 1 -- 172.21.15.176:0/3989182407 shutdown_connections 2024-09-17T03:35:08.729 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.728+0000 7fa9a0e00640 1 -- 172.21.15.176:0/3989182407 wait complete. 2024-09-17T03:35:08.730 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.730+0000 7fa9a0e00640 1 Processor -- start 2024-09-17T03:35:08.730 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.730+0000 7fa9a0e00640 1 -- start start 2024-09-17T03:35:08.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa9a0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c0d3420 0x7fa99c150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:08.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa9a0e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c15e4d0 0x7fa99c1f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:08.733 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa9a0e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c1620c0 0x7fa99c1f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:08.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa9a0e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c06e0a0 con 0x7fa99c0d3420 2024-09-17T03:35:08.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa9a0e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c06df20 con 0x7fa99c15e4d0 2024-09-17T03:35:08.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa9a0e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa99c06e220 con 0x7fa99c1620c0 2024-09-17T03:35:08.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa99be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c1620c0 0x7fa99c1f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:08.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa993e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c15e4d0 0x7fa99c1f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:08.734 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa993e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c15e4d0 0x7fa99c1f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:46778/0 (socket says 172.21.15.176:46778) 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa993e00640 1 -- 172.21.15.176:0/4109364342 learned_addr learned my addr 172.21.15.176:0/4109364342 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa99b400640 1 --2- 172.21.15.176:0/4109364342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c0d3420 0x7fa99c150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa993e00640 1 -- 172.21.15.176:0/4109364342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c1620c0 msgr2=0x7fa99c1f6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa993e00640 1 --2- 172.21.15.176:0/4109364342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c1620c0 0x7fa99c1f6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa993e00640 1 -- 172.21.15.176:0/4109364342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c0d3420 msgr2=0x7fa99c150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa993e00640 1 --2- 172.21.15.176:0/4109364342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c0d3420 0x7fa99c150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.732+0000 7fa993e00640 1 -- 172.21.15.176:0/4109364342 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99c1f63c0 con 0x7fa99c15e4d0 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.733+0000 7fa993e00640 1 --2- 172.21.15.176:0/4109364342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c15e4d0 0x7fa99c1f6600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa984006010 tx=0x7fa9840038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.733+0000 7fa993400640 1 -- 172.21.15.176:0/4109364342 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98403e030 con 0x7fa99c15e4d0 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.733+0000 7fa993400640 1 -- 172.21.15.176:0/4109364342 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa984003d90 con 0x7fa99c15e4d0 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.733+0000 7fa9a0e00640 1 -- 172.21.15.176:0/4109364342 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99c15d7c0 con 0x7fa99c15e4d0 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.733+0000 7fa993400640 1 -- 172.21.15.176:0/4109364342 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984035040 con 0x7fa99c15e4d0 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.733+0000 7fa9a0e00640 1 -- 172.21.15.176:0/4109364342 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa99c1e7eb0 con 0x7fa99c15e4d0 2024-09-17T03:35:08.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.733+0000 7fa993400640 1 -- 172.21.15.176:0/4109364342 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa984041030 con 0x7fa99c15e4d0 2024-09-17T03:35:08.736 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.734+0000 7fa993400640 1 -- 172.21.15.176:0/4109364342 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa984043ce0 con 0x7fa99c15e4d0 2024-09-17T03:35:08.736 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.734+0000 7fa9a0e00640 1 -- 172.21.15.176:0/4109364342 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa99c0d3830 con 0x7fa99c15e4d0 2024-09-17T03:35:08.736 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.737+0000 7fa993400640 1 -- 172.21.15.176:0/4109364342 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa984004f00 con 0x7fa99c15e4d0 2024-09-17T03:35:08.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.809+0000 7fa9a0e00640 1 -- 172.21.15.176:0/4109364342 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3ae2d4c6-e00f-4132-8f96-f661be564aee", "id": 4} v 0) -- 0x7fa99c0b8b40 con 0x7fa99c15e4d0 2024-09-17T03:35:08.813 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.813+0000 7fa993400640 1 -- 172.21.15.176:0/4109364342 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ae2d4c6-e00f-4132-8f96-f661be564aee", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fa9840437d0 con 0x7fa99c15e4d0 2024-09-17T03:35:08.814 INFO:teuthology.orchestra.run.smithi176.stdout:4 2024-09-17T03:35:08.815 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.814+0000 7fa9a0e00640 1 -- 172.21.15.176:0/4109364342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c15e4d0 msgr2=0x7fa99c1f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:08.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.814+0000 7fa9a0e00640 1 --2- 172.21.15.176:0/4109364342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c15e4d0 0x7fa99c1f6600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa984006010 tx=0x7fa9840038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.815+0000 7fa9a0e00640 1 -- 172.21.15.176:0/4109364342 shutdown_connections 2024-09-17T03:35:08.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.815+0000 7fa9a0e00640 1 --2- 172.21.15.176:0/4109364342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c1620c0 0x7fa99c1f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.815+0000 7fa9a0e00640 1 --2- 172.21.15.176:0/4109364342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c15e4d0 0x7fa99c1f6600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.815+0000 7fa9a0e00640 1 --2- 172.21.15.176:0/4109364342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c0d3420 0x7fa99c150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:08.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.815+0000 7fa9a0e00640 1 -- 172.21.15.176:0/4109364342 >> 172.21.15.176:0/4109364342 conn(0x7fa99c0d1980 msgr2=0x7fa99c0b8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:08.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.815+0000 7fa9a0e00640 1 -- 172.21.15.176:0/4109364342 shutdown_connections 2024-09-17T03:35:08.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:08.815+0000 7fa9a0e00640 1 -- 172.21.15.176:0/4109364342 wait complete. 2024-09-17T03:35:08.836 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 2e3aaa40-ae33-4c35-98a2-6e2d05510ccf 5 2024-09-17T03:35:09.052 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.051+0000 7f6e8de00640 1 -- 172.21.15.176:0/4181574850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e8806d2b0 msgr2=0x7f6e881621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.052 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.051+0000 7f6e8de00640 1 --2- 172.21.15.176:0/4181574850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e8806d2b0 0x7f6e881621d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c005fd0 tx=0x7f6e7c02a540 comp rx=0 tx=0).stop 2024-09-17T03:35:09.052 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.051+0000 7f6e8de00640 1 -- 172.21.15.176:0/4181574850 shutdown_connections 2024-09-17T03:35:09.052 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.051+0000 7f6e8de00640 1 --2- 172.21.15.176:0/4181574850 >> v2:172.21.15.121:3300/0 conn(0x7f6e88162710 0x7f6e880cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.052 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.051+0000 7f6e8de00640 1 --2- 172.21.15.176:0/4181574850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e8806d2b0 0x7f6e881621d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.052 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.051+0000 7f6e8de00640 1 -- 172.21.15.176:0/4181574850 >> 172.21.15.176:0/4181574850 conn(0x7f6e880d1960 msgr2=0x7f6e880d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:09.052 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.051+0000 7f6e8de00640 1 -- 172.21.15.176:0/4181574850 shutdown_connections 2024-09-17T03:35:09.052 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.051+0000 7f6e8de00640 1 -- 172.21.15.176:0/4181574850 wait complete. 2024-09-17T03:35:09.053 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.053+0000 7f6e8de00640 1 Processor -- start 2024-09-17T03:35:09.053 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.054+0000 7f6e8de00640 1 -- start start 2024-09-17T03:35:09.056 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8806d2b0 0x7f6e881592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:09.056 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e880cf840 0x7f6e880ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:09.056 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e88162710 0x7f6e881f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:09.057 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8de00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6e88155940 con 0x7f6e880cf840 2024-09-17T03:35:09.057 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8de00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e881557c0 con 0x7f6e8806d2b0 2024-09-17T03:35:09.057 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e88155ac0 con 0x7f6e88162710 2024-09-17T03:35:09.057 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8806d2b0 0x7f6e881592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:09.057 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e88162710 0x7f6e881f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e87e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e880cf840 0x7f6e880ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e88162710 0x7f6e881f9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:54928/0 (socket says 172.21.15.176:54928) 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e87e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e880cf840 0x7f6e880ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.176:54186/0 (socket says 172.21.15.176:54186) 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8d400640 1 -- 172.21.15.176:0/3805459484 learned_addr learned my addr 172.21.15.176:0/3805459484 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.055+0000 7f6e8ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8806d2b0 0x7f6e881592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:51746/0 (socket says 172.21.15.176:51746) 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e8ca00640 1 -- 172.21.15.176:0/3805459484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e88162710 msgr2=0x7f6e881f9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e8ca00640 1 --2- 172.21.15.176:0/3805459484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e88162710 0x7f6e881f9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e8ca00640 1 -- 172.21.15.176:0/3805459484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e880cf840 msgr2=0x7f6e880ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e8ca00640 1 --2- 172.21.15.176:0/3805459484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e880cf840 0x7f6e880ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e8ca00640 1 -- 172.21.15.176:0/3805459484 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8815e680 con 0x7f6e8806d2b0 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e8d400640 1 --2- 172.21.15.176:0/3805459484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e88162710 0x7f6e881f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:09.058 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e8ca00640 1 --2- 172.21.15.176:0/3805459484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8806d2b0 0x7f6e881592a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c031000 tx=0x7f6e7c0038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:09.059 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e84c00640 1 -- 172.21.15.176:0/3805459484 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c03e030 con 0x7f6e8806d2b0 2024-09-17T03:35:09.060 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e84c00640 1 -- 172.21.15.176:0/3805459484 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e7c003ca0 con 0x7f6e8806d2b0 2024-09-17T03:35:09.060 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e84c00640 1 -- 172.21.15.176:0/3805459484 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c035040 con 0x7f6e8806d2b0 2024-09-17T03:35:09.060 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.056+0000 7f6e8de00640 1 -- 172.21.15.176:0/3805459484 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8815dde0 con 0x7f6e8806d2b0 2024-09-17T03:35:09.060 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.057+0000 7f6e8de00640 1 -- 172.21.15.176:0/3805459484 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e8815e3a0 con 0x7f6e8806d2b0 2024-09-17T03:35:09.060 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.057+0000 7f6e84c00640 1 -- 172.21.15.176:0/3805459484 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6e7c041030 con 0x7f6e8806d2b0 2024-09-17T03:35:09.060 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.057+0000 7f6e84c00640 1 -- 172.21.15.176:0/3805459484 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f6e7c043d50 con 0x7f6e8806d2b0 2024-09-17T03:35:09.060 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.058+0000 7f6e8de00640 1 -- 172.21.15.176:0/3805459484 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e881621d0 con 0x7f6e8806d2b0 2024-09-17T03:35:09.061 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.060+0000 7f6e84c00640 1 -- 172.21.15.176:0/3805459484 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6e7c004d90 con 0x7f6e8806d2b0 2024-09-17T03:35:09.133 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.133+0000 7f6e8de00640 1 -- 172.21.15.176:0/3805459484 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e3aaa40-ae33-4c35-98a2-6e2d05510ccf", "id": 5} v 0) -- 0x7f6e880b9a30 con 0x7f6e8806d2b0 2024-09-17T03:35:09.137 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.137+0000 7f6e84c00640 1 -- 172.21.15.176:0/3805459484 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e3aaa40-ae33-4c35-98a2-6e2d05510ccf", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f6e7c004f70 con 0x7f6e8806d2b0 2024-09-17T03:35:09.138 INFO:teuthology.orchestra.run.smithi176.stdout:5 2024-09-17T03:35:09.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.138+0000 7f6e8de00640 1 -- 172.21.15.176:0/3805459484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8806d2b0 msgr2=0x7f6e881592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.138+0000 7f6e8de00640 1 --2- 172.21.15.176:0/3805459484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8806d2b0 0x7f6e881592a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c031000 tx=0x7f6e7c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.139+0000 7f6e8de00640 1 -- 172.21.15.176:0/3805459484 shutdown_connections 2024-09-17T03:35:09.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.139+0000 7f6e8de00640 1 --2- 172.21.15.176:0/3805459484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e88162710 0x7f6e881f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.139+0000 7f6e8de00640 1 --2- 172.21.15.176:0/3805459484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e880cf840 0x7f6e880ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.139+0000 7f6e8de00640 1 --2- 172.21.15.176:0/3805459484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e8806d2b0 0x7f6e881592a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.139+0000 7f6e8de00640 1 -- 172.21.15.176:0/3805459484 >> 172.21.15.176:0/3805459484 conn(0x7f6e880d1960 msgr2=0x7f6e881617f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:09.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.139+0000 7f6e8de00640 1 -- 172.21.15.176:0/3805459484 shutdown_connections 2024-09-17T03:35:09.139 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.139+0000 7f6e8de00640 1 -- 172.21.15.176:0/3805459484 wait complete. 2024-09-17T03:35:09.161 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 433bf660-0d98-4f4a-8c09-a3b499c5bb39 6 2024-09-17T03:35:09.393 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.392+0000 7fb7a7000640 1 -- 172.21.15.176:0/3702413644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7a015b7a0 msgr2=0x7fb7a00cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.393 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.392+0000 7fb7a7000640 1 --2- 172.21.15.176:0/3702413644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7a015b7a0 0x7fb7a00cc6c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb794005fd0 tx=0x7fb79402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.393 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.392+0000 7fb7a7000640 1 -- 172.21.15.176:0/3702413644 shutdown_connections 2024-09-17T03:35:09.393 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.392+0000 7fb7a7000640 1 --2- 172.21.15.176:0/3702413644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7a015eea0 0x7fb7a00cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.393 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.392+0000 7fb7a7000640 1 --2- 172.21.15.176:0/3702413644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7a015b7a0 0x7fb7a00cc6c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.393 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.392+0000 7fb7a7000640 1 -- 172.21.15.176:0/3702413644 >> 172.21.15.176:0/3702413644 conn(0x7fb7a006f920 msgr2=0x7fb7a00b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:09.393 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.392+0000 7fb7a7000640 1 -- 172.21.15.176:0/3702413644 shutdown_connections 2024-09-17T03:35:09.393 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.392+0000 7fb7a7000640 1 -- 172.21.15.176:0/3702413644 wait complete. 2024-09-17T03:35:09.394 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.394+0000 7fb7a7000640 1 Processor -- start 2024-09-17T03:35:09.394 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.394+0000 7fb7a7000640 1 -- start start 2024-09-17T03:35:09.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a7000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7a00ccc00 0x7fb7a014dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:09.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a7000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a015b7a0 0x7fb7a014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:09.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a7000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7a015eea0 0x7fb7a00cea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:09.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a7000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0070e70 con 0x7fb7a015b7a0 2024-09-17T03:35:09.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a7000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0070cf0 con 0x7fb7a00ccc00 2024-09-17T03:35:09.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a7000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a00ce300 con 0x7fb7a015eea0 2024-09-17T03:35:09.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a5c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7a00ccc00 0x7fb7a014dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:09.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a5c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7a00ccc00 0x7fb7a014dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:51848/0 (socket says 172.21.15.176:51848) 2024-09-17T03:35:09.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a5c00640 1 -- 172.21.15.176:0/2377459998 learned_addr learned my addr 172.21.15.176:0/2377459998 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T03:35:09.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a6600640 1 --2- 172.21.15.176:0/2377459998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7a015eea0 0x7fb7a00cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:09.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a5200640 1 --2- 172.21.15.176:0/2377459998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a015b7a0 0x7fb7a014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:09.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a6600640 1 -- 172.21.15.176:0/2377459998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7a00ccc00 msgr2=0x7fb7a014dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a6600640 1 --2- 172.21.15.176:0/2377459998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7a00ccc00 0x7fb7a014dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.399 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a6600640 1 -- 172.21.15.176:0/2377459998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a015b7a0 msgr2=0x7fb7a014e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.399 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.396+0000 7fb7a6600640 1 --2- 172.21.15.176:0/2377459998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a015b7a0 0x7fb7a014e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.399 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.397+0000 7fb7a6600640 1 -- 172.21.15.176:0/2377459998 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a014cc10 con 0x7fb7a015eea0 2024-09-17T03:35:09.399 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.397+0000 7fb7a5c00640 1 --2- 172.21.15.176:0/2377459998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7a00ccc00 0x7fb7a014dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:09.399 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.397+0000 7fb7a6600640 1 --2- 172.21.15.176:0/2377459998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7a015eea0 0x7fb7a00cea30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb798005fd0 tx=0x7fb79800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:09.399 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.397+0000 7fb79d600640 1 -- 172.21.15.176:0/2377459998 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798003970 con 0x7fb7a015eea0 2024-09-17T03:35:09.399 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.397+0000 7fb79d600640 1 -- 172.21.15.176:0/2377459998 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb798003b10 con 0x7fb7a015eea0 2024-09-17T03:35:09.399 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.397+0000 7fb79d600640 1 -- 172.21.15.176:0/2377459998 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798004020 con 0x7fb7a015eea0 2024-09-17T03:35:09.399 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.397+0000 7fb7a7000640 1 -- 172.21.15.176:0/2377459998 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a014cef0 con 0x7fb7a015eea0 2024-09-17T03:35:09.399 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.397+0000 7fb7a7000640 1 -- 172.21.15.176:0/2377459998 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a014d4b0 con 0x7fb7a015eea0 2024-09-17T03:35:09.400 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.398+0000 7fb7a7000640 1 -- 172.21.15.176:0/2377459998 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a00ce820 con 0x7fb7a015eea0 2024-09-17T03:35:09.400 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.398+0000 7fb79d600640 1 -- 172.21.15.176:0/2377459998 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7fb7980041c0 con 0x7fb7a015eea0 2024-09-17T03:35:09.400 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.399+0000 7fb79d600640 1 -- 172.21.15.176:0/2377459998 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fb798052f10 con 0x7fb7a015eea0 2024-09-17T03:35:09.400 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.400+0000 7fb79d600640 1 -- 172.21.15.176:0/2377459998 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb79800f3c0 con 0x7fb7a015eea0 2024-09-17T03:35:09.472 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.471+0000 7fb7a7000640 1 -- 172.21.15.176:0/2377459998 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "433bf660-0d98-4f4a-8c09-a3b499c5bb39", "id": 6} v 0) -- 0x7fb7a006e2d0 con 0x7fb7a015eea0 2024-09-17T03:35:09.481 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.481+0000 7fb79d600640 1 -- 172.21.15.176:0/2377459998 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "433bf660-0d98-4f4a-8c09-a3b499c5bb39", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fb798054070 con 0x7fb7a015eea0 2024-09-17T03:35:09.482 INFO:teuthology.orchestra.run.smithi176.stdout:6 2024-09-17T03:35:09.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.483+0000 7fb7a7000640 1 -- 172.21.15.176:0/2377459998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7a015eea0 msgr2=0x7fb7a00cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.483+0000 7fb7a7000640 1 --2- 172.21.15.176:0/2377459998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7a015eea0 0x7fb7a00cea30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb798005fd0 tx=0x7fb79800c2d0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.483+0000 7fb7a7000640 1 -- 172.21.15.176:0/2377459998 shutdown_connections 2024-09-17T03:35:09.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.483+0000 7fb7a7000640 1 --2- 172.21.15.176:0/2377459998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7a015eea0 0x7fb7a00cea30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.483+0000 7fb7a7000640 1 --2- 172.21.15.176:0/2377459998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a015b7a0 0x7fb7a014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.483+0000 7fb7a7000640 1 --2- 172.21.15.176:0/2377459998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7a00ccc00 0x7fb7a014dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.483+0000 7fb7a7000640 1 -- 172.21.15.176:0/2377459998 >> 172.21.15.176:0/2377459998 conn(0x7fb7a006f920 msgr2=0x7fb7a015e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:09.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.483+0000 7fb7a7000640 1 -- 172.21.15.176:0/2377459998 shutdown_connections 2024-09-17T03:35:09.484 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.483+0000 7fb7a7000640 1 -- 172.21.15.176:0/2377459998 wait complete. 2024-09-17T03:35:09.503 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new a74b57b4-309d-43a5-96fb-44bce8831eaa 7 2024-09-17T03:35:09.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.717+0000 7fe920600640 1 -- 172.21.15.176:0/2255286728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe918156a50 msgr2=0x7fe918074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.717+0000 7fe920600640 1 --2- 172.21.15.176:0/2255286728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe918156a50 0x7fe918074620 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe90c005fd0 tx=0x7fe90c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.717+0000 7fe920600640 1 -- 172.21.15.176:0/2255286728 shutdown_connections 2024-09-17T03:35:09.718 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.717+0000 7fe920600640 1 --2- 172.21.15.176:0/2255286728 >> v2:172.21.15.121:3300/0 conn(0x7fe918074b60 0x7fe91806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.719 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.717+0000 7fe920600640 1 --2- 172.21.15.176:0/2255286728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe918156a50 0x7fe918074620 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.719 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.717+0000 7fe920600640 1 -- 172.21.15.176:0/2255286728 >> 172.21.15.176:0/2255286728 conn(0x7fe9180b1b90 msgr2=0x7fe9180b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:09.719 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.717+0000 7fe920600640 1 -- 172.21.15.176:0/2255286728 shutdown_connections 2024-09-17T03:35:09.719 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.717+0000 7fe920600640 1 -- 172.21.15.176:0/2255286728 wait complete. 2024-09-17T03:35:09.720 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.719+0000 7fe920600640 1 Processor -- start 2024-09-17T03:35:09.720 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.720+0000 7fe920600640 1 -- start start 2024-09-17T03:35:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe920600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe91806e330 0x7fe9180cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe920600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe918074b60 0x7fe9180b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe920600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe918156a50 0x7fe91809edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe920600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9180ce500 con 0x7fe918156a50 2024-09-17T03:35:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe920600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9180ce380 con 0x7fe918074b60 2024-09-17T03:35:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe920600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe9180ce680 con 0x7fe91806e330 2024-09-17T03:35:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe91dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe91806e330 0x7fe9180cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe91d200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe918074b60 0x7fe9180b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe91dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe91806e330 0x7fe9180cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:55030/0 (socket says 172.21.15.176:55030) 2024-09-17T03:35:09.723 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe91dc00640 1 -- 172.21.15.176:0/1252747116 learned_addr learned my addr 172.21.15.176:0/1252747116 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.721+0000 7fe91e600640 1 --2- 172.21.15.176:0/1252747116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe918156a50 0x7fe91809edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.722+0000 7fe91dc00640 1 -- 172.21.15.176:0/1252747116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe918074b60 msgr2=0x7fe9180b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.722+0000 7fe91dc00640 1 --2- 172.21.15.176:0/1252747116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe918074b60 0x7fe9180b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.722+0000 7fe91dc00640 1 -- 172.21.15.176:0/1252747116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe918156a50 msgr2=0x7fe91809edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.722+0000 7fe91dc00640 1 --2- 172.21.15.176:0/1252747116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe918156a50 0x7fe91809edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.722+0000 7fe91dc00640 1 -- 172.21.15.176:0/1252747116 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9180c6220 con 0x7fe91806e330 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.722+0000 7fe91dc00640 1 --2- 172.21.15.176:0/1252747116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe91806e330 0x7fe9180cc1e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe90c034040 tx=0x7fe90c0038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.722+0000 7fe915600640 1 -- 172.21.15.176:0/1252747116 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c03e030 con 0x7fe91806e330 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.722+0000 7fe915600640 1 -- 172.21.15.176:0/1252747116 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe90c003ca0 con 0x7fe91806e330 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.722+0000 7fe915600640 1 -- 172.21.15.176:0/1252747116 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c035040 con 0x7fe91806e330 2024-09-17T03:35:09.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.722+0000 7fe920600640 1 -- 172.21.15.176:0/1252747116 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9180b36b0 con 0x7fe91806e330 2024-09-17T03:35:09.725 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.723+0000 7fe920600640 1 -- 172.21.15.176:0/1252747116 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9180b5d70 con 0x7fe91806e330 2024-09-17T03:35:09.725 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.724+0000 7fe920600640 1 -- 172.21.15.176:0/1252747116 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91806ddf0 con 0x7fe91806e330 2024-09-17T03:35:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.724+0000 7fe915600640 1 -- 172.21.15.176:0/1252747116 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7fe90c041030 con 0x7fe91806e330 2024-09-17T03:35:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.724+0000 7fe915600640 1 -- 172.21.15.176:0/1252747116 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fe90c072a10 con 0x7fe91806e330 2024-09-17T03:35:09.726 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.726+0000 7fe915600640 1 -- 172.21.15.176:0/1252747116 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe90c004d10 con 0x7fe91806e330 2024-09-17T03:35:09.798 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.798+0000 7fe920600640 1 -- 172.21.15.176:0/1252747116 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a74b57b4-309d-43a5-96fb-44bce8831eaa", "id": 7} v 0) -- 0x7fe9180b2ed0 con 0x7fe91806e330 2024-09-17T03:35:09.808 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.808+0000 7fe915600640 1 -- 172.21.15.176:0/1252747116 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a74b57b4-309d-43a5-96fb-44bce8831eaa", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fe90c0481c0 con 0x7fe91806e330 2024-09-17T03:35:09.808 INFO:teuthology.orchestra.run.smithi176.stdout:7 2024-09-17T03:35:09.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.809+0000 7fe920600640 1 -- 172.21.15.176:0/1252747116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe91806e330 msgr2=0x7fe9180cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:09.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.809+0000 7fe920600640 1 --2- 172.21.15.176:0/1252747116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe91806e330 0x7fe9180cc1e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe90c034040 tx=0x7fe90c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.809+0000 7fe920600640 1 -- 172.21.15.176:0/1252747116 shutdown_connections 2024-09-17T03:35:09.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.809+0000 7fe920600640 1 --2- 172.21.15.176:0/1252747116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe918156a50 0x7fe91809edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.809+0000 7fe920600640 1 --2- 172.21.15.176:0/1252747116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe918074b60 0x7fe9180b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.809+0000 7fe920600640 1 --2- 172.21.15.176:0/1252747116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe91806e330 0x7fe9180cc1e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:09.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.809+0000 7fe920600640 1 -- 172.21.15.176:0/1252747116 >> 172.21.15.176:0/1252747116 conn(0x7fe9180b1b90 msgr2=0x7fe9180b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:09.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.809+0000 7fe920600640 1 -- 172.21.15.176:0/1252747116 shutdown_connections 2024-09-17T03:35:09.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:35:09.809+0000 7fe920600640 1 -- 172.21.15.176:0/1252747116 wait complete. 2024-09-17T03:35:09.832 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T03:35:09.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T03:35:09.836 INFO:tasks.ceph.osd.0:Started 2024-09-17T03:35:09.836 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T03:35:09.836 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T03:35:09.840 INFO:tasks.ceph.osd.1:Started 2024-09-17T03:35:09.840 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T03:35:09.840 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T03:35:09.844 INFO:tasks.ceph.osd.2:Started 2024-09-17T03:35:09.844 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T03:35:09.844 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T03:35:09.849 INFO:tasks.ceph.osd.3:Started 2024-09-17T03:35:09.849 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T03:35:09.849 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T03:35:09.853 INFO:tasks.ceph.osd.4:Started 2024-09-17T03:35:09.853 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T03:35:09.853 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T03:35:09.857 INFO:tasks.ceph.osd.5:Started 2024-09-17T03:35:09.857 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T03:35:09.857 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T03:35:09.861 INFO:tasks.ceph.osd.6:Started 2024-09-17T03:35:09.861 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T03:35:09.861 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T03:35:09.865 INFO:tasks.ceph.osd.7:Started 2024-09-17T03:35:09.866 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:10.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.176+0000 7f87ef200640 1 -- 172.21.15.121:0/2170241838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f00b9e40 msgr2=0x7f87f01622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:10.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.176+0000 7f87ef200640 1 --2- 172.21.15.121:0/2170241838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f00b9e40 0x7f87f01622b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f87e0005fd0 tx=0x7f87e002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:35:10.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.176+0000 7f87ef200640 1 -- 172.21.15.121:0/2170241838 shutdown_connections 2024-09-17T03:35:10.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.176+0000 7f87ef200640 1 --2- 172.21.15.121:0/2170241838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f006d9c0 0x7f87f0154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:10.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.176+0000 7f87ef200640 1 --2- 172.21.15.121:0/2170241838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f00b9e40 0x7f87f01622b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:10.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.176+0000 7f87ef200640 1 -- 172.21.15.121:0/2170241838 >> 172.21.15.121:0/2170241838 conn(0x7f87f00d1930 msgr2=0x7f87f00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:10.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.176+0000 7f87ef200640 1 -- 172.21.15.121:0/2170241838 shutdown_connections 2024-09-17T03:35:10.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.176+0000 7f87ef200640 1 -- 172.21.15.121:0/2170241838 wait complete. 2024-09-17T03:35:10.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.178+0000 7f87ef200640 1 Processor -- start 2024-09-17T03:35:10.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.178+0000 7f87ef200640 1 -- start start 2024-09-17T03:35:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ef200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f006d9c0 0x7f87f0159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ef200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f00b9e40 0x7f87f01535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ef200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f01627f0 0x7f87f00cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ef200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87f0155770 con 0x7f87f006d9c0 2024-09-17T03:35:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ef200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01555f0 con 0x7f87f01627f0 2024-09-17T03:35:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ef200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f87f01558f0 con 0x7f87f00b9e40 2024-09-17T03:35:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f006d9c0 0x7f87f0159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f006d9c0 0x7f87f0159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54106/0 (socket says 172.21.15.121:54106) 2024-09-17T03:35:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ede00640 1 -- 172.21.15.121:0/753691750 learned_addr learned my addr 172.21.15.121:0/753691750 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ed400640 1 --2- 172.21.15.121:0/753691750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f00b9e40 0x7f87f01535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ee800640 1 --2- 172.21.15.121:0/753691750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f01627f0 0x7f87f00cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ede00640 1 -- 172.21.15.121:0/753691750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f00b9e40 msgr2=0x7f87f01535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ede00640 1 --2- 172.21.15.121:0/753691750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f00b9e40 0x7f87f01535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ede00640 1 -- 172.21.15.121:0/753691750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f01627f0 msgr2=0x7f87f00cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ede00640 1 --2- 172.21.15.121:0/753691750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f01627f0 0x7f87f00cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.180+0000 7f87ede00640 1 -- 172.21.15.121:0/753691750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f01f5ce0 con 0x7f87f006d9c0 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.181+0000 7f87ede00640 1 --2- 172.21.15.121:0/753691750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f006d9c0 0x7f87f0159ef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87e0034040 tx=0x7f87e00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.181+0000 7f87e6000640 1 -- 172.21.15.121:0/753691750 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e003e030 con 0x7f87f006d9c0 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.181+0000 7f87e6000640 1 -- 172.21.15.121:0/753691750 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87e0003d90 con 0x7f87f006d9c0 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.181+0000 7f87ef200640 1 -- 172.21.15.121:0/753691750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f01f5fc0 con 0x7f87f006d9c0 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.181+0000 7f87e6000640 1 -- 172.21.15.121:0/753691750 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0035040 con 0x7f87f006d9c0 2024-09-17T03:35:10.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.181+0000 7f87ef200640 1 -- 172.21.15.121:0/753691750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f01f7e20 con 0x7f87f006d9c0 2024-09-17T03:35:10.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.182+0000 7f87ef200640 1 -- 172.21.15.121:0/753691750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f00ce6c0 con 0x7f87f006d9c0 2024-09-17T03:35:10.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.182+0000 7f87e6000640 1 -- 172.21.15.121:0/753691750 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f87e0041030 con 0x7f87f006d9c0 2024-09-17T03:35:10.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.183+0000 7f87e6000640 1 -- 172.21.15.121:0/753691750 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f87e0072ae0 con 0x7f87f006d9c0 2024-09-17T03:35:10.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.185+0000 7f87e6000640 1 -- 172.21.15.121:0/753691750 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f87f00ce6c0 con 0x7f87f006d9c0 2024-09-17T03:35:10.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.247+0000 7f87ef200640 1 -- 172.21.15.121:0/753691750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87f01f8080 con 0x7f87f006d9c0 2024-09-17T03:35:10.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.247+0000 7f87e6000640 1 -- 172.21.15.121:0/753691750 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f87e0004eb0 con 0x7f87f006d9c0 2024-09-17T03:35:10.247 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:10.247 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":10,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:09.800632+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:10.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.248+0000 7f87ef200640 1 -- 172.21.15.121:0/753691750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f006d9c0 msgr2=0x7f87f0159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:10.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.248+0000 7f87ef200640 1 --2- 172.21.15.121:0/753691750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f006d9c0 0x7f87f0159ef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87e0034040 tx=0x7f87e00038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:10.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.248+0000 7f87ef200640 1 -- 172.21.15.121:0/753691750 shutdown_connections 2024-09-17T03:35:10.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.248+0000 7f87ef200640 1 --2- 172.21.15.121:0/753691750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f01627f0 0x7f87f00cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:10.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.248+0000 7f87ef200640 1 --2- 172.21.15.121:0/753691750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f00b9e40 0x7f87f01535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:10.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.248+0000 7f87ef200640 1 --2- 172.21.15.121:0/753691750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f006d9c0 0x7f87f0159ef0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:10.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.248+0000 7f87ef200640 1 -- 172.21.15.121:0/753691750 >> 172.21.15.121:0/753691750 conn(0x7f87f00d1930 msgr2=0x7f87f01617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:10.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.248+0000 7f87ef200640 1 -- 172.21.15.121:0/753691750 shutdown_connections 2024-09-17T03:35:10.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:10.248+0000 7f87ef200640 1 -- 172.21.15.121:0/753691750 wait complete. 2024-09-17T03:35:10.268 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T03:35:10.268 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T03:35:10.279 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T03:35:10.279+0000 7f95d9200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T03:35:10.281 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-17T03:35:10.281+0000 7f95d9200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T03:35:11.073 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:11.270 INFO:tasks.ceph.osd.2.smithi121.stderr:2024-09-17T03:35:11.270+0000 7f28e66d4640 -1 Falling back to public interface 2024-09-17T03:35:11.277 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.277+0000 7f8e9dc00640 1 -- 172.21.15.121:0/616312763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e98153410 msgr2=0x7f8e980afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:11.277 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.277+0000 7f8e9dc00640 1 --2- 172.21.15.121:0/616312763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e98153410 0x7f8e980afc30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e88005fd0 tx=0x7f8e8802a540 comp rx=0 tx=0).stop 2024-09-17T03:35:11.277 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.277+0000 7f8e9dc00640 1 -- 172.21.15.121:0/616312763 shutdown_connections 2024-09-17T03:35:11.277 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.277+0000 7f8e9dc00640 1 --2- 172.21.15.121:0/616312763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e9806d150 0x7f8e9806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:11.277 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.277+0000 7f8e9dc00640 1 --2- 172.21.15.121:0/616312763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e98153410 0x7f8e980afc30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:11.277 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.277+0000 7f8e9dc00640 1 -- 172.21.15.121:0/616312763 >> 172.21.15.121:0/616312763 conn(0x7f8e980d0a30 msgr2=0x7f8e980d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:11.277 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.277+0000 7f8e9dc00640 1 -- 172.21.15.121:0/616312763 shutdown_connections 2024-09-17T03:35:11.277 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.277+0000 7f8e9dc00640 1 -- 172.21.15.121:0/616312763 wait complete. 2024-09-17T03:35:11.279 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.279+0000 7f8e9dc00640 1 Processor -- start 2024-09-17T03:35:11.279 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.279+0000 7f8e9dc00640 1 -- start start 2024-09-17T03:35:11.281 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e9dc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e9806d150 0x7f8e980ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:11.281 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e9dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980cf700 0x7f8e9814d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e9dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e98153410 0x7f8e98070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e9dc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9806dc20 con 0x7f8e9806d150 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e9dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9806daa0 con 0x7f8e98153410 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e9dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8e9806dda0 con 0x7f8e980cf700 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e96a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e9806d150 0x7f8e980ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e96a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e9806d150 0x7f8e980ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54110/0 (socket says 172.21.15.121:54110) 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e96a00640 1 -- 172.21.15.121:0/126869585 learned_addr learned my addr 172.21.15.121:0/126869585 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e97400640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e98153410 0x7f8e98070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.281+0000 7f8e96000640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980cf700 0x7f8e9814d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e96a00640 1 -- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980cf700 msgr2=0x7f8e9814d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e96a00640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980cf700 0x7f8e9814d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e96a00640 1 -- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e98153410 msgr2=0x7f8e98070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:11.282 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e96a00640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e98153410 0x7f8e98070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:11.283 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e96a00640 1 -- 172.21.15.121:0/126869585 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9806fc90 con 0x7f8e9806d150 2024-09-17T03:35:11.283 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e96000640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980cf700 0x7f8e9814d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:11.283 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e96a00640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e9806d150 0x7f8e980ad850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8e88034040 tx=0x7f8e880038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:11.283 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e8ea00640 1 -- 172.21.15.121:0/126869585 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8803e030 con 0x7f8e9806d150 2024-09-17T03:35:11.284 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e8ea00640 1 -- 172.21.15.121:0/126869585 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e88003d90 con 0x7f8e9806d150 2024-09-17T03:35:11.284 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e9dc00640 1 -- 172.21.15.121:0/126869585 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9806ff70 con 0x7f8e9806d150 2024-09-17T03:35:11.284 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e8ea00640 1 -- 172.21.15.121:0/126869585 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88035040 con 0x7f8e9806d150 2024-09-17T03:35:11.284 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.282+0000 7f8e9dc00640 1 -- 172.21.15.121:0/126869585 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e98070530 con 0x7f8e9806d150 2024-09-17T03:35:11.284 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.284+0000 7f8e9dc00640 1 -- 172.21.15.121:0/126869585 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e9806e230 con 0x7f8e9806d150 2024-09-17T03:35:11.284 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.285+0000 7f8e8ea00640 1 -- 172.21.15.121:0/126869585 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 3) ==== 101279+0+0 (secure 0 0 0) 0x7f8e88041030 con 0x7f8e9806d150 2024-09-17T03:35:11.286 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.286+0000 7f8e8ea00640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8e780789e0 0x7f8e7807aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:11.286 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.286+0000 7f8e8ea00640 1 -- 172.21.15.121:0/126869585 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8e880ba370 con 0x7f8e9806d150 2024-09-17T03:35:11.286 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.286+0000 7f8e96000640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8e780789e0 0x7f8e7807aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:11.286 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.287+0000 7f8e96000640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8e780789e0 0x7f8e7807aef0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e980af6e0 tx=0x7f8e84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:11.291 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.292+0000 7f8e8ea00640 1 -- 172.21.15.121:0/126869585 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e88083480 con 0x7f8e9806d150 2024-09-17T03:35:11.469 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-17T03:35:11.468+0000 7fae72751640 -1 Falling back to public interface 2024-09-17T03:35:11.476 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.476+0000 7f8e9dc00640 1 -- 172.21.15.121:0/126869585 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e980b1d90 con 0x7f8e9806d150 2024-09-17T03:35:11.477 INFO:tasks.ceph.osd.3.smithi121.stderr:2024-09-17T03:35:11.477+0000 7f95bb330640 -1 Falling back to public interface 2024-09-17T03:35:11.477 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.477+0000 7f8e8ea00640 1 -- 172.21.15.121:0/126869585 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8e88087eb0 con 0x7f8e9806d150 2024-09-17T03:35:11.477 INFO:teuthology.misc.health.smithi121.stdout: 2024-09-17T03:35:11.477 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":10,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:09.800632+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:11.479 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.479+0000 7f8e9dc00640 1 -- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8e780789e0 msgr2=0x7f8e7807aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.479+0000 7f8e9dc00640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8e780789e0 0x7f8e7807aef0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8e980af6e0 tx=0x7f8e84009040 comp rx=0 tx=0).stop 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.479+0000 7f8e9dc00640 1 -- 172.21.15.121:0/126869585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e9806d150 msgr2=0x7f8e980ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.479+0000 7f8e9dc00640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e9806d150 0x7f8e980ad850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8e88034040 tx=0x7f8e880038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.480+0000 7f8e9dc00640 1 -- 172.21.15.121:0/126869585 shutdown_connections 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.480+0000 7f8e9dc00640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e98153410 0x7f8e98070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.480+0000 7f8e9dc00640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e980cf700 0x7f8e9814d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.480+0000 7f8e9dc00640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8e780789e0 0x7f8e7807aef0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.480+0000 7f8e9dc00640 1 --2- 172.21.15.121:0/126869585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e9806d150 0x7f8e980ad850 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.480+0000 7f8e9dc00640 1 -- 172.21.15.121:0/126869585 >> 172.21.15.121:0/126869585 conn(0x7f8e980d0a30 msgr2=0x7f8e9815b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.480+0000 7f8e9dc00640 1 -- 172.21.15.121:0/126869585 shutdown_connections 2024-09-17T03:35:11.480 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:11.480+0000 7f8e9dc00640 1 -- 172.21.15.121:0/126869585 wait complete. 2024-09-17T03:35:11.500 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T03:35:11.507 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-17T03:35:11.507+0000 7f68cf702640 -1 Falling back to public interface 2024-09-17T03:35:11.507 INFO:tasks.ceph.osd.0.smithi121.stderr:2024-09-17T03:35:11.508+0000 7f0ab9b58640 -1 Falling back to public interface 2024-09-17T03:35:11.515 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-17T03:35:11.516+0000 7f07f89a4640 -1 Falling back to public interface 2024-09-17T03:35:11.703 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-17T03:35:11.703+0000 7f73afe0b640 -1 Falling back to public interface 2024-09-17T03:35:11.720 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-17T03:35:11.720+0000 7f2c9e7cc640 -1 Falling back to public interface 2024-09-17T03:35:15.440 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-17T03:35:15.440+0000 7f73afe0b640 -1 osd.4 0 log_to_monitors true 2024-09-17T03:35:15.494 INFO:tasks.ceph.osd.2.smithi121.stderr:2024-09-17T03:35:15.495+0000 7f28e66d4640 -1 osd.2 0 log_to_monitors true 2024-09-17T03:35:15.519 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-17T03:35:15.519+0000 7f68cf702640 -1 osd.6 0 log_to_monitors true 2024-09-17T03:35:15.619 INFO:tasks.ceph.osd.3.smithi121.stderr:2024-09-17T03:35:15.620+0000 7f95bb330640 -1 osd.3 0 log_to_monitors true 2024-09-17T03:35:15.730 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-17T03:35:15.730+0000 7fae72751640 -1 osd.7 0 log_to_monitors true 2024-09-17T03:35:15.735 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-17T03:35:15.735+0000 7f2c9e7cc640 -1 osd.5 0 log_to_monitors true 2024-09-17T03:35:15.974 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-17T03:35:15.975+0000 7f07f89a4640 -1 osd.1 0 log_to_monitors true 2024-09-17T03:35:16.206 INFO:tasks.ceph.osd.0.smithi121.stderr:2024-09-17T03:35:16.207+0000 7f0ab9b58640 -1 osd.0 0 log_to_monitors true 2024-09-17T03:35:17.480 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-17T03:35:17.480+0000 7f73aa800640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T03:35:17.488 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-17T03:35:17.488+0000 7f73a0800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:35:18.307 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:18.557 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.557+0000 7f9ea5600640 1 -- 172.21.15.121:0/3567887201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ea006d2b0 msgr2=0x7f9ea01621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.557 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.557+0000 7f9ea5600640 1 --2- 172.21.15.121:0/3567887201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ea006d2b0 0x7f9ea01621d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9e90005fd0 tx=0x7f9e9002a540 comp rx=0 tx=0).stop 2024-09-17T03:35:18.557 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.557+0000 7f9ea5600640 1 -- 172.21.15.121:0/3567887201 shutdown_connections 2024-09-17T03:35:18.557 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.557+0000 7f9ea5600640 1 --2- 172.21.15.121:0/3567887201 >> v2:172.21.15.176:3300/0 conn(0x7f9ea0162710 0x7f9ea00cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.557 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.557+0000 7f9ea5600640 1 --2- 172.21.15.121:0/3567887201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ea006d2b0 0x7f9ea01621d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.557 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.557+0000 7f9ea5600640 1 -- 172.21.15.121:0/3567887201 >> 172.21.15.121:0/3567887201 conn(0x7f9ea00d1960 msgr2=0x7f9ea00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:18.558 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.557+0000 7f9ea5600640 1 -- 172.21.15.121:0/3567887201 shutdown_connections 2024-09-17T03:35:18.558 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.557+0000 7f9ea5600640 1 -- 172.21.15.121:0/3567887201 wait complete. 2024-09-17T03:35:18.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.559+0000 7f9ea5600640 1 Processor -- start 2024-09-17T03:35:18.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.559+0000 7f9ea5600640 1 -- start start 2024-09-17T03:35:18.561 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9ea5600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ea006d2b0 0x7f9ea0161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.561 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9ea5600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea00cf840 0x7f9ea0158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.561 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9ea5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ea0162710 0x7f9ea01f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.561 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9ea5600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea0155940 con 0x7f9ea00cf840 2024-09-17T03:35:18.561 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9ea5600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea01557c0 con 0x7f9ea0162710 2024-09-17T03:35:18.561 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9ea5600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea0155ac0 con 0x7f9ea006d2b0 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9e9f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea00cf840 0x7f9ea0158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9e9fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ea006d2b0 0x7f9ea0161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9e9f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea00cf840 0x7f9ea0158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44304/0 (socket says 172.21.15.121:44304) 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9e9f400640 1 -- 172.21.15.121:0/1622384677 learned_addr learned my addr 172.21.15.121:0/1622384677 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9ea4c00640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ea0162710 0x7f9ea01f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9e9f400640 1 -- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ea006d2b0 msgr2=0x7f9ea0161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9e9f400640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ea006d2b0 0x7f9ea0161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9e9f400640 1 -- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ea0162710 msgr2=0x7f9ea01f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9e9f400640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ea0162710 0x7f9ea01f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9e9f400640 1 -- 172.21.15.121:0/1622384677 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea01f8940 con 0x7f9ea00cf840 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.561+0000 7f9ea4c00640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ea0162710 0x7f9ea01f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:18.562 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.562+0000 7f9e9f400640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea00cf840 0x7f9ea0158730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00e7c0 tx=0x7f9e8c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:18.581 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.581+0000 7f9e97e00640 1 -- 172.21.15.121:0/1622384677 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00ccc0 con 0x7f9ea00cf840 2024-09-17T03:35:18.581 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.581+0000 7f9ea5600640 1 -- 172.21.15.121:0/1622384677 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea015bd90 con 0x7f9ea00cf840 2024-09-17T03:35:18.581 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.581+0000 7f9ea5600640 1 -- 172.21.15.121:0/1622384677 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea015bab0 con 0x7f9ea00cf840 2024-09-17T03:35:18.581 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.581+0000 7f9e97e00640 1 -- 172.21.15.121:0/1622384677 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e8c010430 con 0x7f9ea00cf840 2024-09-17T03:35:18.581 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.581+0000 7f9e97e00640 1 -- 172.21.15.121:0/1622384677 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c010860 con 0x7f9ea00cf840 2024-09-17T03:35:18.582 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.583+0000 7f9ea5600640 1 -- 172.21.15.121:0/1622384677 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e78005290 con 0x7f9ea00cf840 2024-09-17T03:35:18.584 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.585+0000 7f9e97e00640 1 -- 172.21.15.121:0/1622384677 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f9e8c010a00 con 0x7f9ea00cf840 2024-09-17T03:35:18.586 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.586+0000 7f9e97e00640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9e80078b30 0x7f9e8007b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.586 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.587+0000 7f9e97e00640 1 -- 172.21.15.121:0/1622384677 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f9e8c09a840 con 0x7f9ea00cf840 2024-09-17T03:35:18.586 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.587+0000 7f9e9fe00640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9e80078b30 0x7f9e8007b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.587 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.588+0000 7f9e9fe00640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9e80078b30 0x7f9e8007b040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9e90033000 tx=0x7f9e90004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:18.593 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.594+0000 7f9e97e00640 1 -- 172.21.15.121:0/1622384677 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e8c063270 con 0x7f9ea00cf840 2024-09-17T03:35:18.864 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.864+0000 7f9ea5600640 1 -- 172.21.15.121:0/1622384677 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e78005580 con 0x7f9ea00cf840 2024-09-17T03:35:18.864 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.865+0000 7f9e97e00640 1 -- 172.21.15.121:0/1622384677 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7590 (secure 0 0 0) 0x7f9e8c067ca0 con 0x7f9ea00cf840 2024-09-17T03:35:18.865 INFO:teuthology.misc.health.smithi121.stdout: 2024-09-17T03:35:18.865 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":14,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:18.762647+0000","last_up_change":"2024-09-17T03:35:17.504535+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:18.867 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.867+0000 7f9ea5600640 1 -- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9e80078b30 msgr2=0x7f9e8007b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.867 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.867+0000 7f9ea5600640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9e80078b30 0x7f9e8007b040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9e90033000 tx=0x7f9e90004730 comp rx=0 tx=0).stop 2024-09-17T03:35:18.867 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.867+0000 7f9ea5600640 1 -- 172.21.15.121:0/1622384677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea00cf840 msgr2=0x7f9ea0158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.867 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.867+0000 7f9ea5600640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea00cf840 0x7f9ea0158730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00e7c0 tx=0x7f9e8c00ec80 comp rx=0 tx=0).stop 2024-09-17T03:35:18.868 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.867+0000 7f9ea5600640 1 -- 172.21.15.121:0/1622384677 shutdown_connections 2024-09-17T03:35:18.868 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.867+0000 7f9ea5600640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ea0162710 0x7f9ea01f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.868 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.867+0000 7f9ea5600640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9e80078b30 0x7f9e8007b040 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.868 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.867+0000 7f9ea5600640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ea00cf840 0x7f9ea0158730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.868 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.867+0000 7f9ea5600640 1 --2- 172.21.15.121:0/1622384677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ea006d2b0 0x7f9ea0161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.868 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.867+0000 7f9ea5600640 1 -- 172.21.15.121:0/1622384677 >> 172.21.15.121:0/1622384677 conn(0x7f9ea00d1960 msgr2=0x7f9ea00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:18.868 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.868+0000 7f9ea5600640 1 -- 172.21.15.121:0/1622384677 shutdown_connections 2024-09-17T03:35:18.868 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:18.868+0000 7f9ea5600640 1 -- 172.21.15.121:0/1622384677 wait complete. 2024-09-17T03:35:18.888 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-17T03:35:19.364 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-17T03:35:19.362+0000 7f68cb000640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T03:35:19.366 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-17T03:35:19.365+0000 7f2c9a000640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T03:35:19.373 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-17T03:35:19.373+0000 7f68c0600640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:35:19.382 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-17T03:35:19.382+0000 7f2c8f600640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:35:19.402 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-17T03:35:19.402+0000 7fae6e000640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T03:35:19.420 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-17T03:35:19.420+0000 7fae63600640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:35:19.785 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-17T03:35:19.783+0000 7f07f3800640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T03:35:19.796 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-17T03:35:19.796+0000 7f07e9800640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:35:19.881 INFO:tasks.ceph.osd.2.smithi121.stderr:2024-09-17T03:35:19.881+0000 7f28e1600640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T03:35:19.886 INFO:tasks.ceph.osd.2.smithi121.stderr:2024-09-17T03:35:19.887+0000 7f28d7600640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:35:19.895 INFO:tasks.ceph.osd.0.smithi121.stderr:2024-09-17T03:35:19.895+0000 7f0ab5400640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T03:35:19.907 INFO:tasks.ceph.osd.0.smithi121.stderr:2024-09-17T03:35:19.908+0000 7f0aaaa00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:35:19.959 INFO:tasks.ceph.osd.3.smithi121.stderr:2024-09-17T03:35:19.959+0000 7f95b6200640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T03:35:19.964 INFO:tasks.ceph.osd.3.smithi121.stderr:2024-09-17T03:35:19.965+0000 7f95ac200640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:35:20.716 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:35:20.721 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:35:25.694 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:25.908 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.908+0000 7f92c5c00640 1 -- 172.21.15.121:0/51121594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92a4003a00 msgr2=0x7f92a4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.908 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.908+0000 7f92c5c00640 1 --2- 172.21.15.121:0/51121594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92a4003a00 0x7f92a4003e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009cf0 tx=0x7f92a4005830 comp rx=0 tx=0).stop 2024-09-17T03:35:25.908 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.908+0000 7f92bf400640 1 -- 172.21.15.121:0/51121594 reap_dead start 2024-09-17T03:35:25.908 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.908+0000 7f92c5c00640 1 -- 172.21.15.121:0/51121594 shutdown_connections 2024-09-17T03:35:25.908 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.908+0000 7f92c5c00640 1 -- 172.21.15.121:0/51121594 >> 172.21.15.121:0/51121594 conn(0x7f92c00cca40 msgr2=0x7f92c00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:25.909 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.908+0000 7f92c5c00640 1 -- 172.21.15.121:0/51121594 shutdown_connections 2024-09-17T03:35:25.909 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.908+0000 7f92c5c00640 1 -- 172.21.15.121:0/51121594 wait complete. 2024-09-17T03:35:25.910 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.910+0000 7f92c5c00640 1 Processor -- start 2024-09-17T03:35:25.910 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.910+0000 7f92c5c00640 1 -- start start 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92c5c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a4003a00 0x7f92c01f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92c5c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c015f880 0x7f92c00b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92c5c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92c00b5a30 0x7f92c00c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92c5c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f92c006ede0 con 0x7f92c00b5a30 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92c5c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0074200 con 0x7f92a4003a00 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92c5c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92c006ef60 con 0x7f92c015f880 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92c00b5a30 0x7f92c00c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92c00b5a30 0x7f92c00c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56734/0 (socket says 172.21.15.121:56734) 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92bf400640 1 -- 172.21.15.121:0/1610372982 learned_addr learned my addr 172.21.15.121:0/1610372982 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92bea00640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a4003a00 0x7f92c01f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.913 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92b6000640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c015f880 0x7f92c00b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92bf400640 1 -- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c015f880 msgr2=0x7f92c00b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92bf400640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c015f880 0x7f92c00b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92bf400640 1 -- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a4003a00 msgr2=0x7f92c01f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92bf400640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a4003a00 0x7f92c01f8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92bf400640 1 -- 172.21.15.121:0/1610372982 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c00b5e40 con 0x7f92c00b5a30 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92bea00640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a4003a00 0x7f92c01f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.912+0000 7f92b6000640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c015f880 0x7f92c00b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.913+0000 7f92bf400640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92c00b5a30 0x7f92c00c7f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f92c0072b90 tx=0x7f92b800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.913+0000 7f92b7400640 1 -- 172.21.15.121:0/1610372982 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b800cba0 con 0x7f92c00b5a30 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.913+0000 7f92b7400640 1 -- 172.21.15.121:0/1610372982 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92b8017070 con 0x7f92c00b5a30 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.913+0000 7f92b7400640 1 -- 172.21.15.121:0/1610372982 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b80116c0 con 0x7f92c00b5a30 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.913+0000 7f92c5c00640 1 -- 172.21.15.121:0/1610372982 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c00c9930 con 0x7f92c00b5a30 2024-09-17T03:35:25.914 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.913+0000 7f92c5c00640 1 -- 172.21.15.121:0/1610372982 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c00a0df0 con 0x7f92c00b5a30 2024-09-17T03:35:25.915 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.914+0000 7f92c5c00640 1 -- 172.21.15.121:0/1610372982 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c00cc020 con 0x7f92c00b5a30 2024-09-17T03:35:25.915 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.915+0000 7f92b7400640 1 -- 172.21.15.121:0/1610372982 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92b8011860 con 0x7f92c00b5a30 2024-09-17T03:35:25.917 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.917+0000 7f92b7400640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f929c078b90 0x7f929c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.917 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.917+0000 7f92b7400640 1 -- 172.21.15.121:0/1610372982 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f92b809aff0 con 0x7f92c00b5a30 2024-09-17T03:35:25.917 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.917+0000 7f92bea00640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f929c078b90 0x7f929c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.917 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.918+0000 7f92bea00640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f929c078b90 0x7f929c07b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f92b0034000 tx=0x7f92b00046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:25.922 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:25.922+0000 7f92b7400640 1 -- 172.21.15.121:0/1610372982 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f92c00b5e40 con 0x7f92c00b5a30 2024-09-17T03:35:26.107 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.107+0000 7f92c5c00640 1 -- 172.21.15.121:0/1610372982 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92c0158b90 con 0x7f92c00b5a30 2024-09-17T03:35:26.108 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.108+0000 7f92b7400640 1 -- 172.21.15.121:0/1610372982 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12956 (secure 0 0 0) 0x7f92b807d2b0 con 0x7f92c00b5a30 2024-09-17T03:35:26.108 INFO:teuthology.misc.health.smithi121.stdout: 2024-09-17T03:35:26.108 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":18,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:23.383419+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:26.111 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 -- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f929c078b90 msgr2=0x7f929c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.111 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f929c078b90 0x7f929c07b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f92b0034000 tx=0x7f92b00046c0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.111 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 -- 172.21.15.121:0/1610372982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92c00b5a30 msgr2=0x7f92c00c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.111 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92c00b5a30 0x7f92c00c7f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f92c0072b90 tx=0x7f92b800ed30 comp rx=0 tx=0).stop 2024-09-17T03:35:26.111 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 -- 172.21.15.121:0/1610372982 shutdown_connections 2024-09-17T03:35:26.111 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f929c078b90 0x7f929c07b0a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.111 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92c00b5a30 0x7f92c00c7f00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.111 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c015f880 0x7f92c00b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.111 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 --2- 172.21.15.121:0/1610372982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92a4003a00 0x7f92c01f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.111 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 -- 172.21.15.121:0/1610372982 >> 172.21.15.121:0/1610372982 conn(0x7f92c00cca40 msgr2=0x7f92c015ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:26.112 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 -- 172.21.15.121:0/1610372982 shutdown_connections 2024-09-17T03:35:26.112 INFO:teuthology.misc.health.smithi121.stderr:2024-09-17T03:35:26.111+0000 7f92c5c00640 1 -- 172.21.15.121:0/1610372982 wait complete. 2024-09-17T03:35:26.132 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T03:35:26.132 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T03:35:26.132 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:35:26.133 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:35:26.137 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:35:26.137 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:35:26.137 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:35:26.141 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:35:26.141 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:35:26.141 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:35:26.146 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:35:26.146 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:35:26.146 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:35:26.150 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:35:26.150 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T03:35:26.150 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:26.330 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:35:26.332 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:35:26.350 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:35:26.352 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T03:35:26.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.383+0000 7f4c57a00640 1 -- 172.21.15.121:0/1999198966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c5006e500 msgr2=0x7f4c500cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.383+0000 7f4c57a00640 1 --2- 172.21.15.121:0/1999198966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c5006e500 0x7f4c500cc020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c50076360 tx=0x7f4c4802aac0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.383+0000 7f4c57a00640 1 -- 172.21.15.121:0/1999198966 shutdown_connections 2024-09-17T03:35:26.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.383+0000 7f4c57a00640 1 --2- 172.21.15.121:0/1999198966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c5006e500 0x7f4c500cc020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.383+0000 7f4c57a00640 1 --2- 172.21.15.121:0/1999198966 >> v2:172.21.15.176:3300/0 conn(0x7f4c50074cb0 0x7f4c50073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.383+0000 7f4c57a00640 1 -- 172.21.15.121:0/1999198966 >> 172.21.15.121:0/1999198966 conn(0x7f4c500cca40 msgr2=0x7f4c500cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:26.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.383+0000 7f4c57a00640 1 -- 172.21.15.121:0/1999198966 shutdown_connections 2024-09-17T03:35:26.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.383+0000 7f4c57a00640 1 -- 172.21.15.121:0/1999198966 wait complete. 2024-09-17T03:35:26.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.385+0000 7f4c57a00640 1 Processor -- start 2024-09-17T03:35:26.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.385+0000 7f4c57a00640 1 -- start start 2024-09-17T03:35:26.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c57a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50074cb0 0x7f4c5009e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c57a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c500cbc10 0x7f4c501f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c57a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c500a0f40 0x7f4c501f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c57a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5006f3c0 con 0x7f4c50074cb0 2024-09-17T03:35:26.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c57a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5006f240 con 0x7f4c500a0f40 2024-09-17T03:35:26.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c57a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5006f540 con 0x7f4c500cbc10 2024-09-17T03:35:26.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c55000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50074cb0 0x7f4c5009e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c55000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50074cb0 0x7f4c5009e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56762/0 (socket says 172.21.15.121:56762) 2024-09-17T03:35:26.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c55000640 1 -- 172.21.15.121:0/553906409 learned_addr learned my addr 172.21.15.121:0/553906409 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:26.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c4fe00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c500cbc10 0x7f4c501f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.387+0000 7f4c55a00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c500a0f40 0x7f4c501f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c55000640 1 -- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c500cbc10 msgr2=0x7f4c501f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c55000640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c500cbc10 0x7f4c501f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c55000640 1 -- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c500a0f40 msgr2=0x7f4c501f86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c55000640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c500a0f40 0x7f4c501f86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c55000640 1 -- 172.21.15.121:0/553906409 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5009fea0 con 0x7f4c50074cb0 2024-09-17T03:35:26.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c55000640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50074cb0 0x7f4c5009e170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c40009fd0 tx=0x7f4c4000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:26.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c4cc00640 1 -- 172.21.15.121:0/553906409 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000ccc0 con 0x7f4c50074cb0 2024-09-17T03:35:26.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c4cc00640 1 -- 172.21.15.121:0/553906409 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c4000ee70 con 0x7f4c50074cb0 2024-09-17T03:35:26.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c4cc00640 1 -- 172.21.15.121:0/553906409 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000ce60 con 0x7f4c50074cb0 2024-09-17T03:35:26.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c57a00640 1 -- 172.21.15.121:0/553906409 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c500a0180 con 0x7f4c50074cb0 2024-09-17T03:35:26.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.388+0000 7f4c57a00640 1 -- 172.21.15.121:0/553906409 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c500a0740 con 0x7f4c50074cb0 2024-09-17T03:35:26.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.389+0000 7f4c57a00640 1 -- 172.21.15.121:0/553906409 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c5006f9f0 con 0x7f4c50074cb0 2024-09-17T03:35:26.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.391+0000 7f4c4cc00640 1 -- 172.21.15.121:0/553906409 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c40004280 con 0x7f4c50074cb0 2024-09-17T03:35:26.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.392+0000 7f4c4cc00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c30078bc0 0x7f4c3007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.392+0000 7f4c4cc00640 1 -- 172.21.15.121:0/553906409 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f4c4009b430 con 0x7f4c50074cb0 2024-09-17T03:35:26.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.393+0000 7f4c4fe00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c30078bc0 0x7f4c3007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.393+0000 7f4c4fe00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c30078bc0 0x7f4c3007b0d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c5006e860 tx=0x7f4c3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:26.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.397+0000 7f4c4cc00640 1 -- 172.21.15.121:0/553906409 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c40063b20 con 0x7f4c50074cb0 2024-09-17T03:35:26.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.613+0000 7f4c57a00640 1 -- 172.21.15.121:0/553906409 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c5015df40 con 0x7f4c50074cb0 2024-09-17T03:35:26.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.613+0000 7f4c4cc00640 1 -- 172.21.15.121:0/553906409 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f4c40063420 con 0x7f4c50074cb0 2024-09-17T03:35:26.613 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:26.613 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":2,"btime":"2024-09-17T03:35:26:340288+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T03:35:26.613 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 2 2024-09-17T03:35:26.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.615+0000 7f4c57a00640 1 -- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c30078bc0 msgr2=0x7f4c3007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.615+0000 7f4c57a00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c30078bc0 0x7f4c3007b0d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c5006e860 tx=0x7f4c3c009040 comp rx=0 tx=0).stop 2024-09-17T03:35:26.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.615+0000 7f4c57a00640 1 -- 172.21.15.121:0/553906409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50074cb0 msgr2=0x7f4c5009e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.615+0000 7f4c57a00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50074cb0 0x7f4c5009e170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c40009fd0 tx=0x7f4c4000ec20 comp rx=0 tx=0).stop 2024-09-17T03:35:26.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.615+0000 7f4c57a00640 1 -- 172.21.15.121:0/553906409 shutdown_connections 2024-09-17T03:35:26.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.616+0000 7f4c57a00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c500a0f40 0x7f4c501f86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.616+0000 7f4c57a00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c500cbc10 0x7f4c501f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.616+0000 7f4c57a00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c30078bc0 0x7f4c3007b0d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.616+0000 7f4c57a00640 1 --2- 172.21.15.121:0/553906409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50074cb0 0x7f4c5009e170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.616+0000 7f4c57a00640 1 -- 172.21.15.121:0/553906409 >> 172.21.15.121:0/553906409 conn(0x7f4c500cca40 msgr2=0x7f4c50159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:26.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.616+0000 7f4c57a00640 1 -- 172.21.15.121:0/553906409 shutdown_connections 2024-09-17T03:35:26.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:26.616+0000 7f4c57a00640 1 -- 172.21.15.121:0/553906409 wait complete. 2024-09-17T03:35:28.637 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:28.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.868+0000 7fa372600640 1 -- 172.21.15.121:0/663688213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa36c15f5a0 msgr2=0x7fa36c15f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:28.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.868+0000 7fa372600640 1 --2- 172.21.15.121:0/663688213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa36c15f5a0 0x7fa36c15f9b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa364005fd0 tx=0x7fa36402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.868+0000 7fa372600640 1 -- 172.21.15.121:0/663688213 shutdown_connections 2024-09-17T03:35:28.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.868+0000 7fa372600640 1 --2- 172.21.15.121:0/663688213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa36c15f5a0 0x7fa36c15f9b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.868+0000 7fa372600640 1 --2- 172.21.15.121:0/663688213 >> v2:172.21.15.176:3300/0 conn(0x7fa36c15b9f0 0x7fa36c0cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.868+0000 7fa372600640 1 -- 172.21.15.121:0/663688213 >> 172.21.15.121:0/663688213 conn(0x7fa36c0cca40 msgr2=0x7fa36c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:28.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.869+0000 7fa372600640 1 -- 172.21.15.121:0/663688213 shutdown_connections 2024-09-17T03:35:28.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.869+0000 7fa372600640 1 -- 172.21.15.121:0/663688213 wait complete. 2024-09-17T03:35:28.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.871+0000 7fa372600640 1 Processor -- start 2024-09-17T03:35:28.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.871+0000 7fa372600640 1 -- start start 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.872+0000 7fa372600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa36c0cefa0 0x7fa36c1f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.872+0000 7fa372600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa36c15b9f0 0x7fa36c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.872+0000 7fa372600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa36c15f5a0 0x7fa36c0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.872+0000 7fa372600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c06df70 con 0x7fa36c15f5a0 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.872+0000 7fa372600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c06ddf0 con 0x7fa36c15b9f0 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.872+0000 7fa372600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa36c06e0f0 con 0x7fa36c0cefa0 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa36c15f5a0 0x7fa36c0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa36c15f5a0 0x7fa36c0b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56770/0 (socket says 172.21.15.121:56770) 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36be00640 1 -- 172.21.15.121:0/2669073564 learned_addr learned my addr 172.21.15.121:0/2669073564 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36b400640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa36c0cefa0 0x7fa36c1f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36aa00640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa36c15b9f0 0x7fa36c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36be00640 1 -- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa36c0cefa0 msgr2=0x7fa36c1f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:28.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36be00640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa36c0cefa0 0x7fa36c1f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36be00640 1 -- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa36c15b9f0 msgr2=0x7fa36c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:28.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36be00640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa36c15b9f0 0x7fa36c0b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36be00640 1 -- 172.21.15.121:0/2669073564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c0a0b40 con 0x7fa36c15f5a0 2024-09-17T03:35:28.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.873+0000 7fa36be00640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa36c15f5a0 0x7fa36c0b3960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa36402aea0 tx=0x7fa364033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:28.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.874+0000 7fa363400640 1 -- 172.21.15.121:0/2669073564 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364031990 con 0x7fa36c15f5a0 2024-09-17T03:35:28.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.874+0000 7fa363400640 1 -- 172.21.15.121:0/2669073564 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa364031c20 con 0x7fa36c15f5a0 2024-09-17T03:35:28.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.874+0000 7fa372600640 1 -- 172.21.15.121:0/2669073564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36c0c5780 con 0x7fa36c15f5a0 2024-09-17T03:35:28.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.874+0000 7fa363400640 1 -- 172.21.15.121:0/2669073564 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3640330d0 con 0x7fa36c15f5a0 2024-09-17T03:35:28.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.874+0000 7fa372600640 1 -- 172.21.15.121:0/2669073564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa36c0c5d40 con 0x7fa36c15f5a0 2024-09-17T03:35:28.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.875+0000 7fa372600640 1 -- 172.21.15.121:0/2669073564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa36c06e610 con 0x7fa36c15f5a0 2024-09-17T03:35:28.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.876+0000 7fa363400640 1 -- 172.21.15.121:0/2669073564 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa364033270 con 0x7fa36c15f5a0 2024-09-17T03:35:28.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.877+0000 7fa363400640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa34c078bc0 0x7fa34c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:28.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.877+0000 7fa363400640 1 -- 172.21.15.121:0/2669073564 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fa3640bbd00 con 0x7fa36c15f5a0 2024-09-17T03:35:28.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.878+0000 7fa36b400640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa34c078bc0 0x7fa34c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:28.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.878+0000 7fa36b400640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa34c078bc0 0x7fa34c07b0d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009530 tx=0x7fa35c009260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:28.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:28.882+0000 7fa363400640 1 -- 172.21.15.121:0/2669073564 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa36403f030 con 0x7fa36c15f5a0 2024-09-17T03:35:29.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.101+0000 7fa372600640 1 -- 172.21.15.121:0/2669073564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa36c0a0d10 con 0x7fa36c15f5a0 2024-09-17T03:35:29.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.102+0000 7fa363400640 1 -- 172.21.15.121:0/2669073564 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7fa3640317b0 con 0x7fa36c15f5a0 2024-09-17T03:35:29.102 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:29.102 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":3,"btime":"2024-09-17T03:35:27:343462+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4408,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T03:35:29.102 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 3 2024-09-17T03:35:29.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.104+0000 7fa372600640 1 -- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa34c078bc0 msgr2=0x7fa34c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa34c078bc0 0x7fa34c07b0d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009530 tx=0x7fa35c009260 comp rx=0 tx=0).stop 2024-09-17T03:35:29.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 -- 172.21.15.121:0/2669073564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa36c15f5a0 msgr2=0x7fa36c0b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa36c15f5a0 0x7fa36c0b3960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa36402aea0 tx=0x7fa364033f70 comp rx=0 tx=0).stop 2024-09-17T03:35:29.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 -- 172.21.15.121:0/2669073564 shutdown_connections 2024-09-17T03:35:29.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa34c078bc0 0x7fa34c07b0d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa36c15f5a0 0x7fa36c0b3960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa36c15b9f0 0x7fa36c0b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 --2- 172.21.15.121:0/2669073564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa36c0cefa0 0x7fa36c1f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 -- 172.21.15.121:0/2669073564 >> 172.21.15.121:0/2669073564 conn(0x7fa36c0cca40 msgr2=0x7fa36c06f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:29.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 -- 172.21.15.121:0/2669073564 shutdown_connections 2024-09-17T03:35:29.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.105+0000 7fa372600640 1 -- 172.21.15.121:0/2669073564 wait complete. 2024-09-17T03:35:29.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:35:29.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.347+0000 7fd11ea00640 1 -- 172.21.15.121:0/3633438367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd11806e330 msgr2=0x7fd11806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.347+0000 7fd11ea00640 1 --2- 172.21.15.121:0/3633438367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd11806e330 0x7fd11806ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd110005fd0 tx=0x7fd11002aa90 comp rx=0 tx=0).stop 2024-09-17T03:35:29.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.347+0000 7fd11ea00640 1 -- 172.21.15.121:0/3633438367 shutdown_connections 2024-09-17T03:35:29.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.348+0000 7fd11ea00640 1 --2- 172.21.15.121:0/3633438367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd11806e330 0x7fd11806ede0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.348+0000 7fd11ea00640 1 --2- 172.21.15.121:0/3633438367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd118073dd0 0x7fd11806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.348+0000 7fd11ea00640 1 -- 172.21.15.121:0/3633438367 >> 172.21.15.121:0/3633438367 conn(0x7fd1180cca40 msgr2=0x7fd1180cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:29.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.348+0000 7fd11ea00640 1 -- 172.21.15.121:0/3633438367 shutdown_connections 2024-09-17T03:35:29.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.348+0000 7fd11ea00640 1 -- 172.21.15.121:0/3633438367 wait complete. 2024-09-17T03:35:29.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.350+0000 7fd11ea00640 1 Processor -- start 2024-09-17T03:35:29.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.350+0000 7fd11ea00640 1 -- start start 2024-09-17T03:35:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.351+0000 7fd11ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd11806e330 0x7fd1180cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.351+0000 7fd11ea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd118073dd0 0x7fd1180b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.351+0000 7fd11ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd118074cb0 0x7fd1180b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.351+0000 7fd11ea00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd11806f4a0 con 0x7fd118074cb0 2024-09-17T03:35:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.351+0000 7fd11ea00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd11806f320 con 0x7fd118073dd0 2024-09-17T03:35:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.351+0000 7fd11ea00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd11806f620 con 0x7fd11806e330 2024-09-17T03:35:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd11ca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd118074cb0 0x7fd1180b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd117400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd118073dd0 0x7fd1180b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd117e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd11806e330 0x7fd1180cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd11ca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd118074cb0 0x7fd1180b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56792/0 (socket says 172.21.15.121:56792) 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd11ca00640 1 -- 172.21.15.121:0/4044023592 learned_addr learned my addr 172.21.15.121:0/4044023592 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd11ca00640 1 -- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd11806e330 msgr2=0x7fd1180cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd11ca00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd11806e330 0x7fd1180cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd11ca00640 1 -- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd118073dd0 msgr2=0x7fd1180b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd11ca00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd118073dd0 0x7fd1180b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd11ca00640 1 -- 172.21.15.121:0/4044023592 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1180b3ec0 con 0x7fd118074cb0 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.352+0000 7fd117400640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd118073dd0 0x7fd1180b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.353+0000 7fd11ca00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd118074cb0 0x7fd1180b2e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd110009d90 tx=0x7fd110003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:29.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.355+0000 7fd10fe00640 1 -- 172.21.15.121:0/4044023592 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110044070 con 0x7fd118074cb0 2024-09-17T03:35:29.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.355+0000 7fd10fe00640 1 -- 172.21.15.121:0/4044023592 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd110004040 con 0x7fd118074cb0 2024-09-17T03:35:29.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.355+0000 7fd11ea00640 1 -- 172.21.15.121:0/4044023592 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1180b41a0 con 0x7fd118074cb0 2024-09-17T03:35:29.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.355+0000 7fd10fe00640 1 -- 172.21.15.121:0/4044023592 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110004430 con 0x7fd118074cb0 2024-09-17T03:35:29.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.355+0000 7fd11ea00640 1 -- 172.21.15.121:0/4044023592 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1180b4760 con 0x7fd118074cb0 2024-09-17T03:35:29.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.356+0000 7fd11ea00640 1 -- 172.21.15.121:0/4044023592 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd11806acf0 con 0x7fd118074cb0 2024-09-17T03:35:29.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.357+0000 7fd10fe00640 1 -- 172.21.15.121:0/4044023592 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd110047070 con 0x7fd118074cb0 2024-09-17T03:35:29.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.358+0000 7fd10fe00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f8078b90 0x7fd0f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.358+0000 7fd10fe00640 1 -- 172.21.15.121:0/4044023592 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fd1100bb740 con 0x7fd118074cb0 2024-09-17T03:35:29.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.358+0000 7fd117e00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f8078b90 0x7fd0f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.359+0000 7fd117e00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f8078b90 0x7fd0f807b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd11815a730 tx=0x7fd108009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:29.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.363+0000 7fd10fe00640 1 -- 172.21.15.121:0/4044023592 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd11806e740 con 0x7fd118074cb0 2024-09-17T03:35:29.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.545+0000 7fd11ea00640 1 -- 172.21.15.121:0/4044023592 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd11806fbb0 con 0x7fd118074cb0 2024-09-17T03:35:29.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.546+0000 7fd10fe00640 1 -- 172.21.15.121:0/4044023592 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7fd110032030 con 0x7fd118074cb0 2024-09-17T03:35:29.546 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:29.546 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-17T03:35:29.546 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:35:29.546 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-17T03:35:29.546 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-17T03:35:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:35:29.547 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 -- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f8078b90 msgr2=0x7fd0f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f8078b90 0x7fd0f807b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd11815a730 tx=0x7fd108009040 comp rx=0 tx=0).stop 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 -- 172.21.15.121:0/4044023592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd118074cb0 msgr2=0x7fd1180b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd118074cb0 0x7fd1180b2e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd110009d90 tx=0x7fd110003ce0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 -- 172.21.15.121:0/4044023592 shutdown_connections 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f8078b90 0x7fd0f807b0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd118074cb0 0x7fd1180b2e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd118073dd0 0x7fd1180b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 --2- 172.21.15.121:0/4044023592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd11806e330 0x7fd1180cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 -- 172.21.15.121:0/4044023592 >> 172.21.15.121:0/4044023592 conn(0x7fd1180cca40 msgr2=0x7fd11809e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:29.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 -- 172.21.15.121:0/4044023592 shutdown_connections 2024-09-17T03:35:29.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.548+0000 7fd11ea00640 1 -- 172.21.15.121:0/4044023592 wait complete. 2024-09-17T03:35:29.569 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:35:29.570 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:35:29.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.796+0000 7f86f4a00640 1 -- 172.21.15.121:0/1254701869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86f0160670 msgr2=0x7f86f00ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.796+0000 7f86f4a00640 1 --2- 172.21.15.121:0/1254701869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86f0160670 0x7f86f00ceaf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009830 tx=0x7f86d802a540 comp rx=0 tx=0).stop 2024-09-17T03:35:29.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.796+0000 7f86f4a00640 1 -- 172.21.15.121:0/1254701869 shutdown_connections 2024-09-17T03:35:29.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.796+0000 7f86f4a00640 1 --2- 172.21.15.121:0/1254701869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86f0160670 0x7f86f00ceaf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.796+0000 7f86f4a00640 1 -- 172.21.15.121:0/1254701869 >> 172.21.15.121:0/1254701869 conn(0x7f86f00d0460 msgr2=0x7f86f006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:29.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.796+0000 7f86f4a00640 1 -- 172.21.15.121:0/1254701869 shutdown_connections 2024-09-17T03:35:29.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.796+0000 7f86f4a00640 1 -- 172.21.15.121:0/1254701869 wait complete. 2024-09-17T03:35:29.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.798+0000 7f86f4a00640 1 Processor -- start 2024-09-17T03:35:29.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.798+0000 7f86f4a00640 1 -- start start 2024-09-17T03:35:29.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.799+0000 7f86f4a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86f00b2e60 0x7f86f00b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.799+0000 7f86f4a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86f0145cc0 0x7f86f0073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.799+0000 7f86f4a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86f0074510 0x7f86f01f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.799+0000 7f86f4a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f86f0070080 con 0x7f86f0145cc0 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.799+0000 7f86f4a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f86f006ff00 con 0x7f86f0074510 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.799+0000 7f86f4a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f86f0070200 con 0x7f86f00b2e60 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86e5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86f0145cc0 0x7f86f0073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86e5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86f0145cc0 0x7f86f0073fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56808/0 (socket says 172.21.15.121:56808) 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86e5e00640 1 -- 172.21.15.121:0/3163768972 learned_addr learned my addr 172.21.15.121:0/3163768972 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86ee800640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86f00b2e60 0x7f86f00b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86ef200640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86f0074510 0x7f86f01f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86e5e00640 1 -- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86f00b2e60 msgr2=0x7f86f00b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86e5e00640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86f00b2e60 0x7f86f00b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86e5e00640 1 -- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86f0074510 msgr2=0x7f86f01f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86e5e00640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86f0074510 0x7f86f01f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86e5e00640 1 -- 172.21.15.121:0/3163768972 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f0074920 con 0x7f86f0145cc0 2024-09-17T03:35:29.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86ef200640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86f0074510 0x7f86f01f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:29.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.800+0000 7f86e5e00640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86f0145cc0 0x7f86f0073fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009950 tx=0x7f86d8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:29.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.801+0000 7f86e7400640 1 -- 172.21.15.121:0/3163768972 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8005c90 con 0x7f86f0145cc0 2024-09-17T03:35:29.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.801+0000 7f86e7400640 1 -- 172.21.15.121:0/3163768972 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86d8005020 con 0x7f86f0145cc0 2024-09-17T03:35:29.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.801+0000 7f86e7400640 1 -- 172.21.15.121:0/3163768972 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8005450 con 0x7f86f0145cc0 2024-09-17T03:35:29.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.801+0000 7f86f4a00640 1 -- 172.21.15.121:0/3163768972 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f00b09f0 con 0x7f86f0145cc0 2024-09-17T03:35:29.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.801+0000 7f86f4a00640 1 -- 172.21.15.121:0/3163768972 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f00ad980 con 0x7f86f0145cc0 2024-09-17T03:35:29.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.802+0000 7f86f4a00640 1 -- 172.21.15.121:0/3163768972 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f015ff60 con 0x7f86f0145cc0 2024-09-17T03:35:29.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.803+0000 7f86e7400640 1 -- 172.21.15.121:0/3163768972 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f86d80317c0 con 0x7f86f0145cc0 2024-09-17T03:35:29.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.804+0000 7f86e7400640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f86cc078b90 0x7f86cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.804+0000 7f86e7400640 1 -- 172.21.15.121:0/3163768972 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f86d80bba10 con 0x7f86f0145cc0 2024-09-17T03:35:29.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.804+0000 7f86ee800640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f86cc078b90 0x7f86cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.805+0000 7f86ee800640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f86cc078b90 0x7f86cc07b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f86e0001860 tx=0x7f86e0001690 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:29.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.808+0000 7f86e7400640 1 -- 172.21.15.121:0/3163768972 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f86f0074920 con 0x7f86f0145cc0 2024-09-17T03:35:29.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:29.989+0000 7f86f4a00640 1 -- 172.21.15.121:0/3163768972 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f86f0145500 con 0x7f86f0145cc0 2024-09-17T03:35:30.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.361+0000 7f86e7400640 1 -- 172.21.15.121:0/3163768972 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f86d803f030 con 0x7f86f0145cc0 2024-09-17T03:35:30.361 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-17T03:35:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.364+0000 7f86f4a00640 1 -- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f86cc078b90 msgr2=0x7f86cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.364+0000 7f86f4a00640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f86cc078b90 0x7f86cc07b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f86e0001860 tx=0x7f86e0001690 comp rx=0 tx=0).stop 2024-09-17T03:35:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.365+0000 7f86f4a00640 1 -- 172.21.15.121:0/3163768972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86f0145cc0 msgr2=0x7f86f0073fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.365+0000 7f86f4a00640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86f0145cc0 0x7f86f0073fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009950 tx=0x7f86d8003c10 comp rx=0 tx=0).stop 2024-09-17T03:35:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.365+0000 7f86f4a00640 1 -- 172.21.15.121:0/3163768972 shutdown_connections 2024-09-17T03:35:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.365+0000 7f86f4a00640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86f0074510 0x7f86f01f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.365+0000 7f86f4a00640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f86cc078b90 0x7f86cc07b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.365+0000 7f86f4a00640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86f0145cc0 0x7f86f0073fd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.365+0000 7f86f4a00640 1 --2- 172.21.15.121:0/3163768972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86f00b2e60 0x7f86f00b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.365+0000 7f86f4a00640 1 -- 172.21.15.121:0/3163768972 >> 172.21.15.121:0/3163768972 conn(0x7f86f00d0460 msgr2=0x7f86f00b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:30.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.365+0000 7f86f4a00640 1 -- 172.21.15.121:0/3163768972 shutdown_connections 2024-09-17T03:35:30.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.365+0000 7f86f4a00640 1 -- 172.21.15.121:0/3163768972 wait complete. 2024-09-17T03:35:30.391 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-17T03:35:30.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.618+0000 7f4a64a00640 1 -- 172.21.15.121:0/987573380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6015cb20 msgr2=0x7f4a600cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.618+0000 7f4a64a00640 1 --2- 172.21.15.121:0/987573380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6015cb20 0x7f4a600cddc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a600afb10 tx=0x7f4a5002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.618+0000 7f4a64a00640 1 -- 172.21.15.121:0/987573380 shutdown_connections 2024-09-17T03:35:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.618+0000 7f4a64a00640 1 --2- 172.21.15.121:0/987573380 >> v2:172.21.15.176:3300/0 conn(0x7f4a600cc8d0 0x7f4a600ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.618+0000 7f4a64a00640 1 --2- 172.21.15.121:0/987573380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a6015cb20 0x7f4a600cddc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.618+0000 7f4a64a00640 1 -- 172.21.15.121:0/987573380 >> 172.21.15.121:0/987573380 conn(0x7f4a6006f940 msgr2=0x7f4a600b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.618+0000 7f4a64a00640 1 -- 172.21.15.121:0/987573380 shutdown_connections 2024-09-17T03:35:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.618+0000 7f4a64a00640 1 -- 172.21.15.121:0/987573380 wait complete. 2024-09-17T03:35:30.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.621+0000 7f4a64a00640 1 Processor -- start 2024-09-17T03:35:30.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.621+0000 7f4a64a00640 1 -- start start 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.622+0000 7f4a64a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a600b4990 0x7f4a60153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.622+0000 7f4a64a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a600cc8d0 0x7f4a6015b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.622+0000 7f4a64a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a6015cb20 0x7f4a6015bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.622+0000 7f4a64a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6006d600 con 0x7f4a600cc8d0 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.622+0000 7f4a64a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6006d480 con 0x7f4a600b4990 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.622+0000 7f4a64a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a6006d780 con 0x7f4a6015cb20 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.622+0000 7f4a56a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a600cc8d0 0x7f4a6015b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.623+0000 7f4a56a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a600cc8d0 0x7f4a6015b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56822/0 (socket says 172.21.15.121:56822) 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.623+0000 7f4a56a00640 1 -- 172.21.15.121:0/350617074 learned_addr learned my addr 172.21.15.121:0/350617074 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.623+0000 7f4a5f400640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a600b4990 0x7f4a60153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:30.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.623+0000 7f4a5fe00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a6015cb20 0x7f4a6015bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.623+0000 7f4a56a00640 1 -- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a6015cb20 msgr2=0x7f4a6015bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.623+0000 7f4a56a00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a6015cb20 0x7f4a6015bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.623+0000 7f4a56a00640 1 -- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a600b4990 msgr2=0x7f4a60153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.623+0000 7f4a56a00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a600b4990 0x7f4a60153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.623+0000 7f4a56a00640 1 -- 172.21.15.121:0/350617074 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a60143f50 con 0x7f4a600cc8d0 2024-09-17T03:35:30.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.623+0000 7f4a56a00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a600cc8d0 0x7f4a6015b5f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800d6d0 tx=0x7f4a4800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:30.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.624+0000 7f4a57e00640 1 -- 172.21.15.121:0/350617074 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48017070 con 0x7f4a600cc8d0 2024-09-17T03:35:30.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.624+0000 7f4a57e00640 1 -- 172.21.15.121:0/350617074 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a48005330 con 0x7f4a600cc8d0 2024-09-17T03:35:30.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.624+0000 7f4a57e00640 1 -- 172.21.15.121:0/350617074 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48009820 con 0x7f4a600cc8d0 2024-09-17T03:35:30.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.624+0000 7f4a64a00640 1 -- 172.21.15.121:0/350617074 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a60143190 con 0x7f4a600cc8d0 2024-09-17T03:35:30.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.624+0000 7f4a64a00640 1 -- 172.21.15.121:0/350617074 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a60143750 con 0x7f4a600cc8d0 2024-09-17T03:35:30.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.625+0000 7f4a64a00640 1 -- 172.21.15.121:0/350617074 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a6006dca0 con 0x7f4a600cc8d0 2024-09-17T03:35:30.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.626+0000 7f4a57e00640 1 -- 172.21.15.121:0/350617074 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a48009bd0 con 0x7f4a600cc8d0 2024-09-17T03:35:30.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.627+0000 7f4a57e00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4a3c078b90 0x7f4a3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:30.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.627+0000 7f4a57e00640 1 -- 172.21.15.121:0/350617074 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f4a4809af40 con 0x7f4a600cc8d0 2024-09-17T03:35:30.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.628+0000 7f4a5f400640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4a3c078b90 0x7f4a3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:30.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.628+0000 7f4a5f400640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4a3c078b90 0x7f4a3c07b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4a50033000 tx=0x7f4a50004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:30.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.632+0000 7f4a57e00640 1 -- 172.21.15.121:0/350617074 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a480634c0 con 0x7f4a600cc8d0 2024-09-17T03:35:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:30.817+0000 7f4a64a00640 1 -- 172.21.15.121:0/350617074 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f4a60160270 con 0x7f4a600cc8d0 2024-09-17T03:35:31.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.368+0000 7f4a57e00640 1 -- 172.21.15.121:0/350617074 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f4a48062dc0 con 0x7f4a600cc8d0 2024-09-17T03:35:31.368 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.370+0000 7f4a64a00640 1 -- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4a3c078b90 msgr2=0x7f4a3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.370+0000 7f4a64a00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4a3c078b90 0x7f4a3c07b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4a50033000 tx=0x7f4a50004730 comp rx=0 tx=0).stop 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.370+0000 7f4a64a00640 1 -- 172.21.15.121:0/350617074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a600cc8d0 msgr2=0x7f4a6015b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.370+0000 7f4a64a00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a600cc8d0 0x7f4a6015b5f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800d6d0 tx=0x7f4a4800db90 comp rx=0 tx=0).stop 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.371+0000 7f4a64a00640 1 -- 172.21.15.121:0/350617074 shutdown_connections 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.371+0000 7f4a64a00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a6015cb20 0x7f4a6015bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.371+0000 7f4a64a00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4a3c078b90 0x7f4a3c07b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.371+0000 7f4a64a00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a600cc8d0 0x7f4a6015b5f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.371+0000 7f4a64a00640 1 --2- 172.21.15.121:0/350617074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a600b4990 0x7f4a60153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.371+0000 7f4a64a00640 1 -- 172.21.15.121:0/350617074 >> 172.21.15.121:0/350617074 conn(0x7f4a6006f940 msgr2=0x7f4a600b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:31.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.371+0000 7f4a64a00640 1 -- 172.21.15.121:0/350617074 shutdown_connections 2024-09-17T03:35:31.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.371+0000 7f4a64a00640 1 -- 172.21.15.121:0/350617074 wait complete. 2024-09-17T03:35:31.415 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:35:31.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.639+0000 7eff6b000640 1 -- 172.21.15.121:0/3166988083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff64156a50 msgr2=0x7eff64074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.639+0000 7eff6b000640 1 --2- 172.21.15.121:0/3166988083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff64156a50 0x7eff64074620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff64074160 tx=0x7eff5402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.640+0000 7eff6b000640 1 -- 172.21.15.121:0/3166988083 shutdown_connections 2024-09-17T03:35:31.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.640+0000 7eff6b000640 1 --2- 172.21.15.121:0/3166988083 >> v2:172.21.15.176:3300/0 conn(0x7eff64074b60 0x7eff6406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.640+0000 7eff6b000640 1 --2- 172.21.15.121:0/3166988083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff64156a50 0x7eff64074620 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.640+0000 7eff6b000640 1 -- 172.21.15.121:0/3166988083 >> 172.21.15.121:0/3166988083 conn(0x7eff640b1b90 msgr2=0x7eff640b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:31.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.640+0000 7eff6b000640 1 -- 172.21.15.121:0/3166988083 shutdown_connections 2024-09-17T03:35:31.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.640+0000 7eff6b000640 1 -- 172.21.15.121:0/3166988083 wait complete. 2024-09-17T03:35:31.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.642+0000 7eff6b000640 1 Processor -- start 2024-09-17T03:35:31.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.642+0000 7eff6b000640 1 -- start start 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.643+0000 7eff6b000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff6406e330 0x7eff640a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff6b000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff64074b60 0x7eff641f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff6b000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff64156a50 0x7eff6415ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff6b000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7eff640ce500 con 0x7eff64156a50 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff6b000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff640ce380 con 0x7eff64074b60 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff6b000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7eff640ce680 con 0x7eff6406e330 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff69000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff64156a50 0x7eff6415ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff69000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff64156a50 0x7eff6415ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56846/0 (socket says 172.21.15.121:56846) 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff69000640 1 -- 172.21.15.121:0/2860093865 learned_addr learned my addr 172.21.15.121:0/2860093865 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff63400640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff64074b60 0x7eff641f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff63e00640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff6406e330 0x7eff640a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff69000640 1 -- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff6406e330 msgr2=0x7eff640a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff69000640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff6406e330 0x7eff640a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff69000640 1 -- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff64074b60 msgr2=0x7eff641f8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff69000640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff64074b60 0x7eff641f8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff69000640 1 -- 172.21.15.121:0/2860093865 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff641f5410 con 0x7eff64156a50 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff63400640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff64074b60 0x7eff641f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.644+0000 7eff69000640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff64156a50 0x7eff6415ee60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c730 tx=0x7eff5c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.645+0000 7eff5be00640 1 -- 172.21.15.121:0/2860093865 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c017070 con 0x7eff64156a50 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.645+0000 7eff5be00640 1 -- 172.21.15.121:0/2860093865 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff5c003c60 con 0x7eff64156a50 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.645+0000 7eff5be00640 1 -- 172.21.15.121:0/2860093865 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0052d0 con 0x7eff64156a50 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.645+0000 7eff6b000640 1 -- 172.21.15.121:0/2860093865 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff641f56f0 con 0x7eff64156a50 2024-09-17T03:35:31.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.645+0000 7eff6b000640 1 -- 172.21.15.121:0/2860093865 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff641f5cb0 con 0x7eff64156a50 2024-09-17T03:35:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.646+0000 7eff6b000640 1 -- 172.21.15.121:0/2860093865 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6406ddf0 con 0x7eff64156a50 2024-09-17T03:35:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.647+0000 7eff5be00640 1 -- 172.21.15.121:0/2860093865 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff5c01a070 con 0x7eff64156a50 2024-09-17T03:35:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.648+0000 7eff5be00640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7eff44078b90 0x7eff4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.648+0000 7eff5be00640 1 -- 172.21.15.121:0/2860093865 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7eff5c09a480 con 0x7eff64156a50 2024-09-17T03:35:31.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.649+0000 7eff63e00640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7eff44078b90 0x7eff4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.650+0000 7eff63e00640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7eff44078b90 0x7eff4407b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7eff54033000 tx=0x7eff54004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:31.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.653+0000 7eff5be00640 1 -- 172.21.15.121:0/2860093865 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff6406e740 con 0x7eff64156a50 2024-09-17T03:35:31.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:31.872+0000 7eff6b000640 1 -- 172.21.15.121:0/2860093865 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7eff641f6090 con 0x7eff64156a50 2024-09-17T03:35:32.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.370+0000 7eff5be00640 1 -- 172.21.15.121:0/2860093865 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7eff5c0629b0 con 0x7eff64156a50 2024-09-17T03:35:32.370 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T03:35:32.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 -- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7eff44078b90 msgr2=0x7eff4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7eff44078b90 0x7eff4407b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7eff54033000 tx=0x7eff54004730 comp rx=0 tx=0).stop 2024-09-17T03:35:32.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 -- 172.21.15.121:0/2860093865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff64156a50 msgr2=0x7eff6415ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff64156a50 0x7eff6415ee60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c730 tx=0x7eff5c00cbf0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 -- 172.21.15.121:0/2860093865 shutdown_connections 2024-09-17T03:35:32.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7eff44078b90 0x7eff4407b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff64156a50 0x7eff6415ee60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff64074b60 0x7eff641f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 --2- 172.21.15.121:0/2860093865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff6406e330 0x7eff640a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 -- 172.21.15.121:0/2860093865 >> 172.21.15.121:0/2860093865 conn(0x7eff640b1b90 msgr2=0x7eff6415b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:32.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 -- 172.21.15.121:0/2860093865 shutdown_connections 2024-09-17T03:35:32.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.373+0000 7eff6b000640 1 -- 172.21.15.121:0/2860093865 wait complete. 2024-09-17T03:35:32.427 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-17T03:35:32.427 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-17T03:35:32.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.652+0000 7fae68400640 1 -- 172.21.15.121:0/2824734513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae600d0460 msgr2=0x7fae60161ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.652+0000 7fae68400640 1 --2- 172.21.15.121:0/2824734513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae600d0460 0x7fae60161ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae54005fd0 tx=0x7fae5402a940 comp rx=0 tx=0).stop 2024-09-17T03:35:32.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.653+0000 7fae68400640 1 -- 172.21.15.121:0/2824734513 shutdown_connections 2024-09-17T03:35:32.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.653+0000 7fae68400640 1 --2- 172.21.15.121:0/2824734513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae600d0460 0x7fae60161ed0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.653+0000 7fae68400640 1 -- 172.21.15.121:0/2824734513 >> 172.21.15.121:0/2824734513 conn(0x7fae600d4510 msgr2=0x7fae600d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:32.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.653+0000 7fae68400640 1 -- 172.21.15.121:0/2824734513 shutdown_connections 2024-09-17T03:35:32.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.653+0000 7fae68400640 1 -- 172.21.15.121:0/2824734513 wait complete. 2024-09-17T03:35:32.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.655+0000 7fae68400640 1 Processor -- start 2024-09-17T03:35:32.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.655+0000 7fae68400640 1 -- start start 2024-09-17T03:35:32.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.656+0000 7fae68400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae600b7b60 0x7fae600b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.656+0000 7fae68400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae600cf910 0x7fae600cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae68400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae600d0460 0x7fae601f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae68400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae60162d10 con 0x7fae600cf910 2024-09-17T03:35:32.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae68400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae600b8310 con 0x7fae600d0460 2024-09-17T03:35:32.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae68400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae60162e90 con 0x7fae600b7b60 2024-09-17T03:35:32.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae65000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae600cf910 0x7fae600cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae65000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae600cf910 0x7fae600cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37426/0 (socket says 172.21.15.121:37426) 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae65000640 1 -- 172.21.15.121:0/1023738620 learned_addr learned my addr 172.21.15.121:0/1023738620 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae65a00640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae600b7b60 0x7fae600b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae66400640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae600d0460 0x7fae601f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae65000640 1 -- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae600b7b60 msgr2=0x7fae600b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae65000640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae600b7b60 0x7fae600b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae65000640 1 -- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae600d0460 msgr2=0x7fae601f92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae65000640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae600d0460 0x7fae601f92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae65000640 1 -- 172.21.15.121:0/1023738620 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae601f7030 con 0x7fae600cf910 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae66400640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae600d0460 0x7fae601f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:32.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.657+0000 7fae65000640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae600cf910 0x7fae600cd4f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c370 tx=0x7fae4c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:32.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.658+0000 7fae5d600640 1 -- 172.21.15.121:0/1023738620 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c017070 con 0x7fae600cf910 2024-09-17T03:35:32.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.658+0000 7fae5d600640 1 -- 172.21.15.121:0/1023738620 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae4c0035f0 con 0x7fae600cf910 2024-09-17T03:35:32.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.658+0000 7fae5d600640 1 -- 172.21.15.121:0/1023738620 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c003a40 con 0x7fae600cf910 2024-09-17T03:35:32.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.658+0000 7fae68400640 1 -- 172.21.15.121:0/1023738620 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae600ce260 con 0x7fae600cf910 2024-09-17T03:35:32.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.658+0000 7fae68400640 1 -- 172.21.15.121:0/1023738620 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae601f75d0 con 0x7fae600cf910 2024-09-17T03:35:32.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.659+0000 7fae68400640 1 -- 172.21.15.121:0/1023738620 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae600cdfd0 con 0x7fae600cf910 2024-09-17T03:35:32.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.660+0000 7fae5d600640 1 -- 172.21.15.121:0/1023738620 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae4c01a070 con 0x7fae600cf910 2024-09-17T03:35:32.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.661+0000 7fae5d600640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae40078b90 0x7fae4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.661+0000 7fae5d600640 1 -- 172.21.15.121:0/1023738620 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fae4c099f90 con 0x7fae600cf910 2024-09-17T03:35:32.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.661+0000 7fae65a00640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae40078b90 0x7fae4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.662+0000 7fae65a00640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae40078b90 0x7fae4007b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae54034000 tx=0x7fae54004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:32.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.666+0000 7fae5d600640 1 -- 172.21.15.121:0/1023738620 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae4c062450 con 0x7fae600cf910 2024-09-17T03:35:32.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:32.859+0000 7fae68400640 1 -- 172.21.15.121:0/1023738620 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fae600b3b40 con 0x7fae600cf910 2024-09-17T03:35:33.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.387+0000 7fae5d600640 1 -- 172.21.15.121:0/1023738620 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7fae600b3b40 con 0x7fae600cf910 2024-09-17T03:35:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 -- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae40078b90 msgr2=0x7fae4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae40078b90 0x7fae4007b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae54034000 tx=0x7fae54004ab0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 -- 172.21.15.121:0/1023738620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae600cf910 msgr2=0x7fae600cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae600cf910 0x7fae600cd4f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c370 tx=0x7fae4c00c830 comp rx=0 tx=0).stop 2024-09-17T03:35:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 -- 172.21.15.121:0/1023738620 shutdown_connections 2024-09-17T03:35:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae600d0460 0x7fae601f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae40078b90 0x7fae4007b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae600cf910 0x7fae600cd4f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 --2- 172.21.15.121:0/1023738620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae600b7b60 0x7fae600b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 -- 172.21.15.121:0/1023738620 >> 172.21.15.121:0/1023738620 conn(0x7fae600d4510 msgr2=0x7fae6015f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 -- 172.21.15.121:0/1023738620 shutdown_connections 2024-09-17T03:35:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.390+0000 7fae68400640 1 -- 172.21.15.121:0/1023738620 wait complete. 2024-09-17T03:35:33.416 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:35:33.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.645+0000 7f523b200640 1 -- 172.21.15.121:0/1826971735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f523415b920 msgr2=0x7f523406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.645+0000 7f523b200640 1 --2- 172.21.15.121:0/1826971735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f523415b920 0x7f523406e940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5224005fd0 tx=0x7f522402a540 comp rx=0 tx=0).stop 2024-09-17T03:35:33.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.645+0000 7f523b200640 1 -- 172.21.15.121:0/1826971735 shutdown_connections 2024-09-17T03:35:33.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.645+0000 7f523b200640 1 --2- 172.21.15.121:0/1826971735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52340d0c50 0x7f5234071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.645+0000 7f523b200640 1 --2- 172.21.15.121:0/1826971735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f523415b920 0x7f523406e940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.645+0000 7f523b200640 1 -- 172.21.15.121:0/1826971735 >> 172.21.15.121:0/1826971735 conn(0x7f52340b2c70 msgr2=0x7f52340b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:33.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.645+0000 7f523b200640 1 -- 172.21.15.121:0/1826971735 shutdown_connections 2024-09-17T03:35:33.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.645+0000 7f523b200640 1 -- 172.21.15.121:0/1826971735 wait complete. 2024-09-17T03:35:33.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.647+0000 7f523b200640 1 Processor -- start 2024-09-17T03:35:33.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.647+0000 7f523b200640 1 -- start start 2024-09-17T03:35:33.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.648+0000 7f523b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52340cdb70 0x7f523409e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f523b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52340d0c50 0x7f523406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f523b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f523415b920 0x7f523406d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f523b200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f52340ae400 con 0x7f52340cdb70 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f523b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f52340ae280 con 0x7f52340d0c50 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f523b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f52340ae580 con 0x7f523415b920 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f5233e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52340cdb70 0x7f523409e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f5233e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52340cdb70 0x7f523409e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37440/0 (socket says 172.21.15.121:37440) 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f5233e00640 1 -- 172.21.15.121:0/2430552129 learned_addr learned my addr 172.21.15.121:0/2430552129 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f5233e00640 1 -- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f523415b920 msgr2=0x7f523406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f5233e00640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f523415b920 0x7f523406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f5233e00640 1 -- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52340d0c50 msgr2=0x7f523406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f5233e00640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52340d0c50 0x7f523406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f5233e00640 1 -- 172.21.15.121:0/2430552129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5234154860 con 0x7f52340cdb70 2024-09-17T03:35:33.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.649+0000 7f5233e00640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52340cdb70 0x7f523409e2b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5224034040 tx=0x7f52240038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:33.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.650+0000 7f5230c00640 1 -- 172.21.15.121:0/2430552129 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522403e030 con 0x7f52340cdb70 2024-09-17T03:35:33.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.650+0000 7f5230c00640 1 -- 172.21.15.121:0/2430552129 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5224003d90 con 0x7f52340cdb70 2024-09-17T03:35:33.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.650+0000 7f523b200640 1 -- 172.21.15.121:0/2430552129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5234154b40 con 0x7f52340cdb70 2024-09-17T03:35:33.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.650+0000 7f5230c00640 1 -- 172.21.15.121:0/2430552129 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224035040 con 0x7f52340cdb70 2024-09-17T03:35:33.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.650+0000 7f523b200640 1 -- 172.21.15.121:0/2430552129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5234155100 con 0x7f52340cdb70 2024-09-17T03:35:33.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.651+0000 7f523b200640 1 -- 172.21.15.121:0/2430552129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52340aeb10 con 0x7f52340cdb70 2024-09-17T03:35:33.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.652+0000 7f5230c00640 1 -- 172.21.15.121:0/2430552129 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5224041030 con 0x7f52340cdb70 2024-09-17T03:35:33.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.653+0000 7f5230c00640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5210078b90 0x7f521007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.653+0000 7f5230c00640 1 -- 172.21.15.121:0/2430552129 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f52240bb940 con 0x7f52340cdb70 2024-09-17T03:35:33.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.653+0000 7f522b400640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5210078b90 0x7f521007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:33.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.654+0000 7f522b400640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5210078b90 0x7f521007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f521c0058c0 tx=0x7f521c005850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:33.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.657+0000 7f5230c00640 1 -- 172.21.15.121:0/2430552129 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5224083ce0 con 0x7f52340cdb70 2024-09-17T03:35:33.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:33.840+0000 7f523b200640 1 -- 172.21.15.121:0/2430552129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f52340cf3e0 con 0x7f52340cdb70 2024-09-17T03:35:35.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.405+0000 7f5230c00640 1 -- 172.21.15.121:0/2430552129 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f52240835e0 con 0x7f52340cdb70 2024-09-17T03:35:35.406 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data_ec' created 2024-09-17T03:35:35.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 -- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5210078b90 msgr2=0x7f521007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5210078b90 0x7f521007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f521c0058c0 tx=0x7f521c005850 comp rx=0 tx=0).stop 2024-09-17T03:35:35.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 -- 172.21.15.121:0/2430552129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52340cdb70 msgr2=0x7f523409e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52340cdb70 0x7f523409e2b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5224034040 tx=0x7f52240038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 -- 172.21.15.121:0/2430552129 shutdown_connections 2024-09-17T03:35:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f523415b920 0x7f523406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52340d0c50 0x7f523406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5210078b90 0x7f521007b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 --2- 172.21.15.121:0/2430552129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52340cdb70 0x7f523409e2b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 -- 172.21.15.121:0/2430552129 >> 172.21.15.121:0/2430552129 conn(0x7f52340b2c70 msgr2=0x7f52340cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 -- 172.21.15.121:0/2430552129 shutdown_connections 2024-09-17T03:35:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.409+0000 7f523b200640 1 -- 172.21.15.121:0/2430552129 wait complete. 2024-09-17T03:35:35.442 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-17T03:35:35.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.671+0000 7f7df0200640 1 -- 172.21.15.121:0/3777324206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7de80adee0 msgr2=0x7f7de806e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.671+0000 7f7df0200640 1 --2- 172.21.15.121:0/3777324206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7de80adee0 0x7f7de806e270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009830 tx=0x7f7ddc02a510 comp rx=0 tx=0).stop 2024-09-17T03:35:35.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.671+0000 7f7df0200640 1 -- 172.21.15.121:0/3777324206 shutdown_connections 2024-09-17T03:35:35.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.671+0000 7f7df0200640 1 --2- 172.21.15.121:0/3777324206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7de815bcb0 0x7f7de815c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.671+0000 7f7df0200640 1 --2- 172.21.15.121:0/3777324206 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7de80adee0 0x7f7de806e270 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.671+0000 7f7df0200640 1 -- 172.21.15.121:0/3777324206 >> 172.21.15.121:0/3777324206 conn(0x7f7de80ccac0 msgr2=0x7f7de80cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:35.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.671+0000 7f7df0200640 1 -- 172.21.15.121:0/3777324206 shutdown_connections 2024-09-17T03:35:35.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.671+0000 7f7df0200640 1 -- 172.21.15.121:0/3777324206 wait complete. 2024-09-17T03:35:35.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.673+0000 7f7df0200640 1 Processor -- start 2024-09-17T03:35:35.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.673+0000 7f7df0200640 1 -- start start 2024-09-17T03:35:35.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7df0200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7de80adee0 0x7f7de809d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7df0200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7de815bcb0 0x7f7de81f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7df0200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7de81f8b00 0x7f7de81f8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7df0200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7de8162b00 con 0x7f7de81f8b00 2024-09-17T03:35:35.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7df0200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7de806e9c0 con 0x7f7de815bcb0 2024-09-17T03:35:35.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7df0200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7de8162c80 con 0x7f7de80adee0 2024-09-17T03:35:35.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7dee200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7de81f8b00 0x7f7de81f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7dee200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7de81f8b00 0x7f7de81f8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37452/0 (socket says 172.21.15.121:37452) 2024-09-17T03:35:35.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7dee200640 1 -- 172.21.15.121:0/3050480781 learned_addr learned my addr 172.21.15.121:0/3050480781 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:35.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7dece00640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7de815bcb0 0x7f7de81f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7ded800640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7de80adee0 0x7f7de809d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7dece00640 1 -- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7de80adee0 msgr2=0x7f7de809d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7dece00640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7de80adee0 0x7f7de809d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7dece00640 1 -- 172.21.15.121:0/3050480781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7de81f8b00 msgr2=0x7f7de81f8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7dece00640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7de81f8b00 0x7f7de81f8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.675+0000 7f7dece00640 1 -- 172.21.15.121:0/3050480781 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de809d820 con 0x7f7de815bcb0 2024-09-17T03:35:35.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.676+0000 7f7dee200640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7de81f8b00 0x7f7de81f8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:35.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.676+0000 7f7dece00640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7de815bcb0 0x7f7de81f2900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e6e0 tx=0x7f7dd400eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:35.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.676+0000 7f7de5600640 1 -- 172.21.15.121:0/3050480781 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400cab0 con 0x7f7de815bcb0 2024-09-17T03:35:35.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.676+0000 7f7de5600640 1 -- 172.21.15.121:0/3050480781 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7dd400cd40 con 0x7f7de815bcb0 2024-09-17T03:35:35.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.676+0000 7f7df0200640 1 -- 172.21.15.121:0/3050480781 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de81f9450 con 0x7f7de815bcb0 2024-09-17T03:35:35.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.676+0000 7f7de5600640 1 -- 172.21.15.121:0/3050480781 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4010690 con 0x7f7de815bcb0 2024-09-17T03:35:35.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.676+0000 7f7df0200640 1 -- 172.21.15.121:0/3050480781 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de80c7910 con 0x7f7de815bcb0 2024-09-17T03:35:35.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.677+0000 7f7df0200640 1 -- 172.21.15.121:0/3050480781 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de80c73a0 con 0x7f7de815bcb0 2024-09-17T03:35:35.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.679+0000 7f7de5600640 1 -- 172.21.15.121:0/3050480781 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7dd4010830 con 0x7f7de815bcb0 2024-09-17T03:35:35.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.679+0000 7f7de5600640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7dc8078bc0 0x7f7dc807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.680+0000 7f7de5600640 1 -- 172.21.15.121:0/3050480781 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f7dd409bc60 con 0x7f7de815bcb0 2024-09-17T03:35:35.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.680+0000 7f7ded800640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7dc8078bc0 0x7f7dc807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.681+0000 7f7ded800640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7dc8078bc0 0x7f7dc807b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc034000 tx=0x7f7ddc004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:35.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.685+0000 7f7de5600640 1 -- 172.21.15.121:0/3050480781 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7de81f9450 con 0x7f7de815bcb0 2024-09-17T03:35:35.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:35.868+0000 7f7df0200640 1 -- 172.21.15.121:0/3050480781 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f7de81631d0 con 0x7f7de815bcb0 2024-09-17T03:35:36.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.414+0000 7f7de5600640 1 -- 172.21.15.121:0/3050480781 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f7dd4063690 con 0x7f7de815bcb0 2024-09-17T03:35:36.416 INFO:teuthology.orchestra.run.smithi121.stderr:set pool 4 allow_ec_overwrites to true 2024-09-17T03:35:36.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.420+0000 7f7df0200640 1 -- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7dc8078bc0 msgr2=0x7f7dc807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:36.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.420+0000 7f7df0200640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7dc8078bc0 0x7f7dc807b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc034000 tx=0x7f7ddc004730 comp rx=0 tx=0).stop 2024-09-17T03:35:36.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.420+0000 7f7df0200640 1 -- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7de815bcb0 msgr2=0x7f7de81f2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:36.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.420+0000 7f7df0200640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7de815bcb0 0x7f7de81f2900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e6e0 tx=0x7f7dd400eba0 comp rx=0 tx=0).stop 2024-09-17T03:35:36.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.422+0000 7f7df0200640 1 -- 172.21.15.121:0/3050480781 shutdown_connections 2024-09-17T03:35:36.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.422+0000 7f7df0200640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7dc8078bc0 0x7f7dc807b0d0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc034000 tx=0x7f7ddc004730 comp rx=0 tx=0).stop 2024-09-17T03:35:36.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.422+0000 7f7df0200640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7de81f8b00 0x7f7de81f8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:36.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.422+0000 7f7df0200640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7de815bcb0 0x7f7de81f2900 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:36.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.422+0000 7f7df0200640 1 --2- 172.21.15.121:0/3050480781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7de80adee0 0x7f7de809d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:36.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.422+0000 7f7df0200640 1 -- 172.21.15.121:0/3050480781 >> 172.21.15.121:0/3050480781 conn(0x7f7de80ccac0 msgr2=0x7f7de80afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:36.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.425+0000 7f7df0200640 1 -- 172.21.15.121:0/3050480781 shutdown_connections 2024-09-17T03:35:36.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.427+0000 7f7df0200640 1 -- 172.21.15.121:0/3050480781 wait complete. 2024-09-17T03:35:36.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-17T03:35:36.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.685+0000 7fb332800640 1 -- 172.21.15.121:0/1826937440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c0cef00 msgr2=0x7fb32c0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:36.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.685+0000 7fb332800640 1 --2- 172.21.15.121:0/1826937440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c0cef00 0x7fb32c0cf310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb32c074160 tx=0x7fb32402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:36.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.685+0000 7fb332800640 1 -- 172.21.15.121:0/1826937440 shutdown_connections 2024-09-17T03:35:36.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.685+0000 7fb332800640 1 --2- 172.21.15.121:0/1826937440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c0cef00 0x7fb32c0cf310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:36.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.685+0000 7fb332800640 1 --2- 172.21.15.121:0/1826937440 >> v2:172.21.15.176:3300/0 conn(0x7fb32c06ddf0 0x7fb32c06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:36.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.685+0000 7fb332800640 1 -- 172.21.15.121:0/1826937440 >> 172.21.15.121:0/1826937440 conn(0x7fb32c0b1b90 msgr2=0x7fb32c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:36.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.686+0000 7fb332800640 1 -- 172.21.15.121:0/1826937440 shutdown_connections 2024-09-17T03:35:36.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.686+0000 7fb332800640 1 -- 172.21.15.121:0/1826937440 wait complete. 2024-09-17T03:35:36.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.688+0000 7fb332800640 1 Processor -- start 2024-09-17T03:35:36.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.688+0000 7fb332800640 1 -- start start 2024-09-17T03:35:36.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.689+0000 7fb332800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb32c06ddf0 0x7fb32c157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:36.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.689+0000 7fb332800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c0cef00 0x7fb32c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:36.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.689+0000 7fb332800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb32c156a50 0x7fb32c155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:36.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.689+0000 7fb332800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c0cf850 con 0x7fb32c0cef00 2024-09-17T03:35:36.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.689+0000 7fb332800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c161060 con 0x7fb32c156a50 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.689+0000 7fb332800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb32c0cf9d0 con 0x7fb32c06ddf0 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.689+0000 7fb322a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c0cef00 0x7fb32c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.689+0000 7fb322a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c0cef00 0x7fb32c0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37466/0 (socket says 172.21.15.121:37466) 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.689+0000 7fb322a00640 1 -- 172.21.15.121:0/3108992076 learned_addr learned my addr 172.21.15.121:0/3108992076 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb32be00640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb32c156a50 0x7fb32c155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb32b400640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb32c06ddf0 0x7fb32c157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb322a00640 1 -- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb32c06ddf0 msgr2=0x7fb32c157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb322a00640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb32c06ddf0 0x7fb32c157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb322a00640 1 -- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb32c156a50 msgr2=0x7fb32c155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb322a00640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb32c156a50 0x7fb32c155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb322a00640 1 -- 172.21.15.121:0/3108992076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c0b5140 con 0x7fb32c0cef00 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb322a00640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c0cef00 0x7fb32c0c70d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb31400c9a0 tx=0x7fb31400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:36.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb323e00640 1 -- 172.21.15.121:0/3108992076 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314007bb0 con 0x7fb32c0cef00 2024-09-17T03:35:36.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb323e00640 1 -- 172.21.15.121:0/3108992076 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb314007e40 con 0x7fb32c0cef00 2024-09-17T03:35:36.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.690+0000 7fb332800640 1 -- 172.21.15.121:0/3108992076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c0b5420 con 0x7fb32c0cef00 2024-09-17T03:35:36.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.691+0000 7fb323e00640 1 -- 172.21.15.121:0/3108992076 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31400f6b0 con 0x7fb32c0cef00 2024-09-17T03:35:36.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.691+0000 7fb332800640 1 -- 172.21.15.121:0/3108992076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32c159320 con 0x7fb32c0cef00 2024-09-17T03:35:36.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.692+0000 7fb332800640 1 -- 172.21.15.121:0/3108992076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32c0c7690 con 0x7fb32c0cef00 2024-09-17T03:35:36.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.693+0000 7fb323e00640 1 -- 172.21.15.121:0/3108992076 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb314018400 con 0x7fb32c0cef00 2024-09-17T03:35:36.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.695+0000 7fb323e00640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb308078b90 0x7fb30807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:36.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.695+0000 7fb323e00640 1 -- 172.21.15.121:0/3108992076 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fb31409b700 con 0x7fb32c0cef00 2024-09-17T03:35:36.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.695+0000 7fb32b400640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb308078b90 0x7fb30807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:36.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.696+0000 7fb32b400640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb308078b90 0x7fb30807b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb31c000f60 tx=0x7fb31c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:36.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.700+0000 7fb323e00640 1 -- 172.21.15.121:0/3108992076 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb314014030 con 0x7fb32c0cef00 2024-09-17T03:35:36.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:36.920+0000 7fb332800640 1 -- 172.21.15.121:0/3108992076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fb32c06e200 con 0x7fb32c0cef00 2024-09-17T03:35:37.354 INFO:tasks.ceph.mds.d.smithi176.stderr:2024-09-17T03:35:37.355+0000 7f6ccb200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:35:37.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.429+0000 7fb323e00640 1 -- 172.21.15.121:0/3108992076 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fb3140631c0 con 0x7fb32c0cef00 2024-09-17T03:35:37.429 INFO:teuthology.orchestra.run.smithi121.stderr:added data pool 4 to fsmap 2024-09-17T03:35:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 -- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb308078b90 msgr2=0x7fb30807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb308078b90 0x7fb30807b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb31c000f60 tx=0x7fb31c009040 comp rx=0 tx=0).stop 2024-09-17T03:35:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 -- 172.21.15.121:0/3108992076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c0cef00 msgr2=0x7fb32c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c0cef00 0x7fb32c0c70d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb31400c9a0 tx=0x7fb31400ce60 comp rx=0 tx=0).stop 2024-09-17T03:35:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 -- 172.21.15.121:0/3108992076 shutdown_connections 2024-09-17T03:35:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb32c156a50 0x7fb32c155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb308078b90 0x7fb30807b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c0cef00 0x7fb32c0c70d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 --2- 172.21.15.121:0/3108992076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb32c06ddf0 0x7fb32c157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 -- 172.21.15.121:0/3108992076 >> 172.21.15.121:0/3108992076 conn(0x7fb32c0b1b90 msgr2=0x7fb32c06fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:37.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 -- 172.21.15.121:0/3108992076 shutdown_connections 2024-09-17T03:35:37.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.432+0000 7fb332800640 1 -- 172.21.15.121:0/3108992076 wait complete. 2024-09-17T03:35:37.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:37.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.674+0000 7fdc8d600640 1 -- 172.21.15.121:0/2656014997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc6c003aa0 msgr2=0x7fdc6c003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:37.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.674+0000 7fdc8d600640 1 --2- 172.21.15.121:0/2656014997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc6c003aa0 0x7fdc6c003f10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800c2e0 tx=0x7fdc6c005830 comp rx=0 tx=0).stop 2024-09-17T03:35:37.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.674+0000 7fdc87400640 1 -- 172.21.15.121:0/2656014997 reap_dead start 2024-09-17T03:35:37.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.674+0000 7fdc8d600640 1 -- 172.21.15.121:0/2656014997 shutdown_connections 2024-09-17T03:35:37.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.674+0000 7fdc8d600640 1 -- 172.21.15.121:0/2656014997 >> 172.21.15.121:0/2656014997 conn(0x7fdc880cca40 msgr2=0x7fdc880cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:37.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.674+0000 7fdc8d600640 1 -- 172.21.15.121:0/2656014997 shutdown_connections 2024-09-17T03:35:37.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.674+0000 7fdc8d600640 1 -- 172.21.15.121:0/2656014997 wait complete. 2024-09-17T03:35:37.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.677+0000 7fdc8d600640 1 Processor -- start 2024-09-17T03:35:37.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.677+0000 7fdc8d600640 1 -- start start 2024-09-17T03:35:37.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.678+0000 7fdc8d600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc6c003aa0 0x7fdc88159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:37.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.678+0000 7fdc8d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc880b2e80 0x7fdc880b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:37.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.678+0000 7fdc8d600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc880b4c70 0x7fdc881f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:37.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.678+0000 7fdc8d600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdc88071000 con 0x7fdc880b4c70 2024-09-17T03:35:37.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.678+0000 7fdc8d600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdc88070e80 con 0x7fdc880b2e80 2024-09-17T03:35:37.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.678+0000 7fdc8d600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdc8806ddf0 con 0x7fdc6c003aa0 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.678+0000 7fdc87400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc880b4c70 0x7fdc881f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.678+0000 7fdc87400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc880b4c70 0x7fdc881f8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37486/0 (socket says 172.21.15.121:37486) 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.678+0000 7fdc87400640 1 -- 172.21.15.121:0/2327387098 learned_addr learned my addr 172.21.15.121:0/2327387098 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc86a00640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc6c003aa0 0x7fdc88159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc86000640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc880b2e80 0x7fdc880b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc87400640 1 -- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc6c003aa0 msgr2=0x7fdc88159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc87400640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc6c003aa0 0x7fdc88159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc87400640 1 -- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc880b2e80 msgr2=0x7fdc880b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc87400640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc880b2e80 0x7fdc880b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc87400640 1 -- 172.21.15.121:0/2327387098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc880c6320 con 0x7fdc880b4c70 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc86a00640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc6c003aa0 0x7fdc88159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc87400640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc880b4c70 0x7fdc881f8ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc880cc8f0 tx=0x7fdc80011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc7ea00640 1 -- 172.21.15.121:0/2327387098 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc80003970 con 0x7fdc880b4c70 2024-09-17T03:35:37.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc7ea00640 1 -- 172.21.15.121:0/2327387098 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc80003b10 con 0x7fdc880b4c70 2024-09-17T03:35:37.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc8d600640 1 -- 172.21.15.121:0/2327387098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc880c6600 con 0x7fdc880b4c70 2024-09-17T03:35:37.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.679+0000 7fdc7ea00640 1 -- 172.21.15.121:0/2327387098 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc80004030 con 0x7fdc880b4c70 2024-09-17T03:35:37.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.680+0000 7fdc8d600640 1 -- 172.21.15.121:0/2327387098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc880a0870 con 0x7fdc880b4c70 2024-09-17T03:35:37.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.680+0000 7fdc8d600640 1 -- 172.21.15.121:0/2327387098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc880b0c50 con 0x7fdc880b4c70 2024-09-17T03:35:37.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.682+0000 7fdc7ea00640 1 -- 172.21.15.121:0/2327387098 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc800041d0 con 0x7fdc880b4c70 2024-09-17T03:35:37.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.683+0000 7fdc7ea00640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdc68078b90 0x7fdc6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:37.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.683+0000 7fdc7ea00640 1 -- 172.21.15.121:0/2327387098 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdc8009c380 con 0x7fdc880b4c70 2024-09-17T03:35:37.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.683+0000 7fdc86a00640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdc68078b90 0x7fdc6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:37.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.684+0000 7fdc86a00640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdc68078b90 0x7fdc6807b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc78033000 tx=0x7fdc7802d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:37.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.687+0000 7fdc7ea00640 1 -- 172.21.15.121:0/2327387098 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdc880b0c50 con 0x7fdc880b4c70 2024-09-17T03:35:37.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.909+0000 7fdc8d600640 1 -- 172.21.15.121:0/2327387098 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc8806f710 con 0x7fdc880b4c70 2024-09-17T03:35:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.910+0000 7fdc7ea00640 1 -- 172.21.15.121:0/2327387098 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5219 (secure 0 0 0) 0x7fdc80020060 con 0x7fdc880b4c70 2024-09-17T03:35:37.910 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:37.910 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"btime":"2024-09-17T03:35:37:420200+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:31.874114+0000","modified":"2024-09-17T03:35:36.922145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4408":{"gid":4408,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4408,"qdb_cluster":[4408]},"id":1}]} 2024-09-17T03:35:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 7 2024-09-17T03:35:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.912+0000 7fdc8d600640 1 -- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdc68078b90 msgr2=0x7fdc6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.912+0000 7fdc8d600640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdc68078b90 0x7fdc6807b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc78033000 tx=0x7fdc7802d000 comp rx=0 tx=0).stop 2024-09-17T03:35:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.912+0000 7fdc8d600640 1 -- 172.21.15.121:0/2327387098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc880b4c70 msgr2=0x7fdc881f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.912+0000 7fdc8d600640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc880b4c70 0x7fdc881f8ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc880cc8f0 tx=0x7fdc80011ef0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.912+0000 7fdc8d600640 1 -- 172.21.15.121:0/2327387098 shutdown_connections 2024-09-17T03:35:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.912+0000 7fdc8d600640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdc68078b90 0x7fdc6807b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.912+0000 7fdc8d600640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc880b4c70 0x7fdc881f8ce0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.912+0000 7fdc8d600640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc880b2e80 0x7fdc880b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.912+0000 7fdc8d600640 1 --2- 172.21.15.121:0/2327387098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc6c003aa0 0x7fdc88159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.912+0000 7fdc8d600640 1 -- 172.21.15.121:0/2327387098 >> 172.21.15.121:0/2327387098 conn(0x7fdc880cca40 msgr2=0x7fdc880af180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.913+0000 7fdc8d600640 1 -- 172.21.15.121:0/2327387098 shutdown_connections 2024-09-17T03:35:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:37.913+0000 7fdc8d600640 1 -- 172.21.15.121:0/2327387098 wait complete. 2024-09-17T03:35:37.933 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:38.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.155+0000 7f2493000640 1 -- 172.21.15.121:0/1938757311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248c074cb0 msgr2=0x7f248c073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.155+0000 7f2493000640 1 --2- 172.21.15.121:0/1938757311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248c074cb0 0x7f248c073dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f247c005fd0 tx=0x7f247c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.155+0000 7f2493000640 1 -- 172.21.15.121:0/1938757311 shutdown_connections 2024-09-17T03:35:38.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.155+0000 7f2493000640 1 --2- 172.21.15.121:0/1938757311 >> v2:172.21.15.176:3300/0 conn(0x7f248c0cbc10 0x7f248c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.155+0000 7f2493000640 1 --2- 172.21.15.121:0/1938757311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248c074cb0 0x7f248c073dd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.155+0000 7f2493000640 1 -- 172.21.15.121:0/1938757311 >> 172.21.15.121:0/1938757311 conn(0x7f248c0cca40 msgr2=0x7f248c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:38.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.155+0000 7f2493000640 1 -- 172.21.15.121:0/1938757311 shutdown_connections 2024-09-17T03:35:38.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.155+0000 7f2493000640 1 -- 172.21.15.121:0/1938757311 wait complete. 2024-09-17T03:35:38.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.157+0000 7f2493000640 1 Processor -- start 2024-09-17T03:35:38.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.157+0000 7f2493000640 1 -- start start 2024-09-17T03:35:38.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f2493000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248c06ddf0 0x7f248c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f2493000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f248c074cb0 0x7f248c156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f2493000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248c0cbc10 0x7f248c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f2493000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f248c06f360 con 0x7f248c074cb0 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f2493000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f248c06f1e0 con 0x7f248c06ddf0 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f2493000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f248c06f4e0 con 0x7f248c0cbc10 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f248b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f248c074cb0 0x7f248c156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f248b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f248c074cb0 0x7f248c156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37492/0 (socket says 172.21.15.121:37492) 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f248b400640 1 -- 172.21.15.121:0/2892432803 learned_addr learned my addr 172.21.15.121:0/2892432803 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f248be00640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248c06ddf0 0x7f248c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f2491000640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248c0cbc10 0x7f248c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f248b400640 1 -- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248c0cbc10 msgr2=0x7f248c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f248b400640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248c0cbc10 0x7f248c0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f248b400640 1 -- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248c06ddf0 msgr2=0x7f248c1569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f248b400640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248c06ddf0 0x7f248c1569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f248b400640 1 -- 172.21.15.121:0/2892432803 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c15f6e0 con 0x7f248c074cb0 2024-09-17T03:35:38.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.159+0000 7f248be00640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248c06ddf0 0x7f248c1569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:38.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.160+0000 7f248b400640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f248c074cb0 0x7f248c156ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f247800e7c0 tx=0x7f247800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:38.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.160+0000 7f2483e00640 1 -- 172.21.15.121:0/2892432803 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247800ccc0 con 0x7f248c074cb0 2024-09-17T03:35:38.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.160+0000 7f2483e00640 1 -- 172.21.15.121:0/2892432803 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2478010430 con 0x7f248c074cb0 2024-09-17T03:35:38.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.160+0000 7f2493000640 1 -- 172.21.15.121:0/2892432803 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c157a80 con 0x7f248c074cb0 2024-09-17T03:35:38.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.160+0000 7f2483e00640 1 -- 172.21.15.121:0/2892432803 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478010860 con 0x7f248c074cb0 2024-09-17T03:35:38.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.160+0000 7f2493000640 1 -- 172.21.15.121:0/2892432803 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c157d30 con 0x7f248c074cb0 2024-09-17T03:35:38.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.161+0000 7f2493000640 1 -- 172.21.15.121:0/2892432803 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248c06fa00 con 0x7f248c074cb0 2024-09-17T03:35:38.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.162+0000 7f2483e00640 1 -- 172.21.15.121:0/2892432803 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2478010a00 con 0x7f248c074cb0 2024-09-17T03:35:38.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.163+0000 7f2483e00640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f246c078bc0 0x7f246c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.163+0000 7f2483e00640 1 -- 172.21.15.121:0/2892432803 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f247809bad0 con 0x7f248c074cb0 2024-09-17T03:35:38.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.163+0000 7f248be00640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f246c078bc0 0x7f246c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.164+0000 7f248be00640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f246c078bc0 0x7f246c07b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f247c033000 tx=0x7f247c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:38.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.168+0000 7f2483e00640 1 -- 172.21.15.121:0/2892432803 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2478063bc0 con 0x7f248c074cb0 2024-09-17T03:35:38.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.356+0000 7f2493000640 1 -- 172.21.15.121:0/2892432803 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f248c0cf470 con 0x7f248c074cb0 2024-09-17T03:35:38.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.357+0000 7f2483e00640 1 -- 172.21.15.121:0/2892432803 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18662 (secure 0 0 0) 0x7f24780634c0 con 0x7f248c074cb0 2024-09-17T03:35:38.357 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:38.358 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:36.921947+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:38.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 -- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f246c078bc0 msgr2=0x7f246c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f246c078bc0 0x7f246c07b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f247c033000 tx=0x7f247c004730 comp rx=0 tx=0).stop 2024-09-17T03:35:38.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 -- 172.21.15.121:0/2892432803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f248c074cb0 msgr2=0x7f248c156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f248c074cb0 0x7f248c156ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f247800e7c0 tx=0x7f247800ec80 comp rx=0 tx=0).stop 2024-09-17T03:35:38.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 -- 172.21.15.121:0/2892432803 shutdown_connections 2024-09-17T03:35:38.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248c0cbc10 0x7f248c0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f246c078bc0 0x7f246c07b0d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f248c074cb0 0x7f248c156ee0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 --2- 172.21.15.121:0/2892432803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248c06ddf0 0x7f248c1569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 -- 172.21.15.121:0/2892432803 >> 172.21.15.121:0/2892432803 conn(0x7f248c0cca40 msgr2=0x7f248c15a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:38.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 -- 172.21.15.121:0/2892432803 shutdown_connections 2024-09-17T03:35:38.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.360+0000 7f2493000640 1 -- 172.21.15.121:0/2892432803 wait complete. 2024-09-17T03:35:38.381 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:38.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.600+0000 7f53da000640 1 -- 172.21.15.121:0/1926498917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d415ede0 msgr2=0x7f53d40cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.600+0000 7f53da000640 1 --2- 172.21.15.121:0/1926498917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d415ede0 0x7f53d40cc820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f53d40723d0 tx=0x7f53bc02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.600+0000 7f53da000640 1 -- 172.21.15.121:0/1926498917 shutdown_connections 2024-09-17T03:35:38.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.600+0000 7f53da000640 1 --2- 172.21.15.121:0/1926498917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d415ede0 0x7f53d40cc820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.600+0000 7f53da000640 1 --2- 172.21.15.121:0/1926498917 >> v2:172.21.15.176:3300/0 conn(0x7f53d415b820 0x7f53d415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.600+0000 7f53da000640 1 -- 172.21.15.121:0/1926498917 >> 172.21.15.121:0/1926498917 conn(0x7f53d406f940 msgr2=0x7f53d40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:38.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.600+0000 7f53da000640 1 -- 172.21.15.121:0/1926498917 shutdown_connections 2024-09-17T03:35:38.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.600+0000 7f53da000640 1 -- 172.21.15.121:0/1926498917 wait complete. 2024-09-17T03:35:38.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.602+0000 7f53da000640 1 Processor -- start 2024-09-17T03:35:38.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.602+0000 7f53da000640 1 -- start start 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.603+0000 7f53da000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53d40ccd60 0x7f53d4143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.603+0000 7f53da000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d415b820 0x7f53d41f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.603+0000 7f53da000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53d415ede0 0x7f53d41f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.603+0000 7f53da000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4070e70 con 0x7f53d415b820 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.603+0000 7f53da000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4070cf0 con 0x7f53d40ccd60 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53da000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f53d40ce4d0 con 0x7f53d415ede0 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53cbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d415b820 0x7f53d41f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53cbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d415b820 0x7f53d41f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37504/0 (socket says 172.21.15.121:37504) 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53cbe00640 1 -- 172.21.15.121:0/665060805 learned_addr learned my addr 172.21.15.121:0/665060805 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53d8c00640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53d40ccd60 0x7f53d4143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53d9600640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53d415ede0 0x7f53d41f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53cbe00640 1 -- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53d415ede0 msgr2=0x7f53d41f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53cbe00640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53d415ede0 0x7f53d41f9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53cbe00640 1 -- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53d40ccd60 msgr2=0x7f53d4143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53cbe00640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53d40ccd60 0x7f53d4143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53cbe00640 1 -- 172.21.15.121:0/665060805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d41f9e00 con 0x7f53d415b820 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.604+0000 7f53cbe00640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d415b820 0x7f53d41f8f50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53bc034040 tx=0x7f53bc003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.605+0000 7f53d1600640 1 -- 172.21.15.121:0/665060805 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc03e030 con 0x7f53d415b820 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.605+0000 7f53d1600640 1 -- 172.21.15.121:0/665060805 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53bc003d10 con 0x7f53d415b820 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.605+0000 7f53da000640 1 -- 172.21.15.121:0/665060805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d41563a0 con 0x7f53d415b820 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.605+0000 7f53d1600640 1 -- 172.21.15.121:0/665060805 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc035040 con 0x7f53d415b820 2024-09-17T03:35:38.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.605+0000 7f53da000640 1 -- 172.21.15.121:0/665060805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d4156640 con 0x7f53d415b820 2024-09-17T03:35:38.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.606+0000 7f53da000640 1 -- 172.21.15.121:0/665060805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d40ce980 con 0x7f53d415b820 2024-09-17T03:35:38.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.607+0000 7f53d1600640 1 -- 172.21.15.121:0/665060805 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f53bc041030 con 0x7f53d415b820 2024-09-17T03:35:38.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.608+0000 7f53d1600640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f53b0078b90 0x7f53b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.608+0000 7f53d1600640 1 -- 172.21.15.121:0/665060805 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f53bc0bb830 con 0x7f53d415b820 2024-09-17T03:35:38.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.609+0000 7f53d8c00640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f53b0078b90 0x7f53b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.609+0000 7f53d8c00640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f53b0078b90 0x7f53b007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009b30 tx=0x7f53c4005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:38.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.612+0000 7f53d1600640 1 -- 172.21.15.121:0/665060805 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f53bc083240 con 0x7f53d415b820 2024-09-17T03:35:38.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.796+0000 7f53da000640 1 -- 172.21.15.121:0/665060805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53d40ce280 con 0x7f53d415b820 2024-09-17T03:35:38.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.797+0000 7f53d1600640 1 -- 172.21.15.121:0/665060805 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18662 (secure 0 0 0) 0x7f53bc087c70 con 0x7f53d415b820 2024-09-17T03:35:38.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:38.797 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:36.921947+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 -- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f53b0078b90 msgr2=0x7f53b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f53b0078b90 0x7f53b007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009b30 tx=0x7f53c4005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 -- 172.21.15.121:0/665060805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d415b820 msgr2=0x7f53d41f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d415b820 0x7f53d41f8f50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53bc034040 tx=0x7f53bc003820 comp rx=0 tx=0).stop 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 -- 172.21.15.121:0/665060805 shutdown_connections 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53d415ede0 0x7f53d41f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f53b0078b90 0x7f53b007b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53d415b820 0x7f53d41f8f50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 --2- 172.21.15.121:0/665060805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53d40ccd60 0x7f53d4143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 -- 172.21.15.121:0/665060805 >> 172.21.15.121:0/665060805 conn(0x7f53d406f940 msgr2=0x7f53d4143810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 -- 172.21.15.121:0/665060805 shutdown_connections 2024-09-17T03:35:38.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:38.800+0000 7f53da000640 1 -- 172.21.15.121:0/665060805 wait complete. 2024-09-17T03:35:38.841 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:39.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.060+0000 7fce85e00640 1 -- 172.21.15.121:0/2590174715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800d0930 msgr2=0x7fce8015f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.060+0000 7fce85e00640 1 --2- 172.21.15.121:0/2590174715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800d0930 0x7fce8015f5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fce70005fd0 tx=0x7fce7002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.060+0000 7fce85e00640 1 -- 172.21.15.121:0/2590174715 shutdown_connections 2024-09-17T03:35:39.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.060+0000 7fce85e00640 1 --2- 172.21.15.121:0/2590174715 >> v2:172.21.15.176:3300/0 conn(0x7fce80073ea0 0x7fce800742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.060+0000 7fce85e00640 1 --2- 172.21.15.121:0/2590174715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800d0930 0x7fce8015f5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.060+0000 7fce85e00640 1 -- 172.21.15.121:0/2590174715 >> 172.21.15.121:0/2590174715 conn(0x7fce800d1140 msgr2=0x7fce800d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:39.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.060+0000 7fce85e00640 1 -- 172.21.15.121:0/2590174715 shutdown_connections 2024-09-17T03:35:39.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.060+0000 7fce85e00640 1 -- 172.21.15.121:0/2590174715 wait complete. 2024-09-17T03:35:39.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.062+0000 7fce85e00640 1 Processor -- start 2024-09-17T03:35:39.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.062+0000 7fce85e00640 1 -- start start 2024-09-17T03:35:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce85e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce80073ea0 0x7fce800c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce85e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce800adee0 0x7fce800b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce85e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce800d0930 0x7fce8014d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce85e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce80071730 con 0x7fce800adee0 2024-09-17T03:35:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce85e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fce800715b0 con 0x7fce800d0930 2024-09-17T03:35:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce85e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fce800718b0 con 0x7fce80073ea0 2024-09-17T03:35:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce800adee0 0x7fce800b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce800adee0 0x7fce800b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37520/0 (socket says 172.21.15.121:37520) 2024-09-17T03:35:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7e000640 1 -- 172.21.15.121:0/1626385621 learned_addr learned my addr 172.21.15.121:0/1626385621 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7ea00640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce80073ea0 0x7fce800c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7f400640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce800d0930 0x7fce8014d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7e000640 1 -- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce80073ea0 msgr2=0x7fce800c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7e000640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce80073ea0 0x7fce800c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7e000640 1 -- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce800d0930 msgr2=0x7fce8014d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7e000640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce800d0930 0x7fce8014d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7e000640 1 -- 172.21.15.121:0/1626385621 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce80158bd0 con 0x7fce800adee0 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.064+0000 7fce7ea00640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce80073ea0 0x7fce800c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.065+0000 7fce7e000640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce800adee0 0x7fce800b5890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00ea20 tx=0x7fce6c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.065+0000 7fce77400640 1 -- 172.21.15.121:0/1626385621 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00ce40 con 0x7fce800adee0 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.065+0000 7fce77400640 1 -- 172.21.15.121:0/1626385621 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce6c004020 con 0x7fce800adee0 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.065+0000 7fce85e00640 1 -- 172.21.15.121:0/1626385621 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce801f6140 con 0x7fce800adee0 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.065+0000 7fce77400640 1 -- 172.21.15.121:0/1626385621 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c004470 con 0x7fce800adee0 2024-09-17T03:35:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.065+0000 7fce85e00640 1 -- 172.21.15.121:0/1626385621 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce801f6700 con 0x7fce800adee0 2024-09-17T03:35:39.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.066+0000 7fce85e00640 1 -- 172.21.15.121:0/1626385621 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce800742b0 con 0x7fce800adee0 2024-09-17T03:35:39.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.067+0000 7fce77400640 1 -- 172.21.15.121:0/1626385621 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce6c0035f0 con 0x7fce800adee0 2024-09-17T03:35:39.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.068+0000 7fce77400640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce60078b90 0x7fce6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.068+0000 7fce77400640 1 -- 172.21.15.121:0/1626385621 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fce6c09bbb0 con 0x7fce800adee0 2024-09-17T03:35:39.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.069+0000 7fce7ea00640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce60078b90 0x7fce6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.069+0000 7fce7ea00640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce60078b90 0x7fce6007b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fce70034000 tx=0x7fce70004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.073+0000 7fce77400640 1 -- 172.21.15.121:0/1626385621 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce6c063ca0 con 0x7fce800adee0 2024-09-17T03:35:39.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.289+0000 7fce85e00640 1 -- 172.21.15.121:0/1626385621 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce800cd680 con 0x7fce800adee0 2024-09-17T03:35:39.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.290+0000 7fce77400640 1 -- 172.21.15.121:0/1626385621 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5219 (secure 0 0 0) 0x7fce6c0635a0 con 0x7fce800adee0 2024-09-17T03:35:39.290 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:39.290 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":7,"btime":"2024-09-17T03:35:37:420200+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:31.874114+0000","modified":"2024-09-17T03:35:36.922145+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4408":{"gid":4408,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4408,"qdb_cluster":[4408]},"id":1}]} 2024-09-17T03:35:39.290 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 7 2024-09-17T03:35:39.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 -- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce60078b90 msgr2=0x7fce6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce60078b90 0x7fce6007b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fce70034000 tx=0x7fce70004ab0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 -- 172.21.15.121:0/1626385621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce800adee0 msgr2=0x7fce800b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce800adee0 0x7fce800b5890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00ea20 tx=0x7fce6c00eee0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 -- 172.21.15.121:0/1626385621 shutdown_connections 2024-09-17T03:35:39.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce800d0930 0x7fce8014d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce60078b90 0x7fce6007b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce800adee0 0x7fce800b5890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 --2- 172.21.15.121:0/1626385621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce80073ea0 0x7fce800c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 -- 172.21.15.121:0/1626385621 >> 172.21.15.121:0/1626385621 conn(0x7fce800d1140 msgr2=0x7fce8015f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:39.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 -- 172.21.15.121:0/1626385621 shutdown_connections 2024-09-17T03:35:39.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.293+0000 7fce85e00640 1 -- 172.21.15.121:0/1626385621 wait complete. 2024-09-17T03:35:39.314 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:39.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.537+0000 7fd5e6200640 1 -- 172.21.15.121:0/1196821441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5e0073dd0 msgr2=0x7fd5e006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.537+0000 7fd5e6200640 1 --2- 172.21.15.121:0/1196821441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5e0073dd0 0x7fd5e006ddf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc005fd0 tx=0x7fd5cc02a530 comp rx=0 tx=0).stop 2024-09-17T03:35:39.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.537+0000 7fd5e6200640 1 -- 172.21.15.121:0/1196821441 shutdown_connections 2024-09-17T03:35:39.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.537+0000 7fd5e6200640 1 --2- 172.21.15.121:0/1196821441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e006e330 0x7fd5e006ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.537+0000 7fd5e6200640 1 --2- 172.21.15.121:0/1196821441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5e0073dd0 0x7fd5e006ddf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.537+0000 7fd5e6200640 1 -- 172.21.15.121:0/1196821441 >> 172.21.15.121:0/1196821441 conn(0x7fd5e00cca40 msgr2=0x7fd5e00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:39.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.537+0000 7fd5e6200640 1 -- 172.21.15.121:0/1196821441 shutdown_connections 2024-09-17T03:35:39.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.537+0000 7fd5e6200640 1 -- 172.21.15.121:0/1196821441 wait complete. 2024-09-17T03:35:39.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.539+0000 7fd5e6200640 1 Processor -- start 2024-09-17T03:35:39.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.539+0000 7fd5e6200640 1 -- start start 2024-09-17T03:35:39.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5e6200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e006e330 0x7fd5e009b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5e6200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5e0073dd0 0x7fd5e01f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5e6200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e0074cb0 0x7fd5e01f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5e6200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e006f4a0 con 0x7fd5e0073dd0 2024-09-17T03:35:39.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5e6200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e006f320 con 0x7fd5e006e330 2024-09-17T03:35:39.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5e6200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e006f620 con 0x7fd5e0074cb0 2024-09-17T03:35:39.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5dea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5e0073dd0 0x7fd5e01f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5dea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5e0073dd0 0x7fd5e01f7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37536/0 (socket says 172.21.15.121:37536) 2024-09-17T03:35:39.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5dea00640 1 -- 172.21.15.121:0/2202283794 learned_addr learned my addr 172.21.15.121:0/2202283794 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:39.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5dfe00640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e0074cb0 0x7fd5e01f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5df400640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e006e330 0x7fd5e009b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5dea00640 1 -- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e0074cb0 msgr2=0x7fd5e01f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5dea00640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e0074cb0 0x7fd5e01f7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5dea00640 1 -- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e006e330 msgr2=0x7fd5e009b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5dea00640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e006e330 0x7fd5e009b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5dea00640 1 -- 172.21.15.121:0/2202283794 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e01f4210 con 0x7fd5e0073dd0 2024-09-17T03:35:39.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.541+0000 7fd5df400640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e006e330 0x7fd5e009b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:39.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.542+0000 7fd5dea00640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5e0073dd0 0x7fd5e01f7920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc034040 tx=0x7fd5cc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:39.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.542+0000 7fd5d7400640 1 -- 172.21.15.121:0/2202283794 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc03e030 con 0x7fd5e0073dd0 2024-09-17T03:35:39.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.542+0000 7fd5d7400640 1 -- 172.21.15.121:0/2202283794 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5cc003d90 con 0x7fd5e0073dd0 2024-09-17T03:35:39.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.542+0000 7fd5e6200640 1 -- 172.21.15.121:0/2202283794 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e0155d50 con 0x7fd5e0073dd0 2024-09-17T03:35:39.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.542+0000 7fd5d7400640 1 -- 172.21.15.121:0/2202283794 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc035040 con 0x7fd5e0073dd0 2024-09-17T03:35:39.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.542+0000 7fd5e6200640 1 -- 172.21.15.121:0/2202283794 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e0156310 con 0x7fd5e0073dd0 2024-09-17T03:35:39.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.543+0000 7fd5e6200640 1 -- 172.21.15.121:0/2202283794 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e0154840 con 0x7fd5e0073dd0 2024-09-17T03:35:39.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.544+0000 7fd5d7400640 1 -- 172.21.15.121:0/2202283794 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd5cc041030 con 0x7fd5e0073dd0 2024-09-17T03:35:39.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.545+0000 7fd5d7400640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5c0078bc0 0x7fd5c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.545+0000 7fd5d7400640 1 -- 172.21.15.121:0/2202283794 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd5cc0bbbc0 con 0x7fd5e0073dd0 2024-09-17T03:35:39.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.546+0000 7fd5df400640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5c0078bc0 0x7fd5c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.546+0000 7fd5df400640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5c0078bc0 0x7fd5c007b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0006fd0 tx=0x7fd5d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:39.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.550+0000 7fd5d7400640 1 -- 172.21.15.121:0/2202283794 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd5e006e740 con 0x7fd5e0073dd0 2024-09-17T03:35:39.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.733+0000 7fd5e6200640 1 -- 172.21.15.121:0/2202283794 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5e00b5f40 con 0x7fd5e0073dd0 2024-09-17T03:35:39.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.734+0000 7fd5d7400640 1 -- 172.21.15.121:0/2202283794 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18662 (secure 0 0 0) 0x7fd5e00b5f40 con 0x7fd5e0073dd0 2024-09-17T03:35:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:39.734 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:36.921947+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:39.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.736+0000 7fd5e6200640 1 -- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5c0078bc0 msgr2=0x7fd5c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.736+0000 7fd5e6200640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5c0078bc0 0x7fd5c007b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0006fd0 tx=0x7fd5d0008040 comp rx=0 tx=0).stop 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.736+0000 7fd5e6200640 1 -- 172.21.15.121:0/2202283794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5e0073dd0 msgr2=0x7fd5e01f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.736+0000 7fd5e6200640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5e0073dd0 0x7fd5e01f7920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc034040 tx=0x7fd5cc0038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.736+0000 7fd5e6200640 1 -- 172.21.15.121:0/2202283794 shutdown_connections 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.736+0000 7fd5e6200640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e0074cb0 0x7fd5e01f7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.736+0000 7fd5e6200640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5c0078bc0 0x7fd5c007b0d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.736+0000 7fd5e6200640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5e0073dd0 0x7fd5e01f7920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.736+0000 7fd5e6200640 1 --2- 172.21.15.121:0/2202283794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e006e330 0x7fd5e009b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.737+0000 7fd5e6200640 1 -- 172.21.15.121:0/2202283794 >> 172.21.15.121:0/2202283794 conn(0x7fd5e00cca40 msgr2=0x7fd5e0158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.737+0000 7fd5e6200640 1 -- 172.21.15.121:0/2202283794 shutdown_connections 2024-09-17T03:35:39.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:39.737+0000 7fd5e6200640 1 -- 172.21.15.121:0/2202283794 wait complete. 2024-09-17T03:35:40.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:35:31.874114+0000', 'modified': '2024-09-17T03:35:36.922145+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4408}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4408': {'gid': 4408, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6837/25219205', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6835', 'nonce': 25219205}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 25219205}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4408, 'qdb_cluster': [4408]} 2024-09-17T03:35:40.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:35:40.163 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:35:40.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.388+0000 7f8996e00640 1 -- 172.21.15.121:0/2355903542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8974004000 msgr2=0x7f8974004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.388+0000 7f8996e00640 1 --2- 172.21.15.121:0/2355903542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8974004000 0x7f8974004800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f897c001690 tx=0x7f8974005830 comp rx=0 tx=0).stop 2024-09-17T03:35:40.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.388+0000 7f8994e00640 1 -- 172.21.15.121:0/2355903542 reap_dead start 2024-09-17T03:35:40.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.388+0000 7f8996e00640 1 -- 172.21.15.121:0/2355903542 shutdown_connections 2024-09-17T03:35:40.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.388+0000 7f8996e00640 1 -- 172.21.15.121:0/2355903542 >> 172.21.15.121:0/2355903542 conn(0x7f89900b1b90 msgr2=0x7f89900b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.388+0000 7f8996e00640 1 -- 172.21.15.121:0/2355903542 shutdown_connections 2024-09-17T03:35:40.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.388+0000 7f8996e00640 1 -- 172.21.15.121:0/2355903542 wait complete. 2024-09-17T03:35:40.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.391+0000 7f8996e00640 1 Processor -- start 2024-09-17T03:35:40.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.391+0000 7f8996e00640 1 -- start start 2024-09-17T03:35:40.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f8996e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8974004000 0x7f899009e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f8996e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89900a07c0 0x7f89901f8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f8996e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89901f8b40 0x7f89901f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f8996e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8990072f10 con 0x7f8974004000 2024-09-17T03:35:40.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f8996e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8990072d90 con 0x7f89901f8b40 2024-09-17T03:35:40.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f8996e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8990073090 con 0x7f89900a07c0 2024-09-17T03:35:40.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f898fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8974004000 0x7f899009e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f898fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8974004000 0x7f899009e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37552/0 (socket says 172.21.15.121:37552) 2024-09-17T03:35:40.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f898fe00640 1 -- 172.21.15.121:0/1340228962 learned_addr learned my addr 172.21.15.121:0/1340228962 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f898f400640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89900a07c0 0x7f89901f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f8994e00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89901f8b40 0x7f89901f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f898fe00640 1 -- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89900a07c0 msgr2=0x7f89901f8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f898fe00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89900a07c0 0x7f89901f8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f898fe00640 1 -- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89901f8b40 msgr2=0x7f89901f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f898fe00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89901f8b40 0x7f89901f7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.393+0000 7f898fe00640 1 -- 172.21.15.121:0/1340228962 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89900b3f20 con 0x7f8974004000 2024-09-17T03:35:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.394+0000 7f898fe00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8974004000 0x7f899009e340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8980006680 tx=0x7f89800066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.394+0000 7f8987e00640 1 -- 172.21.15.121:0/1340228962 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980015070 con 0x7f8974004000 2024-09-17T03:35:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.394+0000 7f8987e00640 1 -- 172.21.15.121:0/1340228962 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8980011920 con 0x7f8974004000 2024-09-17T03:35:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.394+0000 7f8996e00640 1 -- 172.21.15.121:0/1340228962 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89900a0fa0 con 0x7f8974004000 2024-09-17T03:35:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.394+0000 7f8987e00640 1 -- 172.21.15.121:0/1340228962 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980011d70 con 0x7f8974004000 2024-09-17T03:35:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.394+0000 7f8996e00640 1 -- 172.21.15.121:0/1340228962 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89900b44c0 con 0x7f8974004000 2024-09-17T03:35:40.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.397+0000 7f8987e00640 1 -- 172.21.15.121:0/1340228962 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8980018070 con 0x7f8974004000 2024-09-17T03:35:40.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.398+0000 7f8987e00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8970078b90 0x7f897007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.398+0000 7f8987e00640 1 -- 172.21.15.121:0/1340228962 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f898009bea0 con 0x7f8974004000 2024-09-17T03:35:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.398+0000 7f898f400640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8970078b90 0x7f897007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.398+0000 7f899de7d740 1 Processor -- start 2024-09-17T03:35:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.398+0000 7f899de7d740 1 -- start start 2024-09-17T03:35:40.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.399+0000 7f898f400640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8970078b90 0x7f897007b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f897c032000 tx=0x7f897c001190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.400+0000 7f899de7d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b57270 0x558a60f27970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.400+0000 7f899de7d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b2e3b0 0x558a60f27eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.400+0000 7f899de7d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b36590 0x558a60ef7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.400+0000 7f899de7d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558a60e81430 con 0x558a60b2e3b0 2024-09-17T03:35:40.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.400+0000 7f899de7d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558a60e715d0 con 0x558a60b57270 2024-09-17T03:35:40.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.400+0000 7f899de7d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558a60e60a00 con 0x558a60b36590 2024-09-17T03:35:40.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.400+0000 7f898f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b2e3b0 0x558a60f27eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f898fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b57270 0x558a60f27970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f898fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b57270 0x558a60f27970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:45360/0 (socket says 172.21.15.121:45360) 2024-09-17T03:35:40.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f898fe00640 1 -- 172.21.15.121:0/1493666584 learned_addr learned my addr 172.21.15.121:0/1493666584 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:40.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f8994e00640 1 --2- 172.21.15.121:0/1493666584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b36590 0x558a60ef7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f898f400640 1 -- 172.21.15.121:0/1493666584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b36590 msgr2=0x558a60ef7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f898f400640 1 --2- 172.21.15.121:0/1493666584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b36590 0x558a60ef7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f898f400640 1 -- 172.21.15.121:0/1493666584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b57270 msgr2=0x558a60f27970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f898f400640 1 --2- 172.21.15.121:0/1493666584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b57270 0x558a60f27970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f898f400640 1 -- 172.21.15.121:0/1493666584 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a60e29520 con 0x558a60b2e3b0 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f898fe00640 1 --2- 172.21.15.121:0/1493666584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b57270 0x558a60f27970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.401+0000 7f898f400640 1 --2- 172.21.15.121:0/1493666584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b2e3b0 0x558a60f27eb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f897c004000 tx=0x7f897c03a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c464c24256129b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.402+0000 7f8984c00640 1 -- 172.21.15.121:0/1493666584 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c03d630 con 0x558a60b2e3b0 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.402+0000 7f8984c00640 1 -- 172.21.15.121:0/1493666584 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f897c039040 con 0x558a60b2e3b0 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.402+0000 7f8984c00640 1 -- 172.21.15.121:0/1493666584 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c03db20 con 0x558a60b2e3b0 2024-09-17T03:35:40.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.403+0000 7f899de7d740 1 -- 172.21.15.121:0/1493666584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b2e3b0 msgr2=0x558a60f27eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.403+0000 7f899de7d740 1 --2- 172.21.15.121:0/1493666584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b2e3b0 0x558a60f27eb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f897c004000 tx=0x7f897c03a000 comp rx=0 tx=0).stop 2024-09-17T03:35:40.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.403+0000 7f899de7d740 1 -- 172.21.15.121:0/1493666584 shutdown_connections 2024-09-17T03:35:40.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.403+0000 7f899de7d740 1 --2- 172.21.15.121:0/1493666584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b36590 0x558a60ef7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.403+0000 7f899de7d740 1 --2- 172.21.15.121:0/1493666584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b2e3b0 0x558a60f27eb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.403+0000 7f899de7d740 1 --2- 172.21.15.121:0/1493666584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b57270 0x558a60f27970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.403+0000 7f899de7d740 1 -- 172.21.15.121:0/1493666584 >> 172.21.15.121:0/1493666584 conn(0x558a60b4b3c0 msgr2=0x558a60efd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.403+0000 7f899de7d740 1 -- 172.21.15.121:0/1493666584 shutdown_connections 2024-09-17T03:35:40.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.403+0000 7f899de7d740 1 -- 172.21.15.121:0/1493666584 wait complete. 2024-09-17T03:35:40.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.404+0000 7f899de7d740 1 -- start start 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.404+0000 7f899de7d740 1 Processor -- start 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f899de7d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b2e3b0 0x558a60f3c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f899de7d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b36590 0x558a60f22680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f899de7d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f21490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f899de7d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558a60e07330 con 0x558a60b57270 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f899de7d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558a60e64810 con 0x558a60b36590 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f899de7d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558a60bd1620 con 0x558a60b2e3b0 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f899de7d740 10 client.0 _ll_register_callbacks cb 0x558a60e0c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f8994e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f21490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f8994e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f21490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37566/0 (socket says 172.21.15.121:37566) 2024-09-17T03:35:40.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f8994e00640 1 -- 172.21.15.121:0/356562618 learned_addr learned my addr 172.21.15.121:0/356562618 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f898f400640 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b36590 0x558a60f22680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f898fe00640 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b2e3b0 0x558a60f3c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f8994e00640 1 -- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b2e3b0 msgr2=0x558a60f3c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f8994e00640 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b2e3b0 0x558a60f3c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f8994e00640 1 -- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b36590 msgr2=0x558a60f22680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f8994e00640 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b36590 0x558a60f22680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.406+0000 7f8994e00640 1 -- 172.21.15.121:0/356562618 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a60bc2850 con 0x558a60b57270 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.407+0000 7f8994e00640 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f21490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8988003eb0 tx=0x7f8988004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f08ba782ff35ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.407+0000 7f8979600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.407+0000 7f8979600640 1 -- 172.21.15.121:0/356562618 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988004d20 con 0x558a60b57270 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.407+0000 7f8979600640 1 -- 172.21.15.121:0/356562618 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8988011770 con 0x558a60b57270 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.407+0000 7f899de7d740 1 -- 172.21.15.121:0/356562618 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f897c039040 con 0x558a60b57270 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.407+0000 7f8979600640 1 -- 172.21.15.121:0/356562618 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f8988025050 con 0x558a60b57270 2024-09-17T03:35:40.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.407+0000 7f899de7d740 10 client.4503 fetch_fsmap learned FSMap version 7 2024-09-17T03:35:40.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.407+0000 7f899de7d740 1 -- 172.21.15.121:0/356562618 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x558a60c396b0 con 0x558a60b57270 2024-09-17T03:35:40.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.408+0000 7f8979600640 1 -- 172.21.15.121:0/356562618 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f897c039040 con 0x558a60b57270 2024-09-17T03:35:40.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.408+0000 7f8979600640 1 -- 172.21.15.121:0/356562618 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f8988028020 con 0x558a60b57270 2024-09-17T03:35:40.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.408+0000 7f899de7d740 10 client.4503 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T03:35:40.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.408+0000 7f899de7d740 10 client.4503 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:35:40.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.408+0000 7f899de7d740 20 client.4503 populate_metadata read hostname 'smithi121' 2024-09-17T03:35:40.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.408+0000 7f899de7d740 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x558a60b15e40 0x558a60f54d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.408+0000 7f899de7d740 4 client.4503 mds_command: new command op to 4408 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:40.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.408+0000 7f899de7d740 1 -- 172.21.15.121:0/356562618 --> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a60e73520 con 0x558a60b15e40 2024-09-17T03:35:40.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.408+0000 7f898fe00640 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x558a60b15e40 0x558a60f54d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.409+0000 7f898fe00640 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x558a60b15e40 0x558a60f54d10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99f87a36a85fe261 server_cookie=1fd13912c2af9ac8 in_seq=0 out_seq=0 2024-09-17T03:35:40.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.409+0000 7f8979600640 10 client.4503 ms_handle_connect on v2:172.21.15.176:6835/25219205 2024-09-17T03:35:40.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f8979600640 1 -- 172.21.15.121:0/356562618 <== mds.0 v2:172.21.15.176:6835/25219205 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a60e73520 con 0x558a60b15e40 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f8979600640 10 client.4503 handle_command_reply: tid=0 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 client.4503 shutdown 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 -- 172.21.15.121:0/356562618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 msgr2=0x558a60f21490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f21490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8988003eb0 tx=0x7f8988004410 comp rx=0 tx=0).stop 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 -- 172.21.15.121:0/356562618 shutdown_connections 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x558a60b15e40 0x558a60f54d10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f21490 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b36590 0x558a60f22680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f8979600640 0 client.4503 ms_handle_reset on v2:172.21.15.176:6835/25219205 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 --2- 172.21.15.121:0/356562618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b2e3b0 0x558a60f3c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 -- 172.21.15.121:0/356562618 >> 172.21.15.121:0/356562618 conn(0x558a60b4b3c0 msgr2=0x558a60f1ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 -- 172.21.15.121:0/356562618 shutdown_connections 2024-09-17T03:35:40.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 1 -- 172.21.15.121:0/356562618 wait complete. 2024-09-17T03:35:40.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.410+0000 7f899de7d740 20 client.4503 trim_cache size 0 max 16384 2024-09-17T03:35:40.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.430+0000 7f899de7d740 1 Processor -- start 2024-09-17T03:35:40.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.430+0000 7f899de7d740 1 -- start start 2024-09-17T03:35:40.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.431+0000 7f899de7d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b2e3b0 0x558a60efb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f899de7d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b36590 0x558a60f1eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f899de7d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b57270 0x558a60f65290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f899de7d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8990202770 con 0x558a60b36590 2024-09-17T03:35:40.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f899de7d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89901f5890 con 0x558a60b2e3b0 2024-09-17T03:35:40.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f899de7d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8990202120 con 0x558a60b57270 2024-09-17T03:35:40.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f898f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b36590 0x558a60f1eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f898f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b36590 0x558a60f1eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37574/0 (socket says 172.21.15.121:37574) 2024-09-17T03:35:40.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f898f400640 1 -- 172.21.15.121:0/2889189957 learned_addr learned my addr 172.21.15.121:0/2889189957 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f898f400640 1 -- 172.21.15.121:0/2889189957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b57270 msgr2=0x558a60f65290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f898f400640 1 --2- 172.21.15.121:0/2889189957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b57270 0x558a60f65290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f898f400640 1 -- 172.21.15.121:0/2889189957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b2e3b0 msgr2=0x558a60efb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f898f400640 1 --2- 172.21.15.121:0/2889189957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b2e3b0 0x558a60efb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f898f400640 1 -- 172.21.15.121:0/2889189957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a60f44ad0 con 0x558a60b36590 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.432+0000 7f898f400640 1 --2- 172.21.15.121:0/2889189957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b36590 0x558a60f1eb90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f897c02a910 tx=0x7f897c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01d26be93441487 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.433+0000 7f897be00640 1 -- 172.21.15.121:0/2889189957 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c057070 con 0x558a60b36590 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.433+0000 7f897be00640 1 -- 172.21.15.121:0/2889189957 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f897c02e040 con 0x558a60b36590 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.433+0000 7f897be00640 1 -- 172.21.15.121:0/2889189957 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c03d8c0 con 0x558a60b36590 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.433+0000 7f899de7d740 1 -- 172.21.15.121:0/2889189957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b36590 msgr2=0x558a60f1eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.433+0000 7f899de7d740 1 --2- 172.21.15.121:0/2889189957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b36590 0x558a60f1eb90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f897c02a910 tx=0x7f897c001120 comp rx=0 tx=0).stop 2024-09-17T03:35:40.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.434+0000 7f899de7d740 1 -- 172.21.15.121:0/2889189957 shutdown_connections 2024-09-17T03:35:40.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.434+0000 7f899de7d740 1 --2- 172.21.15.121:0/2889189957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b57270 0x558a60f65290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.434+0000 7f899de7d740 1 --2- 172.21.15.121:0/2889189957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b36590 0x558a60f1eb90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.434+0000 7f899de7d740 1 --2- 172.21.15.121:0/2889189957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b2e3b0 0x558a60efb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.434+0000 7f899de7d740 1 -- 172.21.15.121:0/2889189957 >> 172.21.15.121:0/2889189957 conn(0x558a60b4b3c0 msgr2=0x558a60f3e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.434+0000 7f899de7d740 1 -- 172.21.15.121:0/2889189957 shutdown_connections 2024-09-17T03:35:40.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.434+0000 7f899de7d740 1 -- 172.21.15.121:0/2889189957 wait complete. 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.435+0000 7f899de7d740 1 -- start start 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.435+0000 7f899de7d740 1 Processor -- start 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.436+0000 7f899de7d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b2e3b0 0x558a60f3b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.436+0000 7f899de7d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b36590 0x558a60f3df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.436+0000 7f899de7d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f1f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.436+0000 7f899de7d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558a60f21a70 con 0x558a60b57270 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.436+0000 7f899de7d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558a60f22fd0 con 0x558a60b36590 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.436+0000 7f899de7d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558a60f3cd40 con 0x558a60b2e3b0 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.436+0000 7f899de7d740 10 client.0 _ll_register_callbacks cb 0x7f8988003b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f8994e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f1f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f8994e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f1f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37588/0 (socket says 172.21.15.121:37588) 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f8994e00640 1 -- 172.21.15.121:0/589216535 learned_addr learned my addr 172.21.15.121:0/589216535 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f898fe00640 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b2e3b0 0x558a60f3b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f898f400640 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b36590 0x558a60f3df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f8994e00640 1 -- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b2e3b0 msgr2=0x558a60f3b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f8994e00640 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b2e3b0 0x558a60f3b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f8994e00640 1 -- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b36590 msgr2=0x558a60f3df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f8994e00640 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b36590 0x558a60f3df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f8994e00640 1 -- 172.21.15.121:0/589216535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a60fc2410 con 0x558a60b57270 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f8994e00640 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f1f610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89880094d0 tx=0x7f8988004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517b85dac3351c7c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.437+0000 7f8979600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.438+0000 7f8979600640 1 -- 172.21.15.121:0/589216535 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988005210 con 0x558a60b57270 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.438+0000 7f8979600640 1 -- 172.21.15.121:0/589216535 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8988011e00 con 0x558a60b57270 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.438+0000 7f899de7d740 1 -- 172.21.15.121:0/589216535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f897c02e040 con 0x558a60b57270 2024-09-17T03:35:40.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.438+0000 7f8979600640 1 -- 172.21.15.121:0/589216535 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f8988038050 con 0x558a60b57270 2024-09-17T03:35:40.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.438+0000 7f899de7d740 10 client.4509 fetch_fsmap learned FSMap version 7 2024-09-17T03:35:40.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.438+0000 7f899de7d740 1 -- 172.21.15.121:0/589216535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x558a60f22930 con 0x558a60b57270 2024-09-17T03:35:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.441+0000 7f8979600640 1 -- 172.21.15.121:0/589216535 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f897c02e040 con 0x558a60b57270 2024-09-17T03:35:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.441+0000 7f8979600640 1 -- 172.21.15.121:0/589216535 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f898803b020 con 0x558a60b57270 2024-09-17T03:35:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.441+0000 7f899de7d740 10 client.4509 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T03:35:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.441+0000 7f899de7d740 10 client.4509 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:35:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.441+0000 7f899de7d740 20 client.4509 populate_metadata read hostname 'smithi121' 2024-09-17T03:35:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.441+0000 7f899de7d740 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x558a60f50af0 0x558a60fc5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.441+0000 7f899de7d740 4 client.4509 mds_command: new command op to 4408 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:35:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.441+0000 7f899de7d740 1 -- 172.21.15.121:0/589216535 --> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] -- command(tid 0: {"prefix": "status"}) -- 0x558a60e6efd0 con 0x558a60f50af0 2024-09-17T03:35:40.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.441+0000 7f898fe00640 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x558a60f50af0 0x558a60fc5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f8979600640 10 client.4509 ms_handle_connect on v2:172.21.15.176:6835/25219205 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f898fe00640 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x558a60f50af0 0x558a60fc5620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=474ae83ff081323a server_cookie=7fad8e69380cf235 in_seq=0 out_seq=0 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f8979600640 1 -- 172.21.15.121:0/589216535 <== mds.0 v2:172.21.15.176:6835/25219205 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x558a60e6efd0 con 0x558a60f50af0 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f8979600640 10 client.4509 handle_command_reply: tid=0 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f899de7d740 1 client.4509 shutdown 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f899de7d740 1 -- 172.21.15.121:0/589216535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 msgr2=0x558a60f1f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f899de7d740 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f1f610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89880094d0 tx=0x7f8988004ce0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f899de7d740 1 -- 172.21.15.121:0/589216535 shutdown_connections 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f899de7d740 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x558a60f50af0 0x558a60fc5620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f899de7d740 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a60b57270 0x558a60f1f610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f899de7d740 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558a60b36590 0x558a60f3df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f8979600640 0 client.4509 ms_handle_reset on v2:172.21.15.176:6835/25219205 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f899de7d740 1 --2- 172.21.15.121:0/589216535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558a60b2e3b0 0x558a60f3b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.442+0000 7f899de7d740 1 -- 172.21.15.121:0/589216535 >> 172.21.15.121:0/589216535 conn(0x558a60b4b3c0 msgr2=0x558a60efb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f899de7d740 1 -- 172.21.15.121:0/589216535 shutdown_connections 2024-09-17T03:35:40.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f899de7d740 1 -- 172.21.15.121:0/589216535 wait complete. 2024-09-17T03:35:40.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f899de7d740 20 client.4509 trim_cache size 0 max 16384 2024-09-17T03:35:40.444 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:35:40.444 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:35:40.444 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:35:40.444 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4408, 2024-09-17T03:35:40.444 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:35:40.444 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:35:40.444 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:35:40.445 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 8.0701441099999993, 2024-09-17T03:35:40.445 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 7, 2024-09-17T03:35:40.445 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 26, 2024-09-17T03:35:40.445 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 26, 2024-09-17T03:35:40.445 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 14.085299324999999 2024-09-17T03:35:40.445 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:35:40.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f8996e00640 1 -- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8970078b90 msgr2=0x7f897007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f8996e00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8970078b90 0x7f897007b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f897c032000 tx=0x7f897c001190 comp rx=0 tx=0).stop 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f8996e00640 1 -- 172.21.15.121:0/1340228962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8974004000 msgr2=0x7f899009e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f8996e00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8974004000 0x7f899009e340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8980006680 tx=0x7f89800066b0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f8996e00640 1 -- 172.21.15.121:0/1340228962 shutdown_connections 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f8996e00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89901f8b40 0x7f89901f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f8996e00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89900a07c0 0x7f89901f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f8996e00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8970078b90 0x7f897007b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f8996e00640 1 --2- 172.21.15.121:0/1340228962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8974004000 0x7f899009e340 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.443+0000 7f8996e00640 1 -- 172.21.15.121:0/1340228962 >> 172.21.15.121:0/1340228962 conn(0x7f89900b1b90 msgr2=0x7f89900cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.444+0000 7f8996e00640 1 -- 172.21.15.121:0/1340228962 shutdown_connections 2024-09-17T03:35:40.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.444+0000 7f8996e00640 1 -- 172.21.15.121:0/1340228962 wait complete. 2024-09-17T03:35:40.467 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:35:40.467 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:35:40.467 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:35:40.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.688+0000 7fb1e6600640 1 -- 172.21.15.121:0/2035158407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1c4005250 msgr2=0x7fb1c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.688+0000 7fb1e6600640 1 --2- 172.21.15.121:0/2035158407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1c4005250 0x7fb1c400b9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800c610 tx=0x7fb1c4005830 comp rx=0 tx=0).stop 2024-09-17T03:35:40.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.688+0000 7fb1e6600640 1 -- 172.21.15.121:0/2035158407 shutdown_connections 2024-09-17T03:35:40.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.688+0000 7fb1e6600640 1 --2- 172.21.15.121:0/2035158407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1c4005250 0x7fb1c400b9c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.688+0000 7fb1e6600640 1 -- 172.21.15.121:0/2035158407 >> 172.21.15.121:0/2035158407 conn(0x7fb1e00cca40 msgr2=0x7fb1e00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.688+0000 7fb1e6600640 1 -- 172.21.15.121:0/2035158407 shutdown_connections 2024-09-17T03:35:40.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.688+0000 7fb1e6600640 1 -- 172.21.15.121:0/2035158407 wait complete. 2024-09-17T03:35:40.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.690+0000 7fb1e6600640 1 Processor -- start 2024-09-17T03:35:40.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.691+0000 7fb1e6600640 1 -- start start 2024-09-17T03:35:40.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.692+0000 7fb1e6600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1c4005250 0x7fb1e015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.692+0000 7fb1e6600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e015bce0 0x7fb1e0160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.692+0000 7fb1e6600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1e00b2e10 0x7fb1e01f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.692+0000 7fb1e6600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00af420 con 0x7fb1c4005250 2024-09-17T03:35:40.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.692+0000 7fb1e6600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00cb960 con 0x7fb1e00b2e10 2024-09-17T03:35:40.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.692+0000 7fb1e6600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e00af5a0 con 0x7fb1e015bce0 2024-09-17T03:35:40.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.692+0000 7fb1df400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1c4005250 0x7fb1e015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.692+0000 7fb1df400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1c4005250 0x7fb1e015f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37596/0 (socket says 172.21.15.121:37596) 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.692+0000 7fb1df400640 1 -- 172.21.15.121:0/2707313429 learned_addr learned my addr 172.21.15.121:0/2707313429 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1dea00640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e015bce0 0x7fb1e0160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1dfe00640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1e00b2e10 0x7fb1e01f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1df400640 1 -- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e015bce0 msgr2=0x7fb1e0160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1df400640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e015bce0 0x7fb1e0160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1df400640 1 -- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1e00b2e10 msgr2=0x7fb1e01f80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1df400640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1e00b2e10 0x7fb1e01f80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1df400640 1 -- 172.21.15.121:0/2707313429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e015fdf0 con 0x7fb1c4005250 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1df400640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1c4005250 0x7fb1e015f8b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0003ed0 tx=0x7fb1d0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1d7400640 1 -- 172.21.15.121:0/2707313429 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0015070 con 0x7fb1c4005250 2024-09-17T03:35:40.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1d7400640 1 -- 172.21.15.121:0/2707313429 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1d0011840 con 0x7fb1c4005250 2024-09-17T03:35:40.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1e6600640 1 -- 172.21.15.121:0/2707313429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e00b5330 con 0x7fb1c4005250 2024-09-17T03:35:40.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1d7400640 1 -- 172.21.15.121:0/2707313429 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0011c90 con 0x7fb1c4005250 2024-09-17T03:35:40.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.693+0000 7fb1e6600640 1 -- 172.21.15.121:0/2707313429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e015f0b0 con 0x7fb1c4005250 2024-09-17T03:35:40.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.694+0000 7fb1e6600640 1 -- 172.21.15.121:0/2707313429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e006ddf0 con 0x7fb1c4005250 2024-09-17T03:35:40.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.696+0000 7fb1d7400640 1 -- 172.21.15.121:0/2707313429 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1d0018070 con 0x7fb1c4005250 2024-09-17T03:35:40.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.697+0000 7fb1d7400640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb1c0078bc0 0x7fb1c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.697+0000 7fb1d7400640 1 -- 172.21.15.121:0/2707313429 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb1d009bcd0 con 0x7fb1c4005250 2024-09-17T03:35:40.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.697+0000 7fb1dea00640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb1c0078bc0 0x7fb1c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.698+0000 7fb1dea00640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb1c0078bc0 0x7fb1c007b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0161fb0 tx=0x7fb1cc005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.701+0000 7fb1d7400640 1 -- 172.21.15.121:0/2707313429 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1d0063d30 con 0x7fb1c4005250 2024-09-17T03:35:40.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.920+0000 7fb1e6600640 1 -- 172.21.15.121:0/2707313429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb1e00ca4f0 con 0x7fb1c4005250 2024-09-17T03:35:40.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.921+0000 7fb1d7400640 1 -- 172.21.15.121:0/2707313429 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fb1d0063630 con 0x7fb1c4005250 2024-09-17T03:35:40.920 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T03:35:40.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 -- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb1c0078bc0 msgr2=0x7fb1c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb1c0078bc0 0x7fb1c007b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0161fb0 tx=0x7fb1cc005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:40.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 -- 172.21.15.121:0/2707313429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1c4005250 msgr2=0x7fb1e015f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1c4005250 0x7fb1e015f8b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0003ed0 tx=0x7fb1d0001630 comp rx=0 tx=0).stop 2024-09-17T03:35:40.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 -- 172.21.15.121:0/2707313429 shutdown_connections 2024-09-17T03:35:40.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1e00b2e10 0x7fb1e01f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1e015bce0 0x7fb1e0160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb1c0078bc0 0x7fb1c007b0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 --2- 172.21.15.121:0/2707313429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1c4005250 0x7fb1e015f8b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 -- 172.21.15.121:0/2707313429 >> 172.21.15.121:0/2707313429 conn(0x7fb1e00cca40 msgr2=0x7fb1e015dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 -- 172.21.15.121:0/2707313429 shutdown_connections 2024-09-17T03:35:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:40.923+0000 7fb1e6600640 1 -- 172.21.15.121:0/2707313429 wait complete. 2024-09-17T03:35:40.945 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:35:40.945 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:35:40.945 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:35:40.945 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-17T03:35:40.945 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:35:40.945 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:35:40.945 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:35:40.945 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:35:40.945 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-17T03:35:40.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:40.946 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:35:40.981 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:35:40.982 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:35:40.982 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:35:40.982 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:35:40.982 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:35:40.982 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:35:40.982 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:35:40.982 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42716sec preferred_lft 42716sec 2024-09-17T03:35:40.982 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:35:40.982 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:35:40.983 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T03:35:40.984 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:35:40.984 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:35:40.984 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add name ceph-brx type bridge 2024-09-17T03:35:40.984 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr flush dev ceph-brx 2024-09-17T03:35:40.984 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set ceph-brx up 2024-09-17T03:35:40.984 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T03:35:40.984 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:35:41.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:35:41.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:41.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:41.397 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:35:41.453 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:35:41.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:41.456 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:35:41.511 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:35:41.511 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:35:41.511 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:35:41.511 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:35:41.511 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:35:41.512 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:35:41.512 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:35:41.512 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:35:41.512 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:35:41.512 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:35:41.512 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:35:41.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:35:42.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:42.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:42.107 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:35:42.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:42.143 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-09-17T03:35:42.218 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:35:42.218 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:35:42.218 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:35:42.219 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-17T03:35:42.219 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:35:42.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:35:42.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:42.395 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-17T03:35:42.395 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:35:42.395 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:35:42.396 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-17T03:35:42.396 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T03:35:42.396 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-17T03:35:42.396 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-17T03:35:42.396 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-17T03:35:42.396 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:35:42.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:35:42.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:42.631 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:35:42.631 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:35:42.631 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:35:42.632 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T03:35:42.632 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:35:42.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:35:42.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:42.798 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-17T03:35:42.798 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:35:42.798 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:35:42.833 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-17T03:35:42.833 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:35:42.834 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:35:42.908 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-17T03:35:43.004 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T03:35:43.043 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-17T03:35:43.043 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-17T03:35:43.043 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-17T03:35:43.043 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-17T03:35:43.043 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-17T03:35:43.043 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-17T03:35:43.043 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-17T03:35:43.043 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-17T03:35:43.043 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-17T03:35:43.043 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T03:35:43.044 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T03:35:43.045 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T03:35:43.045 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-17T03:35:43.045 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-17T03:35:43.045 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T03:35:43.045 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T03:35:43.045 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T03:35:43.045 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T03:35:43.045 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-17T03:35:43.045 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:35:43.045 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:35:43.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:43.046 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-17T03:35:43.121 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T03:35:43.122 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-17T03:35:43.165 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-17T03:35:43.222 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T03:35:43.259 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-17T03:35:43.259 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-17T03:35:43.259 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-17T03:35:43.259 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-17T03:35:43.259 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-17T03:35:43.259 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-17T03:35:43.259 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-17T03:35:43.260 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:35:43.261 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:35:43.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:43.262 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-17T03:35:43.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi121.stderr:2024-09-17T03:35:43.417+0000 7fd51f8ef480 -1 init, newargv = 0x55fc88a31f60 newargc=15 2024-09-17T03:35:43.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi121.stderr:ceph-fuse[43040]: starting ceph client 2024-09-17T03:35:43.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi121.stderr:ceph-fuse[43040]: starting fuse 2024-09-17T03:35:44.441 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-17T03:35:44.502 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T03:35:44.539 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-17T03:35:44.539 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-17T03:35:44.539 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-17T03:35:44.539 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-17T03:35:44.540 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-17T03:35:44.540 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-17T03:35:44.540 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-17T03:35:44.540 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-17T03:35:44.540 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-17T03:35:44.540 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-17T03:35:44.540 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-17T03:35:44.540 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-17T03:35:44.540 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-17T03:35:44.541 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T03:35:44.542 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T03:35:44.542 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T03:35:44.542 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T03:35:44.542 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-17T03:35:44.542 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:35:44.542 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:35:44.542 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-17T03:35:44.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:44.543 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-17T03:35:44.618 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-17T03:35:44.619 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-17T03:35:44.619 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-17T03:35:44.620 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.admin")) 2024-09-17T03:35:44.621 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-17T03:35:44.780 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.admin.43040.asok 2024-09-17T03:35:44.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:44.795 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43040.asok 2024-09-17T03:35:44.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:44.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43040.asok status 2024-09-17T03:35:45.038 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "ce1b342bf8c6349a8c90cd607f83bff2443f21cf", 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)", 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "admin", 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "43040", 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-17T03:35:45.039 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4524, 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4524 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3260237807 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-17T03:35:45.040 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3260237807 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4524 192.168.0.1:0/3260237807", 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.1:0/3260237807", 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 7, 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 26, 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-17T03:35:45.041 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:35:45.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:45.056 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-17T03:35:45.056 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:35:45.092 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-17T03:35:45.092 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:35:45.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:45.092 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:35:45.190 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-17T03:35:45.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:35:45.299 INFO:teuthology.orchestra.run.smithi121.stdout:# file: . 2024-09-17T03:35:45.300 INFO:teuthology.orchestra.run.smithi121.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-17T03:35:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:45.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:45.308 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:35:45.308 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:45.344 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:35:45.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.604+0000 7f56ea600640 1 -- 172.21.15.121:0/1974370681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56e40af5b0 msgr2=0x7f56e406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.604+0000 7f56ea600640 1 --2- 172.21.15.121:0/1974370681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56e40af5b0 0x7f56e406ddf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f56e4075240 tx=0x7f56cc02a560 comp rx=0 tx=0).stop 2024-09-17T03:35:45.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.605+0000 7f56ea600640 1 -- 172.21.15.121:0/1974370681 shutdown_connections 2024-09-17T03:35:45.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.605+0000 7f56ea600640 1 --2- 172.21.15.121:0/1974370681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56e406e330 0x7f56e40ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.605+0000 7f56ea600640 1 --2- 172.21.15.121:0/1974370681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56e40af5b0 0x7f56e406ddf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.605+0000 7f56ea600640 1 --2- 172.21.15.121:0/1974370681 >> v2:172.21.15.176:3300/0 conn(0x7f56e40cc530 0x7f56e415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.605+0000 7f56ea600640 1 -- 172.21.15.121:0/1974370681 >> 172.21.15.121:0/1974370681 conn(0x7f56e40b1b90 msgr2=0x7f56e40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.605+0000 7f56ea600640 1 -- 172.21.15.121:0/1974370681 shutdown_connections 2024-09-17T03:35:45.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.605+0000 7f56ea600640 1 -- 172.21.15.121:0/1974370681 wait complete. 2024-09-17T03:35:45.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.607+0000 7f56ea600640 1 Processor -- start 2024-09-17T03:35:45.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.607+0000 7f56ea600640 1 -- start start 2024-09-17T03:35:45.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.608+0000 7f56ea600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56e406e330 0x7f56e4155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.608+0000 7f56ea600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56e40af5b0 0x7f56e40b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.608+0000 7f56ea600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56e40cc530 0x7f56e40b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56ea600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f56e40cadb0 con 0x7f56e40af5b0 2024-09-17T03:35:45.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56ea600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f56e40cac30 con 0x7f56e406e330 2024-09-17T03:35:45.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56ea600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f56e40caf30 con 0x7f56e40cc530 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56daa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56e40af5b0 0x7f56e40b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56daa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56e40af5b0 0x7f56e40b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41904/0 (socket says 172.21.15.121:41904) 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56daa00640 1 -- 172.21.15.121:0/2609949279 learned_addr learned my addr 172.21.15.121:0/2609949279 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56e3400640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56e406e330 0x7f56e4155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56e3e00640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56e40cc530 0x7f56e40b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56daa00640 1 -- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56e40cc530 msgr2=0x7f56e40b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56daa00640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56e40cc530 0x7f56e40b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56daa00640 1 -- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56e406e330 msgr2=0x7f56e4155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56daa00640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56e406e330 0x7f56e4155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.609+0000 7f56daa00640 1 -- 172.21.15.121:0/2609949279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e409e1b0 con 0x7f56e40af5b0 2024-09-17T03:35:45.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.610+0000 7f56daa00640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56e40af5b0 0x7f56e40b50a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f56cc034040 tx=0x7f56cc003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.610+0000 7f56dbe00640 1 -- 172.21.15.121:0/2609949279 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc03e030 con 0x7f56e40af5b0 2024-09-17T03:35:45.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.610+0000 7f56dbe00640 1 -- 172.21.15.121:0/2609949279 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56cc003e00 con 0x7f56e40af5b0 2024-09-17T03:35:45.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.610+0000 7f56dbe00640 1 -- 172.21.15.121:0/2609949279 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc035040 con 0x7f56e40af5b0 2024-09-17T03:35:45.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.610+0000 7f56ea600640 1 -- 172.21.15.121:0/2609949279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e409e490 con 0x7f56e40af5b0 2024-09-17T03:35:45.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.610+0000 7f56ea600640 1 -- 172.21.15.121:0/2609949279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e409ea50 con 0x7f56e40af5b0 2024-09-17T03:35:45.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.611+0000 7f56ea600640 1 -- 172.21.15.121:0/2609949279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e40cb450 con 0x7f56e40af5b0 2024-09-17T03:35:45.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.613+0000 7f56dbe00640 1 -- 172.21.15.121:0/2609949279 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f56cc041030 con 0x7f56e40af5b0 2024-09-17T03:35:45.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.613+0000 7f56dbe00640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f56c0078b90 0x7f56c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.614+0000 7f56dbe00640 1 -- 172.21.15.121:0/2609949279 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f56cc0bb8a0 con 0x7f56e40af5b0 2024-09-17T03:35:45.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.614+0000 7f56e3400640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f56c0078b90 0x7f56c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.615+0000 7f56e3400640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f56c0078b90 0x7f56c007b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56d400bb50 tx=0x7f56d400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.618+0000 7f56dbe00640 1 -- 172.21.15.121:0/2609949279 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f56cc0832b0 con 0x7f56e40af5b0 2024-09-17T03:35:45.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.812+0000 7f56ea600640 1 -- 172.21.15.121:0/2609949279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f56e4070c60 con 0x7f56e40af5b0 2024-09-17T03:35:45.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.812+0000 7f56dbe00640 1 -- 172.21.15.121:0/2609949279 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f56cc087ce0 con 0x7f56e40af5b0 2024-09-17T03:35:45.812 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:35:45.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 -- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f56c0078b90 msgr2=0x7f56c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f56c0078b90 0x7f56c007b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56d400bb50 tx=0x7f56d400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 -- 172.21.15.121:0/2609949279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56e40af5b0 msgr2=0x7f56e40b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56e40af5b0 0x7f56e40b50a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f56cc034040 tx=0x7f56cc003910 comp rx=0 tx=0).stop 2024-09-17T03:35:45.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 -- 172.21.15.121:0/2609949279 shutdown_connections 2024-09-17T03:35:45.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56e40cc530 0x7f56e40b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f56c0078b90 0x7f56c007b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56e40af5b0 0x7f56e40b50a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 --2- 172.21.15.121:0/2609949279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56e406e330 0x7f56e4155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 -- 172.21.15.121:0/2609949279 >> 172.21.15.121:0/2609949279 conn(0x7f56e40b1b90 msgr2=0x7f56e406fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 -- 172.21.15.121:0/2609949279 shutdown_connections 2024-09-17T03:35:45.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:45.815+0000 7f56ea600640 1 -- 172.21.15.121:0/2609949279 wait complete. 2024-09-17T03:35:45.835 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:35:45.836 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:45.871 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:35:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.132+0000 7f58c4c00640 1 -- 172.21.15.121:0/2814631451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c00ccc40 msgr2=0x7f58c015ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.132+0000 7f58c4c00640 1 --2- 172.21.15.121:0/2814631451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c00ccc40 0x7f58c015ca90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f58c00cd050 tx=0x7f58b002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.133+0000 7f58c4c00640 1 -- 172.21.15.121:0/2814631451 shutdown_connections 2024-09-17T03:35:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.133+0000 7f58c4c00640 1 --2- 172.21.15.121:0/2814631451 >> v2:172.21.15.176:3300/0 conn(0x7f58c00d0d80 0x7f58c00b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.133+0000 7f58c4c00640 1 --2- 172.21.15.121:0/2814631451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c00ccc40 0x7f58c015ca90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.133+0000 7f58c4c00640 1 -- 172.21.15.121:0/2814631451 >> 172.21.15.121:0/2814631451 conn(0x7f58c00b46e0 msgr2=0x7f58c00d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.133+0000 7f58c4c00640 1 -- 172.21.15.121:0/2814631451 shutdown_connections 2024-09-17T03:35:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.133+0000 7f58c4c00640 1 -- 172.21.15.121:0/2814631451 wait complete. 2024-09-17T03:35:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.135+0000 7f58c4c00640 1 Processor -- start 2024-09-17T03:35:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.135+0000 7f58c4c00640 1 -- start start 2024-09-17T03:35:46.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.136+0000 7f58c4c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c00ccc40 0x7f58c01f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.136+0000 7f58c4c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c00cd440 0x7f58c01f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.136+0000 7f58c4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c01f8920 0x7f58c00c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.136+0000 7f58c4c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f58c00b6650 con 0x7f58c00cd440 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.136+0000 7f58c4c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f58c00b64d0 con 0x7f58c01f8920 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.136+0000 7f58c4c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f58c00b67d0 con 0x7f58c00ccc40 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58b7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c00cd440 0x7f58c01f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58bde00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c00ccc40 0x7f58c01f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58b7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c00cd440 0x7f58c01f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41934/0 (socket says 172.21.15.121:41934) 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58b7e00640 1 -- 172.21.15.121:0/1797606288 learned_addr learned my addr 172.21.15.121:0/1797606288 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58be800640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c01f8920 0x7f58c00c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58b7e00640 1 -- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c00ccc40 msgr2=0x7f58c01f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58b7e00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c00ccc40 0x7f58c01f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58b7e00640 1 -- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c01f8920 msgr2=0x7f58c00c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58b7e00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c01f8920 0x7f58c00c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58b7e00640 1 -- 172.21.15.121:0/1797606288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c0070c50 con 0x7f58c00cd440 2024-09-17T03:35:46.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.137+0000 7f58b7e00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c00cd440 0x7f58c01f2770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f58a800c400 tx=0x7f58a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.138+0000 7f58b6000640 1 -- 172.21.15.121:0/1797606288 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8011790 con 0x7f58c00cd440 2024-09-17T03:35:46.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.138+0000 7f58b6000640 1 -- 172.21.15.121:0/1797606288 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58a8017070 con 0x7f58c00cd440 2024-09-17T03:35:46.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.138+0000 7f58b6000640 1 -- 172.21.15.121:0/1797606288 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8011ce0 con 0x7f58c00cd440 2024-09-17T03:35:46.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.138+0000 7f58c4c00640 1 -- 172.21.15.121:0/1797606288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c01f9490 con 0x7f58c00cd440 2024-09-17T03:35:46.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.138+0000 7f58c4c00640 1 -- 172.21.15.121:0/1797606288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c01f5680 con 0x7f58c00cd440 2024-09-17T03:35:46.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.139+0000 7f58c4c00640 1 -- 172.21.15.121:0/1797606288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c00b74b0 con 0x7f58c00cd440 2024-09-17T03:35:46.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.140+0000 7f58b6000640 1 -- 172.21.15.121:0/1797606288 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58a801c460 con 0x7f58c00cd440 2024-09-17T03:35:46.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.141+0000 7f58b6000640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f589c078bc0 0x7f589c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.141+0000 7f58b6000640 1 -- 172.21.15.121:0/1797606288 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f58a809ace0 con 0x7f58c00cd440 2024-09-17T03:35:46.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.141+0000 7f58bde00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f589c078bc0 0x7f589c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.142+0000 7f58bde00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f589c078bc0 0x7f589c07b0d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58b0034000 tx=0x7f58b0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.145+0000 7f58b6000640 1 -- 172.21.15.121:0/1797606288 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f58a80626f0 con 0x7f58c00cd440 2024-09-17T03:35:46.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.338+0000 7f58c4c00640 1 -- 172.21.15.121:0/1797606288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f58c01f9220 con 0x7f58c00cd440 2024-09-17T03:35:46.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.339+0000 7f58b6000640 1 -- 172.21.15.121:0/1797606288 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f58a8067120 con 0x7f58c00cd440 2024-09-17T03:35:46.339 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:35:46.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 -- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f589c078bc0 msgr2=0x7f589c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f589c078bc0 0x7f589c07b0d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f58b0034000 tx=0x7f58b0004730 comp rx=0 tx=0).stop 2024-09-17T03:35:46.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 -- 172.21.15.121:0/1797606288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c00cd440 msgr2=0x7f58c01f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c00cd440 0x7f58c01f2770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f58a800c400 tx=0x7f58a800c8c0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 -- 172.21.15.121:0/1797606288 shutdown_connections 2024-09-17T03:35:46.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c01f8920 0x7f58c00c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f589c078bc0 0x7f589c07b0d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c00cd440 0x7f58c01f2770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 --2- 172.21.15.121:0/1797606288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c00ccc40 0x7f58c01f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 -- 172.21.15.121:0/1797606288 >> 172.21.15.121:0/1797606288 conn(0x7f58c00b46e0 msgr2=0x7f58c015bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 -- 172.21.15.121:0/1797606288 shutdown_connections 2024-09-17T03:35:46.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:46.341+0000 7f58c4c00640 1 -- 172.21.15.121:0/1797606288 wait complete. 2024-09-17T03:35:46.364 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-17T03:35:46.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:46.365 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-17T03:35:46.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi121.stderr:ceph-fuse[43040]: fuse finished with error 0 and tester_r 0 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:35:50.811 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:35:50.816 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:35:52.523 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:35:52.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:52.523 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-17T03:35:52.575 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:52.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.804+0000 7fd804c00640 1 -- 172.21.15.121:0/3783993151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7e40051a0 msgr2=0x7fd7e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.804+0000 7fd804c00640 1 --2- 172.21.15.121:0/3783993151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7e40051a0 0x7fd7e400b9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009ed0 tx=0x7fd7e4005830 comp rx=0 tx=0).stop 2024-09-17T03:35:52.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.804+0000 7fd7ffe00640 1 -- 172.21.15.121:0/3783993151 reap_dead start 2024-09-17T03:35:52.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.804+0000 7fd804c00640 1 -- 172.21.15.121:0/3783993151 shutdown_connections 2024-09-17T03:35:52.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.804+0000 7fd804c00640 1 -- 172.21.15.121:0/3783993151 >> 172.21.15.121:0/3783993151 conn(0x7fd80006f940 msgr2=0x7fd8000b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:52.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.804+0000 7fd804c00640 1 -- 172.21.15.121:0/3783993151 shutdown_connections 2024-09-17T03:35:52.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.804+0000 7fd804c00640 1 -- 172.21.15.121:0/3783993151 wait complete. 2024-09-17T03:35:52.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.806+0000 7fd804c00640 1 Processor -- start 2024-09-17T03:35:52.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.806+0000 7fd804c00640 1 -- start start 2024-09-17T03:35:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd804c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8000cbb80 0x7fd8001e92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd804c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8001e9810 0x7fd8001f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd804c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8001f8fc0 0x7fd8001f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd804c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd8000b4fb0 con 0x7fd8001e9810 2024-09-17T03:35:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd804c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd8000b4e30 con 0x7fd8000cbb80 2024-09-17T03:35:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd804c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd8000b5130 con 0x7fd8001f8fc0 2024-09-17T03:35:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd7fea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8001e9810 0x7fd8001f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd7fea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8001e9810 0x7fd8001f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45792/0 (socket says 172.21.15.121:45792) 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd7fea00640 1 -- 172.21.15.121:0/3722653193 learned_addr learned my addr 172.21.15.121:0/3722653193 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd7ffe00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8001f8fc0 0x7fd8001f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd7ff400640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8000cbb80 0x7fd8001e92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd7fea00640 1 -- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8001f8fc0 msgr2=0x7fd8001f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd7fea00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8001f8fc0 0x7fd8001f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd7fea00640 1 -- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8000cbb80 msgr2=0x7fd8001e92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd7fea00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8000cbb80 0x7fd8001e92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.808+0000 7fd7fea00640 1 -- 172.21.15.121:0/3722653193 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8001e9d70 con 0x7fd8001e9810 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.809+0000 7fd7ffe00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8001f8fc0 0x7fd8001f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.809+0000 7fd7ff400640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8000cbb80 0x7fd8001e92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:52.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.809+0000 7fd7fea00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8001e9810 0x7fd8001f8a80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec006fd0 tx=0x7fd7ec003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:52.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.809+0000 7fd7f7400640 1 -- 172.21.15.121:0/3722653193 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec015070 con 0x7fd8001e9810 2024-09-17T03:35:52.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.809+0000 7fd7f7400640 1 -- 172.21.15.121:0/3722653193 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7ec011920 con 0x7fd8001e9810 2024-09-17T03:35:52.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.809+0000 7fd7f7400640 1 -- 172.21.15.121:0/3722653193 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec011d70 con 0x7fd8001e9810 2024-09-17T03:35:52.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.809+0000 7fd804c00640 1 -- 172.21.15.121:0/3722653193 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8001ea050 con 0x7fd8001e9810 2024-09-17T03:35:52.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.809+0000 7fd804c00640 1 -- 172.21.15.121:0/3722653193 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8001ea610 con 0x7fd8001e9810 2024-09-17T03:35:52.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.810+0000 7fd804c00640 1 -- 172.21.15.121:0/3722653193 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8000cc8d0 con 0x7fd8001e9810 2024-09-17T03:35:52.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.811+0000 7fd7f7400640 1 -- 172.21.15.121:0/3722653193 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7ec018070 con 0x7fd8001e9810 2024-09-17T03:35:52.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.812+0000 7fd7f7400640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd7e0078b90 0x7fd7e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.812+0000 7fd7f7400640 1 -- 172.21.15.121:0/3722653193 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd7ec09be10 con 0x7fd8001e9810 2024-09-17T03:35:52.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.813+0000 7fd7ff400640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd7e0078b90 0x7fd7e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.814+0000 7fd7ff400640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd7e0078b90 0x7fd7e007b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0000c00 tx=0x7fd7f0006b10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:52.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:52.822+0000 7fd7f7400640 1 -- 172.21.15.121:0/3722653193 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7ec09f030 con 0x7fd8001e9810 2024-09-17T03:35:53.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.014+0000 7fd804c00640 1 -- 172.21.15.121:0/3722653193 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8000ce140 con 0x7fd8001e9810 2024-09-17T03:35:53.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.016+0000 7fd7f7400640 1 -- 172.21.15.121:0/3722653193 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18662 (secure 0 0 0) 0x7fd7ec063f90 con 0x7fd8001e9810 2024-09-17T03:35:53.016 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:53.016 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:36.921947+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:53.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 -- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd7e0078b90 msgr2=0x7fd7e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd7e0078b90 0x7fd7e007b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0000c00 tx=0x7fd7f0006b10 comp rx=0 tx=0).stop 2024-09-17T03:35:53.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 -- 172.21.15.121:0/3722653193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8001e9810 msgr2=0x7fd8001f8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8001e9810 0x7fd8001f8a80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec006fd0 tx=0x7fd7ec003aa0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 -- 172.21.15.121:0/3722653193 shutdown_connections 2024-09-17T03:35:53.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8001f8fc0 0x7fd8001f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd7e0078b90 0x7fd7e007b0a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8001e9810 0x7fd8001f8a80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 --2- 172.21.15.121:0/3722653193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8000cbb80 0x7fd8001e92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 -- 172.21.15.121:0/3722653193 >> 172.21.15.121:0/3722653193 conn(0x7fd80006f940 msgr2=0x7fd80015e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 -- 172.21.15.121:0/3722653193 shutdown_connections 2024-09-17T03:35:53.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.018+0000 7fd804c00640 1 -- 172.21.15.121:0/3722653193 wait complete. 2024-09-17T03:35:53.043 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:53.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.262+0000 7f9aa6200640 1 -- 172.21.15.121:0/1788853473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa0074cb0 msgr2=0x7f9aa0073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.262+0000 7f9aa6200640 1 --2- 172.21.15.121:0/1788853473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa0074cb0 0x7f9aa0073dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009830 tx=0x7f9a9002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.262+0000 7f9aa6200640 1 -- 172.21.15.121:0/1788853473 shutdown_connections 2024-09-17T03:35:53.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.262+0000 7f9aa6200640 1 --2- 172.21.15.121:0/1788853473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa0074cb0 0x7f9aa0073dd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.262+0000 7f9aa6200640 1 -- 172.21.15.121:0/1788853473 >> 172.21.15.121:0/1788853473 conn(0x7f9aa00cca40 msgr2=0x7f9aa00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.262+0000 7f9aa6200640 1 -- 172.21.15.121:0/1788853473 shutdown_connections 2024-09-17T03:35:53.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.262+0000 7f9aa6200640 1 -- 172.21.15.121:0/1788853473 wait complete. 2024-09-17T03:35:53.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.265+0000 7f9aa6200640 1 Processor -- start 2024-09-17T03:35:53.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.265+0000 7f9aa6200640 1 -- start start 2024-09-17T03:35:53.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.266+0000 7f9aa6200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9aa0074cb0 0x7f9aa0156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.266+0000 7f9aa6200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa00cbc10 0x7f9aa00b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.266+0000 7f9aa6200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa01572b0 0x7f9aa00b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.266+0000 7f9aa6200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa006f670 con 0x7f9aa0074cb0 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.266+0000 7f9aa6200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa006f4f0 con 0x7f9aa01572b0 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.266+0000 7f9aa6200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa006f7f0 con 0x7f9aa00cbc10 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.266+0000 7f9a9f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9aa0074cb0 0x7f9aa0156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.266+0000 7f9a9f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9aa0074cb0 0x7f9aa0156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45798/0 (socket says 172.21.15.121:45798) 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.266+0000 7f9a9f400640 1 -- 172.21.15.121:0/2775058348 learned_addr learned my addr 172.21.15.121:0/2775058348 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.267+0000 7f9a96a00640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa00cbc10 0x7f9aa00b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.267+0000 7f9a9fe00640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa01572b0 0x7f9aa00b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.267+0000 7f9a9f400640 1 -- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa00cbc10 msgr2=0x7f9aa00b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.267+0000 7f9a9f400640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa00cbc10 0x7f9aa00b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.267+0000 7f9a9f400640 1 -- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa01572b0 msgr2=0x7f9aa00b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.267+0000 7f9a9f400640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa01572b0 0x7f9aa00b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.267+0000 7f9a9f400640 1 -- 172.21.15.121:0/2775058348 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa00b2fb0 con 0x7f9aa0074cb0 2024-09-17T03:35:53.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.267+0000 7f9a9f400640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9aa0074cb0 0x7f9aa0156970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9a90000c00 tx=0x7f9a90033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.268+0000 7f9a97e00640 1 -- 172.21.15.121:0/2775058348 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90031d60 con 0x7f9aa0074cb0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.268+0000 7f9a97e00640 1 -- 172.21.15.121:0/2775058348 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a90033e10 con 0x7f9aa0074cb0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.268+0000 7f9a97e00640 1 -- 172.21.15.121:0/2775058348 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90033310 con 0x7f9aa0074cb0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.268+0000 7f9aa6200640 1 -- 172.21.15.121:0/2775058348 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa00b3290 con 0x7f9aa0074cb0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.268+0000 7f9aa6200640 1 -- 172.21.15.121:0/2775058348 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa00b3850 con 0x7f9aa0074cb0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.269+0000 7f9aa6200640 1 -- 172.21.15.121:0/2775058348 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa0073dd0 con 0x7f9aa0074cb0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.270+0000 7f9a97e00640 1 -- 172.21.15.121:0/2775058348 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a900334b0 con 0x7f9aa0074cb0 2024-09-17T03:35:53.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.271+0000 7f9a97e00640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9a7c078b90 0x7f9a7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.271+0000 7f9a97e00640 1 -- 172.21.15.121:0/2775058348 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9a900bc460 con 0x7f9aa0074cb0 2024-09-17T03:35:53.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.271+0000 7f9a96a00640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9a7c078b90 0x7f9a7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.272+0000 7f9a96a00640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9a7c078b90 0x7f9a7c07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00a11e0 tx=0x7f9a88007cc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.276+0000 7f9a97e00640 1 -- 172.21.15.121:0/2775058348 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a9003f030 con 0x7f9aa0074cb0 2024-09-17T03:35:53.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.459+0000 7f9aa6200640 1 -- 172.21.15.121:0/2775058348 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9aa00cf250 con 0x7f9aa0074cb0 2024-09-17T03:35:53.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.461+0000 7f9a97e00640 1 -- 172.21.15.121:0/2775058348 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18662 (secure 0 0 0) 0x7f9a90084550 con 0x7f9aa0074cb0 2024-09-17T03:35:53.461 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:53.461 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:36.921947+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:53.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 -- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9a7c078b90 msgr2=0x7f9a7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9a7c078b90 0x7f9a7c07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00a11e0 tx=0x7f9a88007cc0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 -- 172.21.15.121:0/2775058348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9aa0074cb0 msgr2=0x7f9aa0156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9aa0074cb0 0x7f9aa0156970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9a90000c00 tx=0x7f9a90033c20 comp rx=0 tx=0).stop 2024-09-17T03:35:53.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 -- 172.21.15.121:0/2775058348 shutdown_connections 2024-09-17T03:35:53.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa01572b0 0x7f9aa00b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa00cbc10 0x7f9aa00b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9a7c078b90 0x7f9a7c07b0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 --2- 172.21.15.121:0/2775058348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9aa0074cb0 0x7f9aa0156970 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 -- 172.21.15.121:0/2775058348 >> 172.21.15.121:0/2775058348 conn(0x7f9aa00cca40 msgr2=0x7f9aa00ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.463+0000 7f9aa6200640 1 -- 172.21.15.121:0/2775058348 shutdown_connections 2024-09-17T03:35:53.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.464+0000 7f9aa6200640 1 -- 172.21.15.121:0/2775058348 wait complete. 2024-09-17T03:35:53.488 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:35:53.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.713+0000 7fc873800640 1 -- 172.21.15.121:0/787969828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc86c15fc50 msgr2=0x7fc86c06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.713+0000 7fc873800640 1 --2- 172.21.15.121:0/787969828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc86c15fc50 0x7fc86c06ddf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0ca680 tx=0x7fc85c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.713+0000 7fc873800640 1 -- 172.21.15.121:0/787969828 shutdown_connections 2024-09-17T03:35:53.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.713+0000 7fc873800640 1 --2- 172.21.15.121:0/787969828 >> v2:172.21.15.176:3300/0 conn(0x7fc86c06e330 0x7fc86c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.713+0000 7fc873800640 1 --2- 172.21.15.121:0/787969828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc86c15fc50 0x7fc86c06ddf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.713+0000 7fc873800640 1 -- 172.21.15.121:0/787969828 >> 172.21.15.121:0/787969828 conn(0x7fc86c0b1b90 msgr2=0x7fc86c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.713+0000 7fc873800640 1 -- 172.21.15.121:0/787969828 shutdown_connections 2024-09-17T03:35:53.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.713+0000 7fc873800640 1 -- 172.21.15.121:0/787969828 wait complete. 2024-09-17T03:35:53.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.715+0000 7fc873800640 1 Processor -- start 2024-09-17T03:35:53.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.715+0000 7fc873800640 1 -- start start 2024-09-17T03:35:53.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc873800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc86c06e330 0x7fc86c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc873800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc86c0cf7d0 0x7fc86c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc873800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc86c15fc50 0x7fc86c0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc873800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c070d20 con 0x7fc86c06e330 2024-09-17T03:35:53.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc873800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c070ba0 con 0x7fc86c0cf7d0 2024-09-17T03:35:53.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc873800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc86c0734a0 con 0x7fc86c15fc50 2024-09-17T03:35:53.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc870e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc86c06e330 0x7fc86c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc870e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc86c06e330 0x7fc86c15af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45820/0 (socket says 172.21.15.121:45820) 2024-09-17T03:35:53.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc870e00640 1 -- 172.21.15.121:0/22118207 learned_addr learned my addr 172.21.15.121:0/22118207 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:53.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc863e00640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc86c0cf7d0 0x7fc86c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc871800640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc86c15fc50 0x7fc86c0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc870e00640 1 -- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc86c15fc50 msgr2=0x7fc86c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc870e00640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc86c15fc50 0x7fc86c0b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc870e00640 1 -- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc86c0cf7d0 msgr2=0x7fc86c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc870e00640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc86c0cf7d0 0x7fc86c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc870e00640 1 -- 172.21.15.121:0/22118207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86c09ffb0 con 0x7fc86c06e330 2024-09-17T03:35:53.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.717+0000 7fc863e00640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc86c0cf7d0 0x7fc86c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:53.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.718+0000 7fc870e00640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc86c06e330 0x7fc86c15af70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc85c034040 tx=0x7fc85c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.718+0000 7fc869600640 1 -- 172.21.15.121:0/22118207 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c03e030 con 0x7fc86c06e330 2024-09-17T03:35:53.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.718+0000 7fc869600640 1 -- 172.21.15.121:0/22118207 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc85c003d10 con 0x7fc86c06e330 2024-09-17T03:35:53.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.718+0000 7fc869600640 1 -- 172.21.15.121:0/22118207 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c035040 con 0x7fc86c06e330 2024-09-17T03:35:53.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.718+0000 7fc873800640 1 -- 172.21.15.121:0/22118207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86c0a0290 con 0x7fc86c06e330 2024-09-17T03:35:53.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.718+0000 7fc873800640 1 -- 172.21.15.121:0/22118207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc86c0c3bd0 con 0x7fc86c06e330 2024-09-17T03:35:53.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.719+0000 7fc873800640 1 -- 172.21.15.121:0/22118207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc86c0739c0 con 0x7fc86c06e330 2024-09-17T03:35:53.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.720+0000 7fc869600640 1 -- 172.21.15.121:0/22118207 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc85c041030 con 0x7fc86c06e330 2024-09-17T03:35:53.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.721+0000 7fc869600640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc848078b90 0x7fc84807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.721+0000 7fc869600640 1 -- 172.21.15.121:0/22118207 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc85c0bb7e0 con 0x7fc86c06e330 2024-09-17T03:35:53.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.722+0000 7fc863e00640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc848078b90 0x7fc84807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.723+0000 7fc863e00640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc848078b90 0x7fc84807b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0aeff0 tx=0x7fc854005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.726+0000 7fc869600640 1 -- 172.21.15.121:0/22118207 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc85c0838d0 con 0x7fc86c06e330 2024-09-17T03:35:53.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:53.943+0000 7fc873800640 1 -- 172.21.15.121:0/22118207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc86c070880 con 0x7fc86c06e330 2024-09-17T03:35:54.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.483+0000 7fc869600640 1 -- 172.21.15.121:0/22118207 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fc85c0831d0 con 0x7fc86c06e330 2024-09-17T03:35:54.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 -- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc848078b90 msgr2=0x7fc84807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc848078b90 0x7fc84807b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0aeff0 tx=0x7fc854005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 -- 172.21.15.121:0/22118207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc86c06e330 msgr2=0x7fc86c15af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc86c06e330 0x7fc86c15af70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc85c034040 tx=0x7fc85c003820 comp rx=0 tx=0).stop 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 -- 172.21.15.121:0/22118207 shutdown_connections 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc86c15fc50 0x7fc86c0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc86c0cf7d0 0x7fc86c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc848078b90 0x7fc84807b0a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 --2- 172.21.15.121:0/22118207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc86c06e330 0x7fc86c15af70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 -- 172.21.15.121:0/22118207 >> 172.21.15.121:0/22118207 conn(0x7fc86c0b1b90 msgr2=0x7fc86c0b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 -- 172.21.15.121:0/22118207 shutdown_connections 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.486+0000 7fc873800640 1 -- 172.21.15.121:0/22118207 wait complete. 2024-09-17T03:35:54.513 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-17T03:35:54.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:35:54.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.738+0000 7ff8f6c00640 1 -- 172.21.15.121:0/1576367791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8f00d0d80 msgr2=0x7ff8f00b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.738+0000 7ff8f6c00640 1 --2- 172.21.15.121:0/1576367791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8f00d0d80 0x7ff8f00b5be0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8005fd0 tx=0x7ff8e802a820 comp rx=0 tx=0).stop 2024-09-17T03:35:54.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.738+0000 7ff8f6c00640 1 -- 172.21.15.121:0/1576367791 shutdown_connections 2024-09-17T03:35:54.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.738+0000 7ff8f6c00640 1 --2- 172.21.15.121:0/1576367791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8f00d0d80 0x7ff8f00b5be0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.738+0000 7ff8f6c00640 1 --2- 172.21.15.121:0/1576367791 >> v2:172.21.15.176:3300/0 conn(0x7ff8f00ccc40 0x7ff8f015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.738+0000 7ff8f6c00640 1 -- 172.21.15.121:0/1576367791 >> 172.21.15.121:0/1576367791 conn(0x7ff8f00b46e0 msgr2=0x7ff8f00d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.738+0000 7ff8f6c00640 1 -- 172.21.15.121:0/1576367791 shutdown_connections 2024-09-17T03:35:54.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.738+0000 7ff8f6c00640 1 -- 172.21.15.121:0/1576367791 wait complete. 2024-09-17T03:35:54.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.740+0000 7ff8f6c00640 1 Processor -- start 2024-09-17T03:35:54.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.741+0000 7ff8f6c00640 1 -- start start 2024-09-17T03:35:54.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.742+0000 7ff8f6c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8f00ccc40 0x7ff8f00a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.742+0000 7ff8f6c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8f00cd440 0x7ff8f00c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.742+0000 7ff8f6c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8f00c81a0 0x7ff8f015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.742+0000 7ff8f6c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f00b66a0 con 0x7ff8f00ccc40 2024-09-17T03:35:54.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.742+0000 7ff8f6c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f00b6520 con 0x7ff8f00cd440 2024-09-17T03:35:54.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.742+0000 7ff8f6c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f00b6820 con 0x7ff8f00c81a0 2024-09-17T03:35:54.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.742+0000 7ff8efe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8f00ccc40 0x7ff8f00a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.742+0000 7ff8efe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8f00ccc40 0x7ff8f00a9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45826/0 (socket says 172.21.15.121:45826) 2024-09-17T03:35:54.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.742+0000 7ff8efe00640 1 -- 172.21.15.121:0/2325286430 learned_addr learned my addr 172.21.15.121:0/2325286430 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:54.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8f4c00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8f00c81a0 0x7ff8f015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8ef400640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8f00cd440 0x7ff8f00c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8efe00640 1 -- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8f00c81a0 msgr2=0x7ff8f015a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8efe00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8f00c81a0 0x7ff8f015a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8efe00640 1 -- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8f00cd440 msgr2=0x7ff8f00c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8efe00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8f00cd440 0x7ff8f00c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8efe00640 1 -- 172.21.15.121:0/2325286430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f00a9dc0 con 0x7ff8f00ccc40 2024-09-17T03:35:54.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8efe00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8f00ccc40 0x7ff8f00a9880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000e7c0 tx=0x7ff8e000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8e7e00640 1 -- 172.21.15.121:0/2325286430 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e000ccc0 con 0x7ff8f00ccc40 2024-09-17T03:35:54.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8e7e00640 1 -- 172.21.15.121:0/2325286430 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8e0010430 con 0x7ff8f00ccc40 2024-09-17T03:35:54.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8f6c00640 1 -- 172.21.15.121:0/2325286430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f015ca90 con 0x7ff8f00ccc40 2024-09-17T03:35:54.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.743+0000 7ff8e7e00640 1 -- 172.21.15.121:0/2325286430 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0010860 con 0x7ff8f00ccc40 2024-09-17T03:35:54.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.744+0000 7ff8f6c00640 1 -- 172.21.15.121:0/2325286430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f015d030 con 0x7ff8f00ccc40 2024-09-17T03:35:54.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.745+0000 7ff8f6c00640 1 -- 172.21.15.121:0/2325286430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f00b6d40 con 0x7ff8f00ccc40 2024-09-17T03:35:54.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.746+0000 7ff8e7e00640 1 -- 172.21.15.121:0/2325286430 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8e0010a00 con 0x7ff8f00ccc40 2024-09-17T03:35:54.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.747+0000 7ff8e7e00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8d0078b90 0x7ff8d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.747+0000 7ff8e7e00640 1 -- 172.21.15.121:0/2325286430 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff8e009ba70 con 0x7ff8f00ccc40 2024-09-17T03:35:54.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.747+0000 7ff8ef400640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8d0078b90 0x7ff8d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.748+0000 7ff8ef400640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8d0078b90 0x7ff8d007b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00c8fd0 tx=0x7ff8dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.751+0000 7ff8e7e00640 1 -- 172.21.15.121:0/2325286430 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff8e0063520 con 0x7ff8f00ccc40 2024-09-17T03:35:54.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:54.972+0000 7ff8f6c00640 1 -- 172.21.15.121:0/2325286430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff8f00d1e10 con 0x7ff8f00ccc40 2024-09-17T03:35:55.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.490+0000 7ff8e7e00640 1 -- 172.21.15.121:0/2325286430 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7ff8e0067f50 con 0x7ff8f00ccc40 2024-09-17T03:35:55.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 -- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8d0078b90 msgr2=0x7ff8d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8d0078b90 0x7ff8d007b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00c8fd0 tx=0x7ff8dc009040 comp rx=0 tx=0).stop 2024-09-17T03:35:55.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 -- 172.21.15.121:0/2325286430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8f00ccc40 msgr2=0x7ff8f00a9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8f00ccc40 0x7ff8f00a9880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000e7c0 tx=0x7ff8e000ec80 comp rx=0 tx=0).stop 2024-09-17T03:35:55.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 -- 172.21.15.121:0/2325286430 shutdown_connections 2024-09-17T03:35:55.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8f00c81a0 0x7ff8f015a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8f00cd440 0x7ff8f00c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8d0078b90 0x7ff8d007b0a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 --2- 172.21.15.121:0/2325286430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8f00ccc40 0x7ff8f00a9880 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 -- 172.21.15.121:0/2325286430 >> 172.21.15.121:0/2325286430 conn(0x7ff8f00b46e0 msgr2=0x7ff8f015bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 -- 172.21.15.121:0/2325286430 shutdown_connections 2024-09-17T03:35:55.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.494+0000 7ff8f6c00640 1 -- 172.21.15.121:0/2325286430 wait complete. 2024-09-17T03:35:55.518 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:35:55.519 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:55.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.740+0000 7fa494e00640 1 -- 172.21.15.121:0/2303969923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa474005ea0 msgr2=0x7fa474006330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.740+0000 7fa494e00640 1 --2- 172.21.15.121:0/2303969923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa474005ea0 0x7fa474006330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa488005fd0 tx=0x7fa474006940 comp rx=0 tx=0).stop 2024-09-17T03:35:55.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.740+0000 7fa48e800640 1 -- 172.21.15.121:0/2303969923 reap_dead start 2024-09-17T03:35:55.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.740+0000 7fa494e00640 1 -- 172.21.15.121:0/2303969923 shutdown_connections 2024-09-17T03:35:55.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.740+0000 7fa494e00640 1 -- 172.21.15.121:0/2303969923 >> 172.21.15.121:0/2303969923 conn(0x7fa4900cca40 msgr2=0x7fa4900cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.740+0000 7fa494e00640 1 -- 172.21.15.121:0/2303969923 shutdown_connections 2024-09-17T03:35:55.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.740+0000 7fa494e00640 1 -- 172.21.15.121:0/2303969923 wait complete. 2024-09-17T03:35:55.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.742+0000 7fa494e00640 1 Processor -- start 2024-09-17T03:35:55.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.743+0000 7fa494e00640 1 -- start start 2024-09-17T03:35:55.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa494e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa474005ea0 0x7fa4900b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa494e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4901f7930 0x7fa490151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa494e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490151850 0x7fa49009a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa494e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa49006df70 con 0x7fa4901f7930 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa494e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa49006ddf0 con 0x7fa474005ea0 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa494e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa49006e0f0 con 0x7fa490151850 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa485400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4901f7930 0x7fa490151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa485400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4901f7930 0x7fa490151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45854/0 (socket says 172.21.15.121:45854) 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa48de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa474005ea0 0x7fa4900b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa485400640 1 -- 172.21.15.121:0/1915348749 learned_addr learned my addr 172.21.15.121:0/1915348749 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.744+0000 7fa48e800640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490151850 0x7fa49009a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa485400640 1 -- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490151850 msgr2=0x7fa49009a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa485400640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490151850 0x7fa49009a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa485400640 1 -- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa474005ea0 msgr2=0x7fa4900b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa485400640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa474005ea0 0x7fa4900b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa485400640 1 -- 172.21.15.121:0/1915348749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa490151c60 con 0x7fa4901f7930 2024-09-17T03:35:55.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa485400640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4901f7930 0x7fa490151310 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa478006660 tx=0x7fa4780039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa486a00640 1 -- 172.21.15.121:0/1915348749 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478015020 con 0x7fa4901f7930 2024-09-17T03:35:55.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa486a00640 1 -- 172.21.15.121:0/1915348749 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa478011900 con 0x7fa4901f7930 2024-09-17T03:35:55.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa494e00640 1 -- 172.21.15.121:0/1915348749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa490153230 con 0x7fa4901f7930 2024-09-17T03:35:55.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa486a00640 1 -- 172.21.15.121:0/1915348749 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478011d50 con 0x7fa4901f7930 2024-09-17T03:35:55.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.745+0000 7fa494e00640 1 -- 172.21.15.121:0/1915348749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49009c230 con 0x7fa4901f7930 2024-09-17T03:35:55.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.747+0000 7fa494e00640 1 -- 172.21.15.121:0/1915348749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa490074230 con 0x7fa4901f7930 2024-09-17T03:35:55.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.748+0000 7fa486a00640 1 -- 172.21.15.121:0/1915348749 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa478018020 con 0x7fa4901f7930 2024-09-17T03:35:55.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.749+0000 7fa486a00640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa46c078b90 0x7fa46c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.749+0000 7fa486a00640 1 -- 172.21.15.121:0/1915348749 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa47809b8a0 con 0x7fa4901f7930 2024-09-17T03:35:55.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.749+0000 7fa48de00640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa46c078b90 0x7fa46c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.750+0000 7fa48de00640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa46c078b90 0x7fa46c07b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa480006fd0 tx=0x7fa480006b30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.753+0000 7fa486a00640 1 -- 172.21.15.121:0/1915348749 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa47801f030 con 0x7fa4901f7930 2024-09-17T03:35:55.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.973+0000 7fa494e00640 1 -- 172.21.15.121:0/1915348749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa490075050 con 0x7fa4901f7930 2024-09-17T03:35:55.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.974+0000 7fa486a00640 1 -- 172.21.15.121:0/1915348749 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5219 (secure 0 0 0) 0x7fa490151c60 con 0x7fa4901f7930 2024-09-17T03:35:55.973 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:55.973 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":9,"btime":"2024-09-17T03:35:55:484285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:31.874114+0000","modified":"2024-09-17T03:35:54.974076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4408":{"gid":4408,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4408,"qdb_cluster":[4408]},"id":1}]} 2024-09-17T03:35:55.974 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 9 2024-09-17T03:35:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 -- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa46c078b90 msgr2=0x7fa46c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa46c078b90 0x7fa46c07b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa480006fd0 tx=0x7fa480006b30 comp rx=0 tx=0).stop 2024-09-17T03:35:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 -- 172.21.15.121:0/1915348749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4901f7930 msgr2=0x7fa490151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4901f7930 0x7fa490151310 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa478006660 tx=0x7fa4780039c0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 -- 172.21.15.121:0/1915348749 shutdown_connections 2024-09-17T03:35:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490151850 0x7fa49009a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa46c078b90 0x7fa46c07b0a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4901f7930 0x7fa490151310 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 --2- 172.21.15.121:0/1915348749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa474005ea0 0x7fa4900b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 -- 172.21.15.121:0/1915348749 >> 172.21.15.121:0/1915348749 conn(0x7fa4900cca40 msgr2=0x7fa49015e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 -- 172.21.15.121:0/1915348749 shutdown_connections 2024-09-17T03:35:55.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:55.976+0000 7fa494e00640 1 -- 172.21.15.121:0/1915348749 wait complete. 2024-09-17T03:35:55.997 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:56.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.220+0000 7f113da00640 1 -- 172.21.15.121:0/3974981399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11380cea90 msgr2=0x7f11380d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.220+0000 7f113da00640 1 --2- 172.21.15.121:0/3974981399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11380cea90 0x7f11380d00d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f11380ba5b0 tx=0x7f112802a560 comp rx=0 tx=0).stop 2024-09-17T03:35:56.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.220+0000 7f113da00640 1 -- 172.21.15.121:0/3974981399 shutdown_connections 2024-09-17T03:35:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.220+0000 7f113da00640 1 --2- 172.21.15.121:0/3974981399 >> v2:172.21.15.176:3300/0 conn(0x7f1138162790 0x7f1138162ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.220+0000 7f113da00640 1 --2- 172.21.15.121:0/3974981399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11380cea90 0x7f11380d00d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.220+0000 7f113da00640 1 -- 172.21.15.121:0/3974981399 >> 172.21.15.121:0/3974981399 conn(0x7f11380d4620 msgr2=0x7f11380d4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.220+0000 7f113da00640 1 -- 172.21.15.121:0/3974981399 shutdown_connections 2024-09-17T03:35:56.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.220+0000 7f113da00640 1 -- 172.21.15.121:0/3974981399 wait complete. 2024-09-17T03:35:56.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.223+0000 7f113da00640 1 Processor -- start 2024-09-17T03:35:56.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.223+0000 7f113da00640 1 -- start start 2024-09-17T03:35:56.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.224+0000 7f113da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11380cea90 0x7f1138157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.224+0000 7f113da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11380d3360 0x7f1138156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.224+0000 7f113da00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1138162790 0x7f1138154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.224+0000 7f113da00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11380b4100 con 0x7f1138162790 2024-09-17T03:35:56.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.224+0000 7f113da00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f11380b3f80 con 0x7f11380d3360 2024-09-17T03:35:56.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.224+0000 7f113da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f11380b4280 con 0x7f11380cea90 2024-09-17T03:35:56.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.224+0000 7f1137400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1138162790 0x7f1138154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1136000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11380d3360 0x7f1138156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1136a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11380cea90 0x7f1138157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1136000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11380d3360 0x7f1138156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:38002/0 (socket says 172.21.15.121:38002) 2024-09-17T03:35:56.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1136000640 1 -- 172.21.15.121:0/3100629163 learned_addr learned my addr 172.21.15.121:0/3100629163 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:56.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1137400640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1138162790 0x7f1138154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45878/0 (socket says 172.21.15.121:45878) 2024-09-17T03:35:56.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1137400640 1 -- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11380cea90 msgr2=0x7f1138157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1137400640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11380cea90 0x7f1138157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1137400640 1 -- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11380d3360 msgr2=0x7f1138156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1137400640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11380d3360 0x7f1138156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1137400640 1 -- 172.21.15.121:0/3100629163 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11381572f0 con 0x7f1138162790 2024-09-17T03:35:56.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.225+0000 7f1137400640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1138162790 0x7f1138154c70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f113000c730 tx=0x7f113000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:56.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.226+0000 7f112ea00640 1 -- 172.21.15.121:0/3100629163 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130017070 con 0x7f1138162790 2024-09-17T03:35:56.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.226+0000 7f112ea00640 1 -- 172.21.15.121:0/3100629163 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1130003c60 con 0x7f1138162790 2024-09-17T03:35:56.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.226+0000 7f112ea00640 1 -- 172.21.15.121:0/3100629163 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11300052d0 con 0x7f1138162790 2024-09-17T03:35:56.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.226+0000 7f113da00640 1 -- 172.21.15.121:0/3100629163 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11381551b0 con 0x7f1138162790 2024-09-17T03:35:56.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.226+0000 7f113da00640 1 -- 172.21.15.121:0/3100629163 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11381562d0 con 0x7f1138162790 2024-09-17T03:35:56.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.227+0000 7f113da00640 1 -- 172.21.15.121:0/3100629163 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11381584b0 con 0x7f1138162790 2024-09-17T03:35:56.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.228+0000 7f112ea00640 1 -- 172.21.15.121:0/3100629163 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f113001a070 con 0x7f1138162790 2024-09-17T03:35:56.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.229+0000 7f112ea00640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1118078bc0 0x7f111807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.229+0000 7f112ea00640 1 -- 172.21.15.121:0/3100629163 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f113009a6d0 con 0x7f1138162790 2024-09-17T03:35:56.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.230+0000 7f1136a00640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1118078bc0 0x7f111807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.231+0000 7f1136a00640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1118078bc0 0x7f111807b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1128034000 tx=0x7f1128004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:56.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.234+0000 7f112ea00640 1 -- 172.21.15.121:0/3100629163 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11381630e0 con 0x7f1138162790 2024-09-17T03:35:56.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.423+0000 7f113da00640 1 -- 172.21.15.121:0/3100629163 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11380b47a0 con 0x7f1138162790 2024-09-17T03:35:56.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.424+0000 7f112ea00640 1 -- 172.21.15.121:0/3100629163 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18662 (secure 0 0 0) 0x7f11300620f0 con 0x7f1138162790 2024-09-17T03:35:56.424 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:56.424 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:36.921947+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:56.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 -- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1118078bc0 msgr2=0x7f111807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1118078bc0 0x7f111807b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1128034000 tx=0x7f1128004730 comp rx=0 tx=0).stop 2024-09-17T03:35:56.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 -- 172.21.15.121:0/3100629163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1138162790 msgr2=0x7f1138154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1138162790 0x7f1138154c70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f113000c730 tx=0x7f113000cbf0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 -- 172.21.15.121:0/3100629163 shutdown_connections 2024-09-17T03:35:56.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1118078bc0 0x7f111807b0d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1138162790 0x7f1138154c70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11380d3360 0x7f1138156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 --2- 172.21.15.121:0/3100629163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11380cea90 0x7f1138157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 -- 172.21.15.121:0/3100629163 >> 172.21.15.121:0/3100629163 conn(0x7f11380d4620 msgr2=0x7f113806cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:56.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 -- 172.21.15.121:0/3100629163 shutdown_connections 2024-09-17T03:35:56.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.426+0000 7f113da00640 1 -- 172.21.15.121:0/3100629163 wait complete. 2024-09-17T03:35:56.447 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:35:56.447 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:35:56.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.668+0000 7f3b03400640 1 -- 172.21.15.121:0/2288203643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3afc074d90 msgr2=0x7f3afc06f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.668+0000 7f3b03400640 1 --2- 172.21.15.121:0/2288203643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3afc074d90 0x7f3afc06f710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3af0005fd0 tx=0x7f3af002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.668+0000 7f3b03400640 1 -- 172.21.15.121:0/2288203643 shutdown_connections 2024-09-17T03:35:56.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.668+0000 7f3b03400640 1 --2- 172.21.15.121:0/2288203643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3afc070030 0x7f3afc06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.668+0000 7f3b03400640 1 --2- 172.21.15.121:0/2288203643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3afc074d90 0x7f3afc06f710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.668+0000 7f3b03400640 1 -- 172.21.15.121:0/2288203643 >> 172.21.15.121:0/2288203643 conn(0x7f3afc0cca40 msgr2=0x7f3afc0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:56.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.668+0000 7f3b03400640 1 -- 172.21.15.121:0/2288203643 shutdown_connections 2024-09-17T03:35:56.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.668+0000 7f3b03400640 1 -- 172.21.15.121:0/2288203643 wait complete. 2024-09-17T03:35:56.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.670+0000 7f3b03400640 1 Processor -- start 2024-09-17T03:35:56.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.671+0000 7f3b03400640 1 -- start start 2024-09-17T03:35:56.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.672+0000 7f3b03400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3afc06e330 0x7f3afc0ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.672+0000 7f3b03400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3afc070030 0x7f3afc0c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.672+0000 7f3b03400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3afc074d90 0x7f3afc0c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.672+0000 7f3b03400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc15ad50 con 0x7f3afc074d90 2024-09-17T03:35:56.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.672+0000 7f3b03400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc15abd0 con 0x7f3afc070030 2024-09-17T03:35:56.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.672+0000 7f3b03400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3afc070e80 con 0x7f3afc06e330 2024-09-17T03:35:56.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.672+0000 7f3b01400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3afc074d90 0x7f3afc0c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3b01400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3afc074d90 0x7f3afc0c0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45886/0 (socket says 172.21.15.121:45886) 2024-09-17T03:35:56.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3b00a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3afc06e330 0x7f3afc0ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3b01400640 1 -- 172.21.15.121:0/3447152020 learned_addr learned my addr 172.21.15.121:0/3447152020 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:56.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3afbe00640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3afc070030 0x7f3afc0c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3b01400640 1 -- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3afc06e330 msgr2=0x7f3afc0ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3b01400640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3afc06e330 0x7f3afc0ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3b01400640 1 -- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3afc070030 msgr2=0x7f3afc0c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3b01400640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3afc070030 0x7f3afc0c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3b01400640 1 -- 172.21.15.121:0/3447152020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc0aeca0 con 0x7f3afc074d90 2024-09-17T03:35:56.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3b01400640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3afc074d90 0x7f3afc0c0ff0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3af400c760 tx=0x7f3af400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:56.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.673+0000 7f3af8c00640 1 -- 172.21.15.121:0/3447152020 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4003b70 con 0x7f3afc074d90 2024-09-17T03:35:56.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.674+0000 7f3af8c00640 1 -- 172.21.15.121:0/3447152020 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3af4003d10 con 0x7f3afc074d90 2024-09-17T03:35:56.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.674+0000 7f3af8c00640 1 -- 172.21.15.121:0/3447152020 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af400aa50 con 0x7f3afc074d90 2024-09-17T03:35:56.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.674+0000 7f3b03400640 1 -- 172.21.15.121:0/3447152020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3afc0b5880 con 0x7f3afc074d90 2024-09-17T03:35:56.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.674+0000 7f3b03400640 1 -- 172.21.15.121:0/3447152020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3afc0af170 con 0x7f3afc074d90 2024-09-17T03:35:56.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.675+0000 7f3b03400640 1 -- 172.21.15.121:0/3447152020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3afc0b5670 con 0x7f3afc074d90 2024-09-17T03:35:56.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.676+0000 7f3af8c00640 1 -- 172.21.15.121:0/3447152020 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3af400abf0 con 0x7f3afc074d90 2024-09-17T03:35:56.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.677+0000 7f3af8c00640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3adc078b90 0x7f3adc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.677+0000 7f3af8c00640 1 -- 172.21.15.121:0/3447152020 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3af409ac60 con 0x7f3afc074d90 2024-09-17T03:35:56.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.677+0000 7f3b00a00640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3adc078b90 0x7f3adc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.678+0000 7f3b00a00640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3adc078b90 0x7f3adc07b0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3af0033000 tx=0x7f3af0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:56.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.682+0000 7f3af8c00640 1 -- 172.21.15.121:0/3447152020 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3af4062700 con 0x7f3afc074d90 2024-09-17T03:35:56.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.860+0000 7f3b03400640 1 -- 172.21.15.121:0/3447152020 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3afc06ddf0 con 0x7f3adc078b90 2024-09-17T03:35:56.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.869+0000 7f3af8c00640 1 -- 172.21.15.121:0/3447152020 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f3afc06ddf0 con 0x7f3adc078b90 2024-09-17T03:35:56.873 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:56.875 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:35:56.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 -- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3adc078b90 msgr2=0x7f3adc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3adc078b90 0x7f3adc07b0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3af0033000 tx=0x7f3af0004730 comp rx=0 tx=0).stop 2024-09-17T03:35:56.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 -- 172.21.15.121:0/3447152020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3afc074d90 msgr2=0x7f3afc0c0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3afc074d90 0x7f3afc0c0ff0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3af400c760 tx=0x7f3af400cc20 comp rx=0 tx=0).stop 2024-09-17T03:35:56.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 -- 172.21.15.121:0/3447152020 shutdown_connections 2024-09-17T03:35:56.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3adc078b90 0x7f3adc07b0a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3afc074d90 0x7f3afc0c0ff0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3afc070030 0x7f3afc0c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 --2- 172.21.15.121:0/3447152020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3afc06e330 0x7f3afc0ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 -- 172.21.15.121:0/3447152020 >> 172.21.15.121:0/3447152020 conn(0x7f3afc0cca40 msgr2=0x7f3afc0a0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:56.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 -- 172.21.15.121:0/3447152020 shutdown_connections 2024-09-17T03:35:56.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:56.874+0000 7f3b03400640 1 -- 172.21.15.121:0/3447152020 wait complete. 2024-09-17T03:35:56.895 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-17T03:35:55.282810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003500"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952940+0000","last_change":"2024-09-17T03:35:31.396637+0000","last_active":"2024-09-17T03:35:37.952940+0000","last_peered":"2024-09-17T03:35:37.952940+0000","last_clean":"2024-09-17T03:35:37.952940+0000","last_became_active":"2024-09-17T03:35:31.396194+0000","last_became_peered":"2024-09-17T03:35:31.396194+0000","last_unstale":"2024-09-17T03:35:37.952940+0000","last_undegraded":"2024-09-17T03:35:37.952940+0000","last_fullsized":"2024-09-17T03:35:37.952940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:58.587185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430670+0000","last_change":"2024-09-17T03:35:32.419807+0000","last_active":"2024-09-17T03:35:37.430670+0000","last_peered":"2024-09-17T03:35:37.430670+0000","last_clean":"2024-09-17T03:35:37.430670+0000","last_became_active":"2024-09-17T03:35:32.419516+0000","last_became_peered":"2024-09-17T03:35:32.419516+0000","last_unstale":"2024-09-17T03:35:37.430670+0000","last_undegraded":"2024-09-17T03:35:37.430670+0000","last_fullsized":"2024-09-17T03:35:37.430670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:18.848416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329189+0000","last_change":"2024-09-17T03:35:36.457719+0000","last_active":"2024-09-17T03:35:38.329189+0000","last_peered":"2024-09-17T03:35:38.329189+0000","last_clean":"2024-09-17T03:35:38.329189+0000","last_became_active":"2024-09-17T03:35:36.457049+0000","last_became_peered":"2024-09-17T03:35:36.457049+0000","last_unstale":"2024-09-17T03:35:38.329189+0000","last_undegraded":"2024-09-17T03:35:38.329189+0000","last_fullsized":"2024-09-17T03:35:38.329189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:26.004535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430809+0000","last_change":"2024-09-17T03:35:31.405486+0000","last_active":"2024-09-17T03:35:37.430809+0000","last_peered":"2024-09-17T03:35:37.430809+0000","last_clean":"2024-09-17T03:35:37.430809+0000","last_became_active":"2024-09-17T03:35:31.405174+0000","last_became_peered":"2024-09-17T03:35:31.405174+0000","last_unstale":"2024-09-17T03:35:37.430809+0000","last_undegraded":"2024-09-17T03:35:37.430809+0000","last_fullsized":"2024-09-17T03:35:37.430809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:50.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430989+0000","last_change":"2024-09-17T03:35:32.420131+0000","last_active":"2024-09-17T03:35:37.430989+0000","last_peered":"2024-09-17T03:35:37.430989+0000","last_clean":"2024-09-17T03:35:37.430989+0000","last_became_active":"2024-09-17T03:35:32.419301+0000","last_became_peered":"2024-09-17T03:35:32.419301+0000","last_unstale":"2024-09-17T03:35:37.430989+0000","last_undegraded":"2024-09-17T03:35:37.430989+0000","last_fullsized":"2024-09-17T03:35:37.430989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328550+0000","last_change":"2024-09-17T03:35:36.448725+0000","last_active":"2024-09-17T03:35:38.328550+0000","last_peered":"2024-09-17T03:35:38.328550+0000","last_clean":"2024-09-17T03:35:38.328550+0000","last_became_active":"2024-09-17T03:35:36.448306+0000","last_became_peered":"2024-09-17T03:35:36.448306+0000","last_unstale":"2024-09-17T03:35:38.328550+0000","last_undegraded":"2024-09-17T03:35:38.328550+0000","last_fullsized":"2024-09-17T03:35:38.328550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:38.297846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716849+0000","last_change":"2024-09-17T03:35:31.406863+0000","last_active":"2024-09-17T03:35:37.716849+0000","last_peered":"2024-09-17T03:35:37.716849+0000","last_clean":"2024-09-17T03:35:37.716849+0000","last_became_active":"2024-09-17T03:35:31.405716+0000","last_became_peered":"2024-09-17T03:35:31.405716+0000","last_unstale":"2024-09-17T03:35:37.716849+0000","last_undegraded":"2024-09-17T03:35:37.716849+0000","last_fullsized":"2024-09-17T03:35:37.716849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:25.988144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329090+0000","last_change":"2024-09-17T03:35:32.404862+0000","last_active":"2024-09-17T03:35:38.329090+0000","last_peered":"2024-09-17T03:35:38.329090+0000","last_clean":"2024-09-17T03:35:38.329090+0000","last_became_active":"2024-09-17T03:35:32.403799+0000","last_became_peered":"2024-09-17T03:35:32.403799+0000","last_unstale":"2024-09-17T03:35:38.329090+0000","last_undegraded":"2024-09-17T03:35:38.329090+0000","last_fullsized":"2024-09-17T03:35:38.329090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.040918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329212+0000","last_change":"2024-09-17T03:35:36.442226+0000","last_active":"2024-09-17T03:35:38.329212+0000","last_peered":"2024-09-17T03:35:38.329212+0000","last_clean":"2024-09-17T03:35:38.329212+0000","last_became_active":"2024-09-17T03:35:36.441650+0000","last_became_peered":"2024-09-17T03:35:36.441650+0000","last_unstale":"2024-09-17T03:35:38.329212+0000","last_undegraded":"2024-09-17T03:35:38.329212+0000","last_fullsized":"2024-09-17T03:35:38.329212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:53.723832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716982+0000","last_change":"2024-09-17T03:35:31.402468+0000","last_active":"2024-09-17T03:35:37.716982+0000","last_peered":"2024-09-17T03:35:37.716982+0000","last_clean":"2024-09-17T03:35:37.716982+0000","last_became_active":"2024-09-17T03:35:31.400527+0000","last_became_peered":"2024-09-17T03:35:31.400527+0000","last_unstale":"2024-09-17T03:35:37.716982+0000","last_undegraded":"2024-09-17T03:35:37.716982+0000","last_fullsized":"2024-09-17T03:35:37.716982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:34.200886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424506+0000","last_change":"2024-09-17T03:35:32.399680+0000","last_active":"2024-09-17T03:35:37.424506+0000","last_peered":"2024-09-17T03:35:37.424506+0000","last_clean":"2024-09-17T03:35:37.424506+0000","last_became_active":"2024-09-17T03:35:32.399385+0000","last_became_peered":"2024-09-17T03:35:32.399385+0000","last_unstale":"2024-09-17T03:35:37.424506+0000","last_undegraded":"2024-09-17T03:35:37.424506+0000","last_fullsized":"2024-09-17T03:35:37.424506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:43.868900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328684+0000","last_change":"2024-09-17T03:35:36.454547+0000","last_active":"2024-09-17T03:35:38.328684+0000","last_peered":"2024-09-17T03:35:38.328684+0000","last_clean":"2024-09-17T03:35:38.328684+0000","last_became_active":"2024-09-17T03:35:36.452245+0000","last_became_peered":"2024-09-17T03:35:36.452245+0000","last_unstale":"2024-09-17T03:35:38.328684+0000","last_undegraded":"2024-09-17T03:35:38.328684+0000","last_fullsized":"2024-09-17T03:35:38.328684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:21.761835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424041+0000","last_change":"2024-09-17T03:35:32.389915+0000","last_active":"2024-09-17T03:35:37.424041+0000","last_peered":"2024-09-17T03:35:37.424041+0000","last_clean":"2024-09-17T03:35:37.424041+0000","last_became_active":"2024-09-17T03:35:32.389629+0000","last_became_peered":"2024-09-17T03:35:32.389629+0000","last_unstale":"2024-09-17T03:35:37.424041+0000","last_undegraded":"2024-09-17T03:35:37.424041+0000","last_fullsized":"2024-09-17T03:35:37.424041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:37.978604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424108+0000","last_change":"2024-09-17T03:35:31.399927+0000","last_active":"2024-09-17T03:35:37.424108+0000","last_peered":"2024-09-17T03:35:37.424108+0000","last_clean":"2024-09-17T03:35:37.424108+0000","last_became_active":"2024-09-17T03:35:31.399633+0000","last_became_peered":"2024-09-17T03:35:31.399633+0000","last_unstale":"2024-09-17T03:35:37.424108+0000","last_undegraded":"2024-09-17T03:35:37.424108+0000","last_fullsized":"2024-09-17T03:35:37.424108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:54.701924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424308+0000","last_change":"2024-09-17T03:35:36.441343+0000","last_active":"2024-09-17T03:35:37.424308+0000","last_peered":"2024-09-17T03:35:37.424308+0000","last_clean":"2024-09-17T03:35:37.424308+0000","last_became_active":"2024-09-17T03:35:36.440928+0000","last_became_peered":"2024-09-17T03:35:36.440928+0000","last_unstale":"2024-09-17T03:35:37.424308+0000","last_undegraded":"2024-09-17T03:35:37.424308+0000","last_fullsized":"2024-09-17T03:35:37.424308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:30.901575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329519+0000","last_change":"2024-09-17T03:35:32.392491+0000","last_active":"2024-09-17T03:35:38.329519+0000","last_peered":"2024-09-17T03:35:38.329519+0000","last_clean":"2024-09-17T03:35:38.329519+0000","last_became_active":"2024-09-17T03:35:32.392158+0000","last_became_peered":"2024-09-17T03:35:32.392158+0000","last_unstale":"2024-09-17T03:35:38.329519+0000","last_undegraded":"2024-09-17T03:35:38.329519+0000","last_fullsized":"2024-09-17T03:35:38.329519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:09.595197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429614+0000","last_change":"2024-09-17T03:35:31.402340+0000","last_active":"2024-09-17T03:35:37.429614+0000","last_peered":"2024-09-17T03:35:37.429614+0000","last_clean":"2024-09-17T03:35:37.429614+0000","last_became_active":"2024-09-17T03:35:31.401416+0000","last_became_peered":"2024-09-17T03:35:31.401416+0000","last_unstale":"2024-09-17T03:35:37.429614+0000","last_undegraded":"2024-09-17T03:35:37.429614+0000","last_fullsized":"2024-09-17T03:35:37.429614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716700+0000","last_change":"2024-09-17T03:35:36.447535+0000","last_active":"2024-09-17T03:35:37.716700+0000","last_peered":"2024-09-17T03:35:37.716700+0000","last_clean":"2024-09-17T03:35:37.716700+0000","last_became_active":"2024-09-17T03:35:36.447090+0000","last_became_peered":"2024-09-17T03:35:36.447090+0000","last_unstale":"2024-09-17T03:35:37.716700+0000","last_undegraded":"2024-09-17T03:35:37.716700+0000","last_fullsized":"2024-09-17T03:35:37.716700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:23.237213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.951840+0000","last_change":"2024-09-17T03:35:32.400250+0000","last_active":"2024-09-17T03:35:37.951840+0000","last_peered":"2024-09-17T03:35:37.951840+0000","last_clean":"2024-09-17T03:35:37.951840+0000","last_became_active":"2024-09-17T03:35:32.399895+0000","last_became_peered":"2024-09-17T03:35:32.399895+0000","last_unstale":"2024-09-17T03:35:37.951840+0000","last_undegraded":"2024-09-17T03:35:37.951840+0000","last_fullsized":"2024-09-17T03:35:37.951840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:55.236620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952361+0000","last_change":"2024-09-17T03:35:31.407356+0000","last_active":"2024-09-17T03:35:37.952361+0000","last_peered":"2024-09-17T03:35:37.952361+0000","last_clean":"2024-09-17T03:35:37.952361+0000","last_became_active":"2024-09-17T03:35:31.407074+0000","last_became_peered":"2024-09-17T03:35:31.407074+0000","last_unstale":"2024-09-17T03:35:37.952361+0000","last_undegraded":"2024-09-17T03:35:37.952361+0000","last_fullsized":"2024-09-17T03:35:37.952361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:05.229644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329905+0000","last_change":"2024-09-17T03:35:36.460644+0000","last_active":"2024-09-17T03:35:38.329905+0000","last_peered":"2024-09-17T03:35:38.329905+0000","last_clean":"2024-09-17T03:35:38.329905+0000","last_became_active":"2024-09-17T03:35:36.460097+0000","last_became_peered":"2024-09-17T03:35:36.460097+0000","last_unstale":"2024-09-17T03:35:38.329905+0000","last_undegraded":"2024-09-17T03:35:38.329905+0000","last_fullsized":"2024-09-17T03:35:38.329905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:48.675841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424083+0000","last_change":"2024-09-17T03:35:32.405208+0000","last_active":"2024-09-17T03:35:37.424083+0000","last_peered":"2024-09-17T03:35:37.424083+0000","last_clean":"2024-09-17T03:35:37.424083+0000","last_became_active":"2024-09-17T03:35:32.404935+0000","last_became_peered":"2024-09-17T03:35:32.404935+0000","last_unstale":"2024-09-17T03:35:37.424083+0000","last_undegraded":"2024-09-17T03:35:37.424083+0000","last_fullsized":"2024-09-17T03:35:37.424083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:29.377565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716031+0000","last_change":"2024-09-17T03:35:31.402429+0000","last_active":"2024-09-17T03:35:37.716031+0000","last_peered":"2024-09-17T03:35:37.716031+0000","last_clean":"2024-09-17T03:35:37.716031+0000","last_became_active":"2024-09-17T03:35:31.400904+0000","last_became_peered":"2024-09-17T03:35:31.400904+0000","last_unstale":"2024-09-17T03:35:37.716031+0000","last_undegraded":"2024-09-17T03:35:37.716031+0000","last_fullsized":"2024-09-17T03:35:37.716031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:35.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329137+0000","last_change":"2024-09-17T03:35:36.439897+0000","last_active":"2024-09-17T03:35:38.329137+0000","last_peered":"2024-09-17T03:35:38.329137+0000","last_clean":"2024-09-17T03:35:38.329137+0000","last_became_active":"2024-09-17T03:35:36.439451+0000","last_became_peered":"2024-09-17T03:35:36.439451+0000","last_unstale":"2024-09-17T03:35:38.329137+0000","last_undegraded":"2024-09-17T03:35:38.329137+0000","last_fullsized":"2024-09-17T03:35:38.329137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:21.113089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952643+0000","last_change":"2024-09-17T03:35:32.397257+0000","last_active":"2024-09-17T03:35:37.952643+0000","last_peered":"2024-09-17T03:35:37.952643+0000","last_clean":"2024-09-17T03:35:37.952643+0000","last_became_active":"2024-09-17T03:35:32.396876+0000","last_became_peered":"2024-09-17T03:35:32.396876+0000","last_unstale":"2024-09-17T03:35:37.952643+0000","last_undegraded":"2024-09-17T03:35:37.952643+0000","last_fullsized":"2024-09-17T03:35:37.952643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:28.702200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424791+0000","last_change":"2024-09-17T03:35:31.409394+0000","last_active":"2024-09-17T03:35:37.424791+0000","last_peered":"2024-09-17T03:35:37.424791+0000","last_clean":"2024-09-17T03:35:37.424791+0000","last_became_active":"2024-09-17T03:35:31.408980+0000","last_became_peered":"2024-09-17T03:35:31.408980+0000","last_unstale":"2024-09-17T03:35:37.424791+0000","last_undegraded":"2024-09-17T03:35:37.424791+0000","last_fullsized":"2024-09-17T03:35:37.424791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:55.652949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329294+0000","last_change":"2024-09-17T03:35:36.436456+0000","last_active":"2024-09-17T03:35:38.329294+0000","last_peered":"2024-09-17T03:35:38.329294+0000","last_clean":"2024-09-17T03:35:38.329294+0000","last_became_active":"2024-09-17T03:35:36.435668+0000","last_became_peered":"2024-09-17T03:35:36.435668+0000","last_unstale":"2024-09-17T03:35:38.329294+0000","last_undegraded":"2024-09-17T03:35:38.329294+0000","last_fullsized":"2024-09-17T03:35:38.329294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:22.885095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952829+0000","last_change":"2024-09-17T03:35:32.401092+0000","last_active":"2024-09-17T03:35:37.952829+0000","last_peered":"2024-09-17T03:35:37.952829+0000","last_clean":"2024-09-17T03:35:37.952829+0000","last_became_active":"2024-09-17T03:35:32.400788+0000","last_became_peered":"2024-09-17T03:35:32.400788+0000","last_unstale":"2024-09-17T03:35:37.952829+0000","last_undegraded":"2024-09-17T03:35:37.952829+0000","last_fullsized":"2024-09-17T03:35:37.952829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:48.624702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952865+0000","last_change":"2024-09-17T03:35:31.409840+0000","last_active":"2024-09-17T03:35:37.952865+0000","last_peered":"2024-09-17T03:35:37.952865+0000","last_clean":"2024-09-17T03:35:37.952865+0000","last_became_active":"2024-09-17T03:35:31.409588+0000","last_became_peered":"2024-09-17T03:35:31.409588+0000","last_unstale":"2024-09-17T03:35:37.952865+0000","last_undegraded":"2024-09-17T03:35:37.952865+0000","last_fullsized":"2024-09-17T03:35:37.952865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:48.768703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.951931+0000","last_change":"2024-09-17T03:35:36.434767+0000","last_active":"2024-09-17T03:35:37.951931+0000","last_peered":"2024-09-17T03:35:37.951931+0000","last_clean":"2024-09-17T03:35:37.951931+0000","last_became_active":"2024-09-17T03:35:36.432238+0000","last_became_peered":"2024-09-17T03:35:36.432238+0000","last_unstale":"2024-09-17T03:35:37.951931+0000","last_undegraded":"2024-09-17T03:35:37.951931+0000","last_fullsized":"2024-09-17T03:35:37.951931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:42.117587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430388+0000","last_change":"2024-09-17T03:35:32.415405+0000","last_active":"2024-09-17T03:35:37.430388+0000","last_peered":"2024-09-17T03:35:37.430388+0000","last_clean":"2024-09-17T03:35:37.430388+0000","last_became_active":"2024-09-17T03:35:32.415059+0000","last_became_peered":"2024-09-17T03:35:32.415059+0000","last_unstale":"2024-09-17T03:35:37.430388+0000","last_undegraded":"2024-09-17T03:35:37.430388+0000","last_fullsized":"2024-09-17T03:35:37.430388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:03.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424840+0000","last_change":"2024-09-17T03:35:31.396414+0000","last_active":"2024-09-17T03:35:37.424840+0000","last_peered":"2024-09-17T03:35:37.424840+0000","last_clean":"2024-09-17T03:35:37.424840+0000","last_became_active":"2024-09-17T03:35:31.395858+0000","last_became_peered":"2024-09-17T03:35:31.395858+0000","last_unstale":"2024-09-17T03:35:37.424840+0000","last_undegraded":"2024-09-17T03:35:37.424840+0000","last_fullsized":"2024-09-17T03:35:37.424840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:48.032251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429676+0000","last_change":"2024-09-17T03:35:36.454944+0000","last_active":"2024-09-17T03:35:37.429676+0000","last_peered":"2024-09-17T03:35:37.429676+0000","last_clean":"2024-09-17T03:35:37.429676+0000","last_became_active":"2024-09-17T03:35:36.452999+0000","last_became_peered":"2024-09-17T03:35:36.452999+0000","last_unstale":"2024-09-17T03:35:37.429676+0000","last_undegraded":"2024-09-17T03:35:37.429676+0000","last_fullsized":"2024-09-17T03:35:37.429676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:59.994365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330037+0000","last_change":"2024-09-17T03:35:32.401014+0000","last_active":"2024-09-17T03:35:38.330037+0000","last_peered":"2024-09-17T03:35:38.330037+0000","last_clean":"2024-09-17T03:35:38.330037+0000","last_became_active":"2024-09-17T03:35:32.392657+0000","last_became_peered":"2024-09-17T03:35:32.392657+0000","last_unstale":"2024-09-17T03:35:38.330037+0000","last_undegraded":"2024-09-17T03:35:38.330037+0000","last_fullsized":"2024-09-17T03:35:38.330037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:54.253376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429390+0000","last_change":"2024-09-17T03:35:31.402788+0000","last_active":"2024-09-17T03:35:37.429390+0000","last_peered":"2024-09-17T03:35:37.429390+0000","last_clean":"2024-09-17T03:35:37.429390+0000","last_became_active":"2024-09-17T03:35:31.402263+0000","last_became_peered":"2024-09-17T03:35:31.402263+0000","last_unstale":"2024-09-17T03:35:37.429390+0000","last_undegraded":"2024-09-17T03:35:37.429390+0000","last_fullsized":"2024-09-17T03:35:37.429390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429266+0000","last_change":"2024-09-17T03:35:36.450678+0000","last_active":"2024-09-17T03:35:37.429266+0000","last_peered":"2024-09-17T03:35:37.429266+0000","last_clean":"2024-09-17T03:35:37.429266+0000","last_became_active":"2024-09-17T03:35:36.450277+0000","last_became_peered":"2024-09-17T03:35:36.450277+0000","last_unstale":"2024-09-17T03:35:37.429266+0000","last_undegraded":"2024-09-17T03:35:37.429266+0000","last_fullsized":"2024-09-17T03:35:37.429266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:58.323368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716675+0000","last_change":"2024-09-17T03:35:32.399401+0000","last_active":"2024-09-17T03:35:37.716675+0000","last_peered":"2024-09-17T03:35:37.716675+0000","last_clean":"2024-09-17T03:35:37.716675+0000","last_became_active":"2024-09-17T03:35:32.399115+0000","last_became_peered":"2024-09-17T03:35:32.399115+0000","last_unstale":"2024-09-17T03:35:37.716675+0000","last_undegraded":"2024-09-17T03:35:37.716675+0000","last_fullsized":"2024-09-17T03:35:37.716675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:44.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424632+0000","last_change":"2024-09-17T03:35:31.395600+0000","last_active":"2024-09-17T03:35:37.424632+0000","last_peered":"2024-09-17T03:35:37.424632+0000","last_clean":"2024-09-17T03:35:37.424632+0000","last_became_active":"2024-09-17T03:35:31.394734+0000","last_became_peered":"2024-09-17T03:35:31.394734+0000","last_unstale":"2024-09-17T03:35:37.424632+0000","last_undegraded":"2024-09-17T03:35:37.424632+0000","last_fullsized":"2024-09-17T03:35:37.424632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:01.197590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430182+0000","last_change":"2024-09-17T03:35:36.443098+0000","last_active":"2024-09-17T03:35:37.430182+0000","last_peered":"2024-09-17T03:35:37.430182+0000","last_clean":"2024-09-17T03:35:37.430182+0000","last_became_active":"2024-09-17T03:35:36.437889+0000","last_became_peered":"2024-09-17T03:35:36.437889+0000","last_unstale":"2024-09-17T03:35:37.430182+0000","last_undegraded":"2024-09-17T03:35:37.430182+0000","last_fullsized":"2024-09-17T03:35:37.430182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.413529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428284+0000","last_change":"2024-09-17T03:35:32.400695+0000","last_active":"2024-09-17T03:35:37.428284+0000","last_peered":"2024-09-17T03:35:37.428284+0000","last_clean":"2024-09-17T03:35:37.428284+0000","last_became_active":"2024-09-17T03:35:32.400363+0000","last_became_peered":"2024-09-17T03:35:32.400363+0000","last_unstale":"2024-09-17T03:35:37.428284+0000","last_undegraded":"2024-09-17T03:35:37.428284+0000","last_fullsized":"2024-09-17T03:35:37.428284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:14.763903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329497+0000","last_change":"2024-09-17T03:35:31.405580+0000","last_active":"2024-09-17T03:35:38.329497+0000","last_peered":"2024-09-17T03:35:38.329497+0000","last_clean":"2024-09-17T03:35:38.329497+0000","last_became_active":"2024-09-17T03:35:31.405210+0000","last_became_peered":"2024-09-17T03:35:31.405210+0000","last_unstale":"2024-09-17T03:35:38.329497+0000","last_undegraded":"2024-09-17T03:35:38.329497+0000","last_fullsized":"2024-09-17T03:35:38.329497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:24.896063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430908+0000","last_change":"2024-09-17T03:35:36.449377+0000","last_active":"2024-09-17T03:35:37.430908+0000","last_peered":"2024-09-17T03:35:37.430908+0000","last_clean":"2024-09-17T03:35:37.430908+0000","last_became_active":"2024-09-17T03:35:36.448135+0000","last_became_peered":"2024-09-17T03:35:36.448135+0000","last_unstale":"2024-09-17T03:35:37.430908+0000","last_undegraded":"2024-09-17T03:35:37.430908+0000","last_fullsized":"2024-09-17T03:35:37.430908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:36.313705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428454+0000","last_change":"2024-09-17T03:35:32.408934+0000","last_active":"2024-09-17T03:35:37.428454+0000","last_peered":"2024-09-17T03:35:37.428454+0000","last_clean":"2024-09-17T03:35:37.428454+0000","last_became_active":"2024-09-17T03:35:32.408637+0000","last_became_peered":"2024-09-17T03:35:32.408637+0000","last_unstale":"2024-09-17T03:35:37.428454+0000","last_undegraded":"2024-09-17T03:35:37.428454+0000","last_fullsized":"2024-09-17T03:35:37.428454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:55.435612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424316+0000","last_change":"2024-09-17T03:35:31.402870+0000","last_active":"2024-09-17T03:35:37.424316+0000","last_peered":"2024-09-17T03:35:37.424316+0000","last_clean":"2024-09-17T03:35:37.424316+0000","last_became_active":"2024-09-17T03:35:31.401653+0000","last_became_peered":"2024-09-17T03:35:31.401653+0000","last_unstale":"2024-09-17T03:35:37.424316+0000","last_undegraded":"2024-09-17T03:35:37.424316+0000","last_fullsized":"2024-09-17T03:35:37.424316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429975+0000","last_change":"2024-09-17T03:35:36.444315+0000","last_active":"2024-09-17T03:35:37.429975+0000","last_peered":"2024-09-17T03:35:37.429975+0000","last_clean":"2024-09-17T03:35:37.429975+0000","last_became_active":"2024-09-17T03:35:36.441801+0000","last_became_peered":"2024-09-17T03:35:36.441801+0000","last_unstale":"2024-09-17T03:35:37.429975+0000","last_undegraded":"2024-09-17T03:35:37.429975+0000","last_fullsized":"2024-09-17T03:35:37.429975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:47.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952163+0000","last_change":"2024-09-17T03:35:32.415099+0000","last_active":"2024-09-17T03:35:37.952163+0000","last_peered":"2024-09-17T03:35:37.952163+0000","last_clean":"2024-09-17T03:35:37.952163+0000","last_became_active":"2024-09-17T03:35:32.414839+0000","last_became_peered":"2024-09-17T03:35:32.414839+0000","last_unstale":"2024-09-17T03:35:37.952163+0000","last_undegraded":"2024-09-17T03:35:37.952163+0000","last_fullsized":"2024-09-17T03:35:37.952163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:28.814349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424280+0000","last_change":"2024-09-17T03:35:31.399644+0000","last_active":"2024-09-17T03:35:37.424280+0000","last_peered":"2024-09-17T03:35:37.424280+0000","last_clean":"2024-09-17T03:35:37.424280+0000","last_became_active":"2024-09-17T03:35:31.398495+0000","last_became_peered":"2024-09-17T03:35:31.398495+0000","last_unstale":"2024-09-17T03:35:37.424280+0000","last_undegraded":"2024-09-17T03:35:37.424280+0000","last_fullsized":"2024-09-17T03:35:37.424280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:43.782608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328458+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:35:38.328458+0000","last_peered":"2024-09-17T03:35:38.328458+0000","last_clean":"2024-09-17T03:35:38.328458+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:35:38.328458+0000","last_undegraded":"2024-09-17T03:35:38.328458+0000","last_fullsized":"2024-09-17T03:35:38.328458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424800+0000","last_change":"2024-09-17T03:35:36.432981+0000","last_active":"2024-09-17T03:35:37.424800+0000","last_peered":"2024-09-17T03:35:37.424800+0000","last_clean":"2024-09-17T03:35:37.424800+0000","last_became_active":"2024-09-17T03:35:36.432550+0000","last_became_peered":"2024-09-17T03:35:36.432550+0000","last_unstale":"2024-09-17T03:35:37.424800+0000","last_undegraded":"2024-09-17T03:35:37.424800+0000","last_fullsized":"2024-09-17T03:35:37.424800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:29.515037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424612+0000","last_change":"2024-09-17T03:35:32.393020+0000","last_active":"2024-09-17T03:35:37.424612+0000","last_peered":"2024-09-17T03:35:37.424612+0000","last_clean":"2024-09-17T03:35:37.424612+0000","last_became_active":"2024-09-17T03:35:32.392509+0000","last_became_peered":"2024-09-17T03:35:32.392509+0000","last_unstale":"2024-09-17T03:35:37.424612+0000","last_undegraded":"2024-09-17T03:35:37.424612+0000","last_fullsized":"2024-09-17T03:35:37.424612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.767440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430467+0000","last_change":"2024-09-17T03:35:31.406748+0000","last_active":"2024-09-17T03:35:37.430467+0000","last_peered":"2024-09-17T03:35:37.430467+0000","last_clean":"2024-09-17T03:35:37.430467+0000","last_became_active":"2024-09-17T03:35:31.406319+0000","last_became_peered":"2024-09-17T03:35:31.406319+0000","last_unstale":"2024-09-17T03:35:37.430467+0000","last_undegraded":"2024-09-17T03:35:37.430467+0000","last_fullsized":"2024-09-17T03:35:37.430467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:24.896063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330083+0000","last_change":"2024-09-17T03:35:36.454141+0000","last_active":"2024-09-17T03:35:38.330083+0000","last_peered":"2024-09-17T03:35:38.330083+0000","last_clean":"2024-09-17T03:35:38.330083+0000","last_became_active":"2024-09-17T03:35:36.452907+0000","last_became_peered":"2024-09-17T03:35:36.452907+0000","last_unstale":"2024-09-17T03:35:38.330083+0000","last_undegraded":"2024-09-17T03:35:38.330083+0000","last_fullsized":"2024-09-17T03:35:38.330083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:48.118603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716957+0000","last_change":"2024-09-17T03:35:32.397883+0000","last_active":"2024-09-17T03:35:37.716957+0000","last_peered":"2024-09-17T03:35:37.716957+0000","last_clean":"2024-09-17T03:35:37.716957+0000","last_became_active":"2024-09-17T03:35:32.395887+0000","last_became_peered":"2024-09-17T03:35:32.395887+0000","last_unstale":"2024-09-17T03:35:37.716957+0000","last_undegraded":"2024-09-17T03:35:37.716957+0000","last_fullsized":"2024-09-17T03:35:37.716957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:07.376850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430343+0000","last_change":"2024-09-17T03:35:31.399882+0000","last_active":"2024-09-17T03:35:37.430343+0000","last_peered":"2024-09-17T03:35:37.430343+0000","last_clean":"2024-09-17T03:35:37.430343+0000","last_became_active":"2024-09-17T03:35:31.399568+0000","last_became_peered":"2024-09-17T03:35:31.399568+0000","last_unstale":"2024-09-17T03:35:37.430343+0000","last_undegraded":"2024-09-17T03:35:37.430343+0000","last_fullsized":"2024-09-17T03:35:37.430343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:16.036571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428981+0000","last_change":"2024-09-17T03:35:36.435798+0000","last_active":"2024-09-17T03:35:37.428981+0000","last_peered":"2024-09-17T03:35:37.428981+0000","last_clean":"2024-09-17T03:35:37.428981+0000","last_became_active":"2024-09-17T03:35:36.434964+0000","last_became_peered":"2024-09-17T03:35:36.434964+0000","last_unstale":"2024-09-17T03:35:37.428981+0000","last_undegraded":"2024-09-17T03:35:37.428981+0000","last_fullsized":"2024-09-17T03:35:37.428981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:55.456589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716617+0000","last_change":"2024-09-17T03:35:32.401068+0000","last_active":"2024-09-17T03:35:37.716617+0000","last_peered":"2024-09-17T03:35:37.716617+0000","last_clean":"2024-09-17T03:35:37.716617+0000","last_became_active":"2024-09-17T03:35:32.400787+0000","last_became_peered":"2024-09-17T03:35:32.400787+0000","last_unstale":"2024-09-17T03:35:37.716617+0000","last_undegraded":"2024-09-17T03:35:37.716617+0000","last_fullsized":"2024-09-17T03:35:37.716617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952776+0000","last_change":"2024-09-17T03:35:31.400243+0000","last_active":"2024-09-17T03:35:37.952776+0000","last_peered":"2024-09-17T03:35:37.952776+0000","last_clean":"2024-09-17T03:35:37.952776+0000","last_became_active":"2024-09-17T03:35:31.399896+0000","last_became_peered":"2024-09-17T03:35:31.399896+0000","last_unstale":"2024-09-17T03:35:37.952776+0000","last_undegraded":"2024-09-17T03:35:37.952776+0000","last_fullsized":"2024-09-17T03:35:37.952776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:05.368297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423725+0000","last_change":"2024-09-17T03:35:36.433676+0000","last_active":"2024-09-17T03:35:37.423725+0000","last_peered":"2024-09-17T03:35:37.423725+0000","last_clean":"2024-09-17T03:35:37.423725+0000","last_became_active":"2024-09-17T03:35:36.431277+0000","last_became_peered":"2024-09-17T03:35:36.431277+0000","last_unstale":"2024-09-17T03:35:37.423725+0000","last_undegraded":"2024-09-17T03:35:37.423725+0000","last_fullsized":"2024-09-17T03:35:37.423725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.696472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329516+0000","last_change":"2024-09-17T03:35:32.412184+0000","last_active":"2024-09-17T03:35:38.329516+0000","last_peered":"2024-09-17T03:35:38.329516+0000","last_clean":"2024-09-17T03:35:38.329516+0000","last_became_active":"2024-09-17T03:35:32.411602+0000","last_became_peered":"2024-09-17T03:35:32.411602+0000","last_unstale":"2024-09-17T03:35:38.329516+0000","last_undegraded":"2024-09-17T03:35:38.329516+0000","last_fullsized":"2024-09-17T03:35:38.329516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:41.794850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716873+0000","last_change":"2024-09-17T03:35:31.405777+0000","last_active":"2024-09-17T03:35:37.716873+0000","last_peered":"2024-09-17T03:35:37.716873+0000","last_clean":"2024-09-17T03:35:37.716873+0000","last_became_active":"2024-09-17T03:35:31.400954+0000","last_became_peered":"2024-09-17T03:35:31.400954+0000","last_unstale":"2024-09-17T03:35:37.716873+0000","last_undegraded":"2024-09-17T03:35:37.716873+0000","last_fullsized":"2024-09-17T03:35:37.716873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:50.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328929+0000","last_change":"2024-09-17T03:35:36.442849+0000","last_active":"2024-09-17T03:35:38.328929+0000","last_peered":"2024-09-17T03:35:38.328929+0000","last_clean":"2024-09-17T03:35:38.328929+0000","last_became_active":"2024-09-17T03:35:36.442373+0000","last_became_peered":"2024-09-17T03:35:36.442373+0000","last_unstale":"2024-09-17T03:35:38.328929+0000","last_undegraded":"2024-09-17T03:35:38.328929+0000","last_fullsized":"2024-09-17T03:35:38.328929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:31.462450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423856+0000","last_change":"2024-09-17T03:35:32.421334+0000","last_active":"2024-09-17T03:35:37.423856+0000","last_peered":"2024-09-17T03:35:37.423856+0000","last_clean":"2024-09-17T03:35:37.423856+0000","last_became_active":"2024-09-17T03:35:32.417735+0000","last_became_peered":"2024-09-17T03:35:32.417735+0000","last_unstale":"2024-09-17T03:35:37.423856+0000","last_undegraded":"2024-09-17T03:35:37.423856+0000","last_fullsized":"2024-09-17T03:35:37.423856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:38.772375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952012+0000","last_change":"2024-09-17T03:35:31.393984+0000","last_active":"2024-09-17T03:35:37.952012+0000","last_peered":"2024-09-17T03:35:37.952012+0000","last_clean":"2024-09-17T03:35:37.952012+0000","last_became_active":"2024-09-17T03:35:31.393359+0000","last_became_peered":"2024-09-17T03:35:31.393359+0000","last_unstale":"2024-09-17T03:35:37.952012+0000","last_undegraded":"2024-09-17T03:35:37.952012+0000","last_fullsized":"2024-09-17T03:35:37.952012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:29.238819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430527+0000","last_change":"2024-09-17T03:35:36.446882+0000","last_active":"2024-09-17T03:35:37.430527+0000","last_peered":"2024-09-17T03:35:37.430527+0000","last_clean":"2024-09-17T03:35:37.430527+0000","last_became_active":"2024-09-17T03:35:36.445788+0000","last_became_peered":"2024-09-17T03:35:36.445788+0000","last_unstale":"2024-09-17T03:35:37.430527+0000","last_undegraded":"2024-09-17T03:35:37.430527+0000","last_fullsized":"2024-09-17T03:35:37.430527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:46.475925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328438+0000","last_change":"2024-09-17T03:35:32.402001+0000","last_active":"2024-09-17T03:35:38.328438+0000","last_peered":"2024-09-17T03:35:38.328438+0000","last_clean":"2024-09-17T03:35:38.328438+0000","last_became_active":"2024-09-17T03:35:32.401658+0000","last_became_peered":"2024-09-17T03:35:32.401658+0000","last_unstale":"2024-09-17T03:35:38.328438+0000","last_undegraded":"2024-09-17T03:35:38.328438+0000","last_fullsized":"2024-09-17T03:35:38.328438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:51.388149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716519+0000","last_change":"2024-09-17T03:35:31.400527+0000","last_active":"2024-09-17T03:35:37.716519+0000","last_peered":"2024-09-17T03:35:37.716519+0000","last_clean":"2024-09-17T03:35:37.716519+0000","last_became_active":"2024-09-17T03:35:31.399807+0000","last_became_peered":"2024-09-17T03:35:31.399807+0000","last_unstale":"2024-09-17T03:35:37.716519+0000","last_undegraded":"2024-09-17T03:35:37.716519+0000","last_fullsized":"2024-09-17T03:35:37.716519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.431087+0000","last_change":"2024-09-17T03:35:36.449338+0000","last_active":"2024-09-17T03:35:37.431087+0000","last_peered":"2024-09-17T03:35:37.431087+0000","last_clean":"2024-09-17T03:35:37.431087+0000","last_became_active":"2024-09-17T03:35:36.448829+0000","last_became_peered":"2024-09-17T03:35:36.448829+0000","last_unstale":"2024-09-17T03:35:37.431087+0000","last_undegraded":"2024-09-17T03:35:37.431087+0000","last_fullsized":"2024-09-17T03:35:37.431087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:30.201889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423978+0000","last_change":"2024-09-17T03:35:32.415025+0000","last_active":"2024-09-17T03:35:37.423978+0000","last_peered":"2024-09-17T03:35:37.423978+0000","last_clean":"2024-09-17T03:35:37.423978+0000","last_became_active":"2024-09-17T03:35:32.399484+0000","last_became_peered":"2024-09-17T03:35:32.399484+0000","last_unstale":"2024-09-17T03:35:37.423978+0000","last_undegraded":"2024-09-17T03:35:37.423978+0000","last_fullsized":"2024-09-17T03:35:37.423978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:06.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424580+0000","last_change":"2024-09-17T03:35:31.393032+0000","last_active":"2024-09-17T03:35:37.424580+0000","last_peered":"2024-09-17T03:35:37.424580+0000","last_clean":"2024-09-17T03:35:37.424580+0000","last_became_active":"2024-09-17T03:35:31.392712+0000","last_became_peered":"2024-09-17T03:35:31.392712+0000","last_unstale":"2024-09-17T03:35:37.424580+0000","last_undegraded":"2024-09-17T03:35:37.424580+0000","last_fullsized":"2024-09-17T03:35:37.424580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:39.717069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430060+0000","last_change":"2024-09-17T03:35:36.448065+0000","last_active":"2024-09-17T03:35:37.430060+0000","last_peered":"2024-09-17T03:35:37.430060+0000","last_clean":"2024-09-17T03:35:37.430060+0000","last_became_active":"2024-09-17T03:35:36.440858+0000","last_became_peered":"2024-09-17T03:35:36.440858+0000","last_unstale":"2024-09-17T03:35:37.430060+0000","last_undegraded":"2024-09-17T03:35:37.430060+0000","last_fullsized":"2024-09-17T03:35:37.430060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.791341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429471+0000","last_change":"2024-09-17T03:35:32.406664+0000","last_active":"2024-09-17T03:35:37.429471+0000","last_peered":"2024-09-17T03:35:37.429471+0000","last_clean":"2024-09-17T03:35:37.429471+0000","last_became_active":"2024-09-17T03:35:32.406094+0000","last_became_peered":"2024-09-17T03:35:32.406094+0000","last_unstale":"2024-09-17T03:35:37.429471+0000","last_undegraded":"2024-09-17T03:35:37.429471+0000","last_fullsized":"2024-09-17T03:35:37.429471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:58.630384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329699+0000","last_change":"2024-09-17T03:35:31.403376+0000","last_active":"2024-09-17T03:35:38.329699+0000","last_peered":"2024-09-17T03:35:38.329699+0000","last_clean":"2024-09-17T03:35:38.329699+0000","last_became_active":"2024-09-17T03:35:31.402949+0000","last_became_peered":"2024-09-17T03:35:31.402949+0000","last_unstale":"2024-09-17T03:35:38.329699+0000","last_undegraded":"2024-09-17T03:35:38.329699+0000","last_fullsized":"2024-09-17T03:35:38.329699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:18.331525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424293+0000","last_change":"2024-09-17T03:35:36.436078+0000","last_active":"2024-09-17T03:35:37.424293+0000","last_peered":"2024-09-17T03:35:37.424293+0000","last_clean":"2024-09-17T03:35:37.424293+0000","last_became_active":"2024-09-17T03:35:36.435669+0000","last_became_peered":"2024-09-17T03:35:36.435669+0000","last_unstale":"2024-09-17T03:35:37.424293+0000","last_undegraded":"2024-09-17T03:35:37.424293+0000","last_fullsized":"2024-09-17T03:35:37.424293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:07.115777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716542+0000","last_change":"2024-09-17T03:35:32.402486+0000","last_active":"2024-09-17T03:35:37.716542+0000","last_peered":"2024-09-17T03:35:37.716542+0000","last_clean":"2024-09-17T03:35:37.716542+0000","last_became_active":"2024-09-17T03:35:32.402185+0000","last_became_peered":"2024-09-17T03:35:32.402185+0000","last_unstale":"2024-09-17T03:35:37.716542+0000","last_undegraded":"2024-09-17T03:35:37.716542+0000","last_fullsized":"2024-09-17T03:35:37.716542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:38.772375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:45.296364+0000","last_change":"2024-09-17T03:35:31.400849+0000","last_active":"2024-09-17T03:35:45.296364+0000","last_peered":"2024-09-17T03:35:45.296364+0000","last_clean":"2024-09-17T03:35:45.296364+0000","last_became_active":"2024-09-17T03:35:31.399182+0000","last_became_peered":"2024-09-17T03:35:31.399182+0000","last_unstale":"2024-09-17T03:35:45.296364+0000","last_undegraded":"2024-09-17T03:35:45.296364+0000","last_fullsized":"2024-09-17T03:35:45.296364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:48.258646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952056+0000","last_change":"2024-09-17T03:35:36.433789+0000","last_active":"2024-09-17T03:35:37.952056+0000","last_peered":"2024-09-17T03:35:37.952056+0000","last_clean":"2024-09-17T03:35:37.952056+0000","last_became_active":"2024-09-17T03:35:36.433154+0000","last_became_peered":"2024-09-17T03:35:36.433154+0000","last_unstale":"2024-09-17T03:35:37.952056+0000","last_undegraded":"2024-09-17T03:35:37.952056+0000","last_fullsized":"2024-09-17T03:35:37.952056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:25.543856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424094+0000","last_change":"2024-09-17T03:35:32.400635+0000","last_active":"2024-09-17T03:35:37.424094+0000","last_peered":"2024-09-17T03:35:37.424094+0000","last_clean":"2024-09-17T03:35:37.424094+0000","last_became_active":"2024-09-17T03:35:32.393225+0000","last_became_peered":"2024-09-17T03:35:32.393225+0000","last_unstale":"2024-09-17T03:35:37.424094+0000","last_undegraded":"2024-09-17T03:35:37.424094+0000","last_fullsized":"2024-09-17T03:35:37.424094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:08.018673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329974+0000","last_change":"2024-09-17T03:35:31.391917+0000","last_active":"2024-09-17T03:35:38.329974+0000","last_peered":"2024-09-17T03:35:38.329974+0000","last_clean":"2024-09-17T03:35:38.329974+0000","last_became_active":"2024-09-17T03:35:31.390310+0000","last_became_peered":"2024-09-17T03:35:31.390310+0000","last_unstale":"2024-09-17T03:35:38.329974+0000","last_undegraded":"2024-09-17T03:35:38.329974+0000","last_fullsized":"2024-09-17T03:35:38.329974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329447+0000","last_change":"2024-09-17T03:35:36.452480+0000","last_active":"2024-09-17T03:35:38.329447+0000","last_peered":"2024-09-17T03:35:38.329447+0000","last_clean":"2024-09-17T03:35:38.329447+0000","last_became_active":"2024-09-17T03:35:36.452057+0000","last_became_peered":"2024-09-17T03:35:36.452057+0000","last_unstale":"2024-09-17T03:35:38.329447+0000","last_undegraded":"2024-09-17T03:35:38.329447+0000","last_fullsized":"2024-09-17T03:35:38.329447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:02.864287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.431137+0000","last_change":"2024-09-17T03:35:32.420703+0000","last_active":"2024-09-17T03:35:37.431137+0000","last_peered":"2024-09-17T03:35:37.431137+0000","last_clean":"2024-09-17T03:35:37.431137+0000","last_became_active":"2024-09-17T03:35:32.420467+0000","last_became_peered":"2024-09-17T03:35:32.420467+0000","last_unstale":"2024-09-17T03:35:37.431137+0000","last_undegraded":"2024-09-17T03:35:37.431137+0000","last_fullsized":"2024-09-17T03:35:37.431137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:08.429869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716577+0000","last_change":"2024-09-17T03:35:31.407562+0000","last_active":"2024-09-17T03:35:37.716577+0000","last_peered":"2024-09-17T03:35:37.716577+0000","last_clean":"2024-09-17T03:35:37.716577+0000","last_became_active":"2024-09-17T03:35:31.405639+0000","last_became_peered":"2024-09-17T03:35:31.405639+0000","last_unstale":"2024-09-17T03:35:37.716577+0000","last_undegraded":"2024-09-17T03:35:37.716577+0000","last_fullsized":"2024-09-17T03:35:37.716577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:16.036571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329103+0000","last_change":"2024-09-17T03:35:36.457602+0000","last_active":"2024-09-17T03:35:38.329103+0000","last_peered":"2024-09-17T03:35:38.329103+0000","last_clean":"2024-09-17T03:35:38.329103+0000","last_became_active":"2024-09-17T03:35:36.455212+0000","last_became_peered":"2024-09-17T03:35:36.455212+0000","last_unstale":"2024-09-17T03:35:38.329103+0000","last_undegraded":"2024-09-17T03:35:38.329103+0000","last_fullsized":"2024-09-17T03:35:38.329103+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:07.594543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329415+0000","last_change":"2024-09-17T03:35:32.407130+0000","last_active":"2024-09-17T03:35:38.329415+0000","last_peered":"2024-09-17T03:35:38.329415+0000","last_clean":"2024-09-17T03:35:38.329415+0000","last_became_active":"2024-09-17T03:35:32.391848+0000","last_became_peered":"2024-09-17T03:35:32.391848+0000","last_unstale":"2024-09-17T03:35:38.329415+0000","last_undegraded":"2024-09-17T03:35:38.329415+0000","last_fullsized":"2024-09-17T03:35:38.329415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:08.067720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329651+0000","last_change":"2024-09-17T03:35:31.390094+0000","last_active":"2024-09-17T03:35:38.329651+0000","last_peered":"2024-09-17T03:35:38.329651+0000","last_clean":"2024-09-17T03:35:38.329651+0000","last_became_active":"2024-09-17T03:35:31.389803+0000","last_became_peered":"2024-09-17T03:35:31.389803+0000","last_unstale":"2024-09-17T03:35:38.329651+0000","last_undegraded":"2024-09-17T03:35:38.329651+0000","last_fullsized":"2024-09-17T03:35:38.329651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952214+0000","last_change":"2024-09-17T03:35:36.437757+0000","last_active":"2024-09-17T03:35:37.952214+0000","last_peered":"2024-09-17T03:35:37.952214+0000","last_clean":"2024-09-17T03:35:37.952214+0000","last_became_active":"2024-09-17T03:35:36.435609+0000","last_became_peered":"2024-09-17T03:35:36.435609+0000","last_unstale":"2024-09-17T03:35:37.952214+0000","last_undegraded":"2024-09-17T03:35:37.952214+0000","last_fullsized":"2024-09-17T03:35:37.952214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:09.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952718+0000","last_change":"2024-09-17T03:35:36.442334+0000","last_active":"2024-09-17T03:35:37.952718+0000","last_peered":"2024-09-17T03:35:37.952718+0000","last_clean":"2024-09-17T03:35:37.952718+0000","last_became_active":"2024-09-17T03:35:36.441896+0000","last_became_peered":"2024-09-17T03:35:36.441896+0000","last_unstale":"2024-09-17T03:35:37.952718+0000","last_undegraded":"2024-09-17T03:35:37.952718+0000","last_fullsized":"2024-09-17T03:35:37.952718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:22.644001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952084+0000","last_change":"2024-09-17T03:35:32.403467+0000","last_active":"2024-09-17T03:35:37.952084+0000","last_peered":"2024-09-17T03:35:37.952084+0000","last_clean":"2024-09-17T03:35:37.952084+0000","last_became_active":"2024-09-17T03:35:32.403114+0000","last_became_peered":"2024-09-17T03:35:32.403114+0000","last_unstale":"2024-09-17T03:35:37.952084+0000","last_undegraded":"2024-09-17T03:35:37.952084+0000","last_fullsized":"2024-09-17T03:35:37.952084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:55.954409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424195+0000","last_change":"2024-09-17T03:35:31.404636+0000","last_active":"2024-09-17T03:35:37.424195+0000","last_peered":"2024-09-17T03:35:37.424195+0000","last_clean":"2024-09-17T03:35:37.424195+0000","last_became_active":"2024-09-17T03:35:31.404277+0000","last_became_peered":"2024-09-17T03:35:31.404277+0000","last_unstale":"2024-09-17T03:35:37.424195+0000","last_undegraded":"2024-09-17T03:35:37.424195+0000","last_fullsized":"2024-09-17T03:35:37.424195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:40.786182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424417+0000","last_change":"2024-09-17T03:35:36.433455+0000","last_active":"2024-09-17T03:35:37.424417+0000","last_peered":"2024-09-17T03:35:37.424417+0000","last_clean":"2024-09-17T03:35:37.424417+0000","last_became_active":"2024-09-17T03:35:36.433005+0000","last_became_peered":"2024-09-17T03:35:36.433005+0000","last_unstale":"2024-09-17T03:35:37.424417+0000","last_undegraded":"2024-09-17T03:35:37.424417+0000","last_fullsized":"2024-09-17T03:35:37.424417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:02.604817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428484+0000","last_change":"2024-09-17T03:35:32.399932+0000","last_active":"2024-09-17T03:35:37.428484+0000","last_peered":"2024-09-17T03:35:37.428484+0000","last_clean":"2024-09-17T03:35:37.428484+0000","last_became_active":"2024-09-17T03:35:32.399566+0000","last_became_peered":"2024-09-17T03:35:32.399566+0000","last_unstale":"2024-09-17T03:35:37.428484+0000","last_undegraded":"2024-09-17T03:35:37.428484+0000","last_fullsized":"2024-09-17T03:35:37.428484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:32.277026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428581+0000","last_change":"2024-09-17T03:35:31.407319+0000","last_active":"2024-09-17T03:35:37.428581+0000","last_peered":"2024-09-17T03:35:37.428581+0000","last_clean":"2024-09-17T03:35:37.428581+0000","last_became_active":"2024-09-17T03:35:31.407022+0000","last_became_peered":"2024-09-17T03:35:31.407022+0000","last_unstale":"2024-09-17T03:35:37.428581+0000","last_undegraded":"2024-09-17T03:35:37.428581+0000","last_fullsized":"2024-09-17T03:35:37.428581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:18.331525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424464+0000","last_change":"2024-09-17T03:35:31.408471+0000","last_active":"2024-09-17T03:35:37.424464+0000","last_peered":"2024-09-17T03:35:37.424464+0000","last_clean":"2024-09-17T03:35:37.424464+0000","last_became_active":"2024-09-17T03:35:31.408242+0000","last_became_peered":"2024-09-17T03:35:31.408242+0000","last_unstale":"2024-09-17T03:35:37.424464+0000","last_undegraded":"2024-09-17T03:35:37.424464+0000","last_fullsized":"2024-09-17T03:35:37.424464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:48.043675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952411+0000","last_change":"2024-09-17T03:35:32.402827+0000","last_active":"2024-09-17T03:35:37.952411+0000","last_peered":"2024-09-17T03:35:37.952411+0000","last_clean":"2024-09-17T03:35:37.952411+0000","last_became_active":"2024-09-17T03:35:32.402121+0000","last_became_peered":"2024-09-17T03:35:32.402121+0000","last_unstale":"2024-09-17T03:35:37.952411+0000","last_undegraded":"2024-09-17T03:35:37.952411+0000","last_fullsized":"2024-09-17T03:35:37.952411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:20.996960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952548+0000","last_change":"2024-09-17T03:35:36.438086+0000","last_active":"2024-09-17T03:35:37.952548+0000","last_peered":"2024-09-17T03:35:37.952548+0000","last_clean":"2024-09-17T03:35:37.952548+0000","last_became_active":"2024-09-17T03:35:36.437628+0000","last_became_peered":"2024-09-17T03:35:36.437628+0000","last_unstale":"2024-09-17T03:35:37.952548+0000","last_undegraded":"2024-09-17T03:35:37.952548+0000","last_fullsized":"2024-09-17T03:35:37.952548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:41.129499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429911+0000","last_change":"2024-09-17T03:35:31.400851+0000","last_active":"2024-09-17T03:35:37.429911+0000","last_peered":"2024-09-17T03:35:37.429911+0000","last_clean":"2024-09-17T03:35:37.429911+0000","last_became_active":"2024-09-17T03:35:31.400467+0000","last_became_peered":"2024-09-17T03:35:31.400467+0000","last_unstale":"2024-09-17T03:35:37.429911+0000","last_undegraded":"2024-09-17T03:35:37.429911+0000","last_fullsized":"2024-09-17T03:35:37.429911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:34.200886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328979+0000","last_change":"2024-09-17T03:35:32.415316+0000","last_active":"2024-09-17T03:35:38.328979+0000","last_peered":"2024-09-17T03:35:38.328979+0000","last_clean":"2024-09-17T03:35:38.328979+0000","last_became_active":"2024-09-17T03:35:32.415012+0000","last_became_peered":"2024-09-17T03:35:32.415012+0000","last_unstale":"2024-09-17T03:35:38.328979+0000","last_undegraded":"2024-09-17T03:35:38.328979+0000","last_fullsized":"2024-09-17T03:35:38.328979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:49.052343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329826+0000","last_change":"2024-09-17T03:35:36.458591+0000","last_active":"2024-09-17T03:35:38.329826+0000","last_peered":"2024-09-17T03:35:38.329826+0000","last_clean":"2024-09-17T03:35:38.329826+0000","last_became_active":"2024-09-17T03:35:36.458192+0000","last_became_peered":"2024-09-17T03:35:36.458192+0000","last_unstale":"2024-09-17T03:35:38.329826+0000","last_undegraded":"2024-09-17T03:35:38.329826+0000","last_fullsized":"2024-09-17T03:35:38.329826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:28.725625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328670+0000","last_change":"2024-09-17T03:35:32.389432+0000","last_active":"2024-09-17T03:35:38.328670+0000","last_peered":"2024-09-17T03:35:38.328670+0000","last_clean":"2024-09-17T03:35:38.328670+0000","last_became_active":"2024-09-17T03:35:32.389081+0000","last_became_peered":"2024-09-17T03:35:32.389081+0000","last_unstale":"2024-09-17T03:35:38.328670+0000","last_undegraded":"2024-09-17T03:35:38.328670+0000","last_fullsized":"2024-09-17T03:35:38.328670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:13.264493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329236+0000","last_change":"2024-09-17T03:35:32.390231+0000","last_active":"2024-09-17T03:35:38.329236+0000","last_peered":"2024-09-17T03:35:38.329236+0000","last_clean":"2024-09-17T03:35:38.329236+0000","last_became_active":"2024-09-17T03:35:32.389090+0000","last_became_peered":"2024-09-17T03:35:32.389090+0000","last_unstale":"2024-09-17T03:35:38.329236+0000","last_undegraded":"2024-09-17T03:35:38.329236+0000","last_fullsized":"2024-09-17T03:35:38.329236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:51.388149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423992+0000","last_change":"2024-09-17T03:35:32.417536+0000","last_active":"2024-09-17T03:35:37.423992+0000","last_peered":"2024-09-17T03:35:37.423992+0000","last_clean":"2024-09-17T03:35:37.423992+0000","last_became_active":"2024-09-17T03:35:32.415503+0000","last_became_peered":"2024-09-17T03:35:32.415503+0000","last_unstale":"2024-09-17T03:35:37.423992+0000","last_undegraded":"2024-09-17T03:35:37.423992+0000","last_fullsized":"2024-09-17T03:35:37.423992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:53.931551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429727+0000","last_change":"2024-09-17T03:35:32.417567+0000","last_active":"2024-09-17T03:35:37.429727+0000","last_peered":"2024-09-17T03:35:37.429727+0000","last_clean":"2024-09-17T03:35:37.429727+0000","last_became_active":"2024-09-17T03:35:32.416075+0000","last_became_peered":"2024-09-17T03:35:32.416075+0000","last_unstale":"2024-09-17T03:35:37.429727+0000","last_undegraded":"2024-09-17T03:35:37.429727+0000","last_fullsized":"2024-09-17T03:35:37.429727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:17.725156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430354+0000","last_change":"2024-09-17T03:35:32.398186+0000","last_active":"2024-09-17T03:35:37.430354+0000","last_peered":"2024-09-17T03:35:37.430354+0000","last_clean":"2024-09-17T03:35:37.430354+0000","last_became_active":"2024-09-17T03:35:32.397332+0000","last_became_peered":"2024-09-17T03:35:32.397332+0000","last_unstale":"2024-09-17T03:35:37.430354+0000","last_undegraded":"2024-09-17T03:35:37.430354+0000","last_fullsized":"2024-09-17T03:35:37.430354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:24.688946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429638+0000","last_change":"2024-09-17T03:35:32.398824+0000","last_active":"2024-09-17T03:35:37.429638+0000","last_peered":"2024-09-17T03:35:37.429638+0000","last_clean":"2024-09-17T03:35:37.429638+0000","last_became_active":"2024-09-17T03:35:32.398561+0000","last_became_peered":"2024-09-17T03:35:32.398561+0000","last_unstale":"2024-09-17T03:35:37.429638+0000","last_undegraded":"2024-09-17T03:35:37.429638+0000","last_fullsized":"2024-09-17T03:35:37.429638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:21.967856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329314+0000","last_change":"2024-09-17T03:35:32.407437+0000","last_active":"2024-09-17T03:35:38.329314+0000","last_peered":"2024-09-17T03:35:38.329314+0000","last_clean":"2024-09-17T03:35:38.329314+0000","last_became_active":"2024-09-17T03:35:32.391983+0000","last_became_peered":"2024-09-17T03:35:32.391983+0000","last_unstale":"2024-09-17T03:35:38.329314+0000","last_undegraded":"2024-09-17T03:35:38.329314+0000","last_fullsized":"2024-09-17T03:35:38.329314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:55.435612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430853+0000","last_change":"2024-09-17T03:35:32.420028+0000","last_active":"2024-09-17T03:35:37.430853+0000","last_peered":"2024-09-17T03:35:37.430853+0000","last_clean":"2024-09-17T03:35:37.430853+0000","last_became_active":"2024-09-17T03:35:32.419318+0000","last_became_peered":"2024-09-17T03:35:32.419318+0000","last_unstale":"2024-09-17T03:35:37.430853+0000","last_undegraded":"2024-09-17T03:35:37.430853+0000","last_fullsized":"2024-09-17T03:35:37.430853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:34.754662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423939+0000","last_change":"2024-09-17T03:35:32.404124+0000","last_active":"2024-09-17T03:35:37.423939+0000","last_peered":"2024-09-17T03:35:37.423939+0000","last_clean":"2024-09-17T03:35:37.423939+0000","last_became_active":"2024-09-17T03:35:32.401565+0000","last_became_peered":"2024-09-17T03:35:32.401565+0000","last_unstale":"2024-09-17T03:35:37.423939+0000","last_undegraded":"2024-09-17T03:35:37.423939+0000","last_fullsized":"2024-09-17T03:35:37.423939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428668+0000","last_change":"2024-09-17T03:35:32.416911+0000","last_active":"2024-09-17T03:35:37.428668+0000","last_peered":"2024-09-17T03:35:37.428668+0000","last_clean":"2024-09-17T03:35:37.428668+0000","last_became_active":"2024-09-17T03:35:32.416607+0000","last_became_peered":"2024-09-17T03:35:32.416607+0000","last_unstale":"2024-09-17T03:35:37.428668+0000","last_undegraded":"2024-09-17T03:35:37.428668+0000","last_fullsized":"2024-09-17T03:35:37.428668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:35.823308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328868+0000","last_change":"2024-09-17T03:35:32.402977+0000","last_active":"2024-09-17T03:35:38.328868+0000","last_peered":"2024-09-17T03:35:38.328868+0000","last_clean":"2024-09-17T03:35:38.328868+0000","last_became_active":"2024-09-17T03:35:32.400089+0000","last_became_peered":"2024-09-17T03:35:32.400089+0000","last_unstale":"2024-09-17T03:35:38.328868+0000","last_undegraded":"2024-09-17T03:35:38.328868+0000","last_fullsized":"2024-09-17T03:35:38.328868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:09.595197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952307+0000","last_change":"2024-09-17T03:35:32.410415+0000","last_active":"2024-09-17T03:35:37.952307+0000","last_peered":"2024-09-17T03:35:37.952307+0000","last_clean":"2024-09-17T03:35:37.952307+0000","last_became_active":"2024-09-17T03:35:32.410050+0000","last_became_peered":"2024-09-17T03:35:32.410050+0000","last_unstale":"2024-09-17T03:35:37.952307+0000","last_undegraded":"2024-09-17T03:35:37.952307+0000","last_fullsized":"2024-09-17T03:35:37.952307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:50.438068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716881+0000","last_change":"2024-09-17T03:35:32.395551+0000","last_active":"2024-09-17T03:35:37.716881+0000","last_peered":"2024-09-17T03:35:37.716881+0000","last_clean":"2024-09-17T03:35:37.716881+0000","last_became_active":"2024-09-17T03:35:32.395266+0000","last_became_peered":"2024-09-17T03:35:32.395266+0000","last_unstale":"2024-09-17T03:35:37.716881+0000","last_undegraded":"2024-09-17T03:35:37.716881+0000","last_fullsized":"2024-09-17T03:35:37.716881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:54.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424777+0000","last_change":"2024-09-17T03:35:32.406349+0000","last_active":"2024-09-17T03:35:37.424777+0000","last_peered":"2024-09-17T03:35:37.424777+0000","last_clean":"2024-09-17T03:35:37.424777+0000","last_became_active":"2024-09-17T03:35:32.406083+0000","last_became_peered":"2024-09-17T03:35:32.406083+0000","last_unstale":"2024-09-17T03:35:37.424777+0000","last_undegraded":"2024-09-17T03:35:37.424777+0000","last_fullsized":"2024-09-17T03:35:37.424777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:28.801756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330010+0000","last_change":"2024-09-17T03:35:32.412025+0000","last_active":"2024-09-17T03:35:38.330010+0000","last_peered":"2024-09-17T03:35:38.330010+0000","last_clean":"2024-09-17T03:35:38.330010+0000","last_became_active":"2024-09-17T03:35:32.411770+0000","last_became_peered":"2024-09-17T03:35:32.411770+0000","last_unstale":"2024-09-17T03:35:38.330010+0000","last_undegraded":"2024-09-17T03:35:38.330010+0000","last_fullsized":"2024-09-17T03:35:38.330010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.040918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424666+0000","last_change":"2024-09-17T03:35:32.405664+0000","last_active":"2024-09-17T03:35:37.424666+0000","last_peered":"2024-09-17T03:35:37.424666+0000","last_clean":"2024-09-17T03:35:37.424666+0000","last_became_active":"2024-09-17T03:35:32.401871+0000","last_became_peered":"2024-09-17T03:35:32.401871+0000","last_unstale":"2024-09-17T03:35:37.424666+0000","last_undegraded":"2024-09-17T03:35:37.424666+0000","last_fullsized":"2024-09-17T03:35:37.424666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:11.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423851+0000","last_change":"2024-09-17T03:35:32.421664+0000","last_active":"2024-09-17T03:35:37.423851+0000","last_peered":"2024-09-17T03:35:37.423851+0000","last_clean":"2024-09-17T03:35:37.423851+0000","last_became_active":"2024-09-17T03:35:32.416736+0000","last_became_peered":"2024-09-17T03:35:32.416736+0000","last_unstale":"2024-09-17T03:35:37.423851+0000","last_undegraded":"2024-09-17T03:35:37.423851+0000","last_fullsized":"2024-09-17T03:35:37.423851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:42.709250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428434+0000","last_change":"2024-09-17T03:35:32.401461+0000","last_active":"2024-09-17T03:35:37.428434+0000","last_peered":"2024-09-17T03:35:37.428434+0000","last_clean":"2024-09-17T03:35:37.428434+0000","last_became_active":"2024-09-17T03:35:32.400913+0000","last_became_peered":"2024-09-17T03:35:32.400913+0000","last_unstale":"2024-09-17T03:35:37.428434+0000","last_undegraded":"2024-09-17T03:35:37.428434+0000","last_fullsized":"2024-09-17T03:35:37.428434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:50.140695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428853+0000","last_change":"2024-09-17T03:35:32.388327+0000","last_active":"2024-09-17T03:35:37.428853+0000","last_peered":"2024-09-17T03:35:37.428853+0000","last_clean":"2024-09-17T03:35:37.428853+0000","last_became_active":"2024-09-17T03:35:32.387938+0000","last_became_peered":"2024-09-17T03:35:32.387938+0000","last_unstale":"2024-09-17T03:35:37.428853+0000","last_undegraded":"2024-09-17T03:35:37.428853+0000","last_fullsized":"2024-09-17T03:35:37.428853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:08.067720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430492+0000","last_change":"2024-09-17T03:35:32.397331+0000","last_active":"2024-09-17T03:35:37.430492+0000","last_peered":"2024-09-17T03:35:37.430492+0000","last_clean":"2024-09-17T03:35:37.430492+0000","last_became_active":"2024-09-17T03:35:32.395724+0000","last_became_peered":"2024-09-17T03:35:32.395724+0000","last_unstale":"2024-09-17T03:35:37.430492+0000","last_undegraded":"2024-09-17T03:35:37.430492+0000","last_fullsized":"2024-09-17T03:35:37.430492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:41.794850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716601+0000","last_change":"2024-09-17T03:35:32.395931+0000","last_active":"2024-09-17T03:35:37.716601+0000","last_peered":"2024-09-17T03:35:37.716601+0000","last_clean":"2024-09-17T03:35:37.716601+0000","last_became_active":"2024-09-17T03:35:32.395572+0000","last_became_peered":"2024-09-17T03:35:32.395572+0000","last_unstale":"2024-09-17T03:35:37.716601+0000","last_undegraded":"2024-09-17T03:35:37.716601+0000","last_fullsized":"2024-09-17T03:35:37.716601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:50.658760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716469+0000","last_change":"2024-09-17T03:35:32.398836+0000","last_active":"2024-09-17T03:35:37.716469+0000","last_peered":"2024-09-17T03:35:37.716469+0000","last_clean":"2024-09-17T03:35:37.716469+0000","last_became_active":"2024-09-17T03:35:32.398500+0000","last_became_peered":"2024-09-17T03:35:32.398500+0000","last_unstale":"2024-09-17T03:35:37.716469+0000","last_undegraded":"2024-09-17T03:35:37.716469+0000","last_fullsized":"2024-09-17T03:35:37.716469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:49.687153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716483+0000","last_change":"2024-09-17T03:35:32.414484+0000","last_active":"2024-09-17T03:35:37.716483+0000","last_peered":"2024-09-17T03:35:37.716483+0000","last_clean":"2024-09-17T03:35:37.716483+0000","last_became_active":"2024-09-17T03:35:32.414165+0000","last_became_peered":"2024-09-17T03:35:32.414165+0000","last_unstale":"2024-09-17T03:35:37.716483+0000","last_undegraded":"2024-09-17T03:35:37.716483+0000","last_fullsized":"2024-09-17T03:35:37.716483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:06.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329649+0000","last_change":"2024-09-17T03:35:32.396020+0000","last_active":"2024-09-17T03:35:38.329649+0000","last_peered":"2024-09-17T03:35:38.329649+0000","last_clean":"2024-09-17T03:35:38.329649+0000","last_became_active":"2024-09-17T03:35:32.395701+0000","last_became_peered":"2024-09-17T03:35:32.395701+0000","last_unstale":"2024-09-17T03:35:38.329649+0000","last_undegraded":"2024-09-17T03:35:38.329649+0000","last_fullsized":"2024-09-17T03:35:38.329649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:44.791275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428123+0000","last_change":"2024-09-17T03:35:32.405817+0000","last_active":"2024-09-17T03:35:37.428123+0000","last_peered":"2024-09-17T03:35:37.428123+0000","last_clean":"2024-09-17T03:35:37.428123+0000","last_became_active":"2024-09-17T03:35:32.401125+0000","last_became_peered":"2024-09-17T03:35:32.401125+0000","last_unstale":"2024-09-17T03:35:37.428123+0000","last_undegraded":"2024-09-17T03:35:37.428123+0000","last_fullsized":"2024-09-17T03:35:37.428123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:44.639162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716409+0000","last_change":"2024-09-17T03:35:32.406706+0000","last_active":"2024-09-17T03:35:37.716409+0000","last_peered":"2024-09-17T03:35:37.716409+0000","last_clean":"2024-09-17T03:35:37.716409+0000","last_became_active":"2024-09-17T03:35:32.406380+0000","last_became_peered":"2024-09-17T03:35:32.406380+0000","last_unstale":"2024-09-17T03:35:37.716409+0000","last_undegraded":"2024-09-17T03:35:37.716409+0000","last_fullsized":"2024-09-17T03:35:37.716409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:35.823308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330231+0000","last_change":"2024-09-17T03:35:32.409026+0000","last_active":"2024-09-17T03:35:38.330231+0000","last_peered":"2024-09-17T03:35:38.330231+0000","last_clean":"2024-09-17T03:35:38.330231+0000","last_became_active":"2024-09-17T03:35:32.408678+0000","last_became_peered":"2024-09-17T03:35:32.408678+0000","last_unstale":"2024-09-17T03:35:38.330231+0000","last_undegraded":"2024-09-17T03:35:38.330231+0000","last_fullsized":"2024-09-17T03:35:38.330231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:57.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716319+0000","last_change":"2024-09-17T03:35:32.417998+0000","last_active":"2024-09-17T03:35:37.716319+0000","last_peered":"2024-09-17T03:35:37.716319+0000","last_clean":"2024-09-17T03:35:37.716319+0000","last_became_active":"2024-09-17T03:35:32.417698+0000","last_became_peered":"2024-09-17T03:35:32.417698+0000","last_unstale":"2024-09-17T03:35:37.716319+0000","last_undegraded":"2024-09-17T03:35:37.716319+0000","last_fullsized":"2024-09-17T03:35:37.716319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:17.076410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329887+0000","last_change":"2024-09-17T03:35:32.400692+0000","last_active":"2024-09-17T03:35:38.329887+0000","last_peered":"2024-09-17T03:35:38.329887+0000","last_clean":"2024-09-17T03:35:38.329887+0000","last_became_active":"2024-09-17T03:35:32.400221+0000","last_became_peered":"2024-09-17T03:35:32.400221+0000","last_unstale":"2024-09-17T03:35:38.329887+0000","last_undegraded":"2024-09-17T03:35:38.329887+0000","last_fullsized":"2024-09-17T03:35:38.329887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:26.763129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430145+0000","last_change":"2024-09-17T03:35:32.415375+0000","last_active":"2024-09-17T03:35:37.430145+0000","last_peered":"2024-09-17T03:35:37.430145+0000","last_clean":"2024-09-17T03:35:37.430145+0000","last_became_active":"2024-09-17T03:35:32.415017+0000","last_became_peered":"2024-09-17T03:35:32.415017+0000","last_unstale":"2024-09-17T03:35:37.430145+0000","last_undegraded":"2024-09-17T03:35:37.430145+0000","last_fullsized":"2024-09-17T03:35:37.430145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:50.658760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430308+0000","last_change":"2024-09-17T03:35:32.415726+0000","last_active":"2024-09-17T03:35:37.430308+0000","last_peered":"2024-09-17T03:35:37.430308+0000","last_clean":"2024-09-17T03:35:37.430308+0000","last_became_active":"2024-09-17T03:35:32.415405+0000","last_became_peered":"2024-09-17T03:35:32.415405+0000","last_unstale":"2024-09-17T03:35:37.430308+0000","last_undegraded":"2024-09-17T03:35:37.430308+0000","last_fullsized":"2024-09-17T03:35:37.430308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:54.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716587+0000","last_change":"2024-09-17T03:35:32.398919+0000","last_active":"2024-09-17T03:35:37.716587+0000","last_peered":"2024-09-17T03:35:37.716587+0000","last_clean":"2024-09-17T03:35:37.716587+0000","last_became_active":"2024-09-17T03:35:32.398610+0000","last_became_peered":"2024-09-17T03:35:32.398610+0000","last_unstale":"2024-09-17T03:35:37.716587+0000","last_undegraded":"2024-09-17T03:35:37.716587+0000","last_fullsized":"2024-09-17T03:35:37.716587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:32.277026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:35:56.901 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:35:57.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.154+0000 7f027f200640 1 -- 172.21.15.121:0/2359918534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028006d7f0 msgr2=0x7f0280154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:57.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.154+0000 7f027f200640 1 --2- 172.21.15.121:0/2359918534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028006d7f0 0x7f0280154ea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f02800d5180 tx=0x7f027802aa30 comp rx=0 tx=0).stop 2024-09-17T03:35:57.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.154+0000 7f027f200640 1 -- 172.21.15.121:0/2359918534 shutdown_connections 2024-09-17T03:35:57.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.154+0000 7f027f200640 1 --2- 172.21.15.121:0/2359918534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028006d7f0 0x7f0280154ea0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.154+0000 7f027f200640 1 --2- 172.21.15.121:0/2359918534 >> v2:172.21.15.176:3300/0 conn(0x7f02801627f0 0x7f028006d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.154+0000 7f027f200640 1 --2- 172.21.15.121:0/2359918534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02800b9e40 0x7f02801622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.154+0000 7f027f200640 1 -- 172.21.15.121:0/2359918534 >> 172.21.15.121:0/2359918534 conn(0x7f02800d1930 msgr2=0x7f02800d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:57.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.154+0000 7f027f200640 1 -- 172.21.15.121:0/2359918534 shutdown_connections 2024-09-17T03:35:57.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.154+0000 7f027f200640 1 -- 172.21.15.121:0/2359918534 wait complete. 2024-09-17T03:35:57.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.156+0000 7f027f200640 1 Processor -- start 2024-09-17T03:35:57.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.156+0000 7f027f200640 1 -- start start 2024-09-17T03:35:57.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028006d7f0 0x7f02801508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:57.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02800b9e40 0x7f02800ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:57.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02801627f0 0x7f02800cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:57.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027f200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0280155770 con 0x7f028006d7f0 2024-09-17T03:35:57.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f02801555f0 con 0x7f02800b9e40 2024-09-17T03:35:57.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f02801558f0 con 0x7f02801627f0 2024-09-17T03:35:57.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028006d7f0 0x7f02801508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:57.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028006d7f0 0x7f02801508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45904/0 (socket says 172.21.15.121:45904) 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027de00640 1 -- 172.21.15.121:0/2602732908 learned_addr learned my addr 172.21.15.121:0/2602732908 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027e800640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02801627f0 0x7f02800cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f0275400640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02800b9e40 0x7f02800ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027de00640 1 -- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02801627f0 msgr2=0x7f02800cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027de00640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02801627f0 0x7f02800cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027de00640 1 -- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02800b9e40 msgr2=0x7f02800ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027de00640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02800b9e40 0x7f02800ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.158+0000 7f027de00640 1 -- 172.21.15.121:0/2602732908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0280151440 con 0x7f028006d7f0 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.159+0000 7f027de00640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028006d7f0 0x7f02801508d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f027000d720 tx=0x7f027000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.159+0000 7f0276a00640 1 -- 172.21.15.121:0/2602732908 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270017070 con 0x7f028006d7f0 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.159+0000 7f0276a00640 1 -- 172.21.15.121:0/2602732908 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0270009ab0 con 0x7f028006d7f0 2024-09-17T03:35:57.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.159+0000 7f027f200640 1 -- 172.21.15.121:0/2602732908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02801f8770 con 0x7f028006d7f0 2024-09-17T03:35:57.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.159+0000 7f0276a00640 1 -- 172.21.15.121:0/2602732908 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270010460 con 0x7f028006d7f0 2024-09-17T03:35:57.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.159+0000 7f027f200640 1 -- 172.21.15.121:0/2602732908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02801f8d30 con 0x7f028006d7f0 2024-09-17T03:35:57.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.160+0000 7f027f200640 1 -- 172.21.15.121:0/2602732908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02801622b0 con 0x7f028006d7f0 2024-09-17T03:35:57.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.161+0000 7f0276a00640 1 -- 172.21.15.121:0/2602732908 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f027001a070 con 0x7f028006d7f0 2024-09-17T03:35:57.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.163+0000 7f0276a00640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f025c078b90 0x7f025c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:57.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.163+0000 7f0276a00640 1 -- 172.21.15.121:0/2602732908 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f027009b190 con 0x7f028006d7f0 2024-09-17T03:35:57.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.163+0000 7f0275400640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f025c078b90 0x7f025c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:57.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.164+0000 7f0275400640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f025c078b90 0x7f025c07b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0280157e10 tx=0x7f026800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.167+0000 7f0276a00640 1 -- 172.21.15.121:0/2602732908 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0270062ba0 con 0x7f028006d7f0 2024-09-17T03:35:57.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.347+0000 7f027f200640 1 -- 172.21.15.121:0/2602732908 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02800b7210 con 0x7f025c078b90 2024-09-17T03:35:57.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.353+0000 7f0276a00640 1 -- 172.21.15.121:0/2602732908 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f02800b7210 con 0x7f025c078b90 2024-09-17T03:35:57.358 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:57.360 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:35:57.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.358+0000 7f027f200640 1 -- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f025c078b90 msgr2=0x7f025c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:57.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.358+0000 7f027f200640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f025c078b90 0x7f025c07b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0280157e10 tx=0x7f026800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.358+0000 7f027f200640 1 -- 172.21.15.121:0/2602732908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028006d7f0 msgr2=0x7f02801508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:57.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.358+0000 7f027f200640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028006d7f0 0x7f02801508d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f027000d720 tx=0x7f027000dbe0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.358+0000 7f027f200640 1 -- 172.21.15.121:0/2602732908 shutdown_connections 2024-09-17T03:35:57.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.358+0000 7f027f200640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02801627f0 0x7f02800cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.358+0000 7f027f200640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02800b9e40 0x7f02800ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.358+0000 7f027f200640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f025c078b90 0x7f025c07b0a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.358+0000 7f027f200640 1 --2- 172.21.15.121:0/2602732908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f028006d7f0 0x7f02801508d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.358+0000 7f027f200640 1 -- 172.21.15.121:0/2602732908 >> 172.21.15.121:0/2602732908 conn(0x7f02800d1930 msgr2=0x7f02800d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:57.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.359+0000 7f027f200640 1 -- 172.21.15.121:0/2602732908 shutdown_connections 2024-09-17T03:35:57.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.359+0000 7f027f200640 1 -- 172.21.15.121:0/2602732908 wait complete. 2024-09-17T03:35:57.380 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-17T03:35:57.283317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003429"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952940+0000","last_change":"2024-09-17T03:35:31.396637+0000","last_active":"2024-09-17T03:35:37.952940+0000","last_peered":"2024-09-17T03:35:37.952940+0000","last_clean":"2024-09-17T03:35:37.952940+0000","last_became_active":"2024-09-17T03:35:31.396194+0000","last_became_peered":"2024-09-17T03:35:31.396194+0000","last_unstale":"2024-09-17T03:35:37.952940+0000","last_undegraded":"2024-09-17T03:35:37.952940+0000","last_fullsized":"2024-09-17T03:35:37.952940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:58.587185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430670+0000","last_change":"2024-09-17T03:35:32.419807+0000","last_active":"2024-09-17T03:35:37.430670+0000","last_peered":"2024-09-17T03:35:37.430670+0000","last_clean":"2024-09-17T03:35:37.430670+0000","last_became_active":"2024-09-17T03:35:32.419516+0000","last_became_peered":"2024-09-17T03:35:32.419516+0000","last_unstale":"2024-09-17T03:35:37.430670+0000","last_undegraded":"2024-09-17T03:35:37.430670+0000","last_fullsized":"2024-09-17T03:35:37.430670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:18.848416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329189+0000","last_change":"2024-09-17T03:35:36.457719+0000","last_active":"2024-09-17T03:35:38.329189+0000","last_peered":"2024-09-17T03:35:38.329189+0000","last_clean":"2024-09-17T03:35:38.329189+0000","last_became_active":"2024-09-17T03:35:36.457049+0000","last_became_peered":"2024-09-17T03:35:36.457049+0000","last_unstale":"2024-09-17T03:35:38.329189+0000","last_undegraded":"2024-09-17T03:35:38.329189+0000","last_fullsized":"2024-09-17T03:35:38.329189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:26.004535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430809+0000","last_change":"2024-09-17T03:35:31.405486+0000","last_active":"2024-09-17T03:35:37.430809+0000","last_peered":"2024-09-17T03:35:37.430809+0000","last_clean":"2024-09-17T03:35:37.430809+0000","last_became_active":"2024-09-17T03:35:31.405174+0000","last_became_peered":"2024-09-17T03:35:31.405174+0000","last_unstale":"2024-09-17T03:35:37.430809+0000","last_undegraded":"2024-09-17T03:35:37.430809+0000","last_fullsized":"2024-09-17T03:35:37.430809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:50.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430989+0000","last_change":"2024-09-17T03:35:32.420131+0000","last_active":"2024-09-17T03:35:37.430989+0000","last_peered":"2024-09-17T03:35:37.430989+0000","last_clean":"2024-09-17T03:35:37.430989+0000","last_became_active":"2024-09-17T03:35:32.419301+0000","last_became_peered":"2024-09-17T03:35:32.419301+0000","last_unstale":"2024-09-17T03:35:37.430989+0000","last_undegraded":"2024-09-17T03:35:37.430989+0000","last_fullsized":"2024-09-17T03:35:37.430989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328550+0000","last_change":"2024-09-17T03:35:36.448725+0000","last_active":"2024-09-17T03:35:38.328550+0000","last_peered":"2024-09-17T03:35:38.328550+0000","last_clean":"2024-09-17T03:35:38.328550+0000","last_became_active":"2024-09-17T03:35:36.448306+0000","last_became_peered":"2024-09-17T03:35:36.448306+0000","last_unstale":"2024-09-17T03:35:38.328550+0000","last_undegraded":"2024-09-17T03:35:38.328550+0000","last_fullsized":"2024-09-17T03:35:38.328550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:38.297846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716849+0000","last_change":"2024-09-17T03:35:31.406863+0000","last_active":"2024-09-17T03:35:37.716849+0000","last_peered":"2024-09-17T03:35:37.716849+0000","last_clean":"2024-09-17T03:35:37.716849+0000","last_became_active":"2024-09-17T03:35:31.405716+0000","last_became_peered":"2024-09-17T03:35:31.405716+0000","last_unstale":"2024-09-17T03:35:37.716849+0000","last_undegraded":"2024-09-17T03:35:37.716849+0000","last_fullsized":"2024-09-17T03:35:37.716849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:25.988144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329090+0000","last_change":"2024-09-17T03:35:32.404862+0000","last_active":"2024-09-17T03:35:38.329090+0000","last_peered":"2024-09-17T03:35:38.329090+0000","last_clean":"2024-09-17T03:35:38.329090+0000","last_became_active":"2024-09-17T03:35:32.403799+0000","last_became_peered":"2024-09-17T03:35:32.403799+0000","last_unstale":"2024-09-17T03:35:38.329090+0000","last_undegraded":"2024-09-17T03:35:38.329090+0000","last_fullsized":"2024-09-17T03:35:38.329090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.040918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329212+0000","last_change":"2024-09-17T03:35:36.442226+0000","last_active":"2024-09-17T03:35:38.329212+0000","last_peered":"2024-09-17T03:35:38.329212+0000","last_clean":"2024-09-17T03:35:38.329212+0000","last_became_active":"2024-09-17T03:35:36.441650+0000","last_became_peered":"2024-09-17T03:35:36.441650+0000","last_unstale":"2024-09-17T03:35:38.329212+0000","last_undegraded":"2024-09-17T03:35:38.329212+0000","last_fullsized":"2024-09-17T03:35:38.329212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:53.723832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716982+0000","last_change":"2024-09-17T03:35:31.402468+0000","last_active":"2024-09-17T03:35:37.716982+0000","last_peered":"2024-09-17T03:35:37.716982+0000","last_clean":"2024-09-17T03:35:37.716982+0000","last_became_active":"2024-09-17T03:35:31.400527+0000","last_became_peered":"2024-09-17T03:35:31.400527+0000","last_unstale":"2024-09-17T03:35:37.716982+0000","last_undegraded":"2024-09-17T03:35:37.716982+0000","last_fullsized":"2024-09-17T03:35:37.716982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:34.200886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424506+0000","last_change":"2024-09-17T03:35:32.399680+0000","last_active":"2024-09-17T03:35:37.424506+0000","last_peered":"2024-09-17T03:35:37.424506+0000","last_clean":"2024-09-17T03:35:37.424506+0000","last_became_active":"2024-09-17T03:35:32.399385+0000","last_became_peered":"2024-09-17T03:35:32.399385+0000","last_unstale":"2024-09-17T03:35:37.424506+0000","last_undegraded":"2024-09-17T03:35:37.424506+0000","last_fullsized":"2024-09-17T03:35:37.424506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:43.868900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328684+0000","last_change":"2024-09-17T03:35:36.454547+0000","last_active":"2024-09-17T03:35:38.328684+0000","last_peered":"2024-09-17T03:35:38.328684+0000","last_clean":"2024-09-17T03:35:38.328684+0000","last_became_active":"2024-09-17T03:35:36.452245+0000","last_became_peered":"2024-09-17T03:35:36.452245+0000","last_unstale":"2024-09-17T03:35:38.328684+0000","last_undegraded":"2024-09-17T03:35:38.328684+0000","last_fullsized":"2024-09-17T03:35:38.328684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:21.761835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424041+0000","last_change":"2024-09-17T03:35:32.389915+0000","last_active":"2024-09-17T03:35:37.424041+0000","last_peered":"2024-09-17T03:35:37.424041+0000","last_clean":"2024-09-17T03:35:37.424041+0000","last_became_active":"2024-09-17T03:35:32.389629+0000","last_became_peered":"2024-09-17T03:35:32.389629+0000","last_unstale":"2024-09-17T03:35:37.424041+0000","last_undegraded":"2024-09-17T03:35:37.424041+0000","last_fullsized":"2024-09-17T03:35:37.424041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:37.978604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424108+0000","last_change":"2024-09-17T03:35:31.399927+0000","last_active":"2024-09-17T03:35:37.424108+0000","last_peered":"2024-09-17T03:35:37.424108+0000","last_clean":"2024-09-17T03:35:37.424108+0000","last_became_active":"2024-09-17T03:35:31.399633+0000","last_became_peered":"2024-09-17T03:35:31.399633+0000","last_unstale":"2024-09-17T03:35:37.424108+0000","last_undegraded":"2024-09-17T03:35:37.424108+0000","last_fullsized":"2024-09-17T03:35:37.424108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:54.701924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424308+0000","last_change":"2024-09-17T03:35:36.441343+0000","last_active":"2024-09-17T03:35:37.424308+0000","last_peered":"2024-09-17T03:35:37.424308+0000","last_clean":"2024-09-17T03:35:37.424308+0000","last_became_active":"2024-09-17T03:35:36.440928+0000","last_became_peered":"2024-09-17T03:35:36.440928+0000","last_unstale":"2024-09-17T03:35:37.424308+0000","last_undegraded":"2024-09-17T03:35:37.424308+0000","last_fullsized":"2024-09-17T03:35:37.424308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:30.901575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329519+0000","last_change":"2024-09-17T03:35:32.392491+0000","last_active":"2024-09-17T03:35:38.329519+0000","last_peered":"2024-09-17T03:35:38.329519+0000","last_clean":"2024-09-17T03:35:38.329519+0000","last_became_active":"2024-09-17T03:35:32.392158+0000","last_became_peered":"2024-09-17T03:35:32.392158+0000","last_unstale":"2024-09-17T03:35:38.329519+0000","last_undegraded":"2024-09-17T03:35:38.329519+0000","last_fullsized":"2024-09-17T03:35:38.329519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:09.595197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429614+0000","last_change":"2024-09-17T03:35:31.402340+0000","last_active":"2024-09-17T03:35:37.429614+0000","last_peered":"2024-09-17T03:35:37.429614+0000","last_clean":"2024-09-17T03:35:37.429614+0000","last_became_active":"2024-09-17T03:35:31.401416+0000","last_became_peered":"2024-09-17T03:35:31.401416+0000","last_unstale":"2024-09-17T03:35:37.429614+0000","last_undegraded":"2024-09-17T03:35:37.429614+0000","last_fullsized":"2024-09-17T03:35:37.429614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716700+0000","last_change":"2024-09-17T03:35:36.447535+0000","last_active":"2024-09-17T03:35:37.716700+0000","last_peered":"2024-09-17T03:35:37.716700+0000","last_clean":"2024-09-17T03:35:37.716700+0000","last_became_active":"2024-09-17T03:35:36.447090+0000","last_became_peered":"2024-09-17T03:35:36.447090+0000","last_unstale":"2024-09-17T03:35:37.716700+0000","last_undegraded":"2024-09-17T03:35:37.716700+0000","last_fullsized":"2024-09-17T03:35:37.716700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:23.237213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.951840+0000","last_change":"2024-09-17T03:35:32.400250+0000","last_active":"2024-09-17T03:35:37.951840+0000","last_peered":"2024-09-17T03:35:37.951840+0000","last_clean":"2024-09-17T03:35:37.951840+0000","last_became_active":"2024-09-17T03:35:32.399895+0000","last_became_peered":"2024-09-17T03:35:32.399895+0000","last_unstale":"2024-09-17T03:35:37.951840+0000","last_undegraded":"2024-09-17T03:35:37.951840+0000","last_fullsized":"2024-09-17T03:35:37.951840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:55.236620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952361+0000","last_change":"2024-09-17T03:35:31.407356+0000","last_active":"2024-09-17T03:35:37.952361+0000","last_peered":"2024-09-17T03:35:37.952361+0000","last_clean":"2024-09-17T03:35:37.952361+0000","last_became_active":"2024-09-17T03:35:31.407074+0000","last_became_peered":"2024-09-17T03:35:31.407074+0000","last_unstale":"2024-09-17T03:35:37.952361+0000","last_undegraded":"2024-09-17T03:35:37.952361+0000","last_fullsized":"2024-09-17T03:35:37.952361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:05.229644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329905+0000","last_change":"2024-09-17T03:35:36.460644+0000","last_active":"2024-09-17T03:35:38.329905+0000","last_peered":"2024-09-17T03:35:38.329905+0000","last_clean":"2024-09-17T03:35:38.329905+0000","last_became_active":"2024-09-17T03:35:36.460097+0000","last_became_peered":"2024-09-17T03:35:36.460097+0000","last_unstale":"2024-09-17T03:35:38.329905+0000","last_undegraded":"2024-09-17T03:35:38.329905+0000","last_fullsized":"2024-09-17T03:35:38.329905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:48.675841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424083+0000","last_change":"2024-09-17T03:35:32.405208+0000","last_active":"2024-09-17T03:35:37.424083+0000","last_peered":"2024-09-17T03:35:37.424083+0000","last_clean":"2024-09-17T03:35:37.424083+0000","last_became_active":"2024-09-17T03:35:32.404935+0000","last_became_peered":"2024-09-17T03:35:32.404935+0000","last_unstale":"2024-09-17T03:35:37.424083+0000","last_undegraded":"2024-09-17T03:35:37.424083+0000","last_fullsized":"2024-09-17T03:35:37.424083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:29.377565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716031+0000","last_change":"2024-09-17T03:35:31.402429+0000","last_active":"2024-09-17T03:35:37.716031+0000","last_peered":"2024-09-17T03:35:37.716031+0000","last_clean":"2024-09-17T03:35:37.716031+0000","last_became_active":"2024-09-17T03:35:31.400904+0000","last_became_peered":"2024-09-17T03:35:31.400904+0000","last_unstale":"2024-09-17T03:35:37.716031+0000","last_undegraded":"2024-09-17T03:35:37.716031+0000","last_fullsized":"2024-09-17T03:35:37.716031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:35.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329137+0000","last_change":"2024-09-17T03:35:36.439897+0000","last_active":"2024-09-17T03:35:38.329137+0000","last_peered":"2024-09-17T03:35:38.329137+0000","last_clean":"2024-09-17T03:35:38.329137+0000","last_became_active":"2024-09-17T03:35:36.439451+0000","last_became_peered":"2024-09-17T03:35:36.439451+0000","last_unstale":"2024-09-17T03:35:38.329137+0000","last_undegraded":"2024-09-17T03:35:38.329137+0000","last_fullsized":"2024-09-17T03:35:38.329137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:21.113089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952643+0000","last_change":"2024-09-17T03:35:32.397257+0000","last_active":"2024-09-17T03:35:37.952643+0000","last_peered":"2024-09-17T03:35:37.952643+0000","last_clean":"2024-09-17T03:35:37.952643+0000","last_became_active":"2024-09-17T03:35:32.396876+0000","last_became_peered":"2024-09-17T03:35:32.396876+0000","last_unstale":"2024-09-17T03:35:37.952643+0000","last_undegraded":"2024-09-17T03:35:37.952643+0000","last_fullsized":"2024-09-17T03:35:37.952643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:28.702200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424791+0000","last_change":"2024-09-17T03:35:31.409394+0000","last_active":"2024-09-17T03:35:37.424791+0000","last_peered":"2024-09-17T03:35:37.424791+0000","last_clean":"2024-09-17T03:35:37.424791+0000","last_became_active":"2024-09-17T03:35:31.408980+0000","last_became_peered":"2024-09-17T03:35:31.408980+0000","last_unstale":"2024-09-17T03:35:37.424791+0000","last_undegraded":"2024-09-17T03:35:37.424791+0000","last_fullsized":"2024-09-17T03:35:37.424791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:55.652949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329294+0000","last_change":"2024-09-17T03:35:36.436456+0000","last_active":"2024-09-17T03:35:38.329294+0000","last_peered":"2024-09-17T03:35:38.329294+0000","last_clean":"2024-09-17T03:35:38.329294+0000","last_became_active":"2024-09-17T03:35:36.435668+0000","last_became_peered":"2024-09-17T03:35:36.435668+0000","last_unstale":"2024-09-17T03:35:38.329294+0000","last_undegraded":"2024-09-17T03:35:38.329294+0000","last_fullsized":"2024-09-17T03:35:38.329294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:22.885095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952829+0000","last_change":"2024-09-17T03:35:32.401092+0000","last_active":"2024-09-17T03:35:37.952829+0000","last_peered":"2024-09-17T03:35:37.952829+0000","last_clean":"2024-09-17T03:35:37.952829+0000","last_became_active":"2024-09-17T03:35:32.400788+0000","last_became_peered":"2024-09-17T03:35:32.400788+0000","last_unstale":"2024-09-17T03:35:37.952829+0000","last_undegraded":"2024-09-17T03:35:37.952829+0000","last_fullsized":"2024-09-17T03:35:37.952829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:48.624702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952865+0000","last_change":"2024-09-17T03:35:31.409840+0000","last_active":"2024-09-17T03:35:37.952865+0000","last_peered":"2024-09-17T03:35:37.952865+0000","last_clean":"2024-09-17T03:35:37.952865+0000","last_became_active":"2024-09-17T03:35:31.409588+0000","last_became_peered":"2024-09-17T03:35:31.409588+0000","last_unstale":"2024-09-17T03:35:37.952865+0000","last_undegraded":"2024-09-17T03:35:37.952865+0000","last_fullsized":"2024-09-17T03:35:37.952865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:48.768703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.951931+0000","last_change":"2024-09-17T03:35:36.434767+0000","last_active":"2024-09-17T03:35:37.951931+0000","last_peered":"2024-09-17T03:35:37.951931+0000","last_clean":"2024-09-17T03:35:37.951931+0000","last_became_active":"2024-09-17T03:35:36.432238+0000","last_became_peered":"2024-09-17T03:35:36.432238+0000","last_unstale":"2024-09-17T03:35:37.951931+0000","last_undegraded":"2024-09-17T03:35:37.951931+0000","last_fullsized":"2024-09-17T03:35:37.951931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:42.117587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430388+0000","last_change":"2024-09-17T03:35:32.415405+0000","last_active":"2024-09-17T03:35:37.430388+0000","last_peered":"2024-09-17T03:35:37.430388+0000","last_clean":"2024-09-17T03:35:37.430388+0000","last_became_active":"2024-09-17T03:35:32.415059+0000","last_became_peered":"2024-09-17T03:35:32.415059+0000","last_unstale":"2024-09-17T03:35:37.430388+0000","last_undegraded":"2024-09-17T03:35:37.430388+0000","last_fullsized":"2024-09-17T03:35:37.430388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:03.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424840+0000","last_change":"2024-09-17T03:35:31.396414+0000","last_active":"2024-09-17T03:35:37.424840+0000","last_peered":"2024-09-17T03:35:37.424840+0000","last_clean":"2024-09-17T03:35:37.424840+0000","last_became_active":"2024-09-17T03:35:31.395858+0000","last_became_peered":"2024-09-17T03:35:31.395858+0000","last_unstale":"2024-09-17T03:35:37.424840+0000","last_undegraded":"2024-09-17T03:35:37.424840+0000","last_fullsized":"2024-09-17T03:35:37.424840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:48.032251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429676+0000","last_change":"2024-09-17T03:35:36.454944+0000","last_active":"2024-09-17T03:35:37.429676+0000","last_peered":"2024-09-17T03:35:37.429676+0000","last_clean":"2024-09-17T03:35:37.429676+0000","last_became_active":"2024-09-17T03:35:36.452999+0000","last_became_peered":"2024-09-17T03:35:36.452999+0000","last_unstale":"2024-09-17T03:35:37.429676+0000","last_undegraded":"2024-09-17T03:35:37.429676+0000","last_fullsized":"2024-09-17T03:35:37.429676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:59.994365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330037+0000","last_change":"2024-09-17T03:35:32.401014+0000","last_active":"2024-09-17T03:35:38.330037+0000","last_peered":"2024-09-17T03:35:38.330037+0000","last_clean":"2024-09-17T03:35:38.330037+0000","last_became_active":"2024-09-17T03:35:32.392657+0000","last_became_peered":"2024-09-17T03:35:32.392657+0000","last_unstale":"2024-09-17T03:35:38.330037+0000","last_undegraded":"2024-09-17T03:35:38.330037+0000","last_fullsized":"2024-09-17T03:35:38.330037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:54.253376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429390+0000","last_change":"2024-09-17T03:35:31.402788+0000","last_active":"2024-09-17T03:35:37.429390+0000","last_peered":"2024-09-17T03:35:37.429390+0000","last_clean":"2024-09-17T03:35:37.429390+0000","last_became_active":"2024-09-17T03:35:31.402263+0000","last_became_peered":"2024-09-17T03:35:31.402263+0000","last_unstale":"2024-09-17T03:35:37.429390+0000","last_undegraded":"2024-09-17T03:35:37.429390+0000","last_fullsized":"2024-09-17T03:35:37.429390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429266+0000","last_change":"2024-09-17T03:35:36.450678+0000","last_active":"2024-09-17T03:35:37.429266+0000","last_peered":"2024-09-17T03:35:37.429266+0000","last_clean":"2024-09-17T03:35:37.429266+0000","last_became_active":"2024-09-17T03:35:36.450277+0000","last_became_peered":"2024-09-17T03:35:36.450277+0000","last_unstale":"2024-09-17T03:35:37.429266+0000","last_undegraded":"2024-09-17T03:35:37.429266+0000","last_fullsized":"2024-09-17T03:35:37.429266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:58.323368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716675+0000","last_change":"2024-09-17T03:35:32.399401+0000","last_active":"2024-09-17T03:35:37.716675+0000","last_peered":"2024-09-17T03:35:37.716675+0000","last_clean":"2024-09-17T03:35:37.716675+0000","last_became_active":"2024-09-17T03:35:32.399115+0000","last_became_peered":"2024-09-17T03:35:32.399115+0000","last_unstale":"2024-09-17T03:35:37.716675+0000","last_undegraded":"2024-09-17T03:35:37.716675+0000","last_fullsized":"2024-09-17T03:35:37.716675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:44.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424632+0000","last_change":"2024-09-17T03:35:31.395600+0000","last_active":"2024-09-17T03:35:37.424632+0000","last_peered":"2024-09-17T03:35:37.424632+0000","last_clean":"2024-09-17T03:35:37.424632+0000","last_became_active":"2024-09-17T03:35:31.394734+0000","last_became_peered":"2024-09-17T03:35:31.394734+0000","last_unstale":"2024-09-17T03:35:37.424632+0000","last_undegraded":"2024-09-17T03:35:37.424632+0000","last_fullsized":"2024-09-17T03:35:37.424632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:01.197590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430182+0000","last_change":"2024-09-17T03:35:36.443098+0000","last_active":"2024-09-17T03:35:37.430182+0000","last_peered":"2024-09-17T03:35:37.430182+0000","last_clean":"2024-09-17T03:35:37.430182+0000","last_became_active":"2024-09-17T03:35:36.437889+0000","last_became_peered":"2024-09-17T03:35:36.437889+0000","last_unstale":"2024-09-17T03:35:37.430182+0000","last_undegraded":"2024-09-17T03:35:37.430182+0000","last_fullsized":"2024-09-17T03:35:37.430182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.413529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428284+0000","last_change":"2024-09-17T03:35:32.400695+0000","last_active":"2024-09-17T03:35:37.428284+0000","last_peered":"2024-09-17T03:35:37.428284+0000","last_clean":"2024-09-17T03:35:37.428284+0000","last_became_active":"2024-09-17T03:35:32.400363+0000","last_became_peered":"2024-09-17T03:35:32.400363+0000","last_unstale":"2024-09-17T03:35:37.428284+0000","last_undegraded":"2024-09-17T03:35:37.428284+0000","last_fullsized":"2024-09-17T03:35:37.428284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:14.763903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329497+0000","last_change":"2024-09-17T03:35:31.405580+0000","last_active":"2024-09-17T03:35:38.329497+0000","last_peered":"2024-09-17T03:35:38.329497+0000","last_clean":"2024-09-17T03:35:38.329497+0000","last_became_active":"2024-09-17T03:35:31.405210+0000","last_became_peered":"2024-09-17T03:35:31.405210+0000","last_unstale":"2024-09-17T03:35:38.329497+0000","last_undegraded":"2024-09-17T03:35:38.329497+0000","last_fullsized":"2024-09-17T03:35:38.329497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:24.896063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430908+0000","last_change":"2024-09-17T03:35:36.449377+0000","last_active":"2024-09-17T03:35:37.430908+0000","last_peered":"2024-09-17T03:35:37.430908+0000","last_clean":"2024-09-17T03:35:37.430908+0000","last_became_active":"2024-09-17T03:35:36.448135+0000","last_became_peered":"2024-09-17T03:35:36.448135+0000","last_unstale":"2024-09-17T03:35:37.430908+0000","last_undegraded":"2024-09-17T03:35:37.430908+0000","last_fullsized":"2024-09-17T03:35:37.430908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:36.313705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428454+0000","last_change":"2024-09-17T03:35:32.408934+0000","last_active":"2024-09-17T03:35:37.428454+0000","last_peered":"2024-09-17T03:35:37.428454+0000","last_clean":"2024-09-17T03:35:37.428454+0000","last_became_active":"2024-09-17T03:35:32.408637+0000","last_became_peered":"2024-09-17T03:35:32.408637+0000","last_unstale":"2024-09-17T03:35:37.428454+0000","last_undegraded":"2024-09-17T03:35:37.428454+0000","last_fullsized":"2024-09-17T03:35:37.428454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:55.435612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424316+0000","last_change":"2024-09-17T03:35:31.402870+0000","last_active":"2024-09-17T03:35:37.424316+0000","last_peered":"2024-09-17T03:35:37.424316+0000","last_clean":"2024-09-17T03:35:37.424316+0000","last_became_active":"2024-09-17T03:35:31.401653+0000","last_became_peered":"2024-09-17T03:35:31.401653+0000","last_unstale":"2024-09-17T03:35:37.424316+0000","last_undegraded":"2024-09-17T03:35:37.424316+0000","last_fullsized":"2024-09-17T03:35:37.424316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429975+0000","last_change":"2024-09-17T03:35:36.444315+0000","last_active":"2024-09-17T03:35:37.429975+0000","last_peered":"2024-09-17T03:35:37.429975+0000","last_clean":"2024-09-17T03:35:37.429975+0000","last_became_active":"2024-09-17T03:35:36.441801+0000","last_became_peered":"2024-09-17T03:35:36.441801+0000","last_unstale":"2024-09-17T03:35:37.429975+0000","last_undegraded":"2024-09-17T03:35:37.429975+0000","last_fullsized":"2024-09-17T03:35:37.429975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:47.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952163+0000","last_change":"2024-09-17T03:35:32.415099+0000","last_active":"2024-09-17T03:35:37.952163+0000","last_peered":"2024-09-17T03:35:37.952163+0000","last_clean":"2024-09-17T03:35:37.952163+0000","last_became_active":"2024-09-17T03:35:32.414839+0000","last_became_peered":"2024-09-17T03:35:32.414839+0000","last_unstale":"2024-09-17T03:35:37.952163+0000","last_undegraded":"2024-09-17T03:35:37.952163+0000","last_fullsized":"2024-09-17T03:35:37.952163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:28.814349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424280+0000","last_change":"2024-09-17T03:35:31.399644+0000","last_active":"2024-09-17T03:35:37.424280+0000","last_peered":"2024-09-17T03:35:37.424280+0000","last_clean":"2024-09-17T03:35:37.424280+0000","last_became_active":"2024-09-17T03:35:31.398495+0000","last_became_peered":"2024-09-17T03:35:31.398495+0000","last_unstale":"2024-09-17T03:35:37.424280+0000","last_undegraded":"2024-09-17T03:35:37.424280+0000","last_fullsized":"2024-09-17T03:35:37.424280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:43.782608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328458+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:35:38.328458+0000","last_peered":"2024-09-17T03:35:38.328458+0000","last_clean":"2024-09-17T03:35:38.328458+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:35:38.328458+0000","last_undegraded":"2024-09-17T03:35:38.328458+0000","last_fullsized":"2024-09-17T03:35:38.328458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424800+0000","last_change":"2024-09-17T03:35:36.432981+0000","last_active":"2024-09-17T03:35:37.424800+0000","last_peered":"2024-09-17T03:35:37.424800+0000","last_clean":"2024-09-17T03:35:37.424800+0000","last_became_active":"2024-09-17T03:35:36.432550+0000","last_became_peered":"2024-09-17T03:35:36.432550+0000","last_unstale":"2024-09-17T03:35:37.424800+0000","last_undegraded":"2024-09-17T03:35:37.424800+0000","last_fullsized":"2024-09-17T03:35:37.424800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:29.515037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424612+0000","last_change":"2024-09-17T03:35:32.393020+0000","last_active":"2024-09-17T03:35:37.424612+0000","last_peered":"2024-09-17T03:35:37.424612+0000","last_clean":"2024-09-17T03:35:37.424612+0000","last_became_active":"2024-09-17T03:35:32.392509+0000","last_became_peered":"2024-09-17T03:35:32.392509+0000","last_unstale":"2024-09-17T03:35:37.424612+0000","last_undegraded":"2024-09-17T03:35:37.424612+0000","last_fullsized":"2024-09-17T03:35:37.424612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.767440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430467+0000","last_change":"2024-09-17T03:35:31.406748+0000","last_active":"2024-09-17T03:35:37.430467+0000","last_peered":"2024-09-17T03:35:37.430467+0000","last_clean":"2024-09-17T03:35:37.430467+0000","last_became_active":"2024-09-17T03:35:31.406319+0000","last_became_peered":"2024-09-17T03:35:31.406319+0000","last_unstale":"2024-09-17T03:35:37.430467+0000","last_undegraded":"2024-09-17T03:35:37.430467+0000","last_fullsized":"2024-09-17T03:35:37.430467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:24.896063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330083+0000","last_change":"2024-09-17T03:35:36.454141+0000","last_active":"2024-09-17T03:35:38.330083+0000","last_peered":"2024-09-17T03:35:38.330083+0000","last_clean":"2024-09-17T03:35:38.330083+0000","last_became_active":"2024-09-17T03:35:36.452907+0000","last_became_peered":"2024-09-17T03:35:36.452907+0000","last_unstale":"2024-09-17T03:35:38.330083+0000","last_undegraded":"2024-09-17T03:35:38.330083+0000","last_fullsized":"2024-09-17T03:35:38.330083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:48.118603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716957+0000","last_change":"2024-09-17T03:35:32.397883+0000","last_active":"2024-09-17T03:35:37.716957+0000","last_peered":"2024-09-17T03:35:37.716957+0000","last_clean":"2024-09-17T03:35:37.716957+0000","last_became_active":"2024-09-17T03:35:32.395887+0000","last_became_peered":"2024-09-17T03:35:32.395887+0000","last_unstale":"2024-09-17T03:35:37.716957+0000","last_undegraded":"2024-09-17T03:35:37.716957+0000","last_fullsized":"2024-09-17T03:35:37.716957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:07.376850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430343+0000","last_change":"2024-09-17T03:35:31.399882+0000","last_active":"2024-09-17T03:35:37.430343+0000","last_peered":"2024-09-17T03:35:37.430343+0000","last_clean":"2024-09-17T03:35:37.430343+0000","last_became_active":"2024-09-17T03:35:31.399568+0000","last_became_peered":"2024-09-17T03:35:31.399568+0000","last_unstale":"2024-09-17T03:35:37.430343+0000","last_undegraded":"2024-09-17T03:35:37.430343+0000","last_fullsized":"2024-09-17T03:35:37.430343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:16.036571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428981+0000","last_change":"2024-09-17T03:35:36.435798+0000","last_active":"2024-09-17T03:35:37.428981+0000","last_peered":"2024-09-17T03:35:37.428981+0000","last_clean":"2024-09-17T03:35:37.428981+0000","last_became_active":"2024-09-17T03:35:36.434964+0000","last_became_peered":"2024-09-17T03:35:36.434964+0000","last_unstale":"2024-09-17T03:35:37.428981+0000","last_undegraded":"2024-09-17T03:35:37.428981+0000","last_fullsized":"2024-09-17T03:35:37.428981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:55.456589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716617+0000","last_change":"2024-09-17T03:35:32.401068+0000","last_active":"2024-09-17T03:35:37.716617+0000","last_peered":"2024-09-17T03:35:37.716617+0000","last_clean":"2024-09-17T03:35:37.716617+0000","last_became_active":"2024-09-17T03:35:32.400787+0000","last_became_peered":"2024-09-17T03:35:32.400787+0000","last_unstale":"2024-09-17T03:35:37.716617+0000","last_undegraded":"2024-09-17T03:35:37.716617+0000","last_fullsized":"2024-09-17T03:35:37.716617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952776+0000","last_change":"2024-09-17T03:35:31.400243+0000","last_active":"2024-09-17T03:35:37.952776+0000","last_peered":"2024-09-17T03:35:37.952776+0000","last_clean":"2024-09-17T03:35:37.952776+0000","last_became_active":"2024-09-17T03:35:31.399896+0000","last_became_peered":"2024-09-17T03:35:31.399896+0000","last_unstale":"2024-09-17T03:35:37.952776+0000","last_undegraded":"2024-09-17T03:35:37.952776+0000","last_fullsized":"2024-09-17T03:35:37.952776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:05.368297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423725+0000","last_change":"2024-09-17T03:35:36.433676+0000","last_active":"2024-09-17T03:35:37.423725+0000","last_peered":"2024-09-17T03:35:37.423725+0000","last_clean":"2024-09-17T03:35:37.423725+0000","last_became_active":"2024-09-17T03:35:36.431277+0000","last_became_peered":"2024-09-17T03:35:36.431277+0000","last_unstale":"2024-09-17T03:35:37.423725+0000","last_undegraded":"2024-09-17T03:35:37.423725+0000","last_fullsized":"2024-09-17T03:35:37.423725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.696472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329516+0000","last_change":"2024-09-17T03:35:32.412184+0000","last_active":"2024-09-17T03:35:38.329516+0000","last_peered":"2024-09-17T03:35:38.329516+0000","last_clean":"2024-09-17T03:35:38.329516+0000","last_became_active":"2024-09-17T03:35:32.411602+0000","last_became_peered":"2024-09-17T03:35:32.411602+0000","last_unstale":"2024-09-17T03:35:38.329516+0000","last_undegraded":"2024-09-17T03:35:38.329516+0000","last_fullsized":"2024-09-17T03:35:38.329516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:41.794850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716873+0000","last_change":"2024-09-17T03:35:31.405777+0000","last_active":"2024-09-17T03:35:37.716873+0000","last_peered":"2024-09-17T03:35:37.716873+0000","last_clean":"2024-09-17T03:35:37.716873+0000","last_became_active":"2024-09-17T03:35:31.400954+0000","last_became_peered":"2024-09-17T03:35:31.400954+0000","last_unstale":"2024-09-17T03:35:37.716873+0000","last_undegraded":"2024-09-17T03:35:37.716873+0000","last_fullsized":"2024-09-17T03:35:37.716873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:50.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328929+0000","last_change":"2024-09-17T03:35:36.442849+0000","last_active":"2024-09-17T03:35:38.328929+0000","last_peered":"2024-09-17T03:35:38.328929+0000","last_clean":"2024-09-17T03:35:38.328929+0000","last_became_active":"2024-09-17T03:35:36.442373+0000","last_became_peered":"2024-09-17T03:35:36.442373+0000","last_unstale":"2024-09-17T03:35:38.328929+0000","last_undegraded":"2024-09-17T03:35:38.328929+0000","last_fullsized":"2024-09-17T03:35:38.328929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:31.462450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423856+0000","last_change":"2024-09-17T03:35:32.421334+0000","last_active":"2024-09-17T03:35:37.423856+0000","last_peered":"2024-09-17T03:35:37.423856+0000","last_clean":"2024-09-17T03:35:37.423856+0000","last_became_active":"2024-09-17T03:35:32.417735+0000","last_became_peered":"2024-09-17T03:35:32.417735+0000","last_unstale":"2024-09-17T03:35:37.423856+0000","last_undegraded":"2024-09-17T03:35:37.423856+0000","last_fullsized":"2024-09-17T03:35:37.423856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:38.772375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952012+0000","last_change":"2024-09-17T03:35:31.393984+0000","last_active":"2024-09-17T03:35:37.952012+0000","last_peered":"2024-09-17T03:35:37.952012+0000","last_clean":"2024-09-17T03:35:37.952012+0000","last_became_active":"2024-09-17T03:35:31.393359+0000","last_became_peered":"2024-09-17T03:35:31.393359+0000","last_unstale":"2024-09-17T03:35:37.952012+0000","last_undegraded":"2024-09-17T03:35:37.952012+0000","last_fullsized":"2024-09-17T03:35:37.952012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:29.238819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430527+0000","last_change":"2024-09-17T03:35:36.446882+0000","last_active":"2024-09-17T03:35:37.430527+0000","last_peered":"2024-09-17T03:35:37.430527+0000","last_clean":"2024-09-17T03:35:37.430527+0000","last_became_active":"2024-09-17T03:35:36.445788+0000","last_became_peered":"2024-09-17T03:35:36.445788+0000","last_unstale":"2024-09-17T03:35:37.430527+0000","last_undegraded":"2024-09-17T03:35:37.430527+0000","last_fullsized":"2024-09-17T03:35:37.430527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:46.475925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328438+0000","last_change":"2024-09-17T03:35:32.402001+0000","last_active":"2024-09-17T03:35:38.328438+0000","last_peered":"2024-09-17T03:35:38.328438+0000","last_clean":"2024-09-17T03:35:38.328438+0000","last_became_active":"2024-09-17T03:35:32.401658+0000","last_became_peered":"2024-09-17T03:35:32.401658+0000","last_unstale":"2024-09-17T03:35:38.328438+0000","last_undegraded":"2024-09-17T03:35:38.328438+0000","last_fullsized":"2024-09-17T03:35:38.328438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:51.388149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716519+0000","last_change":"2024-09-17T03:35:31.400527+0000","last_active":"2024-09-17T03:35:37.716519+0000","last_peered":"2024-09-17T03:35:37.716519+0000","last_clean":"2024-09-17T03:35:37.716519+0000","last_became_active":"2024-09-17T03:35:31.399807+0000","last_became_peered":"2024-09-17T03:35:31.399807+0000","last_unstale":"2024-09-17T03:35:37.716519+0000","last_undegraded":"2024-09-17T03:35:37.716519+0000","last_fullsized":"2024-09-17T03:35:37.716519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.431087+0000","last_change":"2024-09-17T03:35:36.449338+0000","last_active":"2024-09-17T03:35:37.431087+0000","last_peered":"2024-09-17T03:35:37.431087+0000","last_clean":"2024-09-17T03:35:37.431087+0000","last_became_active":"2024-09-17T03:35:36.448829+0000","last_became_peered":"2024-09-17T03:35:36.448829+0000","last_unstale":"2024-09-17T03:35:37.431087+0000","last_undegraded":"2024-09-17T03:35:37.431087+0000","last_fullsized":"2024-09-17T03:35:37.431087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:30.201889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423978+0000","last_change":"2024-09-17T03:35:32.415025+0000","last_active":"2024-09-17T03:35:37.423978+0000","last_peered":"2024-09-17T03:35:37.423978+0000","last_clean":"2024-09-17T03:35:37.423978+0000","last_became_active":"2024-09-17T03:35:32.399484+0000","last_became_peered":"2024-09-17T03:35:32.399484+0000","last_unstale":"2024-09-17T03:35:37.423978+0000","last_undegraded":"2024-09-17T03:35:37.423978+0000","last_fullsized":"2024-09-17T03:35:37.423978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:06.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424580+0000","last_change":"2024-09-17T03:35:31.393032+0000","last_active":"2024-09-17T03:35:37.424580+0000","last_peered":"2024-09-17T03:35:37.424580+0000","last_clean":"2024-09-17T03:35:37.424580+0000","last_became_active":"2024-09-17T03:35:31.392712+0000","last_became_peered":"2024-09-17T03:35:31.392712+0000","last_unstale":"2024-09-17T03:35:37.424580+0000","last_undegraded":"2024-09-17T03:35:37.424580+0000","last_fullsized":"2024-09-17T03:35:37.424580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:39.717069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430060+0000","last_change":"2024-09-17T03:35:36.448065+0000","last_active":"2024-09-17T03:35:37.430060+0000","last_peered":"2024-09-17T03:35:37.430060+0000","last_clean":"2024-09-17T03:35:37.430060+0000","last_became_active":"2024-09-17T03:35:36.440858+0000","last_became_peered":"2024-09-17T03:35:36.440858+0000","last_unstale":"2024-09-17T03:35:37.430060+0000","last_undegraded":"2024-09-17T03:35:37.430060+0000","last_fullsized":"2024-09-17T03:35:37.430060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.791341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429471+0000","last_change":"2024-09-17T03:35:32.406664+0000","last_active":"2024-09-17T03:35:37.429471+0000","last_peered":"2024-09-17T03:35:37.429471+0000","last_clean":"2024-09-17T03:35:37.429471+0000","last_became_active":"2024-09-17T03:35:32.406094+0000","last_became_peered":"2024-09-17T03:35:32.406094+0000","last_unstale":"2024-09-17T03:35:37.429471+0000","last_undegraded":"2024-09-17T03:35:37.429471+0000","last_fullsized":"2024-09-17T03:35:37.429471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:58.630384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329699+0000","last_change":"2024-09-17T03:35:31.403376+0000","last_active":"2024-09-17T03:35:38.329699+0000","last_peered":"2024-09-17T03:35:38.329699+0000","last_clean":"2024-09-17T03:35:38.329699+0000","last_became_active":"2024-09-17T03:35:31.402949+0000","last_became_peered":"2024-09-17T03:35:31.402949+0000","last_unstale":"2024-09-17T03:35:38.329699+0000","last_undegraded":"2024-09-17T03:35:38.329699+0000","last_fullsized":"2024-09-17T03:35:38.329699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:18.331525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424293+0000","last_change":"2024-09-17T03:35:36.436078+0000","last_active":"2024-09-17T03:35:37.424293+0000","last_peered":"2024-09-17T03:35:37.424293+0000","last_clean":"2024-09-17T03:35:37.424293+0000","last_became_active":"2024-09-17T03:35:36.435669+0000","last_became_peered":"2024-09-17T03:35:36.435669+0000","last_unstale":"2024-09-17T03:35:37.424293+0000","last_undegraded":"2024-09-17T03:35:37.424293+0000","last_fullsized":"2024-09-17T03:35:37.424293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:07.115777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716542+0000","last_change":"2024-09-17T03:35:32.402486+0000","last_active":"2024-09-17T03:35:37.716542+0000","last_peered":"2024-09-17T03:35:37.716542+0000","last_clean":"2024-09-17T03:35:37.716542+0000","last_became_active":"2024-09-17T03:35:32.402185+0000","last_became_peered":"2024-09-17T03:35:32.402185+0000","last_unstale":"2024-09-17T03:35:37.716542+0000","last_undegraded":"2024-09-17T03:35:37.716542+0000","last_fullsized":"2024-09-17T03:35:37.716542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:38.772375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:45.296364+0000","last_change":"2024-09-17T03:35:31.400849+0000","last_active":"2024-09-17T03:35:45.296364+0000","last_peered":"2024-09-17T03:35:45.296364+0000","last_clean":"2024-09-17T03:35:45.296364+0000","last_became_active":"2024-09-17T03:35:31.399182+0000","last_became_peered":"2024-09-17T03:35:31.399182+0000","last_unstale":"2024-09-17T03:35:45.296364+0000","last_undegraded":"2024-09-17T03:35:45.296364+0000","last_fullsized":"2024-09-17T03:35:45.296364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:48.258646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952056+0000","last_change":"2024-09-17T03:35:36.433789+0000","last_active":"2024-09-17T03:35:37.952056+0000","last_peered":"2024-09-17T03:35:37.952056+0000","last_clean":"2024-09-17T03:35:37.952056+0000","last_became_active":"2024-09-17T03:35:36.433154+0000","last_became_peered":"2024-09-17T03:35:36.433154+0000","last_unstale":"2024-09-17T03:35:37.952056+0000","last_undegraded":"2024-09-17T03:35:37.952056+0000","last_fullsized":"2024-09-17T03:35:37.952056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:25.543856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424094+0000","last_change":"2024-09-17T03:35:32.400635+0000","last_active":"2024-09-17T03:35:37.424094+0000","last_peered":"2024-09-17T03:35:37.424094+0000","last_clean":"2024-09-17T03:35:37.424094+0000","last_became_active":"2024-09-17T03:35:32.393225+0000","last_became_peered":"2024-09-17T03:35:32.393225+0000","last_unstale":"2024-09-17T03:35:37.424094+0000","last_undegraded":"2024-09-17T03:35:37.424094+0000","last_fullsized":"2024-09-17T03:35:37.424094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:08.018673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329974+0000","last_change":"2024-09-17T03:35:31.391917+0000","last_active":"2024-09-17T03:35:38.329974+0000","last_peered":"2024-09-17T03:35:38.329974+0000","last_clean":"2024-09-17T03:35:38.329974+0000","last_became_active":"2024-09-17T03:35:31.390310+0000","last_became_peered":"2024-09-17T03:35:31.390310+0000","last_unstale":"2024-09-17T03:35:38.329974+0000","last_undegraded":"2024-09-17T03:35:38.329974+0000","last_fullsized":"2024-09-17T03:35:38.329974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329447+0000","last_change":"2024-09-17T03:35:36.452480+0000","last_active":"2024-09-17T03:35:38.329447+0000","last_peered":"2024-09-17T03:35:38.329447+0000","last_clean":"2024-09-17T03:35:38.329447+0000","last_became_active":"2024-09-17T03:35:36.452057+0000","last_became_peered":"2024-09-17T03:35:36.452057+0000","last_unstale":"2024-09-17T03:35:38.329447+0000","last_undegraded":"2024-09-17T03:35:38.329447+0000","last_fullsized":"2024-09-17T03:35:38.329447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:02.864287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.431137+0000","last_change":"2024-09-17T03:35:32.420703+0000","last_active":"2024-09-17T03:35:37.431137+0000","last_peered":"2024-09-17T03:35:37.431137+0000","last_clean":"2024-09-17T03:35:37.431137+0000","last_became_active":"2024-09-17T03:35:32.420467+0000","last_became_peered":"2024-09-17T03:35:32.420467+0000","last_unstale":"2024-09-17T03:35:37.431137+0000","last_undegraded":"2024-09-17T03:35:37.431137+0000","last_fullsized":"2024-09-17T03:35:37.431137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:08.429869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716577+0000","last_change":"2024-09-17T03:35:31.407562+0000","last_active":"2024-09-17T03:35:37.716577+0000","last_peered":"2024-09-17T03:35:37.716577+0000","last_clean":"2024-09-17T03:35:37.716577+0000","last_became_active":"2024-09-17T03:35:31.405639+0000","last_became_peered":"2024-09-17T03:35:31.405639+0000","last_unstale":"2024-09-17T03:35:37.716577+0000","last_undegraded":"2024-09-17T03:35:37.716577+0000","last_fullsized":"2024-09-17T03:35:37.716577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:16.036571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329103+0000","last_change":"2024-09-17T03:35:36.457602+0000","last_active":"2024-09-17T03:35:38.329103+0000","last_peered":"2024-09-17T03:35:38.329103+0000","last_clean":"2024-09-17T03:35:38.329103+0000","last_became_active":"2024-09-17T03:35:36.455212+0000","last_became_peered":"2024-09-17T03:35:36.455212+0000","last_unstale":"2024-09-17T03:35:38.329103+0000","last_undegraded":"2024-09-17T03:35:38.329103+0000","last_fullsized":"2024-09-17T03:35:38.329103+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:07.594543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329415+0000","last_change":"2024-09-17T03:35:32.407130+0000","last_active":"2024-09-17T03:35:38.329415+0000","last_peered":"2024-09-17T03:35:38.329415+0000","last_clean":"2024-09-17T03:35:38.329415+0000","last_became_active":"2024-09-17T03:35:32.391848+0000","last_became_peered":"2024-09-17T03:35:32.391848+0000","last_unstale":"2024-09-17T03:35:38.329415+0000","last_undegraded":"2024-09-17T03:35:38.329415+0000","last_fullsized":"2024-09-17T03:35:38.329415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:08.067720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329651+0000","last_change":"2024-09-17T03:35:31.390094+0000","last_active":"2024-09-17T03:35:38.329651+0000","last_peered":"2024-09-17T03:35:38.329651+0000","last_clean":"2024-09-17T03:35:38.329651+0000","last_became_active":"2024-09-17T03:35:31.389803+0000","last_became_peered":"2024-09-17T03:35:31.389803+0000","last_unstale":"2024-09-17T03:35:38.329651+0000","last_undegraded":"2024-09-17T03:35:38.329651+0000","last_fullsized":"2024-09-17T03:35:38.329651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952214+0000","last_change":"2024-09-17T03:35:36.437757+0000","last_active":"2024-09-17T03:35:37.952214+0000","last_peered":"2024-09-17T03:35:37.952214+0000","last_clean":"2024-09-17T03:35:37.952214+0000","last_became_active":"2024-09-17T03:35:36.435609+0000","last_became_peered":"2024-09-17T03:35:36.435609+0000","last_unstale":"2024-09-17T03:35:37.952214+0000","last_undegraded":"2024-09-17T03:35:37.952214+0000","last_fullsized":"2024-09-17T03:35:37.952214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:09.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952718+0000","last_change":"2024-09-17T03:35:36.442334+0000","last_active":"2024-09-17T03:35:37.952718+0000","last_peered":"2024-09-17T03:35:37.952718+0000","last_clean":"2024-09-17T03:35:37.952718+0000","last_became_active":"2024-09-17T03:35:36.441896+0000","last_became_peered":"2024-09-17T03:35:36.441896+0000","last_unstale":"2024-09-17T03:35:37.952718+0000","last_undegraded":"2024-09-17T03:35:37.952718+0000","last_fullsized":"2024-09-17T03:35:37.952718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:22.644001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952084+0000","last_change":"2024-09-17T03:35:32.403467+0000","last_active":"2024-09-17T03:35:37.952084+0000","last_peered":"2024-09-17T03:35:37.952084+0000","last_clean":"2024-09-17T03:35:37.952084+0000","last_became_active":"2024-09-17T03:35:32.403114+0000","last_became_peered":"2024-09-17T03:35:32.403114+0000","last_unstale":"2024-09-17T03:35:37.952084+0000","last_undegraded":"2024-09-17T03:35:37.952084+0000","last_fullsized":"2024-09-17T03:35:37.952084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:55.954409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424195+0000","last_change":"2024-09-17T03:35:31.404636+0000","last_active":"2024-09-17T03:35:37.424195+0000","last_peered":"2024-09-17T03:35:37.424195+0000","last_clean":"2024-09-17T03:35:37.424195+0000","last_became_active":"2024-09-17T03:35:31.404277+0000","last_became_peered":"2024-09-17T03:35:31.404277+0000","last_unstale":"2024-09-17T03:35:37.424195+0000","last_undegraded":"2024-09-17T03:35:37.424195+0000","last_fullsized":"2024-09-17T03:35:37.424195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:40.786182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424417+0000","last_change":"2024-09-17T03:35:36.433455+0000","last_active":"2024-09-17T03:35:37.424417+0000","last_peered":"2024-09-17T03:35:37.424417+0000","last_clean":"2024-09-17T03:35:37.424417+0000","last_became_active":"2024-09-17T03:35:36.433005+0000","last_became_peered":"2024-09-17T03:35:36.433005+0000","last_unstale":"2024-09-17T03:35:37.424417+0000","last_undegraded":"2024-09-17T03:35:37.424417+0000","last_fullsized":"2024-09-17T03:35:37.424417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:02.604817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428484+0000","last_change":"2024-09-17T03:35:32.399932+0000","last_active":"2024-09-17T03:35:37.428484+0000","last_peered":"2024-09-17T03:35:37.428484+0000","last_clean":"2024-09-17T03:35:37.428484+0000","last_became_active":"2024-09-17T03:35:32.399566+0000","last_became_peered":"2024-09-17T03:35:32.399566+0000","last_unstale":"2024-09-17T03:35:37.428484+0000","last_undegraded":"2024-09-17T03:35:37.428484+0000","last_fullsized":"2024-09-17T03:35:37.428484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:32.277026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428581+0000","last_change":"2024-09-17T03:35:31.407319+0000","last_active":"2024-09-17T03:35:37.428581+0000","last_peered":"2024-09-17T03:35:37.428581+0000","last_clean":"2024-09-17T03:35:37.428581+0000","last_became_active":"2024-09-17T03:35:31.407022+0000","last_became_peered":"2024-09-17T03:35:31.407022+0000","last_unstale":"2024-09-17T03:35:37.428581+0000","last_undegraded":"2024-09-17T03:35:37.428581+0000","last_fullsized":"2024-09-17T03:35:37.428581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:18.331525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424464+0000","last_change":"2024-09-17T03:35:31.408471+0000","last_active":"2024-09-17T03:35:37.424464+0000","last_peered":"2024-09-17T03:35:37.424464+0000","last_clean":"2024-09-17T03:35:37.424464+0000","last_became_active":"2024-09-17T03:35:31.408242+0000","last_became_peered":"2024-09-17T03:35:31.408242+0000","last_unstale":"2024-09-17T03:35:37.424464+0000","last_undegraded":"2024-09-17T03:35:37.424464+0000","last_fullsized":"2024-09-17T03:35:37.424464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:48.043675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952411+0000","last_change":"2024-09-17T03:35:32.402827+0000","last_active":"2024-09-17T03:35:37.952411+0000","last_peered":"2024-09-17T03:35:37.952411+0000","last_clean":"2024-09-17T03:35:37.952411+0000","last_became_active":"2024-09-17T03:35:32.402121+0000","last_became_peered":"2024-09-17T03:35:32.402121+0000","last_unstale":"2024-09-17T03:35:37.952411+0000","last_undegraded":"2024-09-17T03:35:37.952411+0000","last_fullsized":"2024-09-17T03:35:37.952411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:20.996960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952548+0000","last_change":"2024-09-17T03:35:36.438086+0000","last_active":"2024-09-17T03:35:37.952548+0000","last_peered":"2024-09-17T03:35:37.952548+0000","last_clean":"2024-09-17T03:35:37.952548+0000","last_became_active":"2024-09-17T03:35:36.437628+0000","last_became_peered":"2024-09-17T03:35:36.437628+0000","last_unstale":"2024-09-17T03:35:37.952548+0000","last_undegraded":"2024-09-17T03:35:37.952548+0000","last_fullsized":"2024-09-17T03:35:37.952548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:41.129499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429911+0000","last_change":"2024-09-17T03:35:31.400851+0000","last_active":"2024-09-17T03:35:37.429911+0000","last_peered":"2024-09-17T03:35:37.429911+0000","last_clean":"2024-09-17T03:35:37.429911+0000","last_became_active":"2024-09-17T03:35:31.400467+0000","last_became_peered":"2024-09-17T03:35:31.400467+0000","last_unstale":"2024-09-17T03:35:37.429911+0000","last_undegraded":"2024-09-17T03:35:37.429911+0000","last_fullsized":"2024-09-17T03:35:37.429911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:34.200886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328979+0000","last_change":"2024-09-17T03:35:32.415316+0000","last_active":"2024-09-17T03:35:38.328979+0000","last_peered":"2024-09-17T03:35:38.328979+0000","last_clean":"2024-09-17T03:35:38.328979+0000","last_became_active":"2024-09-17T03:35:32.415012+0000","last_became_peered":"2024-09-17T03:35:32.415012+0000","last_unstale":"2024-09-17T03:35:38.328979+0000","last_undegraded":"2024-09-17T03:35:38.328979+0000","last_fullsized":"2024-09-17T03:35:38.328979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:49.052343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329826+0000","last_change":"2024-09-17T03:35:36.458591+0000","last_active":"2024-09-17T03:35:38.329826+0000","last_peered":"2024-09-17T03:35:38.329826+0000","last_clean":"2024-09-17T03:35:38.329826+0000","last_became_active":"2024-09-17T03:35:36.458192+0000","last_became_peered":"2024-09-17T03:35:36.458192+0000","last_unstale":"2024-09-17T03:35:38.329826+0000","last_undegraded":"2024-09-17T03:35:38.329826+0000","last_fullsized":"2024-09-17T03:35:38.329826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:28.725625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328670+0000","last_change":"2024-09-17T03:35:32.389432+0000","last_active":"2024-09-17T03:35:38.328670+0000","last_peered":"2024-09-17T03:35:38.328670+0000","last_clean":"2024-09-17T03:35:38.328670+0000","last_became_active":"2024-09-17T03:35:32.389081+0000","last_became_peered":"2024-09-17T03:35:32.389081+0000","last_unstale":"2024-09-17T03:35:38.328670+0000","last_undegraded":"2024-09-17T03:35:38.328670+0000","last_fullsized":"2024-09-17T03:35:38.328670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:13.264493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329236+0000","last_change":"2024-09-17T03:35:32.390231+0000","last_active":"2024-09-17T03:35:38.329236+0000","last_peered":"2024-09-17T03:35:38.329236+0000","last_clean":"2024-09-17T03:35:38.329236+0000","last_became_active":"2024-09-17T03:35:32.389090+0000","last_became_peered":"2024-09-17T03:35:32.389090+0000","last_unstale":"2024-09-17T03:35:38.329236+0000","last_undegraded":"2024-09-17T03:35:38.329236+0000","last_fullsized":"2024-09-17T03:35:38.329236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:51.388149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423992+0000","last_change":"2024-09-17T03:35:32.417536+0000","last_active":"2024-09-17T03:35:37.423992+0000","last_peered":"2024-09-17T03:35:37.423992+0000","last_clean":"2024-09-17T03:35:37.423992+0000","last_became_active":"2024-09-17T03:35:32.415503+0000","last_became_peered":"2024-09-17T03:35:32.415503+0000","last_unstale":"2024-09-17T03:35:37.423992+0000","last_undegraded":"2024-09-17T03:35:37.423992+0000","last_fullsized":"2024-09-17T03:35:37.423992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:53.931551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429727+0000","last_change":"2024-09-17T03:35:32.417567+0000","last_active":"2024-09-17T03:35:37.429727+0000","last_peered":"2024-09-17T03:35:37.429727+0000","last_clean":"2024-09-17T03:35:37.429727+0000","last_became_active":"2024-09-17T03:35:32.416075+0000","last_became_peered":"2024-09-17T03:35:32.416075+0000","last_unstale":"2024-09-17T03:35:37.429727+0000","last_undegraded":"2024-09-17T03:35:37.429727+0000","last_fullsized":"2024-09-17T03:35:37.429727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:17.725156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430354+0000","last_change":"2024-09-17T03:35:32.398186+0000","last_active":"2024-09-17T03:35:37.430354+0000","last_peered":"2024-09-17T03:35:37.430354+0000","last_clean":"2024-09-17T03:35:37.430354+0000","last_became_active":"2024-09-17T03:35:32.397332+0000","last_became_peered":"2024-09-17T03:35:32.397332+0000","last_unstale":"2024-09-17T03:35:37.430354+0000","last_undegraded":"2024-09-17T03:35:37.430354+0000","last_fullsized":"2024-09-17T03:35:37.430354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:24.688946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429638+0000","last_change":"2024-09-17T03:35:32.398824+0000","last_active":"2024-09-17T03:35:37.429638+0000","last_peered":"2024-09-17T03:35:37.429638+0000","last_clean":"2024-09-17T03:35:37.429638+0000","last_became_active":"2024-09-17T03:35:32.398561+0000","last_became_peered":"2024-09-17T03:35:32.398561+0000","last_unstale":"2024-09-17T03:35:37.429638+0000","last_undegraded":"2024-09-17T03:35:37.429638+0000","last_fullsized":"2024-09-17T03:35:37.429638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:21.967856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329314+0000","last_change":"2024-09-17T03:35:32.407437+0000","last_active":"2024-09-17T03:35:38.329314+0000","last_peered":"2024-09-17T03:35:38.329314+0000","last_clean":"2024-09-17T03:35:38.329314+0000","last_became_active":"2024-09-17T03:35:32.391983+0000","last_became_peered":"2024-09-17T03:35:32.391983+0000","last_unstale":"2024-09-17T03:35:38.329314+0000","last_undegraded":"2024-09-17T03:35:38.329314+0000","last_fullsized":"2024-09-17T03:35:38.329314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:55.435612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430853+0000","last_change":"2024-09-17T03:35:32.420028+0000","last_active":"2024-09-17T03:35:37.430853+0000","last_peered":"2024-09-17T03:35:37.430853+0000","last_clean":"2024-09-17T03:35:37.430853+0000","last_became_active":"2024-09-17T03:35:32.419318+0000","last_became_peered":"2024-09-17T03:35:32.419318+0000","last_unstale":"2024-09-17T03:35:37.430853+0000","last_undegraded":"2024-09-17T03:35:37.430853+0000","last_fullsized":"2024-09-17T03:35:37.430853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:34.754662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423939+0000","last_change":"2024-09-17T03:35:32.404124+0000","last_active":"2024-09-17T03:35:37.423939+0000","last_peered":"2024-09-17T03:35:37.423939+0000","last_clean":"2024-09-17T03:35:37.423939+0000","last_became_active":"2024-09-17T03:35:32.401565+0000","last_became_peered":"2024-09-17T03:35:32.401565+0000","last_unstale":"2024-09-17T03:35:37.423939+0000","last_undegraded":"2024-09-17T03:35:37.423939+0000","last_fullsized":"2024-09-17T03:35:37.423939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428668+0000","last_change":"2024-09-17T03:35:32.416911+0000","last_active":"2024-09-17T03:35:37.428668+0000","last_peered":"2024-09-17T03:35:37.428668+0000","last_clean":"2024-09-17T03:35:37.428668+0000","last_became_active":"2024-09-17T03:35:32.416607+0000","last_became_peered":"2024-09-17T03:35:32.416607+0000","last_unstale":"2024-09-17T03:35:37.428668+0000","last_undegraded":"2024-09-17T03:35:37.428668+0000","last_fullsized":"2024-09-17T03:35:37.428668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:35.823308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328868+0000","last_change":"2024-09-17T03:35:32.402977+0000","last_active":"2024-09-17T03:35:38.328868+0000","last_peered":"2024-09-17T03:35:38.328868+0000","last_clean":"2024-09-17T03:35:38.328868+0000","last_became_active":"2024-09-17T03:35:32.400089+0000","last_became_peered":"2024-09-17T03:35:32.400089+0000","last_unstale":"2024-09-17T03:35:38.328868+0000","last_undegraded":"2024-09-17T03:35:38.328868+0000","last_fullsized":"2024-09-17T03:35:38.328868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:09.595197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952307+0000","last_change":"2024-09-17T03:35:32.410415+0000","last_active":"2024-09-17T03:35:37.952307+0000","last_peered":"2024-09-17T03:35:37.952307+0000","last_clean":"2024-09-17T03:35:37.952307+0000","last_became_active":"2024-09-17T03:35:32.410050+0000","last_became_peered":"2024-09-17T03:35:32.410050+0000","last_unstale":"2024-09-17T03:35:37.952307+0000","last_undegraded":"2024-09-17T03:35:37.952307+0000","last_fullsized":"2024-09-17T03:35:37.952307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:50.438068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716881+0000","last_change":"2024-09-17T03:35:32.395551+0000","last_active":"2024-09-17T03:35:37.716881+0000","last_peered":"2024-09-17T03:35:37.716881+0000","last_clean":"2024-09-17T03:35:37.716881+0000","last_became_active":"2024-09-17T03:35:32.395266+0000","last_became_peered":"2024-09-17T03:35:32.395266+0000","last_unstale":"2024-09-17T03:35:37.716881+0000","last_undegraded":"2024-09-17T03:35:37.716881+0000","last_fullsized":"2024-09-17T03:35:37.716881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:54.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424777+0000","last_change":"2024-09-17T03:35:32.406349+0000","last_active":"2024-09-17T03:35:37.424777+0000","last_peered":"2024-09-17T03:35:37.424777+0000","last_clean":"2024-09-17T03:35:37.424777+0000","last_became_active":"2024-09-17T03:35:32.406083+0000","last_became_peered":"2024-09-17T03:35:32.406083+0000","last_unstale":"2024-09-17T03:35:37.424777+0000","last_undegraded":"2024-09-17T03:35:37.424777+0000","last_fullsized":"2024-09-17T03:35:37.424777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:28.801756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330010+0000","last_change":"2024-09-17T03:35:32.412025+0000","last_active":"2024-09-17T03:35:38.330010+0000","last_peered":"2024-09-17T03:35:38.330010+0000","last_clean":"2024-09-17T03:35:38.330010+0000","last_became_active":"2024-09-17T03:35:32.411770+0000","last_became_peered":"2024-09-17T03:35:32.411770+0000","last_unstale":"2024-09-17T03:35:38.330010+0000","last_undegraded":"2024-09-17T03:35:38.330010+0000","last_fullsized":"2024-09-17T03:35:38.330010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.040918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424666+0000","last_change":"2024-09-17T03:35:32.405664+0000","last_active":"2024-09-17T03:35:37.424666+0000","last_peered":"2024-09-17T03:35:37.424666+0000","last_clean":"2024-09-17T03:35:37.424666+0000","last_became_active":"2024-09-17T03:35:32.401871+0000","last_became_peered":"2024-09-17T03:35:32.401871+0000","last_unstale":"2024-09-17T03:35:37.424666+0000","last_undegraded":"2024-09-17T03:35:37.424666+0000","last_fullsized":"2024-09-17T03:35:37.424666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:11.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423851+0000","last_change":"2024-09-17T03:35:32.421664+0000","last_active":"2024-09-17T03:35:37.423851+0000","last_peered":"2024-09-17T03:35:37.423851+0000","last_clean":"2024-09-17T03:35:37.423851+0000","last_became_active":"2024-09-17T03:35:32.416736+0000","last_became_peered":"2024-09-17T03:35:32.416736+0000","last_unstale":"2024-09-17T03:35:37.423851+0000","last_undegraded":"2024-09-17T03:35:37.423851+0000","last_fullsized":"2024-09-17T03:35:37.423851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:42.709250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428434+0000","last_change":"2024-09-17T03:35:32.401461+0000","last_active":"2024-09-17T03:35:37.428434+0000","last_peered":"2024-09-17T03:35:37.428434+0000","last_clean":"2024-09-17T03:35:37.428434+0000","last_became_active":"2024-09-17T03:35:32.400913+0000","last_became_peered":"2024-09-17T03:35:32.400913+0000","last_unstale":"2024-09-17T03:35:37.428434+0000","last_undegraded":"2024-09-17T03:35:37.428434+0000","last_fullsized":"2024-09-17T03:35:37.428434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:50.140695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428853+0000","last_change":"2024-09-17T03:35:32.388327+0000","last_active":"2024-09-17T03:35:37.428853+0000","last_peered":"2024-09-17T03:35:37.428853+0000","last_clean":"2024-09-17T03:35:37.428853+0000","last_became_active":"2024-09-17T03:35:32.387938+0000","last_became_peered":"2024-09-17T03:35:32.387938+0000","last_unstale":"2024-09-17T03:35:37.428853+0000","last_undegraded":"2024-09-17T03:35:37.428853+0000","last_fullsized":"2024-09-17T03:35:37.428853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:08.067720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430492+0000","last_change":"2024-09-17T03:35:32.397331+0000","last_active":"2024-09-17T03:35:37.430492+0000","last_peered":"2024-09-17T03:35:37.430492+0000","last_clean":"2024-09-17T03:35:37.430492+0000","last_became_active":"2024-09-17T03:35:32.395724+0000","last_became_peered":"2024-09-17T03:35:32.395724+0000","last_unstale":"2024-09-17T03:35:37.430492+0000","last_undegraded":"2024-09-17T03:35:37.430492+0000","last_fullsized":"2024-09-17T03:35:37.430492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:41.794850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716601+0000","last_change":"2024-09-17T03:35:32.395931+0000","last_active":"2024-09-17T03:35:37.716601+0000","last_peered":"2024-09-17T03:35:37.716601+0000","last_clean":"2024-09-17T03:35:37.716601+0000","last_became_active":"2024-09-17T03:35:32.395572+0000","last_became_peered":"2024-09-17T03:35:32.395572+0000","last_unstale":"2024-09-17T03:35:37.716601+0000","last_undegraded":"2024-09-17T03:35:37.716601+0000","last_fullsized":"2024-09-17T03:35:37.716601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:50.658760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716469+0000","last_change":"2024-09-17T03:35:32.398836+0000","last_active":"2024-09-17T03:35:37.716469+0000","last_peered":"2024-09-17T03:35:37.716469+0000","last_clean":"2024-09-17T03:35:37.716469+0000","last_became_active":"2024-09-17T03:35:32.398500+0000","last_became_peered":"2024-09-17T03:35:32.398500+0000","last_unstale":"2024-09-17T03:35:37.716469+0000","last_undegraded":"2024-09-17T03:35:37.716469+0000","last_fullsized":"2024-09-17T03:35:37.716469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:49.687153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716483+0000","last_change":"2024-09-17T03:35:32.414484+0000","last_active":"2024-09-17T03:35:37.716483+0000","last_peered":"2024-09-17T03:35:37.716483+0000","last_clean":"2024-09-17T03:35:37.716483+0000","last_became_active":"2024-09-17T03:35:32.414165+0000","last_became_peered":"2024-09-17T03:35:32.414165+0000","last_unstale":"2024-09-17T03:35:37.716483+0000","last_undegraded":"2024-09-17T03:35:37.716483+0000","last_fullsized":"2024-09-17T03:35:37.716483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:06.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329649+0000","last_change":"2024-09-17T03:35:32.396020+0000","last_active":"2024-09-17T03:35:38.329649+0000","last_peered":"2024-09-17T03:35:38.329649+0000","last_clean":"2024-09-17T03:35:38.329649+0000","last_became_active":"2024-09-17T03:35:32.395701+0000","last_became_peered":"2024-09-17T03:35:32.395701+0000","last_unstale":"2024-09-17T03:35:38.329649+0000","last_undegraded":"2024-09-17T03:35:38.329649+0000","last_fullsized":"2024-09-17T03:35:38.329649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:44.791275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428123+0000","last_change":"2024-09-17T03:35:32.405817+0000","last_active":"2024-09-17T03:35:37.428123+0000","last_peered":"2024-09-17T03:35:37.428123+0000","last_clean":"2024-09-17T03:35:37.428123+0000","last_became_active":"2024-09-17T03:35:32.401125+0000","last_became_peered":"2024-09-17T03:35:32.401125+0000","last_unstale":"2024-09-17T03:35:37.428123+0000","last_undegraded":"2024-09-17T03:35:37.428123+0000","last_fullsized":"2024-09-17T03:35:37.428123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:44.639162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716409+0000","last_change":"2024-09-17T03:35:32.406706+0000","last_active":"2024-09-17T03:35:37.716409+0000","last_peered":"2024-09-17T03:35:37.716409+0000","last_clean":"2024-09-17T03:35:37.716409+0000","last_became_active":"2024-09-17T03:35:32.406380+0000","last_became_peered":"2024-09-17T03:35:32.406380+0000","last_unstale":"2024-09-17T03:35:37.716409+0000","last_undegraded":"2024-09-17T03:35:37.716409+0000","last_fullsized":"2024-09-17T03:35:37.716409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:35.823308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330231+0000","last_change":"2024-09-17T03:35:32.409026+0000","last_active":"2024-09-17T03:35:38.330231+0000","last_peered":"2024-09-17T03:35:38.330231+0000","last_clean":"2024-09-17T03:35:38.330231+0000","last_became_active":"2024-09-17T03:35:32.408678+0000","last_became_peered":"2024-09-17T03:35:32.408678+0000","last_unstale":"2024-09-17T03:35:38.330231+0000","last_undegraded":"2024-09-17T03:35:38.330231+0000","last_fullsized":"2024-09-17T03:35:38.330231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:57.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716319+0000","last_change":"2024-09-17T03:35:32.417998+0000","last_active":"2024-09-17T03:35:37.716319+0000","last_peered":"2024-09-17T03:35:37.716319+0000","last_clean":"2024-09-17T03:35:37.716319+0000","last_became_active":"2024-09-17T03:35:32.417698+0000","last_became_peered":"2024-09-17T03:35:32.417698+0000","last_unstale":"2024-09-17T03:35:37.716319+0000","last_undegraded":"2024-09-17T03:35:37.716319+0000","last_fullsized":"2024-09-17T03:35:37.716319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:17.076410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329887+0000","last_change":"2024-09-17T03:35:32.400692+0000","last_active":"2024-09-17T03:35:38.329887+0000","last_peered":"2024-09-17T03:35:38.329887+0000","last_clean":"2024-09-17T03:35:38.329887+0000","last_became_active":"2024-09-17T03:35:32.400221+0000","last_became_peered":"2024-09-17T03:35:32.400221+0000","last_unstale":"2024-09-17T03:35:38.329887+0000","last_undegraded":"2024-09-17T03:35:38.329887+0000","last_fullsized":"2024-09-17T03:35:38.329887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:26.763129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430145+0000","last_change":"2024-09-17T03:35:32.415375+0000","last_active":"2024-09-17T03:35:37.430145+0000","last_peered":"2024-09-17T03:35:37.430145+0000","last_clean":"2024-09-17T03:35:37.430145+0000","last_became_active":"2024-09-17T03:35:32.415017+0000","last_became_peered":"2024-09-17T03:35:32.415017+0000","last_unstale":"2024-09-17T03:35:37.430145+0000","last_undegraded":"2024-09-17T03:35:37.430145+0000","last_fullsized":"2024-09-17T03:35:37.430145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:50.658760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430308+0000","last_change":"2024-09-17T03:35:32.415726+0000","last_active":"2024-09-17T03:35:37.430308+0000","last_peered":"2024-09-17T03:35:37.430308+0000","last_clean":"2024-09-17T03:35:37.430308+0000","last_became_active":"2024-09-17T03:35:32.415405+0000","last_became_peered":"2024-09-17T03:35:32.415405+0000","last_unstale":"2024-09-17T03:35:37.430308+0000","last_undegraded":"2024-09-17T03:35:37.430308+0000","last_fullsized":"2024-09-17T03:35:37.430308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:54.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716587+0000","last_change":"2024-09-17T03:35:32.398919+0000","last_active":"2024-09-17T03:35:37.716587+0000","last_peered":"2024-09-17T03:35:37.716587+0000","last_clean":"2024-09-17T03:35:37.716587+0000","last_became_active":"2024-09-17T03:35:32.398610+0000","last_became_peered":"2024-09-17T03:35:32.398610+0000","last_unstale":"2024-09-17T03:35:37.716587+0000","last_undegraded":"2024-09-17T03:35:37.716587+0000","last_fullsized":"2024-09-17T03:35:37.716587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:32.277026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:35:57.385 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:35:57.386 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T03:35:57.386 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T03:35:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.643+0000 7f5aa0600640 1 -- 172.21.15.121:0/2967799840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a80003c10 msgr2=0x7f5a80004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.643+0000 7f5aa0600640 1 --2- 172.21.15.121:0/2967799840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a80003c10 0x7f5a80004060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00c760 tx=0x7f5a80005830 comp rx=0 tx=0).stop 2024-09-17T03:35:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.643+0000 7f5a9e600640 1 -- 172.21.15.121:0/2967799840 reap_dead start 2024-09-17T03:35:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.643+0000 7f5aa0600640 1 -- 172.21.15.121:0/2967799840 shutdown_connections 2024-09-17T03:35:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.643+0000 7f5aa0600640 1 -- 172.21.15.121:0/2967799840 >> 172.21.15.121:0/2967799840 conn(0x7f5a980b1b90 msgr2=0x7f5a980b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.643+0000 7f5aa0600640 1 -- 172.21.15.121:0/2967799840 shutdown_connections 2024-09-17T03:35:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.643+0000 7f5aa0600640 1 -- 172.21.15.121:0/2967799840 wait complete. 2024-09-17T03:35:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.645+0000 7f5aa0600640 1 Processor -- start 2024-09-17T03:35:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.645+0000 7f5aa0600640 1 -- start start 2024-09-17T03:35:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5aa0600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a80003c10 0x7f5a980b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5aa0600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a9806d010 0x7f5a9806d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5aa0600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a980c9820 0x7f5a980c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5aa0600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5a98160fd0 con 0x7f5a9806d010 2024-09-17T03:35:57.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5aa0600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5a98160e50 con 0x7f5a980c9820 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5aa0600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5a9806e200 con 0x7f5a80003c10 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9d200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a9806d010 0x7f5a9806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9d200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a9806d010 0x7f5a9806d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45908/0 (socket says 172.21.15.121:45908) 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9d200640 1 -- 172.21.15.121:0/3726085028 learned_addr learned my addr 172.21.15.121:0/3726085028 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9dc00640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a80003c10 0x7f5a980b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9e600640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a980c9820 0x7f5a980c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9d200640 1 -- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a80003c10 msgr2=0x7f5a980b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9d200640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a80003c10 0x7f5a980b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9d200640 1 -- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a980c9820 msgr2=0x7f5a980c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9d200640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a980c9820 0x7f5a980c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9d200640 1 -- 172.21.15.121:0/3726085028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a980ca170 con 0x7f5a9806d010 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.647+0000 7f5a9e600640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a980c9820 0x7f5a980c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:57.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.648+0000 7f5a9d200640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a9806d010 0x7f5a9806d420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a840119b0 tx=0x7f5a84011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:57.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.648+0000 7f5a95600640 1 -- 172.21.15.121:0/3726085028 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400fc70 con 0x7f5a9806d010 2024-09-17T03:35:57.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.648+0000 7f5a95600640 1 -- 172.21.15.121:0/3726085028 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a84005020 con 0x7f5a9806d010 2024-09-17T03:35:57.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.648+0000 7f5aa0600640 1 -- 172.21.15.121:0/3726085028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a980c7fb0 con 0x7f5a9806d010 2024-09-17T03:35:57.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.648+0000 7f5a95600640 1 -- 172.21.15.121:0/3726085028 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a84005450 con 0x7f5a9806d010 2024-09-17T03:35:57.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.648+0000 7f5aa0600640 1 -- 172.21.15.121:0/3726085028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a980b53f0 con 0x7f5a9806d010 2024-09-17T03:35:57.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.649+0000 7f5aa0600640 1 -- 172.21.15.121:0/3726085028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a980b5670 con 0x7f5a9806d010 2024-09-17T03:35:57.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.651+0000 7f5a95600640 1 -- 172.21.15.121:0/3726085028 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a840047a0 con 0x7f5a9806d010 2024-09-17T03:35:57.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.651+0000 7f5a95600640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a78078bc0 0x7f5a7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:57.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.652+0000 7f5a95600640 1 -- 172.21.15.121:0/3726085028 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5a8409bdd0 con 0x7f5a9806d010 2024-09-17T03:35:57.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.652+0000 7f5a9dc00640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a78078bc0 0x7f5a7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:57.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.653+0000 7f5a9dc00640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a78078bc0 0x7f5a7807b0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c033000 tx=0x7f5a8c02d070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:57.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.656+0000 7f5a95600640 1 -- 172.21.15.121:0/3726085028 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a980ca170 con 0x7f5a9806d010 2024-09-17T03:35:57.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.839+0000 7f5aa0600640 1 -- 172.21.15.121:0/3726085028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f5a98074620 con 0x7f5a9806d010 2024-09-17T03:35:57.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.840+0000 7f5a95600640 1 -- 172.21.15.121:0/3726085028 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f5a84063760 con 0x7f5a9806d010 2024-09-17T03:35:57.839 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:57.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 -- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a78078bc0 msgr2=0x7f5a7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:57.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a78078bc0 0x7f5a7807b0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c033000 tx=0x7f5a8c02d070 comp rx=0 tx=0).stop 2024-09-17T03:35:57.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 -- 172.21.15.121:0/3726085028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a9806d010 msgr2=0x7f5a9806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:57.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a9806d010 0x7f5a9806d420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5a840119b0 tx=0x7f5a84011e70 comp rx=0 tx=0).stop 2024-09-17T03:35:57.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 -- 172.21.15.121:0/3726085028 shutdown_connections 2024-09-17T03:35:57.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a980c9820 0x7f5a980c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a78078bc0 0x7f5a7807b0d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a9806d010 0x7f5a9806d420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 --2- 172.21.15.121:0/3726085028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a80003c10 0x7f5a980b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:57.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 -- 172.21.15.121:0/3726085028 >> 172.21.15.121:0/3726085028 conn(0x7f5a980b1b90 msgr2=0x7f5a9815be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:57.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 -- 172.21.15.121:0/3726085028 shutdown_connections 2024-09-17T03:35:57.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:57.842+0000 7f5aa0600640 1 -- 172.21.15.121:0/3726085028 wait complete. 2024-09-17T03:35:57.865 INFO:teuthology.orchestra.run.smithi121.stdout:[{"version":31,"timestamp":"2024-09-17T03:35:19.960333+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"3524.210167"}]}] 2024-09-17T03:35:57.866 INFO:tasks.ceph_manager:config epoch is 31 2024-09-17T03:35:57.866 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T03:35:57.866 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T03:35:57.866 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T03:35:58.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.089+0000 7fa8daa00640 1 -- 172.21.15.121:0/1230726056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d406e500 msgr2=0x7fa8d40cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:58.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.089+0000 7fa8daa00640 1 --2- 172.21.15.121:0/1230726056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d406e500 0x7fa8d40cc020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc005fd0 tx=0x7fa8cc02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.089+0000 7fa8daa00640 1 -- 172.21.15.121:0/1230726056 shutdown_connections 2024-09-17T03:35:58.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.089+0000 7fa8daa00640 1 --2- 172.21.15.121:0/1230726056 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d406e500 0x7fa8d40cc020 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.089+0000 7fa8daa00640 1 --2- 172.21.15.121:0/1230726056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d4074cb0 0x7fa8d4073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.089+0000 7fa8daa00640 1 -- 172.21.15.121:0/1230726056 >> 172.21.15.121:0/1230726056 conn(0x7fa8d40cca40 msgr2=0x7fa8d40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:58.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.089+0000 7fa8daa00640 1 -- 172.21.15.121:0/1230726056 shutdown_connections 2024-09-17T03:35:58.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.089+0000 7fa8daa00640 1 -- 172.21.15.121:0/1230726056 wait complete. 2024-09-17T03:35:58.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.091+0000 7fa8daa00640 1 Processor -- start 2024-09-17T03:35:58.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.091+0000 7fa8daa00640 1 -- start start 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8daa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4074cb0 0x7fa8d40a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8daa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d40cbc10 0x7fa8d40b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8daa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d409f810 0x7fa8d409a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8daa00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d406f360 con 0x7fa8d40cbc10 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8daa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d406f1e0 con 0x7fa8d4074cb0 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8daa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d406f4e0 con 0x7fa8d409f810 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8d3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d40cbc10 0x7fa8d40b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8d3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d40cbc10 0x7fa8d40b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45926/0 (socket says 172.21.15.121:45926) 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8d3400640 1 -- 172.21.15.121:0/294042086 learned_addr learned my addr 172.21.15.121:0/294042086 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8d3e00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4074cb0 0x7fa8d40a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:58.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8d8a00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d409f810 0x7fa8d409a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8d3400640 1 -- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d409f810 msgr2=0x7fa8d409a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8d3400640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d409f810 0x7fa8d409a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8d3400640 1 -- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4074cb0 msgr2=0x7fa8d40a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8d3400640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4074cb0 0x7fa8d40a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.093+0000 7fa8d3400640 1 -- 172.21.15.121:0/294042086 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d40b4770 con 0x7fa8d40cbc10 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.094+0000 7fa8d3400640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d40cbc10 0x7fa8d40b4230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c3a0 tx=0x7fa8c000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.094+0000 7fa8cbe00640 1 -- 172.21.15.121:0/294042086 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0017070 con 0x7fa8d40cbc10 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.094+0000 7fa8cbe00640 1 -- 172.21.15.121:0/294042086 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8c00053c0 con 0x7fa8d40cbc10 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.094+0000 7fa8daa00640 1 -- 172.21.15.121:0/294042086 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d409ea50 con 0x7fa8d40cbc10 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.094+0000 7fa8cbe00640 1 -- 172.21.15.121:0/294042086 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0003850 con 0x7fa8d40cbc10 2024-09-17T03:35:58.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.094+0000 7fa8daa00640 1 -- 172.21.15.121:0/294042086 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d409f010 con 0x7fa8d40cbc10 2024-09-17T03:35:58.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.095+0000 7fa8daa00640 1 -- 172.21.15.121:0/294042086 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d4072860 con 0x7fa8d40cbc10 2024-09-17T03:35:58.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.096+0000 7fa8cbe00640 1 -- 172.21.15.121:0/294042086 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8c001a070 con 0x7fa8d40cbc10 2024-09-17T03:35:58.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.097+0000 7fa8cbe00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa8b4078b90 0x7fa8b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:58.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.097+0000 7fa8cbe00640 1 -- 172.21.15.121:0/294042086 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa8c009a390 con 0x7fa8d40cbc10 2024-09-17T03:35:58.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.098+0000 7fa8d3e00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa8b4078b90 0x7fa8b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:58.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.098+0000 7fa8d3e00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa8b4078b90 0x7fa8b407b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa8d415a730 tx=0x7fa8c4009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:58.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.102+0000 7fa8cbe00640 1 -- 172.21.15.121:0/294042086 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa8d4072860 con 0x7fa8d40cbc10 2024-09-17T03:35:58.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.332+0000 7fa8daa00640 1 -- 172.21.15.121:0/294042086 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa8d40ceeb0 con 0x7fa8d40cbc10 2024-09-17T03:35:58.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.335+0000 7fa8cbe00640 1 -- 172.21.15.121:0/294042086 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194722 (secure 0 0 0) 0x7fa8d40ceeb0 con 0x7fa8d40cbc10 2024-09-17T03:35:58.337 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:58.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 -- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa8b4078b90 msgr2=0x7fa8b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:58.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa8b4078b90 0x7fa8b407b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa8d415a730 tx=0x7fa8c4009500 comp rx=0 tx=0).stop 2024-09-17T03:35:58.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 -- 172.21.15.121:0/294042086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d40cbc10 msgr2=0x7fa8d40b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:58.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d40cbc10 0x7fa8d40b4230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c3a0 tx=0x7fa8c000c860 comp rx=0 tx=0).stop 2024-09-17T03:35:58.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 -- 172.21.15.121:0/294042086 shutdown_connections 2024-09-17T03:35:58.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8d409f810 0x7fa8d409a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa8b4078b90 0x7fa8b407b0a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d40cbc10 0x7fa8d40b4230 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 --2- 172.21.15.121:0/294042086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4074cb0 0x7fa8d40a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 -- 172.21.15.121:0/294042086 >> 172.21.15.121:0/294042086 conn(0x7fa8d40cca40 msgr2=0x7fa8d4159d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:58.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.338+0000 7fa8daa00640 1 -- 172.21.15.121:0/294042086 shutdown_connections 2024-09-17T03:35:58.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.339+0000 7fa8daa00640 1 -- 172.21.15.121:0/294042086 wait complete. 2024-09-17T03:35:58.363 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1198724406},{"type":"v1","addr":"172.21.15.176:6801","nonce":1198724406}]},"active_addr":"172.21.15.176:6801/1198724406","active_change":"2024-09-17T03:35:09.261688+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4116,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":1187855715}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3637164392}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3470877392}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3536905262}]}]} 2024-09-17T03:35:58.368 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T03:35:58.368 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T03:35:58.368 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:58.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.591+0000 7fd49fa00640 1 -- 172.21.15.121:0/425599351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd498074cb0 msgr2=0x7fd498073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:58.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.591+0000 7fd49fa00640 1 --2- 172.21.15.121:0/425599351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd498074cb0 0x7fd498073dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd488005fd0 tx=0x7fd48802a680 comp rx=0 tx=0).stop 2024-09-17T03:35:58.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.591+0000 7fd49fa00640 1 -- 172.21.15.121:0/425599351 shutdown_connections 2024-09-17T03:35:58.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.591+0000 7fd49fa00640 1 --2- 172.21.15.121:0/425599351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd498074cb0 0x7fd498073dd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.591+0000 7fd49fa00640 1 -- 172.21.15.121:0/425599351 >> 172.21.15.121:0/425599351 conn(0x7fd4980cca40 msgr2=0x7fd4980cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:58.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.591+0000 7fd49fa00640 1 -- 172.21.15.121:0/425599351 shutdown_connections 2024-09-17T03:35:58.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.591+0000 7fd49fa00640 1 -- 172.21.15.121:0/425599351 wait complete. 2024-09-17T03:35:58.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.593+0000 7fd49fa00640 1 Processor -- start 2024-09-17T03:35:58.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.593+0000 7fd49fa00640 1 -- start start 2024-09-17T03:35:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49fa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd498074cb0 0x7fd4981f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49fa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4980cbc10 0x7fd4980a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49fa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4980a08a0 0x7fd49809c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49fa00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd49806f670 con 0x7fd498074cb0 2024-09-17T03:35:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49fa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd49806f4f0 con 0x7fd4980a08a0 2024-09-17T03:35:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49fa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd49806f7f0 con 0x7fd4980cbc10 2024-09-17T03:35:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49d000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd498074cb0 0x7fd4981f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49d000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd498074cb0 0x7fd4981f8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45948/0 (socket says 172.21.15.121:45948) 2024-09-17T03:35:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49d000640 1 -- 172.21.15.121:0/2110432506 learned_addr learned my addr 172.21.15.121:0/2110432506 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49da00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4980a08a0 0x7fd49809c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd497e00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4980cbc10 0x7fd4980a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49d000640 1 -- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4980cbc10 msgr2=0x7fd4980a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49d000640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4980cbc10 0x7fd4980a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49d000640 1 -- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4980a08a0 msgr2=0x7fd49809c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49d000640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4980a08a0 0x7fd49809c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.595+0000 7fd49d000640 1 -- 172.21.15.121:0/2110432506 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4981f8cd0 con 0x7fd498074cb0 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.596+0000 7fd49d000640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd498074cb0 0x7fd4981f8790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd488006010 tx=0x7fd4880039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.596+0000 7fd494c00640 1 -- 172.21.15.121:0/2110432506 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48803e030 con 0x7fd498074cb0 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.596+0000 7fd494c00640 1 -- 172.21.15.121:0/2110432506 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4880047a0 con 0x7fd498074cb0 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.596+0000 7fd494c00640 1 -- 172.21.15.121:0/2110432506 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488035040 con 0x7fd498074cb0 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.596+0000 7fd49fa00640 1 -- 172.21.15.121:0/2110432506 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4980a0cb0 con 0x7fd498074cb0 2024-09-17T03:35:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.596+0000 7fd49fa00640 1 -- 172.21.15.121:0/2110432506 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4980cf920 con 0x7fd498074cb0 2024-09-17T03:35:58.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.597+0000 7fd49fa00640 1 -- 172.21.15.121:0/2110432506 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd498073dd0 con 0x7fd498074cb0 2024-09-17T03:35:58.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.598+0000 7fd494c00640 1 -- 172.21.15.121:0/2110432506 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd488041030 con 0x7fd498074cb0 2024-09-17T03:35:58.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.600+0000 7fd494c00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd478078b90 0x7fd47807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:58.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.600+0000 7fd494c00640 1 -- 172.21.15.121:0/2110432506 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd4880bba70 con 0x7fd498074cb0 2024-09-17T03:35:58.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.600+0000 7fd497e00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd478078b90 0x7fd47807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:58.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.601+0000 7fd497e00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd478078b90 0x7fd47807b0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd49809d800 tx=0x7fd484009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:58.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.605+0000 7fd494c00640 1 -- 172.21.15.121:0/2110432506 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd4980a0cb0 con 0x7fd498074cb0 2024-09-17T03:35:58.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.788+0000 7fd49fa00640 1 -- 172.21.15.121:0/2110432506 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4980cfb60 con 0x7fd498074cb0 2024-09-17T03:35:58.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.789+0000 7fd494c00640 1 -- 172.21.15.121:0/2110432506 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18662 (secure 0 0 0) 0x7fd4880bbe20 con 0x7fd498074cb0 2024-09-17T03:35:58.789 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:58.789 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:36.921947+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.791+0000 7fd49fa00640 1 -- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd478078b90 msgr2=0x7fd47807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.791+0000 7fd49fa00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd478078b90 0x7fd47807b0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd49809d800 tx=0x7fd484009040 comp rx=0 tx=0).stop 2024-09-17T03:35:58.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.791+0000 7fd49fa00640 1 -- 172.21.15.121:0/2110432506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd498074cb0 msgr2=0x7fd4981f8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.791+0000 7fd49fa00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd498074cb0 0x7fd4981f8790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd488006010 tx=0x7fd4880039e0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.791+0000 7fd49fa00640 1 -- 172.21.15.121:0/2110432506 shutdown_connections 2024-09-17T03:35:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.791+0000 7fd49fa00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4980a08a0 0x7fd49809c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.791+0000 7fd49fa00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4980cbc10 0x7fd4980a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.791+0000 7fd49fa00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd478078b90 0x7fd47807b0a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.791+0000 7fd49fa00640 1 --2- 172.21.15.121:0/2110432506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd498074cb0 0x7fd4981f8790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.791+0000 7fd49fa00640 1 -- 172.21.15.121:0/2110432506 >> 172.21.15.121:0/2110432506 conn(0x7fd4980cca40 msgr2=0x7fd49815b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.792+0000 7fd49fa00640 1 -- 172.21.15.121:0/2110432506 shutdown_connections 2024-09-17T03:35:58.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:58.792+0000 7fd49fa00640 1 -- 172.21.15.121:0/2110432506 wait complete. 2024-09-17T03:35:58.816 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T03:35:58.816 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:59.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.036+0000 7f80f3600640 1 -- 172.21.15.121:0/410169762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80ec0cbc10 msgr2=0x7f80ec0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.036+0000 7f80f3600640 1 --2- 172.21.15.121:0/410169762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80ec0cbc10 0x7f80ec0cc020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009830 tx=0x7f80d802a510 comp rx=0 tx=0).stop 2024-09-17T03:35:59.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.036+0000 7f80f3600640 1 -- 172.21.15.121:0/410169762 shutdown_connections 2024-09-17T03:35:59.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.036+0000 7f80f3600640 1 --2- 172.21.15.121:0/410169762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80ec0cbc10 0x7f80ec0cc020 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.036+0000 7f80f3600640 1 --2- 172.21.15.121:0/410169762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ec074cb0 0x7f80ec073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.036+0000 7f80f3600640 1 -- 172.21.15.121:0/410169762 >> 172.21.15.121:0/410169762 conn(0x7f80ec0cca40 msgr2=0x7f80ec0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.036+0000 7f80f3600640 1 -- 172.21.15.121:0/410169762 shutdown_connections 2024-09-17T03:35:59.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.036+0000 7f80f3600640 1 -- 172.21.15.121:0/410169762 wait complete. 2024-09-17T03:35:59.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.038+0000 7f80f3600640 1 Processor -- start 2024-09-17T03:35:59.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.039+0000 7f80f3600640 1 -- start start 2024-09-17T03:35:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.040+0000 7f80f3600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80ec06ddf0 0x7f80ec0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.040+0000 7f80f3600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ec074cb0 0x7f80ec0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.040+0000 7f80f3600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ec0cbc10 0x7f80ec1f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.040+0000 7f80f3600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec06f360 con 0x7f80ec06ddf0 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.040+0000 7f80f3600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec06f1e0 con 0x7f80ec074cb0 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.040+0000 7f80f3600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80ec06f4e0 con 0x7f80ec0cbc10 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.040+0000 7f80f0c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80ec06ddf0 0x7f80ec0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.040+0000 7f80f0c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80ec06ddf0 0x7f80ec0cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45956/0 (socket says 172.21.15.121:45956) 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.040+0000 7f80f0c00640 1 -- 172.21.15.121:0/3867304597 learned_addr learned my addr 172.21.15.121:0/3867304597 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80ebe00640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ec074cb0 0x7f80ec0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80f1600640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ec0cbc10 0x7f80ec1f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80f0c00640 1 -- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ec0cbc10 msgr2=0x7f80ec1f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80f0c00640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ec0cbc10 0x7f80ec1f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80f0c00640 1 -- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ec074cb0 msgr2=0x7f80ec0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80f0c00640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ec074cb0 0x7f80ec0cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80f0c00640 1 -- 172.21.15.121:0/3867304597 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec0cf550 con 0x7f80ec06ddf0 2024-09-17T03:35:59.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80f1600640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ec0cbc10 0x7f80ec1f9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:59.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80f0c00640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80ec06ddf0 0x7f80ec0cf780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c9a0 tx=0x7f80e000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80e8c00640 1 -- 172.21.15.121:0/3867304597 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e0007bb0 con 0x7f80ec06ddf0 2024-09-17T03:35:59.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80e8c00640 1 -- 172.21.15.121:0/3867304597 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80e0007e40 con 0x7f80ec06ddf0 2024-09-17T03:35:59.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80e8c00640 1 -- 172.21.15.121:0/3867304597 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e000f6b0 con 0x7f80ec06ddf0 2024-09-17T03:35:59.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.041+0000 7f80f3600640 1 -- 172.21.15.121:0/3867304597 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ec0b3cf0 con 0x7f80ec06ddf0 2024-09-17T03:35:59.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.042+0000 7f80f3600640 1 -- 172.21.15.121:0/3867304597 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ec0b4c60 con 0x7f80ec06ddf0 2024-09-17T03:35:59.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.043+0000 7f80f3600640 1 -- 172.21.15.121:0/3867304597 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80ec15fb40 con 0x7f80ec06ddf0 2024-09-17T03:35:59.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.044+0000 7f80e8c00640 1 -- 172.21.15.121:0/3867304597 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80e000f850 con 0x7f80ec06ddf0 2024-09-17T03:35:59.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.045+0000 7f80e8c00640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80cc078bc0 0x7f80cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.045+0000 7f80e8c00640 1 -- 172.21.15.121:0/3867304597 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f80e009b870 con 0x7f80ec06ddf0 2024-09-17T03:35:59.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.045+0000 7f80ebe00640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80cc078bc0 0x7f80cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.046+0000 7f80ebe00640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80cc078bc0 0x7f80cc07b0d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80d8034000 tx=0x7f80d8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.049+0000 7f80e8c00640 1 -- 172.21.15.121:0/3867304597 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80ec15fb40 con 0x7f80ec06ddf0 2024-09-17T03:35:59.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.236+0000 7f80f3600640 1 -- 172.21.15.121:0/3867304597 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80ec06fa00 con 0x7f80ec06ddf0 2024-09-17T03:35:59.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.237+0000 7f80e8c00640 1 -- 172.21.15.121:0/3867304597 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18662 (secure 0 0 0) 0x7f80e0014030 con 0x7f80ec06ddf0 2024-09-17T03:35:59.237 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:35:59.237 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:36.921947+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:59.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.239+0000 7f80f3600640 1 -- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80cc078bc0 msgr2=0x7f80cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.239+0000 7f80f3600640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80cc078bc0 0x7f80cc07b0d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80d8034000 tx=0x7f80d8004730 comp rx=0 tx=0).stop 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.239+0000 7f80f3600640 1 -- 172.21.15.121:0/3867304597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80ec06ddf0 msgr2=0x7f80ec0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.239+0000 7f80f3600640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80ec06ddf0 0x7f80ec0cf780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c9a0 tx=0x7f80e000ce60 comp rx=0 tx=0).stop 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.239+0000 7f80f3600640 1 -- 172.21.15.121:0/3867304597 shutdown_connections 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.239+0000 7f80f3600640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ec0cbc10 0x7f80ec1f9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.240+0000 7f80f3600640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ec074cb0 0x7f80ec0cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.240+0000 7f80f3600640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80cc078bc0 0x7f80cc07b0d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.240+0000 7f80f3600640 1 --2- 172.21.15.121:0/3867304597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80ec06ddf0 0x7f80ec0cf780 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.240+0000 7f80f3600640 1 -- 172.21.15.121:0/3867304597 >> 172.21.15.121:0/3867304597 conn(0x7f80ec0cca40 msgr2=0x7f80ec070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.240+0000 7f80f3600640 1 -- 172.21.15.121:0/3867304597 shutdown_connections 2024-09-17T03:35:59.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.240+0000 7f80f3600640 1 -- 172.21.15.121:0/3867304597 wait complete. 2024-09-17T03:35:59.261 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T03:35:59.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T03:35:59.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T03:35:59.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T03:35:59.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T03:35:59.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T03:35:59.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T03:35:59.264 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T03:35:59.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.658+0000 7f999a400640 1 -- 172.21.15.121:0/3588864412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998c054190 msgr2=0x7f998c007550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.658+0000 7f999a400640 1 --2- 172.21.15.121:0/3588864412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998c054190 0x7f998c007550 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f998c007240 tx=0x7f998802a4b0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.658+0000 7f999a400640 1 -- 172.21.15.121:0/3588864412 shutdown_connections 2024-09-17T03:35:59.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.658+0000 7f999a400640 1 --2- 172.21.15.121:0/3588864412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998c054190 0x7f998c007550 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.658+0000 7f999a400640 1 -- 172.21.15.121:0/3588864412 >> 172.21.15.121:0/3588864412 conn(0x7f998c03a680 msgr2=0x7f998c03aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.659+0000 7f999a400640 1 -- 172.21.15.121:0/3588864412 shutdown_connections 2024-09-17T03:35:59.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.659+0000 7f999a400640 1 -- 172.21.15.121:0/3588864412 wait complete. 2024-09-17T03:35:59.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.663+0000 7f999a400640 1 Processor -- start 2024-09-17T03:35:59.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.664+0000 7f999a400640 1 -- start start 2024-09-17T03:35:59.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.664+0000 7f77af400640 1 -- 172.21.15.121:0/2786359736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7790004800 msgr2=0x7f7790004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.664+0000 7f77af400640 1 --2- 172.21.15.121:0/2786359736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7790004800 0x7f7790004c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77a806e8f0 tx=0x7f7790005830 comp rx=0 tx=0).stop 2024-09-17T03:35:59.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.664+0000 7f77ad400640 1 -- 172.21.15.121:0/2786359736 reap_dead start 2024-09-17T03:35:59.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.665+0000 7f77af400640 1 -- 172.21.15.121:0/2786359736 shutdown_connections 2024-09-17T03:35:59.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.665+0000 7f77af400640 1 -- 172.21.15.121:0/2786359736 >> 172.21.15.121:0/2786359736 conn(0x7f77a80d4290 msgr2=0x7f77a80d46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.666+0000 7f77af400640 1 -- 172.21.15.121:0/2786359736 shutdown_connections 2024-09-17T03:35:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.667+0000 7f999a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998c053860 0x7f998c187a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.667+0000 7f999a400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f998c054190 0x7f998c0df090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.667+0000 7f999a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f998c0e3200 0x7f998c00cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.667+0000 7f999a400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f998c03cef0 con 0x7f998c054190 2024-09-17T03:35:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.667+0000 7f999a400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f998c03cd70 con 0x7f998c053860 2024-09-17T03:35:59.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.667+0000 7f999a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f998c03d070 con 0x7f998c0e3200 2024-09-17T03:35:59.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.666+0000 7f77af400640 1 -- 172.21.15.121:0/2786359736 wait complete. 2024-09-17T03:35:59.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.668+0000 7f9999000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998c053860 0x7f998c187a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.668+0000 7f9999000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998c053860 0x7f998c187a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:38140/0 (socket says 172.21.15.121:38140) 2024-09-17T03:35:59.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.668+0000 7f9999000640 1 -- 172.21.15.121:0/2692650973 learned_addr learned my addr 172.21.15.121:0/2692650973 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:59.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.668+0000 7f9999a00640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f998c0e3200 0x7f998c00cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.667+0000 7fa1dbe00640 1 -- 172.21.15.121:0/398429390 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc06a580 con 0x7fa1c4005350 2024-09-17T03:35:59.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.668+0000 7fa1e4400640 1 -- 172.21.15.121:0/398429390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1c4005350 msgr2=0x7fa1c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.668+0000 7fa1e4400640 1 --2- 172.21.15.121:0/398429390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1c4005350 0x7fa1c400b9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc06ba80 tx=0x7fa1c4005830 comp rx=0 tx=0).stop 2024-09-17T03:35:59.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.669+0000 7f9993e00640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f998c054190 0x7f998c0df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.669+0000 7f9999a00640 1 -- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998c053860 msgr2=0x7f998c187a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.669+0000 7f9999a00640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998c053860 0x7f998c187a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.669+0000 7f9999a00640 1 -- 172.21.15.121:0/2692650973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f998c054190 msgr2=0x7f998c0df090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.669+0000 7f9999a00640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f998c054190 0x7f998c0df090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.669+0000 7f9999a00640 1 -- 172.21.15.121:0/2692650973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998c187fb0 con 0x7f998c0e3200 2024-09-17T03:35:59.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.669+0000 7f9993e00640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f998c054190 0x7f998c0df090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:59.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.669+0000 7f0036400640 1 -- 172.21.15.121:0/1809168991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0028055270 msgr2=0x7f0028052840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.669+0000 7f0036400640 1 --2- 172.21.15.121:0/1809168991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0028055270 0x7f0028052840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0028055a30 tx=0x7f00300a6280 comp rx=0 tx=0).stop 2024-09-17T03:35:59.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7f0036400640 1 -- 172.21.15.121:0/1809168991 shutdown_connections 2024-09-17T03:35:59.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7f0036400640 1 --2- 172.21.15.121:0/1809168991 >> v2:172.21.15.176:3300/0 conn(0x7f0028037ec0 0x7f0028057070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7f0036400640 1 --2- 172.21.15.121:0/1809168991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0028055270 0x7f0028052840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7f0036400640 1 -- 172.21.15.121:0/1809168991 >> 172.21.15.121:0/1809168991 conn(0x7f002801fc10 msgr2=0x7f0028056960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7f77af400640 1 Processor -- start 2024-09-17T03:35:59.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7f0036400640 1 -- 172.21.15.121:0/1809168991 shutdown_connections 2024-09-17T03:35:59.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7f77af400640 1 -- start start 2024-09-17T03:35:59.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7fa1e4400640 1 -- 172.21.15.121:0/398429390 shutdown_connections 2024-09-17T03:35:59.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7fa1e4400640 1 --2- 172.21.15.121:0/398429390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1c4005350 0x7fa1c400b9c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7fa1e4400640 1 -- 172.21.15.121:0/398429390 >> 172.21.15.121:0/398429390 conn(0x7fa1d4051420 msgr2=0x7fa1d4051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7f0036400640 1 -- 172.21.15.121:0/1809168991 wait complete. 2024-09-17T03:35:59.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7f9999a00640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f998c0e3200 0x7f998c00cfe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f998c03c000 tx=0x7f999406af00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7fa1e4400640 1 -- 172.21.15.121:0/398429390 shutdown_connections 2024-09-17T03:35:59.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.670+0000 7fa1e4400640 1 -- 172.21.15.121:0/398429390 wait complete. 2024-09-17T03:35:59.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.671+0000 7f9990c00640 1 -- 172.21.15.121:0/2692650973 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994075b00 con 0x7f998c0e3200 2024-09-17T03:35:59.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.671+0000 7f9990c00640 1 -- 172.21.15.121:0/2692650973 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9994076180 con 0x7f998c0e3200 2024-09-17T03:35:59.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.671+0000 7f9990c00640 1 -- 172.21.15.121:0/2692650973 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99940765b0 con 0x7f998c0e3200 2024-09-17T03:35:59.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.672+0000 7f999a400640 1 -- 172.21.15.121:0/2692650973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998c17a030 con 0x7f998c0e3200 2024-09-17T03:35:59.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.672+0000 7f999a400640 1 -- 172.21.15.121:0/2692650973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f998c17a5f0 con 0x7f998c0e3200 2024-09-17T03:35:59.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7f9986000640 1 -- 172.21.15.121:0/2692650973 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f998c007550 con 0x7f998c0e3200 2024-09-17T03:35:59.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7f0036400640 1 Processor -- start 2024-09-17T03:35:59.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7f0036400640 1 -- start start 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7f77af400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7790004800 0x7f77a80ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7f77af400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77a80aab70 0x7f77a814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7f77af400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77a814d8f0 0x7f77a81f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7f77af400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77a80ced80 con 0x7f7790004800 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7f77af400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f77a806e000 con 0x7f77a814d8f0 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7f77af400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f77a80cef00 con 0x7f77a80aab70 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.674+0000 7f77ad400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77a814d8f0 0x7f77a81f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.674+0000 7f77ad400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77a814d8f0 0x7f77a81f87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:38148/0 (socket says 172.21.15.121:38148) 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.674+0000 7f77ad400640 1 -- 172.21.15.121:0/3302649025 learned_addr learned my addr 172.21.15.121:0/3302649025 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.674+0000 7f77a7e00640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77a80aab70 0x7f77a814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.674+0000 7f77ad400640 1 -- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77a80aab70 msgr2=0x7f77a814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.674+0000 7f77ad400640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77a80aab70 0x7f77a814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.674+0000 7f77ad400640 1 -- 172.21.15.121:0/3302649025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7790004800 msgr2=0x7f77a80ca9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:35:59.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.675+0000 7f77aca00640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7790004800 0x7f77a80ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.672+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3720405139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b40b4300 msgr2=0x7fc998004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.672+0000 7fc9b8e00640 1 --2- 172.21.15.121:0/3720405139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b40b4300 0x7fc998004800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40d1930 tx=0x7fc998005830 comp rx=0 tx=0).stop 2024-09-17T03:35:59.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7fc9b3e00640 1 -- 172.21.15.121:0/3720405139 reap_dead start 2024-09-17T03:35:59.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3720405139 shutdown_connections 2024-09-17T03:35:59.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.673+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3720405139 >> 172.21.15.121:0/3720405139 conn(0x7fc9b40ceee0 msgr2=0x7fc9b40cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.675+0000 7fa1e4400640 1 Processor -- start 2024-09-17T03:35:59.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.675+0000 7f77ad400640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7790004800 0x7f77a80ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.675+0000 7f77ad400640 1 -- 172.21.15.121:0/3302649025 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a80ab0f0 con 0x7f77a814d8f0 2024-09-17T03:35:59.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.675+0000 7f77aca00640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7790004800 0x7f77a80ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:59.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.675+0000 7fa1e4400640 1 -- start start 2024-09-17T03:35:59.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.675+0000 7f9990c00640 1 -- 172.21.15.121:0/2692650973 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9994093400 con 0x7f998c0e3200 2024-09-17T03:35:59.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.675+0000 7f77ad400640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77a814d8f0 0x7f77a81f87e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f77a0000f80 tx=0x7f77a0007700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.676+0000 7f77a4c00640 1 -- 172.21.15.121:0/3302649025 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a000ec30 con 0x7f77a814d8f0 2024-09-17T03:35:59.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.676+0000 7f77a4c00640 1 -- 172.21.15.121:0/3302649025 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77a0016070 con 0x7f77a814d8f0 2024-09-17T03:35:59.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.676+0000 7f77a4c00640 1 -- 172.21.15.121:0/3302649025 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a00116b0 con 0x7f77a814d8f0 2024-09-17T03:35:59.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.676+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a80cd010 con 0x7f77a814d8f0 2024-09-17T03:35:59.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.677+0000 7f9990c00640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9974078be0 0x7f997407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.677+0000 7f9990c00640 1 -- 172.21.15.121:0/2692650973 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9994116160 con 0x7f998c0e3200 2024-09-17T03:35:59.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.676+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3720405139 shutdown_connections 2024-09-17T03:35:59.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.677+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3720405139 wait complete. 2024-09-17T03:35:59.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.677+0000 7f9990c00640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] conn(0x7f99740823a0 0x7f9974084830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.677+0000 7f9990c00640 1 -- 172.21.15.121:0/2692650973 --> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9994096e50 con 0x7f99740823a0 2024-09-17T03:35:59.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.677+0000 7f9990c00640 1 -- 172.21.15.121:0/2692650973 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9994116510 con 0x7f998c0e3200 2024-09-17T03:35:59.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.677+0000 7f9999000640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9974078be0 0x7f997407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.678+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a80ccce0 con 0x7f77a814d8f0 2024-09-17T03:35:59.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.678+0000 7f9993e00640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] conn(0x7f99740823a0 0x7f9974084830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7fa1e4400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1c4005350 0x7fa1d40e0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7fa1e4400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1d40daea0 0x7fa1d40e11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7fa1e4400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d40f0a50 0x7fa1d40f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7f7749000640 1 -- 172.21.15.121:0/4186962789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774415ac20 msgr2=0x7f7744070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7f7749000640 1 --2- 172.21.15.121:0/4186962789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774415ac20 0x7f7744070070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f774406a1b0 tx=0x7f772c02a3d0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fa1e4400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4005c60 con 0x7fa1d40f0a50 2024-09-17T03:35:59.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fa1e4400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d40df3e0 con 0x7fa1c4005350 2024-09-17T03:35:59.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fa1e4400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d4005de0 con 0x7fa1d40daea0 2024-09-17T03:35:59.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7fa1e1a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1c4005350 0x7fa1d40e0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fa1e1a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1c4005350 0x7fa1d40e0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:38190/0 (socket says 172.21.15.121:38190) 2024-09-17T03:35:59.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fa1e1a00640 1 -- 172.21.15.121:0/148796180 learned_addr learned my addr 172.21.15.121:0/148796180 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:59.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fa1e2400640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d40f0a50 0x7fa1d40f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77a80caf00 con 0x7f77a814d8f0 2024-09-17T03:35:59.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fc9b8e00640 1 Processor -- start 2024-09-17T03:35:59.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7f0036400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0028037ab0 0x7f0028035380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7f0036400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0028037ec0 0x7f00280dee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7f0036400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0028055270 0x7f00280df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7f0036400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0028051310 con 0x7f0028055270 2024-09-17T03:35:59.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7fc9b8e00640 1 -- start start 2024-09-17T03:35:59.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fa1e1a00640 1 -- 172.21.15.121:0/148796180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1d40daea0 msgr2=0x7fa1d40e11b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:35:59.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fa1e1a00640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1d40daea0 0x7fa1d40e11b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7f0036400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0028051190 con 0x7f0028037ab0 2024-09-17T03:35:59.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.679+0000 7f0036400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0028051490 con 0x7f0028037ec0 2024-09-17T03:35:59.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7f002f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0028037ab0 0x7f0028035380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7f002ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0028037ec0 0x7f00280dee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7f002ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0028037ec0 0x7f00280dee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:60656/0 (socket says 172.21.15.121:60656) 2024-09-17T03:35:59.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7f002ea00640 1 -- 172.21.15.121:0/1704597250 learned_addr learned my addr 172.21.15.121:0/1704597250 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:59.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7f7749000640 1 -- 172.21.15.121:0/4186962789 shutdown_connections 2024-09-17T03:35:59.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7f7749000640 1 --2- 172.21.15.121:0/4186962789 >> v2:172.21.15.121:3300/0 conn(0x7f7744072d90 0x7f77440731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7f7749000640 1 --2- 172.21.15.121:0/4186962789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774415ac20 0x7f7744070070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7f7749000640 1 -- 172.21.15.121:0/4186962789 >> 172.21.15.121:0/4186962789 conn(0x7f77440b1b90 msgr2=0x7f77440b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7f9993e00640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] conn(0x7f99740823a0 0x7f9974084830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7f7749000640 1 -- 172.21.15.121:0/4186962789 shutdown_connections 2024-09-17T03:35:59.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7f9999000640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9974078be0 0x7f997407b0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9988005eb0 tx=0x7f9988004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7f7749000640 1 -- 172.21.15.121:0/4186962789 wait complete. 2024-09-17T03:35:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fa1e1a00640 1 -- 172.21.15.121:0/148796180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d40f0a50 msgr2=0x7fa1d40f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.680+0000 7fa1e1a00640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d40f0a50 0x7fa1d40f0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7fa1e1a00640 1 -- 172.21.15.121:0/148796180 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d40dd550 con 0x7fa1c4005350 2024-09-17T03:35:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.681+0000 7fa1e1a00640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1c4005350 0x7fa1d40e0c70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000d620 tx=0x7fa1d000dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7fa1d9600640 1 -- 172.21.15.121:0/148796180 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0014070 con 0x7fa1c4005350 2024-09-17T03:35:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7fa1d9600640 1 -- 172.21.15.121:0/148796180 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1d0004640 con 0x7fa1c4005350 2024-09-17T03:35:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7fa1e4400640 1 -- 172.21.15.121:0/148796180 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d40dd830 con 0x7fa1c4005350 2024-09-17T03:35:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7fa1d9600640 1 -- 172.21.15.121:0/148796180 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0004a50 con 0x7fa1c4005350 2024-09-17T03:35:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7fa1e4400640 1 -- 172.21.15.121:0/148796180 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d40dddf0 con 0x7fa1c4005350 2024-09-17T03:35:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.683+0000 7f77a4c00640 1 -- 172.21.15.121:0/3302649025 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77a0011850 con 0x7f77a814d8f0 2024-09-17T03:35:59.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.683+0000 7f9990c00640 1 -- 172.21.15.121:0/2692650973 <== osd.1 v2:172.21.15.121:6824/1986765065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9994096e50 con 0x7f99740823a0 2024-09-17T03:35:59.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7f002f400640 1 -- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0028037ec0 msgr2=0x7f00280dee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7f002f400640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0028037ec0 0x7f00280dee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7f002f400640 1 -- 172.21.15.121:0/1704597250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0028055270 msgr2=0x7f00280df3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:35:59.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7f002f400640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0028055270 0x7f00280df3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7f002f400640 1 -- 172.21.15.121:0/1704597250 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0028033780 con 0x7f0028037ab0 2024-09-17T03:35:59.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7f002ea00640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0028037ec0 0x7f00280dee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:59.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.682+0000 7f002f400640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0028037ab0 0x7f0028035380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f003006a2f0 tx=0x7f00300aef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.683+0000 7f0023400640 1 -- 172.21.15.121:0/1704597250 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00300cc070 con 0x7f0028037ab0 2024-09-17T03:35:59.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.683+0000 7f0023400640 1 -- 172.21.15.121:0/1704597250 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00300c4040 con 0x7f0028037ab0 2024-09-17T03:35:59.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.683+0000 7f0023400640 1 -- 172.21.15.121:0/1704597250 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00300c8b20 con 0x7f0028037ab0 2024-09-17T03:35:59.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.683+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0028033a60 con 0x7f0028037ab0 2024-09-17T03:35:59.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.683+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0028034020 con 0x7f0028037ab0 2024-09-17T03:35:59.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.683+0000 7fc9b8e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b414a870 0x7fc9b4161780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.683+0000 7fc9b8e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9b414e550 0x7fc9b414bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.683+0000 7fc9b8e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9b414c020 0x7fc9b4156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.684+0000 7fc9b3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b414a870 0x7fc9b4161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.684+0000 7fc9b8e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b40cd1f0 con 0x7fc9b414e550 2024-09-17T03:35:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.684+0000 7fc9b3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b414a870 0x7fc9b4161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:60658/0 (socket says 172.21.15.121:60658) 2024-09-17T03:35:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.684+0000 7fc9b3400640 1 -- 172.21.15.121:0/3565826224 learned_addr learned my addr 172.21.15.121:0/3565826224 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.684+0000 7fc9b2a00640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9b414e550 0x7fc9b414bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.684+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b40b4e90 con 0x7fc9b414c020 2024-09-17T03:35:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.684+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b40cd370 con 0x7fc9b414a870 2024-09-17T03:35:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7fc9b3400640 1 -- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9b414c020 msgr2=0x7fc9b4156280 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:35:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7fc9b3400640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9b414c020 0x7fc9b4156280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7fc9b3400640 1 -- 172.21.15.121:0/3565826224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9b414e550 msgr2=0x7fc9b414bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7fc9b3400640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9b414e550 0x7fc9b414bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7f3876400640 1 -- 172.21.15.121:0/372848380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3858004bf0 msgr2=0x7f3858005060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7f3876400640 1 --2- 172.21.15.121:0/372848380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3858004bf0 0x7f3858005060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f385c001950 tx=0x7f3858005830 comp rx=0 tx=0).stop 2024-09-17T03:35:59.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7f3876400640 1 -- 172.21.15.121:0/372848380 shutdown_connections 2024-09-17T03:35:59.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7f3876400640 1 --2- 172.21.15.121:0/372848380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3858004bf0 0x7f3858005060 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f385c001950 tx=0x7f3858005830 comp rx=0 tx=0).stop 2024-09-17T03:35:59.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7f3876400640 1 -- 172.21.15.121:0/372848380 >> 172.21.15.121:0/372848380 conn(0x7f38700d1960 msgr2=0x7f38700d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7f77a4c00640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7788078b90 0x7f778807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.684+0000 7f7749000640 1 Processor -- start 2024-09-17T03:35:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f000c001030 con 0x7f0028037ab0 2024-09-17T03:35:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.685+0000 7fc9b3400640 1 -- 172.21.15.121:0/3565826224 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b414ead0 con 0x7fc9b414a870 2024-09-17T03:35:59.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7f77a4c00640 1 -- 172.21.15.121:0/3302649025 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f77a009b9b0 con 0x7f77a814d8f0 2024-09-17T03:35:59.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7f7749000640 1 -- start start 2024-09-17T03:35:59.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7fa1cea00640 1 -- 172.21.15.121:0/148796180 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1d4036400 con 0x7fa1c4005350 2024-09-17T03:35:59.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7f77aca00640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7788078b90 0x7f778807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7f77a4c00640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] conn(0x7f7788082360 0x7f77880847f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7f77a4c00640 1 -- 172.21.15.121:0/3302649025 --> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7788084ec0 con 0x7f7788082360 2024-09-17T03:35:59.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7fc9b2a00640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9b414e550 0x7fc9b414bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:59.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7f77a4c00640 1 -- 172.21.15.121:0/3302649025 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f77a00a02a0 con 0x7f77a814d8f0 2024-09-17T03:35:59.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7f77a7e00640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] conn(0x7f7788082360 0x7f77880847f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.686+0000 7fc9b3400640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b414a870 0x7fc9b4161780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4011ba0 tx=0x7fc9a400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.687+0000 7f3876400640 1 -- 172.21.15.121:0/372848380 shutdown_connections 2024-09-17T03:35:59.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.687+0000 7f77a7e00640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] conn(0x7f7788082360 0x7f77880847f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.687+0000 7f3876400640 1 -- 172.21.15.121:0/372848380 wait complete. 2024-09-17T03:35:59.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.687+0000 7fc9ab400640 1 -- 172.21.15.121:0/3565826224 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a401e070 con 0x7fc9b414a870 2024-09-17T03:35:59.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.688+0000 7fc9ab400640 1 -- 172.21.15.121:0/3565826224 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9a400e7c0 con 0x7fc9b414a870 2024-09-17T03:35:59.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.688+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b414edb0 con 0x7fc9b414a870 2024-09-17T03:35:59.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.688+0000 7f7749000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774406ddf0 0x7f77441e5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.688+0000 7f7749000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7744072d90 0x7f7744155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.689+0000 7f7749000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f774415ac20 0x7f77440c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.689+0000 7f77a4c00640 1 -- 172.21.15.121:0/3302649025 <== osd.0 v2:172.21.15.121:6816/519637471 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7788084ec0 con 0x7f7788082360 2024-09-17T03:35:59.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.689+0000 7f7749000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77440736e0 con 0x7f7744072d90 2024-09-17T03:35:59.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.688+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b414f650 con 0x7fc9b414a870 2024-09-17T03:35:59.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.689+0000 7fc9ab400640 1 -- 172.21.15.121:0/3565826224 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a400ebd0 con 0x7fc9b414a870 2024-09-17T03:35:59.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.689+0000 7f7749000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7744071090 con 0x7f774406ddf0 2024-09-17T03:35:59.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.689+0000 7f7749000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7744073860 con 0x7f774415ac20 2024-09-17T03:35:59.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.689+0000 7f7741e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774406ddf0 0x7f77441e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.689+0000 7f7741e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774406ddf0 0x7f77441e5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:38222/0 (socket says 172.21.15.121:38222) 2024-09-17T03:35:59.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.689+0000 7f7741e00640 1 -- 172.21.15.121:0/383408808 learned_addr learned my addr 172.21.15.121:0/383408808 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:59.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.690+0000 7f7742800640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f774415ac20 0x7f77440c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.690+0000 7f7741400640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7744072d90 0x7f7744155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.690+0000 7f7741e00640 1 -- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f774415ac20 msgr2=0x7f77440c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.690+0000 7f7741e00640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f774415ac20 0x7f77440c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.690+0000 7f7741e00640 1 -- 172.21.15.121:0/383408808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7744072d90 msgr2=0x7f7744155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.690+0000 7f7741e00640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7744072d90 0x7f7744155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.690+0000 7f7741e00640 1 -- 172.21.15.121:0/383408808 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77441e43e0 con 0x7f774406ddf0 2024-09-17T03:35:59.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.690+0000 7fa1d9600640 1 -- 172.21.15.121:0/148796180 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1d0017070 con 0x7fa1c4005350 2024-09-17T03:35:59.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.691+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc98c001030 con 0x7fc9b414a870 2024-09-17T03:35:59.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.691+0000 7f7741e00640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774406ddf0 0x7f77441e5160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f772c009920 tx=0x7f772c033af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.692+0000 7f77aca00640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7788078b90 0x7f778807b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77a808d140 tx=0x7f779c005e00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.691+0000 7f0023400640 1 -- 172.21.15.121:0/1704597250 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f00300cf070 con 0x7f0028037ab0 2024-09-17T03:35:59.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.691+0000 7fa1d9600640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa1bc078c90 0x7fa1bc07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.692+0000 7fa1d9600640 1 -- 172.21.15.121:0/148796180 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa1d009b390 con 0x7fa1c4005350 2024-09-17T03:35:59.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.692+0000 7fa1d9600640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] conn(0x7fa1bc082450 0x7fa1bc0848e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.692+0000 7fa1d9600640 1 -- 172.21.15.121:0/148796180 --> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1bc084fb0 con 0x7fa1bc082450 2024-09-17T03:35:59.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.692+0000 7fa1d9600640 1 -- 172.21.15.121:0/148796180 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa1d00a2050 con 0x7fa1c4005350 2024-09-17T03:35:59.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.692+0000 7f773a000640 1 -- 172.21.15.121:0/383408808 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c037050 con 0x7f774406ddf0 2024-09-17T03:35:59.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.692+0000 7f773a000640 1 -- 172.21.15.121:0/383408808 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f772c038040 con 0x7f774406ddf0 2024-09-17T03:35:59.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.692+0000 7f773a000640 1 -- 172.21.15.121:0/383408808 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c005020 con 0x7f774406ddf0 2024-09-17T03:35:59.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.692+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77441e4680 con 0x7f774406ddf0 2024-09-17T03:35:59.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.693+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77440b3f50 con 0x7f774406ddf0 2024-09-17T03:35:59.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.693+0000 7fa1e1000640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa1bc078c90 0x7fa1bc07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.693+0000 7f0023400640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0010078c90 0x7f001007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.693+0000 7fa1e2400640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] conn(0x7fa1bc082450 0x7fa1bc0848e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.693+0000 7f0023400640 1 -- 172.21.15.121:0/1704597250 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0030147ec0 con 0x7f0028037ab0 2024-09-17T03:35:59.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.694+0000 7f002ea00640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0010078c90 0x7f001007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.694+0000 7f0023400640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] conn(0x7f0010082460 0x7f00100848f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.695+0000 7f002ea00640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0010078c90 0x7f001007b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0028052b40 tx=0x7f001c0090e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.695+0000 7f0023400640 1 -- 172.21.15.121:0/1704597250 --> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0030064660 con 0x7f0010082460 2024-09-17T03:35:59.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.695+0000 7f0023400640 1 -- 172.21.15.121:0/1704597250 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f00301482b0 con 0x7f0028037ab0 2024-09-17T03:35:59.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.693+0000 7f3876400640 1 Processor -- start 2024-09-17T03:35:59.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.693+0000 7f3876400640 1 -- start start 2024-09-17T03:35:59.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7facc9400640 1 -- 172.21.15.121:0/3596825618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faca8004800 msgr2=0x7faca8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7f002fe00640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] conn(0x7f0010082460 0x7f00100848f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7facc9400640 1 --2- 172.21.15.121:0/3596825618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faca8004800 0x7faca8004c10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7facac009880 tx=0x7faca8005830 comp rx=0 tx=0).stop 2024-09-17T03:35:59.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7f3876400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3870155d80 0x7f387014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7f3876400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38700b5330 0x7f387015f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7f3876400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f387015f870 0x7f387015fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7f3876400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f38701628e0 con 0x7f38700b5330 2024-09-17T03:35:59.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7f3876400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3870162760 con 0x7f387015f870 2024-09-17T03:35:59.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7f3876400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3870162a60 con 0x7f3870155d80 2024-09-17T03:35:59.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.694+0000 7fa1e2400640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] conn(0x7fa1bc082450 0x7fa1bc0848e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7fa1d9600640 1 -- 172.21.15.121:0/148796180 <== osd.2 v2:172.21.15.121:6800/3957619612 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1bc084fb0 con 0x7fa1bc082450 2024-09-17T03:35:59.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7fa1e1000640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa1bc078c90 0x7fa1bc07b1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4032b40 tx=0x7fa1c8005f60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7f002fe00640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] conn(0x7f0010082460 0x7f00100848f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7f3875000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3870155d80 0x7f387014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7facc3200640 1 -- 172.21.15.121:0/3596825618 reap_dead start 2024-09-17T03:35:59.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7f3875000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3870155d80 0x7f387014e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:60686/0 (socket says 172.21.15.121:60686) 2024-09-17T03:35:59.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7f3875000640 1 -- 172.21.15.121:0/1645325212 learned_addr learned my addr 172.21.15.121:0/1645325212 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:59.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7f3875a00640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f387015f870 0x7f387015fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7f386fe00640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38700b5330 0x7f387015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7facc9400640 1 -- 172.21.15.121:0/3596825618 shutdown_connections 2024-09-17T03:35:59.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7facc9400640 1 -- 172.21.15.121:0/3596825618 >> 172.21.15.121:0/3596825618 conn(0x7facc40b1b90 msgr2=0x7facc40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7fc9ab400640 1 -- 172.21.15.121:0/3565826224 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9a4021070 con 0x7fc9b414a870 2024-09-17T03:35:59.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f3875000640 1 -- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f387015f870 msgr2=0x7f387015fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f3875000640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f387015f870 0x7f387015fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f3875000640 1 -- 172.21.15.121:0/1645325212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38700b5330 msgr2=0x7f387015f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f3875000640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38700b5330 0x7f387015f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f3875000640 1 -- 172.21.15.121:0/1645325212 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38700b5b60 con 0x7f3870155d80 2024-09-17T03:35:59.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f386fe00640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38700b5330 0x7f387015f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:59.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7fc9ab400640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc994078b90 0x7fc99407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.696+0000 7f773a000640 1 -- 172.21.15.121:0/383408808 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f772c045030 con 0x7f774406ddf0 2024-09-17T03:35:59.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.697+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77441559a0 con 0x7f774406ddf0 2024-09-17T03:35:59.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f773a000640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7720078b90 0x7f772007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f773a000640 1 -- 172.21.15.121:0/383408808 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f772c0bb0e0 con 0x7f774406ddf0 2024-09-17T03:35:59.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f773a000640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x7f7720082350 0x7f77200847e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f773a000640 1 -- 172.21.15.121:0/383408808 --> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7720084eb0 con 0x7f7720082350 2024-09-17T03:35:59.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.698+0000 7f773a000640 1 -- 172.21.15.121:0/383408808 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f772c0c2050 con 0x7f774406ddf0 2024-09-17T03:35:59.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7f0023400640 1 -- 172.21.15.121:0/1704597250 <== osd.3 v2:172.21.15.121:6808/1711221515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0030064660 con 0x7f0010082460 2024-09-17T03:35:59.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7facc9400640 1 -- 172.21.15.121:0/3596825618 shutdown_connections 2024-09-17T03:35:59.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7f3875000640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3870155d80 0x7f387014e790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f385c02aaf0 tx=0x7f385c001570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7f386cc00640 1 -- 172.21.15.121:0/1645325212 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c042070 con 0x7f3870155d80 2024-09-17T03:35:59.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7f386cc00640 1 -- 172.21.15.121:0/1645325212 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f385c038040 con 0x7f3870155d80 2024-09-17T03:35:59.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7f386cc00640 1 -- 172.21.15.121:0/1645325212 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c004470 con 0x7f3870155d80 2024-09-17T03:35:59.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7fc9ab400640 1 -- 172.21.15.121:0/3565826224 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc9a409bff0 con 0x7fc9b414a870 2024-09-17T03:35:59.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7fc9b2a00640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc994078b90 0x7fc99407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7fc9ab400640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] conn(0x7fc994082360 0x7fc9940847f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7fc9ab400640 1 -- 172.21.15.121:0/3565826224 --> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc994084ec0 con 0x7fc994082360 2024-09-17T03:35:59.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7fc9ab400640 1 -- 172.21.15.121:0/3565826224 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc9a409e5f0 con 0x7fc9b414a870 2024-09-17T03:35:59.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7facc9400640 1 -- 172.21.15.121:0/3596825618 wait complete. 2024-09-17T03:35:59.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7f7741400640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7720078b90 0x7f772007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7f7742800640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x7f7720082350 0x7f77200847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7f3876400640 1 -- 172.21.15.121:0/1645325212 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38700b5e40 con 0x7f3870155d80 2024-09-17T03:35:59.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.699+0000 7fc9b3e00640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] conn(0x7fc994082360 0x7fc9940847f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.700+0000 7f3876400640 1 -- 172.21.15.121:0/1645325212 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38700b5740 con 0x7f3870155d80 2024-09-17T03:35:59.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.700+0000 7fc9b2a00640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc994078b90 0x7fc99407b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0035000 tx=0x7fc9a00046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.700+0000 7f7741400640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7720078b90 0x7f772007b0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f774415a8c0 tx=0x7f7734009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.701+0000 7f3876400640 1 -- 172.21.15.121:0/1645325212 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f387015ef10 con 0x7f3870155d80 2024-09-17T03:35:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.701+0000 7f7742800640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x7f7720082350 0x7f77200847e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.701+0000 7fc9b3e00640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] conn(0x7fc994082360 0x7fc9940847f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.702+0000 7fc9ab400640 1 -- 172.21.15.121:0/3565826224 <== osd.4 v2:172.21.15.176:6818/3274370689 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc994084ec0 con 0x7fc994082360 2024-09-17T03:35:59.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.702+0000 7facc9400640 1 Processor -- start 2024-09-17T03:35:59.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.703+0000 7f773a000640 1 -- 172.21.15.121:0/383408808 <== osd.6 v2:172.21.15.176:6810/1810611479 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7720084eb0 con 0x7f7720082350 2024-09-17T03:35:59.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.703+0000 7facc9400640 1 -- start start 2024-09-17T03:35:59.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.705+0000 7facc9400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc41f55a0 0x7facc40c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.705+0000 7facc9400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facc41592f0 0x7facc41e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.705+0000 7facc9400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facc4159700 0x7facc41e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.705+0000 7facc9400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7facc4073f90 con 0x7facc41592f0 2024-09-17T03:35:59.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.705+0000 7facc9400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7facc406f980 con 0x7facc41f55a0 2024-09-17T03:35:59.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.705+0000 7facc9400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7facc406e330 con 0x7facc4159700 2024-09-17T03:35:59.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.704+0000 7f386cc00640 1 -- 172.21.15.121:0/1645325212 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f385c0060e0 con 0x7f3870155d80 2024-09-17T03:35:59.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.706+0000 7f386cc00640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3850078b90 0x7f385007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.706+0000 7facc2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc41f55a0 0x7facc40c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.706+0000 7facc2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc41f55a0 0x7facc40c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:38236/0 (socket says 172.21.15.121:38236) 2024-09-17T03:35:59.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.706+0000 7facc2800640 1 -- 172.21.15.121:0/885163314 learned_addr learned my addr 172.21.15.121:0/885163314 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:35:59.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.706+0000 7facc3200640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facc4159700 0x7facc41e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.707+0000 7f386cc00640 1 -- 172.21.15.121:0/1645325212 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f385c0bad20 con 0x7f3870155d80 2024-09-17T03:35:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.707+0000 7facc2800640 1 -- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facc4159700 msgr2=0x7facc41e6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.707+0000 7facc2800640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facc4159700 0x7facc41e6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.707+0000 7facc2800640 1 -- 172.21.15.121:0/885163314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facc41592f0 msgr2=0x7facc41e6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.707+0000 7facc2800640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facc41592f0 0x7facc41e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.708+0000 7facc2800640 1 -- 172.21.15.121:0/885163314 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc4159fb0 con 0x7facc41f55a0 2024-09-17T03:35:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.707+0000 7f386cc00640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] conn(0x7f3850082350 0x7f38500847e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.707+0000 7f386cc00640 1 -- 172.21.15.121:0/1645325212 --> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3850084eb0 con 0x7f3850082350 2024-09-17T03:35:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.707+0000 7f386cc00640 1 -- 172.21.15.121:0/1645325212 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f385c0bb110 con 0x7f3870155d80 2024-09-17T03:35:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.707+0000 7f3875a00640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] conn(0x7f3850082350 0x7f38500847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.708+0000 7f386fe00640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3850078b90 0x7f385007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.708+0000 7f3875a00640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] conn(0x7f3850082350 0x7f38500847e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.709+0000 7f386fe00640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3850078b90 0x7f385007b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3870064980 tx=0x7f38640014e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.709+0000 7f9986000640 1 -- 172.21.15.121:0/2692650973 --> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f998c188270 con 0x7f99740823a0 2024-09-17T03:35:59.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.709+0000 7facc2800640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc41f55a0 0x7facc40c9b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7facb400cce0 tx=0x7facb400a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.709+0000 7f386cc00640 1 -- 172.21.15.121:0/1645325212 <== osd.7 v2:172.21.15.176:6802/2211533111 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3850084eb0 con 0x7f3850082350 2024-09-17T03:35:59.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.710+0000 7facbb400640 1 -- 172.21.15.121:0/885163314 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb400f450 con 0x7facc41f55a0 2024-09-17T03:35:59.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.710+0000 7facbb400640 1 -- 172.21.15.121:0/885163314 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facb400f6e0 con 0x7facc41f55a0 2024-09-17T03:35:59.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.710+0000 7facbb400640 1 -- 172.21.15.121:0/885163314 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb400fad0 con 0x7facc41f55a0 2024-09-17T03:35:59.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.710+0000 7facc9400640 1 -- 172.21.15.121:0/885163314 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc4159cd0 con 0x7facc41f55a0 2024-09-17T03:35:59.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.710+0000 7facc9400640 1 -- 172.21.15.121:0/885163314 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc41f4da0 con 0x7facc41f55a0 2024-09-17T03:35:59.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.711+0000 7facc9400640 1 -- 172.21.15.121:0/885163314 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7facc406ddf0 con 0x7facc41f55a0 2024-09-17T03:35:59.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.711+0000 7f9990c00640 1 -- 172.21.15.121:0/2692650973 <== osd.1 v2:172.21.15.121:6824/1986765065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f998c188270 con 0x7f99740823a0 2024-09-17T03:35:59.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.713+0000 7f9986000640 1 -- 172.21.15.121:0/2692650973 >> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] conn(0x7f99740823a0 msgr2=0x7f9974084830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.713+0000 7f9986000640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] conn(0x7f99740823a0 0x7f9974084830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.713+0000 7f9986000640 1 -- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9974078be0 msgr2=0x7f997407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.713+0000 7f9986000640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9974078be0 0x7f997407b0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9988005eb0 tx=0x7f9988004730 comp rx=0 tx=0).stop 2024-09-17T03:35:59.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.713+0000 7f9986000640 1 -- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f998c0e3200 msgr2=0x7f998c00cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.713+0000 7f9986000640 1 --2- 172.21.15.121:0/2692650973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f998c0e3200 0x7f998c00cfe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f998c03c000 tx=0x7f999406af00 comp rx=0 tx=0).stop 2024-09-17T03:35:59.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.713+0000 7f9999a00640 1 -- 172.21.15.121:0/2692650973 reap_dead start 2024-09-17T03:35:59.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.713+0000 7facbb400640 1 -- 172.21.15.121:0/885163314 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7facb4018400 con 0x7facc41f55a0 2024-09-17T03:35:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.714+0000 7facbb400640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faca0078c90 0x7faca007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.714+0000 7facbb400640 1 -- 172.21.15.121:0/885163314 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7facb409c420 con 0x7facc41f55a0 2024-09-17T03:35:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.715+0000 7facbb400640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] conn(0x7faca0082450 0x7faca00848e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.715+0000 7facbb400640 1 -- 172.21.15.121:0/885163314 --> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faca0084fb0 con 0x7faca0082450 2024-09-17T03:35:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.715+0000 7facbb400640 1 -- 172.21.15.121:0/885163314 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7facb409c810 con 0x7facc41f55a0 2024-09-17T03:35:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.715+0000 7facb9e00640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faca0078c90 0x7faca007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.715+0000 7facc3200640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] conn(0x7faca0082450 0x7faca00848e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.716+0000 7f9986000640 1 -- 172.21.15.121:0/2692650973 shutdown_connections 2024-09-17T03:35:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.716+0000 7f9986000640 1 -- 172.21.15.121:0/2692650973 >> 172.21.15.121:0/2692650973 conn(0x7f998c03a680 msgr2=0x7f998c0e2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.716+0000 7facc3200640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] conn(0x7faca0082450 0x7faca00848e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.716+0000 7facb9e00640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faca0078c90 0x7faca007b1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7facac034000 tx=0x7facac02c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:59.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.717+0000 7facbb400640 1 -- 172.21.15.121:0/885163314 <== osd.5 v2:172.21.15.176:6826/3997922862 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faca0084fb0 con 0x7faca0082450 2024-09-17T03:35:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.720+0000 7f9986000640 1 -- 172.21.15.121:0/2692650973 shutdown_connections 2024-09-17T03:35:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.720+0000 7f9986000640 1 -- 172.21.15.121:0/2692650973 wait complete. 2024-09-17T03:35:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.723+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 --> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77a80d2820 con 0x7f7788082360 2024-09-17T03:35:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.724+0000 7f77a4c00640 1 -- 172.21.15.121:0/3302649025 <== osd.0 v2:172.21.15.121:6816/519637471 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f77a80d2820 con 0x7f7788082360 2024-09-17T03:35:59.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.725+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 >> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] conn(0x7f7788082360 msgr2=0x7f77880847f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.725+0000 7f77af400640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] conn(0x7f7788082360 0x7f77880847f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.725+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7788078b90 msgr2=0x7f778807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.725+0000 7f77af400640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7788078b90 0x7f778807b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77a808d140 tx=0x7f779c005e00 comp rx=0 tx=0).stop 2024-09-17T03:35:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.725+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77a814d8f0 msgr2=0x7f77a81f87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.725+0000 7f77af400640 1 --2- 172.21.15.121:0/3302649025 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77a814d8f0 0x7f77a81f87e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f77a0000f80 tx=0x7f77a0007700 comp rx=0 tx=0).stop 2024-09-17T03:35:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.725+0000 7f77ad400640 1 -- 172.21.15.121:0/3302649025 reap_dead start 2024-09-17T03:35:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.726+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 shutdown_connections 2024-09-17T03:35:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.726+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 >> 172.21.15.121:0/3302649025 conn(0x7f77a80d4290 msgr2=0x7f77a80b5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.726+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 shutdown_connections 2024-09-17T03:35:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.726+0000 7f77af400640 1 -- 172.21.15.121:0/3302649025 wait complete. 2024-09-17T03:35:59.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.730+0000 7fa1cea00640 1 -- 172.21.15.121:0/148796180 --> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa1d4005800 con 0x7fa1bc082450 2024-09-17T03:35:59.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.731+0000 7fa1d9600640 1 -- 172.21.15.121:0/148796180 <== osd.2 v2:172.21.15.121:6800/3957619612 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa1d4005800 con 0x7fa1bc082450 2024-09-17T03:35:59.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.732+0000 7fa1cea00640 1 -- 172.21.15.121:0/148796180 >> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] conn(0x7fa1bc082450 msgr2=0x7fa1bc0848e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.732+0000 7fa1cea00640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] conn(0x7fa1bc082450 0x7fa1bc0848e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.733+0000 7fa1cea00640 1 -- 172.21.15.121:0/148796180 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa1bc078c90 msgr2=0x7fa1bc07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.733+0000 7fa1cea00640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa1bc078c90 0x7fa1bc07b1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4032b40 tx=0x7fa1c8005f60 comp rx=0 tx=0).stop 2024-09-17T03:35:59.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.733+0000 7fa1cea00640 1 -- 172.21.15.121:0/148796180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1c4005350 msgr2=0x7fa1d40e0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.733+0000 7fa1cea00640 1 --2- 172.21.15.121:0/148796180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1c4005350 0x7fa1d40e0c70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000d620 tx=0x7fa1d000dae0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.733+0000 7fa1e2400640 1 -- 172.21.15.121:0/148796180 reap_dead start 2024-09-17T03:35:59.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.733+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 --> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f000c002dd0 con 0x7f0010082460 2024-09-17T03:35:59.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.734+0000 7fa1cea00640 1 -- 172.21.15.121:0/148796180 shutdown_connections 2024-09-17T03:35:59.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.734+0000 7fa1cea00640 1 -- 172.21.15.121:0/148796180 >> 172.21.15.121:0/148796180 conn(0x7fa1d4051420 msgr2=0x7fa1d4004a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.734+0000 7fa1cea00640 1 -- 172.21.15.121:0/148796180 shutdown_connections 2024-09-17T03:35:59.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.734+0000 7fa1cea00640 1 -- 172.21.15.121:0/148796180 wait complete. 2024-09-17T03:35:59.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.734+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 --> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7744073d10 con 0x7f7720082350 2024-09-17T03:35:59.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.734+0000 7f0023400640 1 -- 172.21.15.121:0/1704597250 <== osd.3 v2:172.21.15.121:6808/1711221515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f000c002dd0 con 0x7f0010082460 2024-09-17T03:35:59.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.735+0000 7f773a000640 1 -- 172.21.15.121:0/383408808 <== osd.6 v2:172.21.15.176:6810/1810611479 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7744073d10 con 0x7f7720082350 2024-09-17T03:35:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.735+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 >> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] conn(0x7f0010082460 msgr2=0x7f00100848f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.735+0000 7f0036400640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] conn(0x7f0010082460 0x7f00100848f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.735+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0010078c90 msgr2=0x7f001007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.735+0000 7f0036400640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0010078c90 0x7f001007b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0028052b40 tx=0x7f001c0090e0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.735+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0028037ab0 msgr2=0x7f0028035380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.735+0000 7f0036400640 1 --2- 172.21.15.121:0/1704597250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0028037ab0 0x7f0028035380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f003006a2f0 tx=0x7f00300aef50 comp rx=0 tx=0).stop 2024-09-17T03:35:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.735+0000 7f002fe00640 1 -- 172.21.15.121:0/1704597250 reap_dead start 2024-09-17T03:35:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.736+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 --> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc98c002dd0 con 0x7fc994082360 2024-09-17T03:35:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.736+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 shutdown_connections 2024-09-17T03:35:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.736+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 >> 172.21.15.121:0/1704597250 conn(0x7f002801fc10 msgr2=0x7f00280535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.736+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 shutdown_connections 2024-09-17T03:35:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.736+0000 7f0036400640 1 -- 172.21.15.121:0/1704597250 wait complete. 2024-09-17T03:35:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.736+0000 7fc9ab400640 1 -- 172.21.15.121:0/3565826224 <== osd.4 v2:172.21.15.176:6818/3274370689 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc98c002dd0 con 0x7fc994082360 2024-09-17T03:35:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.736+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x7f7720082350 msgr2=0x7f77200847e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.736+0000 7f7749000640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x7f7720082350 0x7f77200847e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.736+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7720078b90 msgr2=0x7f772007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7f7749000640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7720078b90 0x7f772007b0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f774415a8c0 tx=0x7f7734009040 comp rx=0 tx=0).stop 2024-09-17T03:35:59.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] conn(0x7fc994082360 msgr2=0x7fc9940847f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7fc9b8e00640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] conn(0x7fc994082360 0x7fc9940847f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774406ddf0 msgr2=0x7f77441e5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7f7749000640 1 --2- 172.21.15.121:0/383408808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774406ddf0 0x7f77441e5160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f772c009920 tx=0x7f772c033af0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7f7742800640 1 -- 172.21.15.121:0/383408808 reap_dead start 2024-09-17T03:35:59.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc994078b90 msgr2=0x7fc99407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7fc9b8e00640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc994078b90 0x7fc99407b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0035000 tx=0x7fc9a00046c0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b414a870 msgr2=0x7fc9b4161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7fc9b8e00640 1 --2- 172.21.15.121:0/3565826224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b414a870 0x7fc9b4161780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4011ba0 tx=0x7fc9a400f790 comp rx=0 tx=0).stop 2024-09-17T03:35:59.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 shutdown_connections 2024-09-17T03:35:59.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 >> 172.21.15.121:0/383408808 conn(0x7f77440b1b90 msgr2=0x7f774406eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.737+0000 7fc9b3e00640 1 -- 172.21.15.121:0/3565826224 reap_dead start 2024-09-17T03:35:59.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.738+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 shutdown_connections 2024-09-17T03:35:59.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.738+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 >> 172.21.15.121:0/3565826224 conn(0x7fc9b40ceee0 msgr2=0x7fc9b40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.738+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 shutdown_connections 2024-09-17T03:35:59.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.738+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 shutdown_connections 2024-09-17T03:35:59.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.738+0000 7f7749000640 1 -- 172.21.15.121:0/383408808 wait complete. 2024-09-17T03:35:59.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.738+0000 7fc9b8e00640 1 -- 172.21.15.121:0/3565826224 wait complete. 2024-09-17T03:35:59.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.743+0000 7f3876400640 1 -- 172.21.15.121:0/1645325212 --> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f387006ab30 con 0x7f3850082350 2024-09-17T03:35:59.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.745+0000 7f386cc00640 1 -- 172.21.15.121:0/1645325212 <== osd.7 v2:172.21.15.176:6802/2211533111 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f387006ab30 con 0x7f3850082350 2024-09-17T03:35:59.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7facc9400640 1 -- 172.21.15.121:0/885163314 --> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7facc40af7e0 con 0x7faca0082450 2024-09-17T03:35:59.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3862000640 1 -- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] conn(0x7f3850082350 msgr2=0x7f38500847e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3862000640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] conn(0x7f3850082350 0x7f38500847e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3862000640 1 -- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3850078b90 msgr2=0x7f385007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3862000640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3850078b90 0x7f385007b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3870064980 tx=0x7f38640014e0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3862000640 1 -- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3870155d80 msgr2=0x7f387014e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.747+0000 7facbb400640 1 -- 172.21.15.121:0/885163314 <== osd.5 v2:172.21.15.176:6826/3997922862 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7facc40af7e0 con 0x7faca0082450 2024-09-17T03:35:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3862000640 1 --2- 172.21.15.121:0/1645325212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3870155d80 0x7f387014e790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f385c02aaf0 tx=0x7f385c001570 comp rx=0 tx=0).stop 2024-09-17T03:35:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3875a00640 1 -- 172.21.15.121:0/1645325212 reap_dead start 2024-09-17T03:35:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3862000640 1 -- 172.21.15.121:0/1645325212 shutdown_connections 2024-09-17T03:35:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3862000640 1 -- 172.21.15.121:0/1645325212 >> 172.21.15.121:0/1645325212 conn(0x7f38700d1960 msgr2=0x7f38701580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3862000640 1 -- 172.21.15.121:0/1645325212 shutdown_connections 2024-09-17T03:35:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.746+0000 7f3862000640 1 -- 172.21.15.121:0/1645325212 wait complete. 2024-09-17T03:35:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.748+0000 7facb3e00640 1 -- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] conn(0x7faca0082450 msgr2=0x7faca00848e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.748+0000 7facb3e00640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] conn(0x7faca0082450 0x7faca00848e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.749+0000 7facb3e00640 1 -- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faca0078c90 msgr2=0x7faca007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.749+0000 7facb3e00640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faca0078c90 0x7faca007b1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7facac034000 tx=0x7facac02c040 comp rx=0 tx=0).stop 2024-09-17T03:35:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.749+0000 7facb3e00640 1 -- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc41f55a0 msgr2=0x7facc40c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.749+0000 7facb3e00640 1 --2- 172.21.15.121:0/885163314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc41f55a0 0x7facc40c9b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7facb400cce0 tx=0x7facb400a620 comp rx=0 tx=0).stop 2024-09-17T03:35:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.749+0000 7facc3200640 1 -- 172.21.15.121:0/885163314 reap_dead start 2024-09-17T03:35:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.752+0000 7facb3e00640 1 -- 172.21.15.121:0/885163314 shutdown_connections 2024-09-17T03:35:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.752+0000 7facb3e00640 1 -- 172.21.15.121:0/885163314 >> 172.21.15.121:0/885163314 conn(0x7facc40b1b90 msgr2=0x7facc41e28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.753+0000 7facb3e00640 1 -- 172.21.15.121:0/885163314 shutdown_connections 2024-09-17T03:35:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:35:59.753+0000 7facb3e00640 1 -- 172.21.15.121:0/885163314 wait complete. 2024-09-17T03:35:59.757 INFO:teuthology.orchestra.run.smithi121.stdout:64424509450 2024-09-17T03:35:59.757 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T03:35:59.765 INFO:teuthology.orchestra.run.smithi121.stdout:64424509452 2024-09-17T03:35:59.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T03:35:59.774 INFO:teuthology.orchestra.run.smithi121.stdout:64424509450 2024-09-17T03:35:59.775 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T03:35:59.776 INFO:teuthology.orchestra.run.smithi121.stdout:55834574858 2024-09-17T03:35:59.776 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T03:35:59.777 INFO:teuthology.orchestra.run.smithi121.stdout:64424509451 2024-09-17T03:35:59.777 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T03:35:59.779 INFO:teuthology.orchestra.run.smithi121.stdout:64424509451 2024-09-17T03:35:59.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T03:35:59.790 INFO:teuthology.orchestra.run.smithi121.stdout:64424509449 2024-09-17T03:35:59.791 INFO:teuthology.orchestra.run.smithi121.stdout:64424509451 2024-09-17T03:35:59.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T03:35:59.792 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T03:36:00.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.138+0000 7f7b63200640 1 -- 172.21.15.121:0/3309289621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b640ce330 msgr2=0x7f7b640b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.138+0000 7f7b63200640 1 --2- 172.21.15.121:0/3309289621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b640ce330 0x7f7b640b5300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009830 tx=0x7f7b5402a400 comp rx=0 tx=0).stop 2024-09-17T03:36:00.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.138+0000 7f7b63200640 1 -- 172.21.15.121:0/3309289621 shutdown_connections 2024-09-17T03:36:00.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.138+0000 7f7b63200640 1 --2- 172.21.15.121:0/3309289621 >> v2:172.21.15.176:3300/0 conn(0x7f7b640cf6f0 0x7f7b641623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.138+0000 7f7b63200640 1 --2- 172.21.15.121:0/3309289621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b640ce330 0x7f7b640b5300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.138+0000 7f7b63200640 1 -- 172.21.15.121:0/3309289621 >> 172.21.15.121:0/3309289621 conn(0x7f7b640b4010 msgr2=0x7f7b640b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.138+0000 7f7b63200640 1 -- 172.21.15.121:0/3309289621 shutdown_connections 2024-09-17T03:36:00.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.139+0000 7f7b63200640 1 -- 172.21.15.121:0/3309289621 wait complete. 2024-09-17T03:36:00.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.141+0000 7f38c4000640 1 -- 172.21.15.121:0/1876759222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc0cfac0 msgr2=0x7f38bc162450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.141+0000 7f38c4000640 1 --2- 172.21.15.121:0/1876759222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc0cfac0 0x7f38bc162450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f38a8005fd0 tx=0x7f38a802a560 comp rx=0 tx=0).stop 2024-09-17T03:36:00.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.141+0000 7f7b63200640 1 Processor -- start 2024-09-17T03:36:00.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.141+0000 7f38c4000640 1 -- 172.21.15.121:0/1876759222 shutdown_connections 2024-09-17T03:36:00.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.142+0000 7f38c4000640 1 --2- 172.21.15.121:0/1876759222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc0cfac0 0x7f38bc162450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.142+0000 7f38c4000640 1 --2- 172.21.15.121:0/1876759222 >> v2:172.21.15.176:3300/0 conn(0x7f38bc0cf6b0 0x7f38bc15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.142+0000 7f38c4000640 1 -- 172.21.15.121:0/1876759222 >> 172.21.15.121:0/1876759222 conn(0x7f38bc0b1b90 msgr2=0x7f38bc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.142+0000 7f38c4000640 1 -- 172.21.15.121:0/1876759222 shutdown_connections 2024-09-17T03:36:00.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.142+0000 7f7b63200640 1 -- start start 2024-09-17T03:36:00.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.143+0000 7f7b63200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b640ce330 0x7f7b640705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.143+0000 7f7b63200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6415ea90 0x7f7b64160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.143+0000 7f7b63200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b64070af0 0x7f7b64160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.143+0000 7f7b63200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7b640ce880 con 0x7f7b6415ea90 2024-09-17T03:36:00.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.143+0000 7f7b63200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6415f0b0 con 0x7f7b640ce330 2024-09-17T03:36:00.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.143+0000 7f7b63200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7b641628f0 con 0x7f7b64070af0 2024-09-17T03:36:00.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.144+0000 7f7b61e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b640ce330 0x7f7b640705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.145+0000 7f7b62800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b64070af0 0x7f7b64160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.145+0000 7f7b62800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b64070af0 0x7f7b64160850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:60722/0 (socket says 172.21.15.121:60722) 2024-09-17T03:36:00.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.145+0000 7f7b62800640 1 -- 172.21.15.121:0/97857460 learned_addr learned my addr 172.21.15.121:0/97857460 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:00.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.142+0000 7f38c4000640 1 -- 172.21.15.121:0/1876759222 wait complete. 2024-09-17T03:36:00.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.145+0000 7f7b61400640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6415ea90 0x7f7b64160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.146+0000 7f38c4000640 1 Processor -- start 2024-09-17T03:36:00.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.146+0000 7f7b62800640 1 -- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b640ce330 msgr2=0x7f7b640705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.146+0000 7f38c4000640 1 -- start start 2024-09-17T03:36:00.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.146+0000 7f7b62800640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b640ce330 0x7f7b640705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.146+0000 7f7b62800640 1 -- 172.21.15.121:0/97857460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6415ea90 msgr2=0x7f7b64160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.147+0000 7f7b62800640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6415ea90 0x7f7b64160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.147+0000 7f7b62800640 1 -- 172.21.15.121:0/97857460 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6414ad20 con 0x7f7b64070af0 2024-09-17T03:36:00.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.147+0000 7f7b61400640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6415ea90 0x7f7b64160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:00.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.148+0000 7f7b61e00640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b640ce330 0x7f7b640705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:00.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.148+0000 7f7b62800640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b64070af0 0x7f7b64160850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00ea70 tx=0x7f7b5c00ef30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.149+0000 7f7b5a000640 1 -- 172.21.15.121:0/97857460 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00ce40 con 0x7f7b64070af0 2024-09-17T03:36:00.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.149+0000 7f7b5a000640 1 -- 172.21.15.121:0/97857460 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b5c004c10 con 0x7f7b64070af0 2024-09-17T03:36:00.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.149+0000 7f7b5a000640 1 -- 172.21.15.121:0/97857460 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c005020 con 0x7f7b64070af0 2024-09-17T03:36:00.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.149+0000 7f7b63200640 1 -- 172.21.15.121:0/97857460 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b6414b000 con 0x7f7b64070af0 2024-09-17T03:36:00.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.150+0000 7f38c4000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38bc073000 0x7f38bc15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.150+0000 7f38c4000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc0cf6b0 0x7f38bc1f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.150+0000 7f38c4000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc0cfac0 0x7f38bc0b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.150+0000 7f38c4000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc162d20 con 0x7f38bc073000 2024-09-17T03:36:00.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.151+0000 7f7b63200640 1 -- 172.21.15.121:0/97857460 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b6414b5c0 con 0x7f7b64070af0 2024-09-17T03:36:00.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.151+0000 7f38c4000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc162ba0 con 0x7f38bc0cfac0 2024-09-17T03:36:00.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.151+0000 7f38c2000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc0cfac0 0x7f38bc0b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.151+0000 7f38c2000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc0cfac0 0x7f38bc0b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:38282/0 (socket says 172.21.15.121:38282) 2024-09-17T03:36:00.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.151+0000 7f38c2000640 1 -- 172.21.15.121:0/2813528598 learned_addr learned my addr 172.21.15.121:0/2813528598 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:00.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.151+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f38bc06ddf0 con 0x7f38bc0cf6b0 2024-09-17T03:36:00.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.151+0000 7f38c1600640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38bc073000 0x7f38bc15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.151+0000 7f38c0c00640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc0cf6b0 0x7f38bc1f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.154+0000 7f7b5a000640 1 -- 172.21.15.121:0/97857460 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b5c0051c0 con 0x7f7b64070af0 2024-09-17T03:36:00.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.154+0000 7f7b63200640 1 -- 172.21.15.121:0/97857460 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b64162de0 con 0x7f7b64070af0 2024-09-17T03:36:00.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.155+0000 7f38c2000640 1 -- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc0cf6b0 msgr2=0x7f38bc1f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.156+0000 7f38c2000640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc0cf6b0 0x7f38bc1f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.156+0000 7f38c2000640 1 -- 172.21.15.121:0/2813528598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38bc073000 msgr2=0x7f38bc15dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.156+0000 7f38c2000640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38bc073000 0x7f38bc15dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.156+0000 7f38c2000640 1 -- 172.21.15.121:0/2813528598 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38bc09ff40 con 0x7f38bc0cfac0 2024-09-17T03:36:00.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.156+0000 7f38c0c00640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc0cf6b0 0x7f38bc1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:00.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.156+0000 7f38c1600640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38bc073000 0x7f38bc15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:00.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.158+0000 7ff93aa00640 1 -- 172.21.15.121:0/3444067839 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0b3070 con 0x7ff934009f30 2024-09-17T03:36:00.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.158+0000 7f7b5a000640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b44078be0 0x7f7b4407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.158+0000 7f38c2000640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc0cfac0 0x7f38bc0b2ed0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009230 tx=0x7f38a8003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.158+0000 7f7b5a000640 1 -- 172.21.15.121:0/97857460 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7b5c09b8b0 con 0x7f7b64070af0 2024-09-17T03:36:00.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.158+0000 7f38b9600640 1 -- 172.21.15.121:0/2813528598 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a803e030 con 0x7f38bc0cfac0 2024-09-17T03:36:00.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.159+0000 7f7b61e00640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b44078be0 0x7f7b4407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.159+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38bc0a0220 con 0x7f38bc0cfac0 2024-09-17T03:36:00.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.159+0000 7f38b9600640 1 -- 172.21.15.121:0/2813528598 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38a8005610 con 0x7f38bc0cfac0 2024-09-17T03:36:00.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.159+0000 7f38b9600640 1 -- 172.21.15.121:0/2813528598 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a803e030 con 0x7f38bc0cfac0 2024-09-17T03:36:00.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.159+0000 7ff941600640 1 -- 172.21.15.121:0/3444067839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff934009f30 msgr2=0x7ff93401cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.159+0000 7ff941600640 1 --2- 172.21.15.121:0/3444067839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff934009f30 0x7ff93401cfc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff93400abe0 tx=0x7ff93c0a6350 comp rx=0 tx=0).stop 2024-09-17T03:36:00.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.160+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38bc1f5980 con 0x7f38bc0cfac0 2024-09-17T03:36:00.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.160+0000 7ff941600640 1 -- 172.21.15.121:0/3444067839 shutdown_connections 2024-09-17T03:36:00.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.160+0000 7ff941600640 1 --2- 172.21.15.121:0/3444067839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff934009f30 0x7ff93401cfc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.160+0000 7ff941600640 1 -- 172.21.15.121:0/3444067839 >> 172.21.15.121:0/3444067839 conn(0x7ff934051420 msgr2=0x7ff934051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.160+0000 7f7b61e00640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b44078be0 0x7f7b4407b0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b54034000 tx=0x7f7b54004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.161+0000 7ff941600640 1 -- 172.21.15.121:0/3444067839 shutdown_connections 2024-09-17T03:36:00.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.161+0000 7ff941600640 1 -- 172.21.15.121:0/3444067839 wait complete. 2024-09-17T03:36:00.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.161+0000 7f1226a00640 1 -- 172.21.15.121:0/1048459012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f122015e3c0 msgr2=0x7f1220072f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.161+0000 7f1226a00640 1 --2- 172.21.15.121:0/1048459012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f122015e3c0 0x7f1220072f50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12200b2b00 tx=0x7f120c02a560 comp rx=0 tx=0).stop 2024-09-17T03:36:00.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.161+0000 7f1226a00640 1 -- 172.21.15.121:0/1048459012 shutdown_connections 2024-09-17T03:36:00.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.161+0000 7f1226a00640 1 --2- 172.21.15.121:0/1048459012 >> v2:172.21.15.121:3300/0 conn(0x7f1220073490 0x7f122006ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.162+0000 7f1226a00640 1 --2- 172.21.15.121:0/1048459012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f122015e3c0 0x7f1220072f50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.162+0000 7f1226a00640 1 -- 172.21.15.121:0/1048459012 >> 172.21.15.121:0/1048459012 conn(0x7f12200b1b90 msgr2=0x7f12200b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.162+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38bc1f63e0 con 0x7f38bc0cfac0 2024-09-17T03:36:00.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.162+0000 7f7b5a000640 1 -- 172.21.15.121:0/97857460 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b5c063a20 con 0x7f7b64070af0 2024-09-17T03:36:00.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.162+0000 7f1226a00640 1 -- 172.21.15.121:0/1048459012 shutdown_connections 2024-09-17T03:36:00.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.162+0000 7f1226a00640 1 -- 172.21.15.121:0/1048459012 wait complete. 2024-09-17T03:36:00.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.163+0000 7f38b9600640 1 -- 172.21.15.121:0/2813528598 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38a8041030 con 0x7f38bc0cfac0 2024-09-17T03:36:00.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.165+0000 7fccd4400640 1 -- 172.21.15.121:0/4231122173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc06e330 msgr2=0x7fcccc0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.165+0000 7fccd4400640 1 --2- 172.21.15.121:0/4231122173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc06e330 0x7fcccc0cf290 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ca680 tx=0x7fccc002a490 comp rx=0 tx=0).stop 2024-09-17T03:36:00.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.165+0000 7fccd4400640 1 -- 172.21.15.121:0/4231122173 shutdown_connections 2024-09-17T03:36:00.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.165+0000 7fccd4400640 1 --2- 172.21.15.121:0/4231122173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcccc0cf7d0 0x7fcccc072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.165+0000 7fccd4400640 1 --2- 172.21.15.121:0/4231122173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc06e330 0x7fcccc0cf290 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.165+0000 7fccd4400640 1 --2- 172.21.15.121:0/4231122173 >> v2:172.21.15.121:3300/0 conn(0x7fcccc15fc50 0x7fcccc06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.165+0000 7fccd4400640 1 -- 172.21.15.121:0/4231122173 >> 172.21.15.121:0/4231122173 conn(0x7fcccc0b1b90 msgr2=0x7fcccc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.165+0000 7f38b9600640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f389c078d90 0x7f389c07b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.165+0000 7f38b9600640 1 -- 172.21.15.121:0/2813528598 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f38a80baae0 con 0x7f38bc0cfac0 2024-09-17T03:36:00.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.166+0000 7ff941600640 1 Processor -- start 2024-09-17T03:36:00.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.166+0000 7fccd4400640 1 -- 172.21.15.121:0/4231122173 shutdown_connections 2024-09-17T03:36:00.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.166+0000 7f1226a00640 1 Processor -- start 2024-09-17T03:36:00.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.166+0000 7fccd4400640 1 -- 172.21.15.121:0/4231122173 wait complete. 2024-09-17T03:36:00.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.168+0000 7f38c1600640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f389c078d90 0x7f389c07b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.167+0000 7f1226a00640 1 -- start start 2024-09-17T03:36:00.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.166+0000 7ff941600640 1 -- start start 2024-09-17T03:36:00.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.169+0000 7ff941600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff934009f30 0x7ff93404b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.169+0000 7ff941600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9340e7290 0x7ff9340e45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.169+0000 7f38c1600640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f389c078d90 0x7f389c07b2a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38b0004270 tx=0x7f38b0007e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.169+0000 7ff93be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff934009f30 0x7ff93404b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.169+0000 7ff941600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff934052360 0x7ff934052770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.169+0000 7ff93be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff934009f30 0x7ff93404b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:38310/0 (socket says 172.21.15.121:38310) 2024-09-17T03:36:00.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.169+0000 7ff93be00640 1 -- 172.21.15.121:0/1894791096 learned_addr learned my addr 172.21.15.121:0/1894791096 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:00.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.169+0000 7ff941600640 1 -- 172.21.15.121:0/1894791096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9340388f0 con 0x7ff9340e7290 2024-09-17T03:36:00.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.169+0000 7ff941600640 1 -- 172.21.15.121:0/1894791096 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff934038770 con 0x7ff934009f30 2024-09-17T03:36:00.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.170+0000 7ff941600640 1 -- 172.21.15.121:0/1894791096 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff934038a70 con 0x7ff934052360 2024-09-17T03:36:00.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.170+0000 7f1226a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1220071260 0x7f12200c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.170+0000 7ff940c00640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff934052360 0x7ff934052770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.170+0000 7f1226a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1220073490 0x7f12200c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.170+0000 7ff93b400640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9340e7290 0x7ff9340e45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.170+0000 7f121fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1220071260 0x7f12200c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.171+0000 7f121fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1220071260 0x7f12200c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46150/0 (socket says 172.21.15.121:46150) 2024-09-17T03:36:00.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.171+0000 7f121fe00640 1 -- 172.21.15.121:0/2505101854 learned_addr learned my addr 172.21.15.121:0/2505101854 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:00.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.171+0000 7f1226a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f122015e3c0 0x7f12200c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.171+0000 7fccd4400640 1 Processor -- start 2024-09-17T03:36:00.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.171+0000 7f38b9600640 1 -- 172.21.15.121:0/2813528598 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f38bc1f63e0 con 0x7f38bc0cfac0 2024-09-17T03:36:00.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.171+0000 7f121f400640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1220073490 0x7f12200c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.171+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f12200b2830 con 0x7f1220071260 2024-09-17T03:36:00.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.171+0000 7ff940c00640 1 -- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff934009f30 msgr2=0x7ff93404b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.172+0000 7ff940c00640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff934009f30 0x7ff93404b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.172+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f12200b26b0 con 0x7f1220073490 2024-09-17T03:36:00.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.172+0000 7ff940c00640 1 -- 172.21.15.121:0/1894791096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9340e7290 msgr2=0x7ff9340e45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.172+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f122006f190 con 0x7f122015e3c0 2024-09-17T03:36:00.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.172+0000 7ff940c00640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9340e7290 0x7ff9340e45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.172+0000 7ff940c00640 1 -- 172.21.15.121:0/1894791096 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff934052cb0 con 0x7ff934052360 2024-09-17T03:36:00.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.172+0000 7f1224a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f122015e3c0 0x7f12200c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.172+0000 7fccd4400640 1 -- start start 2024-09-17T03:36:00.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.172+0000 7ff93b400640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9340e7290 0x7ff9340e45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:00.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7ff940c00640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff934052360 0x7ff934052770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff93000c3f0 tx=0x7ff93000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7f1224a00640 1 -- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1220073490 msgr2=0x7f12200c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7f1224a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1220073490 0x7f12200c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7f1224a00640 1 -- 172.21.15.121:0/2505101854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1220071260 msgr2=0x7f12200c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7f1224a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1220071260 0x7f12200c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7ff92fe00640 1 -- 172.21.15.121:0/1894791096 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930017070 con 0x7ff934052360 2024-09-17T03:36:00.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7f1224a00640 1 -- 172.21.15.121:0/2505101854 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1220157c70 con 0x7f122015e3c0 2024-09-17T03:36:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7ff92fe00640 1 -- 172.21.15.121:0/1894791096 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9300053c0 con 0x7ff934052360 2024-09-17T03:36:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7ff92fe00640 1 -- 172.21.15.121:0/1894791096 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930003850 con 0x7ff934052360 2024-09-17T03:36:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7f121fe00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1220071260 0x7f12200c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.173+0000 7ff941600640 1 -- 172.21.15.121:0/1894791096 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93404c090 con 0x7ff934052360 2024-09-17T03:36:00.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.174+0000 7ff941600640 1 -- 172.21.15.121:0/1894791096 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff93417f850 con 0x7ff934052360 2024-09-17T03:36:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.174+0000 7f1224a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f122015e3c0 0x7f12200c40d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f121800bdf0 tx=0x7f121800bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.175+0000 7fccd4400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc06e330 0x7fcccc15d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.175+0000 7fccd4400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcccc0cf7d0 0x7fcccc15e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7fccd4400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcccc15fc50 0x7fcccc0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7f1217e00640 1 -- 172.21.15.121:0/2505101854 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218019070 con 0x7f122015e3c0 2024-09-17T03:36:00.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7f1217e00640 1 -- 172.21.15.121:0/2505101854 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1218014440 con 0x7f122015e3c0 2024-09-17T03:36:00.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7f1217e00640 1 -- 172.21.15.121:0/2505101854 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218014890 con 0x7f122015e3c0 2024-09-17T03:36:00.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7fccd4400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc070d20 con 0x7fcccc15fc50 2024-09-17T03:36:00.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7fccd4400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc070ba0 con 0x7fcccc06e330 2024-09-17T03:36:00.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7fccd1000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcccc0cf7d0 0x7fcccc15e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7fccd4400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcccc0732d0 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7fccd1000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcccc0cf7d0 0x7fcccc15e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:60782/0 (socket says 172.21.15.121:60782) 2024-09-17T03:36:00.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7fccd1000640 1 -- 172.21.15.121:0/3096959796 learned_addr learned my addr 172.21.15.121:0/3096959796 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:00.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1220157ee0 con 0x7f122015e3c0 2024-09-17T03:36:00.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12201566b0 con 0x7f122015e3c0 2024-09-17T03:36:00.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.176+0000 7fccd1a00640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc06e330 0x7fcccc15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.177+0000 7fccd1000640 1 -- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc06e330 msgr2=0x7fcccc15d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.177+0000 7ff92d600640 1 -- 172.21.15.121:0/1894791096 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93404be00 con 0x7ff934052360 2024-09-17T03:36:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.177+0000 7fccd1000640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc06e330 0x7fcccc15d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.177+0000 7fccd1000640 1 -- 172.21.15.121:0/3096959796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcccc15fc50 msgr2=0x7fcccc0afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.177+0000 7fccd1000640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcccc15fc50 0x7fcccc0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.177+0000 7fccd1000640 1 -- 172.21.15.121:0/3096959796 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc0ced80 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.177+0000 7fccd1a00640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc06e330 0x7fcccc15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.177+0000 7fccd1000640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcccc0cf7d0 0x7fcccc15e780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009780 tx=0x7fccc0033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.178+0000 7fccc9600640 1 -- 172.21.15.121:0/3096959796 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0031d60 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.178+0000 7fccc9600640 1 -- 172.21.15.121:0/3096959796 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccc0033e50 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.178+0000 7fccc9600640 1 -- 172.21.15.121:0/3096959796 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0005280 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.178+0000 7fccd4400640 1 -- 172.21.15.121:0/3096959796 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc09ec00 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.178+0000 7fccd4400640 1 -- 172.21.15.121:0/3096959796 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc09f1c0 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.178+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12200c69b0 con 0x7f122015e3c0 2024-09-17T03:36:00.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.179+0000 7ff92fe00640 1 -- 172.21.15.121:0/1894791096 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff93001a070 con 0x7ff934052360 2024-09-17T03:36:00.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.180+0000 7ff92fe00640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff91c078b90 0x7ff91c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.181+0000 7ff92fe00640 1 -- 172.21.15.121:0/1894791096 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff93009a320 con 0x7ff934052360 2024-09-17T03:36:00.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.181+0000 7ff93be00640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff91c078b90 0x7ff91c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.180+0000 7fccbea00640 1 -- 172.21.15.121:0/3096959796 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca0005290 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.182+0000 7ff93be00640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff91c078b90 0x7ff91c07b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff93c06a2f0 tx=0x7ff93c0a8070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.183+0000 7fccc9600640 1 -- 172.21.15.121:0/3096959796 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fccc0005420 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.183+0000 7f1217e00640 1 -- 172.21.15.121:0/2505101854 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f121801c070 con 0x7f122015e3c0 2024-09-17T03:36:00.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.184+0000 7f1217e00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1200078c90 0x7f120007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.184+0000 7f1217e00640 1 -- 172.21.15.121:0/2505101854 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f121809b210 con 0x7f122015e3c0 2024-09-17T03:36:00.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.184+0000 7fccc9600640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccac07d070 0x7fccac07f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.185+0000 7f121fe00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1200078c90 0x7f120007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.185+0000 7fccc9600640 1 -- 172.21.15.121:0/3096959796 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fccc00bc450 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.185+0000 7fccd1a00640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccac07d070 0x7fccac07f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.186+0000 7f121fe00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1200078c90 0x7f120007b1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f12100046b0 tx=0x7f1210004620 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.185+0000 7ff92fe00640 1 -- 172.21.15.121:0/1894791096 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff934052cb0 con 0x7ff934052360 2024-09-17T03:36:00.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.188+0000 7fccd1a00640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccac07d070 0x7fccac07f580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fccc4005fd0 tx=0x7fccc40095c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.191+0000 7fccc9600640 1 -- 172.21.15.121:0/3096959796 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fccc003f030 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.196+0000 7f1217e00640 1 -- 172.21.15.121:0/2505101854 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1218062ca0 con 0x7f122015e3c0 2024-09-17T03:36:00.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.223+0000 7f01a8600640 1 -- 172.21.15.121:0/1174290103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01a00cf6b0 msgr2=0x7f01a015f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.223+0000 7f01a8600640 1 --2- 172.21.15.121:0/1174290103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01a00cf6b0 0x7f01a015f5b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f01a00cbf20 tx=0x7f019402a620 comp rx=0 tx=0).stop 2024-09-17T03:36:00.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.223+0000 7f01a8600640 1 -- 172.21.15.121:0/1174290103 shutdown_connections 2024-09-17T03:36:00.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.223+0000 7f01a8600640 1 --2- 172.21.15.121:0/1174290103 >> v2:172.21.15.176:3300/0 conn(0x7f01a00cfac0 0x7f01a0162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.223+0000 7f01a8600640 1 --2- 172.21.15.121:0/1174290103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01a00cf6b0 0x7f01a015f5b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.223+0000 7f01a8600640 1 -- 172.21.15.121:0/1174290103 >> 172.21.15.121:0/1174290103 conn(0x7f01a00b1b90 msgr2=0x7f01a00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.224+0000 7f01a8600640 1 -- 172.21.15.121:0/1174290103 shutdown_connections 2024-09-17T03:36:00.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.224+0000 7f01a8600640 1 -- 172.21.15.121:0/1174290103 wait complete. 2024-09-17T03:36:00.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.224+0000 7f4c18a00640 1 -- 172.21.15.121:0/1547121854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c14156a50 msgr2=0x7f4c14074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.224+0000 7f4c18a00640 1 --2- 172.21.15.121:0/1547121854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c14156a50 0x7f4c14074620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009830 tx=0x7f4c0402a540 comp rx=0 tx=0).stop 2024-09-17T03:36:00.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.225+0000 7f4c18a00640 1 -- 172.21.15.121:0/1547121854 shutdown_connections 2024-09-17T03:36:00.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.225+0000 7f4c18a00640 1 --2- 172.21.15.121:0/1547121854 >> v2:172.21.15.121:3300/0 conn(0x7f4c14074b60 0x7f4c1406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.225+0000 7f4c18a00640 1 --2- 172.21.15.121:0/1547121854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c14156a50 0x7f4c14074620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.225+0000 7f4c18a00640 1 -- 172.21.15.121:0/1547121854 >> 172.21.15.121:0/1547121854 conn(0x7f4c140b1b90 msgr2=0x7f4c140b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.225+0000 7f4c18a00640 1 -- 172.21.15.121:0/1547121854 shutdown_connections 2024-09-17T03:36:00.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.225+0000 7f4c18a00640 1 -- 172.21.15.121:0/1547121854 wait complete. 2024-09-17T03:36:00.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.227+0000 7f01a8600640 1 Processor -- start 2024-09-17T03:36:00.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.228+0000 7f01a8600640 1 -- start start 2024-09-17T03:36:00.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.231+0000 7f01a8600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a0073000 0x7f01a01fa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.231+0000 7f01a8600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cf6b0 0x7f01a00ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.231+0000 7f01a8600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01a00cfac0 0x7f01a00a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.230+0000 7f4c18a00640 1 Processor -- start 2024-09-17T03:36:00.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.230+0000 7f4c18a00640 1 -- start start 2024-09-17T03:36:00.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.232+0000 7f01a8600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01a0162d20 con 0x7f01a00cfac0 2024-09-17T03:36:00.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f01a8600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01a0162ba0 con 0x7f01a00cf6b0 2024-09-17T03:36:00.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f01a8600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01a015fe20 con 0x7f01a0073000 2024-09-17T03:36:00.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f4c18a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1406e330 0x7f4c140cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f4c18a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c14074b60 0x7f4c141fa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f4c18a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c14156a50 0x7f4c141fa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f4c18a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4c140ce500 con 0x7f4c14156a50 2024-09-17T03:36:00.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f4c18a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c140ce380 con 0x7f4c14074b60 2024-09-17T03:36:00.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f4c18a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4c140ce680 con 0x7f4c1406e330 2024-09-17T03:36:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f01a5c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a0073000 0x7f01a01fa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f01a5200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cf6b0 0x7f01a00ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.234+0000 7f4c11e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1406e330 0x7f4c140cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f01a5200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cf6b0 0x7f01a00ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:38336/0 (socket says 172.21.15.121:38336) 2024-09-17T03:36:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f01a5200640 1 -- 172.21.15.121:0/4078411235 learned_addr learned my addr 172.21.15.121:0/4078411235 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f01a6600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01a00cfac0 0x7f01a00a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.233+0000 7f01a5c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a0073000 0x7f01a01fa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:60796/0 (socket says 172.21.15.121:60796) 2024-09-17T03:36:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.234+0000 7f4c11400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c14074b60 0x7f4c141fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.234+0000 7f4c11e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1406e330 0x7f4c140cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:60810/0 (socket says 172.21.15.121:60810) 2024-09-17T03:36:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.234+0000 7f4c11e00640 1 -- 172.21.15.121:0/1454726695 learned_addr learned my addr 172.21.15.121:0/1454726695 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:00.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.234+0000 7f4c12800640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c14156a50 0x7f4c141fa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.234+0000 7f01a5c00640 1 -- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cf6b0 msgr2=0x7f01a00ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.234+0000 7f01a5c00640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cf6b0 0x7f01a00ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.234+0000 7f01a5c00640 1 -- 172.21.15.121:0/4078411235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01a00cfac0 msgr2=0x7f01a00a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.234+0000 7f01a5c00640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01a00cfac0 0x7f01a00a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.234+0000 7f01a5c00640 1 -- 172.21.15.121:0/4078411235 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a01faa70 con 0x7f01a0073000 2024-09-17T03:36:00.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.235+0000 7f01a5200640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cf6b0 0x7f01a00ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:00.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.235+0000 7f01a5c00640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a0073000 0x7f01a01fa3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f019800c730 tx=0x7f019800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.235+0000 7f4c11e00640 1 -- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c14074b60 msgr2=0x7f4c141fa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.235+0000 7f4c11e00640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c14074b60 0x7f4c141fa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.235+0000 7f4c11e00640 1 -- 172.21.15.121:0/1454726695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c14156a50 msgr2=0x7f4c141fa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.235+0000 7f4c11e00640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c14156a50 0x7f4c141fa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.235+0000 7f4c11e00640 1 -- 172.21.15.121:0/1454726695 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c140ca0c0 con 0x7f4c1406e330 2024-09-17T03:36:00.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.235+0000 7f4c12800640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c14156a50 0x7f4c141fa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:00.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.235+0000 7f019d600640 1 -- 172.21.15.121:0/4078411235 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198004b20 con 0x7f01a0073000 2024-09-17T03:36:00.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.236+0000 7f019d600640 1 -- 172.21.15.121:0/4078411235 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0198004db0 con 0x7f01a0073000 2024-09-17T03:36:00.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.236+0000 7f019d600640 1 -- 172.21.15.121:0/4078411235 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198005290 con 0x7f01a0073000 2024-09-17T03:36:00.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.236+0000 7f01a8600640 1 -- 172.21.15.121:0/4078411235 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a009c9b0 con 0x7f01a0073000 2024-09-17T03:36:00.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.236+0000 7f4c11e00640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1406e330 0x7f4c140cbe00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009950 tx=0x7f4c04033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.236+0000 7f01a8600640 1 -- 172.21.15.121:0/4078411235 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a009c3f0 con 0x7f01a0073000 2024-09-17T03:36:00.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.237+0000 7f4c0a000640 1 -- 172.21.15.121:0/1454726695 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04031d60 con 0x7f4c1406e330 2024-09-17T03:36:00.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.237+0000 7f4c0a000640 1 -- 172.21.15.121:0/1454726695 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c04033e10 con 0x7f4c1406e330 2024-09-17T03:36:00.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.237+0000 7f4c0a000640 1 -- 172.21.15.121:0/1454726695 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04005280 con 0x7f4c1406e330 2024-09-17T03:36:00.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.238+0000 7f4c18a00640 1 -- 172.21.15.121:0/1454726695 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c140c9020 con 0x7f4c1406e330 2024-09-17T03:36:00.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.238+0000 7f4c18a00640 1 -- 172.21.15.121:0/1454726695 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c140c95e0 con 0x7f4c1406e330 2024-09-17T03:36:00.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.240+0000 7f4c18a00640 1 -- 172.21.15.121:0/1454726695 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c1406ddf0 con 0x7f4c1406e330 2024-09-17T03:36:00.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.238+0000 7f01a8600640 1 -- 172.21.15.121:0/4078411235 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f017c005290 con 0x7f01a0073000 2024-09-17T03:36:00.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.241+0000 7f019d600640 1 -- 172.21.15.121:0/4078411235 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0198005430 con 0x7f01a0073000 2024-09-17T03:36:00.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.242+0000 7f1b93200640 1 -- 172.21.15.121:0/546229495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b78004850 msgr2=0x7f1b78004d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.242+0000 7f1b93200640 1 --2- 172.21.15.121:0/546229495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b78004850 0x7f1b78004d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000aa40 tx=0x7f1b78005830 comp rx=0 tx=0).stop 2024-09-17T03:36:00.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.242+0000 7f1b93200640 1 -- 172.21.15.121:0/546229495 shutdown_connections 2024-09-17T03:36:00.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.242+0000 7f1b93200640 1 --2- 172.21.15.121:0/546229495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b78004850 0x7f1b78004d20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.242+0000 7f1b93200640 1 -- 172.21.15.121:0/546229495 >> 172.21.15.121:0/546229495 conn(0x7f1b940d41e0 msgr2=0x7f1b940d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.243+0000 7f1b93200640 1 -- 172.21.15.121:0/546229495 shutdown_connections 2024-09-17T03:36:00.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.243+0000 7f1b93200640 1 -- 172.21.15.121:0/546229495 wait complete. 2024-09-17T03:36:00.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.243+0000 7f019d600640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0180078c60 0x7f018007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.243+0000 7f019d600640 1 -- 172.21.15.121:0/4078411235 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f019809b3a0 con 0x7f01a0073000 2024-09-17T03:36:00.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.243+0000 7f4c0a000640 1 -- 172.21.15.121:0/1454726695 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c04005420 con 0x7f4c1406e330 2024-09-17T03:36:00.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.244+0000 7f01a5200640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0180078c60 0x7f018007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.244+0000 7f4c0a000640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bf4078bc0 0x7f4bf407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.245+0000 7f4c0a000640 1 -- 172.21.15.121:0/1454726695 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4c040bc290 con 0x7f4c1406e330 2024-09-17T03:36:00.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.245+0000 7f01a5200640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0180078c60 0x7f018007b170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0194034040 tx=0x7f019400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.246+0000 7f4c11400640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bf4078bc0 0x7f4bf407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.246+0000 7f4c0a000640 1 -- 172.21.15.121:0/1454726695 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c0403f030 con 0x7f4c1406e330 2024-09-17T03:36:00.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.246+0000 7f1b93200640 1 Processor -- start 2024-09-17T03:36:00.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.247+0000 7f1b93200640 1 -- start start 2024-09-17T03:36:00.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b93200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b78004850 0x7f1b9414ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b93200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b9415b750 0x7f1b940b8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b93200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b940b8da0 0x7f1b940c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b93200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9415eaf0 con 0x7f1b78004850 2024-09-17T03:36:00.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b93200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9415e970 con 0x7f1b9415b750 2024-09-17T03:36:00.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b93200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1b940cfd60 con 0x7f1b940b8da0 2024-09-17T03:36:00.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b91e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b78004850 0x7f1b9414ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b91400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b9415b750 0x7f1b940b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b91e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b78004850 0x7f1b9414ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46226/0 (socket says 172.21.15.121:46226) 2024-09-17T03:36:00.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b91400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b9415b750 0x7f1b940b8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:38360/0 (socket says 172.21.15.121:38360) 2024-09-17T03:36:00.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b91e00640 1 -- 172.21.15.121:0/108865927 learned_addr learned my addr 172.21.15.121:0/108865927 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:00.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f1b92800640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b940b8da0 0x7f1b940c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.250+0000 7f1b91e00640 1 -- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b940b8da0 msgr2=0x7f1b940c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.250+0000 7f1b91e00640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b940b8da0 0x7f1b940c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.250+0000 7f1b91e00640 1 -- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b9415b750 msgr2=0x7f1b940b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.250+0000 7f1b91e00640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b9415b750 0x7f1b940b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.250+0000 7f1b91e00640 1 -- 172.21.15.121:0/108865927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b940b91b0 con 0x7f1b78004850 2024-09-17T03:36:00.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.249+0000 7f4c11400640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bf4078bc0 0x7f4bf407b0d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c140cdd90 tx=0x7f4c0c009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.251+0000 7f1b91e00640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b78004850 0x7f1b9414ad60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c4f0 tx=0x7f1b8400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.251+0000 7f019d600640 1 -- 172.21.15.121:0/4078411235 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0198063510 con 0x7f01a0073000 2024-09-17T03:36:00.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.252+0000 7f1b8a000640 1 -- 172.21.15.121:0/108865927 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84017070 con 0x7f1b78004850 2024-09-17T03:36:00.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.252+0000 7f1b8a000640 1 -- 172.21.15.121:0/108865927 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b840035f0 con 0x7f1b78004850 2024-09-17T03:36:00.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.252+0000 7f1b93200640 1 -- 172.21.15.121:0/108865927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b940ce5d0 con 0x7f1b78004850 2024-09-17T03:36:00.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.252+0000 7f1b93200640 1 -- 172.21.15.121:0/108865927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b941487c0 con 0x7f1b78004850 2024-09-17T03:36:00.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.252+0000 7f1b8a000640 1 -- 172.21.15.121:0/108865927 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84003a40 con 0x7f1b78004850 2024-09-17T03:36:00.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.255+0000 7f1b93200640 1 -- 172.21.15.121:0/108865927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6c005290 con 0x7f1b78004850 2024-09-17T03:36:00.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.262+0000 7f1b8a000640 1 -- 172.21.15.121:0/108865927 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b8401a070 con 0x7f1b78004850 2024-09-17T03:36:00.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.267+0000 7f1b8a000640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b74078c90 0x7f1b7407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:00.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.268+0000 7f1b8a000640 1 -- 172.21.15.121:0/108865927 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1b8409a1f0 con 0x7f1b78004850 2024-09-17T03:36:00.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.270+0000 7f1b91400640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b74078c90 0x7f1b7407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:00.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.270+0000 7f1b8a000640 1 -- 172.21.15.121:0/108865927 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b940b91b0 con 0x7f1b78004850 2024-09-17T03:36:00.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.273+0000 7f1b91400640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b74078c90 0x7f1b7407b1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b80033000 tx=0x7f1b800046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:00.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.596+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f38bc1f5490 con 0x7f38bc0cfac0 2024-09-17T03:36:00.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.597+0000 7f38b9600640 1 -- 172.21.15.121:0/2813528598 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38a8082580 con 0x7f38bc0cfac0 2024-09-17T03:36:00.691 INFO:teuthology.orchestra.run.smithi121.stdout:64424509451 2024-09-17T03:36:00.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.600+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f389c078d90 msgr2=0x7f389c07b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.600+0000 7f38c4000640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f389c078d90 0x7f389c07b2a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38b0004270 tx=0x7f38b0007e30 comp rx=0 tx=0).stop 2024-09-17T03:36:00.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.601+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc0cfac0 msgr2=0x7f38bc0b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.601+0000 7f38c4000640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc0cfac0 0x7f38bc0b2ed0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009230 tx=0x7f38a8003b90 comp rx=0 tx=0).stop 2024-09-17T03:36:00.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.601+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 shutdown_connections 2024-09-17T03:36:00.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.601+0000 7f38c4000640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38bc0cfac0 0x7f38bc0b2ed0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.601+0000 7f38c4000640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38bc0cf6b0 0x7f38bc1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.601+0000 7f38c4000640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f389c078d90 0x7f389c07b2a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.601+0000 7f38c4000640 1 --2- 172.21.15.121:0/2813528598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38bc073000 0x7f38bc15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.601+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 >> 172.21.15.121:0/2813528598 conn(0x7f38bc0b1b90 msgr2=0x7f38bc160fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.602+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 shutdown_connections 2024-09-17T03:36:00.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.602+0000 7f38c4000640 1 -- 172.21.15.121:0/2813528598 wait complete. 2024-09-17T03:36:00.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.605+0000 7ff92d600640 1 -- 172.21.15.121:0/1894791096 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff934038ef0 con 0x7ff934052360 2024-09-17T03:36:00.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.608+0000 7ff92fe00640 1 -- 172.21.15.121:0/1894791096 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff930061dd0 con 0x7ff934052360 2024-09-17T03:36:00.694 INFO:teuthology.orchestra.run.smithi121.stdout:64424509450 2024-09-17T03:36:00.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.611+0000 7ff92d600640 1 -- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff91c078b90 msgr2=0x7ff91c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.612+0000 7ff92d600640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff91c078b90 0x7ff91c07b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff93c06a2f0 tx=0x7ff93c0a8070 comp rx=0 tx=0).stop 2024-09-17T03:36:00.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.612+0000 7ff92d600640 1 -- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff934052360 msgr2=0x7ff934052770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.612+0000 7ff92d600640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff934052360 0x7ff934052770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff93000c3f0 tx=0x7ff93000c8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.612+0000 7ff92d600640 1 -- 172.21.15.121:0/1894791096 shutdown_connections 2024-09-17T03:36:00.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.612+0000 7ff92d600640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff934052360 0x7ff934052770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.612+0000 7ff92d600640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff91c078b90 0x7ff91c07b0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.612+0000 7ff92d600640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9340e7290 0x7ff9340e45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.612+0000 7ff92d600640 1 --2- 172.21.15.121:0/1894791096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff934009f30 0x7ff93404b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.612+0000 7ff92d600640 1 -- 172.21.15.121:0/1894791096 >> 172.21.15.121:0/1894791096 conn(0x7ff934051420 msgr2=0x7ff9340e4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.613+0000 7ff92d600640 1 -- 172.21.15.121:0/1894791096 shutdown_connections 2024-09-17T03:36:00.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.613+0000 7f7b63200640 1 -- 172.21.15.121:0/97857460 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7b640d12d0 con 0x7f7b64070af0 2024-09-17T03:36:00.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.613+0000 7ff92d600640 1 -- 172.21.15.121:0/1894791096 wait complete. 2024-09-17T03:36:00.697 INFO:teuthology.orchestra.run.smithi121.stdout:64424509449 2024-09-17T03:36:00.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.614+0000 7f7b5a000640 1 -- 172.21.15.121:0/97857460 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b5c063320 con 0x7f7b64070af0 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.618+0000 7f7b4f400640 1 -- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b44078be0 msgr2=0x7f7b4407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.618+0000 7f7b4f400640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b44078be0 0x7f7b4407b0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b54034000 tx=0x7f7b54004730 comp rx=0 tx=0).stop 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.618+0000 7f7b4f400640 1 -- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b64070af0 msgr2=0x7f7b64160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.618+0000 7f7b4f400640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b64070af0 0x7f7b64160850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00ea70 tx=0x7f7b5c00ef30 comp rx=0 tx=0).stop 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.619+0000 7f7b4f400640 1 -- 172.21.15.121:0/97857460 shutdown_connections 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.619+0000 7f7b4f400640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b64070af0 0x7f7b64160850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.619+0000 7f7b4f400640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b44078be0 0x7f7b4407b0f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.619+0000 7f7b4f400640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b6415ea90 0x7f7b64160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.619+0000 7f7b4f400640 1 --2- 172.21.15.121:0/97857460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b640ce330 0x7f7b640705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.619+0000 7f7b4f400640 1 -- 172.21.15.121:0/97857460 >> 172.21.15.121:0/97857460 conn(0x7f7b640b4010 msgr2=0x7f7b640b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.619+0000 7f7b4f400640 1 -- 172.21.15.121:0/97857460 shutdown_connections 2024-09-17T03:36:00.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.619+0000 7f7b4f400640 1 -- 172.21.15.121:0/97857460 wait complete. 2024-09-17T03:36:00.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.620+0000 7fccbea00640 1 -- 172.21.15.121:0/3096959796 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fcca0005850 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.700 INFO:teuthology.orchestra.run.smithi121.stdout:55834574857 2024-09-17T03:36:00.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.621+0000 7fccc9600640 1 -- 172.21.15.121:0/3096959796 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fccc00845c0 con 0x7fcccc0cf7d0 2024-09-17T03:36:00.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 -- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccac07d070 msgr2=0x7fccac07f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccac07d070 0x7fccac07f580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fccc4005fd0 tx=0x7fccc40095c0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 -- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcccc0cf7d0 msgr2=0x7fcccc15e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcccc0cf7d0 0x7fcccc15e780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009780 tx=0x7fccc0033ba0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 -- 172.21.15.121:0/3096959796 shutdown_connections 2024-09-17T03:36:00.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccac07d070 0x7fccac07f580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcccc15fc50 0x7fcccc0afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcccc0cf7d0 0x7fcccc15e780 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 --2- 172.21.15.121:0/3096959796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcccc06e330 0x7fcccc15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 -- 172.21.15.121:0/3096959796 >> 172.21.15.121:0/3096959796 conn(0x7fcccc0b1b90 msgr2=0x7fcccc06d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 -- 172.21.15.121:0/3096959796 shutdown_connections 2024-09-17T03:36:00.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.626+0000 7fccbea00640 1 -- 172.21.15.121:0/3096959796 wait complete. 2024-09-17T03:36:00.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.640+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f122006ec50 con 0x7f122015e3c0 2024-09-17T03:36:00.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.641+0000 7f1217e00640 1 -- 172.21.15.121:0/2505101854 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f12180676d0 con 0x7f122015e3c0 2024-09-17T03:36:00.703 INFO:teuthology.orchestra.run.smithi121.stdout:64424509449 2024-09-17T03:36:00.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.0 2024-09-17T03:36:00.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.645+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1200078c90 msgr2=0x7f120007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.645+0000 7f1226a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1200078c90 0x7f120007b1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f12100046b0 tx=0x7f1210004620 comp rx=0 tx=0).stop 2024-09-17T03:36:00.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.645+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f122015e3c0 msgr2=0x7f12200c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.645+0000 7f1226a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f122015e3c0 0x7f12200c40d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f121800bdf0 tx=0x7f121800bee0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.645+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 shutdown_connections 2024-09-17T03:36:00.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.645+0000 7f1226a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f122015e3c0 0x7f12200c40d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.645+0000 7f1226a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1220073490 0x7f12200c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.645+0000 7f1226a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1200078c90 0x7f120007b1a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.645+0000 7f1226a00640 1 --2- 172.21.15.121:0/2505101854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1220071260 0x7f12200c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.645+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 >> 172.21.15.121:0/2505101854 conn(0x7f12200b1b90 msgr2=0x7f12200cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.646+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 shutdown_connections 2024-09-17T03:36:00.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.646+0000 7f1226a00640 1 -- 172.21.15.121:0/2505101854 wait complete. 2024-09-17T03:36:00.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.6 2024-09-17T03:36:00.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-09-17T03:36:00.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-09-17T03:36:00.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.666+0000 7f4c18a00640 1 -- 172.21.15.121:0/1454726695 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4c140a0ee0 con 0x7f4c1406e330 2024-09-17T03:36:00.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.668+0000 7f4c0a000640 1 -- 172.21.15.121:0/1454726695 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c04083db0 con 0x7f4c1406e330 2024-09-17T03:36:00.708 INFO:teuthology.orchestra.run.smithi121.stdout:64424509450 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.670+0000 7f4c18a00640 1 -- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bf4078bc0 msgr2=0x7f4bf407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.670+0000 7f4c18a00640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bf4078bc0 0x7f4bf407b0d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c140cdd90 tx=0x7f4c0c009500 comp rx=0 tx=0).stop 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.670+0000 7f4c18a00640 1 -- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1406e330 msgr2=0x7f4c140cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.670+0000 7f4c18a00640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1406e330 0x7f4c140cbe00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009950 tx=0x7f4c04033c20 comp rx=0 tx=0).stop 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.670+0000 7f4c18a00640 1 -- 172.21.15.121:0/1454726695 shutdown_connections 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.670+0000 7f4c18a00640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bf4078bc0 0x7f4bf407b0d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.670+0000 7f4c18a00640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c14156a50 0x7f4c141fa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.670+0000 7f4c18a00640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c14074b60 0x7f4c141fa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.670+0000 7f4c18a00640 1 --2- 172.21.15.121:0/1454726695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c1406e330 0x7f4c140cbe00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.670+0000 7f4c18a00640 1 -- 172.21.15.121:0/1454726695 >> 172.21.15.121:0/1454726695 conn(0x7f4c140b1b90 msgr2=0x7f4c1406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.671+0000 7f4c18a00640 1 -- 172.21.15.121:0/1454726695 shutdown_connections 2024-09-17T03:36:00.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.671+0000 7f4c18a00640 1 -- 172.21.15.121:0/1454726695 wait complete. 2024-09-17T03:36:00.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.671+0000 7f01a8600640 1 -- 172.21.15.121:0/4078411235 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f017c005580 con 0x7f01a0073000 2024-09-17T03:36:00.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.672+0000 7f019d600640 1 -- 172.21.15.121:0/4078411235 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0198062e10 con 0x7f01a0073000 2024-09-17T03:36:00.711 INFO:teuthology.orchestra.run.smithi121.stdout:64424509448 2024-09-17T03:36:00.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.2 2024-09-17T03:36:00.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f1b93200640 1 -- 172.21.15.121:0/108865927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1b6c005580 con 0x7f1b78004850 2024-09-17T03:36:00.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f1b8a000640 1 -- 172.21.15.121:0/108865927 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b84061c80 con 0x7f1b78004850 2024-09-17T03:36:00.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 -- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0180078c60 msgr2=0x7f018007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0180078c60 0x7f018007b170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0194034040 tx=0x7f019400b040 comp rx=0 tx=0).stop 2024-09-17T03:36:00.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 -- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a0073000 msgr2=0x7f01a01fa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a0073000 0x7f01a01fa3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f019800c730 tx=0x7f019800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.714 INFO:teuthology.orchestra.run.smithi121.stdout:64424509450 2024-09-17T03:36:00.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 -- 172.21.15.121:0/4078411235 shutdown_connections 2024-09-17T03:36:00.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0180078c60 0x7f018007b170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01a00cfac0 0x7f01a00a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01a00cf6b0 0x7f01a00ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 --2- 172.21.15.121:0/4078411235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01a0073000 0x7f01a01fa3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 -- 172.21.15.121:0/4078411235 >> 172.21.15.121:0/4078411235 conn(0x7f01a00b1b90 msgr2=0x7f01a00711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.675+0000 7f01a8600640 1 -- 172.21.15.121:0/4078411235 shutdown_connections 2024-09-17T03:36:00.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.676+0000 7f01a8600640 1 -- 172.21.15.121:0/4078411235 wait complete. 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 -- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b74078c90 msgr2=0x7f1b7407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b74078c90 0x7f1b7407b1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b80033000 tx=0x7f1b800046c0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 -- 172.21.15.121:0/108865927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b78004850 msgr2=0x7f1b9414ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b78004850 0x7f1b9414ad60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c4f0 tx=0x7f1b8400c9b0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 -- 172.21.15.121:0/108865927 shutdown_connections 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b940b8da0 0x7f1b940c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b9415b750 0x7f1b940b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b74078c90 0x7f1b7407b1a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 --2- 172.21.15.121:0/108865927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b78004850 0x7f1b9414ad60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 -- 172.21.15.121:0/108865927 >> 172.21.15.121:0/108865927 conn(0x7f1b940d41e0 msgr2=0x7f1b941614f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 -- 172.21.15.121:0/108865927 shutdown_connections 2024-09-17T03:36:00.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:00.678+0000 7f1b93200640 1 -- 172.21.15.121:0/108865927 wait complete. 2024-09-17T03:36:00.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.7 2024-09-17T03:36:00.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-09-17T03:36:00.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.5 2024-09-17T03:36:01.704 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T03:36:01.706 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T03:36:01.708 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T03:36:01.708 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T03:36:01.713 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T03:36:01.718 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T03:36:01.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T03:36:01.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T03:36:02.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.065+0000 7fd144e00640 1 -- 172.21.15.121:0/370587964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd124003b10 msgr2=0x7fd124003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.065+0000 7fd144e00640 1 --2- 172.21.15.121:0/370587964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd124003b10 0x7fd124003fa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd128009880 tx=0x7fd124005830 comp rx=0 tx=0).stop 2024-09-17T03:36:02.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.068+0000 7fd144e00640 1 -- 172.21.15.121:0/370587964 shutdown_connections 2024-09-17T03:36:02.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.068+0000 7fd144e00640 1 --2- 172.21.15.121:0/370587964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd124003b10 0x7fd124003fa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.068+0000 7fd144e00640 1 -- 172.21.15.121:0/370587964 >> 172.21.15.121:0/370587964 conn(0x7fd1400b3f70 msgr2=0x7fd1400b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.068+0000 7fd144e00640 1 -- 172.21.15.121:0/370587964 shutdown_connections 2024-09-17T03:36:02.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.068+0000 7fd144e00640 1 -- 172.21.15.121:0/370587964 wait complete. 2024-09-17T03:36:02.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.070+0000 7f6a7ee00640 1 -- 172.21.15.121:0/1577159314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7815ab80 msgr2=0x7f6a7815af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.071+0000 7f6a7ee00640 1 --2- 172.21.15.121:0/1577159314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7815ab80 0x7f6a7815af90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a78155210 tx=0x7f6a7000aec0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.071+0000 7f6a7ee00640 1 -- 172.21.15.121:0/1577159314 shutdown_connections 2024-09-17T03:36:02.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.071+0000 7f6a7ee00640 1 --2- 172.21.15.121:0/1577159314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a7815ab80 0x7f6a7815af90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.071+0000 7f6a7ee00640 1 --2- 172.21.15.121:0/1577159314 >> v2:172.21.15.176:3300/0 conn(0x7f6a78151080 0x7f6a78151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.071+0000 7f6a7ee00640 1 --2- 172.21.15.121:0/1577159314 >> v2:172.21.15.121:3300/0 conn(0x7f6a7815e1c0 0x7f6a7815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.071+0000 7f6a7ee00640 1 -- 172.21.15.121:0/1577159314 >> 172.21.15.121:0/1577159314 conn(0x7f6a780d05c0 msgr2=0x7f6a7806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.071+0000 7f3159600640 1 -- 172.21.15.121:0/2620961176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f315415e840 msgr2=0x7f31540cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.071+0000 7f3159600640 1 --2- 172.21.15.121:0/2620961176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f315415e840 0x7f31540cf170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3154072990 tx=0x7f314c02a820 comp rx=0 tx=0).stop 2024-09-17T03:36:02.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.072+0000 7f6a7ee00640 1 -- 172.21.15.121:0/1577159314 shutdown_connections 2024-09-17T03:36:02.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.072+0000 7f6a7ee00640 1 -- 172.21.15.121:0/1577159314 wait complete. 2024-09-17T03:36:02.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.072+0000 7f3159600640 1 -- 172.21.15.121:0/2620961176 shutdown_connections 2024-09-17T03:36:02.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.072+0000 7f3159600640 1 --2- 172.21.15.121:0/2620961176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f315415e840 0x7f31540cf170 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.072+0000 7f3159600640 1 --2- 172.21.15.121:0/2620961176 >> v2:172.21.15.176:3300/0 conn(0x7f31541519d0 0x7f315415e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.072+0000 7f3159600640 1 -- 172.21.15.121:0/2620961176 >> 172.21.15.121:0/2620961176 conn(0x7f31540d0590 msgr2=0x7f315406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.074+0000 7fd144e00640 1 Processor -- start 2024-09-17T03:36:02.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.074+0000 7f3159600640 1 -- 172.21.15.121:0/2620961176 shutdown_connections 2024-09-17T03:36:02.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.074+0000 7fd144e00640 1 -- start start 2024-09-17T03:36:02.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.074+0000 7f3159600640 1 -- 172.21.15.121:0/2620961176 wait complete. 2024-09-17T03:36:02.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.077+0000 7f6a7ee00640 1 Processor -- start 2024-09-17T03:36:02.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.077+0000 7fd144e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd124003b10 0x7fd14006fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.077+0000 7f6a7ee00640 1 -- start start 2024-09-17T03:36:02.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.077+0000 7fd144e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14015f040 0x7fd1400c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.078+0000 7f71d9e00640 1 -- 172.21.15.121:0/2411824923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc005c50 msgr2=0x7f71cc006650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.078+0000 7f71d9e00640 1 --2- 172.21.15.121:0/2411824923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc005c50 0x7f71cc006650 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71d407ad70 tx=0x7f71d40a6390 comp rx=0 tx=0).stop 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.078+0000 7f71d9e00640 1 -- 172.21.15.121:0/2411824923 shutdown_connections 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.078+0000 7f71d9e00640 1 --2- 172.21.15.121:0/2411824923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc005c50 0x7f71cc006650 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.078+0000 7f71d9e00640 1 --2- 172.21.15.121:0/2411824923 >> v2:172.21.15.121:3300/0 conn(0x7f71cc036b30 0x7f71cc0df170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.078+0000 7f71d9e00640 1 -- 172.21.15.121:0/2411824923 >> 172.21.15.121:0/2411824923 conn(0x7f71cc051410 msgr2=0x7f71cc051850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.078+0000 7fd13de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd124003b10 0x7fd14006fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.078+0000 7fd13de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd124003b10 0x7fd14006fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:52008/0 (socket says 172.21.15.121:52008) 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7fd144e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1400c9e80 0x7fd1400c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7fd144e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd1400cf300 con 0x7fd14015f040 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7fd144e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd1400cf180 con 0x7fd124003b10 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7fd144e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd1400cf480 con 0x7fd1400c9e80 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7fd13de00640 1 -- 172.21.15.121:0/2446785912 learned_addr learned my addr 172.21.15.121:0/2446785912 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7f71d9e00640 1 -- 172.21.15.121:0/2411824923 shutdown_connections 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7f3159600640 1 Processor -- start 2024-09-17T03:36:02.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7f71d9e00640 1 -- 172.21.15.121:0/2411824923 wait complete. 2024-09-17T03:36:02.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7f3159600640 1 -- start start 2024-09-17T03:36:02.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7fd13e800640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1400c9e80 0x7fd1400c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.079+0000 7fd13d400640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14015f040 0x7fd1400c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.080+0000 7fd13e800640 1 -- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd124003b10 msgr2=0x7fd14006fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.080+0000 7fd13e800640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd124003b10 0x7fd14006fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.080+0000 7fd13e800640 1 -- 172.21.15.121:0/2446785912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14015f040 msgr2=0x7fd1400c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.080+0000 7f6a7ee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78151080 0x7f6a780cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.080+0000 7f6a7ee00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a7815ab80 0x7f6a7814dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.080+0000 7fd13e800640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14015f040 0x7fd1400c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.081+0000 7f6a7ee00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a7815e1c0 0x7f6a780c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.081+0000 7f6a7ee00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7815b4d0 con 0x7f6a7815ab80 2024-09-17T03:36:02.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.081+0000 7f6a7da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78151080 0x7f6a780cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.081+0000 7f6a7da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78151080 0x7f6a780cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:56988/0 (socket says 172.21.15.121:56988) 2024-09-17T03:36:02.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.081+0000 7f6a7da00640 1 -- 172.21.15.121:0/207569196 learned_addr learned my addr 172.21.15.121:0/207569196 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:02.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.080+0000 7fd13e800640 1 -- 172.21.15.121:0/2446785912 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14006f060 con 0x7fd1400c9e80 2024-09-17T03:36:02.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.081+0000 7f6a7ee00640 1 -- 172.21.15.121:0/207569196 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a78070e70 con 0x7f6a7815e1c0 2024-09-17T03:36:02.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.081+0000 7f6a7ee00640 1 -- 172.21.15.121:0/207569196 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7815b650 con 0x7f6a78151080 2024-09-17T03:36:02.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.081+0000 7fd13de00640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd124003b10 0x7fd14006fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:02.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.081+0000 7f6a7e400640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a7815e1c0 0x7f6a780c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.082+0000 7f6a7d000640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a7815ab80 0x7f6a7814dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.082+0000 7fd13d400640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14015f040 0x7fd1400c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:02.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.082+0000 7f3159600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31541515c0 0x7f315414dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.082+0000 7f3159600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31541519d0 0x7f31541367d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.082+0000 7f3159600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f315415e840 0x7f3154153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f3152a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31541515c0 0x7f315414dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f3152a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31541515c0 0x7f315414dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:52024/0 (socket says 172.21.15.121:52024) 2024-09-17T03:36:02.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.082+0000 7fd13e800640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1400c9e80 0x7fd1400c6d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd140073800 tx=0x7fd138001630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f3152a00640 1 -- 172.21.15.121:0/1160703420 learned_addr learned my addr 172.21.15.121:0/1160703420 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:02.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f3152000640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31541519d0 0x7f31541367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7fd136000640 1 -- 172.21.15.121:0/2446785912 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130006de0 con 0x7fd1400c9e80 2024-09-17T03:36:02.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f6a7e400640 1 -- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78151080 msgr2=0x7f6a780cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f6a7e400640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78151080 0x7f6a780cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f6a7e400640 1 -- 172.21.15.121:0/207569196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a7815ab80 msgr2=0x7f6a7814dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f6a7e400640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a7815ab80 0x7f6a7814dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3154070e00 con 0x7f315415e840 2024-09-17T03:36:02.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f6a7e400640 1 -- 172.21.15.121:0/207569196 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a78149a10 con 0x7f6a7815e1c0 2024-09-17T03:36:02.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f6a7d000640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a7815ab80 0x7f6a7814dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:02.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f6a7e400640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a7815e1c0 0x7f6a780c4dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a70030000 tx=0x7f6a70003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.083+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3154070c80 con 0x7f31541515c0 2024-09-17T03:36:02.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7f6a75600640 1 -- 172.21.15.121:0/207569196 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70040020 con 0x7f6a7815e1c0 2024-09-17T03:36:02.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7f6a75600640 1 -- 172.21.15.121:0/207569196 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a7000a780 con 0x7f6a7815e1c0 2024-09-17T03:36:02.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7f6a75600640 1 -- 172.21.15.121:0/207569196 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70004040 con 0x7f6a7815e1c0 2024-09-17T03:36:02.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7f6a7ee00640 1 -- 172.21.15.121:0/207569196 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7814e2e0 con 0x7f6a7815e1c0 2024-09-17T03:36:02.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7fd136000640 1 -- 172.21.15.121:0/2446785912 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd138018070 con 0x7fd1400c9e80 2024-09-17T03:36:02.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7fd136000640 1 -- 172.21.15.121:0/2446785912 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1380118b0 con 0x7fd1400c9e80 2024-09-17T03:36:02.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7f3153400640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f315415e840 0x7f3154153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31540cf6b0 con 0x7f31541519d0 2024-09-17T03:36:02.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7f6a7ee00640 1 -- 172.21.15.121:0/207569196 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a7814d330 con 0x7f6a7815e1c0 2024-09-17T03:36:02.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7f71d9e00640 1 Processor -- start 2024-09-17T03:36:02.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7fd144e00640 1 -- 172.21.15.121:0/2446785912 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14006f340 con 0x7fd1400c9e80 2024-09-17T03:36:02.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.084+0000 7fd144e00640 1 -- 172.21.15.121:0/2446785912 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1400ca410 con 0x7fd1400c9e80 2024-09-17T03:36:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.085+0000 7f71d9e00640 1 -- start start 2024-09-17T03:36:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.085+0000 7f3153400640 1 -- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31541519d0 msgr2=0x7f31541367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.085+0000 7f3153400640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31541519d0 0x7f31541367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.086+0000 7f3153400640 1 -- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31541515c0 msgr2=0x7f315414dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.086+0000 7f3153400640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31541515c0 0x7f315414dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.086+0000 7f3153400640 1 -- 172.21.15.121:0/1160703420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315414e570 con 0x7f315415e840 2024-09-17T03:36:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.087+0000 7f3153400640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f315415e840 0x7f3154153fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f314c009000 tx=0x7f314c032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.087+0000 7fd144e00640 1 -- 172.21.15.121:0/2446785912 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd14006e0f0 con 0x7fd1400c9e80 2024-09-17T03:36:02.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.089+0000 7f6a6aa00640 1 -- 172.21.15.121:0/207569196 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a78149be0 con 0x7f6a7815e1c0 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.087+0000 7f71d9e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71cc005c50 0x7f71cc0ddf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.088+0000 7f71d9e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc009b90 0x7f71cc178a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.088+0000 7f71d9e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc0de530 0x7f71cc178fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.088+0000 7f71d2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71cc005c50 0x7f71cc0ddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.088+0000 7f71d2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71cc005c50 0x7f71cc0ddf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57810/0 (socket says 172.21.15.121:57810) 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.088+0000 7f71d2000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc009b90 0x7f71cc178a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.088+0000 7f71d2000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc009b90 0x7f71cc178a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:52040/0 (socket says 172.21.15.121:52040) 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.088+0000 7f71d3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc0de530 0x7f71cc178fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.089+0000 7f71d3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc0de530 0x7f71cc178fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:57020/0 (socket says 172.21.15.121:57020) 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.089+0000 7f71d9e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc006f20 con 0x7f71cc005c50 2024-09-17T03:36:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.089+0000 7f71d2a00640 1 -- 172.21.15.121:0/3243163229 learned_addr learned my addr 172.21.15.121:0/3243163229 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:02.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.089+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc006da0 con 0x7f71cc009b90 2024-09-17T03:36:02.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.089+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71cc0070a0 con 0x7f71cc0de530 2024-09-17T03:36:02.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.089+0000 7f71d3400640 1 -- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc009b90 msgr2=0x7f71cc178a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f71d3400640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc009b90 0x7f71cc178a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f71d3400640 1 -- 172.21.15.121:0/3243163229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71cc005c50 msgr2=0x7f71cc0ddf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f71d3400640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71cc005c50 0x7f71cc0ddf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f71d3400640 1 -- 172.21.15.121:0/3243163229 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc022210 con 0x7f71cc0de530 2024-09-17T03:36:02.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f314aa00640 1 -- 172.21.15.121:0/1160703420 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c037040 con 0x7f315415e840 2024-09-17T03:36:02.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f71d2a00640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71cc005c50 0x7f71cc0ddf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:02.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f314aa00640 1 -- 172.21.15.121:0/1160703420 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f314c042070 con 0x7f315415e840 2024-09-17T03:36:02.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7fd136000640 1 -- 172.21.15.121:0/2446785912 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd138011a50 con 0x7fd1400c9e80 2024-09-17T03:36:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f6a75600640 1 -- 172.21.15.121:0/207569196 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a70043020 con 0x7f6a7815e1c0 2024-09-17T03:36:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f71d3400640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc0de530 0x7f71cc178fd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71d4076070 tx=0x7f71d40aef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315414e850 con 0x7f315415e840 2024-09-17T03:36:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.090+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315414ee10 con 0x7f315415e840 2024-09-17T03:36:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.091+0000 7f314aa00640 1 -- 172.21.15.121:0/1160703420 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c004280 con 0x7f315415e840 2024-09-17T03:36:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.092+0000 7f6a75600640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6a58078bc0 0x7f6a5807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.092+0000 7f6a75600640 1 -- 172.21.15.121:0/207569196 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6a700bbcb0 con 0x7f6a7815e1c0 2024-09-17T03:36:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.092+0000 7fd136000640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd11c078c60 0x7fd11c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.092+0000 7fd136000640 1 -- 172.21.15.121:0/2446785912 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd13809b630 con 0x7fd1400c9e80 2024-09-17T03:36:02.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.093+0000 7f6a7da00640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6a58078bc0 0x7f6a5807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.093+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f312c005290 con 0x7f315415e840 2024-09-17T03:36:02.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.094+0000 7fd13de00640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd11c078c60 0x7fd11c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.093+0000 7f71cb400640 1 -- 172.21.15.121:0/3243163229 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d40bb070 con 0x7f71cc0de530 2024-09-17T03:36:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.094+0000 7f71cb400640 1 -- 172.21.15.121:0/3243163229 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71d40b7700 con 0x7f71cc0de530 2024-09-17T03:36:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.094+0000 7f71cb400640 1 -- 172.21.15.121:0/3243163229 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d40b3040 con 0x7f71cc0de530 2024-09-17T03:36:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.095+0000 7f6a7da00640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6a58078bc0 0x7f6a5807b0d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00bd90 tx=0x7f6a6c00d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.095+0000 7fd13de00640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd11c078c60 0x7fd11c07b170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd128009880 tx=0x7fd12802c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.095+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc02bf30 con 0x7f71cc0de530 2024-09-17T03:36:02.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.095+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc02c4f0 con 0x7f71cc0de530 2024-09-17T03:36:02.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.096+0000 7f6a75600640 1 -- 172.21.15.121:0/207569196 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6a70083d90 con 0x7f6a7815e1c0 2024-09-17T03:36:02.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.096+0000 7fd136000640 1 -- 172.21.15.121:0/2446785912 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd138063860 con 0x7fd1400c9e80 2024-09-17T03:36:02.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.097+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71cc039220 con 0x7f71cc0de530 2024-09-17T03:36:02.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.100+0000 7f71cb400640 1 -- 172.21.15.121:0/3243163229 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71d40be070 con 0x7f71cc0de530 2024-09-17T03:36:02.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.102+0000 7f71cb400640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71b407d080 0x7f71b407f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.102+0000 7f71cb400640 1 -- 172.21.15.121:0/3243163229 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f71d4136c50 con 0x7f71cc0de530 2024-09-17T03:36:02.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.103+0000 7f71d2a00640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71b407d080 0x7f71b407f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.104+0000 7f71cb400640 1 -- 172.21.15.121:0/3243163229 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f71d40c5030 con 0x7f71cc0de530 2024-09-17T03:36:02.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.104+0000 7f71d2a00640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71b407d080 0x7f71b407f590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f71c4007fd0 tx=0x7f71c4007d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.107+0000 7f314aa00640 1 -- 172.21.15.121:0/1160703420 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f314c0044e0 con 0x7f315415e840 2024-09-17T03:36:02.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.109+0000 7f314aa00640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3134078c60 0x7f313407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.110+0000 7f3152a00640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3134078c60 0x7f313407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.110+0000 7f314aa00640 1 -- 172.21.15.121:0/1160703420 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f314c0bc680 con 0x7f315415e840 2024-09-17T03:36:02.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.111+0000 7f314aa00640 1 -- 172.21.15.121:0/1160703420 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f314c0bcaa0 con 0x7f315415e840 2024-09-17T03:36:02.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.111+0000 7f3152a00640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3134078c60 0x7f313407b170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f31400016c0 tx=0x7f3140009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.147+0000 7fd443e00640 1 -- 172.21.15.121:0/2790393877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd428004800 msgr2=0x7fd428004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.147+0000 7fd443e00640 1 --2- 172.21.15.121:0/2790393877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd428004800 0x7fd428004c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd444074300 tx=0x7fd428005830 comp rx=0 tx=0).stop 2024-09-17T03:36:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.147+0000 7fd443400640 1 -- 172.21.15.121:0/2790393877 reap_dead start 2024-09-17T03:36:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.148+0000 7fd443e00640 1 -- 172.21.15.121:0/2790393877 shutdown_connections 2024-09-17T03:36:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.148+0000 7fd443e00640 1 -- 172.21.15.121:0/2790393877 >> 172.21.15.121:0/2790393877 conn(0x7fd44406cde0 msgr2=0x7fd44406d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.148+0000 7fd443e00640 1 -- 172.21.15.121:0/2790393877 shutdown_connections 2024-09-17T03:36:02.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.148+0000 7fd443e00640 1 -- 172.21.15.121:0/2790393877 wait complete. 2024-09-17T03:36:02.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.151+0000 7f7633e00640 1 -- 172.21.15.121:0/1839398424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762c03c450 msgr2=0x7f762c03c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.151+0000 7f7633e00640 1 --2- 172.21.15.121:0/1839398424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762c03c450 0x7f762c03c860 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f761c009830 tx=0x7f761c02a410 comp rx=0 tx=0).stop 2024-09-17T03:36:02.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.152+0000 7f7633e00640 1 -- 172.21.15.121:0/1839398424 shutdown_connections 2024-09-17T03:36:02.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.152+0000 7fd443e00640 1 Processor -- start 2024-09-17T03:36:02.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.152+0000 7f7633e00640 1 --2- 172.21.15.121:0/1839398424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762c03c450 0x7f762c03c860 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.152+0000 7f7633e00640 1 --2- 172.21.15.121:0/1839398424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762c057130 0x7f762c007280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.152+0000 7f7633e00640 1 -- 172.21.15.121:0/1839398424 >> 172.21.15.121:0/1839398424 conn(0x7f762c03a680 msgr2=0x7f762c03aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.152+0000 7fd443e00640 1 -- start start 2024-09-17T03:36:02.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.153+0000 7f7633e00640 1 -- 172.21.15.121:0/1839398424 shutdown_connections 2024-09-17T03:36:02.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.153+0000 7f7633e00640 1 -- 172.21.15.121:0/1839398424 wait complete. 2024-09-17T03:36:02.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.155+0000 7fd443e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd428004800 0x7fd444151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.156+0000 7fd443e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd444156280 0x7fd4440afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.156+0000 7fd443e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4440ada90 0x7fd4440b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.157+0000 7fd442a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd428004800 0x7fd444151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.157+0000 7fd442a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd428004800 0x7fd444151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:52066/0 (socket says 172.21.15.121:52066) 2024-09-17T03:36:02.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.157+0000 7fd43a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd444156280 0x7fd4440afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.157+0000 7fd443400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4440ada90 0x7fd4440b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.157+0000 7fd443400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4440ada90 0x7fd4440b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57836/0 (socket says 172.21.15.121:57836) 2024-09-17T03:36:02.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.158+0000 7f7633e00640 1 Processor -- start 2024-09-17T03:36:02.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.157+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd4440ae820 con 0x7fd4440ada90 2024-09-17T03:36:02.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.157+0000 7fd442a00640 1 -- 172.21.15.121:0/461315897 learned_addr learned my addr 172.21.15.121:0/461315897 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:02.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.158+0000 7f7633e00640 1 -- start start 2024-09-17T03:36:02.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.157+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd4440ae6a0 con 0x7fd428004800 2024-09-17T03:36:02.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.157+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd4440ae9a0 con 0x7fd444156280 2024-09-17T03:36:02.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.158+0000 7fd442a00640 1 -- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd444156280 msgr2=0x7fd4440afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.158+0000 7fd442a00640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd444156280 0x7fd4440afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.158+0000 7fd442a00640 1 -- 172.21.15.121:0/461315897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4440ada90 msgr2=0x7fd4440b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.158+0000 7fd442a00640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4440ada90 0x7fd4440b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.158+0000 7fd442a00640 1 -- 172.21.15.121:0/461315897 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd444151b60 con 0x7fd428004800 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.159+0000 7fd443400640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4440ada90 0x7fd4440b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.159+0000 7fd442a00640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd428004800 0x7fd444151620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd43400eaa0 tx=0x7fd43400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.159+0000 7fd43b400640 1 -- 172.21.15.121:0/461315897 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43400cdb0 con 0x7fd428004800 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.160+0000 7fd43b400640 1 -- 172.21.15.121:0/461315897 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd434004c10 con 0x7fd428004800 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.160+0000 7fd43b400640 1 -- 172.21.15.121:0/461315897 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434005020 con 0x7fd428004800 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.160+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4441554c0 con 0x7fd428004800 2024-09-17T03:36:02.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.160+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd444155a80 con 0x7fd428004800 2024-09-17T03:36:02.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.161+0000 7f7633e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762c03c450 0x7f762c04f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.162+0000 7f7633e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762c03cda0 0x7f762c0e33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.162+0000 7f7633e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762c057130 0x7f762c0e3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.162+0000 7f7633e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f762c053e50 con 0x7f762c03c450 2024-09-17T03:36:02.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.162+0000 7f7633e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f762c0e6dc0 con 0x7f762c057130 2024-09-17T03:36:02.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.162+0000 7f7633e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f762c0caee0 con 0x7f762c03cda0 2024-09-17T03:36:02.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.162+0000 7f7632000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762c03cda0 0x7f762c0e33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.162+0000 7f7632000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762c03cda0 0x7f762c0e33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:57064/0 (socket says 172.21.15.121:57064) 2024-09-17T03:36:02.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.162+0000 7f7632000640 1 -- 172.21.15.121:0/1169821042 learned_addr learned my addr 172.21.15.121:0/1169821042 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:02.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.163+0000 7f7632a00640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762c03c450 0x7f762c04f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.163+0000 7f7633400640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762c057130 0x7f762c0e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.163+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4440aef30 con 0x7fd428004800 2024-09-17T03:36:02.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.163+0000 7f7632000640 1 -- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762c057130 msgr2=0x7f762c0e3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.163+0000 7f7632000640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762c057130 0x7f762c0e3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.163+0000 7f7632000640 1 -- 172.21.15.121:0/1169821042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762c03c450 msgr2=0x7f762c04f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.163+0000 7f7632000640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762c03c450 0x7f762c04f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.164+0000 7f7632000640 1 -- 172.21.15.121:0/1169821042 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c00a410 con 0x7f762c03cda0 2024-09-17T03:36:02.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.164+0000 7f7633400640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762c057130 0x7f762c0e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:02.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.164+0000 7f7632a00640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762c03c450 0x7f762c04f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:02.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.165+0000 7f7632000640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762c03cda0 0x7f762c0e33e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f761c009950 tx=0x7f761c003910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.165+0000 7f762b400640 1 -- 172.21.15.121:0/1169821042 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c03f020 con 0x7f762c03cda0 2024-09-17T03:36:02.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.165+0000 7f762b400640 1 -- 172.21.15.121:0/1169821042 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f761c003dd0 con 0x7f762c03cda0 2024-09-17T03:36:02.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.165+0000 7f7633e00640 1 -- 172.21.15.121:0/1169821042 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762c00a130 con 0x7f762c03cda0 2024-09-17T03:36:02.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.165+0000 7f762b400640 1 -- 172.21.15.121:0/1169821042 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c037070 con 0x7f762c03cda0 2024-09-17T03:36:02.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.166+0000 7f7633e00640 1 -- 172.21.15.121:0/1169821042 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f762c0e2be0 con 0x7f762c03cda0 2024-09-17T03:36:02.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.168+0000 7f7633e00640 1 -- 172.21.15.121:0/1169821042 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762c03c860 con 0x7f762c03cda0 2024-09-17T03:36:02.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.167+0000 7fd43b400640 1 -- 172.21.15.121:0/461315897 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd4340051c0 con 0x7fd428004800 2024-09-17T03:36:02.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.168+0000 7fd43b400640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd420078b90 0x7fd42007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.168+0000 7fd43b400640 1 -- 172.21.15.121:0/461315897 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd43409be60 con 0x7fd428004800 2024-09-17T03:36:02.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.170+0000 7fd43b400640 1 -- 172.21.15.121:0/461315897 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd434016030 con 0x7fd428004800 2024-09-17T03:36:02.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.170+0000 7fd43a000640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd420078b90 0x7fd42007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.172+0000 7f762b400640 1 -- 172.21.15.121:0/1169821042 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f761c042020 con 0x7f762c03cda0 2024-09-17T03:36:02.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.174+0000 7f762b400640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7610078b90 0x7f761007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.174+0000 7f762b400640 1 -- 172.21.15.121:0/1169821042 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f761c0baf10 con 0x7f762c03cda0 2024-09-17T03:36:02.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.174+0000 7f7632a00640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7610078b90 0x7f761007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.174+0000 7fd43a000640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd420078b90 0x7fd42007b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd428004780 tx=0x7fd42c0019f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.176+0000 7f7632a00640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7610078b90 0x7f761007b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7624005fd0 tx=0x7f7624005d20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.179+0000 7f762b400640 1 -- 172.21.15.121:0/1169821042 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f761c049030 con 0x7f762c03cda0 2024-09-17T03:36:02.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.214+0000 7f2f4ea00640 1 -- 172.21.15.121:0/1186787661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f480d0c20 msgr2=0x7f2f480d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.214+0000 7f2f4ea00640 1 --2- 172.21.15.121:0/1186787661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f480d0c20 0x7f2f480d1030 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2f4815fe90 tx=0x7f2f4002a800 comp rx=0 tx=0).stop 2024-09-17T03:36:02.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.215+0000 7f2f4ea00640 1 -- 172.21.15.121:0/1186787661 shutdown_connections 2024-09-17T03:36:02.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.215+0000 7f2f4ea00640 1 --2- 172.21.15.121:0/1186787661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f480d0c20 0x7f2f480d1030 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.215+0000 7f2f4ea00640 1 --2- 172.21.15.121:0/1186787661 >> v2:172.21.15.176:3300/0 conn(0x7f2f480b63e0 0x7f2f480b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.215+0000 7f2f4ea00640 1 -- 172.21.15.121:0/1186787661 >> 172.21.15.121:0/1186787661 conn(0x7f2f4809d830 msgr2=0x7f2f480b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.216+0000 7f2f4ea00640 1 -- 172.21.15.121:0/1186787661 shutdown_connections 2024-09-17T03:36:02.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.216+0000 7f2f4ea00640 1 -- 172.21.15.121:0/1186787661 wait complete. 2024-09-17T03:36:02.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.221+0000 7f2f4ea00640 1 Processor -- start 2024-09-17T03:36:02.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.221+0000 7f2f4ea00640 1 -- start start 2024-09-17T03:36:02.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.221+0000 7fdcf2400640 1 -- 172.21.15.121:0/3909692882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdce40e1010 msgr2=0x7fdce40532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.221+0000 7fdcf2400640 1 --2- 172.21.15.121:0/3909692882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdce40e1010 0x7fdce40532b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdce403c9f0 tx=0x7fdce002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.221+0000 7fdcf2400640 1 -- 172.21.15.121:0/3909692882 shutdown_connections 2024-09-17T03:36:02.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.221+0000 7fdcf2400640 1 --2- 172.21.15.121:0/3909692882 >> v2:172.21.15.176:3300/0 conn(0x7fdce40537f0 0x7fdce4054660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.221+0000 7fdcf2400640 1 --2- 172.21.15.121:0/3909692882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdce40e1010 0x7fdce40532b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.221+0000 7fdcf2400640 1 -- 172.21.15.121:0/3909692882 >> 172.21.15.121:0/3909692882 conn(0x7fdce401fbe0 msgr2=0x7fdce4056940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.222+0000 7fdcf2400640 1 -- 172.21.15.121:0/3909692882 shutdown_connections 2024-09-17T03:36:02.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.222+0000 7fdcf2400640 1 -- 172.21.15.121:0/3909692882 wait complete. 2024-09-17T03:36:02.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.224+0000 7f2f4ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f480b63e0 0x7f2f48154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.224+0000 7f2f4ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f480b9ad0 0x7f2f4806e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.224+0000 7f2f4ea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f480d0c20 0x7f2f4806e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.224+0000 7f2f4ea00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2f480b6eb0 con 0x7f2f480b63e0 2024-09-17T03:36:02.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.224+0000 7f2f4ea00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f480b6d30 con 0x7f2f480d0c20 2024-09-17T03:36:02.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.224+0000 7f2f4ea00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f4815ee80 con 0x7f2f480b9ad0 2024-09-17T03:36:02.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.225+0000 7f2f4ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f480d0c20 0x7f2f4806e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.225+0000 7f2f4ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f480d0c20 0x7f2f4806e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:52114/0 (socket says 172.21.15.121:52114) 2024-09-17T03:36:02.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.225+0000 7f2f4ca00640 1 -- 172.21.15.121:0/2505140548 learned_addr learned my addr 172.21.15.121:0/2505140548 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:02.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.226+0000 7f2f47400640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f480b9ad0 0x7f2f4806e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.226+0000 7fdcf2400640 1 Processor -- start 2024-09-17T03:36:02.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.226+0000 7fdcf2400640 1 -- start start 2024-09-17T03:36:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.226+0000 7f2f47e00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f480b63e0 0x7f2f48154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.226+0000 7f2f4ca00640 1 -- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f480b9ad0 msgr2=0x7f2f4806e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.227+0000 7f2f4ca00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f480b9ad0 0x7f2f4806e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.227+0000 7f2f4ca00640 1 -- 172.21.15.121:0/2505140548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f480b63e0 msgr2=0x7f2f48154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.227+0000 7f2f4ca00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f480b63e0 0x7f2f48154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.227+0000 7f2f4ca00640 1 -- 172.21.15.121:0/2505140548 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f481555c0 con 0x7f2f480d0c20 2024-09-17T03:36:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.227+0000 7f2f47e00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f480b63e0 0x7f2f48154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.228+0000 7f2f4ca00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f480d0c20 0x7f2f4806e790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f40035040 tx=0x7f2f40033e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.228+0000 7f2f3fe00640 1 -- 172.21.15.121:0/2505140548 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40042020 con 0x7f2f480d0c20 2024-09-17T03:36:02.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.228+0000 7f2f3fe00640 1 -- 172.21.15.121:0/2505140548 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f40004170 con 0x7f2f480d0c20 2024-09-17T03:36:02.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.228+0000 7f2f3fe00640 1 -- 172.21.15.121:0/2505140548 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40037040 con 0x7f2f480d0c20 2024-09-17T03:36:02.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.229+0000 7f2f4ea00640 1 -- 172.21.15.121:0/2505140548 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f480cc270 con 0x7f2f480d0c20 2024-09-17T03:36:02.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.229+0000 7f2f4ea00640 1 -- 172.21.15.121:0/2505140548 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f480c92d0 con 0x7f2f480d0c20 2024-09-17T03:36:02.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.230+0000 7f2f4ea00640 1 -- 172.21.15.121:0/2505140548 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f480b67f0 con 0x7f2f480d0c20 2024-09-17T03:36:02.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.232+0000 7fdcf2400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce40537f0 0x7fdce40239e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.232+0000 7fdcf2400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdce4054ba0 0x7fdce4023f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.232+0000 7fdcf2400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce40e1010 0x7fdce40def10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.233+0000 7fdcf2400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdce40e5290 con 0x7fdce4054ba0 2024-09-17T03:36:02.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.233+0000 7fdcebe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdce4054ba0 0x7fdce4023f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.233+0000 7fdcf1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce40537f0 0x7fdce40239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.234+0000 7fdcf1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce40537f0 0x7fdce40239e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:52120/0 (socket says 172.21.15.121:52120) 2024-09-17T03:36:02.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.234+0000 7fdcf1000640 1 -- 172.21.15.121:0/3265081516 learned_addr learned my addr 172.21.15.121:0/3265081516 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:02.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.234+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdce40550f0 con 0x7fdce40537f0 2024-09-17T03:36:02.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.234+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdce40e5410 con 0x7fdce40e1010 2024-09-17T03:36:02.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.233+0000 7f2f3fe00640 1 -- 172.21.15.121:0/2505140548 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f40045020 con 0x7f2f480d0c20 2024-09-17T03:36:02.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.235+0000 7f2f3fe00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f28078b90 0x7f2f2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.235+0000 7f2f3fe00640 1 -- 172.21.15.121:0/2505140548 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2f40048e00 con 0x7f2f480d0c20 2024-09-17T03:36:02.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.235+0000 7f2f47e00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f28078b90 0x7f2f2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.235+0000 7fdcebe00640 1 -- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce40e1010 msgr2=0x7fdce40def10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:36:02.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.235+0000 7fdcebe00640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce40e1010 0x7fdce40def10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.235+0000 7fdcebe00640 1 -- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce40537f0 msgr2=0x7fdce40239e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.235+0000 7fdcebe00640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce40537f0 0x7fdce40239e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.235+0000 7fdcebe00640 1 -- 172.21.15.121:0/3265081516 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce40dd1c0 con 0x7fdce4054ba0 2024-09-17T03:36:02.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.236+0000 7fdcf1000640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce40537f0 0x7fdce40239e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:02.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.236+0000 7f2f47e00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f28078b90 0x7f2f2807b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2f38000f60 tx=0x7f2f38009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.237+0000 7fdcebe00640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdce4054ba0 0x7fdce4023f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdcec06bea0 tx=0x7fdcec051650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.237+0000 7f2f3fe00640 1 -- 172.21.15.121:0/2505140548 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f4004c070 con 0x7f2f480d0c20 2024-09-17T03:36:02.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.238+0000 7fdce8c00640 1 -- 172.21.15.121:0/3265081516 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec075980 con 0x7fdce4054ba0 2024-09-17T03:36:02.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.238+0000 7fdce8c00640 1 -- 172.21.15.121:0/3265081516 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcec075b20 con 0x7fdce4054ba0 2024-09-17T03:36:02.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.241+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce4187bd0 con 0x7fdce4054ba0 2024-09-17T03:36:02.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.241+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce41883a0 con 0x7fdce4054ba0 2024-09-17T03:36:02.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.245+0000 7fdce8c00640 1 -- 172.21.15.121:0/3265081516 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0763a0 con 0x7fdce4054ba0 2024-09-17T03:36:02.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.245+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce40e58c0 con 0x7fdce4054ba0 2024-09-17T03:36:02.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.247+0000 7fdce8c00640 1 -- 172.21.15.121:0/3265081516 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdcec076600 con 0x7fdce4054ba0 2024-09-17T03:36:02.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.259+0000 7fdce8c00640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdccc078b90 0x7fdccc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.260+0000 7fdce8c00640 1 -- 172.21.15.121:0/3265081516 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdcec117000 con 0x7fdce4054ba0 2024-09-17T03:36:02.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.261+0000 7fdce8c00640 1 -- 172.21.15.121:0/3265081516 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdcec0df210 con 0x7fdce4054ba0 2024-09-17T03:36:02.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.261+0000 7fdcf1000640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdccc078b90 0x7fdccc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.264+0000 7fdcf1000640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdccc078b90 0x7fdccc07b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009230 tx=0x7fdce0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.523+0000 7fd144e00640 1 -- 172.21.15.121:0/2446785912 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd1400ca670 con 0x7fd1400c9e80 2024-09-17T03:36:02.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.524+0000 7fd136000640 1 -- 172.21.15.121:0/2446785912 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd138063160 con 0x7fd1400c9e80 2024-09-17T03:36:02.524 INFO:teuthology.orchestra.run.smithi121.stdout:64424509453 2024-09-17T03:36:02.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.528+0000 7fd144e00640 1 -- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd11c078c60 msgr2=0x7fd11c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.529+0000 7fd144e00640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd11c078c60 0x7fd11c07b170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd128009880 tx=0x7fd12802c040 comp rx=0 tx=0).stop 2024-09-17T03:36:02.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.529+0000 7fd144e00640 1 -- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1400c9e80 msgr2=0x7fd1400c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.529+0000 7fd144e00640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1400c9e80 0x7fd1400c6d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd140073800 tx=0x7fd138001630 comp rx=0 tx=0).stop 2024-09-17T03:36:02.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.529+0000 7fd144e00640 1 -- 172.21.15.121:0/2446785912 shutdown_connections 2024-09-17T03:36:02.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.530+0000 7fd144e00640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1400c9e80 0x7fd1400c6d30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.530+0000 7fd144e00640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd11c078c60 0x7fd11c07b170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.530+0000 7fd144e00640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14015f040 0x7fd1400c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.530+0000 7fd144e00640 1 --2- 172.21.15.121:0/2446785912 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd124003b10 0x7fd14006fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.530+0000 7fd144e00640 1 -- 172.21.15.121:0/2446785912 >> 172.21.15.121:0/2446785912 conn(0x7fd1400b3f70 msgr2=0x7fd14015e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.530+0000 7fd144e00640 1 -- 172.21.15.121:0/2446785912 shutdown_connections 2024-09-17T03:36:02.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.531+0000 7fd144e00640 1 -- 172.21.15.121:0/2446785912 wait complete. 2024-09-17T03:36:02.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.531+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f71cc038f40 con 0x7f71cc0de530 2024-09-17T03:36:02.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.534+0000 7f71cb400640 1 -- 172.21.15.121:0/3243163229 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71d40fe880 con 0x7f71cc0de530 2024-09-17T03:36:02.537 INFO:teuthology.orchestra.run.smithi121.stdout:64424509451 2024-09-17T03:36:02.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.538+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71b407d080 msgr2=0x7f71b407f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.538+0000 7f71d9e00640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71b407d080 0x7f71b407f590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f71c4007fd0 tx=0x7f71c4007d10 comp rx=0 tx=0).stop 2024-09-17T03:36:02.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.538+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc0de530 msgr2=0x7f71cc178fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.538+0000 7f71d9e00640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc0de530 0x7f71cc178fd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71d4076070 tx=0x7f71d40aef70 comp rx=0 tx=0).stop 2024-09-17T03:36:02.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.539+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 shutdown_connections 2024-09-17T03:36:02.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.539+0000 7f71d9e00640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc0de530 0x7f71cc178fd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.539+0000 7f71d9e00640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc009b90 0x7f71cc178a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.539+0000 7f71d9e00640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71b407d080 0x7f71b407f590 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.539+0000 7f71d9e00640 1 --2- 172.21.15.121:0/3243163229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71cc005c50 0x7f71cc0ddf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.539+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 >> 172.21.15.121:0/3243163229 conn(0x7f71cc051410 msgr2=0x7f71cc038400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.540+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 shutdown_connections 2024-09-17T03:36:02.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.540+0000 7f71d9e00640 1 -- 172.21.15.121:0/3243163229 wait complete. 2024-09-17T03:36:02.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.552+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f312c005850 con 0x7f315415e840 2024-09-17T03:36:02.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.554+0000 7f314aa00640 1 -- 172.21.15.121:0/1160703420 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f314c084760 con 0x7f315415e840 2024-09-17T03:36:02.554 INFO:teuthology.orchestra.run.smithi121.stdout:55834574858 2024-09-17T03:36:02.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3134078c60 msgr2=0x7f313407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f3159600640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3134078c60 0x7f313407b170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f31400016c0 tx=0x7f3140009040 comp rx=0 tx=0).stop 2024-09-17T03:36:02.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f315415e840 msgr2=0x7f3154153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f3159600640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f315415e840 0x7f3154153fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f314c009000 tx=0x7f314c032c60 comp rx=0 tx=0).stop 2024-09-17T03:36:02.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 shutdown_connections 2024-09-17T03:36:02.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f3159600640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3134078c60 0x7f313407b170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f3159600640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f315415e840 0x7f3154153fe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f3159600640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31541519d0 0x7f31541367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f3159600640 1 --2- 172.21.15.121:0/1160703420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31541515c0 0x7f315414dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 >> 172.21.15.121:0/1160703420 conn(0x7f31540d0590 msgr2=0x7f315415cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.559+0000 7f6a6aa00640 1 -- 172.21.15.121:0/207569196 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6a7815af90 con 0x7f6a7815e1c0 2024-09-17T03:36:02.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.560+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 shutdown_connections 2024-09-17T03:36:02.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.560+0000 7f3159600640 1 -- 172.21.15.121:0/1160703420 wait complete. 2024-09-17T03:36:02.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.560+0000 7f6a75600640 1 -- 172.21.15.121:0/207569196 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a70083690 con 0x7f6a7815e1c0 2024-09-17T03:36:02.562 INFO:teuthology.orchestra.run.smithi121.stdout:64424509452 2024-09-17T03:36:02.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.565+0000 7f6a7ee00640 1 -- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6a58078bc0 msgr2=0x7f6a5807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.565+0000 7f6a7ee00640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6a58078bc0 0x7f6a5807b0d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00bd90 tx=0x7f6a6c00d040 comp rx=0 tx=0).stop 2024-09-17T03:36:02.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.565+0000 7f6a7ee00640 1 -- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a7815e1c0 msgr2=0x7f6a780c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.565+0000 7f6a7ee00640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a7815e1c0 0x7f6a780c4dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a70030000 tx=0x7f6a70003f10 comp rx=0 tx=0).stop 2024-09-17T03:36:02.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.565+0000 7f6a7ee00640 1 -- 172.21.15.121:0/207569196 shutdown_connections 2024-09-17T03:36:02.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.565+0000 7f6a7ee00640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a7815e1c0 0x7f6a780c4dd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.565+0000 7f6a7ee00640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6a58078bc0 0x7f6a5807b0d0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00bd90 tx=0x7f6a6c00d040 comp rx=0 tx=0).stop 2024-09-17T03:36:02.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.565+0000 7f6a7ee00640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a7815ab80 0x7f6a7814dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.565+0000 7f6a7ee00640 1 --2- 172.21.15.121:0/207569196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a78151080 0x7f6a780cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.565+0000 7f6a7ee00640 1 -- 172.21.15.121:0/207569196 >> 172.21.15.121:0/207569196 conn(0x7f6a780d05c0 msgr2=0x7f6a780ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.566+0000 7f6a7ee00640 1 -- 172.21.15.121:0/207569196 shutdown_connections 2024-09-17T03:36:02.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.566+0000 7f6a7ee00640 1 -- 172.21.15.121:0/207569196 wait complete. 2024-09-17T03:36:02.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.0 2024-09-17T03:36:02.575 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:02.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.1 2024-09-17T03:36:02.585 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:02.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.602+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd4441618c0 con 0x7fd428004800 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.603+0000 7fd43b400640 1 -- 172.21.15.121:0/461315897 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd434063fd0 con 0x7fd428004800 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi121.stdout:64424509452 2024-09-17T03:36:02.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.6 2024-09-17T03:36:02.607 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:02.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-09-17T03:36:02.608 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:02.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd420078b90 msgr2=0x7fd42007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd420078b90 0x7fd42007b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd428004780 tx=0x7fd42c0019f0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd428004800 msgr2=0x7fd444151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd428004800 0x7fd444151620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd43400eaa0 tx=0x7fd43400ef60 comp rx=0 tx=0).stop 2024-09-17T03:36:02.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 shutdown_connections 2024-09-17T03:36:02.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd420078b90 0x7fd42007b0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4440ada90 0x7fd4440b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd444156280 0x7fd4440afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 --2- 172.21.15.121:0/461315897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd428004800 0x7fd444151620 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 >> 172.21.15.121:0/461315897 conn(0x7fd44406cde0 msgr2=0x7fd4440b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 shutdown_connections 2024-09-17T03:36:02.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7fd443e00640 1 -- 172.21.15.121:0/461315897 wait complete. 2024-09-17T03:36:02.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.607+0000 7f7633e00640 1 -- 172.21.15.121:0/1169821042 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f762c051680 con 0x7f762c03cda0 2024-09-17T03:36:02.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.608+0000 7f762b400640 1 -- 172.21.15.121:0/1169821042 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f761c0830a0 con 0x7f762c03cda0 2024-09-17T03:36:02.610 INFO:teuthology.orchestra.run.smithi121.stdout:64424509451 2024-09-17T03:36:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 -- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7610078b90 msgr2=0x7f761007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7610078b90 0x7f761007b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7624005fd0 tx=0x7f7624005d20 comp rx=0 tx=0).stop 2024-09-17T03:36:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 -- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762c03cda0 msgr2=0x7f762c0e33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762c03cda0 0x7f762c0e33e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f761c009950 tx=0x7f761c003910 comp rx=0 tx=0).stop 2024-09-17T03:36:02.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 -- 172.21.15.121:0/1169821042 shutdown_connections 2024-09-17T03:36:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762c057130 0x7f762c0e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762c03cda0 0x7f762c0e33e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7610078b90 0x7f761007b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 --2- 172.21.15.121:0/1169821042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762c03c450 0x7f762c04f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 -- 172.21.15.121:0/1169821042 >> 172.21.15.121:0/1169821042 conn(0x7f762c03a680 msgr2=0x7f762c0de830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 -- 172.21.15.121:0/1169821042 shutdown_connections 2024-09-17T03:36:02.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.611+0000 7f7633e00640 1 -- 172.21.15.121:0/1169821042 wait complete. 2024-09-17T03:36:02.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.616+0000 7f2f4ea00640 1 -- 172.21.15.121:0/2505140548 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2f481557c0 con 0x7f2f480d0c20 2024-09-17T03:36:02.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.617+0000 7f2f3fe00640 1 -- 172.21.15.121:0/2505140548 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f4002f070 con 0x7f2f480d0c20 2024-09-17T03:36:02.617 INFO:teuthology.orchestra.run.smithi121.stdout:64424509452 2024-09-17T03:36:02.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.619+0000 7f2f4ea00640 1 -- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f28078b90 msgr2=0x7f2f2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.619+0000 7f2f4ea00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f28078b90 0x7f2f2807b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2f38000f60 tx=0x7f2f38009040 comp rx=0 tx=0).stop 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.619+0000 7f2f4ea00640 1 -- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f480d0c20 msgr2=0x7f2f4806e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.619+0000 7f2f4ea00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f480d0c20 0x7f2f4806e790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f40035040 tx=0x7f2f40033e80 comp rx=0 tx=0).stop 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.619+0000 7f2f4ea00640 1 -- 172.21.15.121:0/2505140548 shutdown_connections 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.619+0000 7f2f4ea00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f480d0c20 0x7f2f4806e790 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.619+0000 7f2f4ea00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f480b9ad0 0x7f2f4806e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.619+0000 7f2f4ea00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f28078b90 0x7f2f2807b0a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.619+0000 7f2f4ea00640 1 --2- 172.21.15.121:0/2505140548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f480b63e0 0x7f2f48154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.619+0000 7f2f4ea00640 1 -- 172.21.15.121:0/2505140548 >> 172.21.15.121:0/2505140548 conn(0x7f2f4809d830 msgr2=0x7f2f48158980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.620+0000 7f2f4ea00640 1 -- 172.21.15.121:0/2505140548 shutdown_connections 2024-09-17T03:36:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.620+0000 7f2f4ea00640 1 -- 172.21.15.121:0/2505140548 wait complete. 2024-09-17T03:36:02.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.633+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdce4050d00 con 0x7fdce4054ba0 2024-09-17T03:36:02.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.633+0000 7fdce8c00640 1 -- 172.21.15.121:0/3265081516 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdcec0deb10 con 0x7fdce4054ba0 2024-09-17T03:36:02.633 INFO:teuthology.orchestra.run.smithi121.stdout:64424509450 2024-09-17T03:36:02.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdccc078b90 msgr2=0x7fdccc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdccc078b90 0x7fdccc07b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009230 tx=0x7fdce0004730 comp rx=0 tx=0).stop 2024-09-17T03:36:02.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdce4054ba0 msgr2=0x7fdce4023f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdce4054ba0 0x7fdce4023f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdcec06bea0 tx=0x7fdcec051650 comp rx=0 tx=0).stop 2024-09-17T03:36:02.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 shutdown_connections 2024-09-17T03:36:02.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce40e1010 0x7fdce40def10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdccc078b90 0x7fdccc07b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdce4054ba0 0x7fdce4023f20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 --2- 172.21.15.121:0/3265081516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce40537f0 0x7fdce40239e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 >> 172.21.15.121:0/3265081516 conn(0x7fdce401fbe0 msgr2=0x7fdce4033a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 shutdown_connections 2024-09-17T03:36:02.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.636+0000 7fdcf2400640 1 -- 172.21.15.121:0/3265081516 wait complete. 2024-09-17T03:36:02.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.3 2024-09-17T03:36:02.643 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:02.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.7 2024-09-17T03:36:02.643 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:02.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.2 2024-09-17T03:36:02.648 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:02.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.5 2024-09-17T03:36:02.662 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:02.662 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:36:02.662 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:02.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.920+0000 7f0fac200640 1 -- 172.21.15.121:0/2742486568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fa4162590 msgr2=0x7f0fa41629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.920+0000 7f0fac200640 1 --2- 172.21.15.121:0/2742486568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fa4162590 0x7f0fa41629a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009860 tx=0x7f0f9002a540 comp rx=0 tx=0).stop 2024-09-17T03:36:02.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.920+0000 7f0fac200640 1 -- 172.21.15.121:0/2742486568 shutdown_connections 2024-09-17T03:36:02.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.920+0000 7f0fac200640 1 --2- 172.21.15.121:0/2742486568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fa40b2e60 0x7f0fa40b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.920+0000 7f0fac200640 1 --2- 172.21.15.121:0/2742486568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fa4162590 0x7f0fa41629a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.920+0000 7f0fac200640 1 -- 172.21.15.121:0/2742486568 >> 172.21.15.121:0/2742486568 conn(0x7f0fa40d4440 msgr2=0x7f0fa40d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.920+0000 7f0fac200640 1 -- 172.21.15.121:0/2742486568 shutdown_connections 2024-09-17T03:36:02.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.920+0000 7f0fac200640 1 -- 172.21.15.121:0/2742486568 wait complete. 2024-09-17T03:36:02.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.922+0000 7f0fac200640 1 Processor -- start 2024-09-17T03:36:02.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.923+0000 7f0fac200640 1 -- start start 2024-09-17T03:36:02.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0fac200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fa40b2e60 0x7f0fa415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0fac200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fa40cfe00 0x7f0fa41f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0fac200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fa4162590 0x7f0fa40c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0fac200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa40b3b40 con 0x7f0fa40cfe00 2024-09-17T03:36:02.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0fac200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa40b39c0 con 0x7f0fa4162590 2024-09-17T03:36:02.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0fac200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa40cf590 con 0x7f0fa40b2e60 2024-09-17T03:36:02.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0fa8e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fa40cfe00 0x7f0fa41f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0fa8e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fa40cfe00 0x7f0fa41f8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57918/0 (socket says 172.21.15.121:57918) 2024-09-17T03:36:02.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0fa8e00640 1 -- 172.21.15.121:0/3258875926 learned_addr learned my addr 172.21.15.121:0/3258875926 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:02.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0fa9800640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fa40b2e60 0x7f0fa415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.924+0000 7f0faa200640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fa4162590 0x7f0fa40c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.925+0000 7f0fa8e00640 1 -- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fa40b2e60 msgr2=0x7f0fa415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.925+0000 7f0fa8e00640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fa40b2e60 0x7f0fa415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.925+0000 7f0fa8e00640 1 -- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fa4162590 msgr2=0x7f0fa40c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.925+0000 7f0fa8e00640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fa4162590 0x7f0fa40c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.925+0000 7f0fa8e00640 1 -- 172.21.15.121:0/3258875926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa41f55e0 con 0x7f0fa40cfe00 2024-09-17T03:36:02.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.925+0000 7f0fa8e00640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fa40cfe00 0x7f0fa41f8c00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009980 tx=0x7f0f90033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.925+0000 7f0fa1600640 1 -- 172.21.15.121:0/3258875926 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f90031d60 con 0x7f0fa40cfe00 2024-09-17T03:36:02.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.925+0000 7f0fa1600640 1 -- 172.21.15.121:0/3258875926 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f90033e10 con 0x7f0fa40cfe00 2024-09-17T03:36:02.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.925+0000 7f0fa1600640 1 -- 172.21.15.121:0/3258875926 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f90033310 con 0x7f0fa40cfe00 2024-09-17T03:36:02.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.925+0000 7f0fac200640 1 -- 172.21.15.121:0/3258875926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa41f9940 con 0x7f0fa40cfe00 2024-09-17T03:36:02.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.926+0000 7f0fac200640 1 -- 172.21.15.121:0/3258875926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa41f5b50 con 0x7f0fa40cfe00 2024-09-17T03:36:02.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.927+0000 7f0fac200640 1 -- 172.21.15.121:0/3258875926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa41f96b0 con 0x7f0fa40cfe00 2024-09-17T03:36:02.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.928+0000 7f0fa1600640 1 -- 172.21.15.121:0/3258875926 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f900334b0 con 0x7f0fa40cfe00 2024-09-17T03:36:02.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.929+0000 7f0fa1600640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f84078b90 0x7f0f8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.929+0000 7f0fa1600640 1 -- 172.21.15.121:0/3258875926 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0f900bc3b0 con 0x7f0fa40cfe00 2024-09-17T03:36:02.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.929+0000 7f0fa9800640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f84078b90 0x7f0f8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.930+0000 7f0fa9800640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f84078b90 0x7f0f8407b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f98002200 tx=0x7f0f980019f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:02.934+0000 7f0fa1600640 1 -- 172.21.15.121:0/3258875926 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f9003f030 con 0x7f0fa40cfe00 2024-09-17T03:36:03.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.121+0000 7f0fac200640 1 -- 172.21.15.121:0/3258875926 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0fa40b3270 con 0x7f0f84078b90 2024-09-17T03:36:03.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.128+0000 7f0fa1600640 1 -- 172.21.15.121:0/3258875926 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332518 (secure 0 0 0) 0x7f0fa40b3270 con 0x7f0f84078b90 2024-09-17T03:36:03.131 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:03.133 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:36:03.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.132+0000 7f0fac200640 1 -- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f84078b90 msgr2=0x7f0f8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.132+0000 7f0fac200640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f84078b90 0x7f0f8407b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f98002200 tx=0x7f0f980019f0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.132+0000 7f0fac200640 1 -- 172.21.15.121:0/3258875926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fa40cfe00 msgr2=0x7f0fa41f8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.132+0000 7f0fac200640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fa40cfe00 0x7f0fa41f8c00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009980 tx=0x7f0f90033c20 comp rx=0 tx=0).stop 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.132+0000 7f0fac200640 1 -- 172.21.15.121:0/3258875926 shutdown_connections 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.132+0000 7f0fac200640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fa4162590 0x7f0fa40c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.132+0000 7f0fac200640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f84078b90 0x7f0f8407b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.132+0000 7f0fac200640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fa40cfe00 0x7f0fa41f8c00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.132+0000 7f0fac200640 1 --2- 172.21.15.121:0/3258875926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fa40b2e60 0x7f0fa415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.132+0000 7f0fac200640 1 -- 172.21.15.121:0/3258875926 >> 172.21.15.121:0/3258875926 conn(0x7f0fa40d4440 msgr2=0x7f0fa40d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.133+0000 7f0fac200640 1 -- 172.21.15.121:0/3258875926 shutdown_connections 2024-09-17T03:36:03.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.133+0000 7f0fac200640 1 -- 172.21.15.121:0/3258875926 wait complete. 2024-09-17T03:36:03.156 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-09-17T03:36:01.284636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003609"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952940+0000","last_change":"2024-09-17T03:35:31.396637+0000","last_active":"2024-09-17T03:35:37.952940+0000","last_peered":"2024-09-17T03:35:37.952940+0000","last_clean":"2024-09-17T03:35:37.952940+0000","last_became_active":"2024-09-17T03:35:31.396194+0000","last_became_peered":"2024-09-17T03:35:31.396194+0000","last_unstale":"2024-09-17T03:35:37.952940+0000","last_undegraded":"2024-09-17T03:35:37.952940+0000","last_fullsized":"2024-09-17T03:35:37.952940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:58.587185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430670+0000","last_change":"2024-09-17T03:35:32.419807+0000","last_active":"2024-09-17T03:35:37.430670+0000","last_peered":"2024-09-17T03:35:37.430670+0000","last_clean":"2024-09-17T03:35:37.430670+0000","last_became_active":"2024-09-17T03:35:32.419516+0000","last_became_peered":"2024-09-17T03:35:32.419516+0000","last_unstale":"2024-09-17T03:35:37.430670+0000","last_undegraded":"2024-09-17T03:35:37.430670+0000","last_fullsized":"2024-09-17T03:35:37.430670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:18.848416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329189+0000","last_change":"2024-09-17T03:35:36.457719+0000","last_active":"2024-09-17T03:35:38.329189+0000","last_peered":"2024-09-17T03:35:38.329189+0000","last_clean":"2024-09-17T03:35:38.329189+0000","last_became_active":"2024-09-17T03:35:36.457049+0000","last_became_peered":"2024-09-17T03:35:36.457049+0000","last_unstale":"2024-09-17T03:35:38.329189+0000","last_undegraded":"2024-09-17T03:35:38.329189+0000","last_fullsized":"2024-09-17T03:35:38.329189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:26.004535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430809+0000","last_change":"2024-09-17T03:35:31.405486+0000","last_active":"2024-09-17T03:35:37.430809+0000","last_peered":"2024-09-17T03:35:37.430809+0000","last_clean":"2024-09-17T03:35:37.430809+0000","last_became_active":"2024-09-17T03:35:31.405174+0000","last_became_peered":"2024-09-17T03:35:31.405174+0000","last_unstale":"2024-09-17T03:35:37.430809+0000","last_undegraded":"2024-09-17T03:35:37.430809+0000","last_fullsized":"2024-09-17T03:35:37.430809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:50.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430989+0000","last_change":"2024-09-17T03:35:32.420131+0000","last_active":"2024-09-17T03:35:37.430989+0000","last_peered":"2024-09-17T03:35:37.430989+0000","last_clean":"2024-09-17T03:35:37.430989+0000","last_became_active":"2024-09-17T03:35:32.419301+0000","last_became_peered":"2024-09-17T03:35:32.419301+0000","last_unstale":"2024-09-17T03:35:37.430989+0000","last_undegraded":"2024-09-17T03:35:37.430989+0000","last_fullsized":"2024-09-17T03:35:37.430989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328550+0000","last_change":"2024-09-17T03:35:36.448725+0000","last_active":"2024-09-17T03:35:38.328550+0000","last_peered":"2024-09-17T03:35:38.328550+0000","last_clean":"2024-09-17T03:35:38.328550+0000","last_became_active":"2024-09-17T03:35:36.448306+0000","last_became_peered":"2024-09-17T03:35:36.448306+0000","last_unstale":"2024-09-17T03:35:38.328550+0000","last_undegraded":"2024-09-17T03:35:38.328550+0000","last_fullsized":"2024-09-17T03:35:38.328550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:38.297846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716849+0000","last_change":"2024-09-17T03:35:31.406863+0000","last_active":"2024-09-17T03:35:37.716849+0000","last_peered":"2024-09-17T03:35:37.716849+0000","last_clean":"2024-09-17T03:35:37.716849+0000","last_became_active":"2024-09-17T03:35:31.405716+0000","last_became_peered":"2024-09-17T03:35:31.405716+0000","last_unstale":"2024-09-17T03:35:37.716849+0000","last_undegraded":"2024-09-17T03:35:37.716849+0000","last_fullsized":"2024-09-17T03:35:37.716849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:25.988144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329090+0000","last_change":"2024-09-17T03:35:32.404862+0000","last_active":"2024-09-17T03:35:38.329090+0000","last_peered":"2024-09-17T03:35:38.329090+0000","last_clean":"2024-09-17T03:35:38.329090+0000","last_became_active":"2024-09-17T03:35:32.403799+0000","last_became_peered":"2024-09-17T03:35:32.403799+0000","last_unstale":"2024-09-17T03:35:38.329090+0000","last_undegraded":"2024-09-17T03:35:38.329090+0000","last_fullsized":"2024-09-17T03:35:38.329090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.040918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329212+0000","last_change":"2024-09-17T03:35:36.442226+0000","last_active":"2024-09-17T03:35:38.329212+0000","last_peered":"2024-09-17T03:35:38.329212+0000","last_clean":"2024-09-17T03:35:38.329212+0000","last_became_active":"2024-09-17T03:35:36.441650+0000","last_became_peered":"2024-09-17T03:35:36.441650+0000","last_unstale":"2024-09-17T03:35:38.329212+0000","last_undegraded":"2024-09-17T03:35:38.329212+0000","last_fullsized":"2024-09-17T03:35:38.329212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:53.723832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716982+0000","last_change":"2024-09-17T03:35:31.402468+0000","last_active":"2024-09-17T03:35:37.716982+0000","last_peered":"2024-09-17T03:35:37.716982+0000","last_clean":"2024-09-17T03:35:37.716982+0000","last_became_active":"2024-09-17T03:35:31.400527+0000","last_became_peered":"2024-09-17T03:35:31.400527+0000","last_unstale":"2024-09-17T03:35:37.716982+0000","last_undegraded":"2024-09-17T03:35:37.716982+0000","last_fullsized":"2024-09-17T03:35:37.716982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:34.200886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424506+0000","last_change":"2024-09-17T03:35:32.399680+0000","last_active":"2024-09-17T03:35:37.424506+0000","last_peered":"2024-09-17T03:35:37.424506+0000","last_clean":"2024-09-17T03:35:37.424506+0000","last_became_active":"2024-09-17T03:35:32.399385+0000","last_became_peered":"2024-09-17T03:35:32.399385+0000","last_unstale":"2024-09-17T03:35:37.424506+0000","last_undegraded":"2024-09-17T03:35:37.424506+0000","last_fullsized":"2024-09-17T03:35:37.424506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:43.868900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328684+0000","last_change":"2024-09-17T03:35:36.454547+0000","last_active":"2024-09-17T03:35:38.328684+0000","last_peered":"2024-09-17T03:35:38.328684+0000","last_clean":"2024-09-17T03:35:38.328684+0000","last_became_active":"2024-09-17T03:35:36.452245+0000","last_became_peered":"2024-09-17T03:35:36.452245+0000","last_unstale":"2024-09-17T03:35:38.328684+0000","last_undegraded":"2024-09-17T03:35:38.328684+0000","last_fullsized":"2024-09-17T03:35:38.328684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:21.761835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424041+0000","last_change":"2024-09-17T03:35:32.389915+0000","last_active":"2024-09-17T03:35:37.424041+0000","last_peered":"2024-09-17T03:35:37.424041+0000","last_clean":"2024-09-17T03:35:37.424041+0000","last_became_active":"2024-09-17T03:35:32.389629+0000","last_became_peered":"2024-09-17T03:35:32.389629+0000","last_unstale":"2024-09-17T03:35:37.424041+0000","last_undegraded":"2024-09-17T03:35:37.424041+0000","last_fullsized":"2024-09-17T03:35:37.424041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:37.978604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424108+0000","last_change":"2024-09-17T03:35:31.399927+0000","last_active":"2024-09-17T03:35:37.424108+0000","last_peered":"2024-09-17T03:35:37.424108+0000","last_clean":"2024-09-17T03:35:37.424108+0000","last_became_active":"2024-09-17T03:35:31.399633+0000","last_became_peered":"2024-09-17T03:35:31.399633+0000","last_unstale":"2024-09-17T03:35:37.424108+0000","last_undegraded":"2024-09-17T03:35:37.424108+0000","last_fullsized":"2024-09-17T03:35:37.424108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:54.701924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424308+0000","last_change":"2024-09-17T03:35:36.441343+0000","last_active":"2024-09-17T03:35:37.424308+0000","last_peered":"2024-09-17T03:35:37.424308+0000","last_clean":"2024-09-17T03:35:37.424308+0000","last_became_active":"2024-09-17T03:35:36.440928+0000","last_became_peered":"2024-09-17T03:35:36.440928+0000","last_unstale":"2024-09-17T03:35:37.424308+0000","last_undegraded":"2024-09-17T03:35:37.424308+0000","last_fullsized":"2024-09-17T03:35:37.424308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:30.901575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329519+0000","last_change":"2024-09-17T03:35:32.392491+0000","last_active":"2024-09-17T03:35:38.329519+0000","last_peered":"2024-09-17T03:35:38.329519+0000","last_clean":"2024-09-17T03:35:38.329519+0000","last_became_active":"2024-09-17T03:35:32.392158+0000","last_became_peered":"2024-09-17T03:35:32.392158+0000","last_unstale":"2024-09-17T03:35:38.329519+0000","last_undegraded":"2024-09-17T03:35:38.329519+0000","last_fullsized":"2024-09-17T03:35:38.329519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:09.595197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429614+0000","last_change":"2024-09-17T03:35:31.402340+0000","last_active":"2024-09-17T03:35:37.429614+0000","last_peered":"2024-09-17T03:35:37.429614+0000","last_clean":"2024-09-17T03:35:37.429614+0000","last_became_active":"2024-09-17T03:35:31.401416+0000","last_became_peered":"2024-09-17T03:35:31.401416+0000","last_unstale":"2024-09-17T03:35:37.429614+0000","last_undegraded":"2024-09-17T03:35:37.429614+0000","last_fullsized":"2024-09-17T03:35:37.429614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716700+0000","last_change":"2024-09-17T03:35:36.447535+0000","last_active":"2024-09-17T03:35:37.716700+0000","last_peered":"2024-09-17T03:35:37.716700+0000","last_clean":"2024-09-17T03:35:37.716700+0000","last_became_active":"2024-09-17T03:35:36.447090+0000","last_became_peered":"2024-09-17T03:35:36.447090+0000","last_unstale":"2024-09-17T03:35:37.716700+0000","last_undegraded":"2024-09-17T03:35:37.716700+0000","last_fullsized":"2024-09-17T03:35:37.716700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:23.237213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.951840+0000","last_change":"2024-09-17T03:35:32.400250+0000","last_active":"2024-09-17T03:35:37.951840+0000","last_peered":"2024-09-17T03:35:37.951840+0000","last_clean":"2024-09-17T03:35:37.951840+0000","last_became_active":"2024-09-17T03:35:32.399895+0000","last_became_peered":"2024-09-17T03:35:32.399895+0000","last_unstale":"2024-09-17T03:35:37.951840+0000","last_undegraded":"2024-09-17T03:35:37.951840+0000","last_fullsized":"2024-09-17T03:35:37.951840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:55.236620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952361+0000","last_change":"2024-09-17T03:35:31.407356+0000","last_active":"2024-09-17T03:35:37.952361+0000","last_peered":"2024-09-17T03:35:37.952361+0000","last_clean":"2024-09-17T03:35:37.952361+0000","last_became_active":"2024-09-17T03:35:31.407074+0000","last_became_peered":"2024-09-17T03:35:31.407074+0000","last_unstale":"2024-09-17T03:35:37.952361+0000","last_undegraded":"2024-09-17T03:35:37.952361+0000","last_fullsized":"2024-09-17T03:35:37.952361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:05.229644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329905+0000","last_change":"2024-09-17T03:35:36.460644+0000","last_active":"2024-09-17T03:35:38.329905+0000","last_peered":"2024-09-17T03:35:38.329905+0000","last_clean":"2024-09-17T03:35:38.329905+0000","last_became_active":"2024-09-17T03:35:36.460097+0000","last_became_peered":"2024-09-17T03:35:36.460097+0000","last_unstale":"2024-09-17T03:35:38.329905+0000","last_undegraded":"2024-09-17T03:35:38.329905+0000","last_fullsized":"2024-09-17T03:35:38.329905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:48.675841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424083+0000","last_change":"2024-09-17T03:35:32.405208+0000","last_active":"2024-09-17T03:35:37.424083+0000","last_peered":"2024-09-17T03:35:37.424083+0000","last_clean":"2024-09-17T03:35:37.424083+0000","last_became_active":"2024-09-17T03:35:32.404935+0000","last_became_peered":"2024-09-17T03:35:32.404935+0000","last_unstale":"2024-09-17T03:35:37.424083+0000","last_undegraded":"2024-09-17T03:35:37.424083+0000","last_fullsized":"2024-09-17T03:35:37.424083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:29.377565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716031+0000","last_change":"2024-09-17T03:35:31.402429+0000","last_active":"2024-09-17T03:35:37.716031+0000","last_peered":"2024-09-17T03:35:37.716031+0000","last_clean":"2024-09-17T03:35:37.716031+0000","last_became_active":"2024-09-17T03:35:31.400904+0000","last_became_peered":"2024-09-17T03:35:31.400904+0000","last_unstale":"2024-09-17T03:35:37.716031+0000","last_undegraded":"2024-09-17T03:35:37.716031+0000","last_fullsized":"2024-09-17T03:35:37.716031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:35.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329137+0000","last_change":"2024-09-17T03:35:36.439897+0000","last_active":"2024-09-17T03:35:38.329137+0000","last_peered":"2024-09-17T03:35:38.329137+0000","last_clean":"2024-09-17T03:35:38.329137+0000","last_became_active":"2024-09-17T03:35:36.439451+0000","last_became_peered":"2024-09-17T03:35:36.439451+0000","last_unstale":"2024-09-17T03:35:38.329137+0000","last_undegraded":"2024-09-17T03:35:38.329137+0000","last_fullsized":"2024-09-17T03:35:38.329137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:21.113089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952643+0000","last_change":"2024-09-17T03:35:32.397257+0000","last_active":"2024-09-17T03:35:37.952643+0000","last_peered":"2024-09-17T03:35:37.952643+0000","last_clean":"2024-09-17T03:35:37.952643+0000","last_became_active":"2024-09-17T03:35:32.396876+0000","last_became_peered":"2024-09-17T03:35:32.396876+0000","last_unstale":"2024-09-17T03:35:37.952643+0000","last_undegraded":"2024-09-17T03:35:37.952643+0000","last_fullsized":"2024-09-17T03:35:37.952643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:28.702200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424791+0000","last_change":"2024-09-17T03:35:31.409394+0000","last_active":"2024-09-17T03:35:37.424791+0000","last_peered":"2024-09-17T03:35:37.424791+0000","last_clean":"2024-09-17T03:35:37.424791+0000","last_became_active":"2024-09-17T03:35:31.408980+0000","last_became_peered":"2024-09-17T03:35:31.408980+0000","last_unstale":"2024-09-17T03:35:37.424791+0000","last_undegraded":"2024-09-17T03:35:37.424791+0000","last_fullsized":"2024-09-17T03:35:37.424791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:55.652949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329294+0000","last_change":"2024-09-17T03:35:36.436456+0000","last_active":"2024-09-17T03:35:38.329294+0000","last_peered":"2024-09-17T03:35:38.329294+0000","last_clean":"2024-09-17T03:35:38.329294+0000","last_became_active":"2024-09-17T03:35:36.435668+0000","last_became_peered":"2024-09-17T03:35:36.435668+0000","last_unstale":"2024-09-17T03:35:38.329294+0000","last_undegraded":"2024-09-17T03:35:38.329294+0000","last_fullsized":"2024-09-17T03:35:38.329294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:22.885095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952829+0000","last_change":"2024-09-17T03:35:32.401092+0000","last_active":"2024-09-17T03:35:37.952829+0000","last_peered":"2024-09-17T03:35:37.952829+0000","last_clean":"2024-09-17T03:35:37.952829+0000","last_became_active":"2024-09-17T03:35:32.400788+0000","last_became_peered":"2024-09-17T03:35:32.400788+0000","last_unstale":"2024-09-17T03:35:37.952829+0000","last_undegraded":"2024-09-17T03:35:37.952829+0000","last_fullsized":"2024-09-17T03:35:37.952829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:48.624702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952865+0000","last_change":"2024-09-17T03:35:31.409840+0000","last_active":"2024-09-17T03:35:37.952865+0000","last_peered":"2024-09-17T03:35:37.952865+0000","last_clean":"2024-09-17T03:35:37.952865+0000","last_became_active":"2024-09-17T03:35:31.409588+0000","last_became_peered":"2024-09-17T03:35:31.409588+0000","last_unstale":"2024-09-17T03:35:37.952865+0000","last_undegraded":"2024-09-17T03:35:37.952865+0000","last_fullsized":"2024-09-17T03:35:37.952865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:48.768703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.951931+0000","last_change":"2024-09-17T03:35:36.434767+0000","last_active":"2024-09-17T03:35:37.951931+0000","last_peered":"2024-09-17T03:35:37.951931+0000","last_clean":"2024-09-17T03:35:37.951931+0000","last_became_active":"2024-09-17T03:35:36.432238+0000","last_became_peered":"2024-09-17T03:35:36.432238+0000","last_unstale":"2024-09-17T03:35:37.951931+0000","last_undegraded":"2024-09-17T03:35:37.951931+0000","last_fullsized":"2024-09-17T03:35:37.951931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:42.117587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430388+0000","last_change":"2024-09-17T03:35:32.415405+0000","last_active":"2024-09-17T03:35:37.430388+0000","last_peered":"2024-09-17T03:35:37.430388+0000","last_clean":"2024-09-17T03:35:37.430388+0000","last_became_active":"2024-09-17T03:35:32.415059+0000","last_became_peered":"2024-09-17T03:35:32.415059+0000","last_unstale":"2024-09-17T03:35:37.430388+0000","last_undegraded":"2024-09-17T03:35:37.430388+0000","last_fullsized":"2024-09-17T03:35:37.430388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:03.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424840+0000","last_change":"2024-09-17T03:35:31.396414+0000","last_active":"2024-09-17T03:35:37.424840+0000","last_peered":"2024-09-17T03:35:37.424840+0000","last_clean":"2024-09-17T03:35:37.424840+0000","last_became_active":"2024-09-17T03:35:31.395858+0000","last_became_peered":"2024-09-17T03:35:31.395858+0000","last_unstale":"2024-09-17T03:35:37.424840+0000","last_undegraded":"2024-09-17T03:35:37.424840+0000","last_fullsized":"2024-09-17T03:35:37.424840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:48.032251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429676+0000","last_change":"2024-09-17T03:35:36.454944+0000","last_active":"2024-09-17T03:35:37.429676+0000","last_peered":"2024-09-17T03:35:37.429676+0000","last_clean":"2024-09-17T03:35:37.429676+0000","last_became_active":"2024-09-17T03:35:36.452999+0000","last_became_peered":"2024-09-17T03:35:36.452999+0000","last_unstale":"2024-09-17T03:35:37.429676+0000","last_undegraded":"2024-09-17T03:35:37.429676+0000","last_fullsized":"2024-09-17T03:35:37.429676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:59.994365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330037+0000","last_change":"2024-09-17T03:35:32.401014+0000","last_active":"2024-09-17T03:35:38.330037+0000","last_peered":"2024-09-17T03:35:38.330037+0000","last_clean":"2024-09-17T03:35:38.330037+0000","last_became_active":"2024-09-17T03:35:32.392657+0000","last_became_peered":"2024-09-17T03:35:32.392657+0000","last_unstale":"2024-09-17T03:35:38.330037+0000","last_undegraded":"2024-09-17T03:35:38.330037+0000","last_fullsized":"2024-09-17T03:35:38.330037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:54.253376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429390+0000","last_change":"2024-09-17T03:35:31.402788+0000","last_active":"2024-09-17T03:35:37.429390+0000","last_peered":"2024-09-17T03:35:37.429390+0000","last_clean":"2024-09-17T03:35:37.429390+0000","last_became_active":"2024-09-17T03:35:31.402263+0000","last_became_peered":"2024-09-17T03:35:31.402263+0000","last_unstale":"2024-09-17T03:35:37.429390+0000","last_undegraded":"2024-09-17T03:35:37.429390+0000","last_fullsized":"2024-09-17T03:35:37.429390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429266+0000","last_change":"2024-09-17T03:35:36.450678+0000","last_active":"2024-09-17T03:35:37.429266+0000","last_peered":"2024-09-17T03:35:37.429266+0000","last_clean":"2024-09-17T03:35:37.429266+0000","last_became_active":"2024-09-17T03:35:36.450277+0000","last_became_peered":"2024-09-17T03:35:36.450277+0000","last_unstale":"2024-09-17T03:35:37.429266+0000","last_undegraded":"2024-09-17T03:35:37.429266+0000","last_fullsized":"2024-09-17T03:35:37.429266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:58.323368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716675+0000","last_change":"2024-09-17T03:35:32.399401+0000","last_active":"2024-09-17T03:35:37.716675+0000","last_peered":"2024-09-17T03:35:37.716675+0000","last_clean":"2024-09-17T03:35:37.716675+0000","last_became_active":"2024-09-17T03:35:32.399115+0000","last_became_peered":"2024-09-17T03:35:32.399115+0000","last_unstale":"2024-09-17T03:35:37.716675+0000","last_undegraded":"2024-09-17T03:35:37.716675+0000","last_fullsized":"2024-09-17T03:35:37.716675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:44.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424632+0000","last_change":"2024-09-17T03:35:31.395600+0000","last_active":"2024-09-17T03:35:37.424632+0000","last_peered":"2024-09-17T03:35:37.424632+0000","last_clean":"2024-09-17T03:35:37.424632+0000","last_became_active":"2024-09-17T03:35:31.394734+0000","last_became_peered":"2024-09-17T03:35:31.394734+0000","last_unstale":"2024-09-17T03:35:37.424632+0000","last_undegraded":"2024-09-17T03:35:37.424632+0000","last_fullsized":"2024-09-17T03:35:37.424632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:01.197590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430182+0000","last_change":"2024-09-17T03:35:36.443098+0000","last_active":"2024-09-17T03:35:37.430182+0000","last_peered":"2024-09-17T03:35:37.430182+0000","last_clean":"2024-09-17T03:35:37.430182+0000","last_became_active":"2024-09-17T03:35:36.437889+0000","last_became_peered":"2024-09-17T03:35:36.437889+0000","last_unstale":"2024-09-17T03:35:37.430182+0000","last_undegraded":"2024-09-17T03:35:37.430182+0000","last_fullsized":"2024-09-17T03:35:37.430182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.413529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428284+0000","last_change":"2024-09-17T03:35:32.400695+0000","last_active":"2024-09-17T03:35:37.428284+0000","last_peered":"2024-09-17T03:35:37.428284+0000","last_clean":"2024-09-17T03:35:37.428284+0000","last_became_active":"2024-09-17T03:35:32.400363+0000","last_became_peered":"2024-09-17T03:35:32.400363+0000","last_unstale":"2024-09-17T03:35:37.428284+0000","last_undegraded":"2024-09-17T03:35:37.428284+0000","last_fullsized":"2024-09-17T03:35:37.428284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:14.763903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329497+0000","last_change":"2024-09-17T03:35:31.405580+0000","last_active":"2024-09-17T03:35:38.329497+0000","last_peered":"2024-09-17T03:35:38.329497+0000","last_clean":"2024-09-17T03:35:38.329497+0000","last_became_active":"2024-09-17T03:35:31.405210+0000","last_became_peered":"2024-09-17T03:35:31.405210+0000","last_unstale":"2024-09-17T03:35:38.329497+0000","last_undegraded":"2024-09-17T03:35:38.329497+0000","last_fullsized":"2024-09-17T03:35:38.329497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:24.896063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430908+0000","last_change":"2024-09-17T03:35:36.449377+0000","last_active":"2024-09-17T03:35:37.430908+0000","last_peered":"2024-09-17T03:35:37.430908+0000","last_clean":"2024-09-17T03:35:37.430908+0000","last_became_active":"2024-09-17T03:35:36.448135+0000","last_became_peered":"2024-09-17T03:35:36.448135+0000","last_unstale":"2024-09-17T03:35:37.430908+0000","last_undegraded":"2024-09-17T03:35:37.430908+0000","last_fullsized":"2024-09-17T03:35:37.430908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:36.313705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428454+0000","last_change":"2024-09-17T03:35:32.408934+0000","last_active":"2024-09-17T03:35:37.428454+0000","last_peered":"2024-09-17T03:35:37.428454+0000","last_clean":"2024-09-17T03:35:37.428454+0000","last_became_active":"2024-09-17T03:35:32.408637+0000","last_became_peered":"2024-09-17T03:35:32.408637+0000","last_unstale":"2024-09-17T03:35:37.428454+0000","last_undegraded":"2024-09-17T03:35:37.428454+0000","last_fullsized":"2024-09-17T03:35:37.428454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:55.435612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424316+0000","last_change":"2024-09-17T03:35:31.402870+0000","last_active":"2024-09-17T03:35:37.424316+0000","last_peered":"2024-09-17T03:35:37.424316+0000","last_clean":"2024-09-17T03:35:37.424316+0000","last_became_active":"2024-09-17T03:35:31.401653+0000","last_became_peered":"2024-09-17T03:35:31.401653+0000","last_unstale":"2024-09-17T03:35:37.424316+0000","last_undegraded":"2024-09-17T03:35:37.424316+0000","last_fullsized":"2024-09-17T03:35:37.424316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429975+0000","last_change":"2024-09-17T03:35:36.444315+0000","last_active":"2024-09-17T03:35:37.429975+0000","last_peered":"2024-09-17T03:35:37.429975+0000","last_clean":"2024-09-17T03:35:37.429975+0000","last_became_active":"2024-09-17T03:35:36.441801+0000","last_became_peered":"2024-09-17T03:35:36.441801+0000","last_unstale":"2024-09-17T03:35:37.429975+0000","last_undegraded":"2024-09-17T03:35:37.429975+0000","last_fullsized":"2024-09-17T03:35:37.429975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:47.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952163+0000","last_change":"2024-09-17T03:35:32.415099+0000","last_active":"2024-09-17T03:35:37.952163+0000","last_peered":"2024-09-17T03:35:37.952163+0000","last_clean":"2024-09-17T03:35:37.952163+0000","last_became_active":"2024-09-17T03:35:32.414839+0000","last_became_peered":"2024-09-17T03:35:32.414839+0000","last_unstale":"2024-09-17T03:35:37.952163+0000","last_undegraded":"2024-09-17T03:35:37.952163+0000","last_fullsized":"2024-09-17T03:35:37.952163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:28.814349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424280+0000","last_change":"2024-09-17T03:35:31.399644+0000","last_active":"2024-09-17T03:35:37.424280+0000","last_peered":"2024-09-17T03:35:37.424280+0000","last_clean":"2024-09-17T03:35:37.424280+0000","last_became_active":"2024-09-17T03:35:31.398495+0000","last_became_peered":"2024-09-17T03:35:31.398495+0000","last_unstale":"2024-09-17T03:35:37.424280+0000","last_undegraded":"2024-09-17T03:35:37.424280+0000","last_fullsized":"2024-09-17T03:35:37.424280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:43.782608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328458+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:35:38.328458+0000","last_peered":"2024-09-17T03:35:38.328458+0000","last_clean":"2024-09-17T03:35:38.328458+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:35:38.328458+0000","last_undegraded":"2024-09-17T03:35:38.328458+0000","last_fullsized":"2024-09-17T03:35:38.328458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424800+0000","last_change":"2024-09-17T03:35:36.432981+0000","last_active":"2024-09-17T03:35:37.424800+0000","last_peered":"2024-09-17T03:35:37.424800+0000","last_clean":"2024-09-17T03:35:37.424800+0000","last_became_active":"2024-09-17T03:35:36.432550+0000","last_became_peered":"2024-09-17T03:35:36.432550+0000","last_unstale":"2024-09-17T03:35:37.424800+0000","last_undegraded":"2024-09-17T03:35:37.424800+0000","last_fullsized":"2024-09-17T03:35:37.424800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:29.515037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424612+0000","last_change":"2024-09-17T03:35:32.393020+0000","last_active":"2024-09-17T03:35:37.424612+0000","last_peered":"2024-09-17T03:35:37.424612+0000","last_clean":"2024-09-17T03:35:37.424612+0000","last_became_active":"2024-09-17T03:35:32.392509+0000","last_became_peered":"2024-09-17T03:35:32.392509+0000","last_unstale":"2024-09-17T03:35:37.424612+0000","last_undegraded":"2024-09-17T03:35:37.424612+0000","last_fullsized":"2024-09-17T03:35:37.424612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.767440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430467+0000","last_change":"2024-09-17T03:35:31.406748+0000","last_active":"2024-09-17T03:35:37.430467+0000","last_peered":"2024-09-17T03:35:37.430467+0000","last_clean":"2024-09-17T03:35:37.430467+0000","last_became_active":"2024-09-17T03:35:31.406319+0000","last_became_peered":"2024-09-17T03:35:31.406319+0000","last_unstale":"2024-09-17T03:35:37.430467+0000","last_undegraded":"2024-09-17T03:35:37.430467+0000","last_fullsized":"2024-09-17T03:35:37.430467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:24.896063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330083+0000","last_change":"2024-09-17T03:35:36.454141+0000","last_active":"2024-09-17T03:35:38.330083+0000","last_peered":"2024-09-17T03:35:38.330083+0000","last_clean":"2024-09-17T03:35:38.330083+0000","last_became_active":"2024-09-17T03:35:36.452907+0000","last_became_peered":"2024-09-17T03:35:36.452907+0000","last_unstale":"2024-09-17T03:35:38.330083+0000","last_undegraded":"2024-09-17T03:35:38.330083+0000","last_fullsized":"2024-09-17T03:35:38.330083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:48.118603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716957+0000","last_change":"2024-09-17T03:35:32.397883+0000","last_active":"2024-09-17T03:35:37.716957+0000","last_peered":"2024-09-17T03:35:37.716957+0000","last_clean":"2024-09-17T03:35:37.716957+0000","last_became_active":"2024-09-17T03:35:32.395887+0000","last_became_peered":"2024-09-17T03:35:32.395887+0000","last_unstale":"2024-09-17T03:35:37.716957+0000","last_undegraded":"2024-09-17T03:35:37.716957+0000","last_fullsized":"2024-09-17T03:35:37.716957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:07.376850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430343+0000","last_change":"2024-09-17T03:35:31.399882+0000","last_active":"2024-09-17T03:35:37.430343+0000","last_peered":"2024-09-17T03:35:37.430343+0000","last_clean":"2024-09-17T03:35:37.430343+0000","last_became_active":"2024-09-17T03:35:31.399568+0000","last_became_peered":"2024-09-17T03:35:31.399568+0000","last_unstale":"2024-09-17T03:35:37.430343+0000","last_undegraded":"2024-09-17T03:35:37.430343+0000","last_fullsized":"2024-09-17T03:35:37.430343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:16.036571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428981+0000","last_change":"2024-09-17T03:35:36.435798+0000","last_active":"2024-09-17T03:35:37.428981+0000","last_peered":"2024-09-17T03:35:37.428981+0000","last_clean":"2024-09-17T03:35:37.428981+0000","last_became_active":"2024-09-17T03:35:36.434964+0000","last_became_peered":"2024-09-17T03:35:36.434964+0000","last_unstale":"2024-09-17T03:35:37.428981+0000","last_undegraded":"2024-09-17T03:35:37.428981+0000","last_fullsized":"2024-09-17T03:35:37.428981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:55.456589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716617+0000","last_change":"2024-09-17T03:35:32.401068+0000","last_active":"2024-09-17T03:35:37.716617+0000","last_peered":"2024-09-17T03:35:37.716617+0000","last_clean":"2024-09-17T03:35:37.716617+0000","last_became_active":"2024-09-17T03:35:32.400787+0000","last_became_peered":"2024-09-17T03:35:32.400787+0000","last_unstale":"2024-09-17T03:35:37.716617+0000","last_undegraded":"2024-09-17T03:35:37.716617+0000","last_fullsized":"2024-09-17T03:35:37.716617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952776+0000","last_change":"2024-09-17T03:35:31.400243+0000","last_active":"2024-09-17T03:35:37.952776+0000","last_peered":"2024-09-17T03:35:37.952776+0000","last_clean":"2024-09-17T03:35:37.952776+0000","last_became_active":"2024-09-17T03:35:31.399896+0000","last_became_peered":"2024-09-17T03:35:31.399896+0000","last_unstale":"2024-09-17T03:35:37.952776+0000","last_undegraded":"2024-09-17T03:35:37.952776+0000","last_fullsized":"2024-09-17T03:35:37.952776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:05.368297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423725+0000","last_change":"2024-09-17T03:35:36.433676+0000","last_active":"2024-09-17T03:35:37.423725+0000","last_peered":"2024-09-17T03:35:37.423725+0000","last_clean":"2024-09-17T03:35:37.423725+0000","last_became_active":"2024-09-17T03:35:36.431277+0000","last_became_peered":"2024-09-17T03:35:36.431277+0000","last_unstale":"2024-09-17T03:35:37.423725+0000","last_undegraded":"2024-09-17T03:35:37.423725+0000","last_fullsized":"2024-09-17T03:35:37.423725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.696472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329516+0000","last_change":"2024-09-17T03:35:32.412184+0000","last_active":"2024-09-17T03:35:38.329516+0000","last_peered":"2024-09-17T03:35:38.329516+0000","last_clean":"2024-09-17T03:35:38.329516+0000","last_became_active":"2024-09-17T03:35:32.411602+0000","last_became_peered":"2024-09-17T03:35:32.411602+0000","last_unstale":"2024-09-17T03:35:38.329516+0000","last_undegraded":"2024-09-17T03:35:38.329516+0000","last_fullsized":"2024-09-17T03:35:38.329516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:41.794850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716873+0000","last_change":"2024-09-17T03:35:31.405777+0000","last_active":"2024-09-17T03:35:37.716873+0000","last_peered":"2024-09-17T03:35:37.716873+0000","last_clean":"2024-09-17T03:35:37.716873+0000","last_became_active":"2024-09-17T03:35:31.400954+0000","last_became_peered":"2024-09-17T03:35:31.400954+0000","last_unstale":"2024-09-17T03:35:37.716873+0000","last_undegraded":"2024-09-17T03:35:37.716873+0000","last_fullsized":"2024-09-17T03:35:37.716873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:50.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328929+0000","last_change":"2024-09-17T03:35:36.442849+0000","last_active":"2024-09-17T03:35:38.328929+0000","last_peered":"2024-09-17T03:35:38.328929+0000","last_clean":"2024-09-17T03:35:38.328929+0000","last_became_active":"2024-09-17T03:35:36.442373+0000","last_became_peered":"2024-09-17T03:35:36.442373+0000","last_unstale":"2024-09-17T03:35:38.328929+0000","last_undegraded":"2024-09-17T03:35:38.328929+0000","last_fullsized":"2024-09-17T03:35:38.328929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:31.462450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423856+0000","last_change":"2024-09-17T03:35:32.421334+0000","last_active":"2024-09-17T03:35:37.423856+0000","last_peered":"2024-09-17T03:35:37.423856+0000","last_clean":"2024-09-17T03:35:37.423856+0000","last_became_active":"2024-09-17T03:35:32.417735+0000","last_became_peered":"2024-09-17T03:35:32.417735+0000","last_unstale":"2024-09-17T03:35:37.423856+0000","last_undegraded":"2024-09-17T03:35:37.423856+0000","last_fullsized":"2024-09-17T03:35:37.423856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:38.772375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952012+0000","last_change":"2024-09-17T03:35:31.393984+0000","last_active":"2024-09-17T03:35:37.952012+0000","last_peered":"2024-09-17T03:35:37.952012+0000","last_clean":"2024-09-17T03:35:37.952012+0000","last_became_active":"2024-09-17T03:35:31.393359+0000","last_became_peered":"2024-09-17T03:35:31.393359+0000","last_unstale":"2024-09-17T03:35:37.952012+0000","last_undegraded":"2024-09-17T03:35:37.952012+0000","last_fullsized":"2024-09-17T03:35:37.952012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:29.238819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430527+0000","last_change":"2024-09-17T03:35:36.446882+0000","last_active":"2024-09-17T03:35:37.430527+0000","last_peered":"2024-09-17T03:35:37.430527+0000","last_clean":"2024-09-17T03:35:37.430527+0000","last_became_active":"2024-09-17T03:35:36.445788+0000","last_became_peered":"2024-09-17T03:35:36.445788+0000","last_unstale":"2024-09-17T03:35:37.430527+0000","last_undegraded":"2024-09-17T03:35:37.430527+0000","last_fullsized":"2024-09-17T03:35:37.430527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:46.475925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328438+0000","last_change":"2024-09-17T03:35:32.402001+0000","last_active":"2024-09-17T03:35:38.328438+0000","last_peered":"2024-09-17T03:35:38.328438+0000","last_clean":"2024-09-17T03:35:38.328438+0000","last_became_active":"2024-09-17T03:35:32.401658+0000","last_became_peered":"2024-09-17T03:35:32.401658+0000","last_unstale":"2024-09-17T03:35:38.328438+0000","last_undegraded":"2024-09-17T03:35:38.328438+0000","last_fullsized":"2024-09-17T03:35:38.328438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:51.388149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716519+0000","last_change":"2024-09-17T03:35:31.400527+0000","last_active":"2024-09-17T03:35:37.716519+0000","last_peered":"2024-09-17T03:35:37.716519+0000","last_clean":"2024-09-17T03:35:37.716519+0000","last_became_active":"2024-09-17T03:35:31.399807+0000","last_became_peered":"2024-09-17T03:35:31.399807+0000","last_unstale":"2024-09-17T03:35:37.716519+0000","last_undegraded":"2024-09-17T03:35:37.716519+0000","last_fullsized":"2024-09-17T03:35:37.716519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.431087+0000","last_change":"2024-09-17T03:35:36.449338+0000","last_active":"2024-09-17T03:35:37.431087+0000","last_peered":"2024-09-17T03:35:37.431087+0000","last_clean":"2024-09-17T03:35:37.431087+0000","last_became_active":"2024-09-17T03:35:36.448829+0000","last_became_peered":"2024-09-17T03:35:36.448829+0000","last_unstale":"2024-09-17T03:35:37.431087+0000","last_undegraded":"2024-09-17T03:35:37.431087+0000","last_fullsized":"2024-09-17T03:35:37.431087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:30.201889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423978+0000","last_change":"2024-09-17T03:35:32.415025+0000","last_active":"2024-09-17T03:35:37.423978+0000","last_peered":"2024-09-17T03:35:37.423978+0000","last_clean":"2024-09-17T03:35:37.423978+0000","last_became_active":"2024-09-17T03:35:32.399484+0000","last_became_peered":"2024-09-17T03:35:32.399484+0000","last_unstale":"2024-09-17T03:35:37.423978+0000","last_undegraded":"2024-09-17T03:35:37.423978+0000","last_fullsized":"2024-09-17T03:35:37.423978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:06.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424580+0000","last_change":"2024-09-17T03:35:31.393032+0000","last_active":"2024-09-17T03:35:37.424580+0000","last_peered":"2024-09-17T03:35:37.424580+0000","last_clean":"2024-09-17T03:35:37.424580+0000","last_became_active":"2024-09-17T03:35:31.392712+0000","last_became_peered":"2024-09-17T03:35:31.392712+0000","last_unstale":"2024-09-17T03:35:37.424580+0000","last_undegraded":"2024-09-17T03:35:37.424580+0000","last_fullsized":"2024-09-17T03:35:37.424580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:39.717069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430060+0000","last_change":"2024-09-17T03:35:36.448065+0000","last_active":"2024-09-17T03:35:37.430060+0000","last_peered":"2024-09-17T03:35:37.430060+0000","last_clean":"2024-09-17T03:35:37.430060+0000","last_became_active":"2024-09-17T03:35:36.440858+0000","last_became_peered":"2024-09-17T03:35:36.440858+0000","last_unstale":"2024-09-17T03:35:37.430060+0000","last_undegraded":"2024-09-17T03:35:37.430060+0000","last_fullsized":"2024-09-17T03:35:37.430060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.791341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429471+0000","last_change":"2024-09-17T03:35:32.406664+0000","last_active":"2024-09-17T03:35:37.429471+0000","last_peered":"2024-09-17T03:35:37.429471+0000","last_clean":"2024-09-17T03:35:37.429471+0000","last_became_active":"2024-09-17T03:35:32.406094+0000","last_became_peered":"2024-09-17T03:35:32.406094+0000","last_unstale":"2024-09-17T03:35:37.429471+0000","last_undegraded":"2024-09-17T03:35:37.429471+0000","last_fullsized":"2024-09-17T03:35:37.429471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:58.630384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329699+0000","last_change":"2024-09-17T03:35:31.403376+0000","last_active":"2024-09-17T03:35:38.329699+0000","last_peered":"2024-09-17T03:35:38.329699+0000","last_clean":"2024-09-17T03:35:38.329699+0000","last_became_active":"2024-09-17T03:35:31.402949+0000","last_became_peered":"2024-09-17T03:35:31.402949+0000","last_unstale":"2024-09-17T03:35:38.329699+0000","last_undegraded":"2024-09-17T03:35:38.329699+0000","last_fullsized":"2024-09-17T03:35:38.329699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:18.331525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424293+0000","last_change":"2024-09-17T03:35:36.436078+0000","last_active":"2024-09-17T03:35:37.424293+0000","last_peered":"2024-09-17T03:35:37.424293+0000","last_clean":"2024-09-17T03:35:37.424293+0000","last_became_active":"2024-09-17T03:35:36.435669+0000","last_became_peered":"2024-09-17T03:35:36.435669+0000","last_unstale":"2024-09-17T03:35:37.424293+0000","last_undegraded":"2024-09-17T03:35:37.424293+0000","last_fullsized":"2024-09-17T03:35:37.424293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:07.115777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716542+0000","last_change":"2024-09-17T03:35:32.402486+0000","last_active":"2024-09-17T03:35:37.716542+0000","last_peered":"2024-09-17T03:35:37.716542+0000","last_clean":"2024-09-17T03:35:37.716542+0000","last_became_active":"2024-09-17T03:35:32.402185+0000","last_became_peered":"2024-09-17T03:35:32.402185+0000","last_unstale":"2024-09-17T03:35:37.716542+0000","last_undegraded":"2024-09-17T03:35:37.716542+0000","last_fullsized":"2024-09-17T03:35:37.716542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:38.772375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:45.296364+0000","last_change":"2024-09-17T03:35:31.400849+0000","last_active":"2024-09-17T03:35:45.296364+0000","last_peered":"2024-09-17T03:35:45.296364+0000","last_clean":"2024-09-17T03:35:45.296364+0000","last_became_active":"2024-09-17T03:35:31.399182+0000","last_became_peered":"2024-09-17T03:35:31.399182+0000","last_unstale":"2024-09-17T03:35:45.296364+0000","last_undegraded":"2024-09-17T03:35:45.296364+0000","last_fullsized":"2024-09-17T03:35:45.296364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:48.258646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952056+0000","last_change":"2024-09-17T03:35:36.433789+0000","last_active":"2024-09-17T03:35:37.952056+0000","last_peered":"2024-09-17T03:35:37.952056+0000","last_clean":"2024-09-17T03:35:37.952056+0000","last_became_active":"2024-09-17T03:35:36.433154+0000","last_became_peered":"2024-09-17T03:35:36.433154+0000","last_unstale":"2024-09-17T03:35:37.952056+0000","last_undegraded":"2024-09-17T03:35:37.952056+0000","last_fullsized":"2024-09-17T03:35:37.952056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:25.543856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424094+0000","last_change":"2024-09-17T03:35:32.400635+0000","last_active":"2024-09-17T03:35:37.424094+0000","last_peered":"2024-09-17T03:35:37.424094+0000","last_clean":"2024-09-17T03:35:37.424094+0000","last_became_active":"2024-09-17T03:35:32.393225+0000","last_became_peered":"2024-09-17T03:35:32.393225+0000","last_unstale":"2024-09-17T03:35:37.424094+0000","last_undegraded":"2024-09-17T03:35:37.424094+0000","last_fullsized":"2024-09-17T03:35:37.424094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:08.018673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329974+0000","last_change":"2024-09-17T03:35:31.391917+0000","last_active":"2024-09-17T03:35:38.329974+0000","last_peered":"2024-09-17T03:35:38.329974+0000","last_clean":"2024-09-17T03:35:38.329974+0000","last_became_active":"2024-09-17T03:35:31.390310+0000","last_became_peered":"2024-09-17T03:35:31.390310+0000","last_unstale":"2024-09-17T03:35:38.329974+0000","last_undegraded":"2024-09-17T03:35:38.329974+0000","last_fullsized":"2024-09-17T03:35:38.329974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329447+0000","last_change":"2024-09-17T03:35:36.452480+0000","last_active":"2024-09-17T03:35:38.329447+0000","last_peered":"2024-09-17T03:35:38.329447+0000","last_clean":"2024-09-17T03:35:38.329447+0000","last_became_active":"2024-09-17T03:35:36.452057+0000","last_became_peered":"2024-09-17T03:35:36.452057+0000","last_unstale":"2024-09-17T03:35:38.329447+0000","last_undegraded":"2024-09-17T03:35:38.329447+0000","last_fullsized":"2024-09-17T03:35:38.329447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:02.864287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.431137+0000","last_change":"2024-09-17T03:35:32.420703+0000","last_active":"2024-09-17T03:35:37.431137+0000","last_peered":"2024-09-17T03:35:37.431137+0000","last_clean":"2024-09-17T03:35:37.431137+0000","last_became_active":"2024-09-17T03:35:32.420467+0000","last_became_peered":"2024-09-17T03:35:32.420467+0000","last_unstale":"2024-09-17T03:35:37.431137+0000","last_undegraded":"2024-09-17T03:35:37.431137+0000","last_fullsized":"2024-09-17T03:35:37.431137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:08.429869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716577+0000","last_change":"2024-09-17T03:35:31.407562+0000","last_active":"2024-09-17T03:35:37.716577+0000","last_peered":"2024-09-17T03:35:37.716577+0000","last_clean":"2024-09-17T03:35:37.716577+0000","last_became_active":"2024-09-17T03:35:31.405639+0000","last_became_peered":"2024-09-17T03:35:31.405639+0000","last_unstale":"2024-09-17T03:35:37.716577+0000","last_undegraded":"2024-09-17T03:35:37.716577+0000","last_fullsized":"2024-09-17T03:35:37.716577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:16.036571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329103+0000","last_change":"2024-09-17T03:35:36.457602+0000","last_active":"2024-09-17T03:35:38.329103+0000","last_peered":"2024-09-17T03:35:38.329103+0000","last_clean":"2024-09-17T03:35:38.329103+0000","last_became_active":"2024-09-17T03:35:36.455212+0000","last_became_peered":"2024-09-17T03:35:36.455212+0000","last_unstale":"2024-09-17T03:35:38.329103+0000","last_undegraded":"2024-09-17T03:35:38.329103+0000","last_fullsized":"2024-09-17T03:35:38.329103+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:07.594543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329415+0000","last_change":"2024-09-17T03:35:32.407130+0000","last_active":"2024-09-17T03:35:38.329415+0000","last_peered":"2024-09-17T03:35:38.329415+0000","last_clean":"2024-09-17T03:35:38.329415+0000","last_became_active":"2024-09-17T03:35:32.391848+0000","last_became_peered":"2024-09-17T03:35:32.391848+0000","last_unstale":"2024-09-17T03:35:38.329415+0000","last_undegraded":"2024-09-17T03:35:38.329415+0000","last_fullsized":"2024-09-17T03:35:38.329415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:08.067720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329651+0000","last_change":"2024-09-17T03:35:31.390094+0000","last_active":"2024-09-17T03:35:38.329651+0000","last_peered":"2024-09-17T03:35:38.329651+0000","last_clean":"2024-09-17T03:35:38.329651+0000","last_became_active":"2024-09-17T03:35:31.389803+0000","last_became_peered":"2024-09-17T03:35:31.389803+0000","last_unstale":"2024-09-17T03:35:38.329651+0000","last_undegraded":"2024-09-17T03:35:38.329651+0000","last_fullsized":"2024-09-17T03:35:38.329651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952214+0000","last_change":"2024-09-17T03:35:36.437757+0000","last_active":"2024-09-17T03:35:37.952214+0000","last_peered":"2024-09-17T03:35:37.952214+0000","last_clean":"2024-09-17T03:35:37.952214+0000","last_became_active":"2024-09-17T03:35:36.435609+0000","last_became_peered":"2024-09-17T03:35:36.435609+0000","last_unstale":"2024-09-17T03:35:37.952214+0000","last_undegraded":"2024-09-17T03:35:37.952214+0000","last_fullsized":"2024-09-17T03:35:37.952214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:09.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952718+0000","last_change":"2024-09-17T03:35:36.442334+0000","last_active":"2024-09-17T03:35:37.952718+0000","last_peered":"2024-09-17T03:35:37.952718+0000","last_clean":"2024-09-17T03:35:37.952718+0000","last_became_active":"2024-09-17T03:35:36.441896+0000","last_became_peered":"2024-09-17T03:35:36.441896+0000","last_unstale":"2024-09-17T03:35:37.952718+0000","last_undegraded":"2024-09-17T03:35:37.952718+0000","last_fullsized":"2024-09-17T03:35:37.952718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:22.644001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952084+0000","last_change":"2024-09-17T03:35:32.403467+0000","last_active":"2024-09-17T03:35:37.952084+0000","last_peered":"2024-09-17T03:35:37.952084+0000","last_clean":"2024-09-17T03:35:37.952084+0000","last_became_active":"2024-09-17T03:35:32.403114+0000","last_became_peered":"2024-09-17T03:35:32.403114+0000","last_unstale":"2024-09-17T03:35:37.952084+0000","last_undegraded":"2024-09-17T03:35:37.952084+0000","last_fullsized":"2024-09-17T03:35:37.952084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:55.954409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424195+0000","last_change":"2024-09-17T03:35:31.404636+0000","last_active":"2024-09-17T03:35:37.424195+0000","last_peered":"2024-09-17T03:35:37.424195+0000","last_clean":"2024-09-17T03:35:37.424195+0000","last_became_active":"2024-09-17T03:35:31.404277+0000","last_became_peered":"2024-09-17T03:35:31.404277+0000","last_unstale":"2024-09-17T03:35:37.424195+0000","last_undegraded":"2024-09-17T03:35:37.424195+0000","last_fullsized":"2024-09-17T03:35:37.424195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:40.786182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424417+0000","last_change":"2024-09-17T03:35:36.433455+0000","last_active":"2024-09-17T03:35:37.424417+0000","last_peered":"2024-09-17T03:35:37.424417+0000","last_clean":"2024-09-17T03:35:37.424417+0000","last_became_active":"2024-09-17T03:35:36.433005+0000","last_became_peered":"2024-09-17T03:35:36.433005+0000","last_unstale":"2024-09-17T03:35:37.424417+0000","last_undegraded":"2024-09-17T03:35:37.424417+0000","last_fullsized":"2024-09-17T03:35:37.424417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:02.604817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428484+0000","last_change":"2024-09-17T03:35:32.399932+0000","last_active":"2024-09-17T03:35:37.428484+0000","last_peered":"2024-09-17T03:35:37.428484+0000","last_clean":"2024-09-17T03:35:37.428484+0000","last_became_active":"2024-09-17T03:35:32.399566+0000","last_became_peered":"2024-09-17T03:35:32.399566+0000","last_unstale":"2024-09-17T03:35:37.428484+0000","last_undegraded":"2024-09-17T03:35:37.428484+0000","last_fullsized":"2024-09-17T03:35:37.428484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:32.277026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428581+0000","last_change":"2024-09-17T03:35:31.407319+0000","last_active":"2024-09-17T03:35:37.428581+0000","last_peered":"2024-09-17T03:35:37.428581+0000","last_clean":"2024-09-17T03:35:37.428581+0000","last_became_active":"2024-09-17T03:35:31.407022+0000","last_became_peered":"2024-09-17T03:35:31.407022+0000","last_unstale":"2024-09-17T03:35:37.428581+0000","last_undegraded":"2024-09-17T03:35:37.428581+0000","last_fullsized":"2024-09-17T03:35:37.428581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:18.331525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424464+0000","last_change":"2024-09-17T03:35:31.408471+0000","last_active":"2024-09-17T03:35:37.424464+0000","last_peered":"2024-09-17T03:35:37.424464+0000","last_clean":"2024-09-17T03:35:37.424464+0000","last_became_active":"2024-09-17T03:35:31.408242+0000","last_became_peered":"2024-09-17T03:35:31.408242+0000","last_unstale":"2024-09-17T03:35:37.424464+0000","last_undegraded":"2024-09-17T03:35:37.424464+0000","last_fullsized":"2024-09-17T03:35:37.424464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:48.043675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952411+0000","last_change":"2024-09-17T03:35:32.402827+0000","last_active":"2024-09-17T03:35:37.952411+0000","last_peered":"2024-09-17T03:35:37.952411+0000","last_clean":"2024-09-17T03:35:37.952411+0000","last_became_active":"2024-09-17T03:35:32.402121+0000","last_became_peered":"2024-09-17T03:35:32.402121+0000","last_unstale":"2024-09-17T03:35:37.952411+0000","last_undegraded":"2024-09-17T03:35:37.952411+0000","last_fullsized":"2024-09-17T03:35:37.952411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:20.996960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952548+0000","last_change":"2024-09-17T03:35:36.438086+0000","last_active":"2024-09-17T03:35:37.952548+0000","last_peered":"2024-09-17T03:35:37.952548+0000","last_clean":"2024-09-17T03:35:37.952548+0000","last_became_active":"2024-09-17T03:35:36.437628+0000","last_became_peered":"2024-09-17T03:35:36.437628+0000","last_unstale":"2024-09-17T03:35:37.952548+0000","last_undegraded":"2024-09-17T03:35:37.952548+0000","last_fullsized":"2024-09-17T03:35:37.952548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:41.129499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429911+0000","last_change":"2024-09-17T03:35:31.400851+0000","last_active":"2024-09-17T03:35:37.429911+0000","last_peered":"2024-09-17T03:35:37.429911+0000","last_clean":"2024-09-17T03:35:37.429911+0000","last_became_active":"2024-09-17T03:35:31.400467+0000","last_became_peered":"2024-09-17T03:35:31.400467+0000","last_unstale":"2024-09-17T03:35:37.429911+0000","last_undegraded":"2024-09-17T03:35:37.429911+0000","last_fullsized":"2024-09-17T03:35:37.429911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:34.200886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328979+0000","last_change":"2024-09-17T03:35:32.415316+0000","last_active":"2024-09-17T03:35:38.328979+0000","last_peered":"2024-09-17T03:35:38.328979+0000","last_clean":"2024-09-17T03:35:38.328979+0000","last_became_active":"2024-09-17T03:35:32.415012+0000","last_became_peered":"2024-09-17T03:35:32.415012+0000","last_unstale":"2024-09-17T03:35:38.328979+0000","last_undegraded":"2024-09-17T03:35:38.328979+0000","last_fullsized":"2024-09-17T03:35:38.328979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:49.052343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329826+0000","last_change":"2024-09-17T03:35:36.458591+0000","last_active":"2024-09-17T03:35:38.329826+0000","last_peered":"2024-09-17T03:35:38.329826+0000","last_clean":"2024-09-17T03:35:38.329826+0000","last_became_active":"2024-09-17T03:35:36.458192+0000","last_became_peered":"2024-09-17T03:35:36.458192+0000","last_unstale":"2024-09-17T03:35:38.329826+0000","last_undegraded":"2024-09-17T03:35:38.329826+0000","last_fullsized":"2024-09-17T03:35:38.329826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:28.725625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328670+0000","last_change":"2024-09-17T03:35:32.389432+0000","last_active":"2024-09-17T03:35:38.328670+0000","last_peered":"2024-09-17T03:35:38.328670+0000","last_clean":"2024-09-17T03:35:38.328670+0000","last_became_active":"2024-09-17T03:35:32.389081+0000","last_became_peered":"2024-09-17T03:35:32.389081+0000","last_unstale":"2024-09-17T03:35:38.328670+0000","last_undegraded":"2024-09-17T03:35:38.328670+0000","last_fullsized":"2024-09-17T03:35:38.328670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:13.264493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329236+0000","last_change":"2024-09-17T03:35:32.390231+0000","last_active":"2024-09-17T03:35:38.329236+0000","last_peered":"2024-09-17T03:35:38.329236+0000","last_clean":"2024-09-17T03:35:38.329236+0000","last_became_active":"2024-09-17T03:35:32.389090+0000","last_became_peered":"2024-09-17T03:35:32.389090+0000","last_unstale":"2024-09-17T03:35:38.329236+0000","last_undegraded":"2024-09-17T03:35:38.329236+0000","last_fullsized":"2024-09-17T03:35:38.329236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:51.388149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423992+0000","last_change":"2024-09-17T03:35:32.417536+0000","last_active":"2024-09-17T03:35:37.423992+0000","last_peered":"2024-09-17T03:35:37.423992+0000","last_clean":"2024-09-17T03:35:37.423992+0000","last_became_active":"2024-09-17T03:35:32.415503+0000","last_became_peered":"2024-09-17T03:35:32.415503+0000","last_unstale":"2024-09-17T03:35:37.423992+0000","last_undegraded":"2024-09-17T03:35:37.423992+0000","last_fullsized":"2024-09-17T03:35:37.423992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:53.931551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429727+0000","last_change":"2024-09-17T03:35:32.417567+0000","last_active":"2024-09-17T03:35:37.429727+0000","last_peered":"2024-09-17T03:35:37.429727+0000","last_clean":"2024-09-17T03:35:37.429727+0000","last_became_active":"2024-09-17T03:35:32.416075+0000","last_became_peered":"2024-09-17T03:35:32.416075+0000","last_unstale":"2024-09-17T03:35:37.429727+0000","last_undegraded":"2024-09-17T03:35:37.429727+0000","last_fullsized":"2024-09-17T03:35:37.429727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:17.725156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430354+0000","last_change":"2024-09-17T03:35:32.398186+0000","last_active":"2024-09-17T03:35:37.430354+0000","last_peered":"2024-09-17T03:35:37.430354+0000","last_clean":"2024-09-17T03:35:37.430354+0000","last_became_active":"2024-09-17T03:35:32.397332+0000","last_became_peered":"2024-09-17T03:35:32.397332+0000","last_unstale":"2024-09-17T03:35:37.430354+0000","last_undegraded":"2024-09-17T03:35:37.430354+0000","last_fullsized":"2024-09-17T03:35:37.430354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:24.688946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429638+0000","last_change":"2024-09-17T03:35:32.398824+0000","last_active":"2024-09-17T03:35:37.429638+0000","last_peered":"2024-09-17T03:35:37.429638+0000","last_clean":"2024-09-17T03:35:37.429638+0000","last_became_active":"2024-09-17T03:35:32.398561+0000","last_became_peered":"2024-09-17T03:35:32.398561+0000","last_unstale":"2024-09-17T03:35:37.429638+0000","last_undegraded":"2024-09-17T03:35:37.429638+0000","last_fullsized":"2024-09-17T03:35:37.429638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:21.967856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329314+0000","last_change":"2024-09-17T03:35:32.407437+0000","last_active":"2024-09-17T03:35:38.329314+0000","last_peered":"2024-09-17T03:35:38.329314+0000","last_clean":"2024-09-17T03:35:38.329314+0000","last_became_active":"2024-09-17T03:35:32.391983+0000","last_became_peered":"2024-09-17T03:35:32.391983+0000","last_unstale":"2024-09-17T03:35:38.329314+0000","last_undegraded":"2024-09-17T03:35:38.329314+0000","last_fullsized":"2024-09-17T03:35:38.329314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:55.435612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430853+0000","last_change":"2024-09-17T03:35:32.420028+0000","last_active":"2024-09-17T03:35:37.430853+0000","last_peered":"2024-09-17T03:35:37.430853+0000","last_clean":"2024-09-17T03:35:37.430853+0000","last_became_active":"2024-09-17T03:35:32.419318+0000","last_became_peered":"2024-09-17T03:35:32.419318+0000","last_unstale":"2024-09-17T03:35:37.430853+0000","last_undegraded":"2024-09-17T03:35:37.430853+0000","last_fullsized":"2024-09-17T03:35:37.430853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:34.754662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423939+0000","last_change":"2024-09-17T03:35:32.404124+0000","last_active":"2024-09-17T03:35:37.423939+0000","last_peered":"2024-09-17T03:35:37.423939+0000","last_clean":"2024-09-17T03:35:37.423939+0000","last_became_active":"2024-09-17T03:35:32.401565+0000","last_became_peered":"2024-09-17T03:35:32.401565+0000","last_unstale":"2024-09-17T03:35:37.423939+0000","last_undegraded":"2024-09-17T03:35:37.423939+0000","last_fullsized":"2024-09-17T03:35:37.423939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428668+0000","last_change":"2024-09-17T03:35:32.416911+0000","last_active":"2024-09-17T03:35:37.428668+0000","last_peered":"2024-09-17T03:35:37.428668+0000","last_clean":"2024-09-17T03:35:37.428668+0000","last_became_active":"2024-09-17T03:35:32.416607+0000","last_became_peered":"2024-09-17T03:35:32.416607+0000","last_unstale":"2024-09-17T03:35:37.428668+0000","last_undegraded":"2024-09-17T03:35:37.428668+0000","last_fullsized":"2024-09-17T03:35:37.428668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:35.823308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328868+0000","last_change":"2024-09-17T03:35:32.402977+0000","last_active":"2024-09-17T03:35:38.328868+0000","last_peered":"2024-09-17T03:35:38.328868+0000","last_clean":"2024-09-17T03:35:38.328868+0000","last_became_active":"2024-09-17T03:35:32.400089+0000","last_became_peered":"2024-09-17T03:35:32.400089+0000","last_unstale":"2024-09-17T03:35:38.328868+0000","last_undegraded":"2024-09-17T03:35:38.328868+0000","last_fullsized":"2024-09-17T03:35:38.328868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:09.595197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952307+0000","last_change":"2024-09-17T03:35:32.410415+0000","last_active":"2024-09-17T03:35:37.952307+0000","last_peered":"2024-09-17T03:35:37.952307+0000","last_clean":"2024-09-17T03:35:37.952307+0000","last_became_active":"2024-09-17T03:35:32.410050+0000","last_became_peered":"2024-09-17T03:35:32.410050+0000","last_unstale":"2024-09-17T03:35:37.952307+0000","last_undegraded":"2024-09-17T03:35:37.952307+0000","last_fullsized":"2024-09-17T03:35:37.952307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:50.438068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716881+0000","last_change":"2024-09-17T03:35:32.395551+0000","last_active":"2024-09-17T03:35:37.716881+0000","last_peered":"2024-09-17T03:35:37.716881+0000","last_clean":"2024-09-17T03:35:37.716881+0000","last_became_active":"2024-09-17T03:35:32.395266+0000","last_became_peered":"2024-09-17T03:35:32.395266+0000","last_unstale":"2024-09-17T03:35:37.716881+0000","last_undegraded":"2024-09-17T03:35:37.716881+0000","last_fullsized":"2024-09-17T03:35:37.716881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:54.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424777+0000","last_change":"2024-09-17T03:35:32.406349+0000","last_active":"2024-09-17T03:35:37.424777+0000","last_peered":"2024-09-17T03:35:37.424777+0000","last_clean":"2024-09-17T03:35:37.424777+0000","last_became_active":"2024-09-17T03:35:32.406083+0000","last_became_peered":"2024-09-17T03:35:32.406083+0000","last_unstale":"2024-09-17T03:35:37.424777+0000","last_undegraded":"2024-09-17T03:35:37.424777+0000","last_fullsized":"2024-09-17T03:35:37.424777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:28.801756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330010+0000","last_change":"2024-09-17T03:35:32.412025+0000","last_active":"2024-09-17T03:35:38.330010+0000","last_peered":"2024-09-17T03:35:38.330010+0000","last_clean":"2024-09-17T03:35:38.330010+0000","last_became_active":"2024-09-17T03:35:32.411770+0000","last_became_peered":"2024-09-17T03:35:32.411770+0000","last_unstale":"2024-09-17T03:35:38.330010+0000","last_undegraded":"2024-09-17T03:35:38.330010+0000","last_fullsized":"2024-09-17T03:35:38.330010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.040918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424666+0000","last_change":"2024-09-17T03:35:32.405664+0000","last_active":"2024-09-17T03:35:37.424666+0000","last_peered":"2024-09-17T03:35:37.424666+0000","last_clean":"2024-09-17T03:35:37.424666+0000","last_became_active":"2024-09-17T03:35:32.401871+0000","last_became_peered":"2024-09-17T03:35:32.401871+0000","last_unstale":"2024-09-17T03:35:37.424666+0000","last_undegraded":"2024-09-17T03:35:37.424666+0000","last_fullsized":"2024-09-17T03:35:37.424666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:11.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423851+0000","last_change":"2024-09-17T03:35:32.421664+0000","last_active":"2024-09-17T03:35:37.423851+0000","last_peered":"2024-09-17T03:35:37.423851+0000","last_clean":"2024-09-17T03:35:37.423851+0000","last_became_active":"2024-09-17T03:35:32.416736+0000","last_became_peered":"2024-09-17T03:35:32.416736+0000","last_unstale":"2024-09-17T03:35:37.423851+0000","last_undegraded":"2024-09-17T03:35:37.423851+0000","last_fullsized":"2024-09-17T03:35:37.423851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:42.709250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428434+0000","last_change":"2024-09-17T03:35:32.401461+0000","last_active":"2024-09-17T03:35:37.428434+0000","last_peered":"2024-09-17T03:35:37.428434+0000","last_clean":"2024-09-17T03:35:37.428434+0000","last_became_active":"2024-09-17T03:35:32.400913+0000","last_became_peered":"2024-09-17T03:35:32.400913+0000","last_unstale":"2024-09-17T03:35:37.428434+0000","last_undegraded":"2024-09-17T03:35:37.428434+0000","last_fullsized":"2024-09-17T03:35:37.428434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:50.140695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428853+0000","last_change":"2024-09-17T03:35:32.388327+0000","last_active":"2024-09-17T03:35:37.428853+0000","last_peered":"2024-09-17T03:35:37.428853+0000","last_clean":"2024-09-17T03:35:37.428853+0000","last_became_active":"2024-09-17T03:35:32.387938+0000","last_became_peered":"2024-09-17T03:35:32.387938+0000","last_unstale":"2024-09-17T03:35:37.428853+0000","last_undegraded":"2024-09-17T03:35:37.428853+0000","last_fullsized":"2024-09-17T03:35:37.428853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:08.067720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430492+0000","last_change":"2024-09-17T03:35:32.397331+0000","last_active":"2024-09-17T03:35:37.430492+0000","last_peered":"2024-09-17T03:35:37.430492+0000","last_clean":"2024-09-17T03:35:37.430492+0000","last_became_active":"2024-09-17T03:35:32.395724+0000","last_became_peered":"2024-09-17T03:35:32.395724+0000","last_unstale":"2024-09-17T03:35:37.430492+0000","last_undegraded":"2024-09-17T03:35:37.430492+0000","last_fullsized":"2024-09-17T03:35:37.430492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:41.794850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716601+0000","last_change":"2024-09-17T03:35:32.395931+0000","last_active":"2024-09-17T03:35:37.716601+0000","last_peered":"2024-09-17T03:35:37.716601+0000","last_clean":"2024-09-17T03:35:37.716601+0000","last_became_active":"2024-09-17T03:35:32.395572+0000","last_became_peered":"2024-09-17T03:35:32.395572+0000","last_unstale":"2024-09-17T03:35:37.716601+0000","last_undegraded":"2024-09-17T03:35:37.716601+0000","last_fullsized":"2024-09-17T03:35:37.716601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:50.658760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716469+0000","last_change":"2024-09-17T03:35:32.398836+0000","last_active":"2024-09-17T03:35:37.716469+0000","last_peered":"2024-09-17T03:35:37.716469+0000","last_clean":"2024-09-17T03:35:37.716469+0000","last_became_active":"2024-09-17T03:35:32.398500+0000","last_became_peered":"2024-09-17T03:35:32.398500+0000","last_unstale":"2024-09-17T03:35:37.716469+0000","last_undegraded":"2024-09-17T03:35:37.716469+0000","last_fullsized":"2024-09-17T03:35:37.716469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:49.687153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716483+0000","last_change":"2024-09-17T03:35:32.414484+0000","last_active":"2024-09-17T03:35:37.716483+0000","last_peered":"2024-09-17T03:35:37.716483+0000","last_clean":"2024-09-17T03:35:37.716483+0000","last_became_active":"2024-09-17T03:35:32.414165+0000","last_became_peered":"2024-09-17T03:35:32.414165+0000","last_unstale":"2024-09-17T03:35:37.716483+0000","last_undegraded":"2024-09-17T03:35:37.716483+0000","last_fullsized":"2024-09-17T03:35:37.716483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:06.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329649+0000","last_change":"2024-09-17T03:35:32.396020+0000","last_active":"2024-09-17T03:35:38.329649+0000","last_peered":"2024-09-17T03:35:38.329649+0000","last_clean":"2024-09-17T03:35:38.329649+0000","last_became_active":"2024-09-17T03:35:32.395701+0000","last_became_peered":"2024-09-17T03:35:32.395701+0000","last_unstale":"2024-09-17T03:35:38.329649+0000","last_undegraded":"2024-09-17T03:35:38.329649+0000","last_fullsized":"2024-09-17T03:35:38.329649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:44.791275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428123+0000","last_change":"2024-09-17T03:35:32.405817+0000","last_active":"2024-09-17T03:35:37.428123+0000","last_peered":"2024-09-17T03:35:37.428123+0000","last_clean":"2024-09-17T03:35:37.428123+0000","last_became_active":"2024-09-17T03:35:32.401125+0000","last_became_peered":"2024-09-17T03:35:32.401125+0000","last_unstale":"2024-09-17T03:35:37.428123+0000","last_undegraded":"2024-09-17T03:35:37.428123+0000","last_fullsized":"2024-09-17T03:35:37.428123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:44.639162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716409+0000","last_change":"2024-09-17T03:35:32.406706+0000","last_active":"2024-09-17T03:35:37.716409+0000","last_peered":"2024-09-17T03:35:37.716409+0000","last_clean":"2024-09-17T03:35:37.716409+0000","last_became_active":"2024-09-17T03:35:32.406380+0000","last_became_peered":"2024-09-17T03:35:32.406380+0000","last_unstale":"2024-09-17T03:35:37.716409+0000","last_undegraded":"2024-09-17T03:35:37.716409+0000","last_fullsized":"2024-09-17T03:35:37.716409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:35.823308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330231+0000","last_change":"2024-09-17T03:35:32.409026+0000","last_active":"2024-09-17T03:35:38.330231+0000","last_peered":"2024-09-17T03:35:38.330231+0000","last_clean":"2024-09-17T03:35:38.330231+0000","last_became_active":"2024-09-17T03:35:32.408678+0000","last_became_peered":"2024-09-17T03:35:32.408678+0000","last_unstale":"2024-09-17T03:35:38.330231+0000","last_undegraded":"2024-09-17T03:35:38.330231+0000","last_fullsized":"2024-09-17T03:35:38.330231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:57.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716319+0000","last_change":"2024-09-17T03:35:32.417998+0000","last_active":"2024-09-17T03:35:37.716319+0000","last_peered":"2024-09-17T03:35:37.716319+0000","last_clean":"2024-09-17T03:35:37.716319+0000","last_became_active":"2024-09-17T03:35:32.417698+0000","last_became_peered":"2024-09-17T03:35:32.417698+0000","last_unstale":"2024-09-17T03:35:37.716319+0000","last_undegraded":"2024-09-17T03:35:37.716319+0000","last_fullsized":"2024-09-17T03:35:37.716319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:17.076410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329887+0000","last_change":"2024-09-17T03:35:32.400692+0000","last_active":"2024-09-17T03:35:38.329887+0000","last_peered":"2024-09-17T03:35:38.329887+0000","last_clean":"2024-09-17T03:35:38.329887+0000","last_became_active":"2024-09-17T03:35:32.400221+0000","last_became_peered":"2024-09-17T03:35:32.400221+0000","last_unstale":"2024-09-17T03:35:38.329887+0000","last_undegraded":"2024-09-17T03:35:38.329887+0000","last_fullsized":"2024-09-17T03:35:38.329887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:26.763129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430145+0000","last_change":"2024-09-17T03:35:32.415375+0000","last_active":"2024-09-17T03:35:37.430145+0000","last_peered":"2024-09-17T03:35:37.430145+0000","last_clean":"2024-09-17T03:35:37.430145+0000","last_became_active":"2024-09-17T03:35:32.415017+0000","last_became_peered":"2024-09-17T03:35:32.415017+0000","last_unstale":"2024-09-17T03:35:37.430145+0000","last_undegraded":"2024-09-17T03:35:37.430145+0000","last_fullsized":"2024-09-17T03:35:37.430145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:50.658760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430308+0000","last_change":"2024-09-17T03:35:32.415726+0000","last_active":"2024-09-17T03:35:37.430308+0000","last_peered":"2024-09-17T03:35:37.430308+0000","last_clean":"2024-09-17T03:35:37.430308+0000","last_became_active":"2024-09-17T03:35:32.415405+0000","last_became_peered":"2024-09-17T03:35:32.415405+0000","last_unstale":"2024-09-17T03:35:37.430308+0000","last_undegraded":"2024-09-17T03:35:37.430308+0000","last_fullsized":"2024-09-17T03:35:37.430308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:54.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716587+0000","last_change":"2024-09-17T03:35:32.398919+0000","last_active":"2024-09-17T03:35:37.716587+0000","last_peered":"2024-09-17T03:35:37.716587+0000","last_clean":"2024-09-17T03:35:37.716587+0000","last_became_active":"2024-09-17T03:35:32.398610+0000","last_became_peered":"2024-09-17T03:35:32.398610+0000","last_unstale":"2024-09-17T03:35:37.716587+0000","last_undegraded":"2024-09-17T03:35:37.716587+0000","last_fullsized":"2024-09-17T03:35:37.716587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:32.277026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:03.162 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:03.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.419+0000 7f824ca00640 1 -- 172.21.15.121:0/1660291316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8248071160 msgr2=0x7f8248071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:03.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.419+0000 7f824ca00640 1 --2- 172.21.15.121:0/1660291316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8248071160 0x7f8248071570 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8240005fd0 tx=0x7f824002a780 comp rx=0 tx=0).stop 2024-09-17T03:36:03.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.419+0000 7f824ca00640 1 -- 172.21.15.121:0/1660291316 shutdown_connections 2024-09-17T03:36:03.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.419+0000 7f824ca00640 1 --2- 172.21.15.121:0/1660291316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8248071160 0x7f8248071570 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.419+0000 7f824ca00640 1 -- 172.21.15.121:0/1660291316 >> 172.21.15.121:0/1660291316 conn(0x7f82480d1020 msgr2=0x7f82480d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:03.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.419+0000 7f824ca00640 1 -- 172.21.15.121:0/1660291316 shutdown_connections 2024-09-17T03:36:03.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.419+0000 7f824ca00640 1 -- 172.21.15.121:0/1660291316 wait complete. 2024-09-17T03:36:03.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.421+0000 7f824ca00640 1 Processor -- start 2024-09-17T03:36:03.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.421+0000 7f824ca00640 1 -- start start 2024-09-17T03:36:03.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f824ca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8248071160 0x7f82480b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:03.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f824ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8248072320 0x7f82481f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:03.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f824ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8248152450 0x7f82481f7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:03.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f824ca00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f82480b42e0 con 0x7f8248071160 2024-09-17T03:36:03.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f824ca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f82480b4160 con 0x7f8248152450 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f824ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f82480b4460 con 0x7f8248072320 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f8247400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8248071160 0x7f82480b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f8247400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8248071160 0x7f82480b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57938/0 (socket says 172.21.15.121:57938) 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f8247400640 1 -- 172.21.15.121:0/494272985 learned_addr learned my addr 172.21.15.121:0/494272985 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f8247e00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8248152450 0x7f82481f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.423+0000 7f8246a00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8248072320 0x7f82481f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f8247400640 1 -- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8248072320 msgr2=0x7f82481f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f8247400640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8248072320 0x7f82481f6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f8247400640 1 -- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8248152450 msgr2=0x7f82481f7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f8247400640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8248152450 0x7f82481f7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f8247400640 1 -- 172.21.15.121:0/494272985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480aa040 con 0x7f8248071160 2024-09-17T03:36:03.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f8247e00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8248152450 0x7f82481f7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:03.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f8247400640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8248071160 0x7f82480b00f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f823800c3e0 tx=0x7f823800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:03.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f823f400640 1 -- 172.21.15.121:0/494272985 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238011790 con 0x7f8248071160 2024-09-17T03:36:03.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f823f400640 1 -- 172.21.15.121:0/494272985 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8238017070 con 0x7f8248071160 2024-09-17T03:36:03.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f823f400640 1 -- 172.21.15.121:0/494272985 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238011ce0 con 0x7f8248071160 2024-09-17T03:36:03.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f824ca00640 1 -- 172.21.15.121:0/494272985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8248159060 con 0x7f8248071160 2024-09-17T03:36:03.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.424+0000 7f824ca00640 1 -- 172.21.15.121:0/494272985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82480b0630 con 0x7f8248071160 2024-09-17T03:36:03.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.425+0000 7f824ca00640 1 -- 172.21.15.121:0/494272985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82480d0e10 con 0x7f8248071160 2024-09-17T03:36:03.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.427+0000 7f823f400640 1 -- 172.21.15.121:0/494272985 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f823801c460 con 0x7f8248071160 2024-09-17T03:36:03.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.427+0000 7f823f400640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8228078b90 0x7f822807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:03.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.428+0000 7f823f400640 1 -- 172.21.15.121:0/494272985 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f823809adb0 con 0x7f8248071160 2024-09-17T03:36:03.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.428+0000 7f8246a00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8228078b90 0x7f822807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:03.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.429+0000 7f8246a00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8228078b90 0x7f822807b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f824806e800 tx=0x7f8234009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:03.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.432+0000 7f823f400640 1 -- 172.21.15.121:0/494272985 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82480d0e10 con 0x7f8248071160 2024-09-17T03:36:03.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.614+0000 7f824ca00640 1 -- 172.21.15.121:0/494272985 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8248071570 con 0x7f8228078b90 2024-09-17T03:36:03.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.620+0000 7f823f400640 1 -- 172.21.15.121:0/494272985 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332516 (secure 0 0 0) 0x7f8248071570 con 0x7f8228078b90 2024-09-17T03:36:03.624 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:03.626 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.625+0000 7f824ca00640 1 -- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8228078b90 msgr2=0x7f822807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.625+0000 7f824ca00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8228078b90 0x7f822807b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f824806e800 tx=0x7f8234009060 comp rx=0 tx=0).stop 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.625+0000 7f824ca00640 1 -- 172.21.15.121:0/494272985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8248071160 msgr2=0x7f82480b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.625+0000 7f824ca00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8248071160 0x7f82480b00f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f823800c3e0 tx=0x7f823800c8a0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.625+0000 7f824ca00640 1 -- 172.21.15.121:0/494272985 shutdown_connections 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.625+0000 7f824ca00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8248152450 0x7f82481f7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.625+0000 7f824ca00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8248072320 0x7f82481f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.625+0000 7f824ca00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8228078b90 0x7f822807b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.625+0000 7f824ca00640 1 --2- 172.21.15.121:0/494272985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8248071160 0x7f82480b00f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.625+0000 7f824ca00640 1 -- 172.21.15.121:0/494272985 >> 172.21.15.121:0/494272985 conn(0x7f82480d1020 msgr2=0x7f82480d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.626+0000 7f824ca00640 1 -- 172.21.15.121:0/494272985 shutdown_connections 2024-09-17T03:36:03.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.626+0000 7f824ca00640 1 -- 172.21.15.121:0/494272985 wait complete. 2024-09-17T03:36:03.647 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-17T03:36:03.285354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003876"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952940+0000","last_change":"2024-09-17T03:35:31.396637+0000","last_active":"2024-09-17T03:35:37.952940+0000","last_peered":"2024-09-17T03:35:37.952940+0000","last_clean":"2024-09-17T03:35:37.952940+0000","last_became_active":"2024-09-17T03:35:31.396194+0000","last_became_peered":"2024-09-17T03:35:31.396194+0000","last_unstale":"2024-09-17T03:35:37.952940+0000","last_undegraded":"2024-09-17T03:35:37.952940+0000","last_fullsized":"2024-09-17T03:35:37.952940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:58.587185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430670+0000","last_change":"2024-09-17T03:35:32.419807+0000","last_active":"2024-09-17T03:35:37.430670+0000","last_peered":"2024-09-17T03:35:37.430670+0000","last_clean":"2024-09-17T03:35:37.430670+0000","last_became_active":"2024-09-17T03:35:32.419516+0000","last_became_peered":"2024-09-17T03:35:32.419516+0000","last_unstale":"2024-09-17T03:35:37.430670+0000","last_undegraded":"2024-09-17T03:35:37.430670+0000","last_fullsized":"2024-09-17T03:35:37.430670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:18.848416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329189+0000","last_change":"2024-09-17T03:35:36.457719+0000","last_active":"2024-09-17T03:35:38.329189+0000","last_peered":"2024-09-17T03:35:38.329189+0000","last_clean":"2024-09-17T03:35:38.329189+0000","last_became_active":"2024-09-17T03:35:36.457049+0000","last_became_peered":"2024-09-17T03:35:36.457049+0000","last_unstale":"2024-09-17T03:35:38.329189+0000","last_undegraded":"2024-09-17T03:35:38.329189+0000","last_fullsized":"2024-09-17T03:35:38.329189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:26.004535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430809+0000","last_change":"2024-09-17T03:35:31.405486+0000","last_active":"2024-09-17T03:35:37.430809+0000","last_peered":"2024-09-17T03:35:37.430809+0000","last_clean":"2024-09-17T03:35:37.430809+0000","last_became_active":"2024-09-17T03:35:31.405174+0000","last_became_peered":"2024-09-17T03:35:31.405174+0000","last_unstale":"2024-09-17T03:35:37.430809+0000","last_undegraded":"2024-09-17T03:35:37.430809+0000","last_fullsized":"2024-09-17T03:35:37.430809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:50.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430989+0000","last_change":"2024-09-17T03:35:32.420131+0000","last_active":"2024-09-17T03:35:37.430989+0000","last_peered":"2024-09-17T03:35:37.430989+0000","last_clean":"2024-09-17T03:35:37.430989+0000","last_became_active":"2024-09-17T03:35:32.419301+0000","last_became_peered":"2024-09-17T03:35:32.419301+0000","last_unstale":"2024-09-17T03:35:37.430989+0000","last_undegraded":"2024-09-17T03:35:37.430989+0000","last_fullsized":"2024-09-17T03:35:37.430989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328550+0000","last_change":"2024-09-17T03:35:36.448725+0000","last_active":"2024-09-17T03:35:38.328550+0000","last_peered":"2024-09-17T03:35:38.328550+0000","last_clean":"2024-09-17T03:35:38.328550+0000","last_became_active":"2024-09-17T03:35:36.448306+0000","last_became_peered":"2024-09-17T03:35:36.448306+0000","last_unstale":"2024-09-17T03:35:38.328550+0000","last_undegraded":"2024-09-17T03:35:38.328550+0000","last_fullsized":"2024-09-17T03:35:38.328550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:38.297846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716849+0000","last_change":"2024-09-17T03:35:31.406863+0000","last_active":"2024-09-17T03:35:37.716849+0000","last_peered":"2024-09-17T03:35:37.716849+0000","last_clean":"2024-09-17T03:35:37.716849+0000","last_became_active":"2024-09-17T03:35:31.405716+0000","last_became_peered":"2024-09-17T03:35:31.405716+0000","last_unstale":"2024-09-17T03:35:37.716849+0000","last_undegraded":"2024-09-17T03:35:37.716849+0000","last_fullsized":"2024-09-17T03:35:37.716849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:25.988144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329090+0000","last_change":"2024-09-17T03:35:32.404862+0000","last_active":"2024-09-17T03:35:38.329090+0000","last_peered":"2024-09-17T03:35:38.329090+0000","last_clean":"2024-09-17T03:35:38.329090+0000","last_became_active":"2024-09-17T03:35:32.403799+0000","last_became_peered":"2024-09-17T03:35:32.403799+0000","last_unstale":"2024-09-17T03:35:38.329090+0000","last_undegraded":"2024-09-17T03:35:38.329090+0000","last_fullsized":"2024-09-17T03:35:38.329090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.040918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329212+0000","last_change":"2024-09-17T03:35:36.442226+0000","last_active":"2024-09-17T03:35:38.329212+0000","last_peered":"2024-09-17T03:35:38.329212+0000","last_clean":"2024-09-17T03:35:38.329212+0000","last_became_active":"2024-09-17T03:35:36.441650+0000","last_became_peered":"2024-09-17T03:35:36.441650+0000","last_unstale":"2024-09-17T03:35:38.329212+0000","last_undegraded":"2024-09-17T03:35:38.329212+0000","last_fullsized":"2024-09-17T03:35:38.329212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:53.723832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716982+0000","last_change":"2024-09-17T03:35:31.402468+0000","last_active":"2024-09-17T03:35:37.716982+0000","last_peered":"2024-09-17T03:35:37.716982+0000","last_clean":"2024-09-17T03:35:37.716982+0000","last_became_active":"2024-09-17T03:35:31.400527+0000","last_became_peered":"2024-09-17T03:35:31.400527+0000","last_unstale":"2024-09-17T03:35:37.716982+0000","last_undegraded":"2024-09-17T03:35:37.716982+0000","last_fullsized":"2024-09-17T03:35:37.716982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:34.200886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424506+0000","last_change":"2024-09-17T03:35:32.399680+0000","last_active":"2024-09-17T03:35:37.424506+0000","last_peered":"2024-09-17T03:35:37.424506+0000","last_clean":"2024-09-17T03:35:37.424506+0000","last_became_active":"2024-09-17T03:35:32.399385+0000","last_became_peered":"2024-09-17T03:35:32.399385+0000","last_unstale":"2024-09-17T03:35:37.424506+0000","last_undegraded":"2024-09-17T03:35:37.424506+0000","last_fullsized":"2024-09-17T03:35:37.424506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:43.868900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328684+0000","last_change":"2024-09-17T03:35:36.454547+0000","last_active":"2024-09-17T03:35:38.328684+0000","last_peered":"2024-09-17T03:35:38.328684+0000","last_clean":"2024-09-17T03:35:38.328684+0000","last_became_active":"2024-09-17T03:35:36.452245+0000","last_became_peered":"2024-09-17T03:35:36.452245+0000","last_unstale":"2024-09-17T03:35:38.328684+0000","last_undegraded":"2024-09-17T03:35:38.328684+0000","last_fullsized":"2024-09-17T03:35:38.328684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:21.761835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424041+0000","last_change":"2024-09-17T03:35:32.389915+0000","last_active":"2024-09-17T03:35:37.424041+0000","last_peered":"2024-09-17T03:35:37.424041+0000","last_clean":"2024-09-17T03:35:37.424041+0000","last_became_active":"2024-09-17T03:35:32.389629+0000","last_became_peered":"2024-09-17T03:35:32.389629+0000","last_unstale":"2024-09-17T03:35:37.424041+0000","last_undegraded":"2024-09-17T03:35:37.424041+0000","last_fullsized":"2024-09-17T03:35:37.424041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:37.978604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424108+0000","last_change":"2024-09-17T03:35:31.399927+0000","last_active":"2024-09-17T03:35:37.424108+0000","last_peered":"2024-09-17T03:35:37.424108+0000","last_clean":"2024-09-17T03:35:37.424108+0000","last_became_active":"2024-09-17T03:35:31.399633+0000","last_became_peered":"2024-09-17T03:35:31.399633+0000","last_unstale":"2024-09-17T03:35:37.424108+0000","last_undegraded":"2024-09-17T03:35:37.424108+0000","last_fullsized":"2024-09-17T03:35:37.424108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:54.701924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424308+0000","last_change":"2024-09-17T03:35:36.441343+0000","last_active":"2024-09-17T03:35:37.424308+0000","last_peered":"2024-09-17T03:35:37.424308+0000","last_clean":"2024-09-17T03:35:37.424308+0000","last_became_active":"2024-09-17T03:35:36.440928+0000","last_became_peered":"2024-09-17T03:35:36.440928+0000","last_unstale":"2024-09-17T03:35:37.424308+0000","last_undegraded":"2024-09-17T03:35:37.424308+0000","last_fullsized":"2024-09-17T03:35:37.424308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:30.901575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329519+0000","last_change":"2024-09-17T03:35:32.392491+0000","last_active":"2024-09-17T03:35:38.329519+0000","last_peered":"2024-09-17T03:35:38.329519+0000","last_clean":"2024-09-17T03:35:38.329519+0000","last_became_active":"2024-09-17T03:35:32.392158+0000","last_became_peered":"2024-09-17T03:35:32.392158+0000","last_unstale":"2024-09-17T03:35:38.329519+0000","last_undegraded":"2024-09-17T03:35:38.329519+0000","last_fullsized":"2024-09-17T03:35:38.329519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:09.595197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429614+0000","last_change":"2024-09-17T03:35:31.402340+0000","last_active":"2024-09-17T03:35:37.429614+0000","last_peered":"2024-09-17T03:35:37.429614+0000","last_clean":"2024-09-17T03:35:37.429614+0000","last_became_active":"2024-09-17T03:35:31.401416+0000","last_became_peered":"2024-09-17T03:35:31.401416+0000","last_unstale":"2024-09-17T03:35:37.429614+0000","last_undegraded":"2024-09-17T03:35:37.429614+0000","last_fullsized":"2024-09-17T03:35:37.429614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716700+0000","last_change":"2024-09-17T03:35:36.447535+0000","last_active":"2024-09-17T03:35:37.716700+0000","last_peered":"2024-09-17T03:35:37.716700+0000","last_clean":"2024-09-17T03:35:37.716700+0000","last_became_active":"2024-09-17T03:35:36.447090+0000","last_became_peered":"2024-09-17T03:35:36.447090+0000","last_unstale":"2024-09-17T03:35:37.716700+0000","last_undegraded":"2024-09-17T03:35:37.716700+0000","last_fullsized":"2024-09-17T03:35:37.716700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:23.237213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.951840+0000","last_change":"2024-09-17T03:35:32.400250+0000","last_active":"2024-09-17T03:35:37.951840+0000","last_peered":"2024-09-17T03:35:37.951840+0000","last_clean":"2024-09-17T03:35:37.951840+0000","last_became_active":"2024-09-17T03:35:32.399895+0000","last_became_peered":"2024-09-17T03:35:32.399895+0000","last_unstale":"2024-09-17T03:35:37.951840+0000","last_undegraded":"2024-09-17T03:35:37.951840+0000","last_fullsized":"2024-09-17T03:35:37.951840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:55.236620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952361+0000","last_change":"2024-09-17T03:35:31.407356+0000","last_active":"2024-09-17T03:35:37.952361+0000","last_peered":"2024-09-17T03:35:37.952361+0000","last_clean":"2024-09-17T03:35:37.952361+0000","last_became_active":"2024-09-17T03:35:31.407074+0000","last_became_peered":"2024-09-17T03:35:31.407074+0000","last_unstale":"2024-09-17T03:35:37.952361+0000","last_undegraded":"2024-09-17T03:35:37.952361+0000","last_fullsized":"2024-09-17T03:35:37.952361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:05.229644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329905+0000","last_change":"2024-09-17T03:35:36.460644+0000","last_active":"2024-09-17T03:35:38.329905+0000","last_peered":"2024-09-17T03:35:38.329905+0000","last_clean":"2024-09-17T03:35:38.329905+0000","last_became_active":"2024-09-17T03:35:36.460097+0000","last_became_peered":"2024-09-17T03:35:36.460097+0000","last_unstale":"2024-09-17T03:35:38.329905+0000","last_undegraded":"2024-09-17T03:35:38.329905+0000","last_fullsized":"2024-09-17T03:35:38.329905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:48.675841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424083+0000","last_change":"2024-09-17T03:35:32.405208+0000","last_active":"2024-09-17T03:35:37.424083+0000","last_peered":"2024-09-17T03:35:37.424083+0000","last_clean":"2024-09-17T03:35:37.424083+0000","last_became_active":"2024-09-17T03:35:32.404935+0000","last_became_peered":"2024-09-17T03:35:32.404935+0000","last_unstale":"2024-09-17T03:35:37.424083+0000","last_undegraded":"2024-09-17T03:35:37.424083+0000","last_fullsized":"2024-09-17T03:35:37.424083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:29.377565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716031+0000","last_change":"2024-09-17T03:35:31.402429+0000","last_active":"2024-09-17T03:35:37.716031+0000","last_peered":"2024-09-17T03:35:37.716031+0000","last_clean":"2024-09-17T03:35:37.716031+0000","last_became_active":"2024-09-17T03:35:31.400904+0000","last_became_peered":"2024-09-17T03:35:31.400904+0000","last_unstale":"2024-09-17T03:35:37.716031+0000","last_undegraded":"2024-09-17T03:35:37.716031+0000","last_fullsized":"2024-09-17T03:35:37.716031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:35.114127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329137+0000","last_change":"2024-09-17T03:35:36.439897+0000","last_active":"2024-09-17T03:35:38.329137+0000","last_peered":"2024-09-17T03:35:38.329137+0000","last_clean":"2024-09-17T03:35:38.329137+0000","last_became_active":"2024-09-17T03:35:36.439451+0000","last_became_peered":"2024-09-17T03:35:36.439451+0000","last_unstale":"2024-09-17T03:35:38.329137+0000","last_undegraded":"2024-09-17T03:35:38.329137+0000","last_fullsized":"2024-09-17T03:35:38.329137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:21.113089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952643+0000","last_change":"2024-09-17T03:35:32.397257+0000","last_active":"2024-09-17T03:35:37.952643+0000","last_peered":"2024-09-17T03:35:37.952643+0000","last_clean":"2024-09-17T03:35:37.952643+0000","last_became_active":"2024-09-17T03:35:32.396876+0000","last_became_peered":"2024-09-17T03:35:32.396876+0000","last_unstale":"2024-09-17T03:35:37.952643+0000","last_undegraded":"2024-09-17T03:35:37.952643+0000","last_fullsized":"2024-09-17T03:35:37.952643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:28.702200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424791+0000","last_change":"2024-09-17T03:35:31.409394+0000","last_active":"2024-09-17T03:35:37.424791+0000","last_peered":"2024-09-17T03:35:37.424791+0000","last_clean":"2024-09-17T03:35:37.424791+0000","last_became_active":"2024-09-17T03:35:31.408980+0000","last_became_peered":"2024-09-17T03:35:31.408980+0000","last_unstale":"2024-09-17T03:35:37.424791+0000","last_undegraded":"2024-09-17T03:35:37.424791+0000","last_fullsized":"2024-09-17T03:35:37.424791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:55.652949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329294+0000","last_change":"2024-09-17T03:35:36.436456+0000","last_active":"2024-09-17T03:35:38.329294+0000","last_peered":"2024-09-17T03:35:38.329294+0000","last_clean":"2024-09-17T03:35:38.329294+0000","last_became_active":"2024-09-17T03:35:36.435668+0000","last_became_peered":"2024-09-17T03:35:36.435668+0000","last_unstale":"2024-09-17T03:35:38.329294+0000","last_undegraded":"2024-09-17T03:35:38.329294+0000","last_fullsized":"2024-09-17T03:35:38.329294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:22.885095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952829+0000","last_change":"2024-09-17T03:35:32.401092+0000","last_active":"2024-09-17T03:35:37.952829+0000","last_peered":"2024-09-17T03:35:37.952829+0000","last_clean":"2024-09-17T03:35:37.952829+0000","last_became_active":"2024-09-17T03:35:32.400788+0000","last_became_peered":"2024-09-17T03:35:32.400788+0000","last_unstale":"2024-09-17T03:35:37.952829+0000","last_undegraded":"2024-09-17T03:35:37.952829+0000","last_fullsized":"2024-09-17T03:35:37.952829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:48.624702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952865+0000","last_change":"2024-09-17T03:35:31.409840+0000","last_active":"2024-09-17T03:35:37.952865+0000","last_peered":"2024-09-17T03:35:37.952865+0000","last_clean":"2024-09-17T03:35:37.952865+0000","last_became_active":"2024-09-17T03:35:31.409588+0000","last_became_peered":"2024-09-17T03:35:31.409588+0000","last_unstale":"2024-09-17T03:35:37.952865+0000","last_undegraded":"2024-09-17T03:35:37.952865+0000","last_fullsized":"2024-09-17T03:35:37.952865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:48.768703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.951931+0000","last_change":"2024-09-17T03:35:36.434767+0000","last_active":"2024-09-17T03:35:37.951931+0000","last_peered":"2024-09-17T03:35:37.951931+0000","last_clean":"2024-09-17T03:35:37.951931+0000","last_became_active":"2024-09-17T03:35:36.432238+0000","last_became_peered":"2024-09-17T03:35:36.432238+0000","last_unstale":"2024-09-17T03:35:37.951931+0000","last_undegraded":"2024-09-17T03:35:37.951931+0000","last_fullsized":"2024-09-17T03:35:37.951931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:42.117587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430388+0000","last_change":"2024-09-17T03:35:32.415405+0000","last_active":"2024-09-17T03:35:37.430388+0000","last_peered":"2024-09-17T03:35:37.430388+0000","last_clean":"2024-09-17T03:35:37.430388+0000","last_became_active":"2024-09-17T03:35:32.415059+0000","last_became_peered":"2024-09-17T03:35:32.415059+0000","last_unstale":"2024-09-17T03:35:37.430388+0000","last_undegraded":"2024-09-17T03:35:37.430388+0000","last_fullsized":"2024-09-17T03:35:37.430388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:03.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424840+0000","last_change":"2024-09-17T03:35:31.396414+0000","last_active":"2024-09-17T03:35:37.424840+0000","last_peered":"2024-09-17T03:35:37.424840+0000","last_clean":"2024-09-17T03:35:37.424840+0000","last_became_active":"2024-09-17T03:35:31.395858+0000","last_became_peered":"2024-09-17T03:35:31.395858+0000","last_unstale":"2024-09-17T03:35:37.424840+0000","last_undegraded":"2024-09-17T03:35:37.424840+0000","last_fullsized":"2024-09-17T03:35:37.424840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:48.032251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429676+0000","last_change":"2024-09-17T03:35:36.454944+0000","last_active":"2024-09-17T03:35:37.429676+0000","last_peered":"2024-09-17T03:35:37.429676+0000","last_clean":"2024-09-17T03:35:37.429676+0000","last_became_active":"2024-09-17T03:35:36.452999+0000","last_became_peered":"2024-09-17T03:35:36.452999+0000","last_unstale":"2024-09-17T03:35:37.429676+0000","last_undegraded":"2024-09-17T03:35:37.429676+0000","last_fullsized":"2024-09-17T03:35:37.429676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:59.994365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330037+0000","last_change":"2024-09-17T03:35:32.401014+0000","last_active":"2024-09-17T03:35:38.330037+0000","last_peered":"2024-09-17T03:35:38.330037+0000","last_clean":"2024-09-17T03:35:38.330037+0000","last_became_active":"2024-09-17T03:35:32.392657+0000","last_became_peered":"2024-09-17T03:35:32.392657+0000","last_unstale":"2024-09-17T03:35:38.330037+0000","last_undegraded":"2024-09-17T03:35:38.330037+0000","last_fullsized":"2024-09-17T03:35:38.330037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:54.253376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429390+0000","last_change":"2024-09-17T03:35:31.402788+0000","last_active":"2024-09-17T03:35:37.429390+0000","last_peered":"2024-09-17T03:35:37.429390+0000","last_clean":"2024-09-17T03:35:37.429390+0000","last_became_active":"2024-09-17T03:35:31.402263+0000","last_became_peered":"2024-09-17T03:35:31.402263+0000","last_unstale":"2024-09-17T03:35:37.429390+0000","last_undegraded":"2024-09-17T03:35:37.429390+0000","last_fullsized":"2024-09-17T03:35:37.429390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429266+0000","last_change":"2024-09-17T03:35:36.450678+0000","last_active":"2024-09-17T03:35:37.429266+0000","last_peered":"2024-09-17T03:35:37.429266+0000","last_clean":"2024-09-17T03:35:37.429266+0000","last_became_active":"2024-09-17T03:35:36.450277+0000","last_became_peered":"2024-09-17T03:35:36.450277+0000","last_unstale":"2024-09-17T03:35:37.429266+0000","last_undegraded":"2024-09-17T03:35:37.429266+0000","last_fullsized":"2024-09-17T03:35:37.429266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:58.323368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716675+0000","last_change":"2024-09-17T03:35:32.399401+0000","last_active":"2024-09-17T03:35:37.716675+0000","last_peered":"2024-09-17T03:35:37.716675+0000","last_clean":"2024-09-17T03:35:37.716675+0000","last_became_active":"2024-09-17T03:35:32.399115+0000","last_became_peered":"2024-09-17T03:35:32.399115+0000","last_unstale":"2024-09-17T03:35:37.716675+0000","last_undegraded":"2024-09-17T03:35:37.716675+0000","last_fullsized":"2024-09-17T03:35:37.716675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:44.081924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424632+0000","last_change":"2024-09-17T03:35:31.395600+0000","last_active":"2024-09-17T03:35:37.424632+0000","last_peered":"2024-09-17T03:35:37.424632+0000","last_clean":"2024-09-17T03:35:37.424632+0000","last_became_active":"2024-09-17T03:35:31.394734+0000","last_became_peered":"2024-09-17T03:35:31.394734+0000","last_unstale":"2024-09-17T03:35:37.424632+0000","last_undegraded":"2024-09-17T03:35:37.424632+0000","last_fullsized":"2024-09-17T03:35:37.424632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:01.197590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430182+0000","last_change":"2024-09-17T03:35:36.443098+0000","last_active":"2024-09-17T03:35:37.430182+0000","last_peered":"2024-09-17T03:35:37.430182+0000","last_clean":"2024-09-17T03:35:37.430182+0000","last_became_active":"2024-09-17T03:35:36.437889+0000","last_became_peered":"2024-09-17T03:35:36.437889+0000","last_unstale":"2024-09-17T03:35:37.430182+0000","last_undegraded":"2024-09-17T03:35:37.430182+0000","last_fullsized":"2024-09-17T03:35:37.430182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.413529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428284+0000","last_change":"2024-09-17T03:35:32.400695+0000","last_active":"2024-09-17T03:35:37.428284+0000","last_peered":"2024-09-17T03:35:37.428284+0000","last_clean":"2024-09-17T03:35:37.428284+0000","last_became_active":"2024-09-17T03:35:32.400363+0000","last_became_peered":"2024-09-17T03:35:32.400363+0000","last_unstale":"2024-09-17T03:35:37.428284+0000","last_undegraded":"2024-09-17T03:35:37.428284+0000","last_fullsized":"2024-09-17T03:35:37.428284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:14.763903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329497+0000","last_change":"2024-09-17T03:35:31.405580+0000","last_active":"2024-09-17T03:35:38.329497+0000","last_peered":"2024-09-17T03:35:38.329497+0000","last_clean":"2024-09-17T03:35:38.329497+0000","last_became_active":"2024-09-17T03:35:31.405210+0000","last_became_peered":"2024-09-17T03:35:31.405210+0000","last_unstale":"2024-09-17T03:35:38.329497+0000","last_undegraded":"2024-09-17T03:35:38.329497+0000","last_fullsized":"2024-09-17T03:35:38.329497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:24.896063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430908+0000","last_change":"2024-09-17T03:35:36.449377+0000","last_active":"2024-09-17T03:35:37.430908+0000","last_peered":"2024-09-17T03:35:37.430908+0000","last_clean":"2024-09-17T03:35:37.430908+0000","last_became_active":"2024-09-17T03:35:36.448135+0000","last_became_peered":"2024-09-17T03:35:36.448135+0000","last_unstale":"2024-09-17T03:35:37.430908+0000","last_undegraded":"2024-09-17T03:35:37.430908+0000","last_fullsized":"2024-09-17T03:35:37.430908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:36.313705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428454+0000","last_change":"2024-09-17T03:35:32.408934+0000","last_active":"2024-09-17T03:35:37.428454+0000","last_peered":"2024-09-17T03:35:37.428454+0000","last_clean":"2024-09-17T03:35:37.428454+0000","last_became_active":"2024-09-17T03:35:32.408637+0000","last_became_peered":"2024-09-17T03:35:32.408637+0000","last_unstale":"2024-09-17T03:35:37.428454+0000","last_undegraded":"2024-09-17T03:35:37.428454+0000","last_fullsized":"2024-09-17T03:35:37.428454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:55.435612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424316+0000","last_change":"2024-09-17T03:35:31.402870+0000","last_active":"2024-09-17T03:35:37.424316+0000","last_peered":"2024-09-17T03:35:37.424316+0000","last_clean":"2024-09-17T03:35:37.424316+0000","last_became_active":"2024-09-17T03:35:31.401653+0000","last_became_peered":"2024-09-17T03:35:31.401653+0000","last_unstale":"2024-09-17T03:35:37.424316+0000","last_undegraded":"2024-09-17T03:35:37.424316+0000","last_fullsized":"2024-09-17T03:35:37.424316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429975+0000","last_change":"2024-09-17T03:35:36.444315+0000","last_active":"2024-09-17T03:35:37.429975+0000","last_peered":"2024-09-17T03:35:37.429975+0000","last_clean":"2024-09-17T03:35:37.429975+0000","last_became_active":"2024-09-17T03:35:36.441801+0000","last_became_peered":"2024-09-17T03:35:36.441801+0000","last_unstale":"2024-09-17T03:35:37.429975+0000","last_undegraded":"2024-09-17T03:35:37.429975+0000","last_fullsized":"2024-09-17T03:35:37.429975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:47.905579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952163+0000","last_change":"2024-09-17T03:35:32.415099+0000","last_active":"2024-09-17T03:35:37.952163+0000","last_peered":"2024-09-17T03:35:37.952163+0000","last_clean":"2024-09-17T03:35:37.952163+0000","last_became_active":"2024-09-17T03:35:32.414839+0000","last_became_peered":"2024-09-17T03:35:32.414839+0000","last_unstale":"2024-09-17T03:35:37.952163+0000","last_undegraded":"2024-09-17T03:35:37.952163+0000","last_fullsized":"2024-09-17T03:35:37.952163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:28.814349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424280+0000","last_change":"2024-09-17T03:35:31.399644+0000","last_active":"2024-09-17T03:35:37.424280+0000","last_peered":"2024-09-17T03:35:37.424280+0000","last_clean":"2024-09-17T03:35:37.424280+0000","last_became_active":"2024-09-17T03:35:31.398495+0000","last_became_peered":"2024-09-17T03:35:31.398495+0000","last_unstale":"2024-09-17T03:35:37.424280+0000","last_undegraded":"2024-09-17T03:35:37.424280+0000","last_fullsized":"2024-09-17T03:35:37.424280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:43.782608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328458+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:35:38.328458+0000","last_peered":"2024-09-17T03:35:38.328458+0000","last_clean":"2024-09-17T03:35:38.328458+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:35:38.328458+0000","last_undegraded":"2024-09-17T03:35:38.328458+0000","last_fullsized":"2024-09-17T03:35:38.328458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424800+0000","last_change":"2024-09-17T03:35:36.432981+0000","last_active":"2024-09-17T03:35:37.424800+0000","last_peered":"2024-09-17T03:35:37.424800+0000","last_clean":"2024-09-17T03:35:37.424800+0000","last_became_active":"2024-09-17T03:35:36.432550+0000","last_became_peered":"2024-09-17T03:35:36.432550+0000","last_unstale":"2024-09-17T03:35:37.424800+0000","last_undegraded":"2024-09-17T03:35:37.424800+0000","last_fullsized":"2024-09-17T03:35:37.424800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:29.515037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424612+0000","last_change":"2024-09-17T03:35:32.393020+0000","last_active":"2024-09-17T03:35:37.424612+0000","last_peered":"2024-09-17T03:35:37.424612+0000","last_clean":"2024-09-17T03:35:37.424612+0000","last_became_active":"2024-09-17T03:35:32.392509+0000","last_became_peered":"2024-09-17T03:35:32.392509+0000","last_unstale":"2024-09-17T03:35:37.424612+0000","last_undegraded":"2024-09-17T03:35:37.424612+0000","last_fullsized":"2024-09-17T03:35:37.424612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:46.767440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430467+0000","last_change":"2024-09-17T03:35:31.406748+0000","last_active":"2024-09-17T03:35:37.430467+0000","last_peered":"2024-09-17T03:35:37.430467+0000","last_clean":"2024-09-17T03:35:37.430467+0000","last_became_active":"2024-09-17T03:35:31.406319+0000","last_became_peered":"2024-09-17T03:35:31.406319+0000","last_unstale":"2024-09-17T03:35:37.430467+0000","last_undegraded":"2024-09-17T03:35:37.430467+0000","last_fullsized":"2024-09-17T03:35:37.430467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:24.896063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330083+0000","last_change":"2024-09-17T03:35:36.454141+0000","last_active":"2024-09-17T03:35:38.330083+0000","last_peered":"2024-09-17T03:35:38.330083+0000","last_clean":"2024-09-17T03:35:38.330083+0000","last_became_active":"2024-09-17T03:35:36.452907+0000","last_became_peered":"2024-09-17T03:35:36.452907+0000","last_unstale":"2024-09-17T03:35:38.330083+0000","last_undegraded":"2024-09-17T03:35:38.330083+0000","last_fullsized":"2024-09-17T03:35:38.330083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:48.118603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716957+0000","last_change":"2024-09-17T03:35:32.397883+0000","last_active":"2024-09-17T03:35:37.716957+0000","last_peered":"2024-09-17T03:35:37.716957+0000","last_clean":"2024-09-17T03:35:37.716957+0000","last_became_active":"2024-09-17T03:35:32.395887+0000","last_became_peered":"2024-09-17T03:35:32.395887+0000","last_unstale":"2024-09-17T03:35:37.716957+0000","last_undegraded":"2024-09-17T03:35:37.716957+0000","last_fullsized":"2024-09-17T03:35:37.716957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:07.376850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430343+0000","last_change":"2024-09-17T03:35:31.399882+0000","last_active":"2024-09-17T03:35:37.430343+0000","last_peered":"2024-09-17T03:35:37.430343+0000","last_clean":"2024-09-17T03:35:37.430343+0000","last_became_active":"2024-09-17T03:35:31.399568+0000","last_became_peered":"2024-09-17T03:35:31.399568+0000","last_unstale":"2024-09-17T03:35:37.430343+0000","last_undegraded":"2024-09-17T03:35:37.430343+0000","last_fullsized":"2024-09-17T03:35:37.430343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:16.036571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428981+0000","last_change":"2024-09-17T03:35:36.435798+0000","last_active":"2024-09-17T03:35:37.428981+0000","last_peered":"2024-09-17T03:35:37.428981+0000","last_clean":"2024-09-17T03:35:37.428981+0000","last_became_active":"2024-09-17T03:35:36.434964+0000","last_became_peered":"2024-09-17T03:35:36.434964+0000","last_unstale":"2024-09-17T03:35:37.428981+0000","last_undegraded":"2024-09-17T03:35:37.428981+0000","last_fullsized":"2024-09-17T03:35:37.428981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:55.456589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716617+0000","last_change":"2024-09-17T03:35:32.401068+0000","last_active":"2024-09-17T03:35:37.716617+0000","last_peered":"2024-09-17T03:35:37.716617+0000","last_clean":"2024-09-17T03:35:37.716617+0000","last_became_active":"2024-09-17T03:35:32.400787+0000","last_became_peered":"2024-09-17T03:35:32.400787+0000","last_unstale":"2024-09-17T03:35:37.716617+0000","last_undegraded":"2024-09-17T03:35:37.716617+0000","last_fullsized":"2024-09-17T03:35:37.716617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952776+0000","last_change":"2024-09-17T03:35:31.400243+0000","last_active":"2024-09-17T03:35:37.952776+0000","last_peered":"2024-09-17T03:35:37.952776+0000","last_clean":"2024-09-17T03:35:37.952776+0000","last_became_active":"2024-09-17T03:35:31.399896+0000","last_became_peered":"2024-09-17T03:35:31.399896+0000","last_unstale":"2024-09-17T03:35:37.952776+0000","last_undegraded":"2024-09-17T03:35:37.952776+0000","last_fullsized":"2024-09-17T03:35:37.952776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:05.368297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423725+0000","last_change":"2024-09-17T03:35:36.433676+0000","last_active":"2024-09-17T03:35:37.423725+0000","last_peered":"2024-09-17T03:35:37.423725+0000","last_clean":"2024-09-17T03:35:37.423725+0000","last_became_active":"2024-09-17T03:35:36.431277+0000","last_became_peered":"2024-09-17T03:35:36.431277+0000","last_unstale":"2024-09-17T03:35:37.423725+0000","last_undegraded":"2024-09-17T03:35:37.423725+0000","last_fullsized":"2024-09-17T03:35:37.423725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.696472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329516+0000","last_change":"2024-09-17T03:35:32.412184+0000","last_active":"2024-09-17T03:35:38.329516+0000","last_peered":"2024-09-17T03:35:38.329516+0000","last_clean":"2024-09-17T03:35:38.329516+0000","last_became_active":"2024-09-17T03:35:32.411602+0000","last_became_peered":"2024-09-17T03:35:32.411602+0000","last_unstale":"2024-09-17T03:35:38.329516+0000","last_undegraded":"2024-09-17T03:35:38.329516+0000","last_fullsized":"2024-09-17T03:35:38.329516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:41.794850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716873+0000","last_change":"2024-09-17T03:35:31.405777+0000","last_active":"2024-09-17T03:35:37.716873+0000","last_peered":"2024-09-17T03:35:37.716873+0000","last_clean":"2024-09-17T03:35:37.716873+0000","last_became_active":"2024-09-17T03:35:31.400954+0000","last_became_peered":"2024-09-17T03:35:31.400954+0000","last_unstale":"2024-09-17T03:35:37.716873+0000","last_undegraded":"2024-09-17T03:35:37.716873+0000","last_fullsized":"2024-09-17T03:35:37.716873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:50.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328929+0000","last_change":"2024-09-17T03:35:36.442849+0000","last_active":"2024-09-17T03:35:38.328929+0000","last_peered":"2024-09-17T03:35:38.328929+0000","last_clean":"2024-09-17T03:35:38.328929+0000","last_became_active":"2024-09-17T03:35:36.442373+0000","last_became_peered":"2024-09-17T03:35:36.442373+0000","last_unstale":"2024-09-17T03:35:38.328929+0000","last_undegraded":"2024-09-17T03:35:38.328929+0000","last_fullsized":"2024-09-17T03:35:38.328929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:31.462450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423856+0000","last_change":"2024-09-17T03:35:32.421334+0000","last_active":"2024-09-17T03:35:37.423856+0000","last_peered":"2024-09-17T03:35:37.423856+0000","last_clean":"2024-09-17T03:35:37.423856+0000","last_became_active":"2024-09-17T03:35:32.417735+0000","last_became_peered":"2024-09-17T03:35:32.417735+0000","last_unstale":"2024-09-17T03:35:37.423856+0000","last_undegraded":"2024-09-17T03:35:37.423856+0000","last_fullsized":"2024-09-17T03:35:37.423856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:38.772375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952012+0000","last_change":"2024-09-17T03:35:31.393984+0000","last_active":"2024-09-17T03:35:37.952012+0000","last_peered":"2024-09-17T03:35:37.952012+0000","last_clean":"2024-09-17T03:35:37.952012+0000","last_became_active":"2024-09-17T03:35:31.393359+0000","last_became_peered":"2024-09-17T03:35:31.393359+0000","last_unstale":"2024-09-17T03:35:37.952012+0000","last_undegraded":"2024-09-17T03:35:37.952012+0000","last_fullsized":"2024-09-17T03:35:37.952012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:29.238819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430527+0000","last_change":"2024-09-17T03:35:36.446882+0000","last_active":"2024-09-17T03:35:37.430527+0000","last_peered":"2024-09-17T03:35:37.430527+0000","last_clean":"2024-09-17T03:35:37.430527+0000","last_became_active":"2024-09-17T03:35:36.445788+0000","last_became_peered":"2024-09-17T03:35:36.445788+0000","last_unstale":"2024-09-17T03:35:37.430527+0000","last_undegraded":"2024-09-17T03:35:37.430527+0000","last_fullsized":"2024-09-17T03:35:37.430527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:46.475925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328438+0000","last_change":"2024-09-17T03:35:32.402001+0000","last_active":"2024-09-17T03:35:38.328438+0000","last_peered":"2024-09-17T03:35:38.328438+0000","last_clean":"2024-09-17T03:35:38.328438+0000","last_became_active":"2024-09-17T03:35:32.401658+0000","last_became_peered":"2024-09-17T03:35:32.401658+0000","last_unstale":"2024-09-17T03:35:38.328438+0000","last_undegraded":"2024-09-17T03:35:38.328438+0000","last_fullsized":"2024-09-17T03:35:38.328438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:51.388149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716519+0000","last_change":"2024-09-17T03:35:31.400527+0000","last_active":"2024-09-17T03:35:37.716519+0000","last_peered":"2024-09-17T03:35:37.716519+0000","last_clean":"2024-09-17T03:35:37.716519+0000","last_became_active":"2024-09-17T03:35:31.399807+0000","last_became_peered":"2024-09-17T03:35:31.399807+0000","last_unstale":"2024-09-17T03:35:37.716519+0000","last_undegraded":"2024-09-17T03:35:37.716519+0000","last_fullsized":"2024-09-17T03:35:37.716519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:08.586529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.431087+0000","last_change":"2024-09-17T03:35:36.449338+0000","last_active":"2024-09-17T03:35:37.431087+0000","last_peered":"2024-09-17T03:35:37.431087+0000","last_clean":"2024-09-17T03:35:37.431087+0000","last_became_active":"2024-09-17T03:35:36.448829+0000","last_became_peered":"2024-09-17T03:35:36.448829+0000","last_unstale":"2024-09-17T03:35:37.431087+0000","last_undegraded":"2024-09-17T03:35:37.431087+0000","last_fullsized":"2024-09-17T03:35:37.431087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:30.201889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423978+0000","last_change":"2024-09-17T03:35:32.415025+0000","last_active":"2024-09-17T03:35:37.423978+0000","last_peered":"2024-09-17T03:35:37.423978+0000","last_clean":"2024-09-17T03:35:37.423978+0000","last_became_active":"2024-09-17T03:35:32.399484+0000","last_became_peered":"2024-09-17T03:35:32.399484+0000","last_unstale":"2024-09-17T03:35:37.423978+0000","last_undegraded":"2024-09-17T03:35:37.423978+0000","last_fullsized":"2024-09-17T03:35:37.423978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:06.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424580+0000","last_change":"2024-09-17T03:35:31.393032+0000","last_active":"2024-09-17T03:35:37.424580+0000","last_peered":"2024-09-17T03:35:37.424580+0000","last_clean":"2024-09-17T03:35:37.424580+0000","last_became_active":"2024-09-17T03:35:31.392712+0000","last_became_peered":"2024-09-17T03:35:31.392712+0000","last_unstale":"2024-09-17T03:35:37.424580+0000","last_undegraded":"2024-09-17T03:35:37.424580+0000","last_fullsized":"2024-09-17T03:35:37.424580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:39.717069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430060+0000","last_change":"2024-09-17T03:35:36.448065+0000","last_active":"2024-09-17T03:35:37.430060+0000","last_peered":"2024-09-17T03:35:37.430060+0000","last_clean":"2024-09-17T03:35:37.430060+0000","last_became_active":"2024-09-17T03:35:36.440858+0000","last_became_peered":"2024-09-17T03:35:36.440858+0000","last_unstale":"2024-09-17T03:35:37.430060+0000","last_undegraded":"2024-09-17T03:35:37.430060+0000","last_fullsized":"2024-09-17T03:35:37.430060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:38.791341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429471+0000","last_change":"2024-09-17T03:35:32.406664+0000","last_active":"2024-09-17T03:35:37.429471+0000","last_peered":"2024-09-17T03:35:37.429471+0000","last_clean":"2024-09-17T03:35:37.429471+0000","last_became_active":"2024-09-17T03:35:32.406094+0000","last_became_peered":"2024-09-17T03:35:32.406094+0000","last_unstale":"2024-09-17T03:35:37.429471+0000","last_undegraded":"2024-09-17T03:35:37.429471+0000","last_fullsized":"2024-09-17T03:35:37.429471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:58.630384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329699+0000","last_change":"2024-09-17T03:35:31.403376+0000","last_active":"2024-09-17T03:35:38.329699+0000","last_peered":"2024-09-17T03:35:38.329699+0000","last_clean":"2024-09-17T03:35:38.329699+0000","last_became_active":"2024-09-17T03:35:31.402949+0000","last_became_peered":"2024-09-17T03:35:31.402949+0000","last_unstale":"2024-09-17T03:35:38.329699+0000","last_undegraded":"2024-09-17T03:35:38.329699+0000","last_fullsized":"2024-09-17T03:35:38.329699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:18.331525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424293+0000","last_change":"2024-09-17T03:35:36.436078+0000","last_active":"2024-09-17T03:35:37.424293+0000","last_peered":"2024-09-17T03:35:37.424293+0000","last_clean":"2024-09-17T03:35:37.424293+0000","last_became_active":"2024-09-17T03:35:36.435669+0000","last_became_peered":"2024-09-17T03:35:36.435669+0000","last_unstale":"2024-09-17T03:35:37.424293+0000","last_undegraded":"2024-09-17T03:35:37.424293+0000","last_fullsized":"2024-09-17T03:35:37.424293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:07.115777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716542+0000","last_change":"2024-09-17T03:35:32.402486+0000","last_active":"2024-09-17T03:35:37.716542+0000","last_peered":"2024-09-17T03:35:37.716542+0000","last_clean":"2024-09-17T03:35:37.716542+0000","last_became_active":"2024-09-17T03:35:32.402185+0000","last_became_peered":"2024-09-17T03:35:32.402185+0000","last_unstale":"2024-09-17T03:35:37.716542+0000","last_undegraded":"2024-09-17T03:35:37.716542+0000","last_fullsized":"2024-09-17T03:35:37.716542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:38.772375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:45.296364+0000","last_change":"2024-09-17T03:35:31.400849+0000","last_active":"2024-09-17T03:35:45.296364+0000","last_peered":"2024-09-17T03:35:45.296364+0000","last_clean":"2024-09-17T03:35:45.296364+0000","last_became_active":"2024-09-17T03:35:31.399182+0000","last_became_peered":"2024-09-17T03:35:31.399182+0000","last_unstale":"2024-09-17T03:35:45.296364+0000","last_undegraded":"2024-09-17T03:35:45.296364+0000","last_fullsized":"2024-09-17T03:35:45.296364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:48.258646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952056+0000","last_change":"2024-09-17T03:35:36.433789+0000","last_active":"2024-09-17T03:35:37.952056+0000","last_peered":"2024-09-17T03:35:37.952056+0000","last_clean":"2024-09-17T03:35:37.952056+0000","last_became_active":"2024-09-17T03:35:36.433154+0000","last_became_peered":"2024-09-17T03:35:36.433154+0000","last_unstale":"2024-09-17T03:35:37.952056+0000","last_undegraded":"2024-09-17T03:35:37.952056+0000","last_fullsized":"2024-09-17T03:35:37.952056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:25.543856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424094+0000","last_change":"2024-09-17T03:35:32.400635+0000","last_active":"2024-09-17T03:35:37.424094+0000","last_peered":"2024-09-17T03:35:37.424094+0000","last_clean":"2024-09-17T03:35:37.424094+0000","last_became_active":"2024-09-17T03:35:32.393225+0000","last_became_peered":"2024-09-17T03:35:32.393225+0000","last_unstale":"2024-09-17T03:35:37.424094+0000","last_undegraded":"2024-09-17T03:35:37.424094+0000","last_fullsized":"2024-09-17T03:35:37.424094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:08.018673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329974+0000","last_change":"2024-09-17T03:35:31.391917+0000","last_active":"2024-09-17T03:35:38.329974+0000","last_peered":"2024-09-17T03:35:38.329974+0000","last_clean":"2024-09-17T03:35:38.329974+0000","last_became_active":"2024-09-17T03:35:31.390310+0000","last_became_peered":"2024-09-17T03:35:31.390310+0000","last_unstale":"2024-09-17T03:35:38.329974+0000","last_undegraded":"2024-09-17T03:35:38.329974+0000","last_fullsized":"2024-09-17T03:35:38.329974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329447+0000","last_change":"2024-09-17T03:35:36.452480+0000","last_active":"2024-09-17T03:35:38.329447+0000","last_peered":"2024-09-17T03:35:38.329447+0000","last_clean":"2024-09-17T03:35:38.329447+0000","last_became_active":"2024-09-17T03:35:36.452057+0000","last_became_peered":"2024-09-17T03:35:36.452057+0000","last_unstale":"2024-09-17T03:35:38.329447+0000","last_undegraded":"2024-09-17T03:35:38.329447+0000","last_fullsized":"2024-09-17T03:35:38.329447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:02.864287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.431137+0000","last_change":"2024-09-17T03:35:32.420703+0000","last_active":"2024-09-17T03:35:37.431137+0000","last_peered":"2024-09-17T03:35:37.431137+0000","last_clean":"2024-09-17T03:35:37.431137+0000","last_became_active":"2024-09-17T03:35:32.420467+0000","last_became_peered":"2024-09-17T03:35:32.420467+0000","last_unstale":"2024-09-17T03:35:37.431137+0000","last_undegraded":"2024-09-17T03:35:37.431137+0000","last_fullsized":"2024-09-17T03:35:37.431137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:08.429869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716577+0000","last_change":"2024-09-17T03:35:31.407562+0000","last_active":"2024-09-17T03:35:37.716577+0000","last_peered":"2024-09-17T03:35:37.716577+0000","last_clean":"2024-09-17T03:35:37.716577+0000","last_became_active":"2024-09-17T03:35:31.405639+0000","last_became_peered":"2024-09-17T03:35:31.405639+0000","last_unstale":"2024-09-17T03:35:37.716577+0000","last_undegraded":"2024-09-17T03:35:37.716577+0000","last_fullsized":"2024-09-17T03:35:37.716577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:16.036571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329103+0000","last_change":"2024-09-17T03:35:36.457602+0000","last_active":"2024-09-17T03:35:38.329103+0000","last_peered":"2024-09-17T03:35:38.329103+0000","last_clean":"2024-09-17T03:35:38.329103+0000","last_became_active":"2024-09-17T03:35:36.455212+0000","last_became_peered":"2024-09-17T03:35:36.455212+0000","last_unstale":"2024-09-17T03:35:38.329103+0000","last_undegraded":"2024-09-17T03:35:38.329103+0000","last_fullsized":"2024-09-17T03:35:38.329103+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:07.594543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329415+0000","last_change":"2024-09-17T03:35:32.407130+0000","last_active":"2024-09-17T03:35:38.329415+0000","last_peered":"2024-09-17T03:35:38.329415+0000","last_clean":"2024-09-17T03:35:38.329415+0000","last_became_active":"2024-09-17T03:35:32.391848+0000","last_became_peered":"2024-09-17T03:35:32.391848+0000","last_unstale":"2024-09-17T03:35:38.329415+0000","last_undegraded":"2024-09-17T03:35:38.329415+0000","last_fullsized":"2024-09-17T03:35:38.329415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:08.067720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329651+0000","last_change":"2024-09-17T03:35:31.390094+0000","last_active":"2024-09-17T03:35:38.329651+0000","last_peered":"2024-09-17T03:35:38.329651+0000","last_clean":"2024-09-17T03:35:38.329651+0000","last_became_active":"2024-09-17T03:35:31.389803+0000","last_became_peered":"2024-09-17T03:35:31.389803+0000","last_unstale":"2024-09-17T03:35:38.329651+0000","last_undegraded":"2024-09-17T03:35:38.329651+0000","last_fullsized":"2024-09-17T03:35:38.329651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:52.836647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952214+0000","last_change":"2024-09-17T03:35:36.437757+0000","last_active":"2024-09-17T03:35:37.952214+0000","last_peered":"2024-09-17T03:35:37.952214+0000","last_clean":"2024-09-17T03:35:37.952214+0000","last_became_active":"2024-09-17T03:35:36.435609+0000","last_became_peered":"2024-09-17T03:35:36.435609+0000","last_unstale":"2024-09-17T03:35:37.952214+0000","last_undegraded":"2024-09-17T03:35:37.952214+0000","last_fullsized":"2024-09-17T03:35:37.952214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:09.118896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952718+0000","last_change":"2024-09-17T03:35:36.442334+0000","last_active":"2024-09-17T03:35:37.952718+0000","last_peered":"2024-09-17T03:35:37.952718+0000","last_clean":"2024-09-17T03:35:37.952718+0000","last_became_active":"2024-09-17T03:35:36.441896+0000","last_became_peered":"2024-09-17T03:35:36.441896+0000","last_unstale":"2024-09-17T03:35:37.952718+0000","last_undegraded":"2024-09-17T03:35:37.952718+0000","last_fullsized":"2024-09-17T03:35:37.952718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:22.644001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952084+0000","last_change":"2024-09-17T03:35:32.403467+0000","last_active":"2024-09-17T03:35:37.952084+0000","last_peered":"2024-09-17T03:35:37.952084+0000","last_clean":"2024-09-17T03:35:37.952084+0000","last_became_active":"2024-09-17T03:35:32.403114+0000","last_became_peered":"2024-09-17T03:35:32.403114+0000","last_unstale":"2024-09-17T03:35:37.952084+0000","last_undegraded":"2024-09-17T03:35:37.952084+0000","last_fullsized":"2024-09-17T03:35:37.952084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:55.954409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424195+0000","last_change":"2024-09-17T03:35:31.404636+0000","last_active":"2024-09-17T03:35:37.424195+0000","last_peered":"2024-09-17T03:35:37.424195+0000","last_clean":"2024-09-17T03:35:37.424195+0000","last_became_active":"2024-09-17T03:35:31.404277+0000","last_became_peered":"2024-09-17T03:35:31.404277+0000","last_unstale":"2024-09-17T03:35:37.424195+0000","last_undegraded":"2024-09-17T03:35:37.424195+0000","last_fullsized":"2024-09-17T03:35:37.424195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:40.786182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424417+0000","last_change":"2024-09-17T03:35:36.433455+0000","last_active":"2024-09-17T03:35:37.424417+0000","last_peered":"2024-09-17T03:35:37.424417+0000","last_clean":"2024-09-17T03:35:37.424417+0000","last_became_active":"2024-09-17T03:35:36.433005+0000","last_became_peered":"2024-09-17T03:35:36.433005+0000","last_unstale":"2024-09-17T03:35:37.424417+0000","last_undegraded":"2024-09-17T03:35:37.424417+0000","last_fullsized":"2024-09-17T03:35:37.424417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:02.604817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428484+0000","last_change":"2024-09-17T03:35:32.399932+0000","last_active":"2024-09-17T03:35:37.428484+0000","last_peered":"2024-09-17T03:35:37.428484+0000","last_clean":"2024-09-17T03:35:37.428484+0000","last_became_active":"2024-09-17T03:35:32.399566+0000","last_became_peered":"2024-09-17T03:35:32.399566+0000","last_unstale":"2024-09-17T03:35:37.428484+0000","last_undegraded":"2024-09-17T03:35:37.428484+0000","last_fullsized":"2024-09-17T03:35:37.428484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:32.277026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428581+0000","last_change":"2024-09-17T03:35:31.407319+0000","last_active":"2024-09-17T03:35:37.428581+0000","last_peered":"2024-09-17T03:35:37.428581+0000","last_clean":"2024-09-17T03:35:37.428581+0000","last_became_active":"2024-09-17T03:35:31.407022+0000","last_became_peered":"2024-09-17T03:35:31.407022+0000","last_unstale":"2024-09-17T03:35:37.428581+0000","last_undegraded":"2024-09-17T03:35:37.428581+0000","last_fullsized":"2024-09-17T03:35:37.428581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:18.331525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424464+0000","last_change":"2024-09-17T03:35:31.408471+0000","last_active":"2024-09-17T03:35:37.424464+0000","last_peered":"2024-09-17T03:35:37.424464+0000","last_clean":"2024-09-17T03:35:37.424464+0000","last_became_active":"2024-09-17T03:35:31.408242+0000","last_became_peered":"2024-09-17T03:35:31.408242+0000","last_unstale":"2024-09-17T03:35:37.424464+0000","last_undegraded":"2024-09-17T03:35:37.424464+0000","last_fullsized":"2024-09-17T03:35:37.424464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:48.043675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952411+0000","last_change":"2024-09-17T03:35:32.402827+0000","last_active":"2024-09-17T03:35:37.952411+0000","last_peered":"2024-09-17T03:35:37.952411+0000","last_clean":"2024-09-17T03:35:37.952411+0000","last_became_active":"2024-09-17T03:35:32.402121+0000","last_became_peered":"2024-09-17T03:35:32.402121+0000","last_unstale":"2024-09-17T03:35:37.952411+0000","last_undegraded":"2024-09-17T03:35:37.952411+0000","last_fullsized":"2024-09-17T03:35:37.952411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:20.996960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952548+0000","last_change":"2024-09-17T03:35:36.438086+0000","last_active":"2024-09-17T03:35:37.952548+0000","last_peered":"2024-09-17T03:35:37.952548+0000","last_clean":"2024-09-17T03:35:37.952548+0000","last_became_active":"2024-09-17T03:35:36.437628+0000","last_became_peered":"2024-09-17T03:35:36.437628+0000","last_unstale":"2024-09-17T03:35:37.952548+0000","last_undegraded":"2024-09-17T03:35:37.952548+0000","last_fullsized":"2024-09-17T03:35:37.952548+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:41.129499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429911+0000","last_change":"2024-09-17T03:35:31.400851+0000","last_active":"2024-09-17T03:35:37.429911+0000","last_peered":"2024-09-17T03:35:37.429911+0000","last_clean":"2024-09-17T03:35:37.429911+0000","last_became_active":"2024-09-17T03:35:31.400467+0000","last_became_peered":"2024-09-17T03:35:31.400467+0000","last_unstale":"2024-09-17T03:35:37.429911+0000","last_undegraded":"2024-09-17T03:35:37.429911+0000","last_fullsized":"2024-09-17T03:35:37.429911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.353978+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.353978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:34.200886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328979+0000","last_change":"2024-09-17T03:35:32.415316+0000","last_active":"2024-09-17T03:35:38.328979+0000","last_peered":"2024-09-17T03:35:38.328979+0000","last_clean":"2024-09-17T03:35:38.328979+0000","last_became_active":"2024-09-17T03:35:32.415012+0000","last_became_peered":"2024-09-17T03:35:32.415012+0000","last_unstale":"2024-09-17T03:35:38.328979+0000","last_undegraded":"2024-09-17T03:35:38.328979+0000","last_fullsized":"2024-09-17T03:35:38.328979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:49.052343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329826+0000","last_change":"2024-09-17T03:35:36.458591+0000","last_active":"2024-09-17T03:35:38.329826+0000","last_peered":"2024-09-17T03:35:38.329826+0000","last_clean":"2024-09-17T03:35:38.329826+0000","last_became_active":"2024-09-17T03:35:36.458192+0000","last_became_peered":"2024-09-17T03:35:36.458192+0000","last_unstale":"2024-09-17T03:35:38.329826+0000","last_undegraded":"2024-09-17T03:35:38.329826+0000","last_fullsized":"2024-09-17T03:35:38.329826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:35.399325+0000","last_clean_scrub_stamp":"2024-09-17T03:35:35.399325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:28.725625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328670+0000","last_change":"2024-09-17T03:35:32.389432+0000","last_active":"2024-09-17T03:35:38.328670+0000","last_peered":"2024-09-17T03:35:38.328670+0000","last_clean":"2024-09-17T03:35:38.328670+0000","last_became_active":"2024-09-17T03:35:32.389081+0000","last_became_peered":"2024-09-17T03:35:32.389081+0000","last_unstale":"2024-09-17T03:35:38.328670+0000","last_undegraded":"2024-09-17T03:35:38.328670+0000","last_fullsized":"2024-09-17T03:35:38.328670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:13.264493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329236+0000","last_change":"2024-09-17T03:35:32.390231+0000","last_active":"2024-09-17T03:35:38.329236+0000","last_peered":"2024-09-17T03:35:38.329236+0000","last_clean":"2024-09-17T03:35:38.329236+0000","last_became_active":"2024-09-17T03:35:32.389090+0000","last_became_peered":"2024-09-17T03:35:32.389090+0000","last_unstale":"2024-09-17T03:35:38.329236+0000","last_undegraded":"2024-09-17T03:35:38.329236+0000","last_fullsized":"2024-09-17T03:35:38.329236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:51.388149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423992+0000","last_change":"2024-09-17T03:35:32.417536+0000","last_active":"2024-09-17T03:35:37.423992+0000","last_peered":"2024-09-17T03:35:37.423992+0000","last_clean":"2024-09-17T03:35:37.423992+0000","last_became_active":"2024-09-17T03:35:32.415503+0000","last_became_peered":"2024-09-17T03:35:32.415503+0000","last_unstale":"2024-09-17T03:35:37.423992+0000","last_undegraded":"2024-09-17T03:35:37.423992+0000","last_fullsized":"2024-09-17T03:35:37.423992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:53.931551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429727+0000","last_change":"2024-09-17T03:35:32.417567+0000","last_active":"2024-09-17T03:35:37.429727+0000","last_peered":"2024-09-17T03:35:37.429727+0000","last_clean":"2024-09-17T03:35:37.429727+0000","last_became_active":"2024-09-17T03:35:32.416075+0000","last_became_peered":"2024-09-17T03:35:32.416075+0000","last_unstale":"2024-09-17T03:35:37.429727+0000","last_undegraded":"2024-09-17T03:35:37.429727+0000","last_fullsized":"2024-09-17T03:35:37.429727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:17.725156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430354+0000","last_change":"2024-09-17T03:35:32.398186+0000","last_active":"2024-09-17T03:35:37.430354+0000","last_peered":"2024-09-17T03:35:37.430354+0000","last_clean":"2024-09-17T03:35:37.430354+0000","last_became_active":"2024-09-17T03:35:32.397332+0000","last_became_peered":"2024-09-17T03:35:32.397332+0000","last_unstale":"2024-09-17T03:35:37.430354+0000","last_undegraded":"2024-09-17T03:35:37.430354+0000","last_fullsized":"2024-09-17T03:35:37.430354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:24.688946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.429638+0000","last_change":"2024-09-17T03:35:32.398824+0000","last_active":"2024-09-17T03:35:37.429638+0000","last_peered":"2024-09-17T03:35:37.429638+0000","last_clean":"2024-09-17T03:35:37.429638+0000","last_became_active":"2024-09-17T03:35:32.398561+0000","last_became_peered":"2024-09-17T03:35:32.398561+0000","last_unstale":"2024-09-17T03:35:37.429638+0000","last_undegraded":"2024-09-17T03:35:37.429638+0000","last_fullsized":"2024-09-17T03:35:37.429638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:21.967856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329314+0000","last_change":"2024-09-17T03:35:32.407437+0000","last_active":"2024-09-17T03:35:38.329314+0000","last_peered":"2024-09-17T03:35:38.329314+0000","last_clean":"2024-09-17T03:35:38.329314+0000","last_became_active":"2024-09-17T03:35:32.391983+0000","last_became_peered":"2024-09-17T03:35:32.391983+0000","last_unstale":"2024-09-17T03:35:38.329314+0000","last_undegraded":"2024-09-17T03:35:38.329314+0000","last_fullsized":"2024-09-17T03:35:38.329314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:55.435612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430853+0000","last_change":"2024-09-17T03:35:32.420028+0000","last_active":"2024-09-17T03:35:37.430853+0000","last_peered":"2024-09-17T03:35:37.430853+0000","last_clean":"2024-09-17T03:35:37.430853+0000","last_became_active":"2024-09-17T03:35:32.419318+0000","last_became_peered":"2024-09-17T03:35:32.419318+0000","last_unstale":"2024-09-17T03:35:37.430853+0000","last_undegraded":"2024-09-17T03:35:37.430853+0000","last_fullsized":"2024-09-17T03:35:37.430853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:34.754662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423939+0000","last_change":"2024-09-17T03:35:32.404124+0000","last_active":"2024-09-17T03:35:37.423939+0000","last_peered":"2024-09-17T03:35:37.423939+0000","last_clean":"2024-09-17T03:35:37.423939+0000","last_became_active":"2024-09-17T03:35:32.401565+0000","last_became_peered":"2024-09-17T03:35:32.401565+0000","last_unstale":"2024-09-17T03:35:37.423939+0000","last_undegraded":"2024-09-17T03:35:37.423939+0000","last_fullsized":"2024-09-17T03:35:37.423939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:08.190698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428668+0000","last_change":"2024-09-17T03:35:32.416911+0000","last_active":"2024-09-17T03:35:37.428668+0000","last_peered":"2024-09-17T03:35:37.428668+0000","last_clean":"2024-09-17T03:35:37.428668+0000","last_became_active":"2024-09-17T03:35:32.416607+0000","last_became_peered":"2024-09-17T03:35:32.416607+0000","last_unstale":"2024-09-17T03:35:37.428668+0000","last_undegraded":"2024-09-17T03:35:37.428668+0000","last_fullsized":"2024-09-17T03:35:37.428668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:35.823308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.328868+0000","last_change":"2024-09-17T03:35:32.402977+0000","last_active":"2024-09-17T03:35:38.328868+0000","last_peered":"2024-09-17T03:35:38.328868+0000","last_clean":"2024-09-17T03:35:38.328868+0000","last_became_active":"2024-09-17T03:35:32.400089+0000","last_became_peered":"2024-09-17T03:35:32.400089+0000","last_unstale":"2024-09-17T03:35:38.328868+0000","last_undegraded":"2024-09-17T03:35:38.328868+0000","last_fullsized":"2024-09-17T03:35:38.328868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:09.595197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.952307+0000","last_change":"2024-09-17T03:35:32.410415+0000","last_active":"2024-09-17T03:35:37.952307+0000","last_peered":"2024-09-17T03:35:37.952307+0000","last_clean":"2024-09-17T03:35:37.952307+0000","last_became_active":"2024-09-17T03:35:32.410050+0000","last_became_peered":"2024-09-17T03:35:32.410050+0000","last_unstale":"2024-09-17T03:35:37.952307+0000","last_undegraded":"2024-09-17T03:35:37.952307+0000","last_fullsized":"2024-09-17T03:35:37.952307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:50.438068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716881+0000","last_change":"2024-09-17T03:35:32.395551+0000","last_active":"2024-09-17T03:35:37.716881+0000","last_peered":"2024-09-17T03:35:37.716881+0000","last_clean":"2024-09-17T03:35:37.716881+0000","last_became_active":"2024-09-17T03:35:32.395266+0000","last_became_peered":"2024-09-17T03:35:32.395266+0000","last_unstale":"2024-09-17T03:35:37.716881+0000","last_undegraded":"2024-09-17T03:35:37.716881+0000","last_fullsized":"2024-09-17T03:35:37.716881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:54.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424777+0000","last_change":"2024-09-17T03:35:32.406349+0000","last_active":"2024-09-17T03:35:37.424777+0000","last_peered":"2024-09-17T03:35:37.424777+0000","last_clean":"2024-09-17T03:35:37.424777+0000","last_became_active":"2024-09-17T03:35:32.406083+0000","last_became_peered":"2024-09-17T03:35:32.406083+0000","last_unstale":"2024-09-17T03:35:37.424777+0000","last_undegraded":"2024-09-17T03:35:37.424777+0000","last_fullsized":"2024-09-17T03:35:37.424777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:28.801756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330010+0000","last_change":"2024-09-17T03:35:32.412025+0000","last_active":"2024-09-17T03:35:38.330010+0000","last_peered":"2024-09-17T03:35:38.330010+0000","last_clean":"2024-09-17T03:35:38.330010+0000","last_became_active":"2024-09-17T03:35:32.411770+0000","last_became_peered":"2024-09-17T03:35:32.411770+0000","last_unstale":"2024-09-17T03:35:38.330010+0000","last_undegraded":"2024-09-17T03:35:38.330010+0000","last_fullsized":"2024-09-17T03:35:38.330010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:49.040918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.424666+0000","last_change":"2024-09-17T03:35:32.405664+0000","last_active":"2024-09-17T03:35:37.424666+0000","last_peered":"2024-09-17T03:35:37.424666+0000","last_clean":"2024-09-17T03:35:37.424666+0000","last_became_active":"2024-09-17T03:35:32.401871+0000","last_became_peered":"2024-09-17T03:35:32.401871+0000","last_unstale":"2024-09-17T03:35:37.424666+0000","last_undegraded":"2024-09-17T03:35:37.424666+0000","last_fullsized":"2024-09-17T03:35:37.424666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:11.878974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.423851+0000","last_change":"2024-09-17T03:35:32.421664+0000","last_active":"2024-09-17T03:35:37.423851+0000","last_peered":"2024-09-17T03:35:37.423851+0000","last_clean":"2024-09-17T03:35:37.423851+0000","last_became_active":"2024-09-17T03:35:32.416736+0000","last_became_peered":"2024-09-17T03:35:32.416736+0000","last_unstale":"2024-09-17T03:35:37.423851+0000","last_undegraded":"2024-09-17T03:35:37.423851+0000","last_fullsized":"2024-09-17T03:35:37.423851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:42.709250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428434+0000","last_change":"2024-09-17T03:35:32.401461+0000","last_active":"2024-09-17T03:35:37.428434+0000","last_peered":"2024-09-17T03:35:37.428434+0000","last_clean":"2024-09-17T03:35:37.428434+0000","last_became_active":"2024-09-17T03:35:32.400913+0000","last_became_peered":"2024-09-17T03:35:32.400913+0000","last_unstale":"2024-09-17T03:35:37.428434+0000","last_undegraded":"2024-09-17T03:35:37.428434+0000","last_fullsized":"2024-09-17T03:35:37.428434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:50.140695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428853+0000","last_change":"2024-09-17T03:35:32.388327+0000","last_active":"2024-09-17T03:35:37.428853+0000","last_peered":"2024-09-17T03:35:37.428853+0000","last_clean":"2024-09-17T03:35:37.428853+0000","last_became_active":"2024-09-17T03:35:32.387938+0000","last_became_peered":"2024-09-17T03:35:32.387938+0000","last_unstale":"2024-09-17T03:35:37.428853+0000","last_undegraded":"2024-09-17T03:35:37.428853+0000","last_fullsized":"2024-09-17T03:35:37.428853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:08.067720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430492+0000","last_change":"2024-09-17T03:35:32.397331+0000","last_active":"2024-09-17T03:35:37.430492+0000","last_peered":"2024-09-17T03:35:37.430492+0000","last_clean":"2024-09-17T03:35:37.430492+0000","last_became_active":"2024-09-17T03:35:32.395724+0000","last_became_peered":"2024-09-17T03:35:32.395724+0000","last_unstale":"2024-09-17T03:35:37.430492+0000","last_undegraded":"2024-09-17T03:35:37.430492+0000","last_fullsized":"2024-09-17T03:35:37.430492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:41.794850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716601+0000","last_change":"2024-09-17T03:35:32.395931+0000","last_active":"2024-09-17T03:35:37.716601+0000","last_peered":"2024-09-17T03:35:37.716601+0000","last_clean":"2024-09-17T03:35:37.716601+0000","last_became_active":"2024-09-17T03:35:32.395572+0000","last_became_peered":"2024-09-17T03:35:32.395572+0000","last_unstale":"2024-09-17T03:35:37.716601+0000","last_undegraded":"2024-09-17T03:35:37.716601+0000","last_fullsized":"2024-09-17T03:35:37.716601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:50.658760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716469+0000","last_change":"2024-09-17T03:35:32.398836+0000","last_active":"2024-09-17T03:35:37.716469+0000","last_peered":"2024-09-17T03:35:37.716469+0000","last_clean":"2024-09-17T03:35:37.716469+0000","last_became_active":"2024-09-17T03:35:32.398500+0000","last_became_peered":"2024-09-17T03:35:32.398500+0000","last_unstale":"2024-09-17T03:35:37.716469+0000","last_undegraded":"2024-09-17T03:35:37.716469+0000","last_fullsized":"2024-09-17T03:35:37.716469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:49.687153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716483+0000","last_change":"2024-09-17T03:35:32.414484+0000","last_active":"2024-09-17T03:35:37.716483+0000","last_peered":"2024-09-17T03:35:37.716483+0000","last_clean":"2024-09-17T03:35:37.716483+0000","last_became_active":"2024-09-17T03:35:32.414165+0000","last_became_peered":"2024-09-17T03:35:32.414165+0000","last_unstale":"2024-09-17T03:35:37.716483+0000","last_undegraded":"2024-09-17T03:35:37.716483+0000","last_fullsized":"2024-09-17T03:35:37.716483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:06.302067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329649+0000","last_change":"2024-09-17T03:35:32.396020+0000","last_active":"2024-09-17T03:35:38.329649+0000","last_peered":"2024-09-17T03:35:38.329649+0000","last_clean":"2024-09-17T03:35:38.329649+0000","last_became_active":"2024-09-17T03:35:32.395701+0000","last_became_peered":"2024-09-17T03:35:32.395701+0000","last_unstale":"2024-09-17T03:35:38.329649+0000","last_undegraded":"2024-09-17T03:35:38.329649+0000","last_fullsized":"2024-09-17T03:35:38.329649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:44.791275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.428123+0000","last_change":"2024-09-17T03:35:32.405817+0000","last_active":"2024-09-17T03:35:37.428123+0000","last_peered":"2024-09-17T03:35:37.428123+0000","last_clean":"2024-09-17T03:35:37.428123+0000","last_became_active":"2024-09-17T03:35:32.401125+0000","last_became_peered":"2024-09-17T03:35:32.401125+0000","last_unstale":"2024-09-17T03:35:37.428123+0000","last_undegraded":"2024-09-17T03:35:37.428123+0000","last_fullsized":"2024-09-17T03:35:37.428123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:44.639162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716409+0000","last_change":"2024-09-17T03:35:32.406706+0000","last_active":"2024-09-17T03:35:37.716409+0000","last_peered":"2024-09-17T03:35:37.716409+0000","last_clean":"2024-09-17T03:35:37.716409+0000","last_became_active":"2024-09-17T03:35:32.406380+0000","last_became_peered":"2024-09-17T03:35:32.406380+0000","last_unstale":"2024-09-17T03:35:37.716409+0000","last_undegraded":"2024-09-17T03:35:37.716409+0000","last_fullsized":"2024-09-17T03:35:37.716409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:35.823308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.330231+0000","last_change":"2024-09-17T03:35:32.409026+0000","last_active":"2024-09-17T03:35:38.330231+0000","last_peered":"2024-09-17T03:35:38.330231+0000","last_clean":"2024-09-17T03:35:38.330231+0000","last_became_active":"2024-09-17T03:35:32.408678+0000","last_became_peered":"2024-09-17T03:35:32.408678+0000","last_unstale":"2024-09-17T03:35:38.330231+0000","last_undegraded":"2024-09-17T03:35:38.330231+0000","last_fullsized":"2024-09-17T03:35:38.330231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:57.780295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716319+0000","last_change":"2024-09-17T03:35:32.417998+0000","last_active":"2024-09-17T03:35:37.716319+0000","last_peered":"2024-09-17T03:35:37.716319+0000","last_clean":"2024-09-17T03:35:37.716319+0000","last_became_active":"2024-09-17T03:35:32.417698+0000","last_became_peered":"2024-09-17T03:35:32.417698+0000","last_unstale":"2024-09-17T03:35:37.716319+0000","last_undegraded":"2024-09-17T03:35:37.716319+0000","last_fullsized":"2024-09-17T03:35:37.716319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:17.076410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:38.329887+0000","last_change":"2024-09-17T03:35:32.400692+0000","last_active":"2024-09-17T03:35:38.329887+0000","last_peered":"2024-09-17T03:35:38.329887+0000","last_clean":"2024-09-17T03:35:38.329887+0000","last_became_active":"2024-09-17T03:35:32.400221+0000","last_became_peered":"2024-09-17T03:35:32.400221+0000","last_unstale":"2024-09-17T03:35:38.329887+0000","last_undegraded":"2024-09-17T03:35:38.329887+0000","last_fullsized":"2024-09-17T03:35:38.329887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:26.763129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430145+0000","last_change":"2024-09-17T03:35:32.415375+0000","last_active":"2024-09-17T03:35:37.430145+0000","last_peered":"2024-09-17T03:35:37.430145+0000","last_clean":"2024-09-17T03:35:37.430145+0000","last_became_active":"2024-09-17T03:35:32.415017+0000","last_became_peered":"2024-09-17T03:35:32.415017+0000","last_unstale":"2024-09-17T03:35:37.430145+0000","last_undegraded":"2024-09-17T03:35:37.430145+0000","last_fullsized":"2024-09-17T03:35:37.430145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:50.658760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.430308+0000","last_change":"2024-09-17T03:35:32.415726+0000","last_active":"2024-09-17T03:35:37.430308+0000","last_peered":"2024-09-17T03:35:37.430308+0000","last_clean":"2024-09-17T03:35:37.430308+0000","last_became_active":"2024-09-17T03:35:32.415405+0000","last_became_peered":"2024-09-17T03:35:32.415405+0000","last_unstale":"2024-09-17T03:35:37.430308+0000","last_undegraded":"2024-09-17T03:35:37.430308+0000","last_fullsized":"2024-09-17T03:35:37.430308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:54.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T03:35:37.716587+0000","last_change":"2024-09-17T03:35:32.398919+0000","last_active":"2024-09-17T03:35:37.716587+0000","last_peered":"2024-09-17T03:35:37.716587+0000","last_clean":"2024-09-17T03:35:37.716587+0000","last_became_active":"2024-09-17T03:35:32.398610+0000","last_became_peered":"2024-09-17T03:35:32.398610+0000","last_unstale":"2024-09-17T03:35:37.716587+0000","last_undegraded":"2024-09-17T03:35:37.716587+0000","last_fullsized":"2024-09-17T03:35:37.716587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:31.362646+0000","last_clean_scrub_stamp":"2024-09-17T03:35:31.362646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:32.277026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:03.652 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:36:03.652 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T03:36:03.652 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T03:36:03.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T03:36:03.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.906+0000 7f8d71400640 1 -- 172.21.15.121:0/4065876417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d6c15f5a0 msgr2=0x7f8d6c15f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:03.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.906+0000 7f8d71400640 1 --2- 172.21.15.121:0/4065876417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d6c15f5a0 0x7f8d6c15f9b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d64005fd0 tx=0x7f8d6402ab40 comp rx=0 tx=0).stop 2024-09-17T03:36:03.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.906+0000 7f8d71400640 1 -- 172.21.15.121:0/4065876417 shutdown_connections 2024-09-17T03:36:03.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.906+0000 7f8d71400640 1 --2- 172.21.15.121:0/4065876417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d6c15f5a0 0x7f8d6c15f9b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.906+0000 7f8d71400640 1 -- 172.21.15.121:0/4065876417 >> 172.21.15.121:0/4065876417 conn(0x7f8d6c0cca40 msgr2=0x7f8d6c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:03.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.906+0000 7f8d71400640 1 -- 172.21.15.121:0/4065876417 shutdown_connections 2024-09-17T03:36:03.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.906+0000 7f8d71400640 1 -- 172.21.15.121:0/4065876417 wait complete. 2024-09-17T03:36:03.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.908+0000 7f8d71400640 1 Processor -- start 2024-09-17T03:36:03.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.909+0000 7f8d71400640 1 -- start start 2024-09-17T03:36:03.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.910+0000 7f8d71400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d6c0cf930 0x7f8d6c0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.910+0000 7f8d71400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c15b9f0 0x7f8d6c1f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.910+0000 7f8d71400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c15f5a0 0x7f8d6c0741c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.910+0000 7f8d71400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c06df70 con 0x7f8d6c0cf930 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.910+0000 7f8d71400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c06ddf0 con 0x7f8d6c15b9f0 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.910+0000 7f8d71400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6c06e0f0 con 0x7f8d6c15f5a0 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.910+0000 7f8d6a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d6c0cf930 0x7f8d6c0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.910+0000 7f8d6a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d6c0cf930 0x7f8d6c0c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57958/0 (socket says 172.21.15.121:57958) 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.910+0000 7f8d6a800640 1 -- 172.21.15.121:0/3733169344 learned_addr learned my addr 172.21.15.121:0/3733169344 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d63e00640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c15b9f0 0x7f8d6c1f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d6b200640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c15f5a0 0x7f8d6c0741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d6a800640 1 -- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c15f5a0 msgr2=0x7f8d6c0741c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d6a800640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c15f5a0 0x7f8d6c0741c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d6a800640 1 -- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c15b9f0 msgr2=0x7f8d6c1f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:03.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d6a800640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c15b9f0 0x7f8d6c1f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:03.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d6a800640 1 -- 172.21.15.121:0/3733169344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c0c9df0 con 0x7f8d6c0cf930 2024-09-17T03:36:03.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d63e00640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c15b9f0 0x7f8d6c1f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:03.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d6a800640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d6c0cf930 0x7f8d6c0c7070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00c430 tx=0x7f8d5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:03.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d62a00640 1 -- 172.21.15.121:0/3733169344 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c017070 con 0x7f8d6c0cf930 2024-09-17T03:36:03.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d62a00640 1 -- 172.21.15.121:0/3733169344 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d5c0053c0 con 0x7f8d6c0cf930 2024-09-17T03:36:03.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d71400640 1 -- 172.21.15.121:0/3733169344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c0ca0d0 con 0x7f8d6c0cf930 2024-09-17T03:36:03.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.911+0000 7f8d62a00640 1 -- 172.21.15.121:0/3733169344 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c003850 con 0x7f8d6c0cf930 2024-09-17T03:36:03.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.912+0000 7f8d71400640 1 -- 172.21.15.121:0/3733169344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c0b30f0 con 0x7f8d6c0cf930 2024-09-17T03:36:03.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.913+0000 7f8d71400640 1 -- 172.21.15.121:0/3733169344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c06e5a0 con 0x7f8d6c0cf930 2024-09-17T03:36:03.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.914+0000 7f8d62a00640 1 -- 172.21.15.121:0/3733169344 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d5c01a070 con 0x7f8d6c0cf930 2024-09-17T03:36:03.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.915+0000 7f8d62a00640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d48078bc0 0x7f8d4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:03.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.915+0000 7f8d62a00640 1 -- 172.21.15.121:0/3733169344 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8d5c09a2e0 con 0x7f8d6c0cf930 2024-09-17T03:36:03.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.915+0000 7f8d63e00640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d48078bc0 0x7f8d4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:03.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.916+0000 7f8d63e00640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d48078bc0 0x7f8d4807b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c1582a0 tx=0x7f8d54009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:03.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:03.919+0000 7f8d62a00640 1 -- 172.21.15.121:0/3733169344 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8d5c061d90 con 0x7f8d6c0cf930 2024-09-17T03:36:04.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.138+0000 7f8d71400640 1 -- 172.21.15.121:0/3733169344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8d6c0cf5d0 con 0x7f8d6c0cf930 2024-09-17T03:36:04.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.139+0000 7f8d62a00640 1 -- 172.21.15.121:0/3733169344 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8d5c0667c0 con 0x7f8d6c0cf930 2024-09-17T03:36:04.139 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:04.139 INFO:teuthology.orchestra.run.smithi121.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T03:36:04.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 -- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d48078bc0 msgr2=0x7f8d4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d48078bc0 0x7f8d4807b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c1582a0 tx=0x7f8d54009040 comp rx=0 tx=0).stop 2024-09-17T03:36:04.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 -- 172.21.15.121:0/3733169344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d6c0cf930 msgr2=0x7f8d6c0c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d6c0cf930 0x7f8d6c0c7070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00c430 tx=0x7f8d5c00c8f0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 -- 172.21.15.121:0/3733169344 shutdown_connections 2024-09-17T03:36:04.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d6c15f5a0 0x7f8d6c0741c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d6c15b9f0 0x7f8d6c1f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d48078bc0 0x7f8d4807b0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 --2- 172.21.15.121:0/3733169344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d6c0cf930 0x7f8d6c0c7070 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 -- 172.21.15.121:0/3733169344 >> 172.21.15.121:0/3733169344 conn(0x7f8d6c0cca40 msgr2=0x7f8d6c0ca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:04.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 -- 172.21.15.121:0/3733169344 shutdown_connections 2024-09-17T03:36:04.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.141+0000 7f8d71400640 1 -- 172.21.15.121:0/3733169344 wait complete. 2024-09-17T03:36:04.167 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T03:36:04.167 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:04.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.385+0000 7f0fc0600640 1 -- 172.21.15.121:0/548861932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fb80cbc10 msgr2=0x7f0fb80cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.385+0000 7f0fc0600640 1 --2- 172.21.15.121:0/548861932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fb80cbc10 0x7f0fb80cc020 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8076390 tx=0x7f0fa402a560 comp rx=0 tx=0).stop 2024-09-17T03:36:04.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.385+0000 7f0fc0600640 1 -- 172.21.15.121:0/548861932 shutdown_connections 2024-09-17T03:36:04.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.385+0000 7f0fc0600640 1 --2- 172.21.15.121:0/548861932 >> v2:172.21.15.176:3300/0 conn(0x7f0fb806ddf0 0x7f0fb806e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.385+0000 7f0fc0600640 1 --2- 172.21.15.121:0/548861932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fb80cbc10 0x7f0fb80cc020 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.385+0000 7f0fc0600640 1 --2- 172.21.15.121:0/548861932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fb8074cb0 0x7f0fb8073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.385+0000 7f0fc0600640 1 -- 172.21.15.121:0/548861932 >> 172.21.15.121:0/548861932 conn(0x7f0fb80cca40 msgr2=0x7f0fb80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:04.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.385+0000 7f0fc0600640 1 -- 172.21.15.121:0/548861932 shutdown_connections 2024-09-17T03:36:04.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.385+0000 7f0fc0600640 1 -- 172.21.15.121:0/548861932 wait complete. 2024-09-17T03:36:04.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.388+0000 7f0fc0600640 1 Processor -- start 2024-09-17T03:36:04.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.388+0000 7f0fc0600640 1 -- start start 2024-09-17T03:36:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.389+0000 7f0fc0600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fb806ddf0 0x7f0fb81f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.389+0000 7f0fc0600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fb8074cb0 0x7f0fb81f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.389+0000 7f0fc0600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fb80cbc10 0x7f0fb81f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.389+0000 7f0fc0600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb806f170 con 0x7f0fb8074cb0 2024-09-17T03:36:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.389+0000 7f0fc0600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb806eff0 con 0x7f0fb80cbc10 2024-09-17T03:36:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.389+0000 7f0fc0600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb806f2f0 con 0x7f0fb806ddf0 2024-09-17T03:36:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fb8074cb0 0x7f0fb81f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbdc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fb806ddf0 0x7f0fb81f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fb8074cb0 0x7f0fb81f8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57974/0 (socket says 172.21.15.121:57974) 2024-09-17T03:36:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbd200640 1 -- 172.21.15.121:0/887759430 learned_addr learned my addr 172.21.15.121:0/887759430 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbe600640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fb80cbc10 0x7f0fb81f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbd200640 1 -- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fb806ddf0 msgr2=0x7f0fb81f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbd200640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fb806ddf0 0x7f0fb81f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbd200640 1 -- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fb80cbc10 msgr2=0x7f0fb81f9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbd200640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fb80cbc10 0x7f0fb81f9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbd200640 1 -- 172.21.15.121:0/887759430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb809b270 con 0x7f0fb8074cb0 2024-09-17T03:36:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.390+0000 7f0fbd200640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fb8074cb0 0x7f0fb81f8d50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40099c0 tx=0x7f0fa40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:04.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.391+0000 7f0fb5600640 1 -- 172.21.15.121:0/887759430 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa403e030 con 0x7f0fb8074cb0 2024-09-17T03:36:04.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.391+0000 7f0fb5600640 1 -- 172.21.15.121:0/887759430 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fa40047a0 con 0x7f0fb8074cb0 2024-09-17T03:36:04.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.391+0000 7f0fb5600640 1 -- 172.21.15.121:0/887759430 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4035040 con 0x7f0fb8074cb0 2024-09-17T03:36:04.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.391+0000 7f0fc0600640 1 -- 172.21.15.121:0/887759430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb809abf0 con 0x7f0fb8074cb0 2024-09-17T03:36:04.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.391+0000 7f0fc0600640 1 -- 172.21.15.121:0/887759430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb80c9420 con 0x7f0fb8074cb0 2024-09-17T03:36:04.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.392+0000 7f0fc0600640 1 -- 172.21.15.121:0/887759430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb80a0090 con 0x7f0fb8074cb0 2024-09-17T03:36:04.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.394+0000 7f0fb5600640 1 -- 172.21.15.121:0/887759430 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0fa4041030 con 0x7f0fb8074cb0 2024-09-17T03:36:04.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.395+0000 7f0fb5600640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f98078b90 0x7f0f9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.395+0000 7f0fb5600640 1 -- 172.21.15.121:0/887759430 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0fa40bb8b0 con 0x7f0fb8074cb0 2024-09-17T03:36:04.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.395+0000 7f0fbdc00640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f98078b90 0x7f0f9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.396+0000 7f0fbdc00640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f98078b90 0x7f0f9807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0fb815a730 tx=0x7f0fac00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:04.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.400+0000 7f0fb5600640 1 -- 172.21.15.121:0/887759430 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0fb80a0090 con 0x7f0fb8074cb0 2024-09-17T03:36:04.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.622+0000 7f0fc0600640 1 -- 172.21.15.121:0/887759430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fb8073dd0 con 0x7f0fb8074cb0 2024-09-17T03:36:04.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.623+0000 7f0fb5600640 1 -- 172.21.15.121:0/887759430 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5219 (secure 0 0 0) 0x7f0fa40b9e20 con 0x7f0fb8074cb0 2024-09-17T03:36:04.623 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:04.623 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":9,"btime":"2024-09-17T03:35:55:484285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:31.874114+0000","modified":"2024-09-17T03:35:54.974076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4408":{"gid":4408,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4408,"qdb_cluster":[4408]},"id":1}]} 2024-09-17T03:36:04.623 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 9 2024-09-17T03:36:04.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.625+0000 7f0fc0600640 1 -- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f98078b90 msgr2=0x7f0f9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.625+0000 7f0fc0600640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f98078b90 0x7f0f9807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0fb815a730 tx=0x7f0fac00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.625+0000 7f0fc0600640 1 -- 172.21.15.121:0/887759430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fb8074cb0 msgr2=0x7f0fb81f8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.625+0000 7f0fc0600640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fb8074cb0 0x7f0fb81f8d50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40099c0 tx=0x7f0fa40039e0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.625+0000 7f0fc0600640 1 -- 172.21.15.121:0/887759430 shutdown_connections 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.625+0000 7f0fc0600640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0fb80cbc10 0x7f0fb81f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.625+0000 7f0fc0600640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f98078b90 0x7f0f9807b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.625+0000 7f0fc0600640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fb8074cb0 0x7f0fb81f8d50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.625+0000 7f0fc0600640 1 --2- 172.21.15.121:0/887759430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0fb806ddf0 0x7f0fb81f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.625+0000 7f0fc0600640 1 -- 172.21.15.121:0/887759430 >> 172.21.15.121:0/887759430 conn(0x7f0fb80cca40 msgr2=0x7f0fb815bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.626+0000 7f0fc0600640 1 -- 172.21.15.121:0/887759430 shutdown_connections 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.626+0000 7f0fc0600640 1 -- 172.21.15.121:0/887759430 wait complete. 2024-09-17T03:36:04.647 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:04.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.869+0000 7fca9a400640 1 -- 172.21.15.121:0/380851474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca941627f0 msgr2=0x7fca9406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.869+0000 7fca9a400640 1 --2- 172.21.15.121:0/380851474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca941627f0 0x7fca9406d2b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca940b6de0 tx=0x7fca7c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.869+0000 7fca9a400640 1 -- 172.21.15.121:0/380851474 shutdown_connections 2024-09-17T03:36:04.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.869+0000 7fca9a400640 1 --2- 172.21.15.121:0/380851474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca941627f0 0x7fca9406d2b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.869+0000 7fca9a400640 1 --2- 172.21.15.121:0/380851474 >> v2:172.21.15.176:3300/0 conn(0x7fca940b9e40 0x7fca941622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.869+0000 7fca9a400640 1 -- 172.21.15.121:0/380851474 >> 172.21.15.121:0/380851474 conn(0x7fca940d1930 msgr2=0x7fca940d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:04.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.869+0000 7fca9a400640 1 -- 172.21.15.121:0/380851474 shutdown_connections 2024-09-17T03:36:04.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.869+0000 7fca9a400640 1 -- 172.21.15.121:0/380851474 wait complete. 2024-09-17T03:36:04.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.871+0000 7fca9a400640 1 Processor -- start 2024-09-17T03:36:04.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.871+0000 7fca9a400640 1 -- start start 2024-09-17T03:36:04.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.872+0000 7fca9a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca9406d7f0 0x7fca941574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.872+0000 7fca9a400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca940b9e40 0x7fca940cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.872+0000 7fca9a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca941627f0 0x7fca940cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca9a400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fca94155940 con 0x7fca940b9e40 2024-09-17T03:36:04.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca9a400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fca941557c0 con 0x7fca9406d7f0 2024-09-17T03:36:04.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca9a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fca94155ac0 con 0x7fca941627f0 2024-09-17T03:36:04.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca8be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca940b9e40 0x7fca940cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca8be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca940b9e40 0x7fca940cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57994/0 (socket says 172.21.15.121:57994) 2024-09-17T03:36:04.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca8be00640 1 -- 172.21.15.121:0/4218985026 learned_addr learned my addr 172.21.15.121:0/4218985026 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:04.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca99000640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca9406d7f0 0x7fca941574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca8be00640 1 -- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca941627f0 msgr2=0x7fca940cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca99a00640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca941627f0 0x7fca940cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca8be00640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca941627f0 0x7fca940cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca8be00640 1 -- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca9406d7f0 msgr2=0x7fca941574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca8be00640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca9406d7f0 0x7fca941574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca8be00640 1 -- 172.21.15.121:0/4218985026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca94157dd0 con 0x7fca940b9e40 2024-09-17T03:36:04.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca99000640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca9406d7f0 0x7fca941574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:04.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.873+0000 7fca99a00640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca941627f0 0x7fca940cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:04.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.874+0000 7fca8be00640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca940b9e40 0x7fca940cc8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fca7c034040 tx=0x7fca7c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:04.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.874+0000 7fca91600640 1 -- 172.21.15.121:0/4218985026 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c03e030 con 0x7fca940b9e40 2024-09-17T03:36:04.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.874+0000 7fca91600640 1 -- 172.21.15.121:0/4218985026 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca7c003db0 con 0x7fca940b9e40 2024-09-17T03:36:04.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.874+0000 7fca91600640 1 -- 172.21.15.121:0/4218985026 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c035040 con 0x7fca940b9e40 2024-09-17T03:36:04.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.874+0000 7fca9a400640 1 -- 172.21.15.121:0/4218985026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca94155e70 con 0x7fca940b9e40 2024-09-17T03:36:04.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.874+0000 7fca9a400640 1 -- 172.21.15.121:0/4218985026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca94156430 con 0x7fca940b9e40 2024-09-17T03:36:04.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.875+0000 7fca9a400640 1 -- 172.21.15.121:0/4218985026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca94157b40 con 0x7fca940b9e40 2024-09-17T03:36:04.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.876+0000 7fca91600640 1 -- 172.21.15.121:0/4218985026 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca7c041030 con 0x7fca940b9e40 2024-09-17T03:36:04.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.878+0000 7fca91600640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fca70078b90 0x7fca7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.878+0000 7fca91600640 1 -- 172.21.15.121:0/4218985026 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fca7c0bbb40 con 0x7fca940b9e40 2024-09-17T03:36:04.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.878+0000 7fca99000640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fca70078b90 0x7fca7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.879+0000 7fca99000640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fca70078b90 0x7fca7007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fca84009ab0 tx=0x7fca84005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:04.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:04.883+0000 7fca91600640 1 -- 172.21.15.121:0/4218985026 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fca7c083c30 con 0x7fca940b9e40 2024-09-17T03:36:05.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.099+0000 7fca9a400640 1 -- 172.21.15.121:0/4218985026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca941622b0 con 0x7fca940b9e40 2024-09-17T03:36:05.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.099+0000 7fca91600640 1 -- 172.21.15.121:0/4218985026 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5219 (secure 0 0 0) 0x7fca7c083530 con 0x7fca940b9e40 2024-09-17T03:36:05.099 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:05.099 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":9,"btime":"2024-09-17T03:35:55:484285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:31.874114+0000","modified":"2024-09-17T03:35:54.974076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4408":{"gid":4408,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4408,"qdb_cluster":[4408]},"id":1}]} 2024-09-17T03:36:05.099 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 9 2024-09-17T03:36:05.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 -- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fca70078b90 msgr2=0x7fca7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fca70078b90 0x7fca7007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fca84009ab0 tx=0x7fca84005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:05.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 -- 172.21.15.121:0/4218985026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca940b9e40 msgr2=0x7fca940cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca940b9e40 0x7fca940cc8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fca7c034040 tx=0x7fca7c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 -- 172.21.15.121:0/4218985026 shutdown_connections 2024-09-17T03:36:05.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca941627f0 0x7fca940cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fca70078b90 0x7fca7007b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca940b9e40 0x7fca940cc8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 --2- 172.21.15.121:0/4218985026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca9406d7f0 0x7fca941574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 -- 172.21.15.121:0/4218985026 >> 172.21.15.121:0/4218985026 conn(0x7fca940d1930 msgr2=0x7fca94160830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:05.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 -- 172.21.15.121:0/4218985026 shutdown_connections 2024-09-17T03:36:05.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.102+0000 7fca9a400640 1 -- 172.21.15.121:0/4218985026 wait complete. 2024-09-17T03:36:05.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:05.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.348+0000 7f4323200640 1 -- 172.21.15.121:0/2862389460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240cc8d0 msgr2=0x7f43240ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.348+0000 7f4323200640 1 --2- 172.21.15.121:0/2862389460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240cc8d0 0x7f43240ccce0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f430c009830 tx=0x7f430c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.348+0000 7f4323200640 1 -- 172.21.15.121:0/2862389460 shutdown_connections 2024-09-17T03:36:05.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.348+0000 7f4323200640 1 --2- 172.21.15.121:0/2862389460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240cc8d0 0x7f43240ccce0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.348+0000 7f4323200640 1 --2- 172.21.15.121:0/2862389460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f432415cb20 0x7f43240cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.348+0000 7f4323200640 1 -- 172.21.15.121:0/2862389460 >> 172.21.15.121:0/2862389460 conn(0x7f432406f940 msgr2=0x7f43240b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:05.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.348+0000 7f4323200640 1 -- 172.21.15.121:0/2862389460 shutdown_connections 2024-09-17T03:36:05.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.348+0000 7f4323200640 1 -- 172.21.15.121:0/2862389460 wait complete. 2024-09-17T03:36:05.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.350+0000 7f4323200640 1 Processor -- start 2024-09-17T03:36:05.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.350+0000 7f4323200640 1 -- start start 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4323200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240b4990 0x7f43240740c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4323200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43240cc8d0 0x7f4324141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4323200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f432415cb20 0x7f43241605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4323200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f432406d600 con 0x7f432415cb20 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4323200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f432406d480 con 0x7f43240b4990 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4323200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f432406d780 con 0x7f43240cc8d0 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4322800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f432415cb20 0x7f43241605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4322800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f432415cb20 0x7f43241605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58000/0 (socket says 172.21.15.121:58000) 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4322800640 1 -- 172.21.15.121:0/1893500596 learned_addr learned my addr 172.21.15.121:0/1893500596 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4321e00640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240b4990 0x7f43240740c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4319400640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43240cc8d0 0x7f4324141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4322800640 1 -- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43240cc8d0 msgr2=0x7f4324141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4322800640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43240cc8d0 0x7f4324141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4322800640 1 -- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240b4990 msgr2=0x7f43240740c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4322800640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240b4990 0x7f43240740c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.352+0000 7f4322800640 1 -- 172.21.15.121:0/1893500596 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432414dcc0 con 0x7f432415cb20 2024-09-17T03:36:05.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.353+0000 7f4322800640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f432415cb20 0x7f43241605a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f431c00c480 tx=0x7f431c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:05.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.353+0000 7f431aa00640 1 -- 172.21.15.121:0/1893500596 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c016020 con 0x7f432415cb20 2024-09-17T03:36:05.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.353+0000 7f431aa00640 1 -- 172.21.15.121:0/1893500596 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f431c012940 con 0x7f432415cb20 2024-09-17T03:36:05.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.353+0000 7f431aa00640 1 -- 172.21.15.121:0/1893500596 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c012d90 con 0x7f432415cb20 2024-09-17T03:36:05.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.353+0000 7f4323200640 1 -- 172.21.15.121:0/1893500596 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43240737b0 con 0x7f432415cb20 2024-09-17T03:36:05.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.353+0000 7f4323200640 1 -- 172.21.15.121:0/1893500596 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4324073d70 con 0x7f432415cb20 2024-09-17T03:36:05.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.354+0000 7f4323200640 1 -- 172.21.15.121:0/1893500596 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f432406dc50 con 0x7f432415cb20 2024-09-17T03:36:05.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.355+0000 7f431aa00640 1 -- 172.21.15.121:0/1893500596 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f431c019020 con 0x7f432415cb20 2024-09-17T03:36:05.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.356+0000 7f431aa00640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4300078bc0 0x7f430007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.356+0000 7f431aa00640 1 -- 172.21.15.121:0/1893500596 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f431c09af90 con 0x7f432415cb20 2024-09-17T03:36:05.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.357+0000 7f4321e00640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4300078bc0 0x7f430007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.357+0000 7f4321e00640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4300078bc0 0x7f430007b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4314005fd0 tx=0x7f4314009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:05.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.361+0000 7f431aa00640 1 -- 172.21.15.121:0/1893500596 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f431c020020 con 0x7f432415cb20 2024-09-17T03:36:05.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.542+0000 7f4323200640 1 -- 172.21.15.121:0/1893500596 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43240cfb90 con 0x7f432415cb20 2024-09-17T03:36:05.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.544+0000 7f431aa00640 1 -- 172.21.15.121:0/1893500596 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18662 (secure 0 0 0) 0x7f43240cd220 con 0x7f432415cb20 2024-09-17T03:36:05.544 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:05.544 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:35:36.921947+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:05.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 -- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4300078bc0 msgr2=0x7f430007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4300078bc0 0x7f430007b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4314005fd0 tx=0x7f4314009500 comp rx=0 tx=0).stop 2024-09-17T03:36:05.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 -- 172.21.15.121:0/1893500596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f432415cb20 msgr2=0x7f43241605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f432415cb20 0x7f43241605a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f431c00c480 tx=0x7f431c00c940 comp rx=0 tx=0).stop 2024-09-17T03:36:05.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 -- 172.21.15.121:0/1893500596 shutdown_connections 2024-09-17T03:36:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4300078bc0 0x7f430007b0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f432415cb20 0x7f43241605a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43240cc8d0 0x7f4324141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 --2- 172.21.15.121:0/1893500596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43240b4990 0x7f43240740c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 -- 172.21.15.121:0/1893500596 >> 172.21.15.121:0/1893500596 conn(0x7f432406f940 msgr2=0x7f43240d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 -- 172.21.15.121:0/1893500596 shutdown_connections 2024-09-17T03:36:05.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.546+0000 7f4323200640 1 -- 172.21.15.121:0/1893500596 wait complete. 2024-09-17T03:36:05.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:05.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.791+0000 7f806b000640 1 -- 172.21.15.121:0/78473960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f804c004d40 msgr2=0x7f804c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.791+0000 7f806b000640 1 --2- 172.21.15.121:0/78473960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f804c004d40 0x7f804c005210 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f805c001dc0 tx=0x7f804c005830 comp rx=0 tx=0).stop 2024-09-17T03:36:05.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.791+0000 7f806a600640 1 -- 172.21.15.121:0/78473960 reap_dead start 2024-09-17T03:36:05.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.791+0000 7f806b000640 1 -- 172.21.15.121:0/78473960 shutdown_connections 2024-09-17T03:36:05.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.791+0000 7f806b000640 1 -- 172.21.15.121:0/78473960 >> 172.21.15.121:0/78473960 conn(0x7f806406f940 msgr2=0x7f80640b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:05.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.791+0000 7f806b000640 1 -- 172.21.15.121:0/78473960 shutdown_connections 2024-09-17T03:36:05.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.791+0000 7f806b000640 1 -- 172.21.15.121:0/78473960 wait complete. 2024-09-17T03:36:05.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.794+0000 7f806b000640 1 Processor -- start 2024-09-17T03:36:05.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.794+0000 7f806b000640 1 -- start start 2024-09-17T03:36:05.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.795+0000 7f806b000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f804c004d40 0x7f8064142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.795+0000 7f806b000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8064072c00 0x7f80641437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.795+0000 7f806b000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8064143d00 0x7f8064155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.795+0000 7f806b000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f80641635d0 con 0x7f8064143d00 2024-09-17T03:36:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.795+0000 7f806b000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8064163450 con 0x7f8064072c00 2024-09-17T03:36:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.795+0000 7f806b000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8064163750 con 0x7f804c004d40 2024-09-17T03:36:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f806a600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8064143d00 0x7f8064155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f806a600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8064143d00 0x7f8064155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58006/0 (socket says 172.21.15.121:58006) 2024-09-17T03:36:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f806a600640 1 -- 172.21.15.121:0/587695262 learned_addr learned my addr 172.21.15.121:0/587695262 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f8069c00640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f804c004d40 0x7f8064142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f8069200640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8064072c00 0x7f80641437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f806a600640 1 -- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f804c004d40 msgr2=0x7f8064142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f806a600640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f804c004d40 0x7f8064142430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f806a600640 1 -- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8064072c00 msgr2=0x7f80641437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f806a600640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8064072c00 0x7f80641437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f806a600640 1 -- 172.21.15.121:0/587695262 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8064156a30 con 0x7f8064143d00 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.796+0000 7f806a600640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8064143d00 0x7f8064155d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f805c02acc0 tx=0x7f805c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.797+0000 7f8061600640 1 -- 172.21.15.121:0/587695262 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c0060b0 con 0x7f8064143d00 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.797+0000 7f8061600640 1 -- 172.21.15.121:0/587695262 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f805c006250 con 0x7f8064143d00 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.797+0000 7f8061600640 1 -- 172.21.15.121:0/587695262 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c0066a0 con 0x7f8064143d00 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.797+0000 7f806b000640 1 -- 172.21.15.121:0/587695262 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8064156d10 con 0x7f8064143d00 2024-09-17T03:36:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.797+0000 7f806b000640 1 -- 172.21.15.121:0/587695262 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8064142fc0 con 0x7f8064143d00 2024-09-17T03:36:05.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.798+0000 7f806b000640 1 -- 172.21.15.121:0/587695262 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80641567a0 con 0x7f8064143d00 2024-09-17T03:36:05.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.799+0000 7f8061600640 1 -- 172.21.15.121:0/587695262 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f805c033480 con 0x7f8064143d00 2024-09-17T03:36:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.800+0000 7f8061600640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8044078b90 0x7f804407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.800+0000 7f8061600640 1 -- 172.21.15.121:0/587695262 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f805c0badc0 con 0x7f8064143d00 2024-09-17T03:36:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.800+0000 7f8069c00640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8044078b90 0x7f804407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.801+0000 7f8069c00640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8044078b90 0x7f804407b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8058006cb0 tx=0x7f80580067a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:05.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:05.804+0000 7f8061600640 1 -- 172.21.15.121:0/587695262 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f805c0827d0 con 0x7f8064143d00 2024-09-17T03:36:06.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.026+0000 7f806b000640 1 -- 172.21.15.121:0/587695262 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8064160a40 con 0x7f8064143d00 2024-09-17T03:36:06.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.027+0000 7f8061600640 1 -- 172.21.15.121:0/587695262 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5219 (secure 0 0 0) 0x7f805c087200 con 0x7f8064143d00 2024-09-17T03:36:06.028 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:06.028 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":9,"btime":"2024-09-17T03:35:55:484285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:31.874114+0000","modified":"2024-09-17T03:35:54.974076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4408":{"gid":4408,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4408,"qdb_cluster":[4408]},"id":1}]} 2024-09-17T03:36:06.028 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 9 2024-09-17T03:36:06.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 -- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8044078b90 msgr2=0x7f804407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8044078b90 0x7f804407b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8058006cb0 tx=0x7f80580067a0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 -- 172.21.15.121:0/587695262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8064143d00 msgr2=0x7f8064155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8064143d00 0x7f8064155d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f805c02acc0 tx=0x7f805c001b10 comp rx=0 tx=0).stop 2024-09-17T03:36:06.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 -- 172.21.15.121:0/587695262 shutdown_connections 2024-09-17T03:36:06.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8044078b90 0x7f804407b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8064143d00 0x7f8064155d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8064072c00 0x7f80641437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 --2- 172.21.15.121:0/587695262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f804c004d40 0x7f8064142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 -- 172.21.15.121:0/587695262 >> 172.21.15.121:0/587695262 conn(0x7f806406f940 msgr2=0x7f8064144840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 -- 172.21.15.121:0/587695262 shutdown_connections 2024-09-17T03:36:06.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.029+0000 7f806b000640 1 -- 172.21.15.121:0/587695262 wait complete. 2024-09-17T03:36:06.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:35:31.874114+0000', 'modified': '2024-09-17T03:35:54.974076+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4408}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4408': {'gid': 4408, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6837/25219205', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6835', 'nonce': 25219205}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 25219205}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4408, 'qdb_cluster': [4408]} 2024-09-17T03:36:06.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:36:06.457 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:36:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.680+0000 7fdae2c00640 1 -- 172.21.15.121:0/2268707764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdadc06fe00 msgr2=0x7fdadc070210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.680+0000 7fdae2c00640 1 --2- 172.21.15.121:0/2268707764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdadc06fe00 0x7fdadc070210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdad4005fd0 tx=0x7fdad402ab30 comp rx=0 tx=0).stop 2024-09-17T03:36:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.680+0000 7fdae2c00640 1 -- 172.21.15.121:0/2268707764 shutdown_connections 2024-09-17T03:36:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.680+0000 7fdae2c00640 1 --2- 172.21.15.121:0/2268707764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdadc06fe00 0x7fdadc070210 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.680+0000 7fdae2c00640 1 -- 172.21.15.121:0/2268707764 >> 172.21.15.121:0/2268707764 conn(0x7fdadc0d05c0 msgr2=0x7fdadc06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.680+0000 7fdae2c00640 1 -- 172.21.15.121:0/2268707764 shutdown_connections 2024-09-17T03:36:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.680+0000 7fdae2c00640 1 -- 172.21.15.121:0/2268707764 wait complete. 2024-09-17T03:36:06.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.682+0000 7fdae2c00640 1 Processor -- start 2024-09-17T03:36:06.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.682+0000 7fdae2c00640 1 -- start start 2024-09-17T03:36:06.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae2c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdadc06fe00 0x7fdadc14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae2c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc0ade20 0x7fdadc1f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae2c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdadc0aef80 0x7fdadc1f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae2c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc155450 con 0x7fdadc0aef80 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae2c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc1552d0 con 0x7fdadc0ade20 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae2c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdadc1555d0 con 0x7fdadc06fe00 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae2200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdadc0aef80 0x7fdadc1f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae2200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdadc0aef80 0x7fdadc1f6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58012/0 (socket says 172.21.15.121:58012) 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae2200640 1 -- 172.21.15.121:0/2560764564 learned_addr learned my addr 172.21.15.121:0/2560764564 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae0e00640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc0ade20 0x7fdadc1f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae1800640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdadc06fe00 0x7fdadc14d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.684+0000 7fdae2200640 1 -- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdadc06fe00 msgr2=0x7fdadc14d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdae2200640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdadc06fe00 0x7fdadc14d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdae2200640 1 -- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc0ade20 msgr2=0x7fdadc1f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdae2200640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc0ade20 0x7fdadc1f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdae2200640 1 -- 172.21.15.121:0/2560764564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc150350 con 0x7fdadc0aef80 2024-09-17T03:36:06.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdae0e00640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc0ade20 0x7fdadc1f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:06.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdae1800640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdadc06fe00 0x7fdadc14d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:06.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdae2200640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdadc0aef80 0x7fdadc1f6060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009d90 tx=0x7fdad402cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:06.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdad9600640 1 -- 172.21.15.121:0/2560764564 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4044070 con 0x7fdadc0aef80 2024-09-17T03:36:06.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdad9600640 1 -- 172.21.15.121:0/2560764564 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdad4004250 con 0x7fdadc0aef80 2024-09-17T03:36:06.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdae2c00640 1 -- 172.21.15.121:0/2560764564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdadc1f6920 con 0x7fdadc0aef80 2024-09-17T03:36:06.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdad9600640 1 -- 172.21.15.121:0/2560764564 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4004660 con 0x7fdadc0aef80 2024-09-17T03:36:06.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.685+0000 7fdae2c00640 1 -- 172.21.15.121:0/2560764564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdadc14df00 con 0x7fdadc0aef80 2024-09-17T03:36:06.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.688+0000 7fdad9600640 1 -- 172.21.15.121:0/2560764564 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdad4036400 con 0x7fdadc0aef80 2024-09-17T03:36:06.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.688+0000 7fdad9600640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdabc078bc0 0x7fdabc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.689+0000 7fdad9600640 1 -- 172.21.15.121:0/2560764564 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdad40bb9e0 con 0x7fdadc0aef80 2024-09-17T03:36:06.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.689+0000 7fdae1800640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdabc078bc0 0x7fdabc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.689+0000 7fdaeb2a8740 1 Processor -- start 2024-09-17T03:36:06.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.689+0000 7fdaeb2a8740 1 -- start start 2024-09-17T03:36:06.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.690+0000 7fdae1800640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdabc078bc0 0x7fdabc07b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdad00016a0 tx=0x7fdad0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:06.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.690+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 0x56034a309b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.690+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a30a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.690+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f18590 0x56034a2da150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.690+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56034a263430 con 0x560349f103b0 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.690+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56034a2535d0 con 0x560349f39270 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.690+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56034a242a00 con 0x560349f18590 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.691+0000 7fdae0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a30a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.691+0000 7fdae0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a30a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58014/0 (socket says 172.21.15.121:58014) 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.691+0000 7fdae0e00640 1 -- 172.21.15.121:0/2778783506 learned_addr learned my addr 172.21.15.121:0/2778783506 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.691+0000 7fdae1800640 1 --2- 172.21.15.121:0/2778783506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 0x56034a309b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.691+0000 7fdae2200640 1 --2- 172.21.15.121:0/2778783506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f18590 0x56034a2da150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.691+0000 7fdae0e00640 1 -- 172.21.15.121:0/2778783506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f18590 msgr2=0x56034a2da150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.691+0000 7fdae0e00640 1 --2- 172.21.15.121:0/2778783506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f18590 0x56034a2da150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.691+0000 7fdae0e00640 1 -- 172.21.15.121:0/2778783506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 msgr2=0x56034a309b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:06.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.691+0000 7fdae0e00640 1 --2- 172.21.15.121:0/2778783506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 0x56034a309b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.691+0000 7fdae0e00640 1 -- 172.21.15.121:0/2778783506 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56034a20b520 con 0x560349f103b0 2024-09-17T03:36:06.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.692+0000 7fdae0e00640 1 --2- 172.21.15.121:0/2778783506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a30a0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdac80016c0 tx=0x7fdac8001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2197a1084d3c4a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:06.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.692+0000 7fdace000640 1 -- 172.21.15.121:0/2778783506 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8016020 con 0x560349f103b0 2024-09-17T03:36:06.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.692+0000 7fdace000640 1 -- 172.21.15.121:0/2778783506 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdac800dc30 con 0x560349f103b0 2024-09-17T03:36:06.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.692+0000 7fdace000640 1 -- 172.21.15.121:0/2778783506 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac80123f0 con 0x560349f103b0 2024-09-17T03:36:06.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.693+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/2778783506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 msgr2=0x56034a30a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.693+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/2778783506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a30a0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdac80016c0 tx=0x7fdac8001b80 comp rx=0 tx=0).stop 2024-09-17T03:36:06.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.693+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/2778783506 shutdown_connections 2024-09-17T03:36:06.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.693+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/2778783506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f18590 0x56034a2da150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.693+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/2778783506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a30a0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.693+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/2778783506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 0x56034a309b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.693+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/2778783506 >> 172.21.15.121:0/2778783506 conn(0x560349f2d3c0 msgr2=0x56034a2dfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.693+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/2778783506 shutdown_connections 2024-09-17T03:36:06.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.693+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/2778783506 wait complete. 2024-09-17T03:36:06.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.694+0000 7fdaeb2a8740 1 -- start start 2024-09-17T03:36:06.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.694+0000 7fdaeb2a8740 1 Processor -- start 2024-09-17T03:36:06.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a31e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f18590 0x56034a305d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 0x56034a2fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56034a1e9330 con 0x560349f103b0 2024-09-17T03:36:06.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56034a246810 con 0x560349f39270 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x560349fb3620 con 0x560349f18590 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdaeb2a8740 10 client.0 _ll_register_callbacks cb 0x56034a1ee420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae1800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a31e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae1800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a31e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58016/0 (socket says 172.21.15.121:58016) 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae1800640 1 -- 172.21.15.121:0/1825712010 learned_addr learned my addr 172.21.15.121:0/1825712010 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae2200640 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 0x56034a2fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae0e00640 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f18590 0x56034a305d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae1800640 1 -- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f18590 msgr2=0x56034a305d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae1800640 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f18590 0x56034a305d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae1800640 1 -- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 msgr2=0x56034a2fffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:06.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae1800640 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 0x56034a2fffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae1800640 1 -- 172.21.15.121:0/1825712010 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560349fa4850 con 0x560349f103b0 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.696+0000 7fdae2200640 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 0x56034a2fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.697+0000 7fdae1800640 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a31e7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdad000de30 tx=0x7fdad0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd33054bcc9f35d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.697+0000 7fdac2a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.697+0000 7fdac2a00640 1 -- 172.21.15.121:0/1825712010 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad0024030 con 0x560349f103b0 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.697+0000 7fdac2a00640 1 -- 172.21.15.121:0/1825712010 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdad001d040 con 0x560349f103b0 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.697+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/1825712010 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdac800dc30 con 0x560349f103b0 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.697+0000 7fdac2a00640 1 -- 172.21.15.121:0/1825712010 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdad002d050 con 0x560349f103b0 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.697+0000 7fdaeb2a8740 10 client.4794 fetch_fsmap learned FSMap version 9 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.697+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/1825712010 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56034a01b6b0 con 0x560349f103b0 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.697+0000 7fdac2a00640 1 -- 172.21.15.121:0/1825712010 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdac800dc30 con 0x560349f103b0 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.698+0000 7fdac2a00640 1 -- 172.21.15.121:0/1825712010 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7fdad0030020 con 0x560349f103b0 2024-09-17T03:36:06.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.698+0000 7fdaeb2a8740 10 client.4794 fetch_fsmap finished waiting for FSMap version 9 2024-09-17T03:36:06.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.698+0000 7fdaeb2a8740 10 client.4794 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:36:06.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.698+0000 7fdaeb2a8740 20 client.4794 populate_metadata read hostname 'smithi121' 2024-09-17T03:36:06.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.698+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x560349ef7e40 0x56034a333c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.698+0000 7fdaeb2a8740 4 client.4794 mds_command: new command op to 4408 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:36:06.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.698+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/1825712010 --> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56034a255520 con 0x560349ef7e40 2024-09-17T03:36:06.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.698+0000 7fdae0e00640 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x560349ef7e40 0x56034a333c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.699+0000 7fdac2a00640 10 client.4794 ms_handle_connect on v2:172.21.15.176:6835/25219205 2024-09-17T03:36:06.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.699+0000 7fdae0e00640 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x560349ef7e40 0x56034a333c80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f08a7985643a39f6 server_cookie=8d5c09e0f5ab5a95 in_seq=0 out_seq=0 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdac2a00640 1 -- 172.21.15.121:0/1825712010 <== mds.0 v2:172.21.15.176:6835/25219205 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56034a255520 con 0x560349ef7e40 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdac2a00640 10 client.4794 handle_command_reply: tid=0 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 client.4794 shutdown 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/1825712010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 msgr2=0x56034a31e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a31e7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdad000de30 tx=0x7fdad0000ed0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/1825712010 shutdown_connections 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x560349ef7e40 0x56034a333c80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f39270 0x56034a2fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f18590 0x56034a305d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdac2a00640 0 client.4794 ms_handle_reset on v2:172.21.15.176:6835/25219205 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/1825712010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a31e7a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/1825712010 >> 172.21.15.121:0/1825712010 conn(0x560349f2d3c0 msgr2=0x56034a327ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/1825712010 shutdown_connections 2024-09-17T03:36:06.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/1825712010 wait complete. 2024-09-17T03:36:06.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.700+0000 7fdaeb2a8740 20 client.4794 trim_cache size 0 max 16384 2024-09-17T03:36:06.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.719+0000 7fdaeb2a8740 1 Processor -- start 2024-09-17T03:36:06.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.719+0000 7fdaeb2a8740 1 -- start start 2024-09-17T03:36:06.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a301330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f18590 0x56034a335ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f39270 0x56034a336400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc202650 con 0x560349f103b0 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc161d90 con 0x560349f18590 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdadc202090 con 0x560349f39270 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdae1800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a301330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdae1800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a301330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58032/0 (socket says 172.21.15.121:58032) 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdae1800640 1 -- 172.21.15.121:0/38138864 learned_addr learned my addr 172.21.15.121:0/38138864 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdae0e00640 1 --2- 172.21.15.121:0/38138864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f18590 0x56034a335ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdae2200640 1 --2- 172.21.15.121:0/38138864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f39270 0x56034a336400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdae1800640 1 -- 172.21.15.121:0/38138864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f39270 msgr2=0x56034a336400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdae1800640 1 --2- 172.21.15.121:0/38138864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f39270 0x56034a336400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdae1800640 1 -- 172.21.15.121:0/38138864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f18590 msgr2=0x56034a335ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdae1800640 1 --2- 172.21.15.121:0/38138864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f18590 0x56034a335ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.721+0000 7fdae1800640 1 -- 172.21.15.121:0/38138864 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56034a347d40 con 0x560349f103b0 2024-09-17T03:36:06.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.722+0000 7fdae1800640 1 --2- 172.21.15.121:0/38138864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a301330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdad0001450 tx=0x7fdad0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49db884bb0355aae server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:06.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.722+0000 7fdacd600640 1 -- 172.21.15.121:0/38138864 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad0024070 con 0x560349f103b0 2024-09-17T03:36:06.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.722+0000 7fdacd600640 1 -- 172.21.15.121:0/38138864 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdad0007520 con 0x560349f103b0 2024-09-17T03:36:06.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.722+0000 7fdacd600640 1 -- 172.21.15.121:0/38138864 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad00285e0 con 0x560349f103b0 2024-09-17T03:36:06.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.722+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/38138864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 msgr2=0x56034a301330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.722+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/38138864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a301330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdad0001450 tx=0x7fdad0012000 comp rx=0 tx=0).stop 2024-09-17T03:36:06.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.723+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/38138864 shutdown_connections 2024-09-17T03:36:06.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.723+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/38138864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f39270 0x56034a336400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.723+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/38138864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f18590 0x56034a335ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.723+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/38138864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f103b0 0x56034a301330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.723+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/38138864 >> 172.21.15.121:0/38138864 conn(0x560349f2d3c0 msgr2=0x56034a2db390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.723+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/38138864 shutdown_connections 2024-09-17T03:36:06.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.723+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/38138864 wait complete. 2024-09-17T03:36:06.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.724+0000 7fdaeb2a8740 1 -- start start 2024-09-17T03:36:06.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.724+0000 7fdaeb2a8740 1 Processor -- start 2024-09-17T03:36:06.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.725+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f103b0 0x56034a3a73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.725+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f18590 0x56034a389da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.725+0000 7fdaeb2a8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f39270 0x56034a3281f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.725+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56034a302d80 con 0x560349f18590 2024-09-17T03:36:06.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.725+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56034a3004f0 con 0x560349f103b0 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.725+0000 7fdaeb2a8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56034a3370e0 con 0x560349f39270 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.725+0000 7fdaeb2a8740 10 client.0 _ll_register_callbacks cb 0x7fdad000dae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.725+0000 7fdae0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f18590 0x56034a389da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.725+0000 7fdae0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f18590 0x56034a389da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58040/0 (socket says 172.21.15.121:58040) 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdae0e00640 1 -- 172.21.15.121:0/370852961 learned_addr learned my addr 172.21.15.121:0/370852961 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdae2200640 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f39270 0x56034a3281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdae1800640 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f103b0 0x56034a3a73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdae0e00640 1 -- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f39270 msgr2=0x56034a3281f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdae0e00640 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f39270 0x56034a3281f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdae0e00640 1 -- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f103b0 msgr2=0x56034a3a73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdae0e00640 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f103b0 0x56034a3a73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdae0e00640 1 -- 172.21.15.121:0/370852961 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56034a38a2e0 con 0x560349f18590 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdae0e00640 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f18590 0x56034a389da0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdac800d520 tx=0x7fdac8001dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64cef125096ff28 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdac2a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdac2a00640 1 -- 172.21.15.121:0/370852961 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8016040 con 0x560349f18590 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/370852961 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad0007520 con 0x560349f18590 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.726+0000 7fdac2a00640 1 -- 172.21.15.121:0/370852961 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdac8005110 con 0x560349f18590 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdac2a00640 1 -- 172.21.15.121:0/370852961 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdac8032050 con 0x560349f18590 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdaeb2a8740 10 client.4800 fetch_fsmap learned FSMap version 9 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/370852961 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56034a3057f0 con 0x560349f18590 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdac2a00640 1 -- 172.21.15.121:0/370852961 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdad0007520 con 0x560349f18590 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdac2a00640 1 -- 172.21.15.121:0/370852961 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7fdac8035020 con 0x560349f18590 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdaeb2a8740 10 client.4800 fetch_fsmap finished waiting for FSMap version 9 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdaeb2a8740 10 client.4800 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdaeb2a8740 20 client.4800 populate_metadata read hostname 'smithi121' 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x56034a328730 0x56034a3462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdaeb2a8740 4 client.4800 mds_command: new command op to 4408 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:36:06.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.727+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/370852961 --> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] -- command(tid 0: {"prefix": "status"}) -- 0x56034a2ddb60 con 0x56034a328730 2024-09-17T03:36:06.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.728+0000 7fdae1800640 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x56034a328730 0x56034a3462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.728+0000 7fdae1800640 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x56034a328730 0x56034a3462b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=219175e3a36023fe server_cookie=56d1489330a3d4ca in_seq=0 out_seq=0 2024-09-17T03:36:06.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.728+0000 7fdac2a00640 10 client.4800 ms_handle_connect on v2:172.21.15.176:6835/25219205 2024-09-17T03:36:06.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.728+0000 7fdac2a00640 1 -- 172.21.15.121:0/370852961 <== mds.0 v2:172.21.15.176:6835/25219205 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x56034a2ddb60 con 0x56034a328730 2024-09-17T03:36:06.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.728+0000 7fdac2a00640 10 client.4800 handle_command_reply: tid=0 2024-09-17T03:36:06.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.728+0000 7fdaeb2a8740 1 client.4800 shutdown 2024-09-17T03:36:06.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/370852961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f18590 msgr2=0x56034a389da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f18590 0x56034a389da0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdac800d520 tx=0x7fdac8001dd0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/370852961 shutdown_connections 2024-09-17T03:36:06.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:6835/25219205,v1:172.21.15.176:6837/25219205] conn(0x56034a328730 0x56034a3462b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560349f39270 0x56034a3281f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560349f18590 0x56034a389da0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdac2a00640 0 client.4800 ms_handle_reset on v2:172.21.15.176:6835/25219205 2024-09-17T03:36:06.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 1 --2- 172.21.15.121:0/370852961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560349f103b0 0x56034a3a73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/370852961 >> 172.21.15.121:0/370852961 conn(0x560349f2d3c0 msgr2=0x56034a2dfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/370852961 shutdown_connections 2024-09-17T03:36:06.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 1 -- 172.21.15.121:0/370852961 wait complete. 2024-09-17T03:36:06.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.729+0000 7fdaeb2a8740 20 client.4800 trim_cache size 0 max 16384 2024-09-17T03:36:06.733 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:36:06.733 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4408, 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 34.35754567, 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 9, 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 26, 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 26, 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 40.372702574000002 2024-09-17T03:36:06.734 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:36:06.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 -- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdabc078bc0 msgr2=0x7fdabc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdabc078bc0 0x7fdabc07b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdad00016a0 tx=0x7fdad0009040 comp rx=0 tx=0).stop 2024-09-17T03:36:06.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 -- 172.21.15.121:0/2560764564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdadc0aef80 msgr2=0x7fdadc1f6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdadc0aef80 0x7fdadc1f6060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009d90 tx=0x7fdad402cf00 comp rx=0 tx=0).stop 2024-09-17T03:36:06.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 -- 172.21.15.121:0/2560764564 shutdown_connections 2024-09-17T03:36:06.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdabc078bc0 0x7fdabc07b0d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdadc0aef80 0x7fdadc1f6060 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc0ade20 0x7fdadc1f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 --2- 172.21.15.121:0/2560764564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdadc06fe00 0x7fdadc14d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 -- 172.21.15.121:0/2560764564 >> 172.21.15.121:0/2560764564 conn(0x7fdadc0d05c0 msgr2=0x7fdadc0b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 -- 172.21.15.121:0/2560764564 shutdown_connections 2024-09-17T03:36:06.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:06.730+0000 7fdae2c00640 1 -- 172.21.15.121:0/2560764564 wait complete. 2024-09-17T03:36:06.756 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T03:36:06.769 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T03:36:06.769 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T03:36:06.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:06.770 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:36:06.805 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-17T03:36:06.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:06.806 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T03:36:06.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:06.904 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-09-17T03:36:07.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:07.185 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:36:07.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:07.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-09-17T03:36:07.320 INFO:teuthology.orchestra.run.smithi121.stderr:Cannot find device "ceph-brx" 2024-09-17T03:36:07.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:36:07.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:07.323 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:36:07.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:07.364 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-17T03:36:07.467 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-17T03:36:07.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:36:07.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:07.470 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:36:07.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:07.506 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-17T03:36:07.605 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-17T03:36:07.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:36:07.608 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-17T03:36:07.608 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:36:07.608 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:07.608 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:36:07.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.828+0000 7f5af4400640 1 -- 172.21.15.121:0/2693814374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aec0cefa0 msgr2=0x7f5aec0ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:07.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.828+0000 7f5af4400640 1 --2- 172.21.15.121:0/2693814374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aec0cefa0 0x7f5aec0ce320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5aec072560 tx=0x7f5ad802a540 comp rx=0 tx=0).stop 2024-09-17T03:36:07.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.828+0000 7f5af4400640 1 -- 172.21.15.121:0/2693814374 shutdown_connections 2024-09-17T03:36:07.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.828+0000 7f5af4400640 1 --2- 172.21.15.121:0/2693814374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aec0cefa0 0x7f5aec0ce320 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:07.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.828+0000 7f5af4400640 1 --2- 172.21.15.121:0/2693814374 >> v2:172.21.15.176:3300/0 conn(0x7f5aec15b9f0 0x7f5aec0cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:07.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.828+0000 7f5af4400640 1 -- 172.21.15.121:0/2693814374 >> 172.21.15.121:0/2693814374 conn(0x7f5aec0cca40 msgr2=0x7f5aec0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:07.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.828+0000 7f5af4400640 1 -- 172.21.15.121:0/2693814374 shutdown_connections 2024-09-17T03:36:07.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.828+0000 7f5af4400640 1 -- 172.21.15.121:0/2693814374 wait complete. 2024-09-17T03:36:07.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.830+0000 7f5af4400640 1 Processor -- start 2024-09-17T03:36:07.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.831+0000 7f5af4400640 1 -- start start 2024-09-17T03:36:07.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af4400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aec0ce860 0x7f5aec0b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:07.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af4400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec0cefa0 0x7f5aec0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:07.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af4400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5aec15b9f0 0x7f5aec1f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:07.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af4400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec06ddf0 con 0x7f5aec0ce860 2024-09-17T03:36:07.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af4400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec06df70 con 0x7f5aec0cefa0 2024-09-17T03:36:07.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af4400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5aec06e0f0 con 0x7f5aec15b9f0 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af1a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aec0ce860 0x7f5aec0b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af1a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aec0ce860 0x7f5aec0b5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:58054/0 (socket says 172.21.15.121:58054) 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af1a00640 1 -- 172.21.15.121:0/153840447 learned_addr learned my addr 172.21.15.121:0/153840447 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af1000640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec0cefa0 0x7f5aec0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.832+0000 7f5af2400640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5aec15b9f0 0x7f5aec1f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5af1a00640 1 -- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5aec15b9f0 msgr2=0x7f5aec1f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5af1a00640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5aec15b9f0 0x7f5aec1f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5af1a00640 1 -- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec0cefa0 msgr2=0x7f5aec0aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5af1a00640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec0cefa0 0x7f5aec0aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5af1a00640 1 -- 172.21.15.121:0/153840447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec0af3e0 con 0x7f5aec0ce860 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5af1a00640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aec0ce860 0x7f5aec0b5930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000d740 tx=0x7f5ae000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5ae9600640 1 -- 172.21.15.121:0/153840447 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0017070 con 0x7f5aec0ce860 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5ae9600640 1 -- 172.21.15.121:0/153840447 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ae0009d20 con 0x7f5aec0ce860 2024-09-17T03:36:07.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5af4400640 1 -- 172.21.15.121:0/153840447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec0ca220 con 0x7f5aec0ce860 2024-09-17T03:36:07.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5ae9600640 1 -- 172.21.15.121:0/153840447 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00106c0 con 0x7f5aec0ce860 2024-09-17T03:36:07.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.833+0000 7f5af4400640 1 -- 172.21.15.121:0/153840447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aec0c83d0 con 0x7f5aec0ce860 2024-09-17T03:36:07.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.835+0000 7f5af4400640 1 -- 172.21.15.121:0/153840447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aec06e5a0 con 0x7f5aec0ce860 2024-09-17T03:36:07.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.836+0000 7f5ae9600640 1 -- 172.21.15.121:0/153840447 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ae001a070 con 0x7f5aec0ce860 2024-09-17T03:36:07.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.837+0000 7f5ae9600640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5acc078b90 0x7f5acc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:07.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.837+0000 7f5ae9600640 1 -- 172.21.15.121:0/153840447 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5ae009b110 con 0x7f5aec0ce860 2024-09-17T03:36:07.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.838+0000 7f5af1000640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5acc078b90 0x7f5acc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:07.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.839+0000 7f5af1000640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5acc078b90 0x7f5acc07b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8034000 tx=0x7f5ad8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:07.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:07.842+0000 7f5ae9600640 1 -- 172.21.15.121:0/153840447 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5ae0062c50 con 0x7f5aec0ce860 2024-09-17T03:36:08.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.057+0000 7f5af4400640 1 -- 172.21.15.121:0/153840447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5aec070400 con 0x7f5aec0ce860 2024-09-17T03:36:08.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.058+0000 7f5ae9600640 1 -- 172.21.15.121:0/153840447 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f5ae0067680 con 0x7f5aec0ce860 2024-09-17T03:36:08.059 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T03:36:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 -- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5acc078b90 msgr2=0x7f5acc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5acc078b90 0x7f5acc07b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8034000 tx=0x7f5ad8004730 comp rx=0 tx=0).stop 2024-09-17T03:36:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 -- 172.21.15.121:0/153840447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aec0ce860 msgr2=0x7f5aec0b5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aec0ce860 0x7f5aec0b5930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000d740 tx=0x7f5ae000dc00 comp rx=0 tx=0).stop 2024-09-17T03:36:08.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 -- 172.21.15.121:0/153840447 shutdown_connections 2024-09-17T03:36:08.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5aec15b9f0 0x7f5aec1f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec0cefa0 0x7f5aec0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5acc078b90 0x7f5acc07b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 --2- 172.21.15.121:0/153840447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5aec0ce860 0x7f5aec0b5930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 -- 172.21.15.121:0/153840447 >> 172.21.15.121:0/153840447 conn(0x7f5aec0cca40 msgr2=0x7f5aec0afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:08.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 -- 172.21.15.121:0/153840447 shutdown_connections 2024-09-17T03:36:08.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08.060+0000 7f5af4400640 1 -- 172.21.15.121:0/153840447 wait complete. 2024-09-17T03:36:08.084 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:36:08.085 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:36:08.085 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:36:08.085 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:36:08.085 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:08.085 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:36:08.085 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:36:08.085 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:36:08.085 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:36:08.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:08.085 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:36:08.120 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:08.120 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:08.120 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:08.120 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:08.120 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:36:08.121 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42688sec preferred_lft 42688sec 2024-09-17T03:36:08.122 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:36:08.122 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:08.122 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T03:36:08.123 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:08.123 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:36:08.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add name ceph-brx type bridge 2024-09-17T03:36:08.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr flush dev ceph-brx 2024-09-17T03:36:08.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set ceph-brx up 2024-09-17T03:36:08.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T03:36:08.123 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:36:08.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:08.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:08.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:08.343 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:36:08.397 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:36:08.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:08.401 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:36:08.438 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:36:08.438 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:36:08.438 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:36:08.438 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:36:08.438 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:36:08.438 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:08.438 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:36:08.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:36:08.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:36:08.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:36:08.439 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:36:08.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:08.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:08.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:08.637 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:36:08.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:08.674 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-09-17T03:36:08.749 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:08.749 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:36:08.749 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:36:08.749 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T03:36:08.749 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:36:08.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:08.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:08.923 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T03:36:08.924 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:08.924 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:36:08.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T03:36:08.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T03:36:08.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T03:36:08.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T03:36:08.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T03:36:08.924 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:36:09.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:09.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:09.139 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:09.139 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:36:09.139 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:36:09.139 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T03:36:09.139 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:36:09.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:09.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:09.304 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:09.304 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:09.339 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:36:09.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:09.339 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:09.414 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:36:09.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:09.414 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:09.616 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:09.616 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:36:09.616 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:36:11.544 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:11.545 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:36:11.545 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:36:11.545 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:11.545 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:11.585 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:11.586 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:36:11.586 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:36:11.586 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:11.586 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:11.586 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:36:11.586 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:36:11.586 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:36:11.588 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:36:11.589 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:36:11.589 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:36:11.589 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:36:11.589 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:36:11.592 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:36:11.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:11.592 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:11.649 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:11.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:11.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:11.741 INFO:teuthology.orchestra.run.smithi121.stdout:client4634 2024-09-17T03:36:11.744 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:11.745 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:11.780 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:11.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:11.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:11.912 INFO:teuthology.orchestra.run.smithi121.stdout:client4634 2024-09-17T03:36:11.912 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:11.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:11.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:12.002 INFO:teuthology.orchestra.run.smithi121.stdout:client4634 2024-09-17T03:36:12.003 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f24b1682-8755-41b1-8124-cbd8f88939a2.client4634/status') 2024-09-17T03:36:12.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:12.102 INFO:teuthology.orchestra.run.smithi121.stdout:instance: client.4634 (3)172.21.15.121:0/1075037962 2024-09-17T03:36:12.103 INFO:teuthology.orchestra.run.smithi121.stdout:blocklisted: false 2024-09-17T03:36:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records in 2024-09-17T03:36:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records out 2024-09-17T03:36:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:71 bytes copied, 5.6153e-05 s, 1.3 MB/s 2024-09-17T03:36:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:12.113 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-17T03:36:12.113 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:36:12.113 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T03:36:12.114 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:36:12.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.342+0000 7f9214a00640 1 -- 172.21.15.121:0/2493013678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f4004230 msgr2=0x7f91f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.342+0000 7f9214a00640 1 --2- 172.21.15.121:0/2493013678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f4004230 0x7f91f4004800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9210074e70 tx=0x7f91f4005830 comp rx=0 tx=0).stop 2024-09-17T03:36:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.342+0000 7f920f200640 1 -- 172.21.15.121:0/2493013678 reap_dead start 2024-09-17T03:36:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.342+0000 7f9214a00640 1 -- 172.21.15.121:0/2493013678 shutdown_connections 2024-09-17T03:36:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.342+0000 7f9214a00640 1 -- 172.21.15.121:0/2493013678 >> 172.21.15.121:0/2493013678 conn(0x7f921006f940 msgr2=0x7f92100b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.342+0000 7f9214a00640 1 -- 172.21.15.121:0/2493013678 shutdown_connections 2024-09-17T03:36:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.342+0000 7f9214a00640 1 -- 172.21.15.121:0/2493013678 wait complete. 2024-09-17T03:36:12.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.345+0000 7f9214a00640 1 Processor -- start 2024-09-17T03:36:12.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.345+0000 7f9214a00640 1 -- start start 2024-09-17T03:36:12.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f9214a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91f4004230 0x7f92100af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f9214a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92100ac420 0x7f92100aa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f9214a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92100aa6a0 0x7f921015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f9214a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f92101635d0 con 0x7f92100aa6a0 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f9214a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9210163450 con 0x7f91f4004230 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f9214a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9210163750 con 0x7f92100ac420 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f920f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92100aa6a0 0x7f921015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f920f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92100aa6a0 0x7f921015e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46170/0 (socket says 172.21.15.121:46170) 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f920f200640 1 -- 172.21.15.121:0/145459784 learned_addr learned my addr 172.21.15.121:0/145459784 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f920e800640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91f4004230 0x7f92100af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.346+0000 7f9207e00640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92100ac420 0x7f92100aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.347+0000 7f920f200640 1 -- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92100ac420 msgr2=0x7f92100aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.347+0000 7f920f200640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92100ac420 0x7f92100aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.347+0000 7f920f200640 1 -- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91f4004230 msgr2=0x7f92100af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.347+0000 7f920f200640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91f4004230 0x7f92100af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.347+0000 7f920f200640 1 -- 172.21.15.121:0/145459784 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92100aaab0 con 0x7f92100aa6a0 2024-09-17T03:36:12.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.347+0000 7f920f200640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92100aa6a0 0x7f921015e900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f921015caf0 tx=0x7f92080064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:12.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.347+0000 7f9206a00640 1 -- 172.21.15.121:0/145459784 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920800f960 con 0x7f92100aa6a0 2024-09-17T03:36:12.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.347+0000 7f9206a00640 1 -- 172.21.15.121:0/145459784 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f920800fb00 con 0x7f92100aa6a0 2024-09-17T03:36:12.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.347+0000 7f9206a00640 1 -- 172.21.15.121:0/145459784 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208011430 con 0x7f92100aa6a0 2024-09-17T03:36:12.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.347+0000 7f9214a00640 1 -- 172.21.15.121:0/145459784 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92100acba0 con 0x7f92100aa6a0 2024-09-17T03:36:12.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.348+0000 7f9214a00640 1 -- 172.21.15.121:0/145459784 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92100ae840 con 0x7f92100aa6a0 2024-09-17T03:36:12.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.349+0000 7f9214a00640 1 -- 172.21.15.121:0/145459784 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9210160a40 con 0x7f92100aa6a0 2024-09-17T03:36:12.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.350+0000 7f9206a00640 1 -- 172.21.15.121:0/145459784 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92080115d0 con 0x7f92100aa6a0 2024-09-17T03:36:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.351+0000 7f9206a00640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91ec078b90 0x7f91ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.351+0000 7f9206a00640 1 -- 172.21.15.121:0/145459784 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f920809b7b0 con 0x7f92100aa6a0 2024-09-17T03:36:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.351+0000 7f920e800640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91ec078b90 0x7f91ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.352+0000 7f920e800640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91ec078b90 0x7f91ec07b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9200001160 tx=0x7f9200001d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.356+0000 7f9206a00640 1 -- 172.21.15.121:0/145459784 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9208063230 con 0x7f92100aa6a0 2024-09-17T03:36:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.591+0000 7f9214a00640 1 -- 172.21.15.121:0/145459784 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f92100cc0e0 con 0x7f92100aa6a0 2024-09-17T03:36:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.591+0000 7f9206a00640 1 -- 172.21.15.121:0/145459784 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f9208067c60 con 0x7f92100aa6a0 2024-09-17T03:36:12.592 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T03:36:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 -- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91ec078b90 msgr2=0x7f91ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91ec078b90 0x7f91ec07b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9200001160 tx=0x7f9200001d80 comp rx=0 tx=0).stop 2024-09-17T03:36:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 -- 172.21.15.121:0/145459784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92100aa6a0 msgr2=0x7f921015e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92100aa6a0 0x7f921015e900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f921015caf0 tx=0x7f92080064f0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 -- 172.21.15.121:0/145459784 shutdown_connections 2024-09-17T03:36:12.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91ec078b90 0x7f91ec07b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92100aa6a0 0x7f921015e900 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92100ac420 0x7f92100aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 --2- 172.21.15.121:0/145459784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91f4004230 0x7f92100af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 -- 172.21.15.121:0/145459784 >> 172.21.15.121:0/145459784 conn(0x7f921006f940 msgr2=0x7f9210144820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:12.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 -- 172.21.15.121:0/145459784 shutdown_connections 2024-09-17T03:36:12.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12.594+0000 7f9214a00640 1 -- 172.21.15.121:0/145459784 wait complete. 2024-09-17T03:36:12.618 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:36:12.618 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:36:12.618 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:36:12.618 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T03:36:12.618 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T03:36:12.618 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:36:12.618 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:36:12.618 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:36:12.619 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T03:36:12.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:12.619 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:36:12.655 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:12.655 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:12.655 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:12.655 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:12.655 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:12.655 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:12.655 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42684sec preferred_lft 42684sec 2024-09-17T03:36:12.656 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:36:12.657 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:12.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:12.658 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:36:12.749 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:36:12.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:12.753 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:36:12.790 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:36:12.790 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:36:12.790 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:36:12.790 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:36:12.790 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:36:12.791 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:12.791 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:36:12.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:36:12.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:36:12.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:36:12.791 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:36:12.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:12.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:12.987 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:36:13.022 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:36:13.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:13.022 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-09-17T03:36:13.097 INFO:teuthology.orchestra.run.smithi121.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T03:36:13.098 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:13.098 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:36:13.098 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:36:13.098 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T03:36:13.098 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:36:13.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:13.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:13.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:13.273 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T03:36:13.329 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:13.329 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:13.329 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:13.329 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:13.329 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:13.329 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:13.329 INFO:teuthology.orchestra.run.smithi121.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:36:13.329 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ba:77:b6:49:e7:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:36:13.329 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:36:13.329 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:13.330 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::b877:b6ff:fe49:e76b/64 scope link 2024-09-17T03:36:13.330 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:13.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:13.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T03:36:13.387 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:13.387 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:13.387 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:13.387 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:13.387 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:13.387 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:13.387 INFO:teuthology.orchestra.run.smithi121.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:36:13.387 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ba:77:b6:49:e7:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:36:13.387 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:36:13.387 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:13.388 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::b877:b6ff:fe49:e76b/64 scope link 2024-09-17T03:36:13.388 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:13.390 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T03:36:13.390 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:13.390 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:36:13.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T03:36:13.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T03:36:13.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T03:36:13.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T03:36:13.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T03:36:13.390 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:36:13.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:13.607 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:13.607 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:36:13.607 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.1 up 2024-09-17T03:36:13.607 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T03:36:13.607 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:36:13.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:13.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:13.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:13.773 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T03:36:13.808 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T03:36:13.809 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:13.809 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T03:36:13.883 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:36:13.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:13.883 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:36:14.078 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:36:14.078 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:36:14.078 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:36:14.099 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:36:14.099 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:36:14.099 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:36:14.099 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:14.099 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:14.128 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:36:14.129 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:36:14.129 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:36:14.129 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:14.129 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:14.129 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:36:14.129 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:36:14.129 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:36:14.131 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-17T03:36:14.131 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:36:14.131 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:36:14.131 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:36:14.131 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:36:14.134 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:36:14.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:14.134 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T03:36:14.190 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:14.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:14.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:14.280 INFO:teuthology.orchestra.run.smithi121.stdout:client4818 2024-09-17T03:36:14.280 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:14.280 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:14.315 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:14.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:14.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:14.443 INFO:teuthology.orchestra.run.smithi121.stdout:client4818 2024-09-17T03:36:14.444 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:14.533 INFO:teuthology.orchestra.run.smithi121.stdout:client4818 2024-09-17T03:36:14.533 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f24b1682-8755-41b1-8124-cbd8f88939a2.client4818/status') 2024-09-17T03:36:14.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:14.632 INFO:teuthology.orchestra.run.smithi121.stdout:instance: client.4818 (3)192.168.0.2:0/1307389948 2024-09-17T03:36:14.632 INFO:teuthology.orchestra.run.smithi121.stdout:blocklisted: false 2024-09-17T03:36:14.632 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records in 2024-09-17T03:36:14.632 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records out 2024-09-17T03:36:14.632 INFO:teuthology.orchestra.run.smithi121.stderr:69 bytes copied, 8.0431e-05 s, 858 kB/s 2024-09-17T03:36:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:14.642 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-17T03:36:14.642 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:36:14.642 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:36:14.643 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:36:14.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.863+0000 7f6bbf600640 1 -- 172.21.15.121:0/2580989074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bb815ee30 msgr2=0x7f6bb80b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:14.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.863+0000 7f6bbf600640 1 --2- 172.21.15.121:0/2580989074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bb815ee30 0x7f6bb80b1b40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009830 tx=0x7f6bac02a480 comp rx=0 tx=0).stop 2024-09-17T03:36:14.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.863+0000 7f6bbf600640 1 -- 172.21.15.121:0/2580989074 shutdown_connections 2024-09-17T03:36:14.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.863+0000 7f6bbf600640 1 --2- 172.21.15.121:0/2580989074 >> v2:172.21.15.176:3300/0 conn(0x7f6bb80d0bd0 0x7f6bb806e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.863+0000 7f6bbf600640 1 --2- 172.21.15.121:0/2580989074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bb815ee30 0x7f6bb80b1b40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.863+0000 7f6bbf600640 1 -- 172.21.15.121:0/2580989074 >> 172.21.15.121:0/2580989074 conn(0x7f6bb8072990 msgr2=0x7f6bb8072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:14.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.863+0000 7f6bbf600640 1 -- 172.21.15.121:0/2580989074 shutdown_connections 2024-09-17T03:36:14.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.863+0000 7f6bbf600640 1 -- 172.21.15.121:0/2580989074 wait complete. 2024-09-17T03:36:14.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.865+0000 7f6bbf600640 1 Processor -- start 2024-09-17T03:36:14.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.865+0000 7f6bbf600640 1 -- start start 2024-09-17T03:36:14.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bbf600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bb806e0e0 0x7f6bb815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:14.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bbf600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bb815ee30 0x7f6bb8156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:14.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bbf600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bb81f5600 0x7f6bb81f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:14.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bbf600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb80cd860 con 0x7f6bb815ee30 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bbf600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb80cd6e0 con 0x7f6bb81f5600 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bbf600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb80cd9e0 con 0x7f6bb806e0e0 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bb7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bb815ee30 0x7f6bb8156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bb7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bb815ee30 0x7f6bb8156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46178/0 (socket says 172.21.15.121:46178) 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bb7e00640 1 -- 172.21.15.121:0/1901668028 learned_addr learned my addr 172.21.15.121:0/1901668028 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bbd600640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bb81f5600 0x7f6bb81f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bb7e00640 1 -- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bb806e0e0 msgr2=0x7f6bb815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bb7e00640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bb806e0e0 0x7f6bb815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bb7e00640 1 -- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bb81f5600 msgr2=0x7f6bb81f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bb7e00640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bb81f5600 0x7f6bb81f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bb7e00640 1 -- 172.21.15.121:0/1901668028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb81f62d0 con 0x7f6bb815ee30 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.867+0000 7f6bbd600640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bb81f5600 0x7f6bb81f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.868+0000 7f6bb7e00640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bb815ee30 0x7f6bb8156e70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400c430 tx=0x7f6ba400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.868+0000 7f6bb4c00640 1 -- 172.21.15.121:0/1901668028 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011790 con 0x7f6bb815ee30 2024-09-17T03:36:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.868+0000 7f6bb4c00640 1 -- 172.21.15.121:0/1901668028 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ba4017070 con 0x7f6bb815ee30 2024-09-17T03:36:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.868+0000 7f6bbf600640 1 -- 172.21.15.121:0/1901668028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb815c500 con 0x7f6bb815ee30 2024-09-17T03:36:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.868+0000 7f6bb4c00640 1 -- 172.21.15.121:0/1901668028 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011ce0 con 0x7f6bb815ee30 2024-09-17T03:36:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.868+0000 7f6bbf600640 1 -- 172.21.15.121:0/1901668028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb8155330 con 0x7f6bb815ee30 2024-09-17T03:36:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.869+0000 7f6bbf600640 1 -- 172.21.15.121:0/1901668028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb81f65b0 con 0x7f6bb815ee30 2024-09-17T03:36:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.870+0000 7f6bb4c00640 1 -- 172.21.15.121:0/1901668028 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ba401c460 con 0x7f6bb815ee30 2024-09-17T03:36:14.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.871+0000 7f6bb4c00640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6b98078b90 0x7f6b9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:14.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.871+0000 7f6bb4c00640 1 -- 172.21.15.121:0/1901668028 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f6ba409add0 con 0x7f6bb815ee30 2024-09-17T03:36:14.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.872+0000 7f6bbcc00640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6b98078b90 0x7f6b9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:14.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.872+0000 7f6bbcc00640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6b98078b90 0x7f6b9807b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6bac034000 tx=0x7f6bac0046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:14.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:14.876+0000 7f6bb4c00640 1 -- 172.21.15.121:0/1901668028 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ba4062f20 con 0x7f6bb815ee30 2024-09-17T03:36:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.093+0000 7f6bbf600640 1 -- 172.21.15.121:0/1901668028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6bb81f6060 con 0x7f6bb815ee30 2024-09-17T03:36:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.094+0000 7f6bb4c00640 1 -- 172.21.15.121:0/1901668028 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f6ba4062820 con 0x7f6bb815ee30 2024-09-17T03:36:15.094 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T03:36:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 -- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6b98078b90 msgr2=0x7f6b9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6b98078b90 0x7f6b9807b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6bac034000 tx=0x7f6bac0046c0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 -- 172.21.15.121:0/1901668028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bb815ee30 msgr2=0x7f6bb8156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bb815ee30 0x7f6bb8156e70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400c430 tx=0x7f6ba400c8f0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 -- 172.21.15.121:0/1901668028 shutdown_connections 2024-09-17T03:36:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6bb81f5600 0x7f6bb81f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6b98078b90 0x7f6b9807b0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bb815ee30 0x7f6bb8156e70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 --2- 172.21.15.121:0/1901668028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6bb806e0e0 0x7f6bb815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 -- 172.21.15.121:0/1901668028 >> 172.21.15.121:0/1901668028 conn(0x7f6bb8072990 msgr2=0x7f6bb815a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 -- 172.21.15.121:0/1901668028 shutdown_connections 2024-09-17T03:36:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:15.096+0000 7f6bbf600640 1 -- 172.21.15.121:0/1901668028 wait complete. 2024-09-17T03:36:15.120 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:36:15.120 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:36:15.121 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:36:15.121 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:36:15.121 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:36:15.121 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:36:15.121 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:36:15.121 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:36:15.121 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:36:15.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:15.121 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:36:15.162 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:15.162 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:15.162 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:15.162 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:15.162 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:15.162 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:15.162 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42679sec preferred_lft 42679sec 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:36:15.163 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:15.164 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T03:36:15.164 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:15.164 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:36:15.164 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2024-09-17T03:36:15.164 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2024-09-17T03:36:15.164 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2024-09-17T03:36:15.164 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T03:36:15.164 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:36:15.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:15.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:15.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:15.583 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:36:15.641 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:36:15.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:15.645 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:36:15.696 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:36:15.696 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:36:15.697 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:36:15.697 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:36:15.697 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:36:15.697 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:15.697 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:36:15.697 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:36:15.697 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:36:15.697 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:36:15.697 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:36:15.776 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:16.277 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:16.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:16.285 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:36:16.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:16.321 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-09-17T03:36:16.397 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:16.397 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:36:16.398 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:36:16.398 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T03:36:16.398 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:36:16.518 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:16.569 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:16.577 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T03:36:16.577 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:16.578 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:36:16.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T03:36:16.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T03:36:16.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T03:36:16.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T03:36:16.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T03:36:16.578 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:36:16.657 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:16.805 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:16.813 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:16.814 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:36:16.814 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T03:36:16.814 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T03:36:16.814 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:36:16.891 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:16.972 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:16.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:16.980 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:36:17.015 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:36:17.016 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:17.016 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:36:17.092 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:36:17.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:17.092 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:36:17.299 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:36:17.299 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:36:17.299 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:36:17.915 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:36:17.915 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:36:17.915 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:36:17.915 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:17.915 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:17.948 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:36:17.948 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:36:17.948 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:36:17.949 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:17.949 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:17.949 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:36:17.949 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:36:17.949 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:36:17.950 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:36:17.950 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:36:17.950 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:36:17.950 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:36:17.951 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:36:17.953 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:36:17.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:17.954 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:36:18.010 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:18.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:18.092 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:18.100 INFO:teuthology.orchestra.run.smithi176.stdout:client4822 2024-09-17T03:36:18.100 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:36:18.100 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:18.136 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:18.253 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:18.256 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:18.264 INFO:teuthology.orchestra.run.smithi176.stdout:client4822 2024-09-17T03:36:18.265 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:18.342 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:18.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:18.353 INFO:teuthology.orchestra.run.smithi176.stdout:client4822 2024-09-17T03:36:18.353 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f24b1682-8755-41b1-8124-cbd8f88939a2.client4822/status') 2024-09-17T03:36:18.431 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:18.452 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4822 (3)192.168.0.1:0/3591113016 2024-09-17T03:36:18.452 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-09-17T03:36:18.452 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-09-17T03:36:18.452 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-09-17T03:36:18.452 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 5.6215e-05 s, 1.2 MB/s 2024-09-17T03:36:18.454 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:18.462 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-17T03:36:18.463 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:36:18.463 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T03:36:18.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:36:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.692+0000 7f43f3400640 1 -- 172.21.15.121:0/2457783887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec070030 msgr2=0x7f43ec06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.692+0000 7f43f3400640 1 --2- 172.21.15.121:0/2457783887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec070030 0x7f43ec06ddf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009830 tx=0x7f43d802a490 comp rx=0 tx=0).stop 2024-09-17T03:36:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.693+0000 7f43f3400640 1 -- 172.21.15.121:0/2457783887 shutdown_connections 2024-09-17T03:36:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.693+0000 7f43f3400640 1 --2- 172.21.15.121:0/2457783887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec070030 0x7f43ec06ddf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.693+0000 7f43f3400640 1 --2- 172.21.15.121:0/2457783887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074d90 0x7f43ec06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.693+0000 7f43f3400640 1 -- 172.21.15.121:0/2457783887 >> 172.21.15.121:0/2457783887 conn(0x7f43ec0cca40 msgr2=0x7f43ec0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.693+0000 7f43f3400640 1 -- 172.21.15.121:0/2457783887 shutdown_connections 2024-09-17T03:36:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.693+0000 7f43f3400640 1 -- 172.21.15.121:0/2457783887 wait complete. 2024-09-17T03:36:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.695+0000 7f43f3400640 1 Processor -- start 2024-09-17T03:36:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.695+0000 7f43f3400640 1 -- start start 2024-09-17T03:36:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.696+0000 7f43f3400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec06e330 0x7f43ec156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.696+0000 7f43f3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec070030 0x7f43ec15d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.696+0000 7f43f3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074d90 0x7f43ec15d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.696+0000 7f43f3400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec15ad50 con 0x7f43ec070030 2024-09-17T03:36:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.696+0000 7f43f3400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec15abd0 con 0x7f43ec06e330 2024-09-17T03:36:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.696+0000 7f43f3400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f43ec070e80 con 0x7f43ec074d90 2024-09-17T03:36:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.697+0000 7f43ebe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec070030 0x7f43ec15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.697+0000 7f43ebe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec070030 0x7f43ec15d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46180/0 (socket says 172.21.15.121:46180) 2024-09-17T03:36:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.697+0000 7f43ebe00640 1 -- 172.21.15.121:0/668265758 learned_addr learned my addr 172.21.15.121:0/668265758 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.697+0000 7f43f0a00640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec06e330 0x7f43ec156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.697+0000 7f43f1400640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074d90 0x7f43ec15d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.697+0000 7f43f0a00640 1 -- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074d90 msgr2=0x7f43ec15d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.697+0000 7f43f0a00640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074d90 0x7f43ec15d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.697+0000 7f43f0a00640 1 -- 172.21.15.121:0/668265758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec070030 msgr2=0x7f43ec15d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.697+0000 7f43f0a00640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec070030 0x7f43ec15d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.697+0000 7f43f0a00640 1 -- 172.21.15.121:0/668265758 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ec0a0080 con 0x7f43ec06e330 2024-09-17T03:36:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.698+0000 7f43f0a00640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec06e330 0x7f43ec156060 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f43e000e9f0 tx=0x7f43e000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.698+0000 7f43e8c00640 1 -- 172.21.15.121:0/668265758 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e000ccc0 con 0x7f43ec06e330 2024-09-17T03:36:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.698+0000 7f43e8c00640 1 -- 172.21.15.121:0/668265758 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43e0004020 con 0x7f43ec06e330 2024-09-17T03:36:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.698+0000 7f43f3400640 1 -- 172.21.15.121:0/668265758 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ec1565a0 con 0x7f43ec06e330 2024-09-17T03:36:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.698+0000 7f43e8c00640 1 -- 172.21.15.121:0/668265758 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e000ce60 con 0x7f43ec06e330 2024-09-17T03:36:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.698+0000 7f43f3400640 1 -- 172.21.15.121:0/668265758 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ec09e520 con 0x7f43ec06e330 2024-09-17T03:36:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.699+0000 7f43f3400640 1 -- 172.21.15.121:0/668265758 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ec0c4b40 con 0x7f43ec06e330 2024-09-17T03:36:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.700+0000 7f43e8c00640 1 -- 172.21.15.121:0/668265758 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43e00035f0 con 0x7f43ec06e330 2024-09-17T03:36:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.701+0000 7f43e8c00640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43cc078b90 0x7f43cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.701+0000 7f43e8c00640 1 -- 172.21.15.121:0/668265758 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f43e009b920 con 0x7f43ec06e330 2024-09-17T03:36:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.701+0000 7f43ebe00640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43cc078b90 0x7f43cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.702+0000 7f43ebe00640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43cc078b90 0x7f43cc07b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f43d802aa50 tx=0x7f43d8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:18.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.706+0000 7f43e8c00640 1 -- 172.21.15.121:0/668265758 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f43e0063300 con 0x7f43ec06e330 2024-09-17T03:36:18.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.923+0000 7f43f3400640 1 -- 172.21.15.121:0/668265758 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f43ec0b01d0 con 0x7f43ec06e330 2024-09-17T03:36:18.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.924+0000 7f43e8c00640 1 -- 172.21.15.121:0/668265758 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f43ec0b01d0 con 0x7f43ec06e330 2024-09-17T03:36:18.925 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T03:36:18.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.926+0000 7f43f3400640 1 -- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43cc078b90 msgr2=0x7f43cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.926+0000 7f43f3400640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43cc078b90 0x7f43cc07b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f43d802aa50 tx=0x7f43d8004730 comp rx=0 tx=0).stop 2024-09-17T03:36:18.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.926+0000 7f43f3400640 1 -- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec06e330 msgr2=0x7f43ec156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.926+0000 7f43f3400640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec06e330 0x7f43ec156060 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f43e000e9f0 tx=0x7f43e000eeb0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.926+0000 7f43f3400640 1 -- 172.21.15.121:0/668265758 shutdown_connections 2024-09-17T03:36:18.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.926+0000 7f43f3400640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074d90 0x7f43ec15d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.926+0000 7f43f3400640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43cc078b90 0x7f43cc07b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.926+0000 7f43f3400640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec070030 0x7f43ec15d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.926+0000 7f43f3400640 1 --2- 172.21.15.121:0/668265758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec06e330 0x7f43ec156060 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.926+0000 7f43f3400640 1 -- 172.21.15.121:0/668265758 >> 172.21.15.121:0/668265758 conn(0x7f43ec0cca40 msgr2=0x7f43ec0b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:18.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.927+0000 7f43f3400640 1 -- 172.21.15.121:0/668265758 shutdown_connections 2024-09-17T03:36:18.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:18.927+0000 7f43f3400640 1 -- 172.21.15.121:0/668265758 wait complete. 2024-09-17T03:36:18.949 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:36:18.949 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:36:18.949 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:36:18.949 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T03:36:18.949 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T03:36:18.949 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:36:18.949 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:36:18.949 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:36:18.949 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T03:36:18.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:18.950 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:36:18.986 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:18.986 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:18.986 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:18.986 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:18.986 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:18.986 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:18.986 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:18.986 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:18.986 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:36:18.986 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42675sec preferred_lft 42675sec 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:18.987 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::80c9:d6ff:fe9f:5926/64 scope link 2024-09-17T03:36:18.988 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:18.988 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:36:18.988 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:36:18.988 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d4cd:10ff:feb7:d68f/64 scope link 2024-09-17T03:36:18.988 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:18.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:18.988 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:36:19.080 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:36:19.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:19.084 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:36:19.119 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:36:19.119 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:36:19.119 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:36:19.119 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:36:19.120 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:36:19.120 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:19.120 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:36:19.120 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:36:19.120 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:36:19.120 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:36:19.120 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:36:19.236 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:19.308 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:19.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:19.316 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:36:19.352 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:36:19.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:19.352 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-09-17T03:36:19.427 INFO:teuthology.orchestra.run.smithi176.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T03:36:19.428 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:19.428 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:36:19.428 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:36:19.428 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T03:36:19.428 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:36:19.545 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:19.595 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:19.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:19.604 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T03:36:19.661 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:19.661 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:19.661 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:19.661 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:19.661 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:19.662 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:19.662 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:36:19.662 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 06:b3:24:b6:17:ae brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:36:19.662 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:36:19.662 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:19.662 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::4b3:24ff:feb6:17ae/64 scope link 2024-09-17T03:36:19.662 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:19.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:19.664 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T03:36:19.719 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:19.719 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:19.719 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:19.719 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:19.720 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:19.720 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:19.720 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:36:19.720 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 06:b3:24:b6:17:ae brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:36:19.720 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:36:19.720 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:19.720 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::4b3:24ff:feb6:17ae/64 scope link 2024-09-17T03:36:19.720 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:19.722 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T03:36:19.722 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:19.722 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:36:19.722 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T03:36:19.723 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T03:36:19.723 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T03:36:19.723 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T03:36:19.723 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T03:36:19.723 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:36:19.800 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:19.929 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:19.937 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:19.937 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:36:19.937 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.1 up 2024-09-17T03:36:19.937 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T03:36:19.937 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:36:20.014 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:20.093 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:20.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:20.102 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T03:36:20.137 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T03:36:20.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:20.137 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T03:36:20.211 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:36:20.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:20.211 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:36:20.406 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:36:20.406 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:36:20.406 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:36:20.426 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:36:20.427 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:36:20.427 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:36:20.427 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:20.427 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:20.457 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:36:20.457 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:36:20.458 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:36:20.458 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:20.458 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:20.458 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:36:20.458 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:36:20.458 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:36:20.459 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-17T03:36:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:36:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:36:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:36:20.459 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:36:20.462 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:36:20.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:20.462 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T03:36:20.518 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:20.597 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:20.600 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:20.608 INFO:teuthology.orchestra.run.smithi176.stdout:client4652 2024-09-17T03:36:20.608 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:36:20.608 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:20.644 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:20.760 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:20.764 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:20.771 INFO:teuthology.orchestra.run.smithi176.stdout:client4652 2024-09-17T03:36:20.771 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:20.850 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:20.853 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:20.861 INFO:teuthology.orchestra.run.smithi176.stdout:client4652 2024-09-17T03:36:20.861 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f24b1682-8755-41b1-8124-cbd8f88939a2.client4652/status') 2024-09-17T03:36:20.901 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:36:20.906 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:36:20.940 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:20.962 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4652 (3)192.168.0.2:0/2767935463 2024-09-17T03:36:20.962 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-09-17T03:36:20.962 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-09-17T03:36:20.962 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-09-17T03:36:20.962 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 5.5248e-05 s, 1.2 MB/s 2024-09-17T03:36:20.964 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:20.972 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T03:36:20.999 INFO:tasks.cephfs_test_runner:Starting test: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a client unmounts, the thread count on the MDS goes back 2024-09-17T03:36:20.999 INFO:tasks.cephfs_test_runner:test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-17T03:36:21.000 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:21.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.268+0000 7f7b44600640 1 -- 172.21.15.121:0/2357128929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0cb750 msgr2=0x7f7b3c0af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.268+0000 7f7b44600640 1 --2- 172.21.15.121:0/2357128929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0cb750 0x7f7b3c0af420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009830 tx=0x7f7b3002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.268+0000 7f7b44600640 1 -- 172.21.15.121:0/2357128929 shutdown_connections 2024-09-17T03:36:21.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.268+0000 7f7b44600640 1 --2- 172.21.15.121:0/2357128929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0cb750 0x7f7b3c0af420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.268+0000 7f7b44600640 1 -- 172.21.15.121:0/2357128929 >> 172.21.15.121:0/2357128929 conn(0x7f7b3c0cca40 msgr2=0x7f7b3c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:21.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.268+0000 7f7b44600640 1 -- 172.21.15.121:0/2357128929 shutdown_connections 2024-09-17T03:36:21.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.268+0000 7f7b44600640 1 -- 172.21.15.121:0/2357128929 wait complete. 2024-09-17T03:36:21.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.270+0000 7f7b44600640 1 Processor -- start 2024-09-17T03:36:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.270+0000 7f7b44600640 1 -- start start 2024-09-17T03:36:21.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b44600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b3c15e7c0 0x7f7b3c159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b44600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3c0b47a0 0x7f7b3c1f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b44600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0a0360 0x7f7b3c0a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b44600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c0ce8a0 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b44600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c0ce720 con 0x7f7b3c0a0360 2024-09-17T03:36:21.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b44600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3c0cea20 con 0x7f7b3c0b47a0 2024-09-17T03:36:21.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b41c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b3c15e7c0 0x7f7b3c159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b41c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b3c15e7c0 0x7f7b3c159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46194/0 (socket says 172.21.15.121:46194) 2024-09-17T03:36:21.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b41c00640 1 -- 172.21.15.121:0/1160972731 learned_addr learned my addr 172.21.15.121:0/1160972731 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:21.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b42600640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0a0360 0x7f7b3c0a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b41200640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3c0b47a0 0x7f7b3c1f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b41c00640 1 -- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3c0b47a0 msgr2=0x7f7b3c1f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b41c00640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3c0b47a0 0x7f7b3c1f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b41c00640 1 -- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0a0360 msgr2=0x7f7b3c0a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b41c00640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0a0360 0x7f7b3c0a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.272+0000 7f7b41c00640 1 -- 172.21.15.121:0/1160972731 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3c0a0cb0 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.273+0000 7f7b41c00640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b3c15e7c0 0x7f7b3c159cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009950 tx=0x7f7b30033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:21.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.273+0000 7f7b39600640 1 -- 172.21.15.121:0/1160972731 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30031d60 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.273+0000 7f7b39600640 1 -- 172.21.15.121:0/1160972731 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b30033e10 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.273+0000 7f7b44600640 1 -- 172.21.15.121:0/1160972731 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b3c0b4e80 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.273+0000 7f7b39600640 1 -- 172.21.15.121:0/1160972731 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30005260 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.273+0000 7f7b44600640 1 -- 172.21.15.121:0/1160972731 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b3c0b3300 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.274+0000 7f7b44600640 1 -- 172.21.15.121:0/1160972731 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b3c0b2e10 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.275+0000 7f7b39600640 1 -- 172.21.15.121:0/1160972731 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b30005400 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.276+0000 7f7b39600640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b1c078b90 0x7f7b1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.276+0000 7f7b39600640 1 -- 172.21.15.121:0/1160972731 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f7b300bc1e0 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.277+0000 7f7b41200640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b1c078b90 0x7f7b1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.277+0000 7f7b41200640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b1c078b90 0x7f7b1c07b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7b28007fd0 tx=0x7f7b28001390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:21.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.281+0000 7f7b39600640 1 -- 172.21.15.121:0/1160972731 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b3c0a0cb0 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.465+0000 7f7b44600640 1 -- 172.21.15.121:0/1160972731 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b3c0cb750 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.466+0000 7f7b39600640 1 -- 172.21.15.121:0/1160972731 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18756 (secure 0 0 0) 0x7f7b3003f030 con 0x7f7b3c15e7c0 2024-09-17T03:36:21.467 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:21.467 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:36:10.573094+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:21.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.468+0000 7f7b44600640 1 -- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b1c078b90 msgr2=0x7f7b1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.468+0000 7f7b44600640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b1c078b90 0x7f7b1c07b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7b28007fd0 tx=0x7f7b28001390 comp rx=0 tx=0).stop 2024-09-17T03:36:21.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.468+0000 7f7b44600640 1 -- 172.21.15.121:0/1160972731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b3c15e7c0 msgr2=0x7f7b3c159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.468+0000 7f7b44600640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b3c15e7c0 0x7f7b3c159cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009950 tx=0x7f7b30033c20 comp rx=0 tx=0).stop 2024-09-17T03:36:21.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.468+0000 7f7b44600640 1 -- 172.21.15.121:0/1160972731 shutdown_connections 2024-09-17T03:36:21.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.468+0000 7f7b44600640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0a0360 0x7f7b3c0a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.468+0000 7f7b44600640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3c0b47a0 0x7f7b3c1f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.468+0000 7f7b44600640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b1c078b90 0x7f7b1c07b0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.468+0000 7f7b44600640 1 --2- 172.21.15.121:0/1160972731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b3c15e7c0 0x7f7b3c159cc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.468+0000 7f7b44600640 1 -- 172.21.15.121:0/1160972731 >> 172.21.15.121:0/1160972731 conn(0x7f7b3c0cca40 msgr2=0x7f7b3c0ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:21.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.469+0000 7f7b44600640 1 -- 172.21.15.121:0/1160972731 shutdown_connections 2024-09-17T03:36:21.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.469+0000 7f7b44600640 1 -- 172.21.15.121:0/1160972731 wait complete. 2024-09-17T03:36:21.492 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:35:21.303701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T03:35:30.001860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T03:35:30.829496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-17T03:35:34.413369+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-17T03:36:21.493 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:36:21.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.715+0000 7f994c400640 1 -- 172.21.15.121:0/217950733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9944073dd0 msgr2=0x7f994406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.715+0000 7f994c400640 1 --2- 172.21.15.121:0/217950733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9944073dd0 0x7f994406ddf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f994415d980 tx=0x7f993002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.715+0000 7f994c400640 1 -- 172.21.15.121:0/217950733 shutdown_connections 2024-09-17T03:36:21.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.715+0000 7f994c400640 1 --2- 172.21.15.121:0/217950733 >> v2:172.21.15.176:3300/0 conn(0x7f994406e330 0x7f994406ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.715+0000 7f994c400640 1 --2- 172.21.15.121:0/217950733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9944073dd0 0x7f994406ddf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.715+0000 7f994c400640 1 -- 172.21.15.121:0/217950733 >> 172.21.15.121:0/217950733 conn(0x7f99440cca40 msgr2=0x7f99440cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:21.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.715+0000 7f994c400640 1 -- 172.21.15.121:0/217950733 shutdown_connections 2024-09-17T03:36:21.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.715+0000 7f994c400640 1 -- 172.21.15.121:0/217950733 wait complete. 2024-09-17T03:36:21.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.718+0000 7f994c400640 1 Processor -- start 2024-09-17T03:36:21.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.718+0000 7f994c400640 1 -- start start 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.719+0000 7f994c400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f994406e330 0x7f994409a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.719+0000 7f994c400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9944073dd0 0x7f9944152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.719+0000 7f994c400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9944074cb0 0x7f99441f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.719+0000 7f994c400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f994406f4a0 con 0x7f9944073dd0 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.719+0000 7f994c400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f994406f320 con 0x7f9944074cb0 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.719+0000 7f994c400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f994406f620 con 0x7f994406e330 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.719+0000 7f9949000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9944073dd0 0x7f9944152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.719+0000 7f9949000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9944073dd0 0x7f9944152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46224/0 (socket says 172.21.15.121:46224) 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.719+0000 7f9949000640 1 -- 172.21.15.121:0/17694145 learned_addr learned my addr 172.21.15.121:0/17694145 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.720+0000 7f994a400640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9944074cb0 0x7f99441f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.720+0000 7f9949a00640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f994406e330 0x7f994409a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.720+0000 7f9949000640 1 -- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f994406e330 msgr2=0x7f994409a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.720+0000 7f9949000640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f994406e330 0x7f994409a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.720+0000 7f9949000640 1 -- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9944074cb0 msgr2=0x7f99441f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.720+0000 7f9949000640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9944074cb0 0x7f99441f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.720+0000 7f9949000640 1 -- 172.21.15.121:0/17694145 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99441f97a0 con 0x7f9944073dd0 2024-09-17T03:36:21.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.720+0000 7f9949000640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9944073dd0 0x7f9944152e80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9930034040 tx=0x7f9930003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:21.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.720+0000 7f9941600640 1 -- 172.21.15.121:0/17694145 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993003e030 con 0x7f9944073dd0 2024-09-17T03:36:21.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.721+0000 7f9941600640 1 -- 172.21.15.121:0/17694145 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9930003e00 con 0x7f9944073dd0 2024-09-17T03:36:21.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.721+0000 7f994c400640 1 -- 172.21.15.121:0/17694145 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99440a0030 con 0x7f9944073dd0 2024-09-17T03:36:21.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.721+0000 7f9941600640 1 -- 172.21.15.121:0/17694145 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930035040 con 0x7f9944073dd0 2024-09-17T03:36:21.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.721+0000 7f994c400640 1 -- 172.21.15.121:0/17694145 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99440a05f0 con 0x7f9944073dd0 2024-09-17T03:36:21.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.722+0000 7f994c400640 1 -- 172.21.15.121:0/17694145 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99441f9510 con 0x7f9944073dd0 2024-09-17T03:36:21.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.723+0000 7f9941600640 1 -- 172.21.15.121:0/17694145 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9930041030 con 0x7f9944073dd0 2024-09-17T03:36:21.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.724+0000 7f9941600640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9924078b90 0x7f992407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.724+0000 7f9941600640 1 -- 172.21.15.121:0/17694145 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f99300bb6d0 con 0x7f9944073dd0 2024-09-17T03:36:21.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.724+0000 7f9949a00640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9924078b90 0x7f992407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.725+0000 7f9949a00640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9924078b90 0x7f992407b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f994415a730 tx=0x7f9938009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:21.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.729+0000 7f9941600640 1 -- 172.21.15.121:0/17694145 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f994406e740 con 0x7f9944073dd0 2024-09-17T03:36:21.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.914+0000 7f994c400640 1 -- 172.21.15.121:0/17694145 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f994406fb60 con 0x7f9944073dd0 2024-09-17T03:36:21.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.915+0000 7f9941600640 1 -- 172.21.15.121:0/17694145 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f9930083270 con 0x7f9944073dd0 2024-09-17T03:36:21.915 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-17T03:36:21.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 -- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9924078b90 msgr2=0x7f992407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9924078b90 0x7f992407b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f994415a730 tx=0x7f9938009040 comp rx=0 tx=0).stop 2024-09-17T03:36:21.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 -- 172.21.15.121:0/17694145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9944073dd0 msgr2=0x7f9944152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9944073dd0 0x7f9944152e80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9930034040 tx=0x7f9930003910 comp rx=0 tx=0).stop 2024-09-17T03:36:21.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 -- 172.21.15.121:0/17694145 shutdown_connections 2024-09-17T03:36:21.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9944074cb0 0x7f99441f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9924078b90 0x7f992407b0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9944073dd0 0x7f9944152e80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 --2- 172.21.15.121:0/17694145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f994406e330 0x7f994409a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 -- 172.21.15.121:0/17694145 >> 172.21.15.121:0/17694145 conn(0x7f99440cca40 msgr2=0x7f99440cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:21.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 -- 172.21.15.121:0/17694145 shutdown_connections 2024-09-17T03:36:21.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:21.917+0000 7f994c400640 1 -- 172.21.15.121:0/17694145 wait complete. 2024-09-17T03:36:21.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T03:36:22.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.163+0000 7fce42600640 1 -- 172.21.15.121:0/2400553613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce3c06ddf0 msgr2=0x7fce3c06e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.163+0000 7fce42600640 1 --2- 172.21.15.121:0/2400553613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce3c06ddf0 0x7fce3c06e200 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce24009830 tx=0x7fce2402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.163+0000 7fce42600640 1 -- 172.21.15.121:0/2400553613 shutdown_connections 2024-09-17T03:36:22.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.163+0000 7fce42600640 1 --2- 172.21.15.121:0/2400553613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce3c0cef00 0x7fce3c0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.163+0000 7fce42600640 1 --2- 172.21.15.121:0/2400553613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce3c06ddf0 0x7fce3c06e200 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.163+0000 7fce42600640 1 -- 172.21.15.121:0/2400553613 >> 172.21.15.121:0/2400553613 conn(0x7fce3c0b1b90 msgr2=0x7fce3c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:22.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.163+0000 7fce42600640 1 -- 172.21.15.121:0/2400553613 shutdown_connections 2024-09-17T03:36:22.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.163+0000 7fce42600640 1 -- 172.21.15.121:0/2400553613 wait complete. 2024-09-17T03:36:22.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.165+0000 7fce42600640 1 Processor -- start 2024-09-17T03:36:22.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.166+0000 7fce42600640 1 -- start start 2024-09-17T03:36:22.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.167+0000 7fce42600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce3c06ddf0 0x7fce3c0b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.167+0000 7fce42600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce3c0cef00 0x7fce3c1f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.167+0000 7fce42600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce3c156a50 0x7fce3c0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.167+0000 7fce42600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c0cf850 con 0x7fce3c06ddf0 2024-09-17T03:36:22.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.167+0000 7fce42600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c161060 con 0x7fce3c0cef00 2024-09-17T03:36:22.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.167+0000 7fce42600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c0cf9d0 con 0x7fce3c156a50 2024-09-17T03:36:22.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.167+0000 7fce3b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce3c06ddf0 0x7fce3c0b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.167+0000 7fce3b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce3c06ddf0 0x7fce3c0b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48226/0 (socket says 172.21.15.121:48226) 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.167+0000 7fce3b400640 1 -- 172.21.15.121:0/427500158 learned_addr learned my addr 172.21.15.121:0/427500158 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce32a00640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce3c0cef00 0x7fce3c1f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce3be00640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce3c156a50 0x7fce3c0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce3b400640 1 -- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce3c156a50 msgr2=0x7fce3c0b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce3b400640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce3c156a50 0x7fce3c0b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce3b400640 1 -- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce3c0cef00 msgr2=0x7fce3c1f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce3b400640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce3c0cef00 0x7fce3c1f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce3b400640 1 -- 172.21.15.121:0/427500158 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c1f6190 con 0x7fce3c06ddf0 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce3be00640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce3c156a50 0x7fce3c0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce3b400640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce3c06ddf0 0x7fce3c0b57b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00c530 tx=0x7fce2c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce33e00640 1 -- 172.21.15.121:0/427500158 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c016020 con 0x7fce3c06ddf0 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce33e00640 1 -- 172.21.15.121:0/427500158 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce2c012940 con 0x7fce3c06ddf0 2024-09-17T03:36:22.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce42600640 1 -- 172.21.15.121:0/427500158 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c1f6470 con 0x7fce3c06ddf0 2024-09-17T03:36:22.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.168+0000 7fce33e00640 1 -- 172.21.15.121:0/427500158 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c012d90 con 0x7fce3c06ddf0 2024-09-17T03:36:22.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.169+0000 7fce42600640 1 -- 172.21.15.121:0/427500158 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c0b5cf0 con 0x7fce3c06ddf0 2024-09-17T03:36:22.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.169+0000 7fce42600640 1 -- 172.21.15.121:0/427500158 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c071760 con 0x7fce3c06ddf0 2024-09-17T03:36:22.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.171+0000 7fce33e00640 1 -- 172.21.15.121:0/427500158 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce2c019020 con 0x7fce3c06ddf0 2024-09-17T03:36:22.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.172+0000 7fce33e00640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce18078b90 0x7fce1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.172+0000 7fce33e00640 1 -- 172.21.15.121:0/427500158 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fce2c09afd0 con 0x7fce3c06ddf0 2024-09-17T03:36:22.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.172+0000 7fce32a00640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce18078b90 0x7fce1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.173+0000 7fce32a00640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce18078b90 0x7fce1807b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce24034000 tx=0x7fce24004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:22.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.176+0000 7fce33e00640 1 -- 172.21.15.121:0/427500158 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce3c071760 con 0x7fce3c06ddf0 2024-09-17T03:36:22.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.362+0000 7fce42600640 1 -- 172.21.15.121:0/427500158 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fce3c1604d0 con 0x7fce3c06ddf0 2024-09-17T03:36:22.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.363+0000 7fce33e00640 1 -- 172.21.15.121:0/427500158 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7fce3c1604d0 con 0x7fce3c06ddf0 2024-09-17T03:36:22.364 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.365+0000 7fce42600640 1 -- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce18078b90 msgr2=0x7fce1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.365+0000 7fce42600640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce18078b90 0x7fce1807b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce24034000 tx=0x7fce24004730 comp rx=0 tx=0).stop 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.365+0000 7fce42600640 1 -- 172.21.15.121:0/427500158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce3c06ddf0 msgr2=0x7fce3c0b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.365+0000 7fce42600640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce3c06ddf0 0x7fce3c0b57b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00c530 tx=0x7fce2c00c9f0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.366+0000 7fce42600640 1 -- 172.21.15.121:0/427500158 shutdown_connections 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.366+0000 7fce42600640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce3c156a50 0x7fce3c0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.366+0000 7fce42600640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce3c0cef00 0x7fce3c1f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.366+0000 7fce42600640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce18078b90 0x7fce1807b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.366+0000 7fce42600640 1 --2- 172.21.15.121:0/427500158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce3c06ddf0 0x7fce3c0b57b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.366+0000 7fce42600640 1 -- 172.21.15.121:0/427500158 >> 172.21.15.121:0/427500158 conn(0x7fce3c0b1b90 msgr2=0x7fce3c073690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.366+0000 7fce42600640 1 -- 172.21.15.121:0/427500158 shutdown_connections 2024-09-17T03:36:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.366+0000 7fce42600640 1 -- 172.21.15.121:0/427500158 wait complete. 2024-09-17T03:36:22.390 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T03:36:22.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.612+0000 7f66fd200640 1 -- 172.21.15.121:0/1719445793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f8156a50 msgr2=0x7f66f8074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.612+0000 7f66fd200640 1 --2- 172.21.15.121:0/1719445793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f8156a50 0x7f66f8074620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009830 tx=0x7f66e802a5b0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.612+0000 7f66fd200640 1 -- 172.21.15.121:0/1719445793 shutdown_connections 2024-09-17T03:36:22.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.612+0000 7f66fd200640 1 --2- 172.21.15.121:0/1719445793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f8156a50 0x7f66f8074620 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.612+0000 7f66fd200640 1 -- 172.21.15.121:0/1719445793 >> 172.21.15.121:0/1719445793 conn(0x7f66f80b1b90 msgr2=0x7f66f80b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:22.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.612+0000 7f66fd200640 1 -- 172.21.15.121:0/1719445793 shutdown_connections 2024-09-17T03:36:22.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.612+0000 7f66fd200640 1 -- 172.21.15.121:0/1719445793 wait complete. 2024-09-17T03:36:22.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.615+0000 7f66fd200640 1 Processor -- start 2024-09-17T03:36:22.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.615+0000 7f66fd200640 1 -- start start 2024-09-17T03:36:22.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.616+0000 7f66fd200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66f8074b60 0x7f66f80cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.616+0000 7f66fd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66f8156a50 0x7f66f80cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.616+0000 7f66fd200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f81e7090 0x7f66f81e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.616+0000 7f66fd200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f66f80cf790 con 0x7f66f8156a50 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.616+0000 7f66fd200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f66f80cf610 con 0x7f66f81e7090 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.616+0000 7f66fd200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f66f80cf910 con 0x7f66f8074b60 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66ed400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66f8156a50 0x7f66f80cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66ed400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66f8156a50 0x7f66f80cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48228/0 (socket says 172.21.15.121:48228) 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66ed400640 1 -- 172.21.15.121:0/225487639 learned_addr learned my addr 172.21.15.121:0/225487639 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66f5e00640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66f8074b60 0x7f66f80cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66f6800640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f81e7090 0x7f66f81e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66ed400640 1 -- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66f8074b60 msgr2=0x7f66f80cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66ed400640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66f8074b60 0x7f66f80cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66ed400640 1 -- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f81e7090 msgr2=0x7f66f81e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66ed400640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f81e7090 0x7f66f81e74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66ed400640 1 -- 172.21.15.121:0/225487639 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f81e5ff0 con 0x7f66f8156a50 2024-09-17T03:36:22.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.617+0000 7f66ed400640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66f8156a50 0x7f66f80cb390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f66e000c3c0 tx=0x7f66e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:22.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.618+0000 7f66eea00640 1 -- 172.21.15.121:0/225487639 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0011790 con 0x7f66f8156a50 2024-09-17T03:36:22.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.618+0000 7f66eea00640 1 -- 172.21.15.121:0/225487639 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66e0017070 con 0x7f66f8156a50 2024-09-17T03:36:22.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.618+0000 7f66eea00640 1 -- 172.21.15.121:0/225487639 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0011cc0 con 0x7f66f8156a50 2024-09-17T03:36:22.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.618+0000 7f66fd200640 1 -- 172.21.15.121:0/225487639 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f81e62d0 con 0x7f66f8156a50 2024-09-17T03:36:22.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.618+0000 7f66fd200640 1 -- 172.21.15.121:0/225487639 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f81e6890 con 0x7f66f8156a50 2024-09-17T03:36:22.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.619+0000 7f66fd200640 1 -- 172.21.15.121:0/225487639 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f8074620 con 0x7f66f8156a50 2024-09-17T03:36:22.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.620+0000 7f66eea00640 1 -- 172.21.15.121:0/225487639 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66e001c460 con 0x7f66f8156a50 2024-09-17T03:36:22.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.621+0000 7f66eea00640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d4078b90 0x7f66d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.621+0000 7f66eea00640 1 -- 172.21.15.121:0/225487639 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f66e009ad80 con 0x7f66f8156a50 2024-09-17T03:36:22.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.622+0000 7f66f5e00640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d4078b90 0x7f66d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.622+0000 7f66f5e00640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d4078b90 0x7f66d407b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f66e8034000 tx=0x7f66e8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:22.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.626+0000 7f66eea00640 1 -- 172.21.15.121:0/225487639 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66e0062760 con 0x7f66f8156a50 2024-09-17T03:36:22.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.809+0000 7f66fd200640 1 -- 172.21.15.121:0/225487639 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f66f80a0760 con 0x7f66f8156a50 2024-09-17T03:36:22.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.809+0000 7f66eea00640 1 -- 172.21.15.121:0/225487639 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f66e0067190 con 0x7f66f8156a50 2024-09-17T03:36:22.810 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2024-09-17T03:36:22.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.811+0000 7f66fd200640 1 -- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d4078b90 msgr2=0x7f66d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.811+0000 7f66fd200640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d4078b90 0x7f66d407b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f66e8034000 tx=0x7f66e8004730 comp rx=0 tx=0).stop 2024-09-17T03:36:22.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.811+0000 7f66fd200640 1 -- 172.21.15.121:0/225487639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66f8156a50 msgr2=0x7f66f80cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.812+0000 7f66fd200640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66f8156a50 0x7f66f80cb390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f66e000c3c0 tx=0x7f66e000c880 comp rx=0 tx=0).stop 2024-09-17T03:36:22.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.812+0000 7f66fd200640 1 -- 172.21.15.121:0/225487639 shutdown_connections 2024-09-17T03:36:22.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.812+0000 7f66fd200640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f81e7090 0x7f66f81e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.812+0000 7f66fd200640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d4078b90 0x7f66d407b0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.812+0000 7f66fd200640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66f8156a50 0x7f66f80cb390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.812+0000 7f66fd200640 1 --2- 172.21.15.121:0/225487639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66f8074b60 0x7f66f80cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.812+0000 7f66fd200640 1 -- 172.21.15.121:0/225487639 >> 172.21.15.121:0/225487639 conn(0x7f66f80b1b90 msgr2=0x7f66f80b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:22.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.812+0000 7f66fd200640 1 -- 172.21.15.121:0/225487639 shutdown_connections 2024-09-17T03:36:22.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:22.812+0000 7f66fd200640 1 -- 172.21.15.121:0/225487639 wait complete. 2024-09-17T03:36:22.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-17T03:36:23.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.057+0000 7fe5d8200640 1 -- 172.21.15.121:0/1799406899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d006ddf0 msgr2=0x7fe5d006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:23.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.057+0000 7fe5d8200640 1 --2- 172.21.15.121:0/1799406899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d006ddf0 0x7fe5d006e200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009830 tx=0x7fe5bc02a5b0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.058+0000 7fe5d8200640 1 -- 172.21.15.121:0/1799406899 shutdown_connections 2024-09-17T03:36:23.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.058+0000 7fe5d8200640 1 --2- 172.21.15.121:0/1799406899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d006ddf0 0x7fe5d006e200 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.058+0000 7fe5d8200640 1 -- 172.21.15.121:0/1799406899 >> 172.21.15.121:0/1799406899 conn(0x7fe5d00b1b90 msgr2=0x7fe5d00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:23.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.058+0000 7fe5d8200640 1 -- 172.21.15.121:0/1799406899 shutdown_connections 2024-09-17T03:36:23.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.058+0000 7fe5d8200640 1 -- 172.21.15.121:0/1799406899 wait complete. 2024-09-17T03:36:23.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.060+0000 7fe5d8200640 1 Processor -- start 2024-09-17T03:36:23.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.060+0000 7fe5d8200640 1 -- start start 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.061+0000 7fe5d8200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d006ddf0 0x7fe5d0157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.061+0000 7fe5d8200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5d00cef00 0x7fe5d00cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.061+0000 7fe5d8200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5d0156a50 0x7fe5d0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.061+0000 7fe5d8200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d0160fd0 con 0x7fe5d006ddf0 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.061+0000 7fe5d8200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d0160e50 con 0x7fe5d00cef00 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.061+0000 7fe5d8200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d00cfa20 con 0x7fe5d0156a50 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d5800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d006ddf0 0x7fe5d0157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d5800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d006ddf0 0x7fe5d0157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48234/0 (socket says 172.21.15.121:48234) 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d5800640 1 -- 172.21.15.121:0/4214064058 learned_addr learned my addr 172.21.15.121:0/4214064058 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d4e00640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5d00cef00 0x7fe5d00cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:23.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d6200640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5d0156a50 0x7fe5d0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:23.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d5800640 1 -- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5d0156a50 msgr2=0x7fe5d0159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:23.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d5800640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5d0156a50 0x7fe5d0159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d5800640 1 -- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5d00cef00 msgr2=0x7fe5d00cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:23.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d5800640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5d00cef00 0x7fe5d00cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d5800640 1 -- 172.21.15.121:0/4214064058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d01f5780 con 0x7fe5d006ddf0 2024-09-17T03:36:23.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.062+0000 7fe5d5800640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d006ddf0 0x7fe5d0157c40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400c400 tx=0x7fe5c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:23.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.063+0000 7fe5cd600640 1 -- 172.21.15.121:0/4214064058 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4011790 con 0x7fe5d006ddf0 2024-09-17T03:36:23.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.063+0000 7fe5cd600640 1 -- 172.21.15.121:0/4214064058 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5c4017070 con 0x7fe5d006ddf0 2024-09-17T03:36:23.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.063+0000 7fe5cd600640 1 -- 172.21.15.121:0/4214064058 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4011ce0 con 0x7fe5d006ddf0 2024-09-17T03:36:23.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.063+0000 7fe5d8200640 1 -- 172.21.15.121:0/4214064058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d01f5a60 con 0x7fe5d006ddf0 2024-09-17T03:36:23.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.063+0000 7fe5d8200640 1 -- 172.21.15.121:0/4214064058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d01f6300 con 0x7fe5d006ddf0 2024-09-17T03:36:23.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.064+0000 7fe5d8200640 1 -- 172.21.15.121:0/4214064058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d006e200 con 0x7fe5d006ddf0 2024-09-17T03:36:23.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.065+0000 7fe5cd600640 1 -- 172.21.15.121:0/4214064058 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5c401c460 con 0x7fe5d006ddf0 2024-09-17T03:36:23.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.066+0000 7fe5cd600640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe5b0078b90 0x7fe5b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:23.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.066+0000 7fe5cd600640 1 -- 172.21.15.121:0/4214064058 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fe5c409aef0 con 0x7fe5d006ddf0 2024-09-17T03:36:23.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.066+0000 7fe5d4e00640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe5b0078b90 0x7fe5b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:23.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.067+0000 7fe5d4e00640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe5b0078b90 0x7fe5b007b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc034000 tx=0x7fe5bc004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:23.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.070+0000 7fe5cd600640 1 -- 172.21.15.121:0/4214064058 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe5d006e740 con 0x7fe5d006ddf0 2024-09-17T03:36:23.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.254+0000 7fe5d8200640 1 -- 172.21.15.121:0/4214064058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe5d01f5c30 con 0x7fe5d006ddf0 2024-09-17T03:36:23.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.255+0000 7fe5cd600640 1 -- 172.21.15.121:0/4214064058 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7fe5c4062f20 con 0x7fe5d006ddf0 2024-09-17T03:36:23.256 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2024-09-17T03:36:23.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 -- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe5b0078b90 msgr2=0x7fe5b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:23.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe5b0078b90 0x7fe5b007b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc034000 tx=0x7fe5bc004730 comp rx=0 tx=0).stop 2024-09-17T03:36:23.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 -- 172.21.15.121:0/4214064058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d006ddf0 msgr2=0x7fe5d0157c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:23.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d006ddf0 0x7fe5d0157c40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400c400 tx=0x7fe5c400c8c0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 -- 172.21.15.121:0/4214064058 shutdown_connections 2024-09-17T03:36:23.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5d0156a50 0x7fe5d0159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5d00cef00 0x7fe5d00cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe5b0078b90 0x7fe5b007b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 --2- 172.21.15.121:0/4214064058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5d006ddf0 0x7fe5d0157c40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 -- 172.21.15.121:0/4214064058 >> 172.21.15.121:0/4214064058 conn(0x7fe5d00b1b90 msgr2=0x7fe5d015a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:23.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.257+0000 7fe5d8200640 1 -- 172.21.15.121:0/4214064058 shutdown_connections 2024-09-17T03:36:23.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.258+0000 7fe5d8200640 1 -- 172.21.15.121:0/4214064058 wait complete. 2024-09-17T03:36:23.283 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-09-17T03:36:23.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.502+0000 7fa6f9a00640 1 -- 172.21.15.121:0/978675289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6f40cc8b0 msgr2=0x7fa6f40cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:23.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.502+0000 7fa6f9a00640 1 --2- 172.21.15.121:0/978675289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6f40cc8b0 0x7fa6f40cccc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc005fd0 tx=0x7fa6dc02a560 comp rx=0 tx=0).stop 2024-09-17T03:36:23.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.502+0000 7fa6f9a00640 1 -- 172.21.15.121:0/978675289 shutdown_connections 2024-09-17T03:36:23.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.502+0000 7fa6f9a00640 1 --2- 172.21.15.121:0/978675289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6f40cc8b0 0x7fa6f40cccc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.502+0000 7fa6f9a00640 1 -- 172.21.15.121:0/978675289 >> 172.21.15.121:0/978675289 conn(0x7fa6f406f940 msgr2=0x7fa6f40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:23.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.502+0000 7fa6f9a00640 1 -- 172.21.15.121:0/978675289 shutdown_connections 2024-09-17T03:36:23.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.502+0000 7fa6f9a00640 1 -- 172.21.15.121:0/978675289 wait complete. 2024-09-17T03:36:23.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.504+0000 7fa6f9a00640 1 Processor -- start 2024-09-17T03:36:23.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.505+0000 7fa6f9a00640 1 -- start start 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6f9a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6f40cc8b0 0x7fa6f4153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6f9a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f40cdea0 0x7fa6f4148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6f9a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6f415f760 0x7fa6f40b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6f9a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f406df60 con 0x7fa6f40cc8b0 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6f9a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f406e600 con 0x7fa6f40cdea0 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6f9a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f40ce9c0 con 0x7fa6f415f760 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6f3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6f40cc8b0 0x7fa6f4153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6f3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6f40cc8b0 0x7fa6f4153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48244/0 (socket says 172.21.15.121:48244) 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6eb400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f40cdea0 0x7fa6f4148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6f3e00640 1 -- 172.21.15.121:0/2820842053 learned_addr learned my addr 172.21.15.121:0/2820842053 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.506+0000 7fa6f9000640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6f415f760 0x7fa6f40b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.507+0000 7fa6eb400640 1 -- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6f415f760 msgr2=0x7fa6f40b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.507+0000 7fa6eb400640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6f415f760 0x7fa6f40b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.507+0000 7fa6eb400640 1 -- 172.21.15.121:0/2820842053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6f40cc8b0 msgr2=0x7fa6f4153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.507+0000 7fa6eb400640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6f40cc8b0 0x7fa6f4153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.507+0000 7fa6eb400640 1 -- 172.21.15.121:0/2820842053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f40c5090 con 0x7fa6f40cdea0 2024-09-17T03:36:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.507+0000 7fa6f3e00640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6f40cc8b0 0x7fa6f4153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.507+0000 7fa6eb400640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f40cdea0 0x7fa6f4148b00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc031000 tx=0x7fa6dc003910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:23.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.507+0000 7fa6f0c00640 1 -- 172.21.15.121:0/2820842053 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc03e030 con 0x7fa6f40cdea0 2024-09-17T03:36:23.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.507+0000 7fa6f0c00640 1 -- 172.21.15.121:0/2820842053 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6dc0047a0 con 0x7fa6f40cdea0 2024-09-17T03:36:23.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.507+0000 7fa6f0c00640 1 -- 172.21.15.121:0/2820842053 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc035040 con 0x7fa6f40cdea0 2024-09-17T03:36:23.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.508+0000 7fa6f9a00640 1 -- 172.21.15.121:0/2820842053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f40c5370 con 0x7fa6f40cdea0 2024-09-17T03:36:23.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.508+0000 7fa6f9a00640 1 -- 172.21.15.121:0/2820842053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f40c5930 con 0x7fa6f40cdea0 2024-09-17T03:36:23.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.508+0000 7fa6f9a00640 1 -- 172.21.15.121:0/2820842053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f41f9af0 con 0x7fa6f40cdea0 2024-09-17T03:36:23.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.510+0000 7fa6f0c00640 1 -- 172.21.15.121:0/2820842053 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6dc041030 con 0x7fa6f40cdea0 2024-09-17T03:36:23.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.511+0000 7fa6f0c00640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d0078b90 0x7fa6d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:23.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.511+0000 7fa6f0c00640 1 -- 172.21.15.121:0/2820842053 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fa6dc0bb860 con 0x7fa6f40cdea0 2024-09-17T03:36:23.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.511+0000 7fa6f3e00640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d0078b90 0x7fa6d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:23.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.512+0000 7fa6f3e00640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d0078b90 0x7fa6d007b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4007fd0 tx=0x7fa6e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:23.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.516+0000 7fa6f0c00640 1 -- 172.21.15.121:0/2820842053 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa6dc0832d0 con 0x7fa6f40cdea0 2024-09-17T03:36:23.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:23.770+0000 7fa6f9a00640 1 -- 172.21.15.121:0/2820842053 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) -- 0x7fa6f4153d70 con 0x7fa6f40cdea0 2024-09-17T03:36:24.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.644+0000 7fa6f0c00640 1 -- 172.21.15.121:0/2820842053 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v72) ==== 147+0+0 (secure 0 0 0) 0x7fa6dc087d00 con 0x7fa6f40cdea0 2024-09-17T03:36:24.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 -- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d0078b90 msgr2=0x7fa6d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:24.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d0078b90 0x7fa6d007b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4007fd0 tx=0x7fa6e4009040 comp rx=0 tx=0).stop 2024-09-17T03:36:24.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 -- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f40cdea0 msgr2=0x7fa6f4148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:24.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f40cdea0 0x7fa6f4148b00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc031000 tx=0x7fa6dc003910 comp rx=0 tx=0).stop 2024-09-17T03:36:24.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 -- 172.21.15.121:0/2820842053 shutdown_connections 2024-09-17T03:36:24.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6f415f760 0x7fa6f40b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:24.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6f40cdea0 0x7fa6f4148b00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:24.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d0078b90 0x7fa6d007b0a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:24.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 --2- 172.21.15.121:0/2820842053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6f40cc8b0 0x7fa6f4153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:24.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 -- 172.21.15.121:0/2820842053 >> 172.21.15.121:0/2820842053 conn(0x7fa6f406f940 msgr2=0x7fa6f40b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:24.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 -- 172.21.15.121:0/2820842053 shutdown_connections 2024-09-17T03:36:24.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.647+0000 7fa6f9a00640 1 -- 172.21.15.121:0/2820842053 wait complete. 2024-09-17T03:36:24.670 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:36:24.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.890+0000 7f3dc7200640 1 -- 172.21.15.121:0/2093033147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dc806d7f0 msgr2=0x7f3dc8154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:24.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.890+0000 7f3dc7200640 1 --2- 172.21.15.121:0/2093033147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dc806d7f0 0x7f3dc8154ea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80d5180 tx=0x7f3dc002aa30 comp rx=0 tx=0).stop 2024-09-17T03:36:24.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.890+0000 7f3dc7200640 1 -- 172.21.15.121:0/2093033147 shutdown_connections 2024-09-17T03:36:24.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.890+0000 7f3dc7200640 1 --2- 172.21.15.121:0/2093033147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dc806d7f0 0x7f3dc8154ea0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:24.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.890+0000 7f3dc7200640 1 --2- 172.21.15.121:0/2093033147 >> v2:172.21.15.176:3300/0 conn(0x7f3dc81627f0 0x7f3dc806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:24.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.890+0000 7f3dc7200640 1 --2- 172.21.15.121:0/2093033147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dc80b9e40 0x7f3dc81622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:24.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.890+0000 7f3dc7200640 1 -- 172.21.15.121:0/2093033147 >> 172.21.15.121:0/2093033147 conn(0x7f3dc80d1930 msgr2=0x7f3dc80d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:24.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.890+0000 7f3dc7200640 1 -- 172.21.15.121:0/2093033147 shutdown_connections 2024-09-17T03:36:24.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.890+0000 7f3dc7200640 1 -- 172.21.15.121:0/2093033147 wait complete. 2024-09-17T03:36:24.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.892+0000 7f3dc7200640 1 Processor -- start 2024-09-17T03:36:24.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.892+0000 7f3dc7200640 1 -- start start 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc7200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dc806d7f0 0x7f3dc815b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc7200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dc80b9e40 0x7f3dc81610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc7200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dc81627f0 0x7f3dc8161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc7200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc81555f0 con 0x7f3dc80b9e40 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc7200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc806e7f0 con 0x7f3dc806d7f0 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc7200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc8155770 con 0x7f3dc81627f0 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dc80b9e40 0x7f3dc81610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dc80b9e40 0x7f3dc81610d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48262/0 (socket says 172.21.15.121:48262) 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc5400640 1 -- 172.21.15.121:0/2345397463 learned_addr learned my addr 172.21.15.121:0/2345397463 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc6800640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dc81627f0 0x7f3dc8161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:24.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc5e00640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dc806d7f0 0x7f3dc815b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:24.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc5400640 1 -- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dc81627f0 msgr2=0x7f3dc8161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:24.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc5400640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dc81627f0 0x7f3dc8161610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:24.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc5400640 1 -- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dc806d7f0 msgr2=0x7f3dc815b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:24.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc5400640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dc806d7f0 0x7f3dc815b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:24.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc5400640 1 -- 172.21.15.121:0/2345397463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc815fef0 con 0x7f3dc80b9e40 2024-09-17T03:36:24.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.894+0000 7f3dc6800640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dc81627f0 0x7f3dc8161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:24.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.895+0000 7f3dc5400640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dc80b9e40 0x7f3dc81610d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3db400d6d0 tx=0x7f3db400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:24.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.895+0000 7f3dbe000640 1 -- 172.21.15.121:0/2345397463 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4017070 con 0x7f3dc80b9e40 2024-09-17T03:36:24.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.895+0000 7f3dbe000640 1 -- 172.21.15.121:0/2345397463 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3db4009b10 con 0x7f3dc80b9e40 2024-09-17T03:36:24.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.895+0000 7f3dc7200640 1 -- 172.21.15.121:0/2345397463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc81601d0 con 0x7f3dc80b9e40 2024-09-17T03:36:24.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.895+0000 7f3dbe000640 1 -- 172.21.15.121:0/2345397463 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4010460 con 0x7f3dc80b9e40 2024-09-17T03:36:24.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.895+0000 7f3dc7200640 1 -- 172.21.15.121:0/2345397463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc8160790 con 0x7f3dc80b9e40 2024-09-17T03:36:24.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.896+0000 7f3dc7200640 1 -- 172.21.15.121:0/2345397463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc81f4fe0 con 0x7f3dc80b9e40 2024-09-17T03:36:24.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.897+0000 7f3dbe000640 1 -- 172.21.15.121:0/2345397463 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3db401a070 con 0x7f3dc80b9e40 2024-09-17T03:36:24.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.900+0000 7f3dbe000640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3da8078b90 0x7f3da807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:24.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.900+0000 7f3dbe000640 1 -- 172.21.15.121:0/2345397463 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f3db409b230 con 0x7f3dc80b9e40 2024-09-17T03:36:24.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.900+0000 7f3dc5e00640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3da8078b90 0x7f3da807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:24.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.901+0000 7f3dc5e00640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3da8078b90 0x7f3da807b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3db800daa0 tx=0x7f3db8005d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:24.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:24.904+0000 7f3dbe000640 1 -- 172.21.15.121:0/2345397463 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3db40632f0 con 0x7f3dc80b9e40 2024-09-17T03:36:25.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.085+0000 7f3dc7200640 1 -- 172.21.15.121:0/2345397463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f3dc815fc80 con 0x7f3dc80b9e40 2024-09-17T03:36:25.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.085+0000 7f3dbe000640 1 -- 172.21.15.121:0/2345397463 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7f3db4062bf0 con 0x7f3dc80b9e40 2024-09-17T03:36:25.085 INFO:teuthology.orchestra.run.smithi121.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:36:25.085 INFO:teuthology.orchestra.run.smithi121.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:36:25.085 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:36:25.085 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_client 20/20 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3249.879374 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3414.976419 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3347.142673 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3524.210167 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 7230.495988 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4229.547603 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4520.738354 2024-09-17T03:36:25.086 INFO:teuthology.orchestra.run.smithi121.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4185.245448 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds 20/20 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_ms 2/2 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_frag true 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_verify_scatter true 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced client_mount_timeout 600 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_client 20/20 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_ms 1/1 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:36:25.087 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:36:25.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.087+0000 7f3dc7200640 1 -- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3da8078b90 msgr2=0x7f3da807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:25.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.087+0000 7f3dc7200640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3da8078b90 0x7f3da807b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3db800daa0 tx=0x7f3db8005d70 comp rx=0 tx=0).stop 2024-09-17T03:36:25.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.088+0000 7f3dc7200640 1 -- 172.21.15.121:0/2345397463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dc80b9e40 msgr2=0x7f3dc81610d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:25.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.088+0000 7f3dc7200640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dc80b9e40 0x7f3dc81610d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3db400d6d0 tx=0x7f3db400db90 comp rx=0 tx=0).stop 2024-09-17T03:36:25.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.088+0000 7f3dc7200640 1 -- 172.21.15.121:0/2345397463 shutdown_connections 2024-09-17T03:36:25.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.088+0000 7f3dc7200640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3dc81627f0 0x7f3dc8161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.088+0000 7f3dc7200640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3da8078b90 0x7f3da807b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.088+0000 7f3dc7200640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dc80b9e40 0x7f3dc81610d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.088+0000 7f3dc7200640 1 --2- 172.21.15.121:0/2345397463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3dc806d7f0 0x7f3dc815b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.088+0000 7f3dc7200640 1 -- 172.21.15.121:0/2345397463 >> 172.21.15.121:0/2345397463 conn(0x7f3dc80d1930 msgr2=0x7f3dc8154cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:25.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.088+0000 7f3dc7200640 1 -- 172.21.15.121:0/2345397463 shutdown_connections 2024-09-17T03:36:25.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.088+0000 7f3dc7200640 1 -- 172.21.15.121:0/2345397463 wait complete. 2024-09-17T03:36:25.112 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:36:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.335+0000 7f67e9400640 1 -- 172.21.15.121:0/3267397251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67e406e330 msgr2=0x7f67e40cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.335+0000 7f67e9400640 1 --2- 172.21.15.121:0/3267397251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67e406e330 0x7f67e40cdc70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f67e40cca40 tx=0x7f67dc02aa30 comp rx=0 tx=0).stop 2024-09-17T03:36:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.335+0000 7f67e9400640 1 -- 172.21.15.121:0/3267397251 shutdown_connections 2024-09-17T03:36:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.335+0000 7f67e9400640 1 --2- 172.21.15.121:0/3267397251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67e406e330 0x7f67e40cdc70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.335+0000 7f67e9400640 1 --2- 172.21.15.121:0/3267397251 >> v2:172.21.15.176:3300/0 conn(0x7f67e4074b60 0x7f67e406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.335+0000 7f67e9400640 1 --2- 172.21.15.121:0/3267397251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e4156a50 0x7f67e4074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.335+0000 7f67e9400640 1 -- 172.21.15.121:0/3267397251 >> 172.21.15.121:0/3267397251 conn(0x7f67e40b1b90 msgr2=0x7f67e40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.335+0000 7f67e9400640 1 -- 172.21.15.121:0/3267397251 shutdown_connections 2024-09-17T03:36:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.335+0000 7f67e9400640 1 -- 172.21.15.121:0/3267397251 wait complete. 2024-09-17T03:36:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.338+0000 7f67e9400640 1 Processor -- start 2024-09-17T03:36:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.338+0000 7f67e9400640 1 -- start start 2024-09-17T03:36:25.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.339+0000 7f67e9400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e406e330 0x7f67e40c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:25.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.339+0000 7f67e9400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e4074b60 0x7f67e40c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:25.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.339+0000 7f67e9400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67e4156a50 0x7f67e415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.339+0000 7f67e9400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f67e40ce330 con 0x7f67e4156a50 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.339+0000 7f67e9400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67e40ce1b0 con 0x7f67e4074b60 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.339+0000 7f67e9400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f67e40ce4b0 con 0x7f67e406e330 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.339+0000 7f67e3200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67e4156a50 0x7f67e415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.339+0000 7f67e3200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67e4156a50 0x7f67e415e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48288/0 (socket says 172.21.15.121:48288) 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.339+0000 7f67e3200640 1 -- 172.21.15.121:0/2774084165 learned_addr learned my addr 172.21.15.121:0/2774084165 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67e2800640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e406e330 0x7f67e40c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67dbe00640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e4074b60 0x7f67e40c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67e3200640 1 -- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e406e330 msgr2=0x7f67e40c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67e3200640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e406e330 0x7f67e40c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67e3200640 1 -- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e4074b60 msgr2=0x7f67e40c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67e3200640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e4074b60 0x7f67e40c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67e3200640 1 -- 172.21.15.121:0/2774084165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e40c79d0 con 0x7f67e4156a50 2024-09-17T03:36:25.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67e2800640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e406e330 0x7f67e40c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:25.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67dbe00640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e4074b60 0x7f67e40c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:25.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67e3200640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67e4156a50 0x7f67e415e1b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f67dc02b020 tx=0x7f67dc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:25.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67daa00640 1 -- 172.21.15.121:0/2774084165 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc033050 con 0x7f67e4156a50 2024-09-17T03:36:25.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67daa00640 1 -- 172.21.15.121:0/2774084165 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67dc004450 con 0x7f67e4156a50 2024-09-17T03:36:25.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67e9400640 1 -- 172.21.15.121:0/2774084165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e40c7cb0 con 0x7f67e4156a50 2024-09-17T03:36:25.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.340+0000 7f67daa00640 1 -- 172.21.15.121:0/2774084165 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc038450 con 0x7f67e4156a50 2024-09-17T03:36:25.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.341+0000 7f67e9400640 1 -- 172.21.15.121:0/2774084165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e40ca240 con 0x7f67e4156a50 2024-09-17T03:36:25.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.342+0000 7f67e9400640 1 -- 172.21.15.121:0/2774084165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e40c7740 con 0x7f67e4156a50 2024-09-17T03:36:25.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.343+0000 7f67daa00640 1 -- 172.21.15.121:0/2774084165 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f67dc036070 con 0x7f67e4156a50 2024-09-17T03:36:25.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.344+0000 7f67daa00640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f67c0078b90 0x7f67c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:25.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.344+0000 7f67daa00640 1 -- 172.21.15.121:0/2774084165 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f67dc0bc770 con 0x7f67e4156a50 2024-09-17T03:36:25.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.344+0000 7f67e2800640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f67c0078b90 0x7f67c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:25.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.345+0000 7f67e2800640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f67c0078b90 0x7f67c007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009aa0 tx=0x7f67d4005db0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:25.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.349+0000 7f67daa00640 1 -- 172.21.15.121:0/2774084165 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f67dc0847a0 con 0x7f67e4156a50 2024-09-17T03:36:25.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.530+0000 7f67e9400640 1 -- 172.21.15.121:0/2774084165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f67e4070ec0 con 0x7f67e4156a50 2024-09-17T03:36:25.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.535+0000 7f67daa00640 1 -- 172.21.15.121:0/2774084165 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f67e4070ec0 con 0x7f67e4156a50 2024-09-17T03:36:25.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.537+0000 7f67e9400640 1 -- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f67c0078b90 msgr2=0x7f67c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:25.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.537+0000 7f67e9400640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f67c0078b90 0x7f67c007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009aa0 tx=0x7f67d4005db0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.537+0000 7f67e9400640 1 -- 172.21.15.121:0/2774084165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67e4156a50 msgr2=0x7f67e415e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:25.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.537+0000 7f67e9400640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67e4156a50 0x7f67e415e1b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f67dc02b020 tx=0x7f67dc003f10 comp rx=0 tx=0).stop 2024-09-17T03:36:25.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.537+0000 7f67e9400640 1 -- 172.21.15.121:0/2774084165 shutdown_connections 2024-09-17T03:36:25.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.537+0000 7f67e9400640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f67c0078b90 0x7f67c007b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.537+0000 7f67e9400640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67e4156a50 0x7f67e415e1b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.537+0000 7f67e9400640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67e4074b60 0x7f67e40c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.537+0000 7f67e9400640 1 --2- 172.21.15.121:0/2774084165 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67e406e330 0x7f67e40c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:25.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.537+0000 7f67e9400640 1 -- 172.21.15.121:0/2774084165 >> 172.21.15.121:0/2774084165 conn(0x7f67e40b1b90 msgr2=0x7f67e40afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:25.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.538+0000 7f67e9400640 1 -- 172.21.15.121:0/2774084165 shutdown_connections 2024-09-17T03:36:25.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:25.538+0000 7f67e9400640 1 -- 172.21.15.121:0/2774084165 wait complete. 2024-09-17T03:36:25.559 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:36:25.559 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:36:25.651 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:36:25.756 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:36:25.756 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:25.756 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:25.792 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:25.792 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:25.868 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:25.868 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:25.944 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:36:26.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.205+0000 7fefd5800640 1 -- 172.21.15.121:0/1774902675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd0156a50 msgr2=0x7fefd0074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.205+0000 7fefd5800640 1 --2- 172.21.15.121:0/1774902675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd0156a50 0x7fefd0074620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fefc0005fd0 tx=0x7fefc002a530 comp rx=0 tx=0).stop 2024-09-17T03:36:26.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.205+0000 7fefd5800640 1 -- 172.21.15.121:0/1774902675 shutdown_connections 2024-09-17T03:36:26.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.205+0000 7fefd5800640 1 --2- 172.21.15.121:0/1774902675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd006e500 0x7fefd00cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.205+0000 7fefd5800640 1 --2- 172.21.15.121:0/1774902675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd0156a50 0x7fefd0074620 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.205+0000 7fefd5800640 1 -- 172.21.15.121:0/1774902675 >> 172.21.15.121:0/1774902675 conn(0x7fefd00b1b90 msgr2=0x7fefd00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:26.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.205+0000 7fefd5800640 1 -- 172.21.15.121:0/1774902675 shutdown_connections 2024-09-17T03:36:26.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.205+0000 7fefd5800640 1 -- 172.21.15.121:0/1774902675 wait complete. 2024-09-17T03:36:26.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.207+0000 7fefd5800640 1 Processor -- start 2024-09-17T03:36:26.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.208+0000 7fefd5800640 1 -- start start 2024-09-17T03:36:26.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefd5800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd0074b60 0x7fefd00c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefd5800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd0156a50 0x7fefd00c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefd5800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd00c5990 0x7fefd00b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefd5800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fefd00cf7d0 con 0x7fefd00c5990 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefd5800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fefd00cf650 con 0x7fefd0074b60 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefd5800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fefd00cf950 con 0x7fefd0156a50 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefcf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd00c5990 0x7fefd00b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefcf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd00c5990 0x7fefd00b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48306/0 (socket says 172.21.15.121:48306) 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefcf400640 1 -- 172.21.15.121:0/636820824 learned_addr learned my addr 172.21.15.121:0/636820824 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefcea00640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd0074b60 0x7fefd00c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.209+0000 7fefce000640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd0156a50 0x7fefd00c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefcf400640 1 -- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd0156a50 msgr2=0x7fefd00c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefcf400640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd0156a50 0x7fefd00c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefcf400640 1 -- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd0074b60 msgr2=0x7fefd00c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefcf400640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd0074b60 0x7fefd00c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefcf400640 1 -- 172.21.15.121:0/636820824 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd00b46c0 con 0x7fefd00c5990 2024-09-17T03:36:26.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefce000640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd0156a50 0x7fefd00c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:26.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefcf400640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd00c5990 0x7fefd00b4180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fefc800e990 tx=0x7fefc800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:26.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefc6a00640 1 -- 172.21.15.121:0/636820824 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8004d20 con 0x7fefd00c5990 2024-09-17T03:36:26.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefc6a00640 1 -- 172.21.15.121:0/636820824 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefc800caa0 con 0x7fefd00c5990 2024-09-17T03:36:26.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefd5800640 1 -- 172.21.15.121:0/636820824 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd00c8970 con 0x7fefd00c5990 2024-09-17T03:36:26.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefc6a00640 1 -- 172.21.15.121:0/636820824 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8005020 con 0x7fefd00c5990 2024-09-17T03:36:26.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.210+0000 7fefd5800640 1 -- 172.21.15.121:0/636820824 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd00c8f30 con 0x7fefd00c5990 2024-09-17T03:36:26.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.211+0000 7fefd5800640 1 -- 172.21.15.121:0/636820824 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd0070ec0 con 0x7fefd00c5990 2024-09-17T03:36:26.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.213+0000 7fefc6a00640 1 -- 172.21.15.121:0/636820824 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fefc80051c0 con 0x7fefd00c5990 2024-09-17T03:36:26.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.214+0000 7fefc6a00640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefb0078b90 0x7fefb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.214+0000 7fefc6a00640 1 -- 172.21.15.121:0/636820824 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fefc809b9c0 con 0x7fefd00c5990 2024-09-17T03:36:26.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.214+0000 7fefcea00640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefb0078b90 0x7fefb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.215+0000 7fefcea00640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefb0078b90 0x7fefb007b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fefc0033000 tx=0x7fefc0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:26.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.218+0000 7fefc6a00640 1 -- 172.21.15.121:0/636820824 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fefd0070ec0 con 0x7fefd00c5990 2024-09-17T03:36:26.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.416+0000 7fefd5800640 1 -- 172.21.15.121:0/636820824 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fefd00c8700 con 0x7fefd00c5990 2024-09-17T03:36:26.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.416+0000 7fefc6a00640 1 -- 172.21.15.121:0/636820824 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fefc8016030 con 0x7fefd00c5990 2024-09-17T03:36:26.416 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:36:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 -- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefb0078b90 msgr2=0x7fefb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefb0078b90 0x7fefb007b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fefc0033000 tx=0x7fefc0004730 comp rx=0 tx=0).stop 2024-09-17T03:36:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 -- 172.21.15.121:0/636820824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd00c5990 msgr2=0x7fefd00b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd00c5990 0x7fefd00b4180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fefc800e990 tx=0x7fefc800ee50 comp rx=0 tx=0).stop 2024-09-17T03:36:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 -- 172.21.15.121:0/636820824 shutdown_connections 2024-09-17T03:36:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefb0078b90 0x7fefb007b0a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd00c5990 0x7fefd00b4180 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefd0156a50 0x7fefd00c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 --2- 172.21.15.121:0/636820824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefd0074b60 0x7fefd00c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 -- 172.21.15.121:0/636820824 >> 172.21.15.121:0/636820824 conn(0x7fefd00b1b90 msgr2=0x7fefd015fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:26.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 -- 172.21.15.121:0/636820824 shutdown_connections 2024-09-17T03:36:26.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.419+0000 7fefd5800640 1 -- 172.21.15.121:0/636820824 wait complete. 2024-09-17T03:36:26.442 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:36:26.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:26.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T03:36:26.504 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:36:26.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:26.504 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:36:26.540 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:36:26.540 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:26.580 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:36:26.581 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:26.661 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:36:26.661 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:26.740 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:36:26.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.962+0000 7fc0fd000640 1 -- 172.21.15.121:0/3764889985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc004d40 msgr2=0x7fc0dc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.962+0000 7fc0fd000640 1 --2- 172.21.15.121:0/3764889985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc004d40 0x7fc0dc005150 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000c780 tx=0x7fc0dc005830 comp rx=0 tx=0).stop 2024-09-17T03:36:26.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.962+0000 7fc0f6800640 1 -- 172.21.15.121:0/3764889985 reap_dead start 2024-09-17T03:36:26.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.962+0000 7fc0fd000640 1 -- 172.21.15.121:0/3764889985 shutdown_connections 2024-09-17T03:36:26.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.962+0000 7fc0fd000640 1 -- 172.21.15.121:0/3764889985 >> 172.21.15.121:0/3764889985 conn(0x7fc0f80b1b90 msgr2=0x7fc0f80b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:26.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.962+0000 7fc0fd000640 1 -- 172.21.15.121:0/3764889985 shutdown_connections 2024-09-17T03:36:26.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.962+0000 7fc0fd000640 1 -- 172.21.15.121:0/3764889985 wait complete. 2024-09-17T03:36:26.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.964+0000 7fc0fd000640 1 Processor -- start 2024-09-17T03:36:26.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.965+0000 7fc0fd000640 1 -- start start 2024-09-17T03:36:26.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0fd000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f80b5540 0x7fc0f81546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0fd000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f8154f80 0x7fc0f8155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0fd000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0f81558d0 0x7fc0f80b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0fd000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f8071000 con 0x7fc0f8154f80 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0fd000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f8070e80 con 0x7fc0f80b5540 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0fd000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f806f770 con 0x7fc0f81558d0 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0f5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f8154f80 0x7fc0f8155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0f5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f8154f80 0x7fc0f8155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48320/0 (socket says 172.21.15.121:48320) 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0f5400640 1 -- 172.21.15.121:0/1885410868 learned_addr learned my addr 172.21.15.121:0/1885410868 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0f5e00640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f80b5540 0x7fc0f81546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.966+0000 7fc0f6800640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0f81558d0 0x7fc0f80b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0f5400640 1 -- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0f81558d0 msgr2=0x7fc0f80b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0f5400640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0f81558d0 0x7fc0f80b6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0f5400640 1 -- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f80b5540 msgr2=0x7fc0f81546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0f5400640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f80b5540 0x7fc0f81546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0f5400640 1 -- 172.21.15.121:0/1885410868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f8155ce0 con 0x7fc0f8154f80 2024-09-17T03:36:26.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0f5400640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f8154f80 0x7fc0f8155390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4011ae0 tx=0x7fc0e4011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:26.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0ee000640 1 -- 172.21.15.121:0/1885410868 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4004460 con 0x7fc0f8154f80 2024-09-17T03:36:26.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0ee000640 1 -- 172.21.15.121:0/1885410868 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0e400f9e0 con 0x7fc0f8154f80 2024-09-17T03:36:26.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0fd000640 1 -- 172.21.15.121:0/1885410868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f80c9840 con 0x7fc0f8154f80 2024-09-17T03:36:26.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0ee000640 1 -- 172.21.15.121:0/1885410868 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e400fe10 con 0x7fc0f8154f80 2024-09-17T03:36:26.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.967+0000 7fc0fd000640 1 -- 172.21.15.121:0/1885410868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f80b4d40 con 0x7fc0f8154f80 2024-09-17T03:36:26.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.968+0000 7fc0fd000640 1 -- 172.21.15.121:0/1885410868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f806e200 con 0x7fc0f8154f80 2024-09-17T03:36:26.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.970+0000 7fc0ee000640 1 -- 172.21.15.121:0/1885410868 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0e40035f0 con 0x7fc0f8154f80 2024-09-17T03:36:26.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.972+0000 7fc0ee000640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0d8078b90 0x7fc0d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.972+0000 7fc0ee000640 1 -- 172.21.15.121:0/1885410868 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fc0e409c0b0 con 0x7fc0f8154f80 2024-09-17T03:36:26.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.972+0000 7fc0f5e00640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0d8078b90 0x7fc0d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.973+0000 7fc0f5e00640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0d8078b90 0x7fc0d807b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80691c0 tx=0x7fc0e8005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:26.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:26.976+0000 7fc0ee000640 1 -- 172.21.15.121:0/1885410868 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0e4063c50 con 0x7fc0f8154f80 2024-09-17T03:36:27.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.173+0000 7fc0fd000640 1 -- 172.21.15.121:0/1885410868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc0f80af7e0 con 0x7fc0f8154f80 2024-09-17T03:36:27.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.173+0000 7fc0ee000640 1 -- 172.21.15.121:0/1885410868 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fc0e4068680 con 0x7fc0f8154f80 2024-09-17T03:36:27.173 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:36:27.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.175+0000 7fc0fd000640 1 -- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0d8078b90 msgr2=0x7fc0d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.175+0000 7fc0fd000640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0d8078b90 0x7fc0d807b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80691c0 tx=0x7fc0e8005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:27.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.176+0000 7fc0fd000640 1 -- 172.21.15.121:0/1885410868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f8154f80 msgr2=0x7fc0f8155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.176+0000 7fc0fd000640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f8154f80 0x7fc0f8155390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4011ae0 tx=0x7fc0e4011ee0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.176+0000 7fc0fd000640 1 -- 172.21.15.121:0/1885410868 shutdown_connections 2024-09-17T03:36:27.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.176+0000 7fc0fd000640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0f81558d0 0x7fc0f80b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.176+0000 7fc0fd000640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0d8078b90 0x7fc0d807b0a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.176+0000 7fc0fd000640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f8154f80 0x7fc0f8155390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.176+0000 7fc0fd000640 1 --2- 172.21.15.121:0/1885410868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f80b5540 0x7fc0f81546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.176+0000 7fc0fd000640 1 -- 172.21.15.121:0/1885410868 >> 172.21.15.121:0/1885410868 conn(0x7fc0f80b1b90 msgr2=0x7fc0f80740c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.176+0000 7fc0fd000640 1 -- 172.21.15.121:0/1885410868 shutdown_connections 2024-09-17T03:36:27.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.176+0000 7fc0fd000640 1 -- 172.21.15.121:0/1885410868 wait complete. 2024-09-17T03:36:27.197 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:36:27.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:27.197 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T03:36:27.266 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:36:27.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:27.266 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:36:27.321 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:27.321 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:27.356 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:27.357 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:27.432 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:27.432 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:27.508 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:36:27.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.771+0000 7f543f400640 1 -- 172.21.15.121:0/1349340452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f541c005150 msgr2=0x7f541c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.771+0000 7f543f400640 1 --2- 172.21.15.121:0/1349340452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f541c005150 0x7f541c00b9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f543000c760 tx=0x7f541c005830 comp rx=0 tx=0).stop 2024-09-17T03:36:27.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.771+0000 7f543d400640 1 -- 172.21.15.121:0/1349340452 reap_dead start 2024-09-17T03:36:27.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.772+0000 7f543f400640 1 -- 172.21.15.121:0/1349340452 shutdown_connections 2024-09-17T03:36:27.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.772+0000 7f543f400640 1 -- 172.21.15.121:0/1349340452 >> 172.21.15.121:0/1349340452 conn(0x7f54380b1b90 msgr2=0x7f54380b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.772+0000 7f543f400640 1 -- 172.21.15.121:0/1349340452 shutdown_connections 2024-09-17T03:36:27.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.772+0000 7f543f400640 1 -- 172.21.15.121:0/1349340452 wait complete. 2024-09-17T03:36:27.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.774+0000 7f543f400640 1 Processor -- start 2024-09-17T03:36:27.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.774+0000 7f543f400640 1 -- start start 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f543f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f541c005150 0x7f54381f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f543f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54380c2010 0x7f54381f0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f543f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381f6890 0x7f54381f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f543f400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5438074620 con 0x7f54380c2010 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f543f400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5438161090 con 0x7f54381f6890 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f543f400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f54380747a0 con 0x7f541c005150 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f542fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54380c2010 0x7f54381f0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f542fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54380c2010 0x7f54381f0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48328/0 (socket says 172.21.15.121:48328) 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f542fe00640 1 -- 172.21.15.121:0/1015848077 learned_addr learned my addr 172.21.15.121:0/1015848077 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f543ca00640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f541c005150 0x7f54381f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f543d400640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381f6890 0x7f54381f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f542fe00640 1 -- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f541c005150 msgr2=0x7f54381f7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f542fe00640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f541c005150 0x7f54381f7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f542fe00640 1 -- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381f6890 msgr2=0x7f54381f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f542fe00640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381f6890 0x7f54381f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f542fe00640 1 -- 172.21.15.121:0/1015848077 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54380b5be0 con 0x7f54380c2010 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.776+0000 7f543d400640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381f6890 0x7f54381f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.777+0000 7f542fe00640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54380c2010 0x7f54381f0750 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5420011b10 tx=0x7f5420009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.777+0000 7f5435600640 1 -- 172.21.15.121:0/1015848077 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542000fc80 con 0x7f54380c2010 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.777+0000 7f5435600640 1 -- 172.21.15.121:0/1015848077 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f542000fe20 con 0x7f54380c2010 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.777+0000 7f5435600640 1 -- 172.21.15.121:0/1015848077 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5420004280 con 0x7f54380c2010 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.777+0000 7f543f400640 1 -- 172.21.15.121:0/1015848077 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54381f71e0 con 0x7f54380c2010 2024-09-17T03:36:27.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.777+0000 7f543f400640 1 -- 172.21.15.121:0/1015848077 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54380c4690 con 0x7f54380c2010 2024-09-17T03:36:27.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.778+0000 7f543f400640 1 -- 172.21.15.121:0/1015848077 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f543806ddf0 con 0x7f54380c2010 2024-09-17T03:36:27.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.779+0000 7f5435600640 1 -- 172.21.15.121:0/1015848077 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f54200035f0 con 0x7f54380c2010 2024-09-17T03:36:27.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.781+0000 7f5435600640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5414078b90 0x7f541407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.781+0000 7f5435600640 1 -- 172.21.15.121:0/1015848077 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f542009bbe0 con 0x7f54380c2010 2024-09-17T03:36:27.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.781+0000 7f543ca00640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5414078b90 0x7f541407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.782+0000 7f543ca00640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5414078b90 0x7f541407b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54380b2c70 tx=0x7f5428005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:27.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.785+0000 7f5435600640 1 -- 172.21.15.121:0/1015848077 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f54381f71e0 con 0x7f54380c2010 2024-09-17T03:36:27.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.980+0000 7f543f400640 1 -- 172.21.15.121:0/1015848077 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f54380c6a00 con 0x7f54380c2010 2024-09-17T03:36:27.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.981+0000 7f5435600640 1 -- 172.21.15.121:0/1015848077 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f5420063660 con 0x7f54380c2010 2024-09-17T03:36:27.980 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:36:27.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 -- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5414078b90 msgr2=0x7f541407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5414078b90 0x7f541407b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54380b2c70 tx=0x7f5428005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:27.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 -- 172.21.15.121:0/1015848077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54380c2010 msgr2=0x7f54381f0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54380c2010 0x7f54381f0750 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5420011b10 tx=0x7f5420009f10 comp rx=0 tx=0).stop 2024-09-17T03:36:27.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 -- 172.21.15.121:0/1015848077 shutdown_connections 2024-09-17T03:36:27.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54381f6890 0x7f54381f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5414078b90 0x7f541407b0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54380c2010 0x7f54381f0750 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 --2- 172.21.15.121:0/1015848077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f541c005150 0x7f54381f7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 -- 172.21.15.121:0/1015848077 >> 172.21.15.121:0/1015848077 conn(0x7f54380b1b90 msgr2=0x7f54380afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 -- 172.21.15.121:0/1015848077 shutdown_connections 2024-09-17T03:36:27.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:27.983+0000 7f543f400640 1 -- 172.21.15.121:0/1015848077 wait complete. 2024-09-17T03:36:28.005 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T03:36:28.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.005 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T03:36:28.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:36:28.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.065 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T03:36:28.101 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:36:28.101 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:28.141 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:36:28.141 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:28.218 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:36:28.219 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:28.296 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:36:28.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.521+0000 7f3949200640 1 -- 172.21.15.121:0/3841778613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3944072d90 msgr2=0x7f39440731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:28.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.521+0000 7f3949200640 1 --2- 172.21.15.121:0/3841778613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3944072d90 0x7f39440731a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f394415cda0 tx=0x7f393c02ab40 comp rx=0 tx=0).stop 2024-09-17T03:36:28.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.521+0000 7f3949200640 1 -- 172.21.15.121:0/3841778613 shutdown_connections 2024-09-17T03:36:28.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.521+0000 7f3949200640 1 --2- 172.21.15.121:0/3841778613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3944072d90 0x7f39440731a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.521+0000 7f3949200640 1 -- 172.21.15.121:0/3841778613 >> 172.21.15.121:0/3841778613 conn(0x7f39440b1b90 msgr2=0x7f39440b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:28.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.521+0000 7f3949200640 1 -- 172.21.15.121:0/3841778613 shutdown_connections 2024-09-17T03:36:28.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.521+0000 7f3949200640 1 -- 172.21.15.121:0/3841778613 wait complete. 2024-09-17T03:36:28.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.523+0000 7f3949200640 1 Processor -- start 2024-09-17T03:36:28.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.523+0000 7f3949200640 1 -- start start 2024-09-17T03:36:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3949200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f394406ddf0 0x7f39441571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3949200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3944072d90 0x7f39440a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3949200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3944156a50 0x7f39440beef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3949200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3944073860 con 0x7f3944156a50 2024-09-17T03:36:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3949200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39440736e0 con 0x7f394406ddf0 2024-09-17T03:36:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3949200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39440739e0 con 0x7f3944072d90 2024-09-17T03:36:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3942800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3944156a50 0x7f39440beef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3942800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3944156a50 0x7f39440beef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48344/0 (socket says 172.21.15.121:48344) 2024-09-17T03:36:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3942800640 1 -- 172.21.15.121:0/2261834770 learned_addr learned my addr 172.21.15.121:0/2261834770 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3941e00640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f394406ddf0 0x7f39441571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.525+0000 7f3939400640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3944072d90 0x7f39440a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f3942800640 1 -- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3944072d90 msgr2=0x7f39440a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f3942800640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3944072d90 0x7f39440a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f3942800640 1 -- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f394406ddf0 msgr2=0x7f39441571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f3942800640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f394406ddf0 0x7f39441571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f3942800640 1 -- 172.21.15.121:0/2261834770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3944157f10 con 0x7f3944156a50 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f3942800640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3944156a50 0x7f39440beef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f393c009d60 tx=0x7f393c02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f393aa00640 1 -- 172.21.15.121:0/2261834770 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c044070 con 0x7f3944156a50 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f393aa00640 1 -- 172.21.15.121:0/2261834770 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f393c004250 con 0x7f3944156a50 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f3949200640 1 -- 172.21.15.121:0/2261834770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39441581f0 con 0x7f3944156a50 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f393aa00640 1 -- 172.21.15.121:0/2261834770 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c004660 con 0x7f3944156a50 2024-09-17T03:36:28.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.526+0000 7f3949200640 1 -- 172.21.15.121:0/2261834770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39440a0070 con 0x7f3944156a50 2024-09-17T03:36:28.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.527+0000 7f3949200640 1 -- 172.21.15.121:0/2261834770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3944157c80 con 0x7f3944156a50 2024-09-17T03:36:28.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.528+0000 7f393aa00640 1 -- 172.21.15.121:0/2261834770 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f393c036400 con 0x7f3944156a50 2024-09-17T03:36:28.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.530+0000 7f393aa00640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3920078bc0 0x7f392007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:28.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.530+0000 7f393aa00640 1 -- 172.21.15.121:0/2261834770 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f393c0bbab0 con 0x7f3944156a50 2024-09-17T03:36:28.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.530+0000 7f3941e00640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3920078bc0 0x7f392007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:28.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.531+0000 7f3941e00640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3920078bc0 0x7f392007b0d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3934000f60 tx=0x7f3934009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:28.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.534+0000 7f393aa00640 1 -- 172.21.15.121:0/2261834770 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f393c032030 con 0x7f3944156a50 2024-09-17T03:36:28.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.732+0000 7f3949200640 1 -- 172.21.15.121:0/2261834770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f39440731a0 con 0x7f3944156a50 2024-09-17T03:36:28.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.733+0000 7f393aa00640 1 -- 172.21.15.121:0/2261834770 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f393c083ae0 con 0x7f3944156a50 2024-09-17T03:36:28.733 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:36:28.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.735+0000 7f3949200640 1 -- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3920078bc0 msgr2=0x7f392007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.735+0000 7f3949200640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3920078bc0 0x7f392007b0d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3934000f60 tx=0x7f3934009040 comp rx=0 tx=0).stop 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.735+0000 7f3949200640 1 -- 172.21.15.121:0/2261834770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3944156a50 msgr2=0x7f39440beef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.735+0000 7f3949200640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3944156a50 0x7f39440beef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f393c009d60 tx=0x7f393c02c8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.736+0000 7f3949200640 1 -- 172.21.15.121:0/2261834770 shutdown_connections 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.736+0000 7f3949200640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3920078bc0 0x7f392007b0d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.736+0000 7f3949200640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3944156a50 0x7f39440beef0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.736+0000 7f3949200640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3944072d90 0x7f39440a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.736+0000 7f3949200640 1 --2- 172.21.15.121:0/2261834770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f394406ddf0 0x7f39441571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.736+0000 7f3949200640 1 -- 172.21.15.121:0/2261834770 >> 172.21.15.121:0/2261834770 conn(0x7f39440b1b90 msgr2=0x7f39440ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.736+0000 7f3949200640 1 -- 172.21.15.121:0/2261834770 shutdown_connections 2024-09-17T03:36:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:28.736+0000 7f3949200640 1 -- 172.21.15.121:0/2261834770 wait complete. 2024-09-17T03:36:28.757 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T03:36:28.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.758 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T03:36:28.819 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:36:28.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.820 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T03:36:28.856 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:36:28.857 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:29.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.078+0000 7fc0eb000640 1 -- 172.21.15.121:0/3316705602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0e40ce860 msgr2=0x7fc0e415f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.078+0000 7fc0eb000640 1 --2- 172.21.15.121:0/3316705602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0e40ce860 0x7fc0e415f5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc005fd0 tx=0x7fc0dc02a840 comp rx=0 tx=0).stop 2024-09-17T03:36:29.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.078+0000 7fc0eb000640 1 -- 172.21.15.121:0/3316705602 shutdown_connections 2024-09-17T03:36:29.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.078+0000 7fc0eb000640 1 --2- 172.21.15.121:0/3316705602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0e40ce860 0x7fc0e415f5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.078+0000 7fc0eb000640 1 --2- 172.21.15.121:0/3316705602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0e40cf930 0x7fc0e40ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.078+0000 7fc0eb000640 1 -- 172.21.15.121:0/3316705602 >> 172.21.15.121:0/3316705602 conn(0x7fc0e40cca40 msgr2=0x7fc0e40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:29.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.078+0000 7fc0eb000640 1 -- 172.21.15.121:0/3316705602 shutdown_connections 2024-09-17T03:36:29.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.078+0000 7fc0eb000640 1 -- 172.21.15.121:0/3316705602 wait complete. 2024-09-17T03:36:29.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.081+0000 7fc0eb000640 1 Processor -- start 2024-09-17T03:36:29.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.081+0000 7fc0eb000640 1 -- start start 2024-09-17T03:36:29.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.082+0000 7fc0eb000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0e40ce860 0x7fc0e40c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.082+0000 7fc0eb000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0e40cf930 0x7fc0e41f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.082+0000 7fc0eb000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0e415b9f0 0x7fc0e41f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.082+0000 7fc0eb000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e406df70 con 0x7fc0e40cf930 2024-09-17T03:36:29.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.082+0000 7fc0eb000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e406ddf0 con 0x7fc0e415b9f0 2024-09-17T03:36:29.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.082+0000 7fc0eb000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e406e0f0 con 0x7fc0e40ce860 2024-09-17T03:36:29.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.082+0000 7fc0db400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0e40cf930 0x7fc0e41f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.083+0000 7fc0db400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0e40cf930 0x7fc0e41f6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48360/0 (socket says 172.21.15.121:48360) 2024-09-17T03:36:29.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.083+0000 7fc0db400640 1 -- 172.21.15.121:0/1580643296 learned_addr learned my addr 172.21.15.121:0/1580643296 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.083+0000 7fc0e9000640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0e415b9f0 0x7fc0e41f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.083+0000 7fc0e3e00640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0e40ce860 0x7fc0e40c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.083+0000 7fc0db400640 1 -- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0e40ce860 msgr2=0x7fc0e40c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.083+0000 7fc0db400640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0e40ce860 0x7fc0e40c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.083+0000 7fc0db400640 1 -- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0e415b9f0 msgr2=0x7fc0e41f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.083+0000 7fc0db400640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0e415b9f0 0x7fc0e41f6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.083+0000 7fc0db400640 1 -- 172.21.15.121:0/1580643296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e41f7580 con 0x7fc0e40cf930 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.083+0000 7fc0db400640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0e40cf930 0x7fc0e41f6770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc00e7c0 tx=0x7fc0cc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.084+0000 7fc0e0c00640 1 -- 172.21.15.121:0/1580643296 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00ccc0 con 0x7fc0e40cf930 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.084+0000 7fc0e0c00640 1 -- 172.21.15.121:0/1580643296 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0cc00ee70 con 0x7fc0e40cf930 2024-09-17T03:36:29.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.084+0000 7fc0eb000640 1 -- 172.21.15.121:0/1580643296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e409ebf0 con 0x7fc0e40cf930 2024-09-17T03:36:29.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.084+0000 7fc0e0c00640 1 -- 172.21.15.121:0/1580643296 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc010690 con 0x7fc0e40cf930 2024-09-17T03:36:29.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.084+0000 7fc0eb000640 1 -- 172.21.15.121:0/1580643296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e40c8e00 con 0x7fc0e40cf930 2024-09-17T03:36:29.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.085+0000 7fc0eb000640 1 -- 172.21.15.121:0/1580643296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e406e630 con 0x7fc0e40cf930 2024-09-17T03:36:29.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.086+0000 7fc0e0c00640 1 -- 172.21.15.121:0/1580643296 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0cc010830 con 0x7fc0e40cf930 2024-09-17T03:36:29.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.087+0000 7fc0e0c00640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0c0078b90 0x7fc0c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.087+0000 7fc0e0c00640 1 -- 172.21.15.121:0/1580643296 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fc0cc09ba30 con 0x7fc0e40cf930 2024-09-17T03:36:29.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.087+0000 7fc0e3e00640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0c0078b90 0x7fc0c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.088+0000 7fc0e3e00640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0c0078b90 0x7fc0c007b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4001eb0 tx=0x7fc0d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:29.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.092+0000 7fc0e0c00640 1 -- 172.21.15.121:0/1580643296 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0cc063490 con 0x7fc0e40cf930 2024-09-17T03:36:29.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.310+0000 7fc0eb000640 1 -- 172.21.15.121:0/1580643296 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0e4074370 con 0x7fc0e40cf930 2024-09-17T03:36:29.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.310+0000 7fc0e0c00640 1 -- 172.21.15.121:0/1580643296 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5219 (secure 0 0 0) 0x7fc0cc067ec0 con 0x7fc0e40cf930 2024-09-17T03:36:29.310 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:29.310 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":9,"btime":"2024-09-17T03:35:55:484285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:31.874114+0000","modified":"2024-09-17T03:35:54.974076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4408":{"gid":4408,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4408,"qdb_cluster":[4408]},"id":1}]} 2024-09-17T03:36:29.311 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 9 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 -- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0c0078b90 msgr2=0x7fc0c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0c0078b90 0x7fc0c007b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4001eb0 tx=0x7fc0d4009040 comp rx=0 tx=0).stop 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 -- 172.21.15.121:0/1580643296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0e40cf930 msgr2=0x7fc0e41f6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0e40cf930 0x7fc0e41f6770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc00e7c0 tx=0x7fc0cc00ec80 comp rx=0 tx=0).stop 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 -- 172.21.15.121:0/1580643296 shutdown_connections 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0e415b9f0 0x7fc0e41f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0c0078b90 0x7fc0c007b0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0e40cf930 0x7fc0e41f6770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 --2- 172.21.15.121:0/1580643296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0e40ce860 0x7fc0e40c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 -- 172.21.15.121:0/1580643296 >> 172.21.15.121:0/1580643296 conn(0x7fc0e40cca40 msgr2=0x7fc0e406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:29.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 -- 172.21.15.121:0/1580643296 shutdown_connections 2024-09-17T03:36:29.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.313+0000 7fc0eb000640 1 -- 172.21.15.121:0/1580643296 wait complete. 2024-09-17T03:36:29.335 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:29.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.555+0000 7fd12b000640 1 -- 172.21.15.121:0/1602254419 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd12406e500 msgr2=0x7fd1240cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.555+0000 7fd12b000640 1 --2- 172.21.15.121:0/1602254419 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd12406e500 0x7fd1240cc020 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd11c005fd0 tx=0x7fd11c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.556+0000 7fd12b000640 1 -- 172.21.15.121:0/1602254419 shutdown_connections 2024-09-17T03:36:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.556+0000 7fd12b000640 1 --2- 172.21.15.121:0/1602254419 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd12406e500 0x7fd1240cc020 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.556+0000 7fd12b000640 1 --2- 172.21.15.121:0/1602254419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd124074cb0 0x7fd124073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.556+0000 7fd12b000640 1 -- 172.21.15.121:0/1602254419 >> 172.21.15.121:0/1602254419 conn(0x7fd1240cca40 msgr2=0x7fd1240cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.556+0000 7fd12b000640 1 -- 172.21.15.121:0/1602254419 shutdown_connections 2024-09-17T03:36:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.556+0000 7fd12b000640 1 -- 172.21.15.121:0/1602254419 wait complete. 2024-09-17T03:36:29.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.558+0000 7fd12b000640 1 Processor -- start 2024-09-17T03:36:29.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.558+0000 7fd12b000640 1 -- start start 2024-09-17T03:36:29.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.559+0000 7fd12b000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd124074cb0 0x7fd1240b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.559+0000 7fd12b000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1240cbc10 0x7fd124155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.559+0000 7fd12b000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1240b0c00 0x7fd124155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.559+0000 7fd12b000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd12406f360 con 0x7fd124074cb0 2024-09-17T03:36:29.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.559+0000 7fd12b000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd12406f1e0 con 0x7fd1240cbc10 2024-09-17T03:36:29.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.559+0000 7fd12b000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd12406f4e0 con 0x7fd1240b0c00 2024-09-17T03:36:29.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.560+0000 7fd123e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd124074cb0 0x7fd1240b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.560+0000 7fd123e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd124074cb0 0x7fd1240b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48362/0 (socket says 172.21.15.121:48362) 2024-09-17T03:36:29.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.560+0000 7fd123e00640 1 -- 172.21.15.121:0/2566784619 learned_addr learned my addr 172.21.15.121:0/2566784619 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:29.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.560+0000 7fd123400640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1240cbc10 0x7fd124155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.560+0000 7fd129000640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1240b0c00 0x7fd124155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.560+0000 7fd123e00640 1 -- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1240b0c00 msgr2=0x7fd124155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.560+0000 7fd123e00640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1240b0c00 0x7fd124155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.560+0000 7fd123e00640 1 -- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1240cbc10 msgr2=0x7fd124155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.560+0000 7fd123e00640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1240cbc10 0x7fd124155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.560+0000 7fd123e00640 1 -- 172.21.15.121:0/2566784619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1240b3fe0 con 0x7fd124074cb0 2024-09-17T03:36:29.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.561+0000 7fd123e00640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd124074cb0 0x7fd1240b4aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd11400e9f0 tx=0x7fd11400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:29.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.561+0000 7fd11be00640 1 -- 172.21.15.121:0/2566784619 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11400cd80 con 0x7fd124074cb0 2024-09-17T03:36:29.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.561+0000 7fd11be00640 1 -- 172.21.15.121:0/2566784619 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd114010430 con 0x7fd124074cb0 2024-09-17T03:36:29.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.561+0000 7fd11be00640 1 -- 172.21.15.121:0/2566784619 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114010860 con 0x7fd124074cb0 2024-09-17T03:36:29.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.561+0000 7fd12b000640 1 -- 172.21.15.121:0/2566784619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1240b1230 con 0x7fd124074cb0 2024-09-17T03:36:29.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.561+0000 7fd12b000640 1 -- 172.21.15.121:0/2566784619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1240b4580 con 0x7fd124074cb0 2024-09-17T03:36:29.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.562+0000 7fd12b000640 1 -- 172.21.15.121:0/2566784619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12406fa00 con 0x7fd124074cb0 2024-09-17T03:36:29.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.564+0000 7fd11be00640 1 -- 172.21.15.121:0/2566784619 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd114009400 con 0x7fd124074cb0 2024-09-17T03:36:29.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.565+0000 7fd11be00640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd104078b90 0x7fd10407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.565+0000 7fd11be00640 1 -- 172.21.15.121:0/2566784619 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fd11409b9b0 con 0x7fd124074cb0 2024-09-17T03:36:29.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.565+0000 7fd123400640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd104078b90 0x7fd10407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.566+0000 7fd123400640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd104078b90 0x7fd10407b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd12415c0d0 tx=0x7fd110009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:29.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.570+0000 7fd11be00640 1 -- 172.21.15.121:0/2566784619 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd114063550 con 0x7fd124074cb0 2024-09-17T03:36:29.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.788+0000 7fd12b000640 1 -- 172.21.15.121:0/2566784619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd12409b0c0 con 0x7fd124074cb0 2024-09-17T03:36:29.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.789+0000 7fd11be00640 1 -- 172.21.15.121:0/2566784619 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5219 (secure 0 0 0) 0x7fd114067f80 con 0x7fd124074cb0 2024-09-17T03:36:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:29.789 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":9,"btime":"2024-09-17T03:35:55:484285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:31.874114+0000","modified":"2024-09-17T03:35:54.974076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4408":{"gid":4408,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4408,"qdb_cluster":[4408]},"id":1}]} 2024-09-17T03:36:29.789 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 9 2024-09-17T03:36:29.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 -- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd104078b90 msgr2=0x7fd10407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd104078b90 0x7fd10407b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd12415c0d0 tx=0x7fd110009040 comp rx=0 tx=0).stop 2024-09-17T03:36:29.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 -- 172.21.15.121:0/2566784619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd124074cb0 msgr2=0x7fd1240b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd124074cb0 0x7fd1240b4aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd11400e9f0 tx=0x7fd11400edf0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 -- 172.21.15.121:0/2566784619 shutdown_connections 2024-09-17T03:36:29.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1240b0c00 0x7fd124155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1240cbc10 0x7fd124155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd104078b90 0x7fd10407b0a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 --2- 172.21.15.121:0/2566784619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd124074cb0 0x7fd1240b4aa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 -- 172.21.15.121:0/2566784619 >> 172.21.15.121:0/2566784619 conn(0x7fd1240cca40 msgr2=0x7fd1241e4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:29.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 -- 172.21.15.121:0/2566784619 shutdown_connections 2024-09-17T03:36:29.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:29.791+0000 7fd12b000640 1 -- 172.21.15.121:0/2566784619 wait complete. 2024-09-17T03:36:29.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:30.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.034+0000 7f79edc00640 1 -- 172.21.15.121:0/3196933049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79cc004800 msgr2=0x7f79cc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.034+0000 7f79edc00640 1 --2- 172.21.15.121:0/3196933049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79cc004800 0x7f79cc004c10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79e80cd8c0 tx=0x7f79cc005830 comp rx=0 tx=0).stop 2024-09-17T03:36:30.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.034+0000 7f79edc00640 1 -- 172.21.15.121:0/3196933049 shutdown_connections 2024-09-17T03:36:30.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.034+0000 7f79edc00640 1 --2- 172.21.15.121:0/3196933049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79cc004800 0x7f79cc004c10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.034+0000 7f79edc00640 1 -- 172.21.15.121:0/3196933049 >> 172.21.15.121:0/3196933049 conn(0x7f79e80cca40 msgr2=0x7f79e80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:30.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.034+0000 7f79edc00640 1 -- 172.21.15.121:0/3196933049 shutdown_connections 2024-09-17T03:36:30.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.034+0000 7f79edc00640 1 -- 172.21.15.121:0/3196933049 wait complete. 2024-09-17T03:36:30.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.036+0000 7f79edc00640 1 Processor -- start 2024-09-17T03:36:30.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.036+0000 7f79edc00640 1 -- start start 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79edc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79cc004800 0x7f79e8153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79edc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79e815ef00 0x7f79e809cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79edc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79e80a0b60 0x7f79e809d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79edc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f79e806e180 con 0x7f79cc004800 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79edc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f79e806e000 con 0x7f79e815ef00 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79edc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f79e80cbc10 con 0x7f79e80a0b60 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79e6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79cc004800 0x7f79e8153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79e6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79cc004800 0x7f79e8153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48376/0 (socket says 172.21.15.121:48376) 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79e6a00640 1 -- 172.21.15.121:0/2703207280 learned_addr learned my addr 172.21.15.121:0/2703207280 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79e6a00640 1 -- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79e80a0b60 msgr2=0x7f79e809d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79e6a00640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79e80a0b60 0x7f79e809d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79e6a00640 1 -- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79e815ef00 msgr2=0x7f79e809cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79e6a00640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79e815ef00 0x7f79e809cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.038+0000 7f79e6a00640 1 -- 172.21.15.121:0/2703207280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e8157d90 con 0x7f79cc004800 2024-09-17T03:36:30.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.039+0000 7f79e6a00640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79cc004800 0x7f79e8153f20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f79d8006680 tx=0x7f79d80066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:30.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.039+0000 7f79df400640 1 -- 172.21.15.121:0/2703207280 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8015070 con 0x7f79cc004800 2024-09-17T03:36:30.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.039+0000 7f79df400640 1 -- 172.21.15.121:0/2703207280 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79d8011900 con 0x7f79cc004800 2024-09-17T03:36:30.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.039+0000 7f79edc00640 1 -- 172.21.15.121:0/2703207280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e8155b20 con 0x7f79cc004800 2024-09-17T03:36:30.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.039+0000 7f79df400640 1 -- 172.21.15.121:0/2703207280 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8011d50 con 0x7f79cc004800 2024-09-17T03:36:30.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.039+0000 7f79edc00640 1 -- 172.21.15.121:0/2703207280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e81560e0 con 0x7f79cc004800 2024-09-17T03:36:30.040 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.040+0000 7f79edc00640 1 -- 172.21.15.121:0/2703207280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e809dc10 con 0x7f79cc004800 2024-09-17T03:36:30.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.041+0000 7f79df400640 1 -- 172.21.15.121:0/2703207280 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79d8018070 con 0x7f79cc004800 2024-09-17T03:36:30.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.042+0000 7f79df400640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f79c4078b90 0x7f79c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.042+0000 7f79df400640 1 -- 172.21.15.121:0/2703207280 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f79d809be20 con 0x7f79cc004800 2024-09-17T03:36:30.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.043+0000 7f79de000640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f79c4078b90 0x7f79c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.044+0000 7f79de000640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f79c4078b90 0x7f79c407b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f79d0035000 tx=0x7f79d0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:30.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.047+0000 7f79df400640 1 -- 172.21.15.121:0/2703207280 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f79e809dc10 con 0x7f79cc004800 2024-09-17T03:36:30.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.232+0000 7f79edc00640 1 -- 172.21.15.121:0/2703207280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79e8070a50 con 0x7f79cc004800 2024-09-17T03:36:30.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.233+0000 7f79df400640 1 -- 172.21.15.121:0/2703207280 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18756 (secure 0 0 0) 0x7f79e8070a50 con 0x7f79cc004800 2024-09-17T03:36:30.233 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:30.233 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:36:10.573094+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:30.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.235+0000 7f79edc00640 1 -- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f79c4078b90 msgr2=0x7f79c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.235+0000 7f79edc00640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f79c4078b90 0x7f79c407b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f79d0035000 tx=0x7f79d0004730 comp rx=0 tx=0).stop 2024-09-17T03:36:30.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.235+0000 7f79edc00640 1 -- 172.21.15.121:0/2703207280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79cc004800 msgr2=0x7f79e8153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.235+0000 7f79edc00640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79cc004800 0x7f79e8153f20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f79d8006680 tx=0x7f79d80066b0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.236+0000 7f79edc00640 1 -- 172.21.15.121:0/2703207280 shutdown_connections 2024-09-17T03:36:30.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.236+0000 7f79edc00640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79e80a0b60 0x7f79e809d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.236+0000 7f79edc00640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79e815ef00 0x7f79e809cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.236+0000 7f79edc00640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f79c4078b90 0x7f79c407b0a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.236+0000 7f79edc00640 1 --2- 172.21.15.121:0/2703207280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79cc004800 0x7f79e8153f20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.236+0000 7f79edc00640 1 -- 172.21.15.121:0/2703207280 >> 172.21.15.121:0/2703207280 conn(0x7f79e80cca40 msgr2=0x7f79e806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:30.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.236+0000 7f79edc00640 1 -- 172.21.15.121:0/2703207280 shutdown_connections 2024-09-17T03:36:30.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.236+0000 7f79edc00640 1 -- 172.21.15.121:0/2703207280 wait complete. 2024-09-17T03:36:30.257 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:36:30.258 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:30.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.479+0000 7f3115200640 1 -- 172.21.15.121:0/408655961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f4003a30 msgr2=0x7f30f4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.479+0000 7f3115200640 1 --2- 172.21.15.121:0/408655961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f4003a30 0x7f30f4003ea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3100009b20 tx=0x7f30f4005830 comp rx=0 tx=0).stop 2024-09-17T03:36:30.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.479+0000 7f310e800640 1 -- 172.21.15.121:0/408655961 reap_dead start 2024-09-17T03:36:30.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.479+0000 7f3115200640 1 -- 172.21.15.121:0/408655961 shutdown_connections 2024-09-17T03:36:30.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.479+0000 7f3115200640 1 -- 172.21.15.121:0/408655961 >> 172.21.15.121:0/408655961 conn(0x7f31100cca40 msgr2=0x7f31100cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:30.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.479+0000 7f3115200640 1 -- 172.21.15.121:0/408655961 shutdown_connections 2024-09-17T03:36:30.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.479+0000 7f3115200640 1 -- 172.21.15.121:0/408655961 wait complete. 2024-09-17T03:36:30.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.481+0000 7f3115200640 1 Processor -- start 2024-09-17T03:36:30.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.482+0000 7f3115200640 1 -- start start 2024-09-17T03:36:30.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.483+0000 7f3115200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f4003a30 0x7f3110157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.483+0000 7f3115200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f311009fe60 0x7f3110070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.483+0000 7f3115200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31100a0270 0x7f31100705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.483+0000 7f3115200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f31100cc1a0 con 0x7f31100a0270 2024-09-17T03:36:30.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.483+0000 7f3115200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31100cc020 con 0x7f311009fe60 2024-09-17T03:36:30.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.483+0000 7f3115200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31100cc320 con 0x7f30f4003a30 2024-09-17T03:36:30.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.483+0000 7f310e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31100a0270 0x7f31100705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.483+0000 7f310e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31100a0270 0x7f31100705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48394/0 (socket says 172.21.15.121:48394) 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.483+0000 7f310e800640 1 -- 172.21.15.121:0/3269055760 learned_addr learned my addr 172.21.15.121:0/3269055760 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.483+0000 7f310de00640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f4003a30 0x7f3110157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f3105400640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f311009fe60 0x7f3110070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f310e800640 1 -- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f4003a30 msgr2=0x7f3110157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f310e800640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f4003a30 0x7f3110157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f310e800640 1 -- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f311009fe60 msgr2=0x7f3110070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f310e800640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f311009fe60 0x7f3110070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f310e800640 1 -- 172.21.15.121:0/3269055760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31101f2fb0 con 0x7f31100a0270 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f310e800640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31100a0270 0x7f31100705d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3110072b90 tx=0x7f310800eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f3106a00640 1 -- 172.21.15.121:0/3269055760 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310800c970 con 0x7f31100a0270 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f3106a00640 1 -- 172.21.15.121:0/3269055760 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3108017070 con 0x7f31100a0270 2024-09-17T03:36:30.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f3115200640 1 -- 172.21.15.121:0/3269055760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31101f65d0 con 0x7f31100a0270 2024-09-17T03:36:30.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.484+0000 7f3106a00640 1 -- 172.21.15.121:0/3269055760 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310800cea0 con 0x7f31100a0270 2024-09-17T03:36:30.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.485+0000 7f3115200640 1 -- 172.21.15.121:0/3269055760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31101f6db0 con 0x7f31100a0270 2024-09-17T03:36:30.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.486+0000 7f3115200640 1 -- 172.21.15.121:0/3269055760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311006f790 con 0x7f31100a0270 2024-09-17T03:36:30.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.487+0000 7f3106a00640 1 -- 172.21.15.121:0/3269055760 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f310801c460 con 0x7f31100a0270 2024-09-17T03:36:30.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.488+0000 7f3106a00640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30ec078bc0 0x7f30ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.488+0000 7f3106a00640 1 -- 172.21.15.121:0/3269055760 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f310809b3a0 con 0x7f31100a0270 2024-09-17T03:36:30.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.488+0000 7f310de00640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30ec078bc0 0x7f30ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.489+0000 7f310de00640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30ec078bc0 0x7f30ec07b0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3100035000 tx=0x7f310002d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:30.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.492+0000 7f3106a00640 1 -- 172.21.15.121:0/3269055760 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3108062e10 con 0x7f31100a0270 2024-09-17T03:36:30.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.716+0000 7f3115200640 1 -- 172.21.15.121:0/3269055760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31101f6860 con 0x7f31100a0270 2024-09-17T03:36:30.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.717+0000 7f3106a00640 1 -- 172.21.15.121:0/3269055760 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5219 (secure 0 0 0) 0x7f3108067840 con 0x7f31100a0270 2024-09-17T03:36:30.716 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:30.717 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":9,"btime":"2024-09-17T03:35:55:484285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:31.874114+0000","modified":"2024-09-17T03:35:54.974076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4408":{"gid":4408,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4408,"qdb_cluster":[4408]},"id":1}]} 2024-09-17T03:36:30.717 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 9 2024-09-17T03:36:30.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 -- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30ec078bc0 msgr2=0x7f30ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30ec078bc0 0x7f30ec07b0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3100035000 tx=0x7f310002d040 comp rx=0 tx=0).stop 2024-09-17T03:36:30.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 -- 172.21.15.121:0/3269055760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31100a0270 msgr2=0x7f31100705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31100a0270 0x7f31100705d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3110072b90 tx=0x7f310800eae0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 -- 172.21.15.121:0/3269055760 shutdown_connections 2024-09-17T03:36:30.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30ec078bc0 0x7f30ec07b0d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31100a0270 0x7f31100705d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f311009fe60 0x7f3110070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 --2- 172.21.15.121:0/3269055760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f4003a30 0x7f3110157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 -- 172.21.15.121:0/3269055760 >> 172.21.15.121:0/3269055760 conn(0x7f31100cca40 msgr2=0x7f311006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:30.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 -- 172.21.15.121:0/3269055760 shutdown_connections 2024-09-17T03:36:30.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.719+0000 7f3115200640 1 -- 172.21.15.121:0/3269055760 wait complete. 2024-09-17T03:36:30.741 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.963+0000 7febbfa00640 1 -- 172.21.15.121:0/1692561559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febb8070030 msgr2=0x7febb806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.963+0000 7febbfa00640 1 --2- 172.21.15.121:0/1692561559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febb8070030 0x7febb806ddf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7feba0005fd0 tx=0x7feba002b910 comp rx=0 tx=0).stop 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.963+0000 7febbfa00640 1 -- 172.21.15.121:0/1692561559 shutdown_connections 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.963+0000 7febbfa00640 1 --2- 172.21.15.121:0/1692561559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febb8070030 0x7febb806ddf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.963+0000 7febbfa00640 1 -- 172.21.15.121:0/1692561559 >> 172.21.15.121:0/1692561559 conn(0x7febb80cca40 msgr2=0x7febb80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.963+0000 7febbfa00640 1 -- 172.21.15.121:0/1692561559 shutdown_connections 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.963+0000 7febbfa00640 1 -- 172.21.15.121:0/1692561559 wait complete. 2024-09-17T03:36:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.965+0000 7febbfa00640 1 Processor -- start 2024-09-17T03:36:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.965+0000 7febbfa00640 1 -- start start 2024-09-17T03:36:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbfa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febb806e330 0x7febb80af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbfa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb8070030 0x7febb809ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbfa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb8074d90 0x7febb809b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbfa00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7febb8071000 con 0x7febb806e330 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbfa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7febb8070e80 con 0x7febb8070030 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbfa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7febb80ce2a0 con 0x7febb8074d90 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbd000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febb806e330 0x7febb80af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbd000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febb806e330 0x7febb80af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48414/0 (socket says 172.21.15.121:48414) 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbd000640 1 -- 172.21.15.121:0/644789603 learned_addr learned my addr 172.21.15.121:0/644789603 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbd000640 1 -- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb8074d90 msgr2=0x7febb809b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbd000640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb8074d90 0x7febb809b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbd000640 1 -- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb8070030 msgr2=0x7febb809ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbd000640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb8070030 0x7febb809ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.967+0000 7febbd000640 1 -- 172.21.15.121:0/644789603 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb809e8f0 con 0x7febb806e330 2024-09-17T03:36:30.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.968+0000 7febbd000640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febb806e330 0x7febb80af0b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feba800b3f0 tx=0x7feba800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:30.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.968+0000 7febb5600640 1 -- 172.21.15.121:0/644789603 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8015020 con 0x7febb806e330 2024-09-17T03:36:30.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.968+0000 7febb5600640 1 -- 172.21.15.121:0/644789603 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feba8011920 con 0x7febb806e330 2024-09-17T03:36:30.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.968+0000 7febb5600640 1 -- 172.21.15.121:0/644789603 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8011d70 con 0x7febb806e330 2024-09-17T03:36:30.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.968+0000 7febbfa00640 1 -- 172.21.15.121:0/644789603 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb809ebd0 con 0x7febb806e330 2024-09-17T03:36:30.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.968+0000 7febbfa00640 1 -- 172.21.15.121:0/644789603 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb809f190 con 0x7febb806e330 2024-09-17T03:36:30.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.969+0000 7febbfa00640 1 -- 172.21.15.121:0/644789603 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb8074800 con 0x7febb806e330 2024-09-17T03:36:30.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.970+0000 7febb5600640 1 -- 172.21.15.121:0/644789603 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feba8018020 con 0x7febb806e330 2024-09-17T03:36:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.971+0000 7febb5600640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feb94078b90 0x7feb9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.971+0000 7febb5600640 1 -- 172.21.15.121:0/644789603 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7feba809ae10 con 0x7febb806e330 2024-09-17T03:36:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.972+0000 7febafe00640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feb94078b90 0x7feb9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.972+0000 7febafe00640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feb94078b90 0x7feb9407b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feba0035000 tx=0x7feba00046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:30.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:30.976+0000 7febb5600640 1 -- 172.21.15.121:0/644789603 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7febb8074800 con 0x7febb806e330 2024-09-17T03:36:31.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.193+0000 7febbfa00640 1 -- 172.21.15.121:0/644789603 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febb806ddf0 con 0x7febb806e330 2024-09-17T03:36:31.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.194+0000 7febb5600640 1 -- 172.21.15.121:0/644789603 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5219 (secure 0 0 0) 0x7feba809e030 con 0x7febb806e330 2024-09-17T03:36:31.194 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:31.194 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":9,"btime":"2024-09-17T03:35:55:484285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4100291866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4100291866},{"type":"v1","addr":"172.21.15.121:6833","nonce":4100291866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/91283630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":91283630},{"type":"v1","addr":"172.21.15.176:6836","nonce":91283630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3207479919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3207479919},{"type":"v1","addr":"172.21.15.121:6835","nonce":3207479919}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:31.874114+0000","modified":"2024-09-17T03:35:54.974076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4408},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4408":{"gid":4408,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/25219205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":25219205},{"type":"v1","addr":"172.21.15.176:6837","nonce":25219205}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4408,"qdb_cluster":[4408]},"id":1}]} 2024-09-17T03:36:31.194 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 9 2024-09-17T03:36:31.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.196+0000 7febbfa00640 1 -- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feb94078b90 msgr2=0x7feb9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.196+0000 7febbfa00640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feb94078b90 0x7feb9407b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feba0035000 tx=0x7feba00046c0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.196+0000 7febbfa00640 1 -- 172.21.15.121:0/644789603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febb806e330 msgr2=0x7febb80af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.196+0000 7febbfa00640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febb806e330 0x7febb80af0b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feba800b3f0 tx=0x7feba800b8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.196+0000 7febbfa00640 1 -- 172.21.15.121:0/644789603 shutdown_connections 2024-09-17T03:36:31.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.196+0000 7febbfa00640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febb8074d90 0x7febb809b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.196+0000 7febbfa00640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb8070030 0x7febb809ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.196+0000 7febbfa00640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feb94078b90 0x7feb9407b0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.196+0000 7febbfa00640 1 --2- 172.21.15.121:0/644789603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febb806e330 0x7febb80af0b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.196+0000 7febbfa00640 1 -- 172.21.15.121:0/644789603 >> 172.21.15.121:0/644789603 conn(0x7febb80cca40 msgr2=0x7febb80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.197+0000 7febbfa00640 1 -- 172.21.15.121:0/644789603 shutdown_connections 2024-09-17T03:36:31.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.197+0000 7febbfa00640 1 -- 172.21.15.121:0/644789603 wait complete. 2024-09-17T03:36:31.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.447+0000 7fcb72400640 1 -- 172.21.15.121:0/1189321980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb6c15dfe0 msgr2=0x7fcb6c160a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.447+0000 7fcb72400640 1 --2- 172.21.15.121:0/1189321980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb6c15dfe0 0x7fcb6c160a40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c153b50 tx=0x7fcb5c02a560 comp rx=0 tx=0).stop 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.447+0000 7fcb72400640 1 -- 172.21.15.121:0/1189321980 shutdown_connections 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.447+0000 7fcb72400640 1 --2- 172.21.15.121:0/1189321980 >> v2:172.21.15.176:3300/0 conn(0x7fcb6c06e160 0x7fcb6c06e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.447+0000 7fcb72400640 1 --2- 172.21.15.121:0/1189321980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb6c15dfe0 0x7fcb6c160a40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.447+0000 7fcb72400640 1 -- 172.21.15.121:0/1189321980 >> 172.21.15.121:0/1189321980 conn(0x7fcb6c06f940 msgr2=0x7fcb6c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.447+0000 7fcb72400640 1 -- 172.21.15.121:0/1189321980 shutdown_connections 2024-09-17T03:36:31.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.447+0000 7fcb72400640 1 -- 172.21.15.121:0/1189321980 wait complete. 2024-09-17T03:36:31.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.449+0000 7fcb72400640 1 Processor -- start 2024-09-17T03:36:31.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.450+0000 7fcb72400640 1 -- start start 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.451+0000 7fcb72400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb6c06e160 0x7fcb6c0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.451+0000 7fcb72400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb6c0cc8d0 0x7fcb6c1385f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.451+0000 7fcb72400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb6c15dfe0 0x7fcb6c135180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.451+0000 7fcb72400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c0b4b70 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.451+0000 7fcb72400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c0b49f0 con 0x7fcb6c06e160 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.451+0000 7fcb72400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c0b4cf0 con 0x7fcb6c0cc8d0 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.451+0000 7fcb71a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb6c15dfe0 0x7fcb6c135180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.452+0000 7fcb71a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb6c15dfe0 0x7fcb6c135180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48438/0 (socket says 172.21.15.121:48438) 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.452+0000 7fcb71a00640 1 -- 172.21.15.121:0/1293424276 learned_addr learned my addr 172.21.15.121:0/1293424276 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.452+0000 7fcb71000640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb6c06e160 0x7fcb6c0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.452+0000 7fcb63e00640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb6c0cc8d0 0x7fcb6c1385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.452+0000 7fcb71a00640 1 -- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb6c0cc8d0 msgr2=0x7fcb6c1385f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.452+0000 7fcb71a00640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb6c0cc8d0 0x7fcb6c1385f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.452+0000 7fcb71a00640 1 -- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb6c06e160 msgr2=0x7fcb6c0aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.452+0000 7fcb71a00640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb6c06e160 0x7fcb6c0aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.452+0000 7fcb71a00640 1 -- 172.21.15.121:0/1293424276 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c159490 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.452+0000 7fcb71a00640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb6c15dfe0 0x7fcb6c135180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c760 tx=0x7fcb6400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.453+0000 7fcb69600640 1 -- 172.21.15.121:0/1293424276 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64003b90 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.453+0000 7fcb69600640 1 -- 172.21.15.121:0/1293424276 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb64003d30 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.453+0000 7fcb69600640 1 -- 172.21.15.121:0/1293424276 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400aab0 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.453+0000 7fcb72400640 1 -- 172.21.15.121:0/1293424276 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c159770 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.453+0000 7fcb72400640 1 -- 172.21.15.121:0/1293424276 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c1380d0 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.454+0000 7fcb72400640 1 -- 172.21.15.121:0/1293424276 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c0b5210 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.455+0000 7fcb69600640 1 -- 172.21.15.121:0/1293424276 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb6400ac50 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.456+0000 7fcb69600640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb48078bc0 0x7fcb4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.456+0000 7fcb69600640 1 -- 172.21.15.121:0/1293424276 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fcb6409ad00 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.456+0000 7fcb71000640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb48078bc0 0x7fcb4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.457+0000 7fcb71000640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb48078bc0 0x7fcb4807b0d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c033000 tx=0x7fcb5c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.460+0000 7fcb69600640 1 -- 172.21.15.121:0/1293424276 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcb64062790 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.643+0000 7fcb72400640 1 -- 172.21.15.121:0/1293424276 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb6c0cc0e0 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.644+0000 7fcb69600640 1 -- 172.21.15.121:0/1293424276 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18756 (secure 0 0 0) 0x7fcb640671c0 con 0x7fcb6c15dfe0 2024-09-17T03:36:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:31.645 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:36:10.573094+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:30.001860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:30.829496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T03:35:34.413369+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 -- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb48078bc0 msgr2=0x7fcb4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb48078bc0 0x7fcb4807b0d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c033000 tx=0x7fcb5c004730 comp rx=0 tx=0).stop 2024-09-17T03:36:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 -- 172.21.15.121:0/1293424276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb6c15dfe0 msgr2=0x7fcb6c135180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb6c15dfe0 0x7fcb6c135180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c760 tx=0x7fcb6400cc20 comp rx=0 tx=0).stop 2024-09-17T03:36:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 -- 172.21.15.121:0/1293424276 shutdown_connections 2024-09-17T03:36:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb48078bc0 0x7fcb4807b0d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb6c15dfe0 0x7fcb6c135180 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb6c0cc8d0 0x7fcb6c1385f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 --2- 172.21.15.121:0/1293424276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb6c06e160 0x7fcb6c0aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 -- 172.21.15.121:0/1293424276 >> 172.21.15.121:0/1293424276 conn(0x7fcb6c06f940 msgr2=0x7fcb6c0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 -- 172.21.15.121:0/1293424276 shutdown_connections 2024-09-17T03:36:31.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.647+0000 7fcb72400640 1 -- 172.21.15.121:0/1293424276 wait complete. 2024-09-17T03:36:31.670 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:36:31.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.891+0000 7f6723c00640 1 -- 172.21.15.121:0/3503051650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6704005270 msgr2=0x7f670400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.891+0000 7f6723c00640 1 --2- 172.21.15.121:0/3503051650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6704005270 0x7f670400b9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6714005fd0 tx=0x7f6704005830 comp rx=0 tx=0).stop 2024-09-17T03:36:31.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.892+0000 7f6723c00640 1 -- 172.21.15.121:0/3503051650 shutdown_connections 2024-09-17T03:36:31.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.892+0000 7f6723c00640 1 --2- 172.21.15.121:0/3503051650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6704005270 0x7f670400b9c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.892+0000 7f6723c00640 1 -- 172.21.15.121:0/3503051650 >> 172.21.15.121:0/3503051650 conn(0x7f671c0b1b90 msgr2=0x7f671c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.892+0000 7f6723c00640 1 -- 172.21.15.121:0/3503051650 shutdown_connections 2024-09-17T03:36:31.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.892+0000 7f6723c00640 1 -- 172.21.15.121:0/3503051650 wait complete. 2024-09-17T03:36:31.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.894+0000 7f6723c00640 1 Processor -- start 2024-09-17T03:36:31.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.894+0000 7f6723c00640 1 -- start start 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f6723c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6704005270 0x7f671c0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f6723c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c0a0840 0x7f671c1f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f6723c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f671c1f8530 0x7f671c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f6723c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f671c06e590 con 0x7f671c0a0840 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f6723c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f671c06e410 con 0x7f671c1f8530 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f6723c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f671c06e710 con 0x7f6704005270 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f671be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c0a0840 0x7f671c1f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f671be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c0a0840 0x7f671c1f5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36422/0 (socket says 172.21.15.121:36422) 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f671be00640 1 -- 172.21.15.121:0/2379496817 learned_addr learned my addr 172.21.15.121:0/2379496817 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f6721200640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6704005270 0x7f671c0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f6721c00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f671c1f8530 0x7f671c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f671be00640 1 -- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6704005270 msgr2=0x7f671c0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f671be00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6704005270 0x7f671c0b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f671be00640 1 -- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f671c1f8530 msgr2=0x7f671c0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f671be00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f671c1f8530 0x7f671c0ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f671be00640 1 -- 172.21.15.121:0/2379496817 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671c0b5cd0 con 0x7f671c0a0840 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.896+0000 7f6721c00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f671c1f8530 0x7f671c0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.897+0000 7f671be00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c0a0840 0x7f671c1f5970 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6708006490 tx=0x7f67080039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.897+0000 7f6718c00640 1 -- 172.21.15.121:0/2379496817 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708015070 con 0x7f671c0a0840 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.897+0000 7f6718c00640 1 -- 172.21.15.121:0/2379496817 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6708011860 con 0x7f671c0a0840 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.897+0000 7f6723c00640 1 -- 172.21.15.121:0/2379496817 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671c1f5eb0 con 0x7f671c0a0840 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.897+0000 7f6718c00640 1 -- 172.21.15.121:0/2379496817 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708011cb0 con 0x7f671c0a0840 2024-09-17T03:36:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.897+0000 7f6723c00640 1 -- 172.21.15.121:0/2379496817 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f671c0cc4f0 con 0x7f671c0a0840 2024-09-17T03:36:31.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.898+0000 7f6723c00640 1 -- 172.21.15.121:0/2379496817 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f671c0cc6f0 con 0x7f671c0a0840 2024-09-17T03:36:31.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.899+0000 7f6718c00640 1 -- 172.21.15.121:0/2379496817 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6708018070 con 0x7f671c0a0840 2024-09-17T03:36:31.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.900+0000 7f6718c00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66fc078bc0 0x7f66fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.900+0000 7f6718c00640 1 -- 172.21.15.121:0/2379496817 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f670809bc10 con 0x7f671c0a0840 2024-09-17T03:36:31.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.901+0000 7f6721200640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66fc078bc0 0x7f66fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.902+0000 7f6721200640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66fc078bc0 0x7f66fc07b0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6710000c00 tx=0x7f6710006b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:31.905+0000 7f6718c00640 1 -- 172.21.15.121:0/2379496817 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f671c0cc6f0 con 0x7f671c0a0840 2024-09-17T03:36:32.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.124+0000 7f6723c00640 1 -- 172.21.15.121:0/2379496817 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f671c0cbfa0 con 0x7f671c0a0840 2024-09-17T03:36:32.124 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-17T03:36:32.125+0000 7f1def400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:36:32.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.128+0000 7f6718c00640 1 -- 172.21.15.121:0/2379496817 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f6708063cf0 con 0x7f671c0a0840 2024-09-17T03:36:32.128 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:36:32.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.131+0000 7f6723c00640 1 -- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66fc078bc0 msgr2=0x7f66fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.131+0000 7f6723c00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66fc078bc0 0x7f66fc07b0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6710000c00 tx=0x7f6710006b70 comp rx=0 tx=0).stop 2024-09-17T03:36:32.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.131+0000 7f6723c00640 1 -- 172.21.15.121:0/2379496817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c0a0840 msgr2=0x7f671c1f5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.132+0000 7f6723c00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c0a0840 0x7f671c1f5970 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6708006490 tx=0x7f67080039c0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.132+0000 7f6723c00640 1 -- 172.21.15.121:0/2379496817 shutdown_connections 2024-09-17T03:36:32.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.132+0000 7f6723c00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f671c1f8530 0x7f671c0ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.132+0000 7f6723c00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66fc078bc0 0x7f66fc07b0d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.132+0000 7f6723c00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f671c0a0840 0x7f671c1f5970 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.132+0000 7f6723c00640 1 --2- 172.21.15.121:0/2379496817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6704005270 0x7f671c0b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.132+0000 7f6723c00640 1 -- 172.21.15.121:0/2379496817 >> 172.21.15.121:0/2379496817 conn(0x7f671c0b1b90 msgr2=0x7f671c156010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:32.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.132+0000 7f6723c00640 1 -- 172.21.15.121:0/2379496817 shutdown_connections 2024-09-17T03:36:32.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.132+0000 7f6723c00640 1 -- 172.21.15.121:0/2379496817 wait complete. 2024-09-17T03:36:32.142 INFO:tasks.ceph.mds.d.smithi176.stderr: -5170> 2024-09-17T03:35:37.355+0000 7f6ccb200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:36:32.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:36:32.267 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T03:36:32.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.383+0000 7f8f20800640 1 -- 172.21.15.121:0/3869482077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f1806e330 msgr2=0x7f8f180ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.383+0000 7f8f20800640 1 --2- 172.21.15.121:0/3869482077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f1806e330 0x7f8f180ca6f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8f18075240 tx=0x7f8f1402aa10 comp rx=0 tx=0).stop 2024-09-17T03:36:32.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.383+0000 7f8f20800640 1 -- 172.21.15.121:0/3869482077 shutdown_connections 2024-09-17T03:36:32.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.383+0000 7f8f20800640 1 --2- 172.21.15.121:0/3869482077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f1806e330 0x7f8f180ca6f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.383+0000 7f8f20800640 1 --2- 172.21.15.121:0/3869482077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f180af5b0 0x7f8f1806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.383+0000 7f8f20800640 1 --2- 172.21.15.121:0/3869482077 >> v2:172.21.15.176:3300/0 conn(0x7f8f180cc530 0x7f8f1815ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.383+0000 7f8f20800640 1 -- 172.21.15.121:0/3869482077 >> 172.21.15.121:0/3869482077 conn(0x7f8f180b1b90 msgr2=0x7f8f180b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:32.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.383+0000 7f8f20800640 1 -- 172.21.15.121:0/3869482077 shutdown_connections 2024-09-17T03:36:32.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.383+0000 7f8f20800640 1 -- 172.21.15.121:0/3869482077 wait complete. 2024-09-17T03:36:32.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.386+0000 7f8f20800640 1 Processor -- start 2024-09-17T03:36:32.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.386+0000 7f8f20800640 1 -- start start 2024-09-17T03:36:32.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.387+0000 7f8f20800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f1806e330 0x7f8f181f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:32.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.387+0000 7f8f20800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f180af5b0 0x7f8f181f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:32.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.387+0000 7f8f20800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f180cc530 0x7f8f180b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:32.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.387+0000 7f8f20800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8f180cadb0 con 0x7f8f180cc530 2024-09-17T03:36:32.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.387+0000 7f8f20800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f180cac30 con 0x7f8f180af5b0 2024-09-17T03:36:32.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.387+0000 7f8f20800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f180caf30 con 0x7f8f1806e330 2024-09-17T03:36:32.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f180cc530 0x7f8f180b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:32.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f180cc530 0x7f8f180b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36440/0 (socket says 172.21.15.121:36440) 2024-09-17T03:36:32.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1e800640 1 -- 172.21.15.121:0/1676950545 learned_addr learned my addr 172.21.15.121:0/1676950545 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:32.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1d400640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f180af5b0 0x7f8f181f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:32.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1de00640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f1806e330 0x7f8f181f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:32.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1e800640 1 -- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f1806e330 msgr2=0x7f8f181f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1e800640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f1806e330 0x7f8f181f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1e800640 1 -- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f180af5b0 msgr2=0x7f8f181f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1e800640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f180af5b0 0x7f8f181f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1e800640 1 -- 172.21.15.121:0/1676950545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f181575b0 con 0x7f8f180cc530 2024-09-17T03:36:32.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.388+0000 7f8f1e800640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f180cc530 0x7f8f180b2ed0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009d60 tx=0x7f8f14003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:32.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.389+0000 7f8f12000640 1 -- 172.21.15.121:0/1676950545 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14033050 con 0x7f8f180cc530 2024-09-17T03:36:32.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.389+0000 7f8f12000640 1 -- 172.21.15.121:0/1676950545 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f14004450 con 0x7f8f180cc530 2024-09-17T03:36:32.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.389+0000 7f8f12000640 1 -- 172.21.15.121:0/1676950545 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14004860 con 0x7f8f180cc530 2024-09-17T03:36:32.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.389+0000 7f8f20800640 1 -- 172.21.15.121:0/1676950545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f181f5430 con 0x7f8f180cc530 2024-09-17T03:36:32.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.389+0000 7f8f20800640 1 -- 172.21.15.121:0/1676950545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f181f94c0 con 0x7f8f180cc530 2024-09-17T03:36:32.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.390+0000 7f8f20800640 1 -- 172.21.15.121:0/1676950545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f180cb450 con 0x7f8f180cc530 2024-09-17T03:36:32.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.391+0000 7f8f12000640 1 -- 172.21.15.121:0/1676950545 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f14036070 con 0x7f8f180cc530 2024-09-17T03:36:32.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.392+0000 7f8f12000640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8efc078b90 0x7f8efc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:32.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.392+0000 7f8f12000640 1 -- 172.21.15.121:0/1676950545 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7f8f140bc4f0 con 0x7f8f180cc530 2024-09-17T03:36:32.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.392+0000 7f8f1de00640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8efc078b90 0x7f8efc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:32.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.393+0000 7f8f1de00640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8efc078b90 0x7f8efc07b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c005fd0 tx=0x7f8f0c00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:32.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.396+0000 7f8f12000640 1 -- 172.21.15.121:0/1676950545 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f181f5430 con 0x7f8f180cc530 2024-09-17T03:36:32.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:32.622+0000 7f8f20800640 1 -- 172.21.15.121:0/1676950545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8f18070c50 con 0x7f8f180cc530 2024-09-17T03:36:33.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.130+0000 7f8f12000640 1 -- 172.21.15.121:0/1676950545 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f8f14083f00 con 0x7f8f180cc530 2024-09-17T03:36:33.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.132+0000 7f8f20800640 1 -- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8efc078b90 msgr2=0x7f8efc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.132+0000 7f8f20800640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8efc078b90 0x7f8efc07b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c005fd0 tx=0x7f8f0c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.132+0000 7f8f20800640 1 -- 172.21.15.121:0/1676950545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f180cc530 msgr2=0x7f8f180b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.132+0000 7f8f20800640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f180cc530 0x7f8f180b2ed0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009d60 tx=0x7f8f14003f10 comp rx=0 tx=0).stop 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.132+0000 7f8f20800640 1 -- 172.21.15.121:0/1676950545 shutdown_connections 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.132+0000 7f8f20800640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8efc078b90 0x7f8efc07b0a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.132+0000 7f8f20800640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f180cc530 0x7f8f180b2ed0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.132+0000 7f8f20800640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f180af5b0 0x7f8f181f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.132+0000 7f8f20800640 1 --2- 172.21.15.121:0/1676950545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f1806e330 0x7f8f181f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.132+0000 7f8f20800640 1 -- 172.21.15.121:0/1676950545 >> 172.21.15.121:0/1676950545 conn(0x7f8f180b1b90 msgr2=0x7f8f1806fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.133+0000 7f8f20800640 1 -- 172.21.15.121:0/1676950545 shutdown_connections 2024-09-17T03:36:33.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.133+0000 7f8f20800640 1 -- 172.21.15.121:0/1676950545 wait complete. 2024-09-17T03:36:33.159 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:36:33.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.385+0000 7fa9a1000640 1 -- 172.21.15.121:0/3236174303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c06e2f0 msgr2=0x7fa99c160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:33.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.385+0000 7fa9a1000640 1 --2- 172.21.15.121:0/3236174303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c06e2f0 0x7fa99c160a50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa994005fd0 tx=0x7fa99402aa90 comp rx=0 tx=0).stop 2024-09-17T03:36:33.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.385+0000 7fa9a1000640 1 -- 172.21.15.121:0/3236174303 shutdown_connections 2024-09-17T03:36:33.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.385+0000 7fa9a1000640 1 --2- 172.21.15.121:0/3236174303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c06e2f0 0x7fa99c160a50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:33.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.385+0000 7fa9a1000640 1 --2- 172.21.15.121:0/3236174303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c0ca690 0x7fa99c160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:33.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.385+0000 7fa9a1000640 1 -- 172.21.15.121:0/3236174303 >> 172.21.15.121:0/3236174303 conn(0x7fa99c0ccac0 msgr2=0x7fa99c0cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:33.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.385+0000 7fa9a1000640 1 -- 172.21.15.121:0/3236174303 shutdown_connections 2024-09-17T03:36:33.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.385+0000 7fa9a1000640 1 -- 172.21.15.121:0/3236174303 wait complete. 2024-09-17T03:36:33.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.388+0000 7fa9a1000640 1 Processor -- start 2024-09-17T03:36:33.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.388+0000 7fa9a1000640 1 -- start start 2024-09-17T03:36:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.389+0000 7fa9a1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c06e2f0 0x7fa99c157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.389+0000 7fa9a1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c0ca690 0x7fa99c1f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.389+0000 7fa9a1000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c160640 0x7fa99c1f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.389+0000 7fa9a1000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c06f9d0 con 0x7fa99c06e2f0 2024-09-17T03:36:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.389+0000 7fa9a1000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c06f850 con 0x7fa99c0ca690 2024-09-17T03:36:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.389+0000 7fa9a1000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa99c06fb50 con 0x7fa99c160640 2024-09-17T03:36:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c06e2f0 0x7fa99c157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c06e2f0 0x7fa99c157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36466/0 (socket says 172.21.15.121:36466) 2024-09-17T03:36:33.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999e00640 1 -- 172.21.15.121:0/2832804902 learned_addr learned my addr 172.21.15.121:0/2832804902 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa99a800640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c160640 0x7fa99c1f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999400640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c0ca690 0x7fa99c1f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999e00640 1 -- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c160640 msgr2=0x7fa99c1f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999e00640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c160640 0x7fa99c1f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999e00640 1 -- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c0ca690 msgr2=0x7fa99c1f8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999e00640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c0ca690 0x7fa99c1f8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999e00640 1 -- 172.21.15.121:0/2832804902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99c1f9b60 con 0x7fa99c06e2f0 2024-09-17T03:36:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999400640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c0ca690 0x7fa99c1f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:33.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.390+0000 7fa999e00640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c06e2f0 0x7fa99c157530 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00d740 tx=0x7fa98c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:33.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.391+0000 7fa992000640 1 -- 172.21.15.121:0/2832804902 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c017070 con 0x7fa99c06e2f0 2024-09-17T03:36:33.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.391+0000 7fa992000640 1 -- 172.21.15.121:0/2832804902 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa98c009d20 con 0x7fa99c06e2f0 2024-09-17T03:36:33.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.391+0000 7fa992000640 1 -- 172.21.15.121:0/2832804902 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c0106c0 con 0x7fa99c06e2f0 2024-09-17T03:36:33.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.391+0000 7fa9a1000640 1 -- 172.21.15.121:0/2832804902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99c0cead0 con 0x7fa99c06e2f0 2024-09-17T03:36:33.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.391+0000 7fa9a1000640 1 -- 172.21.15.121:0/2832804902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa99c0ced70 con 0x7fa99c06e2f0 2024-09-17T03:36:33.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.392+0000 7fa9a1000640 1 -- 172.21.15.121:0/2832804902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa99c160a50 con 0x7fa99c06e2f0 2024-09-17T03:36:33.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.393+0000 7fa992000640 1 -- 172.21.15.121:0/2832804902 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa98c01a070 con 0x7fa99c06e2f0 2024-09-17T03:36:33.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.394+0000 7fa992000640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa97c078bc0 0x7fa97c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:33.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.394+0000 7fa992000640 1 -- 172.21.15.121:0/2832804902 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7fa98c09b2d0 con 0x7fa99c06e2f0 2024-09-17T03:36:33.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.395+0000 7fa999400640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa97c078bc0 0x7fa97c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:33.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.395+0000 7fa999400640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa97c078bc0 0x7fa97c07b0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0ce9a0 tx=0x7fa988009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:33.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.399+0000 7fa992000640 1 -- 172.21.15.121:0/2832804902 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa98c063330 con 0x7fa99c06e2f0 2024-09-17T03:36:33.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:33.581+0000 7fa9a1000640 1 -- 172.21.15.121:0/2832804902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa99c0b5f20 con 0x7fa99c06e2f0 2024-09-17T03:36:34.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.136+0000 7fa992000640 1 -- 172.21.15.121:0/2832804902 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fa98c062c30 con 0x7fa99c06e2f0 2024-09-17T03:36:34.136 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 -- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa97c078bc0 msgr2=0x7fa97c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa97c078bc0 0x7fa97c07b0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0ce9a0 tx=0x7fa988009040 comp rx=0 tx=0).stop 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 -- 172.21.15.121:0/2832804902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c06e2f0 msgr2=0x7fa99c157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c06e2f0 0x7fa99c157530 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00d740 tx=0x7fa98c00dc00 comp rx=0 tx=0).stop 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 -- 172.21.15.121:0/2832804902 shutdown_connections 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa99c160640 0x7fa99c1f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa99c0ca690 0x7fa99c1f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa97c078bc0 0x7fa97c07b0d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 --2- 172.21.15.121:0/2832804902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa99c06e2f0 0x7fa99c157530 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 -- 172.21.15.121:0/2832804902 >> 172.21.15.121:0/2832804902 conn(0x7fa99c0ccac0 msgr2=0x7fa99c0afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:34.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 -- 172.21.15.121:0/2832804902 shutdown_connections 2024-09-17T03:36:34.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.139+0000 7fa9a1000640 1 -- 172.21.15.121:0/2832804902 wait complete. 2024-09-17T03:36:34.165 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:36:34.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.391+0000 7f9c72400640 1 -- 172.21.15.121:0/1121139413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c6c160640 msgr2=0x7f9c6c160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:34.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.391+0000 7f9c72400640 1 --2- 172.21.15.121:0/1121139413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c6c160640 0x7f9c6c160a50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009830 tx=0x7f9c5402a520 comp rx=0 tx=0).stop 2024-09-17T03:36:34.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.391+0000 7f9c72400640 1 -- 172.21.15.121:0/1121139413 shutdown_connections 2024-09-17T03:36:34.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.391+0000 7f9c72400640 1 --2- 172.21.15.121:0/1121139413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c6c160640 0x7f9c6c160a50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.391+0000 7f9c72400640 1 --2- 172.21.15.121:0/1121139413 >> v2:172.21.15.176:3300/0 conn(0x7f9c6c0ca690 0x7f9c6c160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.391+0000 7f9c72400640 1 -- 172.21.15.121:0/1121139413 >> 172.21.15.121:0/1121139413 conn(0x7f9c6c0ccac0 msgr2=0x7f9c6c0cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:34.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.391+0000 7f9c72400640 1 -- 172.21.15.121:0/1121139413 shutdown_connections 2024-09-17T03:36:34.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.391+0000 7f9c72400640 1 -- 172.21.15.121:0/1121139413 wait complete. 2024-09-17T03:36:34.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.393+0000 7f9c72400640 1 Processor -- start 2024-09-17T03:36:34.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.394+0000 7f9c72400640 1 -- start start 2024-09-17T03:36:34.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.395+0000 7f9c72400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c6c06ef30 0x7f9c6c0c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:34.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.395+0000 7f9c72400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c6c0ca690 0x7f9c6c0c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:34.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.395+0000 7f9c72400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c160640 0x7f9c6c151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:34.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.395+0000 7f9c72400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c06fa50 con 0x7f9c6c160640 2024-09-17T03:36:34.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.395+0000 7f9c72400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c06e500 con 0x7f9c6c0ca690 2024-09-17T03:36:34.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.395+0000 7f9c72400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c6c06fbd0 con 0x7f9c6c06ef30 2024-09-17T03:36:34.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.395+0000 7f9c6be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c160640 0x7f9c6c151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:34.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.395+0000 7f9c6be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c160640 0x7f9c6c151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36474/0 (socket says 172.21.15.121:36474) 2024-09-17T03:36:34.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.395+0000 7f9c6be00640 1 -- 172.21.15.121:0/3928525424 learned_addr learned my addr 172.21.15.121:0/3928525424 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:34.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.395+0000 7f9c6b400640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c6c06ef30 0x7f9c6c0c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:34.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c62a00640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c6c0ca690 0x7f9c6c0c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:34.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c6be00640 1 -- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c6c06ef30 msgr2=0x7f9c6c0c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:34.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c6be00640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c6c06ef30 0x7f9c6c0c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c6be00640 1 -- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c6c0ca690 msgr2=0x7f9c6c0c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:34.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c6be00640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c6c0ca690 0x7f9c6c0c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c6be00640 1 -- 172.21.15.121:0/3928525424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6c0c52f0 con 0x7f9c6c160640 2024-09-17T03:36:34.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c62a00640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c6c0ca690 0x7f9c6c0c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:34.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c6be00640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c160640 0x7f9c6c151560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400cad0 tx=0x7f9c6400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:34.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c63e00640 1 -- 172.21.15.121:0/3928525424 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c64016020 con 0x7f9c6c160640 2024-09-17T03:36:34.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c63e00640 1 -- 172.21.15.121:0/3928525424 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c6400ad20 con 0x7f9c6c160640 2024-09-17T03:36:34.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c72400640 1 -- 172.21.15.121:0/3928525424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c6c0c55d0 con 0x7f9c6c160640 2024-09-17T03:36:34.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.396+0000 7f9c63e00640 1 -- 172.21.15.121:0/3928525424 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c64012680 con 0x7f9c6c160640 2024-09-17T03:36:34.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.397+0000 7f9c72400640 1 -- 172.21.15.121:0/3928525424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c6c0c76c0 con 0x7f9c6c160640 2024-09-17T03:36:34.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.398+0000 7f9c72400640 1 -- 172.21.15.121:0/3928525424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6c160100 con 0x7f9c6c160640 2024-09-17T03:36:34.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.399+0000 7f9c63e00640 1 -- 172.21.15.121:0/3928525424 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c64019020 con 0x7f9c6c160640 2024-09-17T03:36:34.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.400+0000 7f9c63e00640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9c48078bc0 0x7f9c4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:34.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.400+0000 7f9c63e00640 1 -- 172.21.15.121:0/3928525424 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6238+0+0 (secure 0 0 0) 0x7f9c6409b510 con 0x7f9c6c160640 2024-09-17T03:36:34.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.400+0000 7f9c6b400640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9c48078bc0 0x7f9c4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:34.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.401+0000 7f9c6b400640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9c48078bc0 0x7f9c4807b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0095f0 tx=0x7f9c5c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:34.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.405+0000 7f9c63e00640 1 -- 172.21.15.121:0/3928525424 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9c64020020 con 0x7f9c6c160640 2024-09-17T03:36:34.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:34.587+0000 7f9c72400640 1 -- 172.21.15.121:0/3928525424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9c6c0b5f20 con 0x7f9c6c160640 2024-09-17T03:36:35.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.138+0000 7f9c63e00640 1 -- 172.21.15.121:0/3928525424 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f9c640636a0 con 0x7f9c6c160640 2024-09-17T03:36:35.138 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-17T03:36:35.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.142+0000 7f9c72400640 1 -- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9c48078bc0 msgr2=0x7f9c4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.142+0000 7f9c72400640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9c48078bc0 0x7f9c4807b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0095f0 tx=0x7f9c5c005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.142+0000 7f9c72400640 1 -- 172.21.15.121:0/3928525424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c160640 msgr2=0x7f9c6c151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.142+0000 7f9c72400640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c160640 0x7f9c6c151560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400cad0 tx=0x7f9c6400cf90 comp rx=0 tx=0).stop 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.143+0000 7f9c72400640 1 -- 172.21.15.121:0/3928525424 shutdown_connections 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.143+0000 7f9c72400640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9c48078bc0 0x7f9c4807b0d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.143+0000 7f9c72400640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c160640 0x7f9c6c151560 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.143+0000 7f9c72400640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c6c0ca690 0x7f9c6c0c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.143+0000 7f9c72400640 1 --2- 172.21.15.121:0/3928525424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c6c06ef30 0x7f9c6c0c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.143+0000 7f9c72400640 1 -- 172.21.15.121:0/3928525424 >> 172.21.15.121:0/3928525424 conn(0x7f9c6c0ccac0 msgr2=0x7f9c6c0b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.143+0000 7f9c72400640 1 -- 172.21.15.121:0/3928525424 shutdown_connections 2024-09-17T03:36:35.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.143+0000 7f9c72400640 1 -- 172.21.15.121:0/3928525424 wait complete. 2024-09-17T03:36:35.166 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-17T03:36:35.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.405+0000 7ff247e00640 1 -- 172.21.15.121:0/898686745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff22c004800 msgr2=0x7ff22c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:35.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.405+0000 7ff247e00640 1 --2- 172.21.15.121:0/898686745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff22c004800 0x7ff22c004c10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff2480b44b0 tx=0x7ff22c005830 comp rx=0 tx=0).stop 2024-09-17T03:36:35.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.405+0000 7ff247400640 1 -- 172.21.15.121:0/898686745 reap_dead start 2024-09-17T03:36:35.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.405+0000 7ff247e00640 1 -- 172.21.15.121:0/898686745 shutdown_connections 2024-09-17T03:36:35.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.405+0000 7ff247e00640 1 -- 172.21.15.121:0/898686745 >> 172.21.15.121:0/898686745 conn(0x7ff2480d0460 msgr2=0x7ff24806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:35.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.405+0000 7ff247e00640 1 -- 172.21.15.121:0/898686745 shutdown_connections 2024-09-17T03:36:35.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.405+0000 7ff247e00640 1 -- 172.21.15.121:0/898686745 wait complete. 2024-09-17T03:36:35.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.407+0000 7ff247e00640 1 Processor -- start 2024-09-17T03:36:35.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.407+0000 7ff247e00640 1 -- start start 2024-09-17T03:36:35.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff22c004800 0x7ff2480aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2481f4b20 0x7ff24813d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2481f3f60 0x7ff2481f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff24806f590 con 0x7ff2481f3f60 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff248074140 con 0x7ff22c004800 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff24806f710 con 0x7ff2481f4b20 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2481f3f60 0x7ff2481f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2481f3f60 0x7ff2481f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36502/0 (socket says 172.21.15.121:36502) 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247400640 1 -- 172.21.15.121:0/2569404323 learned_addr learned my addr 172.21.15.121:0/2569404323 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff246a00640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff22c004800 0x7ff2480aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff246000640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2481f4b20 0x7ff24813d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247400640 1 -- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2481f4b20 msgr2=0x7ff24813d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247400640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2481f4b20 0x7ff24813d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247400640 1 -- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff22c004800 msgr2=0x7ff2480aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247400640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff22c004800 0x7ff2480aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff247400640 1 -- 172.21.15.121:0/2569404323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2481f48b0 con 0x7ff2481f3f60 2024-09-17T03:36:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff246a00640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff22c004800 0x7ff2480aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.409+0000 7ff246000640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2481f4b20 0x7ff24813d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.410+0000 7ff247400640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2481f3f60 0x7ff2481f4370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff24815fde0 tx=0x7ff240010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.410+0000 7ff23f400640 1 -- 172.21.15.121:0/2569404323 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240003970 con 0x7ff2481f3f60 2024-09-17T03:36:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.410+0000 7ff23f400640 1 -- 172.21.15.121:0/2569404323 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff240015070 con 0x7ff2481f3f60 2024-09-17T03:36:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.410+0000 7ff247e00640 1 -- 172.21.15.121:0/2569404323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2480a9650 con 0x7ff2481f3f60 2024-09-17T03:36:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.410+0000 7ff23f400640 1 -- 172.21.15.121:0/2569404323 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240004030 con 0x7ff2481f3f60 2024-09-17T03:36:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.410+0000 7ff247e00640 1 -- 172.21.15.121:0/2569404323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2480a9c10 con 0x7ff2481f3f60 2024-09-17T03:36:35.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.411+0000 7ff247e00640 1 -- 172.21.15.121:0/2569404323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2480b2e60 con 0x7ff2481f3f60 2024-09-17T03:36:35.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.412+0000 7ff23f400640 1 -- 172.21.15.121:0/2569404323 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2400041d0 con 0x7ff2481f3f60 2024-09-17T03:36:35.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.413+0000 7ff23f400640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff228078b90 0x7ff22807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.413+0000 7ff23f400640 1 -- 172.21.15.121:0/2569404323 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5795+0+0 (secure 0 0 0) 0x7ff24009b5f0 con 0x7ff2481f3f60 2024-09-17T03:36:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.414+0000 7ff246a00640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff228078b90 0x7ff22807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:35.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.414+0000 7ff246a00640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff228078b90 0x7ff22807b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2380011a0 tx=0x7ff238006b10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:35.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.418+0000 7ff23f400640 1 -- 172.21.15.121:0/2569404323 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2481f48b0 con 0x7ff2481f3f60 2024-09-17T03:36:35.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:35.601+0000 7ff247e00640 1 -- 172.21.15.121:0/2569404323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff248074e40 con 0x7ff2481f3f60 2024-09-17T03:36:36.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.144+0000 7ff23f400640 1 -- 172.21.15.121:0/2569404323 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7ff240063930 con 0x7ff2481f3f60 2024-09-17T03:36:36.144 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data_ec' removed 2024-09-17T03:36:36.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.149+0000 7ff247e00640 1 -- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff228078b90 msgr2=0x7ff22807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.149+0000 7ff247e00640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff228078b90 0x7ff22807b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2380011a0 tx=0x7ff238006b10 comp rx=0 tx=0).stop 2024-09-17T03:36:36.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.149+0000 7ff247e00640 1 -- 172.21.15.121:0/2569404323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2481f3f60 msgr2=0x7ff2481f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.149+0000 7ff247e00640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2481f3f60 0x7ff2481f4370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff24815fde0 tx=0x7ff240010f40 comp rx=0 tx=0).stop 2024-09-17T03:36:36.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.149+0000 7ff247e00640 1 -- 172.21.15.121:0/2569404323 shutdown_connections 2024-09-17T03:36:36.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.149+0000 7ff247e00640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff228078b90 0x7ff22807b0a0 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2380011a0 tx=0x7ff238006b10 comp rx=0 tx=0).stop 2024-09-17T03:36:36.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.149+0000 7ff247e00640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2481f3f60 0x7ff2481f4370 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.149+0000 7ff247e00640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2481f4b20 0x7ff24813d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.149+0000 7ff247e00640 1 --2- 172.21.15.121:0/2569404323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff22c004800 0x7ff2480aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.149+0000 7ff247e00640 1 -- 172.21.15.121:0/2569404323 >> 172.21.15.121:0/2569404323 conn(0x7ff2480d0460 msgr2=0x7ff2480cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:36.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.150+0000 7ff247e00640 1 -- 172.21.15.121:0/2569404323 shutdown_connections 2024-09-17T03:36:36.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.150+0000 7ff247e00640 1 -- 172.21.15.121:0/2569404323 wait complete. 2024-09-17T03:36:36.178 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:36:36.179 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:36:36.179 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:36:36.179 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:36.179 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:36:36.179 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:36:36.179 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:36:36.180 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:36.180 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:36:36.180 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:36:36.180 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:36:36.180 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:36.180 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:36:36.180 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:36:36.181 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:36:36.181 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:36.205 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:36:36.205 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:36:36.206 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:36:36.206 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:36:36.208 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:36:36.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:36:36.210 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:36:36.210 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:36:36.250 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:36:36.250 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:36.252 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:36:36.253 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:36.254 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:36:36.254 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:36.257 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:36:36.257 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:36.257 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:36:36.448 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:36:36.449 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T03:36:36.452 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:36:36.452 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:36:36.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.490+0000 7f1564600640 1 -- 172.21.15.121:0/4183564935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155c15ead0 msgr2=0x7f155c162e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.490+0000 7f1564600640 1 --2- 172.21.15.121:0/4183564935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155c15ead0 0x7f155c162e20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f155c0b6ff0 tx=0x7f154802a440 comp rx=0 tx=0).stop 2024-09-17T03:36:36.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.491+0000 7f1564600640 1 -- 172.21.15.121:0/4183564935 shutdown_connections 2024-09-17T03:36:36.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.491+0000 7f1564600640 1 --2- 172.21.15.121:0/4183564935 >> v2:172.21.15.176:3300/0 conn(0x7f155c0cd450 0x7f155c0cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.491+0000 7f1564600640 1 --2- 172.21.15.121:0/4183564935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155c15ead0 0x7f155c162e20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.491+0000 7f1564600640 1 -- 172.21.15.121:0/4183564935 >> 172.21.15.121:0/4183564935 conn(0x7f155c0b46e0 msgr2=0x7f155c0d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:36.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.491+0000 7f1564600640 1 -- 172.21.15.121:0/4183564935 shutdown_connections 2024-09-17T03:36:36.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.491+0000 7f1564600640 1 -- 172.21.15.121:0/4183564935 wait complete. 2024-09-17T03:36:36.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.493+0000 7f1564600640 1 Processor -- start 2024-09-17T03:36:36.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.493+0000 7f1564600640 1 -- start start 2024-09-17T03:36:36.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.494+0000 7f1564600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f155c0b5bd0 0x7f155c155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1564600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155c0cd450 0x7f155c1486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1564600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f155c15ead0 0x7f155c160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1564600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f155c0cdf20 con 0x7f155c0cd450 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1564600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f155c0cdda0 con 0x7f155c0b5bd0 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1564600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f155c0ce0a0 con 0x7f155c15ead0 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1561200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155c0cd450 0x7f155c1486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1561200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155c0cd450 0x7f155c1486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36550/0 (socket says 172.21.15.121:36550) 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1561200640 1 -- 172.21.15.121:0/2888968919 learned_addr learned my addr 172.21.15.121:0/2888968919 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1561c00640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f155c0b5bd0 0x7f155c155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1562600640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f155c15ead0 0x7f155c160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1561200640 1 -- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f155c15ead0 msgr2=0x7f155c160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1561200640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f155c15ead0 0x7f155c160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1561200640 1 -- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f155c0b5bd0 msgr2=0x7f155c155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1561200640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f155c0b5bd0 0x7f155c155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.495+0000 7f1561200640 1 -- 172.21.15.121:0/2888968919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c1f69e0 con 0x7f155c0cd450 2024-09-17T03:36:36.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.496+0000 7f1561200640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155c0cd450 0x7f155c1486c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1548000c00 tx=0x7f15480039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:36.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.496+0000 7f1559600640 1 -- 172.21.15.121:0/2888968919 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154803e030 con 0x7f155c0cd450 2024-09-17T03:36:36.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.496+0000 7f1559600640 1 -- 172.21.15.121:0/2888968919 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15480047a0 con 0x7f155c0cd450 2024-09-17T03:36:36.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.496+0000 7f1559600640 1 -- 172.21.15.121:0/2888968919 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548035040 con 0x7f155c0cd450 2024-09-17T03:36:36.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.496+0000 7f1564600640 1 -- 172.21.15.121:0/2888968919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155c1f5c20 con 0x7f155c0cd450 2024-09-17T03:36:36.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.496+0000 7f1564600640 1 -- 172.21.15.121:0/2888968919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f155c1f61e0 con 0x7f155c0cd450 2024-09-17T03:36:36.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.497+0000 7f1564600640 1 -- 172.21.15.121:0/2888968919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f155c158c10 con 0x7f155c0cd450 2024-09-17T03:36:36.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.498+0000 7f1559600640 1 -- 172.21.15.121:0/2888968919 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1548041030 con 0x7f155c0cd450 2024-09-17T03:36:36.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.499+0000 7f1559600640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f153c078b90 0x7f153c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.499+0000 7f1559600640 1 -- 172.21.15.121:0/2888968919 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5335+0+0 (secure 0 0 0) 0x7f15480bb4e0 con 0x7f155c0cd450 2024-09-17T03:36:36.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.500+0000 7f1561c00640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f153c078b90 0x7f153c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.500+0000 7f1561c00640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f153c078b90 0x7f153c07b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1550006fd0 tx=0x7f1550009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.504+0000 7f1559600640 1 -- 172.21.15.121:0/2888968919 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f15480833a0 con 0x7f155c0cd450 2024-09-17T03:36:36.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:36.712+0000 7f1564600640 1 -- 172.21.15.121:0/2888968919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f155c0ce640 con 0x7f155c0cd450 2024-09-17T03:36:37.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.158+0000 7f1559600640 1 -- 172.21.15.121:0/2888968919 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) ==== 97+0+0 (secure 0 0 0) 0x7f1548087dd0 con 0x7f155c0cd450 2024-09-17T03:36:37.158 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-17T03:36:37.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.160+0000 7f1564600640 1 -- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f153c078b90 msgr2=0x7f153c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.160+0000 7f1564600640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f153c078b90 0x7f153c07b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1550006fd0 tx=0x7f1550009060 comp rx=0 tx=0).stop 2024-09-17T03:36:37.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.160+0000 7f1564600640 1 -- 172.21.15.121:0/2888968919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155c0cd450 msgr2=0x7f155c1486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.160+0000 7f1564600640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155c0cd450 0x7f155c1486c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1548000c00 tx=0x7f15480039e0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.160+0000 7f1564600640 1 -- 172.21.15.121:0/2888968919 shutdown_connections 2024-09-17T03:36:37.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.160+0000 7f1564600640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f155c15ead0 0x7f155c160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.160+0000 7f1564600640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f153c078b90 0x7f153c07b0a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.160+0000 7f1564600640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f155c0cd450 0x7f155c1486c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.160+0000 7f1564600640 1 --2- 172.21.15.121:0/2888968919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f155c0b5bd0 0x7f155c155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.160+0000 7f1564600640 1 -- 172.21.15.121:0/2888968919 >> 172.21.15.121:0/2888968919 conn(0x7f155c0b46e0 msgr2=0x7f155c15c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.161+0000 7f1564600640 1 -- 172.21.15.121:0/2888968919 shutdown_connections 2024-09-17T03:36:37.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.161+0000 7f1564600640 1 -- 172.21.15.121:0/2888968919 wait complete. 2024-09-17T03:36:37.184 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:36:37.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.402+0000 7f393f200640 1 -- 172.21.15.121:0/2724186965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3938152530 msgr2=0x7f39380b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.402+0000 7f393f200640 1 --2- 172.21.15.121:0/2724186965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3938152530 0x7f39380b3490 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3928005fd0 tx=0x7f392802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.402+0000 7f393f200640 1 -- 172.21.15.121:0/2724186965 shutdown_connections 2024-09-17T03:36:37.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.402+0000 7f393f200640 1 --2- 172.21.15.121:0/2724186965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3938152530 0x7f39380b3490 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.402+0000 7f393f200640 1 --2- 172.21.15.121:0/2724186965 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3938073dd0 0x7f393815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.402+0000 7f393f200640 1 -- 172.21.15.121:0/2724186965 >> 172.21.15.121:0/2724186965 conn(0x7f393806f940 msgr2=0x7f39380b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.402+0000 7f393f200640 1 -- 172.21.15.121:0/2724186965 shutdown_connections 2024-09-17T03:36:37.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.402+0000 7f393f200640 1 -- 172.21.15.121:0/2724186965 wait complete. 2024-09-17T03:36:37.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.404+0000 7f393f200640 1 Processor -- start 2024-09-17T03:36:37.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.404+0000 7f393f200640 1 -- start start 2024-09-17T03:36:37.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3938073dd0 0x7f3938148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39380b39d0 0x7f39380b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3938152530 0x7f39381e9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393f200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f39380cf5b0 con 0x7f39380b39d0 2024-09-17T03:36:37.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39380cf430 con 0x7f3938152530 2024-09-17T03:36:37.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39380cf730 con 0x7f3938073dd0 2024-09-17T03:36:37.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39380b39d0 0x7f39380b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39380b39d0 0x7f39380b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36566/0 (socket says 172.21.15.121:36566) 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393d400640 1 -- 172.21.15.121:0/3882480926 learned_addr learned my addr 172.21.15.121:0/3882480926 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393de00640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3938073dd0 0x7f3938148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393e800640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3938152530 0x7f39381e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393d400640 1 -- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3938073dd0 msgr2=0x7f3938148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393d400640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3938073dd0 0x7f3938148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393d400640 1 -- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3938152530 msgr2=0x7f39381e9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393d400640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3938152530 0x7f39381e9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393d400640 1 -- 172.21.15.121:0/3882480926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39381489d0 con 0x7f39380b39d0 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.406+0000 7f393de00640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3938073dd0 0x7f3938148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.407+0000 7f393d400640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39380b39d0 0x7f39380b15d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3928034040 tx=0x7f39280038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.407+0000 7f3932000640 1 -- 172.21.15.121:0/3882480926 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392803e030 con 0x7f39380b39d0 2024-09-17T03:36:37.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.407+0000 7f3932000640 1 -- 172.21.15.121:0/3882480926 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3928003ca0 con 0x7f39380b39d0 2024-09-17T03:36:37.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.407+0000 7f3932000640 1 -- 172.21.15.121:0/3882480926 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928035040 con 0x7f39380b39d0 2024-09-17T03:36:37.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.407+0000 7f393f200640 1 -- 172.21.15.121:0/3882480926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f393814ecc0 con 0x7f39380b39d0 2024-09-17T03:36:37.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.407+0000 7f393f200640 1 -- 172.21.15.121:0/3882480926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39381f5d30 con 0x7f39380b39d0 2024-09-17T03:36:37.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.408+0000 7f393f200640 1 -- 172.21.15.121:0/3882480926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39380cfbe0 con 0x7f39380b39d0 2024-09-17T03:36:37.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.411+0000 7f3932000640 1 -- 172.21.15.121:0/3882480926 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3928041030 con 0x7f39380b39d0 2024-09-17T03:36:37.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.412+0000 7f3932000640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f391c078b90 0x7f391c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.412+0000 7f3932000640 1 -- 172.21.15.121:0/3882480926 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f39280bb660 con 0x7f39380b39d0 2024-09-17T03:36:37.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.412+0000 7f393de00640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f391c078b90 0x7f391c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.413+0000 7f393de00640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f391c078b90 0x7f391c07b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f392c005fd0 tx=0x7f392c00f360 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.415+0000 7f3932000640 1 -- 172.21.15.121:0/3882480926 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3928083c40 con 0x7f39380b39d0 2024-09-17T03:36:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.662+0000 7f393f200640 1 -- 172.21.15.121:0/3882480926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f393814ea50 con 0x7f39380b39d0 2024-09-17T03:36:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.663+0000 7f3932000640 1 -- 172.21.15.121:0/3882480926 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v3) ==== 80+0+6645 (secure 0 0 0) 0x7f3928083540 con 0x7f39380b39d0 2024-09-17T03:36:37.662 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:37.662 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohm64sFGhAAJDdFwMDkudwacQaLfvbAdg==", 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmIGvPNRAAvE+tovzn5WadGa9C/P/A3A==", 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.c", 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmV/btJxAAmhL4jXk0LVdzCPaNi9Hzhg==", 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.d", 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmeQccCBAAtTfeUysbtoqrKjwaKRWyvg==", 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:36:37.665 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDE+OhmBxJKNRAAGxPaH7R2JtcFVO5kR/Qh2A==", 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDI+OhmRtvFCBAAOG/1XD75Atl6ztUGPw3PKA==", 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL+OhmwzDzIxAA9Z/IIRphtZK1jbS2sIXeJQ==", 2024-09-17T03:36:37.667 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.3", 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDO+Ohm94g0NBAAmxtHPev4OOM0YfOQt7N5Jg==", 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:36:37.668 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.4", 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDV+Ohmj7OoCBAA/Hrj9dHVT98lURPWJE3r/g==", 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.669 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.5", 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDY+Ohmc29QFxAAGsMy0+9MviYohok8JpL+ZA==", 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.6", 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDb+OhmDO8tKRAAq6bn/I54WKTdN6XiviHNsQ==", 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:37.670 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.7", 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDe+OhmUuFwNxAAgAeDJiL/TIGDuDAC+dXCyA==", 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw==", 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohmec7LKRAAl5nAqPEncglNL2FbRlD0oA==", 2024-09-17T03:36:37.672 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.2", 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohme/hCHxAAdP8DjxaXWMGi/Fw+85zUFA==", 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:36:37.673 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.3", 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmivFTNBAA5f47Lq5CE+iXt3i+5fUJGA==", 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC/+OhmXWj6GBAAh/FBw0ElmHixSBXm8PPeAg==", 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-mds", 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDo+OhmdA2YCBAAlhuLAvcSuN3IWwCYXqBo7A==", 2024-09-17T03:36:37.675 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDo+Ohm3xaYCBAAc2O7ev2wTYoGUpaY0j/drA==", 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-osd", 2024-09-17T03:36:37.676 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDo+OhmLx+YCBAADXWOUzA+oZ+XsHJOYORw6g==", 2024-09-17T03:36:37.677 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.677 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T03:36:37.677 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.677 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.677 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.677 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T03:36:37.677 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDo+OhmjCeYCBAAsLGSSn48iI+IP1evQe6BmQ==", 2024-09-17T03:36:37.677 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.677 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T03:36:37.677 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDo+OhmzTGYCBAAfRgBjsftVitm4q/RCZ0isQ==", 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDo+OhmkDqYCBAA4shRkylUXJIyXhPYpAslIg==", 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.678 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohmsn9CDxAAzjtaZG1qe4XTnBge+t3vlA==", 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.y", 2024-09-17T03:36:37.679 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmQfYJAxAA6Mc5PiIb5VDamVU5Vhx3aQ==", 2024-09-17T03:36:37.680 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:36:37.680 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:36:37.680 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:36:37.680 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:36:37.680 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.680 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:37.680 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-17T03:36:37.680 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:36:37.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 -- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f391c078b90 msgr2=0x7f391c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f391c078b90 0x7f391c07b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f392c005fd0 tx=0x7f392c00f360 comp rx=0 tx=0).stop 2024-09-17T03:36:37.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 -- 172.21.15.121:0/3882480926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39380b39d0 msgr2=0x7f39380b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39380b39d0 0x7f39380b15d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3928034040 tx=0x7f39280038a0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 -- 172.21.15.121:0/3882480926 shutdown_connections 2024-09-17T03:36:37.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3938152530 0x7f39381e9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f391c078b90 0x7f391c07b0a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39380b39d0 0x7f39380b15d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 --2- 172.21.15.121:0/3882480926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3938073dd0 0x7f3938148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 -- 172.21.15.121:0/3882480926 >> 172.21.15.121:0/3882480926 conn(0x7f393806f940 msgr2=0x7f393806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 -- 172.21.15.121:0/3882480926 shutdown_connections 2024-09-17T03:36:37.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.665+0000 7f393f200640 1 -- 172.21.15.121:0/3882480926 wait complete. 2024-09-17T03:36:37.687 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T03:36:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.910+0000 7f3789e00640 1 -- 172.21.15.121:0/2550636452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3768004d40 msgr2=0x7f3768005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.910+0000 7f3789e00640 1 --2- 172.21.15.121:0/2550636452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3768004d40 0x7f3768005150 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f377c009f40 tx=0x7f3768005830 comp rx=0 tx=0).stop 2024-09-17T03:36:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.910+0000 7f3783400640 1 -- 172.21.15.121:0/2550636452 reap_dead start 2024-09-17T03:36:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.911+0000 7f3789e00640 1 -- 172.21.15.121:0/2550636452 shutdown_connections 2024-09-17T03:36:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.911+0000 7f3789e00640 1 -- 172.21.15.121:0/2550636452 >> 172.21.15.121:0/2550636452 conn(0x7f37840b1b90 msgr2=0x7f37840b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.911+0000 7f3789e00640 1 -- 172.21.15.121:0/2550636452 shutdown_connections 2024-09-17T03:36:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.911+0000 7f3789e00640 1 -- 172.21.15.121:0/2550636452 wait complete. 2024-09-17T03:36:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.913+0000 7f3789e00640 1 Processor -- start 2024-09-17T03:36:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.913+0000 7f3789e00640 1 -- start start 2024-09-17T03:36:37.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.914+0000 7f3789e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37840c5950 0x7f37840c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.914+0000 7f3789e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37840ca070 0x7f37841f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.914+0000 7f3789e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840c5d60 0x7f37841f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.914+0000 7f3789e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3784160fd0 con 0x7f37840c5950 2024-09-17T03:36:37.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.914+0000 7f3789e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3784160e50 con 0x7f37840c5d60 2024-09-17T03:36:37.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.914+0000 7f3789e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f378406e200 con 0x7f37840ca070 2024-09-17T03:36:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3782a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37840c5950 0x7f37840c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3782a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37840c5950 0x7f37840c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36586/0 (socket says 172.21.15.121:36586) 2024-09-17T03:36:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3782a00640 1 -- 172.21.15.121:0/1250317542 learned_addr learned my addr 172.21.15.121:0/1250317542 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f377a000640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37840ca070 0x7f37841f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3783400640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840c5d60 0x7f37841f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3782a00640 1 -- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37840ca070 msgr2=0x7f37841f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3782a00640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37840ca070 0x7f37841f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3782a00640 1 -- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840c5d60 msgr2=0x7f37841f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3782a00640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840c5d60 0x7f37841f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3782a00640 1 -- 172.21.15.121:0/1250317542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3784159b20 con 0x7f37840c5950 2024-09-17T03:36:37.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3783400640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840c5d60 0x7f37841f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:37.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.915+0000 7f3782a00640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37840c5950 0x7f37840c9b30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3774000fb0 tx=0x7f3774004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.916+0000 7f377be00640 1 -- 172.21.15.121:0/1250317542 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774015020 con 0x7f37840c5950 2024-09-17T03:36:37.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.916+0000 7f377be00640 1 -- 172.21.15.121:0/1250317542 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3774010980 con 0x7f37840c5950 2024-09-17T03:36:37.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.916+0000 7f377be00640 1 -- 172.21.15.121:0/1250317542 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774010d50 con 0x7f37840c5950 2024-09-17T03:36:37.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.916+0000 7f3789e00640 1 -- 172.21.15.121:0/1250317542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3784159e00 con 0x7f37840c5950 2024-09-17T03:36:37.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.916+0000 7f3789e00640 1 -- 172.21.15.121:0/1250317542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37841596b0 con 0x7f37840c5950 2024-09-17T03:36:37.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.917+0000 7f3789e00640 1 -- 172.21.15.121:0/1250317542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3784074620 con 0x7f37840c5950 2024-09-17T03:36:37.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.918+0000 7f377be00640 1 -- 172.21.15.121:0/1250317542 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3774018020 con 0x7f37840c5950 2024-09-17T03:36:37.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.919+0000 7f377be00640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3760078b90 0x7f376007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.919+0000 7f377be00640 1 -- 172.21.15.121:0/1250317542 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f377409b710 con 0x7f37840c5950 2024-09-17T03:36:37.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.919+0000 7f377a000640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3760078b90 0x7f376007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.920+0000 7f377a000640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3760078b90 0x7f376007b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3784075220 tx=0x7f376c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:37.924+0000 7f377be00640 1 -- 172.21.15.121:0/1250317542 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f377401f020 con 0x7f37840c5950 2024-09-17T03:36:38.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.178+0000 7f3789e00640 1 -- 172.21.15.121:0/1250317542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f37840ca4d0 con 0x7f37840c5950 2024-09-17T03:36:38.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.181+0000 7f377be00640 1 -- 172.21.15.121:0/1250317542 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f378406e740 con 0x7f37840c5950 2024-09-17T03:36:38.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 -- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3760078b90 msgr2=0x7f376007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3760078b90 0x7f376007b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3784075220 tx=0x7f376c005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:38.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 -- 172.21.15.121:0/1250317542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37840c5950 msgr2=0x7f37840c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37840c5950 0x7f37840c9b30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3774000fb0 tx=0x7f3774004ab0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 -- 172.21.15.121:0/1250317542 shutdown_connections 2024-09-17T03:36:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840c5d60 0x7f37841f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37840ca070 0x7f37841f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3760078b90 0x7f376007b0a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 --2- 172.21.15.121:0/1250317542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37840c5950 0x7f37840c9b30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 -- 172.21.15.121:0/1250317542 >> 172.21.15.121:0/1250317542 conn(0x7f37840b1b90 msgr2=0x7f37840b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 -- 172.21.15.121:0/1250317542 shutdown_connections 2024-09-17T03:36:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.183+0000 7f3789e00640 1 -- 172.21.15.121:0/1250317542 wait complete. 2024-09-17T03:36:38.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T03:36:38.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.424+0000 7efde9a00640 1 -- 172.21.15.121:0/978872693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde4156a50 msgr2=0x7efde4074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.424+0000 7efde9a00640 1 --2- 172.21.15.121:0/978872693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde4156a50 0x7efde4074620 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efdd4005fd0 tx=0x7efdd402aa00 comp rx=0 tx=0).stop 2024-09-17T03:36:38.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.424+0000 7efde9a00640 1 -- 172.21.15.121:0/978872693 shutdown_connections 2024-09-17T03:36:38.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.424+0000 7efde9a00640 1 --2- 172.21.15.121:0/978872693 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efde406e500 0x7efde40cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.424+0000 7efde9a00640 1 --2- 172.21.15.121:0/978872693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde4156a50 0x7efde4074620 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.424+0000 7efde9a00640 1 -- 172.21.15.121:0/978872693 >> 172.21.15.121:0/978872693 conn(0x7efde40b1b90 msgr2=0x7efde40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:38.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.424+0000 7efde9a00640 1 -- 172.21.15.121:0/978872693 shutdown_connections 2024-09-17T03:36:38.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.424+0000 7efde9a00640 1 -- 172.21.15.121:0/978872693 wait complete. 2024-09-17T03:36:38.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.427+0000 7efde9a00640 1 Processor -- start 2024-09-17T03:36:38.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.427+0000 7efde9a00640 1 -- start start 2024-09-17T03:36:38.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.428+0000 7efde9a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efde4074b60 0x7efde40ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.428+0000 7efde9a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efde4156a50 0x7efde415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.428+0000 7efde9a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde415f450 0x7efde41f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.428+0000 7efde9a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efde40cf7d0 con 0x7efde415f450 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.428+0000 7efde9a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efde40cf650 con 0x7efde4074b60 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.428+0000 7efde9a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efde40cf950 con 0x7efde4156a50 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.428+0000 7efde3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde415f450 0x7efde41f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.428+0000 7efde3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde415f450 0x7efde41f7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36604/0 (socket says 172.21.15.121:36604) 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.428+0000 7efde3400640 1 -- 172.21.15.121:0/532801460 learned_addr learned my addr 172.21.15.121:0/532801460 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.429+0000 7efde2a00640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efde4074b60 0x7efde40ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.429+0000 7efde2000640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efde4156a50 0x7efde415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.429+0000 7efde3400640 1 -- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efde4156a50 msgr2=0x7efde415ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.429+0000 7efde3400640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efde4156a50 0x7efde415ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.429+0000 7efde3400640 1 -- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efde4074b60 msgr2=0x7efde40ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.429+0000 7efde3400640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efde4074b60 0x7efde40ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.429+0000 7efde3400640 1 -- 172.21.15.121:0/532801460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde41f55f0 con 0x7efde415f450 2024-09-17T03:36:38.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.429+0000 7efde3400640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde415f450 0x7efde41f7a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efddc005d00 tx=0x7efddc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:38.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.429+0000 7efddaa00640 1 -- 172.21.15.121:0/532801460 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc017070 con 0x7efde415f450 2024-09-17T03:36:38.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.429+0000 7efddaa00640 1 -- 172.21.15.121:0/532801460 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efddc005330 con 0x7efde415f450 2024-09-17T03:36:38.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.430+0000 7efddaa00640 1 -- 172.21.15.121:0/532801460 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc0047a0 con 0x7efde415f450 2024-09-17T03:36:38.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.430+0000 7efde9a00640 1 -- 172.21.15.121:0/532801460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde41f58d0 con 0x7efde415f450 2024-09-17T03:36:38.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.430+0000 7efde9a00640 1 -- 172.21.15.121:0/532801460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde41f5e90 con 0x7efde415f450 2024-09-17T03:36:38.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.431+0000 7efde9a00640 1 -- 172.21.15.121:0/532801460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde40cef00 con 0x7efde415f450 2024-09-17T03:36:38.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.432+0000 7efddaa00640 1 -- 172.21.15.121:0/532801460 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efddc004940 con 0x7efde415f450 2024-09-17T03:36:38.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.433+0000 7efddaa00640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdc4078b90 0x7efdc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.433+0000 7efddaa00640 1 -- 172.21.15.121:0/532801460 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7efddc09ac40 con 0x7efde415f450 2024-09-17T03:36:38.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.433+0000 7efde2a00640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdc4078b90 0x7efdc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.434+0000 7efde2a00640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdc4078b90 0x7efdc407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efdd4035000 tx=0x7efdd403b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:38.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.437+0000 7efddaa00640 1 -- 172.21.15.121:0/532801460 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efddc062b50 con 0x7efde415f450 2024-09-17T03:36:38.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.686+0000 7efde9a00640 1 -- 172.21.15.121:0/532801460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7efde41f5380 con 0x7efde415f450 2024-09-17T03:36:38.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.689+0000 7efddaa00640 1 -- 172.21.15.121:0/532801460 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7efddc067580 con 0x7efde415f450 2024-09-17T03:36:38.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 -- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdc4078b90 msgr2=0x7efdc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdc4078b90 0x7efdc407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efdd4035000 tx=0x7efdd403b040 comp rx=0 tx=0).stop 2024-09-17T03:36:38.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 -- 172.21.15.121:0/532801460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde415f450 msgr2=0x7efde41f7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde415f450 0x7efde41f7a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efddc005d00 tx=0x7efddc00dae0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 -- 172.21.15.121:0/532801460 shutdown_connections 2024-09-17T03:36:38.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdc4078b90 0x7efdc407b0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde415f450 0x7efde41f7a00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efde4156a50 0x7efde415ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 --2- 172.21.15.121:0/532801460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efde4074b60 0x7efde40ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 -- 172.21.15.121:0/532801460 >> 172.21.15.121:0/532801460 conn(0x7efde40b1b90 msgr2=0x7efde406d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:38.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 -- 172.21.15.121:0/532801460 shutdown_connections 2024-09-17T03:36:38.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.692+0000 7efde9a00640 1 -- 172.21.15.121:0/532801460 wait complete. 2024-09-17T03:36:38.713 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T03:36:38.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.935+0000 7f3e46e00640 1 -- 172.21.15.121:0/2873762949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e400cf6d0 msgr2=0x7f3e400b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.935+0000 7f3e46e00640 1 --2- 172.21.15.121:0/2873762949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e400cf6d0 0x7f3e400b3110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3e38005fd0 tx=0x7f3e3802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.935+0000 7f3e46e00640 1 -- 172.21.15.121:0/2873762949 shutdown_connections 2024-09-17T03:36:38.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.935+0000 7f3e46e00640 1 --2- 172.21.15.121:0/2873762949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e400cf6d0 0x7f3e400b3110 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.935+0000 7f3e46e00640 1 --2- 172.21.15.121:0/2873762949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e401605f0 0x7f3e400702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.935+0000 7f3e46e00640 1 -- 172.21.15.121:0/2873762949 >> 172.21.15.121:0/2873762949 conn(0x7f3e400d05c0 msgr2=0x7f3e4006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:38.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.935+0000 7f3e46e00640 1 -- 172.21.15.121:0/2873762949 shutdown_connections 2024-09-17T03:36:38.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.935+0000 7f3e46e00640 1 -- 172.21.15.121:0/2873762949 wait complete. 2024-09-17T03:36:38.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.937+0000 7f3e46e00640 1 Processor -- start 2024-09-17T03:36:38.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.937+0000 7f3e46e00640 1 -- start start 2024-09-17T03:36:38.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.939+0000 7f3e46e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cc0e0 0x7f3e401f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.939+0000 7f3e46e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e400cf6d0 0x7f3e401f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.939+0000 7f3e46e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e401e7e80 0x7f3e401e8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.939+0000 7f3e46e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3e400b3c30 con 0x7f3e401e7e80 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.939+0000 7f3e46e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e400b3ab0 con 0x7f3e400cf6d0 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.939+0000 7f3e46e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e400b3db0 con 0x7f3e400cc0e0 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.939+0000 7f3e46400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e401e7e80 0x7f3e401e8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.939+0000 7f3e46400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e401e7e80 0x7f3e401e8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36630/0 (socket says 172.21.15.121:36630) 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.939+0000 7f3e46400640 1 -- 172.21.15.121:0/1555804389 learned_addr learned my addr 172.21.15.121:0/1555804389 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e45000640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e400cf6d0 0x7f3e401f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e45a00640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cc0e0 0x7f3e401f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e46400640 1 -- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cc0e0 msgr2=0x7f3e401f6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e46400640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cc0e0 0x7f3e401f6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e46400640 1 -- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e400cf6d0 msgr2=0x7f3e401f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e46400640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e400cf6d0 0x7f3e401f2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e46400640 1 -- 172.21.15.121:0/1555804389 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e401e87d0 con 0x7f3e401e7e80 2024-09-17T03:36:38.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e45000640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e400cf6d0 0x7f3e401f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:38.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e45a00640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cc0e0 0x7f3e401f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:38.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e46400640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e401e7e80 0x7f3e401e8290 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009cd0 tx=0x7f3e380316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:38.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e3d600640 1 -- 172.21.15.121:0/1555804389 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38031da0 con 0x7f3e401e7e80 2024-09-17T03:36:38.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e3d600640 1 -- 172.21.15.121:0/1555804389 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e38003a60 con 0x7f3e401e7e80 2024-09-17T03:36:38.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e46e00640 1 -- 172.21.15.121:0/1555804389 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e401f7210 con 0x7f3e401e7e80 2024-09-17T03:36:38.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e3d600640 1 -- 172.21.15.121:0/1555804389 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e380330d0 con 0x7f3e401e7e80 2024-09-17T03:36:38.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.940+0000 7f3e46e00640 1 -- 172.21.15.121:0/1555804389 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e40140310 con 0x7f3e401e7e80 2024-09-17T03:36:38.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.942+0000 7f3e46e00640 1 -- 172.21.15.121:0/1555804389 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e400b4260 con 0x7f3e401e7e80 2024-09-17T03:36:38.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.943+0000 7f3e3d600640 1 -- 172.21.15.121:0/1555804389 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e38033270 con 0x7f3e401e7e80 2024-09-17T03:36:38.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.944+0000 7f3e3d600640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3e20078b90 0x7f3e2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.944+0000 7f3e3d600640 1 -- 172.21.15.121:0/1555804389 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f3e380bc140 con 0x7f3e401e7e80 2024-09-17T03:36:38.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.944+0000 7f3e45a00640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3e20078b90 0x7f3e2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.945+0000 7f3e45a00640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3e20078b90 0x7f3e2007b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e34001220 tx=0x7f3e34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:38.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:38.948+0000 7f3e3d600640 1 -- 172.21.15.121:0/1555804389 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3e401e87d0 con 0x7f3e401e7e80 2024-09-17T03:36:39.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.201+0000 7f3e46e00640 1 -- 172.21.15.121:0/1555804389 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f3e40145850 con 0x7f3e401e7e80 2024-09-17T03:36:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.204+0000 7f3e3d600640 1 -- 172.21.15.121:0/1555804389 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f3e3803f030 con 0x7f3e401e7e80 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.206+0000 7f3e46e00640 1 -- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3e20078b90 msgr2=0x7f3e2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.206+0000 7f3e46e00640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3e20078b90 0x7f3e2007b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e34001220 tx=0x7f3e34009040 comp rx=0 tx=0).stop 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.207+0000 7f3e46e00640 1 -- 172.21.15.121:0/1555804389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e401e7e80 msgr2=0x7f3e401e8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.207+0000 7f3e46e00640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e401e7e80 0x7f3e401e8290 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009cd0 tx=0x7f3e380316f0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.207+0000 7f3e46e00640 1 -- 172.21.15.121:0/1555804389 shutdown_connections 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.207+0000 7f3e46e00640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3e20078b90 0x7f3e2007b0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.207+0000 7f3e46e00640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e401e7e80 0x7f3e401e8290 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.207+0000 7f3e46e00640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e400cf6d0 0x7f3e401f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.207+0000 7f3e46e00640 1 --2- 172.21.15.121:0/1555804389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e400cc0e0 0x7f3e401f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.207+0000 7f3e46e00640 1 -- 172.21.15.121:0/1555804389 >> 172.21.15.121:0/1555804389 conn(0x7f3e400d05c0 msgr2=0x7f3e4006f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.207+0000 7f3e46e00640 1 -- 172.21.15.121:0/1555804389 shutdown_connections 2024-09-17T03:36:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.207+0000 7f3e46e00640 1 -- 172.21.15.121:0/1555804389 wait complete. 2024-09-17T03:36:39.228 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T03:36:39.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.450+0000 7f8660200640 1 -- 172.21.15.121:0/1519107863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f865806ddf0 msgr2=0x7f865806e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:39.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.450+0000 7f8660200640 1 --2- 172.21.15.121:0/1519107863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f865806ddf0 0x7f865806e200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8644005fd0 tx=0x7f864402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.450+0000 7f8660200640 1 -- 172.21.15.121:0/1519107863 shutdown_connections 2024-09-17T03:36:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.450+0000 7f8660200640 1 --2- 172.21.15.121:0/1519107863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f86580cef00 0x7f86580cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.450+0000 7f8660200640 1 --2- 172.21.15.121:0/1519107863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f865806ddf0 0x7f865806e200 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.450+0000 7f8660200640 1 -- 172.21.15.121:0/1519107863 >> 172.21.15.121:0/1519107863 conn(0x7f86580b1b90 msgr2=0x7f86580b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.450+0000 7f8660200640 1 -- 172.21.15.121:0/1519107863 shutdown_connections 2024-09-17T03:36:39.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.450+0000 7f8660200640 1 -- 172.21.15.121:0/1519107863 wait complete. 2024-09-17T03:36:39.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.453+0000 7f8660200640 1 Processor -- start 2024-09-17T03:36:39.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.453+0000 7f8660200640 1 -- start start 2024-09-17T03:36:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.454+0000 7f8660200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865806ddf0 0x7f86581f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.454+0000 7f8660200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86580cef00 0x7f86580cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.454+0000 7f8660200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8658156a50 0x7f8658157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.454+0000 7f8660200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f86580cf850 con 0x7f8658156a50 2024-09-17T03:36:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.454+0000 7f8660200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8658161060 con 0x7f86580cef00 2024-09-17T03:36:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.454+0000 7f8660200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f86580cf9d0 con 0x7f865806ddf0 2024-09-17T03:36:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.454+0000 7f865e200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8658156a50 0x7f8658157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.454+0000 7f865e200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8658156a50 0x7f8658157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36652/0 (socket says 172.21.15.121:36652) 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f865e200640 1 -- 172.21.15.121:0/9250141 learned_addr learned my addr 172.21.15.121:0/9250141 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f865ce00640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86580cef00 0x7f86580cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f865d800640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865806ddf0 0x7f86581f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f865e200640 1 -- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865806ddf0 msgr2=0x7f86581f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f865e200640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865806ddf0 0x7f86581f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f865e200640 1 -- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86580cef00 msgr2=0x7f86580cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f865e200640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86580cef00 0x7f86580cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f865e200640 1 -- 172.21.15.121:0/9250141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8658157440 con 0x7f8658156a50 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f865d800640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865806ddf0 0x7f86581f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f865e200640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8658156a50 0x7f8658157bc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f865000cad0 tx=0x7f865000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f8655600640 1 -- 172.21.15.121:0/9250141 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865000ae20 con 0x7f8658156a50 2024-09-17T03:36:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.455+0000 7f8655600640 1 -- 172.21.15.121:0/9250141 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f865000f540 con 0x7f8658156a50 2024-09-17T03:36:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.456+0000 7f8655600640 1 -- 172.21.15.121:0/9250141 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865000f990 con 0x7f8658156a50 2024-09-17T03:36:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.456+0000 7f8660200640 1 -- 172.21.15.121:0/9250141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8658157720 con 0x7f8658156a50 2024-09-17T03:36:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.456+0000 7f8660200640 1 -- 172.21.15.121:0/9250141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86580b4200 con 0x7f8658156a50 2024-09-17T03:36:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.457+0000 7f8660200640 1 -- 172.21.15.121:0/9250141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86581571b0 con 0x7f8658156a50 2024-09-17T03:36:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.458+0000 7f8655600640 1 -- 172.21.15.121:0/9250141 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f865000fb30 con 0x7f8658156a50 2024-09-17T03:36:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.459+0000 7f8655600640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8638078bc0 0x7f863807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.459+0000 7f8655600640 1 -- 172.21.15.121:0/9250141 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f865009b580 con 0x7f8658156a50 2024-09-17T03:36:39.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.459+0000 7f865d800640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8638078bc0 0x7f863807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:39.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.460+0000 7f865d800640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8638078bc0 0x7f863807b0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f864c000f60 tx=0x7f864c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:39.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.463+0000 7f8655600640 1 -- 172.21.15.121:0/9250141 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8650014030 con 0x7f8658156a50 2024-09-17T03:36:39.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.717+0000 7f8660200640 1 -- 172.21.15.121:0/9250141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f8658072e30 con 0x7f8658156a50 2024-09-17T03:36:39.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.720+0000 7f8655600640 1 -- 172.21.15.121:0/9250141 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f865000fe20 con 0x7f8658156a50 2024-09-17T03:36:39.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 -- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8638078bc0 msgr2=0x7f863807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8638078bc0 0x7f863807b0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f864c000f60 tx=0x7f864c009040 comp rx=0 tx=0).stop 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 -- 172.21.15.121:0/9250141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8658156a50 msgr2=0x7f8658157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8658156a50 0x7f8658157bc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f865000cad0 tx=0x7f865000cf90 comp rx=0 tx=0).stop 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 -- 172.21.15.121:0/9250141 shutdown_connections 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8638078bc0 0x7f863807b0d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8658156a50 0x7f8658157bc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f86580cef00 0x7f86580cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 --2- 172.21.15.121:0/9250141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f865806ddf0 0x7f86581f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 -- 172.21.15.121:0/9250141 >> 172.21.15.121:0/9250141 conn(0x7f86580b1b90 msgr2=0x7f86580b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 -- 172.21.15.121:0/9250141 shutdown_connections 2024-09-17T03:36:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.723+0000 7f8660200640 1 -- 172.21.15.121:0/9250141 wait complete. 2024-09-17T03:36:39.747 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T03:36:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.969+0000 7f9f27e00640 1 -- 172.21.15.121:0/2155586680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f280d00e0 msgr2=0x7f9f280ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.969+0000 7f9f27e00640 1 --2- 172.21.15.121:0/2155586680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f280d00e0 0x7f9f280ce3d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9f280cd170 tx=0x7f9f1802a560 comp rx=0 tx=0).stop 2024-09-17T03:36:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.969+0000 7f9f27e00640 1 -- 172.21.15.121:0/2155586680 shutdown_connections 2024-09-17T03:36:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.969+0000 7f9f27e00640 1 --2- 172.21.15.121:0/2155586680 >> v2:172.21.15.176:3300/0 conn(0x7f9f28073b10 0x7f9f28073f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.969+0000 7f9f27e00640 1 --2- 172.21.15.121:0/2155586680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f280d00e0 0x7f9f280ce3d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.969+0000 7f9f27e00640 1 -- 172.21.15.121:0/2155586680 >> 172.21.15.121:0/2155586680 conn(0x7f9f280d1190 msgr2=0x7f9f28073400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.969+0000 7f9f27e00640 1 -- 172.21.15.121:0/2155586680 shutdown_connections 2024-09-17T03:36:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.969+0000 7f9f27e00640 1 -- 172.21.15.121:0/2155586680 wait complete. 2024-09-17T03:36:39.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.971+0000 7f9f27e00640 1 Processor -- start 2024-09-17T03:36:39.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.971+0000 7f9f27e00640 1 -- start start 2024-09-17T03:36:39.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f27e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f28073b10 0x7f9f280abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:39.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f27e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f280b4a10 0x7f9f28147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f27e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f280d00e0 0x7f9f281f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f27e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9f28070ad0 con 0x7f9f280b4a10 2024-09-17T03:36:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f27e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f28070950 con 0x7f9f280d00e0 2024-09-17T03:36:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f27e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f28070c50 con 0x7f9f28073b10 2024-09-17T03:36:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f1e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f280b4a10 0x7f9f28147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f1e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f280b4a10 0x7f9f28147b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36678/0 (socket says 172.21.15.121:36678) 2024-09-17T03:36:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f1e000640 1 -- 172.21.15.121:0/654271191 learned_addr learned my addr 172.21.15.121:0/654271191 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f26a00640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f28073b10 0x7f9f280abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.973+0000 7f9f27400640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f280d00e0 0x7f9f281f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:39.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f1e000640 1 -- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f28073b10 msgr2=0x7f9f280abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f1e000640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f28073b10 0x7f9f280abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f1e000640 1 -- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f280d00e0 msgr2=0x7f9f281f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f1e000640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f280d00e0 0x7f9f281f6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f1e000640 1 -- 172.21.15.121:0/654271191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f281f3330 con 0x7f9f280b4a10 2024-09-17T03:36:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f1e000640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f280b4a10 0x7f9f28147b00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000eb60 tx=0x7f9f1000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f1fe00640 1 -- 172.21.15.121:0/654271191 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10010630 con 0x7f9f280b4a10 2024-09-17T03:36:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f1fe00640 1 -- 172.21.15.121:0/654271191 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f100108c0 con 0x7f9f280b4a10 2024-09-17T03:36:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f1fe00640 1 -- 172.21.15.121:0/654271191 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10010d10 con 0x7f9f280b4a10 2024-09-17T03:36:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f27e00640 1 -- 172.21.15.121:0/654271191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f281f3610 con 0x7f9f280b4a10 2024-09-17T03:36:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.974+0000 7f9f27e00640 1 -- 172.21.15.121:0/654271191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f281f3bd0 con 0x7f9f280b4a10 2024-09-17T03:36:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.975+0000 7f9f27e00640 1 -- 172.21.15.121:0/654271191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f280b5800 con 0x7f9f280b4a10 2024-09-17T03:36:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.976+0000 7f9f1fe00640 1 -- 172.21.15.121:0/654271191 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f10018420 con 0x7f9f280b4a10 2024-09-17T03:36:39.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.978+0000 7f9f1fe00640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9f04078b90 0x7f9f0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:39.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.978+0000 7f9f1fe00640 1 -- 172.21.15.121:0/654271191 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f9f1009b8b0 con 0x7f9f280b4a10 2024-09-17T03:36:39.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.978+0000 7f9f26a00640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9f04078b90 0x7f9f0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:39.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.979+0000 7f9f26a00640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9f04078b90 0x7f9f0407b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9f18033000 tx=0x7f9f18004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:39.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:39.982+0000 7f9f1fe00640 1 -- 172.21.15.121:0/654271191 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9f1000ee60 con 0x7f9f280b4a10 2024-09-17T03:36:40.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.236+0000 7f9f27e00640 1 -- 172.21.15.121:0/654271191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f9f280735a0 con 0x7f9f280b4a10 2024-09-17T03:36:40.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.238+0000 7f9f1fe00640 1 -- 172.21.15.121:0/654271191 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v8) ==== 97+0+0 (secure 0 0 0) 0x7f9f10063850 con 0x7f9f280b4a10 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 -- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9f04078b90 msgr2=0x7f9f0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9f04078b90 0x7f9f0407b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9f18033000 tx=0x7f9f18004730 comp rx=0 tx=0).stop 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 -- 172.21.15.121:0/654271191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f280b4a10 msgr2=0x7f9f28147b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f280b4a10 0x7f9f28147b00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000eb60 tx=0x7f9f1000c6a0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 -- 172.21.15.121:0/654271191 shutdown_connections 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f280d00e0 0x7f9f281f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9f04078b90 0x7f9f0407b0a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f280b4a10 0x7f9f28147b00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 --2- 172.21.15.121:0/654271191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f28073b10 0x7f9f280abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 -- 172.21.15.121:0/654271191 >> 172.21.15.121:0/654271191 conn(0x7f9f280d1190 msgr2=0x7f9f2815db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:40.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 -- 172.21.15.121:0/654271191 shutdown_connections 2024-09-17T03:36:40.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.241+0000 7f9f27e00640 1 -- 172.21.15.121:0/654271191 wait complete. 2024-09-17T03:36:40.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T03:36:40.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.485+0000 7fdd10000640 1 -- 172.21.15.121:0/930157977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd08074b60 msgr2=0x7fdd0806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:40.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.485+0000 7fdd10000640 1 --2- 172.21.15.121:0/930157977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd08074b60 0x7fdd0806ddf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4005fd0 tx=0x7fdcf402a530 comp rx=0 tx=0).stop 2024-09-17T03:36:40.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.485+0000 7fdd10000640 1 -- 172.21.15.121:0/930157977 shutdown_connections 2024-09-17T03:36:40.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.485+0000 7fdd10000640 1 --2- 172.21.15.121:0/930157977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd08074b60 0x7fdd0806ddf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.485+0000 7fdd10000640 1 --2- 172.21.15.121:0/930157977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd08156a50 0x7fdd08074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.485+0000 7fdd10000640 1 -- 172.21.15.121:0/930157977 >> 172.21.15.121:0/930157977 conn(0x7fdd080b1b90 msgr2=0x7fdd080b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:40.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.485+0000 7fdd10000640 1 -- 172.21.15.121:0/930157977 shutdown_connections 2024-09-17T03:36:40.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.485+0000 7fdd10000640 1 -- 172.21.15.121:0/930157977 wait complete. 2024-09-17T03:36:40.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.488+0000 7fdd10000640 1 Processor -- start 2024-09-17T03:36:40.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.488+0000 7fdd10000640 1 -- start start 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.489+0000 7fdd10000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd0806e330 0x7fdd080b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.489+0000 7fdd10000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd08074b60 0x7fdd080c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.489+0000 7fdd10000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd08156a50 0x7fdd080cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.489+0000 7fdd10000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd080ce500 con 0x7fdd08156a50 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.489+0000 7fdd10000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd080ce380 con 0x7fdd0806e330 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.489+0000 7fdd10000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd080ce680 con 0x7fdd08074b60 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.489+0000 7fdd0e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd08156a50 0x7fdd080cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.489+0000 7fdd0e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd08156a50 0x7fdd080cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36698/0 (socket says 172.21.15.121:36698) 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.489+0000 7fdd0e000640 1 -- 172.21.15.121:0/2845181329 learned_addr learned my addr 172.21.15.121:0/2845181329 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.490+0000 7fdd0cc00640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd08074b60 0x7fdd080c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.490+0000 7fdd0d600640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd0806e330 0x7fdd080b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:40.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.490+0000 7fdd0e000640 1 -- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd08074b60 msgr2=0x7fdd080c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:40.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.490+0000 7fdd0e000640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd08074b60 0x7fdd080c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.490+0000 7fdd0e000640 1 -- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd0806e330 msgr2=0x7fdd080b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:40.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.490+0000 7fdd0e000640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd0806e330 0x7fdd080b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.490+0000 7fdd0e000640 1 -- 172.21.15.121:0/2845181329 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd080b4590 con 0x7fdd08156a50 2024-09-17T03:36:40.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.490+0000 7fdd0e000640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd08156a50 0x7fdd080cb420 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000b970 tx=0x7fdd0000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:40.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.490+0000 7fdd05600640 1 -- 172.21.15.121:0/2845181329 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd00019070 con 0x7fdd08156a50 2024-09-17T03:36:40.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.490+0000 7fdd05600640 1 -- 172.21.15.121:0/2845181329 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd0000cc30 con 0x7fdd08156a50 2024-09-17T03:36:40.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.491+0000 7fdd10000640 1 -- 172.21.15.121:0/2845181329 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd080ca940 con 0x7fdd08156a50 2024-09-17T03:36:40.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.491+0000 7fdd05600640 1 -- 172.21.15.121:0/2845181329 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd000146a0 con 0x7fdd08156a50 2024-09-17T03:36:40.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.491+0000 7fdd10000640 1 -- 172.21.15.121:0/2845181329 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd080cac20 con 0x7fdd08156a50 2024-09-17T03:36:40.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.492+0000 7fdd10000640 1 -- 172.21.15.121:0/2845181329 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd0806ddf0 con 0x7fdd08156a50 2024-09-17T03:36:40.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.493+0000 7fdd05600640 1 -- 172.21.15.121:0/2845181329 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd0001c070 con 0x7fdd08156a50 2024-09-17T03:36:40.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.494+0000 7fdd05600640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdce8078b90 0x7fdce807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:40.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.494+0000 7fdd05600640 1 -- 172.21.15.121:0/2845181329 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fdd0009a730 con 0x7fdd08156a50 2024-09-17T03:36:40.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.494+0000 7fdd0d600640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdce8078b90 0x7fdce807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:40.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.495+0000 7fdd0d600640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdce8078b90 0x7fdce807b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0098e0 tx=0x7fdcfc009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:40.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.498+0000 7fdd05600640 1 -- 172.21.15.121:0/2845181329 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd00062800 con 0x7fdd08156a50 2024-09-17T03:36:40.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.747+0000 7fdd10000640 1 -- 172.21.15.121:0/2845181329 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fdd080b1620 con 0x7fdd08156a50 2024-09-17T03:36:40.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.750+0000 7fdd05600640 1 -- 172.21.15.121:0/2845181329 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fdd00067230 con 0x7fdd08156a50 2024-09-17T03:36:40.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 -- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdce8078b90 msgr2=0x7fdce807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:40.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdce8078b90 0x7fdce807b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0098e0 tx=0x7fdcfc009060 comp rx=0 tx=0).stop 2024-09-17T03:36:40.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 -- 172.21.15.121:0/2845181329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd08156a50 msgr2=0x7fdd080cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:40.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd08156a50 0x7fdd080cb420 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000b970 tx=0x7fdd0000be30 comp rx=0 tx=0).stop 2024-09-17T03:36:40.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 -- 172.21.15.121:0/2845181329 shutdown_connections 2024-09-17T03:36:40.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdce8078b90 0x7fdce807b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd08156a50 0x7fdd080cb420 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd08074b60 0x7fdd080c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 --2- 172.21.15.121:0/2845181329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd0806e330 0x7fdd080b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 -- 172.21.15.121:0/2845181329 >> 172.21.15.121:0/2845181329 conn(0x7fdd080b1b90 msgr2=0x7fdd080afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:40.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 -- 172.21.15.121:0/2845181329 shutdown_connections 2024-09-17T03:36:40.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.753+0000 7fdd10000640 1 -- 172.21.15.121:0/2845181329 wait complete. 2024-09-17T03:36:40.774 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:36:40.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.994+0000 7fb299200640 1 -- 172.21.15.121:0/3831565727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2940b9e40 msgr2=0x7fb2941622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:40.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.994+0000 7fb299200640 1 --2- 172.21.15.121:0/3831565727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2940b9e40 0x7fb2941622b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb284009830 tx=0x7fb28402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.994+0000 7fb299200640 1 -- 172.21.15.121:0/3831565727 shutdown_connections 2024-09-17T03:36:40.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.994+0000 7fb299200640 1 --2- 172.21.15.121:0/3831565727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2940b9e40 0x7fb2941622b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:40.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.994+0000 7fb299200640 1 -- 172.21.15.121:0/3831565727 >> 172.21.15.121:0/3831565727 conn(0x7fb2940d1930 msgr2=0x7fb2940d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:40.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.994+0000 7fb299200640 1 -- 172.21.15.121:0/3831565727 shutdown_connections 2024-09-17T03:36:40.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.994+0000 7fb299200640 1 -- 172.21.15.121:0/3831565727 wait complete. 2024-09-17T03:36:40.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.996+0000 7fb299200640 1 Processor -- start 2024-09-17T03:36:40.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.996+0000 7fb299200640 1 -- start start 2024-09-17T03:36:41.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb299200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29406d9c0 0x7fb2940c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:41.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb299200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2940b9e40 0x7fb2940c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:41.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb299200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2941627f0 0x7fb294153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:41.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb299200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2941555b0 con 0x7fb2941627f0 2024-09-17T03:36:41.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb299200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2940d37e0 con 0x7fb29406d9c0 2024-09-17T03:36:41.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb299200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb294155730 con 0x7fb2940b9e40 2024-09-17T03:36:41.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb293e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2941627f0 0x7fb294153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:41.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb293e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2941627f0 0x7fb294153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36722/0 (socket says 172.21.15.121:36722) 2024-09-17T03:36:41.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb293e00640 1 -- 172.21.15.121:0/2889291504 learned_addr learned my addr 172.21.15.121:0/2889291504 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:41.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb293400640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29406d9c0 0x7fb2940c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:41.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb28aa00640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2940b9e40 0x7fb2940c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:41.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb293e00640 1 -- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2940b9e40 msgr2=0x7fb2940c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:41.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb293e00640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2940b9e40 0x7fb2940c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb293e00640 1 -- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29406d9c0 msgr2=0x7fb2940c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:41.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb293e00640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29406d9c0 0x7fb2940c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb293e00640 1 -- 172.21.15.121:0/2889291504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2940ca210 con 0x7fb2941627f0 2024-09-17T03:36:41.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.998+0000 7fb293400640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29406d9c0 0x7fb2940c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:41.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.999+0000 7fb293e00640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2941627f0 0x7fb294153850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb28c00cb10 tx=0x7fb28c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:41.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.999+0000 7fb28be00640 1 -- 172.21.15.121:0/2889291504 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c016020 con 0x7fb2941627f0 2024-09-17T03:36:41.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.999+0000 7fb28be00640 1 -- 172.21.15.121:0/2889291504 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb28c00ad00 con 0x7fb2941627f0 2024-09-17T03:36:41.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.999+0000 7fb28be00640 1 -- 172.21.15.121:0/2889291504 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c012680 con 0x7fb2941627f0 2024-09-17T03:36:41.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.999+0000 7fb299200640 1 -- 172.21.15.121:0/2889291504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb294155d40 con 0x7fb2941627f0 2024-09-17T03:36:41.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:40.999+0000 7fb299200640 1 -- 172.21.15.121:0/2889291504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb294155fe0 con 0x7fb2941627f0 2024-09-17T03:36:41.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.000+0000 7fb299200640 1 -- 172.21.15.121:0/2889291504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2941622b0 con 0x7fb2941627f0 2024-09-17T03:36:41.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.002+0000 7fb28be00640 1 -- 172.21.15.121:0/2889291504 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb28c019020 con 0x7fb2941627f0 2024-09-17T03:36:41.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.003+0000 7fb28be00640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb270078b90 0x7fb27007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:41.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.003+0000 7fb28be00640 1 -- 172.21.15.121:0/2889291504 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fb28c09b200 con 0x7fb2941627f0 2024-09-17T03:36:41.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.003+0000 7fb293400640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb270078b90 0x7fb27007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:41.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.004+0000 7fb293400640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb270078b90 0x7fb27007b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb284034000 tx=0x7fb284004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:41.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.008+0000 7fb28be00640 1 -- 172.21.15.121:0/2889291504 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb28c020020 con 0x7fb2941627f0 2024-09-17T03:36:41.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.192+0000 7fb299200640 1 -- 172.21.15.121:0/2889291504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb2940b9570 con 0x7fb2941627f0 2024-09-17T03:36:41.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.193+0000 7fb28be00640 1 -- 172.21.15.121:0/2889291504 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+65 (secure 0 0 0) 0x7fb294155d40 con 0x7fb2941627f0 2024-09-17T03:36:41.193 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:41.193 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-17T03:36:41.193 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:36:41.193 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-17T03:36:41.193 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-17T03:36:41.193 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:36:41.193 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-17T03:36:41.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.195+0000 7fb299200640 1 -- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb270078b90 msgr2=0x7fb27007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:41.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.195+0000 7fb299200640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb270078b90 0x7fb27007b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb284034000 tx=0x7fb284004730 comp rx=0 tx=0).stop 2024-09-17T03:36:41.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.195+0000 7fb299200640 1 -- 172.21.15.121:0/2889291504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2941627f0 msgr2=0x7fb294153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:41.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.195+0000 7fb299200640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2941627f0 0x7fb294153850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb28c00cb10 tx=0x7fb28c00a060 comp rx=0 tx=0).stop 2024-09-17T03:36:41.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.195+0000 7fb299200640 1 -- 172.21.15.121:0/2889291504 shutdown_connections 2024-09-17T03:36:41.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.195+0000 7fb299200640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb270078b90 0x7fb27007b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.195+0000 7fb299200640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2941627f0 0x7fb294153850 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.195+0000 7fb299200640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2940b9e40 0x7fb2940c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.195+0000 7fb299200640 1 --2- 172.21.15.121:0/2889291504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb29406d9c0 0x7fb2940c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.195+0000 7fb299200640 1 -- 172.21.15.121:0/2889291504 >> 172.21.15.121:0/2889291504 conn(0x7fb2940d1930 msgr2=0x7fb2940ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:41.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.196+0000 7fb299200640 1 -- 172.21.15.121:0/2889291504 shutdown_connections 2024-09-17T03:36:41.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.196+0000 7fb299200640 1 -- 172.21.15.121:0/2889291504 wait complete. 2024-09-17T03:36:41.219 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:36:41.219 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:36:41.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.443+0000 7f408de00640 1 -- 172.21.15.121:0/1128070459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40880ced00 msgr2=0x7f40880b76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:41.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.443+0000 7f408de00640 1 --2- 172.21.15.121:0/1128070459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40880ced00 0x7f40880b76d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40880d2760 tx=0x7f407802a560 comp rx=0 tx=0).stop 2024-09-17T03:36:41.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.444+0000 7f408de00640 1 -- 172.21.15.121:0/1128070459 shutdown_connections 2024-09-17T03:36:41.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.444+0000 7f408de00640 1 --2- 172.21.15.121:0/1128070459 >> v2:172.21.15.176:3300/0 conn(0x7f40880b5370 0x7f40880d2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.444+0000 7f408de00640 1 --2- 172.21.15.121:0/1128070459 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880b4a20 0x7f40880b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.444+0000 7f408de00640 1 --2- 172.21.15.121:0/1128070459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40880ced00 0x7f40880b76d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.444+0000 7f408de00640 1 -- 172.21.15.121:0/1128070459 >> 172.21.15.121:0/1128070459 conn(0x7f40880d18c0 msgr2=0x7f40880d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:41.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.444+0000 7f408de00640 1 -- 172.21.15.121:0/1128070459 shutdown_connections 2024-09-17T03:36:41.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.444+0000 7f408de00640 1 -- 172.21.15.121:0/1128070459 wait complete. 2024-09-17T03:36:41.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.446+0000 7f408de00640 1 Processor -- start 2024-09-17T03:36:41.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.446+0000 7f408de00640 1 -- start start 2024-09-17T03:36:41.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.447+0000 7f408de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40880b4a20 0x7f4088160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:41.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.447+0000 7f408de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880b5370 0x7f4088160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:41.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.447+0000 7f408de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40880ced00 0x7f40881612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.447+0000 7f408de00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f40880d31f0 con 0x7f40880ced00 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.447+0000 7f408de00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f40880b3420 con 0x7f40880b4a20 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.447+0000 7f408de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f40880d3370 con 0x7f40880b5370 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f408d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40880ced00 0x7f40881612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f408d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40880ced00 0x7f40881612d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36740/0 (socket says 172.21.15.121:36740) 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f408d400640 1 -- 172.21.15.121:0/209942497 learned_addr learned my addr 172.21.15.121:0/209942497 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f408ca00640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40880b4a20 0x7f4088160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f407fe00640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880b5370 0x7f4088160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f408d400640 1 -- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880b5370 msgr2=0x7f4088160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f408d400640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880b5370 0x7f4088160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f408d400640 1 -- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40880b4a20 msgr2=0x7f4088160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f408d400640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40880b4a20 0x7f4088160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f408d400640 1 -- 172.21.15.121:0/209942497 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4088151d80 con 0x7f40880ced00 2024-09-17T03:36:41.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.448+0000 7f408d400640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40880ced00 0x7f40881612d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f408000e960 tx=0x7f408000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:41.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.449+0000 7f4085600640 1 -- 172.21.15.121:0/209942497 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080004d20 con 0x7f40880ced00 2024-09-17T03:36:41.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.449+0000 7f4085600640 1 -- 172.21.15.121:0/209942497 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f408000cb20 con 0x7f40880ced00 2024-09-17T03:36:41.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.449+0000 7f408de00640 1 -- 172.21.15.121:0/209942497 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4088160090 con 0x7f40880ced00 2024-09-17T03:36:41.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.449+0000 7f4085600640 1 -- 172.21.15.121:0/209942497 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080005020 con 0x7f40880ced00 2024-09-17T03:36:41.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.449+0000 7f408de00640 1 -- 172.21.15.121:0/209942497 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40881555a0 con 0x7f40880ced00 2024-09-17T03:36:41.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.450+0000 7f408de00640 1 -- 172.21.15.121:0/209942497 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40881f69b0 con 0x7f40880ced00 2024-09-17T03:36:41.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.451+0000 7f4085600640 1 -- 172.21.15.121:0/209942497 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40800051c0 con 0x7f40880ced00 2024-09-17T03:36:41.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.452+0000 7f4085600640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4064078b90 0x7f406407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:41.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.453+0000 7f4085600640 1 -- 172.21.15.121:0/209942497 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f408009b400 con 0x7f40880ced00 2024-09-17T03:36:41.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.453+0000 7f408ca00640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4064078b90 0x7f406407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:41.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.454+0000 7f408ca00640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4064078b90 0x7f406407b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4078033000 tx=0x7f4078004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:41.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.457+0000 7f4085600640 1 -- 172.21.15.121:0/209942497 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4088151d80 con 0x7f40880ced00 2024-09-17T03:36:41.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:41.639+0000 7f408de00640 1 -- 172.21.15.121:0/209942497 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4088152840 con 0x7f40880ced00 2024-09-17T03:36:42.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.215+0000 7f4085600640 1 -- 172.21.15.121:0/209942497 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) ==== 138+0+0 (secure 0 0 0) 0x7f4080016030 con 0x7f40880ced00 2024-09-17T03:36:42.215 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-17T03:36:42.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.217+0000 7f408de00640 1 -- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4064078b90 msgr2=0x7f406407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:42.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.217+0000 7f408de00640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4064078b90 0x7f406407b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4078033000 tx=0x7f4078004730 comp rx=0 tx=0).stop 2024-09-17T03:36:42.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.217+0000 7f408de00640 1 -- 172.21.15.121:0/209942497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40880ced00 msgr2=0x7f40881612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:42.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.217+0000 7f408de00640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40880ced00 0x7f40881612d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f408000e960 tx=0x7f408000ee20 comp rx=0 tx=0).stop 2024-09-17T03:36:42.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.217+0000 7f408de00640 1 -- 172.21.15.121:0/209942497 shutdown_connections 2024-09-17T03:36:42.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.217+0000 7f408de00640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4064078b90 0x7f406407b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:42.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.217+0000 7f408de00640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40880ced00 0x7f40881612d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:42.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.217+0000 7f408de00640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40880b5370 0x7f4088160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:42.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.217+0000 7f408de00640 1 --2- 172.21.15.121:0/209942497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40880b4a20 0x7f4088160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:42.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.217+0000 7f408de00640 1 -- 172.21.15.121:0/209942497 >> 172.21.15.121:0/209942497 conn(0x7f40880d18c0 msgr2=0x7f4088158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:42.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.218+0000 7f408de00640 1 -- 172.21.15.121:0/209942497 shutdown_connections 2024-09-17T03:36:42.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.218+0000 7f408de00640 1 -- 172.21.15.121:0/209942497 wait complete. 2024-09-17T03:36:42.244 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:36:42.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.472+0000 7f658de00640 1 -- 172.21.15.121:0/2502580951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6588073dd0 msgr2=0x7f658806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:42.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.472+0000 7f658de00640 1 --2- 172.21.15.121:0/2502580951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6588073dd0 0x7f658806ddf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6570009830 tx=0x7f657002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:36:42.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.472+0000 7f658de00640 1 -- 172.21.15.121:0/2502580951 shutdown_connections 2024-09-17T03:36:42.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.472+0000 7f658de00640 1 --2- 172.21.15.121:0/2502580951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6588073dd0 0x7f658806ddf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:42.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.472+0000 7f658de00640 1 -- 172.21.15.121:0/2502580951 >> 172.21.15.121:0/2502580951 conn(0x7f65880cca40 msgr2=0x7f65880cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:42.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.472+0000 7f658de00640 1 -- 172.21.15.121:0/2502580951 shutdown_connections 2024-09-17T03:36:42.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.472+0000 7f658de00640 1 -- 172.21.15.121:0/2502580951 wait complete. 2024-09-17T03:36:42.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.474+0000 7f658de00640 1 Processor -- start 2024-09-17T03:36:42.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.475+0000 7f658de00640 1 -- start start 2024-09-17T03:36:42.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.476+0000 7f658de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f658806e330 0x7f65881e8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:42.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.476+0000 7f658de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6588073dd0 0x7f65881571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.476+0000 7f658de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6588074cb0 0x7f65880b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.476+0000 7f658de00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f658806f670 con 0x7f658806e330 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.476+0000 7f658de00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f658806f4f0 con 0x7f6588073dd0 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.476+0000 7f658de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f658806f7f0 con 0x7f6588074cb0 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.476+0000 7f6586a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f658806e330 0x7f65881e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.476+0000 7f6586a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f658806e330 0x7f65881e8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46034/0 (socket says 172.21.15.121:46034) 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.476+0000 7f6586a00640 1 -- 172.21.15.121:0/2670298085 learned_addr learned my addr 172.21.15.121:0/2670298085 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.476+0000 7f657e000640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6588073dd0 0x7f65881571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f6587400640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6588074cb0 0x7f65880b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f6586a00640 1 -- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6588074cb0 msgr2=0x7f65880b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f6586a00640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6588074cb0 0x7f65880b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:42.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f6586a00640 1 -- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6588073dd0 msgr2=0x7f65881571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:42.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f6586a00640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6588073dd0 0x7f65881571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:42.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f6586a00640 1 -- 172.21.15.121:0/2670298085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6588157720 con 0x7f658806e330 2024-09-17T03:36:42.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f6586a00640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f658806e330 0x7f65881e8500 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6578001eb0 tx=0x7f657800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:42.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f657fe00640 1 -- 172.21.15.121:0/2670298085 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578017070 con 0x7f658806e330 2024-09-17T03:36:42.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f657fe00640 1 -- 172.21.15.121:0/2670298085 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65780053c0 con 0x7f658806e330 2024-09-17T03:36:42.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f658de00640 1 -- 172.21.15.121:0/2670298085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65880c87e0 con 0x7f658806e330 2024-09-17T03:36:42.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.477+0000 7f657fe00640 1 -- 172.21.15.121:0/2670298085 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578003830 con 0x7f658806e330 2024-09-17T03:36:42.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.478+0000 7f658de00640 1 -- 172.21.15.121:0/2670298085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65880b3a30 con 0x7f658806e330 2024-09-17T03:36:42.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.479+0000 7f658de00640 1 -- 172.21.15.121:0/2670298085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658806acf0 con 0x7f658806e330 2024-09-17T03:36:42.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.480+0000 7f657fe00640 1 -- 172.21.15.121:0/2670298085 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f657801a070 con 0x7f658806e330 2024-09-17T03:36:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.481+0000 7f657fe00640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078b90 0x7f656407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.481+0000 7f657fe00640 1 -- 172.21.15.121:0/2670298085 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5619+0+0 (secure 0 0 0) 0x7f657809a1a0 con 0x7f658806e330 2024-09-17T03:36:42.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.482+0000 7f657e000640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078b90 0x7f656407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:42.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.482+0000 7f657e000640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078b90 0x7f656407b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6570034000 tx=0x7f6570004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.486+0000 7f657fe00640 1 -- 172.21.15.121:0/2670298085 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f658806acf0 con 0x7f658806e330 2024-09-17T03:36:42.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:42.671+0000 7f658de00640 1 -- 172.21.15.121:0/2670298085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f658806ddf0 con 0x7f658806e330 2024-09-17T03:36:43.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.218+0000 7f657fe00640 1 -- 172.21.15.121:0/2670298085 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) ==== 170+0+0 (secure 0 0 0) 0x7f658806e740 con 0x7f658806e330 2024-09-17T03:36:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-17T03:36:43.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.220+0000 7f658de00640 1 -- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078b90 msgr2=0x7f656407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:43.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.220+0000 7f658de00640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078b90 0x7f656407b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6570034000 tx=0x7f6570004730 comp rx=0 tx=0).stop 2024-09-17T03:36:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.220+0000 7f658de00640 1 -- 172.21.15.121:0/2670298085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f658806e330 msgr2=0x7f65881e8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.220+0000 7f658de00640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f658806e330 0x7f65881e8500 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6578001eb0 tx=0x7f657800c890 comp rx=0 tx=0).stop 2024-09-17T03:36:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.220+0000 7f658de00640 1 -- 172.21.15.121:0/2670298085 shutdown_connections 2024-09-17T03:36:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.221+0000 7f658de00640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6588074cb0 0x7f65880b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.221+0000 7f658de00640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6588073dd0 0x7f65881571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.221+0000 7f658de00640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078b90 0x7f656407b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.221+0000 7f658de00640 1 --2- 172.21.15.121:0/2670298085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f658806e330 0x7f65881e8500 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.221+0000 7f658de00640 1 -- 172.21.15.121:0/2670298085 >> 172.21.15.121:0/2670298085 conn(0x7f65880cca40 msgr2=0x7f65880cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.221+0000 7f658de00640 1 -- 172.21.15.121:0/2670298085 shutdown_connections 2024-09-17T03:36:43.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.221+0000 7f658de00640 1 -- 172.21.15.121:0/2670298085 wait complete. 2024-09-17T03:36:43.257 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:36:43.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.481+0000 7f8681400640 1 -- 172.21.15.121:0/2693083334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8660003c10 msgr2=0x7f8660004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:43.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.481+0000 7f8681400640 1 --2- 172.21.15.121:0/2693083334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8660003c10 0x7f8660004060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f866c006fb0 tx=0x7f8660005830 comp rx=0 tx=0).stop 2024-09-17T03:36:43.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.481+0000 7f867b200640 1 -- 172.21.15.121:0/2693083334 reap_dead start 2024-09-17T03:36:43.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.481+0000 7f8681400640 1 -- 172.21.15.121:0/2693083334 shutdown_connections 2024-09-17T03:36:43.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.481+0000 7f8681400640 1 -- 172.21.15.121:0/2693083334 >> 172.21.15.121:0/2693083334 conn(0x7f867c0b1b90 msgr2=0x7f867c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:43.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.481+0000 7f8681400640 1 -- 172.21.15.121:0/2693083334 shutdown_connections 2024-09-17T03:36:43.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.481+0000 7f8681400640 1 -- 172.21.15.121:0/2693083334 wait complete. 2024-09-17T03:36:43.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.483+0000 7f8681400640 1 Processor -- start 2024-09-17T03:36:43.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.484+0000 7f8681400640 1 -- start start 2024-09-17T03:36:43.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f8681400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8660003c10 0x7f867c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:43.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f8681400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f867c0a0680 0x7f867c0a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:43.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f8681400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f867c154980 0x7f867c154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:43.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f8681400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f867c073320 con 0x7f867c154980 2024-09-17T03:36:43.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f8681400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f867c0731a0 con 0x7f8660003c10 2024-09-17T03:36:43.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f8681400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f867c0734a0 con 0x7f867c0a0680 2024-09-17T03:36:43.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f867b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f867c154980 0x7f867c154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:43.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f867a800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8660003c10 0x7f867c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:43.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f8673e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f867c0a0680 0x7f867c0a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:43.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f867a800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8660003c10 0x7f867c0c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:47882/0 (socket says 172.21.15.121:47882) 2024-09-17T03:36:43.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.485+0000 7f867a800640 1 -- 172.21.15.121:0/4189879009 learned_addr learned my addr 172.21.15.121:0/4189879009 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:43.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.486+0000 7f867b200640 1 -- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f867c0a0680 msgr2=0x7f867c0a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:43.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.486+0000 7f867b200640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f867c0a0680 0x7f867c0a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.486+0000 7f867b200640 1 -- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8660003c10 msgr2=0x7f867c0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:43.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.486+0000 7f867b200640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8660003c10 0x7f867c0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.486+0000 7f867b200640 1 -- 172.21.15.121:0/4189879009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c1552d0 con 0x7f867c154980 2024-09-17T03:36:43.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.486+0000 7f867b200640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f867c154980 0x7f867c154d90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f867c06a150 tx=0x7f8674010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:43.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.486+0000 7f8672a00640 1 -- 172.21.15.121:0/4189879009 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8674003970 con 0x7f867c154980 2024-09-17T03:36:43.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.486+0000 7f8672a00640 1 -- 172.21.15.121:0/4189879009 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8674015070 con 0x7f867c154980 2024-09-17T03:36:43.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.486+0000 7f8681400640 1 -- 172.21.15.121:0/4189879009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867c1f8cc0 con 0x7f867c154980 2024-09-17T03:36:43.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.487+0000 7f8672a00640 1 -- 172.21.15.121:0/4189879009 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8674004030 con 0x7f867c154980 2024-09-17T03:36:43.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.487+0000 7f8681400640 1 -- 172.21.15.121:0/4189879009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867c1f9240 con 0x7f867c154980 2024-09-17T03:36:43.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.488+0000 7f8681400640 1 -- 172.21.15.121:0/4189879009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867c073a30 con 0x7f867c154980 2024-09-17T03:36:43.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.489+0000 7f8672a00640 1 -- 172.21.15.121:0/4189879009 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f86740041d0 con 0x7f867c154980 2024-09-17T03:36:43.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.490+0000 7f8672a00640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8658078b90 0x7f865807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:43.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.490+0000 7f8672a00640 1 -- 172.21.15.121:0/4189879009 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6001+0+0 (secure 0 0 0) 0x7f867409b8b0 con 0x7f867c154980 2024-09-17T03:36:43.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.490+0000 7f867a800640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8658078b90 0x7f865807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:43.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.491+0000 7f867a800640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8658078b90 0x7f865807b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f866c000f60 tx=0x7f866c02d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:43.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.495+0000 7f8672a00640 1 -- 172.21.15.121:0/4189879009 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f867c1552d0 con 0x7f867c154980 2024-09-17T03:36:43.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:43.716+0000 7f8681400640 1 -- 172.21.15.121:0/4189879009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f867c160470 con 0x7f867c154980 2024-09-17T03:36:44.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.243+0000 7f8672a00640 1 -- 172.21.15.121:0/4189879009 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f8674063570 con 0x7f867c154980 2024-09-17T03:36:44.245 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 5 and data pool 6 2024-09-17T03:36:44.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.247+0000 7f8681400640 1 -- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8658078b90 msgr2=0x7f865807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.247+0000 7f8681400640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8658078b90 0x7f865807b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f866c000f60 tx=0x7f866c02d000 comp rx=0 tx=0).stop 2024-09-17T03:36:44.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.247+0000 7f8681400640 1 -- 172.21.15.121:0/4189879009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f867c154980 msgr2=0x7f867c154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.247+0000 7f8681400640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f867c154980 0x7f867c154d90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f867c06a150 tx=0x7f8674010f40 comp rx=0 tx=0).stop 2024-09-17T03:36:44.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.248+0000 7f8681400640 1 -- 172.21.15.121:0/4189879009 shutdown_connections 2024-09-17T03:36:44.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.248+0000 7f8681400640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8658078b90 0x7f865807b0a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.248+0000 7f8681400640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f867c154980 0x7f867c154d90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.248+0000 7f8681400640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f867c0a0680 0x7f867c0a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.248+0000 7f8681400640 1 --2- 172.21.15.121:0/4189879009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8660003c10 0x7f867c0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.248+0000 7f8681400640 1 -- 172.21.15.121:0/4189879009 >> 172.21.15.121:0/4189879009 conn(0x7f867c0b1b90 msgr2=0x7f867c0b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:44.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.249+0000 7f8681400640 1 -- 172.21.15.121:0/4189879009 shutdown_connections 2024-09-17T03:36:44.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.250+0000 7f8681400640 1 -- 172.21.15.121:0/4189879009 wait complete. 2024-09-17T03:36:44.294 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:44.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.516+0000 7f2840a00640 1 -- 172.21.15.121:0/4032890666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f283c0af420 msgr2=0x7f283c15e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.516+0000 7f2840a00640 1 --2- 172.21.15.121:0/4032890666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f283c0af420 0x7f283c15e7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2834009be0 tx=0x7f283402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.516+0000 7f2840a00640 1 -- 172.21.15.121:0/4032890666 shutdown_connections 2024-09-17T03:36:44.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.516+0000 7f2840a00640 1 --2- 172.21.15.121:0/4032890666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f283c0af420 0x7f283c15e7c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.516+0000 7f2840a00640 1 -- 172.21.15.121:0/4032890666 >> 172.21.15.121:0/4032890666 conn(0x7f283c0cca40 msgr2=0x7f283c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:44.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.516+0000 7f2840a00640 1 -- 172.21.15.121:0/4032890666 shutdown_connections 2024-09-17T03:36:44.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.516+0000 7f2840a00640 1 -- 172.21.15.121:0/4032890666 wait complete. 2024-09-17T03:36:44.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.518+0000 7f2840a00640 1 Processor -- start 2024-09-17T03:36:44.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.518+0000 7f2840a00640 1 -- start start 2024-09-17T03:36:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f2840a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f283c0af420 0x7f283c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f2840a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c0c6020 0x7f283c0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f2840a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f283c1f4110 0x7f283c1f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f2840a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f283c0ce8a0 con 0x7f283c0c6020 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f2840a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f283c0ce720 con 0x7f283c1f4110 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f2840a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f283c0cea20 con 0x7f283c0af420 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f2833e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c0c6020 0x7f283c0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f2833e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c0c6020 0x7f283c0c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46064/0 (socket says 172.21.15.121:46064) 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f2833e00640 1 -- 172.21.15.121:0/1021814607 learned_addr learned my addr 172.21.15.121:0/1021814607 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f283a800640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f283c1f4110 0x7f283c1f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.520+0000 7f2839e00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f283c0af420 0x7f283c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2833e00640 1 -- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f283c0af420 msgr2=0x7f283c156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2833e00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f283c0af420 0x7f283c156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2833e00640 1 -- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f283c1f4110 msgr2=0x7f283c1f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2833e00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f283c1f4110 0x7f283c1f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2833e00640 1 -- 172.21.15.121:0/1021814607 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c156fe0 con 0x7f283c0c6020 2024-09-17T03:36:44.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2833e00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c0c6020 0x7f283c0c6430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f282400c430 tx=0x7f282400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:44.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2832000640 1 -- 172.21.15.121:0/1021814607 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824017070 con 0x7f283c0c6020 2024-09-17T03:36:44.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2832000640 1 -- 172.21.15.121:0/1021814607 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28240053e0 con 0x7f283c0c6020 2024-09-17T03:36:44.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2840a00640 1 -- 172.21.15.121:0/1021814607 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283c1572c0 con 0x7f283c0c6020 2024-09-17T03:36:44.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2832000640 1 -- 172.21.15.121:0/1021814607 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824003850 con 0x7f283c0c6020 2024-09-17T03:36:44.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.521+0000 7f2840a00640 1 -- 172.21.15.121:0/1021814607 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283c157880 con 0x7f283c0c6020 2024-09-17T03:36:44.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.522+0000 7f2840a00640 1 -- 172.21.15.121:0/1021814607 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f283c0cb750 con 0x7f283c0c6020 2024-09-17T03:36:44.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.524+0000 7f2832000640 1 -- 172.21.15.121:0/1021814607 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f282401a070 con 0x7f283c0c6020 2024-09-17T03:36:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.524+0000 7f2832000640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2818078b90 0x7f281807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.525+0000 7f2832000640 1 -- 172.21.15.121:0/1021814607 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f282409a200 con 0x7f283c0c6020 2024-09-17T03:36:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.525+0000 7f2839e00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2818078b90 0x7f281807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.526+0000 7f2839e00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2818078b90 0x7f281807b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f282c000c00 tx=0x7f282c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:44.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.529+0000 7f2832000640 1 -- 172.21.15.121:0/1021814607 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2824061e60 con 0x7f283c0c6020 2024-09-17T03:36:44.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.711+0000 7f2840a00640 1 -- 172.21.15.121:0/1021814607 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f283c15bae0 con 0x7f283c0c6020 2024-09-17T03:36:44.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.713+0000 7f2832000640 1 -- 172.21.15.121:0/1021814607 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17075 (secure 0 0 0) 0x7f2824066890 con 0x7f283c0c6020 2024-09-17T03:36:44.713 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:44.713 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":39,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:36:43.718187+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:41.651337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:42.683336+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:44.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 -- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2818078b90 msgr2=0x7f281807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2818078b90 0x7f281807b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f282c000c00 tx=0x7f282c009040 comp rx=0 tx=0).stop 2024-09-17T03:36:44.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 -- 172.21.15.121:0/1021814607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c0c6020 msgr2=0x7f283c0c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c0c6020 0x7f283c0c6430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f282400c430 tx=0x7f282400c8f0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 -- 172.21.15.121:0/1021814607 shutdown_connections 2024-09-17T03:36:44.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f283c1f4110 0x7f283c1f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2818078b90 0x7f281807b0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f283c0c6020 0x7f283c0c6430 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 --2- 172.21.15.121:0/1021814607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f283c0af420 0x7f283c156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 -- 172.21.15.121:0/1021814607 >> 172.21.15.121:0/1021814607 conn(0x7f283c0cca40 msgr2=0x7f283c0c9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:44.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 -- 172.21.15.121:0/1021814607 shutdown_connections 2024-09-17T03:36:44.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.715+0000 7f2840a00640 1 -- 172.21.15.121:0/1021814607 wait complete. 2024-09-17T03:36:44.737 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:44.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.958+0000 7fcf19400640 1 -- 172.21.15.121:0/1676772241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf1406d7f0 msgr2=0x7fcf14154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.958+0000 7fcf19400640 1 --2- 172.21.15.121:0/1676772241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf1406d7f0 0x7fcf14154ea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c005fd0 tx=0x7fcf0c02aa90 comp rx=0 tx=0).stop 2024-09-17T03:36:44.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.958+0000 7fcf19400640 1 -- 172.21.15.121:0/1676772241 shutdown_connections 2024-09-17T03:36:44.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.958+0000 7fcf19400640 1 --2- 172.21.15.121:0/1676772241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf1406d7f0 0x7fcf14154ea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.958+0000 7fcf19400640 1 --2- 172.21.15.121:0/1676772241 >> v2:172.21.15.176:3300/0 conn(0x7fcf141629c0 0x7fcf1406d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.958+0000 7fcf19400640 1 -- 172.21.15.121:0/1676772241 >> 172.21.15.121:0/1676772241 conn(0x7fcf140d1930 msgr2=0x7fcf140d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:44.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.958+0000 7fcf19400640 1 -- 172.21.15.121:0/1676772241 shutdown_connections 2024-09-17T03:36:44.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.958+0000 7fcf19400640 1 -- 172.21.15.121:0/1676772241 wait complete. 2024-09-17T03:36:44.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.960+0000 7fcf19400640 1 Processor -- start 2024-09-17T03:36:44.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.960+0000 7fcf19400640 1 -- start start 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf19400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf1406d7f0 0x7fcf140c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf19400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf140b9e40 0x7fcf140cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf19400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140cbb20 0x7fcf141e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf19400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcf14155820 con 0x7fcf140cbb20 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf19400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf141556a0 con 0x7fcf1406d7f0 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf19400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf141559a0 con 0x7fcf140b9e40 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf18a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140cbb20 0x7fcf141e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf18a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140cbb20 0x7fcf141e8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46072/0 (socket says 172.21.15.121:46072) 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf18a00640 1 -- 172.21.15.121:0/4074382639 learned_addr learned my addr 172.21.15.121:0/4074382639 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf13e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf1406d7f0 0x7fcf140c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.962+0000 7fcf0b400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf140b9e40 0x7fcf140cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.963+0000 7fcf18a00640 1 -- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf140b9e40 msgr2=0x7fcf140cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.963+0000 7fcf18a00640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf140b9e40 0x7fcf140cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.963+0000 7fcf18a00640 1 -- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf1406d7f0 msgr2=0x7fcf140c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.963+0000 7fcf18a00640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf1406d7f0 0x7fcf140c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.963+0000 7fcf18a00640 1 -- 172.21.15.121:0/4074382639 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf140cc760 con 0x7fcf140cbb20 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.963+0000 7fcf18a00640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140cbb20 0x7fcf141e8f00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009d90 tx=0x7fcf0c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:44.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.963+0000 7fcf10c00640 1 -- 172.21.15.121:0/4074382639 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c044070 con 0x7fcf140cbb20 2024-09-17T03:36:44.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.963+0000 7fcf10c00640 1 -- 172.21.15.121:0/4074382639 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf0c004040 con 0x7fcf140cbb20 2024-09-17T03:36:44.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.963+0000 7fcf19400640 1 -- 172.21.15.121:0/4074382639 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf140cc480 con 0x7fcf140cbb20 2024-09-17T03:36:44.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.963+0000 7fcf10c00640 1 -- 172.21.15.121:0/4074382639 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c004430 con 0x7fcf140cbb20 2024-09-17T03:36:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.964+0000 7fcf19400640 1 -- 172.21.15.121:0/4074382639 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf140ce160 con 0x7fcf140cbb20 2024-09-17T03:36:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.964+0000 7fcf19400640 1 -- 172.21.15.121:0/4074382639 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf14154ea0 con 0x7fcf140cbb20 2024-09-17T03:36:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.966+0000 7fcf10c00640 1 -- 172.21.15.121:0/4074382639 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf0c047070 con 0x7fcf140cbb20 2024-09-17T03:36:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.967+0000 7fcf10c00640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcef0078b90 0x7fcef007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.967+0000 7fcf10c00640 1 -- 172.21.15.121:0/4074382639 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fcf0c0bbc00 con 0x7fcf140cbb20 2024-09-17T03:36:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.967+0000 7fcf13e00640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcef0078b90 0x7fcef007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.968+0000 7fcf13e00640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcef0078b90 0x7fcef007b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf04001720 tx=0x7fcf04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:44.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:44.971+0000 7fcf10c00640 1 -- 172.21.15.121:0/4074382639 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcf0c032030 con 0x7fcf140cbb20 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.154+0000 7fcf19400640 1 -- 172.21.15.121:0/4074382639 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf140d3400 con 0x7fcf140cbb20 2024-09-17T03:36:45.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.155+0000 7fcf10c00640 1 -- 172.21.15.121:0/4074382639 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17075 (secure 0 0 0) 0x7fcf0c0838e0 con 0x7fcf140cbb20 2024-09-17T03:36:45.155 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:45.155 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":39,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:36:43.718187+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:41.651337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:42.683336+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 -- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcef0078b90 msgr2=0x7fcef007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcef0078b90 0x7fcef007b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf04001720 tx=0x7fcf04009040 comp rx=0 tx=0).stop 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 -- 172.21.15.121:0/4074382639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140cbb20 msgr2=0x7fcf141e8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140cbb20 0x7fcf141e8f00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009d90 tx=0x7fcf0c003ce0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 -- 172.21.15.121:0/4074382639 shutdown_connections 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcef0078b90 0x7fcef007b0a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf140cbb20 0x7fcf141e8f00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf140b9e40 0x7fcf140cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 --2- 172.21.15.121:0/4074382639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf1406d7f0 0x7fcf140c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 -- 172.21.15.121:0/4074382639 >> 172.21.15.121:0/4074382639 conn(0x7fcf140d1930 msgr2=0x7fcf1415fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 -- 172.21.15.121:0/4074382639 shutdown_connections 2024-09-17T03:36:45.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.158+0000 7fcf19400640 1 -- 172.21.15.121:0/4074382639 wait complete. 2024-09-17T03:36:45.182 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:36:45.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.411+0000 7fc9d1000640 1 -- 172.21.15.121:0/2290642444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9cc0d3280 msgr2=0x7fc9cc0cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.411+0000 7fc9d1000640 1 --2- 172.21.15.121:0/2290642444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9cc0d3280 0x7fc9cc0cfa10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4005fd0 tx=0x7fc9c402aaa0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.411+0000 7fc9d1000640 1 -- 172.21.15.121:0/2290642444 shutdown_connections 2024-09-17T03:36:45.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.411+0000 7fc9d1000640 1 --2- 172.21.15.121:0/2290642444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9cc0d3280 0x7fc9cc0cfa10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.411+0000 7fc9d1000640 1 -- 172.21.15.121:0/2290642444 >> 172.21.15.121:0/2290642444 conn(0x7fc9cc0d1960 msgr2=0x7fc9cc0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:45.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.411+0000 7fc9d1000640 1 -- 172.21.15.121:0/2290642444 shutdown_connections 2024-09-17T03:36:45.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.411+0000 7fc9d1000640 1 -- 172.21.15.121:0/2290642444 wait complete. 2024-09-17T03:36:45.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.413+0000 7fc9d1000640 1 Processor -- start 2024-09-17T03:36:45.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.413+0000 7fc9d1000640 1 -- start start 2024-09-17T03:36:45.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9d1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9cc06d2b0 0x7fc9cc147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9d1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9cc0d3280 0x7fc9cc1608b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9d1000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9cc152770 0x7fc9cc160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9d1000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc155620 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9d1000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc1554a0 con 0x7fc9cc0d3280 2024-09-17T03:36:45.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9d1000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9cc1557a0 con 0x7fc9cc152770 2024-09-17T03:36:45.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9cb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9cc06d2b0 0x7fc9cc147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9cb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9cc06d2b0 0x7fc9cc147580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46102/0 (socket says 172.21.15.121:46102) 2024-09-17T03:36:45.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9cb400640 1 -- 172.21.15.121:0/4101300933 learned_addr learned my addr 172.21.15.121:0/4101300933 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:45.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9caa00640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9cc0d3280 0x7fc9cc1608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.415+0000 7fc9cbe00640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9cc152770 0x7fc9cc160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9cb400640 1 -- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9cc152770 msgr2=0x7fc9cc160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9cb400640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9cc152770 0x7fc9cc160df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9cb400640 1 -- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9cc0d3280 msgr2=0x7fc9cc1608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9cb400640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9cc0d3280 0x7fc9cc1608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9cb400640 1 -- 172.21.15.121:0/4101300933 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc147ac0 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9caa00640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9cc0d3280 0x7fc9cc1608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9cb400640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9cc06d2b0 0x7fc9cc147580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c400 tx=0x7fc9bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9c3400640 1 -- 172.21.15.121:0/4101300933 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc017070 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9c3400640 1 -- 172.21.15.121:0/4101300933 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9bc0053c0 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9c3400640 1 -- 172.21.15.121:0/4101300933 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc003850 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9d1000640 1 -- 172.21.15.121:0/4101300933 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc161e60 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.416+0000 7fc9d1000640 1 -- 172.21.15.121:0/4101300933 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc156590 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.417+0000 7fc9d1000640 1 -- 172.21.15.121:0/4101300933 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9cc1621d0 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.420+0000 7fc9c3400640 1 -- 172.21.15.121:0/4101300933 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9bc01a070 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.421+0000 7fc9c3400640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9ac078b90 0x7fc9ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.421+0000 7fc9c3400640 1 -- 172.21.15.121:0/4101300933 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc9bc09a340 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.421+0000 7fc9caa00640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9ac078b90 0x7fc9ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.422+0000 7fc9caa00640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9ac078b90 0x7fc9ac07b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0d38f0 tx=0x7fc9b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:45.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.426+0000 7fc9c3400640 1 -- 172.21.15.121:0/4101300933 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9bc0625e0 con 0x7fc9cc06d2b0 2024-09-17T03:36:45.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:45.642+0000 7fc9d1000640 1 -- 172.21.15.121:0/4101300933 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc9cc0d3f00 con 0x7fc9cc06d2b0 2024-09-17T03:36:46.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.258+0000 7fc9c3400640 1 -- 172.21.15.121:0/4101300933 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fc9bc061ee0 con 0x7fc9cc06d2b0 2024-09-17T03:36:46.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.260+0000 7fc9d1000640 1 -- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9ac078b90 msgr2=0x7fc9ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.260+0000 7fc9d1000640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9ac078b90 0x7fc9ac07b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0d38f0 tx=0x7fc9b8009040 comp rx=0 tx=0).stop 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.260+0000 7fc9d1000640 1 -- 172.21.15.121:0/4101300933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9cc06d2b0 msgr2=0x7fc9cc147580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.260+0000 7fc9d1000640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9cc06d2b0 0x7fc9cc147580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c400 tx=0x7fc9bc00c8c0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.260+0000 7fc9d1000640 1 -- 172.21.15.121:0/4101300933 shutdown_connections 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.260+0000 7fc9d1000640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9cc152770 0x7fc9cc160df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.260+0000 7fc9d1000640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9cc0d3280 0x7fc9cc1608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.260+0000 7fc9d1000640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9ac078b90 0x7fc9ac07b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.260+0000 7fc9d1000640 1 --2- 172.21.15.121:0/4101300933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9cc06d2b0 0x7fc9cc147580 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.260+0000 7fc9d1000640 1 -- 172.21.15.121:0/4101300933 >> 172.21.15.121:0/4101300933 conn(0x7fc9cc0d1960 msgr2=0x7fc9cc0b8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.261+0000 7fc9d1000640 1 -- 172.21.15.121:0/4101300933 shutdown_connections 2024-09-17T03:36:46.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.261+0000 7fc9d1000640 1 -- 172.21.15.121:0/4101300933 wait complete. 2024-09-17T03:36:46.283 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:36:46.283 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:36:46.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.508+0000 7f658aa00640 1 -- 172.21.15.121:0/1482248457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584162890 msgr2=0x7f6584154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.508+0000 7f658aa00640 1 --2- 172.21.15.121:0/1482248457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584162890 0x7f6584154f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6584069b40 tx=0x7f657002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.508+0000 7f658aa00640 1 -- 172.21.15.121:0/1482248457 shutdown_connections 2024-09-17T03:36:46.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.508+0000 7f658aa00640 1 --2- 172.21.15.121:0/1482248457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584162890 0x7f6584154f20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.508+0000 7f658aa00640 1 --2- 172.21.15.121:0/1482248457 >> v2:172.21.15.176:3300/0 conn(0x7f65840d2760 0x7f6584162350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.508+0000 7f658aa00640 1 -- 172.21.15.121:0/1482248457 >> 172.21.15.121:0/1482248457 conn(0x7f65840d4360 msgr2=0x7f65840d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:46.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.508+0000 7f658aa00640 1 -- 172.21.15.121:0/1482248457 shutdown_connections 2024-09-17T03:36:46.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.508+0000 7f658aa00640 1 -- 172.21.15.121:0/1482248457 wait complete. 2024-09-17T03:36:46.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.510+0000 7f658aa00640 1 Processor -- start 2024-09-17T03:36:46.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.511+0000 7f658aa00640 1 -- start start 2024-09-17T03:36:46.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.512+0000 7f658aa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65840d2760 0x7f658414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.512+0000 7f658aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6584155460 0x7f65840ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.512+0000 7f658aa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584162890 0x7f65840ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.512+0000 7f658aa00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f658415f290 con 0x7f6584162890 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.512+0000 7f658aa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f65840cfee0 con 0x7f6584155460 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.512+0000 7f658aa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f658415f410 con 0x7f65840d2760 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.512+0000 7f658a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584162890 0x7f65840ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.512+0000 7f658a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584162890 0x7f65840ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46116/0 (socket says 172.21.15.121:46116) 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.512+0000 7f658a000640 1 -- 172.21.15.121:0/2987029330 learned_addr learned my addr 172.21.15.121:0/2987029330 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.513+0000 7f6588c00640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6584155460 0x7f65840ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.513+0000 7f6589600640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65840d2760 0x7f658414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.513+0000 7f658a000640 1 -- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65840d2760 msgr2=0x7f658414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.513+0000 7f658a000640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65840d2760 0x7f658414ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.513+0000 7f658a000640 1 -- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6584155460 msgr2=0x7f65840ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.513+0000 7f658a000640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6584155460 0x7f65840ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.513+0000 7f658a000640 1 -- 172.21.15.121:0/2987029330 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65840cc420 con 0x7f6584162890 2024-09-17T03:36:46.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.513+0000 7f658a000640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584162890 0x7f65840ca7e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f657c00c760 tx=0x7f657c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:46.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.513+0000 7f6581600640 1 -- 172.21.15.121:0/2987029330 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c003b70 con 0x7f6584162890 2024-09-17T03:36:46.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.514+0000 7f6581600640 1 -- 172.21.15.121:0/2987029330 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f657c003d10 con 0x7f6584162890 2024-09-17T03:36:46.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.514+0000 7f658aa00640 1 -- 172.21.15.121:0/2987029330 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65840cb8a0 con 0x7f6584162890 2024-09-17T03:36:46.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.514+0000 7f6581600640 1 -- 172.21.15.121:0/2987029330 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c0052d0 con 0x7f6584162890 2024-09-17T03:36:46.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.514+0000 7f658aa00640 1 -- 172.21.15.121:0/2987029330 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65840cbe60 con 0x7f6584162890 2024-09-17T03:36:46.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.515+0000 7f658aa00640 1 -- 172.21.15.121:0/2987029330 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65840cb610 con 0x7f6584162890 2024-09-17T03:36:46.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.516+0000 7f6581600640 1 -- 172.21.15.121:0/2987029330 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f657c005470 con 0x7f6584162890 2024-09-17T03:36:46.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.517+0000 7f6581600640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078bc0 0x7f656407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.517+0000 7f6581600640 1 -- 172.21.15.121:0/2987029330 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f657c09ac40 con 0x7f6584162890 2024-09-17T03:36:46.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.517+0000 7f6589600640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078bc0 0x7f656407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:46.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.518+0000 7f6589600640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078bc0 0x7f656407b0d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f657800bb00 tx=0x7f6578005e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:46.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.521+0000 7f6581600640 1 -- 172.21.15.121:0/2987029330 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f657c062ef0 con 0x7f6584162890 2024-09-17T03:36:46.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:46.739+0000 7f658aa00640 1 -- 172.21.15.121:0/2987029330 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f658415f930 con 0x7f6584162890 2024-09-17T03:36:47.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.260+0000 7f6581600640 1 -- 172.21.15.121:0/2987029330 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f657c0627f0 con 0x7f6584162890 2024-09-17T03:36:47.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 -- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078bc0 msgr2=0x7f656407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078bc0 0x7f656407b0d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f657800bb00 tx=0x7f6578005e30 comp rx=0 tx=0).stop 2024-09-17T03:36:47.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 -- 172.21.15.121:0/2987029330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584162890 msgr2=0x7f65840ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584162890 0x7f65840ca7e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f657c00c760 tx=0x7f657c00cb60 comp rx=0 tx=0).stop 2024-09-17T03:36:47.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 -- 172.21.15.121:0/2987029330 shutdown_connections 2024-09-17T03:36:47.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6564078bc0 0x7f656407b0d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6584162890 0x7f65840ca7e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6584155460 0x7f65840ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 --2- 172.21.15.121:0/2987029330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65840d2760 0x7f658414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 -- 172.21.15.121:0/2987029330 >> 172.21.15.121:0/2987029330 conn(0x7f65840d4360 msgr2=0x7f65840d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:47.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 -- 172.21.15.121:0/2987029330 shutdown_connections 2024-09-17T03:36:47.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.262+0000 7f658aa00640 1 -- 172.21.15.121:0/2987029330 wait complete. 2024-09-17T03:36:47.286 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:36:47.286 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:47.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.508+0000 7f85c4200640 1 -- 172.21.15.121:0/1117073541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85a4005280 msgr2=0x7f85a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.508+0000 7f85c4200640 1 --2- 172.21.15.121:0/1117073541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85a4005280 0x7f85a400b9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f85b40020d0 tx=0x7f85a4005830 comp rx=0 tx=0).stop 2024-09-17T03:36:47.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.508+0000 7f85c4200640 1 -- 172.21.15.121:0/1117073541 shutdown_connections 2024-09-17T03:36:47.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.508+0000 7f85c4200640 1 --2- 172.21.15.121:0/1117073541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85a4005280 0x7f85a400b9c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.508+0000 7f85c4200640 1 -- 172.21.15.121:0/1117073541 >> 172.21.15.121:0/1117073541 conn(0x7f85bc0cca40 msgr2=0x7f85bc0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:47.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.508+0000 7f85c4200640 1 -- 172.21.15.121:0/1117073541 shutdown_connections 2024-09-17T03:36:47.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.508+0000 7f85c4200640 1 -- 172.21.15.121:0/1117073541 wait complete. 2024-09-17T03:36:47.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.510+0000 7f85c4200640 1 Processor -- start 2024-09-17T03:36:47.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.510+0000 7f85c4200640 1 -- start start 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c4200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85a4005280 0x7f85bc1e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c4200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85bc1f61c0 0x7f85bc1e6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c4200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85bc1f65d0 0x7f85bc1e6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c4200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc06e180 con 0x7f85a4005280 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c4200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc06e000 con 0x7f85bc1f61c0 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c4200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85bc0cbc10 con 0x7f85bc1f65d0 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c1800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85a4005280 0x7f85bc1e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c1800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85a4005280 0x7f85bc1e9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46144/0 (socket says 172.21.15.121:46144) 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c1800640 1 -- 172.21.15.121:0/610695283 learned_addr learned my addr 172.21.15.121:0/610695283 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c0e00640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85bc1f61c0 0x7f85bc1e6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c2200640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85bc1f65d0 0x7f85bc1e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c1800640 1 -- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85bc1f65d0 msgr2=0x7f85bc1e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c1800640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85bc1f65d0 0x7f85bc1e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c1800640 1 -- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85bc1f61c0 msgr2=0x7f85bc1e6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c1800640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85bc1f61c0 0x7f85bc1e6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.512+0000 7f85c1800640 1 -- 172.21.15.121:0/610695283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc1e4f70 con 0x7f85a4005280 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.513+0000 7f85c1800640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85a4005280 0x7f85bc1e9de0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f85b0006600 tx=0x7f85b00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.513+0000 7f85b9600640 1 -- 172.21.15.121:0/610695283 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0015070 con 0x7f85a4005280 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.513+0000 7f85b9600640 1 -- 172.21.15.121:0/610695283 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85b0011900 con 0x7f85a4005280 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.513+0000 7f85c4200640 1 -- 172.21.15.121:0/610695283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85bc1e5250 con 0x7f85a4005280 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.513+0000 7f85b9600640 1 -- 172.21.15.121:0/610695283 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0011d10 con 0x7f85a4005280 2024-09-17T03:36:47.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.513+0000 7f85c4200640 1 -- 172.21.15.121:0/610695283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85bc1e5810 con 0x7f85a4005280 2024-09-17T03:36:47.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.514+0000 7f85c4200640 1 -- 172.21.15.121:0/610695283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85bc071640 con 0x7f85a4005280 2024-09-17T03:36:47.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.515+0000 7f85b9600640 1 -- 172.21.15.121:0/610695283 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85b0018070 con 0x7f85a4005280 2024-09-17T03:36:47.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.516+0000 7f85b9600640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f859c078bc0 0x7f859c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.516+0000 7f85b9600640 1 -- 172.21.15.121:0/610695283 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f85b009bbc0 con 0x7f85a4005280 2024-09-17T03:36:47.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.517+0000 7f85c0e00640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f859c078bc0 0x7f859c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.517+0000 7f85c0e00640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f859c078bc0 0x7f859c07b0d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85bc09ee20 tx=0x7f85a8005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:47.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.521+0000 7f85b9600640 1 -- 172.21.15.121:0/610695283 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f85bc071640 con 0x7f85a4005280 2024-09-17T03:36:47.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.739+0000 7f85c4200640 1 -- 172.21.15.121:0/610695283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85bc0cc170 con 0x7f85a4005280 2024-09-17T03:36:47.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.740+0000 7f85b9600640 1 -- 172.21.15.121:0/610695283 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7f85b0063ef0 con 0x7f85a4005280 2024-09-17T03:36:47.740 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:47.740 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"btime":"2024-09-17T03:36:47:258731+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3162771203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3162771203},{"type":"v1","addr":"172.21.15.176:6837","nonce":3162771203}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4101257140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4101257140},{"type":"v1","addr":"172.21.15.176:6836","nonce":4101257140}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/4075176322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4075176322},{"type":"v1","addr":"172.21.15.121:6834","nonce":4075176322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:43.718129+0000","modified":"2024-09-17T03:36:46.740327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3665568713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":3665568713},{"type":"v1","addr":"172.21.15.121:6835","nonce":3665568713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5019,"qdb_cluster":[5019]},"id":2}]} 2024-09-17T03:36:47.740 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.742+0000 7f85c4200640 1 -- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f859c078bc0 msgr2=0x7f859c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.742+0000 7f85c4200640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f859c078bc0 0x7f859c07b0d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85bc09ee20 tx=0x7f85a8005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.742+0000 7f85c4200640 1 -- 172.21.15.121:0/610695283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85a4005280 msgr2=0x7f85bc1e9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.742+0000 7f85c4200640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85a4005280 0x7f85bc1e9de0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f85b0006600 tx=0x7f85b00039c0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.743+0000 7f85c4200640 1 -- 172.21.15.121:0/610695283 shutdown_connections 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.743+0000 7f85c4200640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85bc1f65d0 0x7f85bc1e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.743+0000 7f85c4200640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85bc1f61c0 0x7f85bc1e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.743+0000 7f85c4200640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f859c078bc0 0x7f859c07b0d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.743+0000 7f85c4200640 1 --2- 172.21.15.121:0/610695283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85a4005280 0x7f85bc1e9de0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.743+0000 7f85c4200640 1 -- 172.21.15.121:0/610695283 >> 172.21.15.121:0/610695283 conn(0x7f85bc0cca40 msgr2=0x7f85bc0cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.743+0000 7f85c4200640 1 -- 172.21.15.121:0/610695283 shutdown_connections 2024-09-17T03:36:47.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.743+0000 7f85c4200640 1 -- 172.21.15.121:0/610695283 wait complete. 2024-09-17T03:36:47.764 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:47.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.985+0000 7fe4d1e00640 1 -- 172.21.15.121:0/1252948560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4cc06e500 msgr2=0x7fe4cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.985+0000 7fe4d1e00640 1 --2- 172.21.15.121:0/1252948560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4cc06e500 0x7fe4cc06ede0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4005fd0 tx=0x7fe4c402a670 comp rx=0 tx=0).stop 2024-09-17T03:36:47.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.985+0000 7fe4d1e00640 1 -- 172.21.15.121:0/1252948560 shutdown_connections 2024-09-17T03:36:47.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.985+0000 7fe4d1e00640 1 --2- 172.21.15.121:0/1252948560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4cc06e500 0x7fe4cc06ede0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.985+0000 7fe4d1e00640 1 -- 172.21.15.121:0/1252948560 >> 172.21.15.121:0/1252948560 conn(0x7fe4cc0cca40 msgr2=0x7fe4cc0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:47.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.985+0000 7fe4d1e00640 1 -- 172.21.15.121:0/1252948560 shutdown_connections 2024-09-17T03:36:47.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.985+0000 7fe4d1e00640 1 -- 172.21.15.121:0/1252948560 wait complete. 2024-09-17T03:36:47.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.987+0000 7fe4d1e00640 1 Processor -- start 2024-09-17T03:36:47.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.988+0000 7fe4d1e00640 1 -- start start 2024-09-17T03:36:47.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.989+0000 7fe4d1e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4cc073dd0 0x7fe4cc0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.989+0000 7fe4d1e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4cc074cb0 0x7fe4cc0b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.989+0000 7fe4d1e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4cc0cf4f0 0x7fe4cc09fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.989+0000 7fe4d1e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc06f6b0 con 0x7fe4cc0cf4f0 2024-09-17T03:36:47.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.989+0000 7fe4d1e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc06f530 con 0x7fe4cc073dd0 2024-09-17T03:36:47.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.989+0000 7fe4d1e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc06f830 con 0x7fe4cc074cb0 2024-09-17T03:36:47.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.989+0000 7fe4cb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4cc0cf4f0 0x7fe4cc09fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.989+0000 7fe4cb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4cc0cf4f0 0x7fe4cc09fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46154/0 (socket says 172.21.15.121:46154) 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.989+0000 7fe4cb400640 1 -- 172.21.15.121:0/3161126484 learned_addr learned my addr 172.21.15.121:0/3161126484 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4caa00640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4cc073dd0 0x7fe4cc0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4ca000640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4cc074cb0 0x7fe4cc0b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4cb400640 1 -- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4cc074cb0 msgr2=0x7fe4cc0b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4cb400640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4cc074cb0 0x7fe4cc0b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4cb400640 1 -- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4cc073dd0 msgr2=0x7fe4cc0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4cb400640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4cc073dd0 0x7fe4cc0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4cb400640 1 -- 172.21.15.121:0/3161126484 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc1e78a0 con 0x7fe4cc0cf4f0 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4cb400640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4cc0cf4f0 0x7fe4cc09fec0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009230 tx=0x7fe4c4003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4c3400640 1 -- 172.21.15.121:0/3161126484 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c403e030 con 0x7fe4cc0cf4f0 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4c3400640 1 -- 172.21.15.121:0/3161126484 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4c4003e50 con 0x7fe4cc0cf4f0 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.990+0000 7fe4c3400640 1 -- 172.21.15.121:0/3161126484 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4035040 con 0x7fe4cc0cf4f0 2024-09-17T03:36:47.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.991+0000 7fe4d1e00640 1 -- 172.21.15.121:0/3161126484 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc1e7b80 con 0x7fe4cc0cf4f0 2024-09-17T03:36:47.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.991+0000 7fe4d1e00640 1 -- 172.21.15.121:0/3161126484 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc0b3450 con 0x7fe4cc0cf4f0 2024-09-17T03:36:47.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.992+0000 7fe4d1e00640 1 -- 172.21.15.121:0/3161126484 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4cc0b36b0 con 0x7fe4cc0cf4f0 2024-09-17T03:36:47.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.993+0000 7fe4c3400640 1 -- 172.21.15.121:0/3161126484 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4c4041030 con 0x7fe4cc0cf4f0 2024-09-17T03:36:47.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.994+0000 7fe4c3400640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe4ac078bc0 0x7fe4ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.994+0000 7fe4c3400640 1 -- 172.21.15.121:0/3161126484 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fe4c40bb6b0 con 0x7fe4cc0cf4f0 2024-09-17T03:36:47.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.994+0000 7fe4caa00640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe4ac078bc0 0x7fe4ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.995+0000 7fe4caa00640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe4ac078bc0 0x7fe4ac07b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc15a730 tx=0x7fe4bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:47.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:47.998+0000 7fe4c3400640 1 -- 172.21.15.121:0/3161126484 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe4c4083270 con 0x7fe4cc0cf4f0 2024-09-17T03:36:48.167 INFO:tasks.ceph.mds.c.smithi121.stderr:2024-09-17T03:36:48.167+0000 7ff859000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:36:48.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.184+0000 7fe4d1e00640 1 -- 172.21.15.121:0/3161126484 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4cc06ede0 con 0x7fe4cc0cf4f0 2024-09-17T03:36:48.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.185+0000 7fe4c3400640 1 -- 172.21.15.121:0/3161126484 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17062 (secure 0 0 0) 0x7fe4c4087ca0 con 0x7fe4cc0cf4f0 2024-09-17T03:36:48.185 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:48.185 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":40,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:36:45.243335+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:41.651337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:42.683336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:48.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 -- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe4ac078bc0 msgr2=0x7fe4ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe4ac078bc0 0x7fe4ac07b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc15a730 tx=0x7fe4bc009040 comp rx=0 tx=0).stop 2024-09-17T03:36:48.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 -- 172.21.15.121:0/3161126484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4cc0cf4f0 msgr2=0x7fe4cc09fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4cc0cf4f0 0x7fe4cc09fec0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009230 tx=0x7fe4c4003960 comp rx=0 tx=0).stop 2024-09-17T03:36:48.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 -- 172.21.15.121:0/3161126484 shutdown_connections 2024-09-17T03:36:48.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe4ac078bc0 0x7fe4ac07b0d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4cc0cf4f0 0x7fe4cc09fec0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4cc074cb0 0x7fe4cc0b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 --2- 172.21.15.121:0/3161126484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4cc073dd0 0x7fe4cc0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 -- 172.21.15.121:0/3161126484 >> 172.21.15.121:0/3161126484 conn(0x7fe4cc0cca40 msgr2=0x7fe4cc15dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:48.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.187+0000 7fe4d1e00640 1 -- 172.21.15.121:0/3161126484 shutdown_connections 2024-09-17T03:36:48.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.188+0000 7fe4d1e00640 1 -- 172.21.15.121:0/3161126484 wait complete. 2024-09-17T03:36:48.212 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:36:48.212 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:48.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.433+0000 7fdab2400640 1 -- 172.21.15.121:0/158694226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaac074cb0 msgr2=0x7fdaac073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.433+0000 7fdab2400640 1 --2- 172.21.15.121:0/158694226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaac074cb0 0x7fdaac073dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdaac09e110 tx=0x7fda9c02a560 comp rx=0 tx=0).stop 2024-09-17T03:36:48.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.433+0000 7fdab2400640 1 -- 172.21.15.121:0/158694226 shutdown_connections 2024-09-17T03:36:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.433+0000 7fdab2400640 1 --2- 172.21.15.121:0/158694226 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdaac06ddf0 0x7fdaac06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.433+0000 7fdab2400640 1 --2- 172.21.15.121:0/158694226 >> v2:172.21.15.176:3300/0 conn(0x7fdaac0cbc10 0x7fdaac0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.433+0000 7fdab2400640 1 --2- 172.21.15.121:0/158694226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaac074cb0 0x7fdaac073dd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.433+0000 7fdab2400640 1 -- 172.21.15.121:0/158694226 >> 172.21.15.121:0/158694226 conn(0x7fdaac0cca40 msgr2=0x7fdaac0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.433+0000 7fdab2400640 1 -- 172.21.15.121:0/158694226 shutdown_connections 2024-09-17T03:36:48.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.433+0000 7fdab2400640 1 -- 172.21.15.121:0/158694226 wait complete. 2024-09-17T03:36:48.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.435+0000 7fdab2400640 1 Processor -- start 2024-09-17T03:36:48.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.436+0000 7fdab2400640 1 -- start start 2024-09-17T03:36:48.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.437+0000 7fdab2400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaac06ddf0 0x7fdaac09ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.437+0000 7fdab2400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaac074cb0 0x7fdaac15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.437+0000 7fdab2400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdaac0cbc10 0x7fdaac15be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.437+0000 7fdab2400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac06f170 con 0x7fdaac06ddf0 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.437+0000 7fdab2400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac06eff0 con 0x7fdaac074cb0 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.437+0000 7fdab2400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdaac06f2f0 con 0x7fdaac0cbc10 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.437+0000 7fdaab400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaac06ddf0 0x7fdaac09ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.438+0000 7fdaab400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaac06ddf0 0x7fdaac09ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46174/0 (socket says 172.21.15.121:46174) 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.438+0000 7fdaab400640 1 -- 172.21.15.121:0/2697262602 learned_addr learned my addr 172.21.15.121:0/2697262602 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.438+0000 7fdaabe00640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdaac0cbc10 0x7fdaac15be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.438+0000 7fdaa2a00640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaac074cb0 0x7fdaac15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.438+0000 7fdaab400640 1 -- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdaac0cbc10 msgr2=0x7fdaac15be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.438+0000 7fdaab400640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdaac0cbc10 0x7fdaac15be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.438+0000 7fdaab400640 1 -- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaac074cb0 msgr2=0x7fdaac15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.438+0000 7fdaab400640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaac074cb0 0x7fdaac15b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.438+0000 7fdaab400640 1 -- 172.21.15.121:0/2697262602 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaac1f8fa0 con 0x7fdaac06ddf0 2024-09-17T03:36:48.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.438+0000 7fdaab400640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaac06ddf0 0x7fdaac09ae80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fda9c034040 tx=0x7fda9c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:48.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.439+0000 7fdaa3e00640 1 -- 172.21.15.121:0/2697262602 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c03e030 con 0x7fdaac06ddf0 2024-09-17T03:36:48.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.439+0000 7fdaa3e00640 1 -- 172.21.15.121:0/2697262602 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda9c003e00 con 0x7fdaac06ddf0 2024-09-17T03:36:48.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.439+0000 7fdab2400640 1 -- 172.21.15.121:0/2697262602 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaac1f9280 con 0x7fdaac06ddf0 2024-09-17T03:36:48.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.439+0000 7fdaa3e00640 1 -- 172.21.15.121:0/2697262602 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c035040 con 0x7fdaac06ddf0 2024-09-17T03:36:48.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.439+0000 7fdab2400640 1 -- 172.21.15.121:0/2697262602 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaac0b3f00 con 0x7fdaac06ddf0 2024-09-17T03:36:48.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.440+0000 7fdab2400640 1 -- 172.21.15.121:0/2697262602 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaac073dd0 con 0x7fdaac06ddf0 2024-09-17T03:36:48.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.441+0000 7fdaa3e00640 1 -- 172.21.15.121:0/2697262602 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda9c041030 con 0x7fdaac06ddf0 2024-09-17T03:36:48.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.442+0000 7fdaa3e00640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda88078b90 0x7fda8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.442+0000 7fdaa3e00640 1 -- 172.21.15.121:0/2697262602 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fda9c0bb6f0 con 0x7fdaac06ddf0 2024-09-17T03:36:48.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.442+0000 7fdaa2a00640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda88078b90 0x7fda8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.443+0000 7fdaa2a00640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda88078b90 0x7fda8807b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0b5960 tx=0x7fda9400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:48.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.446+0000 7fdaa3e00640 1 -- 172.21.15.121:0/2697262602 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fda9c0832b0 con 0x7fdaac06ddf0 2024-09-17T03:36:48.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.625+0000 7fdab2400640 1 -- 172.21.15.121:0/2697262602 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdaac15eb70 con 0x7fda88078b90 2024-09-17T03:36:48.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.630+0000 7fdaa3e00640 1 -- 172.21.15.121:0/2697262602 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249630 (secure 0 0 0) 0x7fdaac15eb70 con 0x7fda88078b90 2024-09-17T03:36:48.633 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:48.634 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:36:48.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.634+0000 7fdab2400640 1 -- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda88078b90 msgr2=0x7fda8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.634+0000 7fdab2400640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda88078b90 0x7fda8807b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0b5960 tx=0x7fda9400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.634+0000 7fdab2400640 1 -- 172.21.15.121:0/2697262602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaac06ddf0 msgr2=0x7fdaac09ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.634+0000 7fdab2400640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaac06ddf0 0x7fdaac09ae80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fda9c034040 tx=0x7fda9c003910 comp rx=0 tx=0).stop 2024-09-17T03:36:48.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.634+0000 7fdab2400640 1 -- 172.21.15.121:0/2697262602 shutdown_connections 2024-09-17T03:36:48.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.634+0000 7fdab2400640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdaac0cbc10 0x7fdaac15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.634+0000 7fdab2400640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaac074cb0 0x7fdaac15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.634+0000 7fdab2400640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda88078b90 0x7fda8807b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.634+0000 7fdab2400640 1 --2- 172.21.15.121:0/2697262602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaac06ddf0 0x7fdaac09ae80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.634+0000 7fdab2400640 1 -- 172.21.15.121:0/2697262602 >> 172.21.15.121:0/2697262602 conn(0x7fdaac0cca40 msgr2=0x7fdaac15f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:48.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.635+0000 7fdab2400640 1 -- 172.21.15.121:0/2697262602 shutdown_connections 2024-09-17T03:36:48.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.635+0000 7fdab2400640 1 -- 172.21.15.121:0/2697262602 wait complete. 2024-09-17T03:36:48.656 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-09-17T03:36:47.297374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220940,"kb_used_data":4660,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753780,"statfs":{"total":773094113280,"available":772867870720,"internally_reserved":0,"allocated":4771840,"data_stored":2688573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.079846"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257666+0000","last_change":"2024-09-17T03:36:44.254536+0000","last_active":"2024-09-17T03:36:45.257666+0000","last_peered":"2024-09-17T03:36:45.257666+0000","last_clean":"2024-09-17T03:36:45.257666+0000","last_became_active":"2024-09-17T03:36:44.253988+0000","last_became_peered":"2024-09-17T03:36:44.253988+0000","last_unstale":"2024-09-17T03:36:45.257666+0000","last_undegraded":"2024-09-17T03:36:45.257666+0000","last_fullsized":"2024-09-17T03:36:45.257666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:13.241349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262421+0000","last_change":"2024-09-17T03:36:44.270961+0000","last_active":"2024-09-17T03:36:45.262421+0000","last_peered":"2024-09-17T03:36:45.262421+0000","last_clean":"2024-09-17T03:36:45.262421+0000","last_became_active":"2024-09-17T03:36:44.270715+0000","last_became_peered":"2024-09-17T03:36:44.270715+0000","last_unstale":"2024-09-17T03:36:45.262421+0000","last_undegraded":"2024-09-17T03:36:45.262421+0000","last_fullsized":"2024-09-17T03:36:45.262421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:28.602443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256080+0000","last_change":"2024-09-17T03:36:44.252818+0000","last_active":"2024-09-17T03:36:45.256080+0000","last_peered":"2024-09-17T03:36:45.256080+0000","last_clean":"2024-09-17T03:36:45.256080+0000","last_became_active":"2024-09-17T03:36:44.252517+0000","last_became_peered":"2024-09-17T03:36:44.252517+0000","last_unstale":"2024-09-17T03:36:45.256080+0000","last_undegraded":"2024-09-17T03:36:45.256080+0000","last_fullsized":"2024-09-17T03:36:45.256080+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:52.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339570+0000","last_change":"2024-09-17T03:36:44.258990+0000","last_active":"2024-09-17T03:36:45.339570+0000","last_peered":"2024-09-17T03:36:45.339570+0000","last_clean":"2024-09-17T03:36:45.339570+0000","last_became_active":"2024-09-17T03:36:44.257521+0000","last_became_peered":"2024-09-17T03:36:44.257521+0000","last_unstale":"2024-09-17T03:36:45.339570+0000","last_undegraded":"2024-09-17T03:36:45.339570+0000","last_fullsized":"2024-09-17T03:36:45.339570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:15.883165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262780+0000","last_change":"2024-09-17T03:36:44.262837+0000","last_active":"2024-09-17T03:36:45.262780+0000","last_peered":"2024-09-17T03:36:45.262780+0000","last_clean":"2024-09-17T03:36:45.262780+0000","last_became_active":"2024-09-17T03:36:44.262509+0000","last_became_peered":"2024-09-17T03:36:44.262509+0000","last_unstale":"2024-09-17T03:36:45.262780+0000","last_undegraded":"2024-09-17T03:36:45.262780+0000","last_fullsized":"2024-09-17T03:36:45.262780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:10.421129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340043+0000","last_change":"2024-09-17T03:36:44.265401+0000","last_active":"2024-09-17T03:36:45.340043+0000","last_peered":"2024-09-17T03:36:45.340043+0000","last_clean":"2024-09-17T03:36:45.340043+0000","last_became_active":"2024-09-17T03:36:44.264977+0000","last_became_peered":"2024-09-17T03:36:44.264977+0000","last_unstale":"2024-09-17T03:36:45.340043+0000","last_undegraded":"2024-09-17T03:36:45.340043+0000","last_fullsized":"2024-09-17T03:36:45.340043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:12.406230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266229+0000","last_change":"2024-09-17T03:36:44.263719+0000","last_active":"2024-09-17T03:36:45.266229+0000","last_peered":"2024-09-17T03:36:45.266229+0000","last_clean":"2024-09-17T03:36:45.266229+0000","last_became_active":"2024-09-17T03:36:44.263036+0000","last_became_peered":"2024-09-17T03:36:44.263036+0000","last_unstale":"2024-09-17T03:36:45.266229+0000","last_undegraded":"2024-09-17T03:36:45.266229+0000","last_fullsized":"2024-09-17T03:36:45.266229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:17.529967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262471+0000","last_change":"2024-09-17T03:36:44.256960+0000","last_active":"2024-09-17T03:36:45.262471+0000","last_peered":"2024-09-17T03:36:45.262471+0000","last_clean":"2024-09-17T03:36:45.262471+0000","last_became_active":"2024-09-17T03:36:44.256672+0000","last_became_peered":"2024-09-17T03:36:44.256672+0000","last_unstale":"2024-09-17T03:36:45.262471+0000","last_undegraded":"2024-09-17T03:36:45.262471+0000","last_fullsized":"2024-09-17T03:36:45.262471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:04.996521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339625+0000","last_change":"2024-09-17T03:36:44.256119+0000","last_active":"2024-09-17T03:36:45.339625+0000","last_peered":"2024-09-17T03:36:45.339625+0000","last_clean":"2024-09-17T03:36:45.339625+0000","last_became_active":"2024-09-17T03:36:44.255740+0000","last_became_peered":"2024-09-17T03:36:44.255740+0000","last_unstale":"2024-09-17T03:36:45.339625+0000","last_undegraded":"2024-09-17T03:36:45.339625+0000","last_fullsized":"2024-09-17T03:36:45.339625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:53.649917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339888+0000","last_change":"2024-09-17T03:36:44.257717+0000","last_active":"2024-09-17T03:36:45.339888+0000","last_peered":"2024-09-17T03:36:45.339888+0000","last_clean":"2024-09-17T03:36:45.339888+0000","last_became_active":"2024-09-17T03:36:44.257422+0000","last_became_peered":"2024-09-17T03:36:44.257422+0000","last_unstale":"2024-09-17T03:36:45.339888+0000","last_undegraded":"2024-09-17T03:36:45.339888+0000","last_fullsized":"2024-09-17T03:36:45.339888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:47.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257792+0000","last_change":"2024-09-17T03:36:44.244112+0000","last_active":"2024-09-17T03:36:45.257792+0000","last_peered":"2024-09-17T03:36:45.257792+0000","last_clean":"2024-09-17T03:36:45.257792+0000","last_became_active":"2024-09-17T03:36:44.243734+0000","last_became_peered":"2024-09-17T03:36:44.243734+0000","last_unstale":"2024-09-17T03:36:45.257792+0000","last_undegraded":"2024-09-17T03:36:45.257792+0000","last_fullsized":"2024-09-17T03:36:45.257792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:10.602532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339489+0000","last_change":"2024-09-17T03:36:44.254142+0000","last_active":"2024-09-17T03:36:45.339489+0000","last_peered":"2024-09-17T03:36:45.339489+0000","last_clean":"2024-09-17T03:36:45.339489+0000","last_became_active":"2024-09-17T03:36:44.253871+0000","last_became_peered":"2024-09-17T03:36:44.253871+0000","last_unstale":"2024-09-17T03:36:45.339489+0000","last_undegraded":"2024-09-17T03:36:45.339489+0000","last_fullsized":"2024-09-17T03:36:45.339489+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:27.123960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258233+0000","last_change":"2024-09-17T03:36:44.267635+0000","last_active":"2024-09-17T03:36:45.258233+0000","last_peered":"2024-09-17T03:36:45.258233+0000","last_clean":"2024-09-17T03:36:45.258233+0000","last_became_active":"2024-09-17T03:36:44.267199+0000","last_became_peered":"2024-09-17T03:36:44.267199+0000","last_unstale":"2024-09-17T03:36:45.258233+0000","last_undegraded":"2024-09-17T03:36:45.258233+0000","last_fullsized":"2024-09-17T03:36:45.258233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:44.085686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258400+0000","last_change":"2024-09-17T03:36:44.249470+0000","last_active":"2024-09-17T03:36:45.258400+0000","last_peered":"2024-09-17T03:36:45.258400+0000","last_clean":"2024-09-17T03:36:45.258400+0000","last_became_active":"2024-09-17T03:36:44.248597+0000","last_became_peered":"2024-09-17T03:36:44.248597+0000","last_unstale":"2024-09-17T03:36:45.258400+0000","last_undegraded":"2024-09-17T03:36:45.258400+0000","last_fullsized":"2024-09-17T03:36:45.258400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:54.287309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340772+0000","last_change":"2024-09-17T03:36:44.262318+0000","last_active":"2024-09-17T03:36:45.340772+0000","last_peered":"2024-09-17T03:36:45.340772+0000","last_clean":"2024-09-17T03:36:45.340772+0000","last_became_active":"2024-09-17T03:36:44.261979+0000","last_became_peered":"2024-09-17T03:36:44.261979+0000","last_unstale":"2024-09-17T03:36:45.340772+0000","last_undegraded":"2024-09-17T03:36:45.340772+0000","last_fullsized":"2024-09-17T03:36:45.340772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:52.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265813+0000","last_change":"2024-09-17T03:36:44.264562+0000","last_active":"2024-09-17T03:36:45.265813+0000","last_peered":"2024-09-17T03:36:45.265813+0000","last_clean":"2024-09-17T03:36:45.265813+0000","last_became_active":"2024-09-17T03:36:44.264273+0000","last_became_peered":"2024-09-17T03:36:44.264273+0000","last_unstale":"2024-09-17T03:36:45.265813+0000","last_undegraded":"2024-09-17T03:36:45.265813+0000","last_fullsized":"2024-09-17T03:36:45.265813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:44.688328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265788+0000","last_change":"2024-09-17T03:36:44.255197+0000","last_active":"2024-09-17T03:36:45.265788+0000","last_peered":"2024-09-17T03:36:45.265788+0000","last_clean":"2024-09-17T03:36:45.265788+0000","last_became_active":"2024-09-17T03:36:44.254536+0000","last_became_peered":"2024-09-17T03:36:44.254536+0000","last_unstale":"2024-09-17T03:36:45.265788+0000","last_undegraded":"2024-09-17T03:36:45.265788+0000","last_fullsized":"2024-09-17T03:36:45.265788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.442706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265693+0000","last_change":"2024-09-17T03:36:44.264660+0000","last_active":"2024-09-17T03:36:45.265693+0000","last_peered":"2024-09-17T03:36:45.265693+0000","last_clean":"2024-09-17T03:36:45.265693+0000","last_became_active":"2024-09-17T03:36:44.257929+0000","last_became_peered":"2024-09-17T03:36:44.257929+0000","last_unstale":"2024-09-17T03:36:45.265693+0000","last_undegraded":"2024-09-17T03:36:45.265693+0000","last_fullsized":"2024-09-17T03:36:45.265693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:34.451288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257806+0000","last_change":"2024-09-17T03:36:44.263605+0000","last_active":"2024-09-17T03:36:45.257806+0000","last_peered":"2024-09-17T03:36:45.257806+0000","last_clean":"2024-09-17T03:36:45.257806+0000","last_became_active":"2024-09-17T03:36:44.255877+0000","last_became_peered":"2024-09-17T03:36:44.255877+0000","last_unstale":"2024-09-17T03:36:45.257806+0000","last_undegraded":"2024-09-17T03:36:45.257806+0000","last_fullsized":"2024-09-17T03:36:45.257806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:03.771519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340781+0000","last_change":"2024-09-17T03:36:44.253003+0000","last_active":"2024-09-17T03:36:45.340781+0000","last_peered":"2024-09-17T03:36:45.340781+0000","last_clean":"2024-09-17T03:36:45.340781+0000","last_became_active":"2024-09-17T03:36:44.252680+0000","last_became_peered":"2024-09-17T03:36:44.252680+0000","last_unstale":"2024-09-17T03:36:45.340781+0000","last_undegraded":"2024-09-17T03:36:45.340781+0000","last_fullsized":"2024-09-17T03:36:45.340781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:43.947306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266123+0000","last_change":"2024-09-17T03:36:44.270263+0000","last_active":"2024-09-17T03:36:45.266123+0000","last_peered":"2024-09-17T03:36:45.266123+0000","last_clean":"2024-09-17T03:36:45.266123+0000","last_became_active":"2024-09-17T03:36:44.269849+0000","last_became_peered":"2024-09-17T03:36:44.269849+0000","last_unstale":"2024-09-17T03:36:45.266123+0000","last_undegraded":"2024-09-17T03:36:45.266123+0000","last_fullsized":"2024-09-17T03:36:45.266123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:34.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340142+0000","last_change":"2024-09-17T03:36:44.257142+0000","last_active":"2024-09-17T03:36:45.340142+0000","last_peered":"2024-09-17T03:36:45.340142+0000","last_clean":"2024-09-17T03:36:45.340142+0000","last_became_active":"2024-09-17T03:36:44.256859+0000","last_became_peered":"2024-09-17T03:36:44.256859+0000","last_unstale":"2024-09-17T03:36:45.340142+0000","last_undegraded":"2024-09-17T03:36:45.340142+0000","last_fullsized":"2024-09-17T03:36:45.340142+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:10.452184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257870+0000","last_change":"2024-09-17T03:36:44.250935+0000","last_active":"2024-09-17T03:36:45.257870+0000","last_peered":"2024-09-17T03:36:45.257870+0000","last_clean":"2024-09-17T03:36:45.257870+0000","last_became_active":"2024-09-17T03:36:44.250594+0000","last_became_peered":"2024-09-17T03:36:44.250594+0000","last_unstale":"2024-09-17T03:36:45.257870+0000","last_undegraded":"2024-09-17T03:36:45.257870+0000","last_fullsized":"2024-09-17T03:36:45.257870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:46.657454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258428+0000","last_change":"2024-09-17T03:36:44.253829+0000","last_active":"2024-09-17T03:36:45.258428+0000","last_peered":"2024-09-17T03:36:45.258428+0000","last_clean":"2024-09-17T03:36:45.258428+0000","last_became_active":"2024-09-17T03:36:44.253489+0000","last_became_peered":"2024-09-17T03:36:44.253489+0000","last_unstale":"2024-09-17T03:36:45.258428+0000","last_undegraded":"2024-09-17T03:36:45.258428+0000","last_fullsized":"2024-09-17T03:36:45.258428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:18.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339864+0000","last_change":"2024-09-17T03:36:44.257862+0000","last_active":"2024-09-17T03:36:45.339864+0000","last_peered":"2024-09-17T03:36:45.339864+0000","last_clean":"2024-09-17T03:36:45.339864+0000","last_became_active":"2024-09-17T03:36:44.256454+0000","last_became_peered":"2024-09-17T03:36:44.256454+0000","last_unstale":"2024-09-17T03:36:45.339864+0000","last_undegraded":"2024-09-17T03:36:45.339864+0000","last_fullsized":"2024-09-17T03:36:45.339864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:31.416993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258326+0000","last_change":"2024-09-17T03:36:44.245754+0000","last_active":"2024-09-17T03:36:45.258326+0000","last_peered":"2024-09-17T03:36:45.258326+0000","last_clean":"2024-09-17T03:36:45.258326+0000","last_became_active":"2024-09-17T03:36:44.245408+0000","last_became_peered":"2024-09-17T03:36:44.245408+0000","last_unstale":"2024-09-17T03:36:45.258326+0000","last_undegraded":"2024-09-17T03:36:45.258326+0000","last_fullsized":"2024-09-17T03:36:45.258326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:44.165481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340900+0000","last_change":"2024-09-17T03:36:43.245126+0000","last_active":"2024-09-17T03:36:45.340900+0000","last_peered":"2024-09-17T03:36:45.340900+0000","last_clean":"2024-09-17T03:36:45.340900+0000","last_became_active":"2024-09-17T03:36:43.244672+0000","last_became_peered":"2024-09-17T03:36:43.244672+0000","last_unstale":"2024-09-17T03:36:45.340900+0000","last_undegraded":"2024-09-17T03:36:45.340900+0000","last_fullsized":"2024-09-17T03:36:45.340900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257397+0000","last_change":"2024-09-17T03:36:44.268310+0000","last_active":"2024-09-17T03:36:45.257397+0000","last_peered":"2024-09-17T03:36:45.257397+0000","last_clean":"2024-09-17T03:36:45.257397+0000","last_became_active":"2024-09-17T03:36:44.265610+0000","last_became_peered":"2024-09-17T03:36:44.265610+0000","last_unstale":"2024-09-17T03:36:45.257397+0000","last_undegraded":"2024-09-17T03:36:45.257397+0000","last_fullsized":"2024-09-17T03:36:45.257397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:24.017008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257820+0000","last_change":"2024-09-17T03:36:43.244589+0000","last_active":"2024-09-17T03:36:45.257820+0000","last_peered":"2024-09-17T03:36:45.257820+0000","last_clean":"2024-09-17T03:36:45.257820+0000","last_became_active":"2024-09-17T03:36:43.244277+0000","last_became_peered":"2024-09-17T03:36:43.244277+0000","last_unstale":"2024-09-17T03:36:45.257820+0000","last_undegraded":"2024-09-17T03:36:45.257820+0000","last_fullsized":"2024-09-17T03:36:45.257820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258699+0000","last_change":"2024-09-17T03:36:44.259012+0000","last_active":"2024-09-17T03:36:45.258699+0000","last_peered":"2024-09-17T03:36:45.258699+0000","last_clean":"2024-09-17T03:36:45.258699+0000","last_became_active":"2024-09-17T03:36:44.258013+0000","last_became_peered":"2024-09-17T03:36:44.258013+0000","last_unstale":"2024-09-17T03:36:45.258699+0000","last_undegraded":"2024-09-17T03:36:45.258699+0000","last_fullsized":"2024-09-17T03:36:45.258699+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:37.644719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.221535+0000","last_change":"2024-09-17T03:36:42.221535+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.221535+0000","last_undegraded":"2024-09-17T03:36:42.221535+0000","last_fullsized":"2024-09-17T03:36:42.221535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258015+0000","last_change":"2024-09-17T03:36:44.265627+0000","last_active":"2024-09-17T03:36:45.258015+0000","last_peered":"2024-09-17T03:36:45.258015+0000","last_clean":"2024-09-17T03:36:45.258015+0000","last_became_active":"2024-09-17T03:36:44.265268+0000","last_became_peered":"2024-09-17T03:36:44.265268+0000","last_unstale":"2024-09-17T03:36:45.258015+0000","last_undegraded":"2024-09-17T03:36:45.258015+0000","last_fullsized":"2024-09-17T03:36:45.258015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:56.232153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340576+0000","last_change":"2024-09-17T03:36:43.243254+0000","last_active":"2024-09-17T03:36:45.340576+0000","last_peered":"2024-09-17T03:36:45.340576+0000","last_clean":"2024-09-17T03:36:45.340576+0000","last_became_active":"2024-09-17T03:36:43.242906+0000","last_became_peered":"2024-09-17T03:36:43.242906+0000","last_unstale":"2024-09-17T03:36:45.340576+0000","last_undegraded":"2024-09-17T03:36:45.340576+0000","last_fullsized":"2024-09-17T03:36:45.340576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340298+0000","last_change":"2024-09-17T03:36:43.239775+0000","last_active":"2024-09-17T03:36:45.340298+0000","last_peered":"2024-09-17T03:36:45.340298+0000","last_clean":"2024-09-17T03:36:45.340298+0000","last_became_active":"2024-09-17T03:36:43.239466+0000","last_became_peered":"2024-09-17T03:36:43.239466+0000","last_unstale":"2024-09-17T03:36:45.340298+0000","last_undegraded":"2024-09-17T03:36:45.340298+0000","last_fullsized":"2024-09-17T03:36:45.340298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:14.876381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265496+0000","last_change":"2024-09-17T03:36:44.257169+0000","last_active":"2024-09-17T03:36:45.265496+0000","last_peered":"2024-09-17T03:36:45.265496+0000","last_clean":"2024-09-17T03:36:45.265496+0000","last_became_active":"2024-09-17T03:36:44.256569+0000","last_became_peered":"2024-09-17T03:36:44.256569+0000","last_unstale":"2024-09-17T03:36:45.265496+0000","last_undegraded":"2024-09-17T03:36:45.265496+0000","last_fullsized":"2024-09-17T03:36:45.265496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:36.847491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339665+0000","last_change":"2024-09-17T03:36:43.238069+0000","last_active":"2024-09-17T03:36:45.339665+0000","last_peered":"2024-09-17T03:36:45.339665+0000","last_clean":"2024-09-17T03:36:45.339665+0000","last_became_active":"2024-09-17T03:36:43.237720+0000","last_became_peered":"2024-09-17T03:36:43.237720+0000","last_unstale":"2024-09-17T03:36:45.339665+0000","last_undegraded":"2024-09-17T03:36:45.339665+0000","last_fullsized":"2024-09-17T03:36:45.339665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:46.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257884+0000","last_change":"2024-09-17T03:36:44.265836+0000","last_active":"2024-09-17T03:36:45.257884+0000","last_peered":"2024-09-17T03:36:45.257884+0000","last_clean":"2024-09-17T03:36:45.257884+0000","last_became_active":"2024-09-17T03:36:44.265525+0000","last_became_peered":"2024-09-17T03:36:44.265525+0000","last_unstale":"2024-09-17T03:36:45.257884+0000","last_undegraded":"2024-09-17T03:36:45.257884+0000","last_fullsized":"2024-09-17T03:36:45.257884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:08.571368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.220650+0000","last_change":"2024-09-17T03:36:42.220650+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.220650+0000","last_undegraded":"2024-09-17T03:36:42.220650+0000","last_fullsized":"2024-09-17T03:36:42.220650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258114+0000","last_change":"2024-09-17T03:36:44.258467+0000","last_active":"2024-09-17T03:36:45.258114+0000","last_peered":"2024-09-17T03:36:45.258114+0000","last_clean":"2024-09-17T03:36:45.258114+0000","last_became_active":"2024-09-17T03:36:44.258054+0000","last_became_peered":"2024-09-17T03:36:44.258054+0000","last_unstale":"2024-09-17T03:36:45.258114+0000","last_undegraded":"2024-09-17T03:36:45.258114+0000","last_fullsized":"2024-09-17T03:36:45.258114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:53.739833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339566+0000","last_change":"2024-09-17T03:36:43.242724+0000","last_active":"2024-09-17T03:36:45.339566+0000","last_peered":"2024-09-17T03:36:45.339566+0000","last_clean":"2024-09-17T03:36:45.339566+0000","last_became_active":"2024-09-17T03:36:43.242438+0000","last_became_peered":"2024-09-17T03:36:43.242438+0000","last_unstale":"2024-09-17T03:36:45.339566+0000","last_undegraded":"2024-09-17T03:36:45.339566+0000","last_fullsized":"2024-09-17T03:36:45.339566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:51.471274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.222663+0000","last_change":"2024-09-17T03:36:42.222663+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.222663+0000","last_undegraded":"2024-09-17T03:36:42.222663+0000","last_fullsized":"2024-09-17T03:36:42.222663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340631+0000","last_change":"2024-09-17T03:36:44.266455+0000","last_active":"2024-09-17T03:36:45.340631+0000","last_peered":"2024-09-17T03:36:45.340631+0000","last_clean":"2024-09-17T03:36:45.340631+0000","last_became_active":"2024-09-17T03:36:44.266153+0000","last_became_peered":"2024-09-17T03:36:44.266153+0000","last_unstale":"2024-09-17T03:36:45.340631+0000","last_undegraded":"2024-09-17T03:36:45.340631+0000","last_fullsized":"2024-09-17T03:36:45.340631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:01.286771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258504+0000","last_change":"2024-09-17T03:36:43.251663+0000","last_active":"2024-09-17T03:36:45.258504+0000","last_peered":"2024-09-17T03:36:45.258504+0000","last_clean":"2024-09-17T03:36:45.258504+0000","last_became_active":"2024-09-17T03:36:43.249590+0000","last_became_peered":"2024-09-17T03:36:43.249590+0000","last_unstale":"2024-09-17T03:36:45.258504+0000","last_undegraded":"2024-09-17T03:36:45.258504+0000","last_fullsized":"2024-09-17T03:36:45.258504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:28.331414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257931+0000","last_change":"2024-09-17T03:36:43.250402+0000","last_active":"2024-09-17T03:36:45.257931+0000","last_peered":"2024-09-17T03:36:45.257931+0000","last_clean":"2024-09-17T03:36:45.257931+0000","last_became_active":"2024-09-17T03:36:43.250094+0000","last_became_peered":"2024-09-17T03:36:43.250094+0000","last_unstale":"2024-09-17T03:36:45.257931+0000","last_undegraded":"2024-09-17T03:36:45.257931+0000","last_fullsized":"2024-09-17T03:36:45.257931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:04.120350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340018+0000","last_change":"2024-09-17T03:36:44.256373+0000","last_active":"2024-09-17T03:36:45.340018+0000","last_peered":"2024-09-17T03:36:45.340018+0000","last_clean":"2024-09-17T03:36:45.340018+0000","last_became_active":"2024-09-17T03:36:44.256013+0000","last_became_peered":"2024-09-17T03:36:44.256013+0000","last_unstale":"2024-09-17T03:36:45.340018+0000","last_undegraded":"2024-09-17T03:36:45.340018+0000","last_fullsized":"2024-09-17T03:36:45.340018+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:05.669667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.222177+0000","last_change":"2024-09-17T03:36:42.222177+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.222177+0000","last_undegraded":"2024-09-17T03:36:42.222177+0000","last_fullsized":"2024-09-17T03:36:42.222177+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.221723+0000","last_change":"2024-09-17T03:36:42.221723+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.221723+0000","last_undegraded":"2024-09-17T03:36:42.221723+0000","last_fullsized":"2024-09-17T03:36:42.221723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256090+0000","last_change":"2024-09-17T03:36:44.257966+0000","last_active":"2024-09-17T03:36:45.256090+0000","last_peered":"2024-09-17T03:36:45.256090+0000","last_clean":"2024-09-17T03:36:45.256090+0000","last_became_active":"2024-09-17T03:36:44.257627+0000","last_became_peered":"2024-09-17T03:36:44.257627+0000","last_unstale":"2024-09-17T03:36:45.256090+0000","last_undegraded":"2024-09-17T03:36:45.256090+0000","last_fullsized":"2024-09-17T03:36:45.256090+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:07.526657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257449+0000","last_change":"2024-09-17T03:36:43.242166+0000","last_active":"2024-09-17T03:36:45.257449+0000","last_peered":"2024-09-17T03:36:45.257449+0000","last_clean":"2024-09-17T03:36:45.257449+0000","last_became_active":"2024-09-17T03:36:43.241720+0000","last_became_peered":"2024-09-17T03:36:43.241720+0000","last_unstale":"2024-09-17T03:36:45.257449+0000","last_undegraded":"2024-09-17T03:36:45.257449+0000","last_fullsized":"2024-09-17T03:36:45.257449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:30.410210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265941+0000","last_change":"2024-09-17T03:36:44.253537+0000","last_active":"2024-09-17T03:36:45.265941+0000","last_peered":"2024-09-17T03:36:45.265941+0000","last_clean":"2024-09-17T03:36:45.265941+0000","last_became_active":"2024-09-17T03:36:44.253232+0000","last_became_peered":"2024-09-17T03:36:44.253232+0000","last_unstale":"2024-09-17T03:36:45.265941+0000","last_undegraded":"2024-09-17T03:36:45.265941+0000","last_fullsized":"2024-09-17T03:36:45.265941+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:20.976361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258034+0000","last_change":"2024-09-17T03:36:43.245321+0000","last_active":"2024-09-17T03:36:45.258034+0000","last_peered":"2024-09-17T03:36:45.258034+0000","last_clean":"2024-09-17T03:36:45.258034+0000","last_became_active":"2024-09-17T03:36:43.245000+0000","last_became_peered":"2024-09-17T03:36:43.245000+0000","last_unstale":"2024-09-17T03:36:45.258034+0000","last_undegraded":"2024-09-17T03:36:45.258034+0000","last_fullsized":"2024-09-17T03:36:45.258034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:06.451160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262584+0000","last_change":"2024-09-17T03:36:44.255583+0000","last_active":"2024-09-17T03:36:45.262584+0000","last_peered":"2024-09-17T03:36:45.262584+0000","last_clean":"2024-09-17T03:36:45.262584+0000","last_became_active":"2024-09-17T03:36:44.255259+0000","last_became_peered":"2024-09-17T03:36:44.255259+0000","last_unstale":"2024-09-17T03:36:45.262584+0000","last_undegraded":"2024-09-17T03:36:45.262584+0000","last_fullsized":"2024-09-17T03:36:45.262584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:14.932088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339312+0000","last_change":"2024-09-17T03:36:43.239640+0000","last_active":"2024-09-17T03:36:45.339312+0000","last_peered":"2024-09-17T03:36:45.339312+0000","last_clean":"2024-09-17T03:36:45.339312+0000","last_became_active":"2024-09-17T03:36:43.239321+0000","last_became_peered":"2024-09-17T03:36:43.239321+0000","last_unstale":"2024-09-17T03:36:45.339312+0000","last_undegraded":"2024-09-17T03:36:45.339312+0000","last_fullsized":"2024-09-17T03:36:45.339312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:30.410210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257073+0000","last_change":"2024-09-17T03:36:44.260816+0000","last_active":"2024-09-17T03:36:45.257073+0000","last_peered":"2024-09-17T03:36:45.257073+0000","last_clean":"2024-09-17T03:36:45.257073+0000","last_became_active":"2024-09-17T03:36:44.260481+0000","last_became_peered":"2024-09-17T03:36:44.260481+0000","last_unstale":"2024-09-17T03:36:45.257073+0000","last_undegraded":"2024-09-17T03:36:45.257073+0000","last_fullsized":"2024-09-17T03:36:45.257073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:04.179982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340101+0000","last_change":"2024-09-17T03:36:43.250977+0000","last_active":"2024-09-17T03:36:45.340101+0000","last_peered":"2024-09-17T03:36:45.340101+0000","last_clean":"2024-09-17T03:36:45.340101+0000","last_became_active":"2024-09-17T03:36:43.250638+0000","last_became_peered":"2024-09-17T03:36:43.250638+0000","last_unstale":"2024-09-17T03:36:45.340101+0000","last_undegraded":"2024-09-17T03:36:45.340101+0000","last_fullsized":"2024-09-17T03:36:45.340101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:54.928131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340247+0000","last_change":"2024-09-17T03:36:44.261046+0000","last_active":"2024-09-17T03:36:45.340247+0000","last_peered":"2024-09-17T03:36:45.340247+0000","last_clean":"2024-09-17T03:36:45.340247+0000","last_became_active":"2024-09-17T03:36:44.260749+0000","last_became_peered":"2024-09-17T03:36:44.260749+0000","last_unstale":"2024-09-17T03:36:45.340247+0000","last_undegraded":"2024-09-17T03:36:45.340247+0000","last_fullsized":"2024-09-17T03:36:45.340247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:47.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258597+0000","last_change":"2024-09-17T03:36:43.248274+0000","last_active":"2024-09-17T03:36:45.258597+0000","last_peered":"2024-09-17T03:36:45.258597+0000","last_clean":"2024-09-17T03:36:45.258597+0000","last_became_active":"2024-09-17T03:36:43.247287+0000","last_became_peered":"2024-09-17T03:36:43.247287+0000","last_unstale":"2024-09-17T03:36:45.258597+0000","last_undegraded":"2024-09-17T03:36:45.258597+0000","last_fullsized":"2024-09-17T03:36:45.258597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:08.860204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340228+0000","last_change":"2024-09-17T03:36:44.260449+0000","last_active":"2024-09-17T03:36:45.340228+0000","last_peered":"2024-09-17T03:36:45.340228+0000","last_clean":"2024-09-17T03:36:45.340228+0000","last_became_active":"2024-09-17T03:36:44.260163+0000","last_became_peered":"2024-09-17T03:36:44.260163+0000","last_unstale":"2024-09-17T03:36:45.340228+0000","last_undegraded":"2024-09-17T03:36:45.340228+0000","last_fullsized":"2024-09-17T03:36:45.340228+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:49.493460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262410+0000","last_change":"2024-09-17T03:36:43.242358+0000","last_active":"2024-09-17T03:36:45.262410+0000","last_peered":"2024-09-17T03:36:45.262410+0000","last_clean":"2024-09-17T03:36:45.262410+0000","last_became_active":"2024-09-17T03:36:43.241998+0000","last_became_peered":"2024-09-17T03:36:43.241998+0000","last_unstale":"2024-09-17T03:36:45.262410+0000","last_undegraded":"2024-09-17T03:36:45.262410+0000","last_fullsized":"2024-09-17T03:36:45.262410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:02.266116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340839+0000","last_change":"2024-09-17T03:36:44.255735+0000","last_active":"2024-09-17T03:36:45.340839+0000","last_peered":"2024-09-17T03:36:45.340839+0000","last_clean":"2024-09-17T03:36:45.340839+0000","last_became_active":"2024-09-17T03:36:44.254710+0000","last_became_peered":"2024-09-17T03:36:44.254710+0000","last_unstale":"2024-09-17T03:36:45.340839+0000","last_undegraded":"2024-09-17T03:36:45.340839+0000","last_fullsized":"2024-09-17T03:36:45.340839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:14.497107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340523+0000","last_change":"2024-09-17T03:36:43.246790+0000","last_active":"2024-09-17T03:36:45.340523+0000","last_peered":"2024-09-17T03:36:45.340523+0000","last_clean":"2024-09-17T03:36:45.340523+0000","last_became_active":"2024-09-17T03:36:43.246506+0000","last_became_peered":"2024-09-17T03:36:43.246506+0000","last_unstale":"2024-09-17T03:36:45.340523+0000","last_undegraded":"2024-09-17T03:36:45.340523+0000","last_fullsized":"2024-09-17T03:36:45.340523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:36.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257782+0000","last_change":"2024-09-17T03:36:44.251074+0000","last_active":"2024-09-17T03:36:45.257782+0000","last_peered":"2024-09-17T03:36:45.257782+0000","last_clean":"2024-09-17T03:36:45.257782+0000","last_became_active":"2024-09-17T03:36:44.249327+0000","last_became_peered":"2024-09-17T03:36:44.249327+0000","last_unstale":"2024-09-17T03:36:45.257782+0000","last_undegraded":"2024-09-17T03:36:45.257782+0000","last_fullsized":"2024-09-17T03:36:45.257782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:12.553359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340586+0000","last_change":"2024-09-17T03:36:43.244507+0000","last_active":"2024-09-17T03:36:45.340586+0000","last_peered":"2024-09-17T03:36:45.340586+0000","last_clean":"2024-09-17T03:36:45.340586+0000","last_became_active":"2024-09-17T03:36:43.244138+0000","last_became_peered":"2024-09-17T03:36:43.244138+0000","last_unstale":"2024-09-17T03:36:45.340586+0000","last_undegraded":"2024-09-17T03:36:45.340586+0000","last_fullsized":"2024-09-17T03:36:45.340586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:37.711102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257330+0000","last_change":"2024-09-17T03:36:43.245115+0000","last_active":"2024-09-17T03:36:45.257330+0000","last_peered":"2024-09-17T03:36:45.257330+0000","last_clean":"2024-09-17T03:36:45.257330+0000","last_became_active":"2024-09-17T03:36:43.244800+0000","last_became_peered":"2024-09-17T03:36:43.244800+0000","last_unstale":"2024-09-17T03:36:45.257330+0000","last_undegraded":"2024-09-17T03:36:45.257330+0000","last_fullsized":"2024-09-17T03:36:45.257330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265952+0000","last_change":"2024-09-17T03:36:44.263078+0000","last_active":"2024-09-17T03:36:45.265952+0000","last_peered":"2024-09-17T03:36:45.265952+0000","last_clean":"2024-09-17T03:36:45.265952+0000","last_became_active":"2024-09-17T03:36:44.262753+0000","last_became_peered":"2024-09-17T03:36:44.262753+0000","last_unstale":"2024-09-17T03:36:45.265952+0000","last_undegraded":"2024-09-17T03:36:45.265952+0000","last_fullsized":"2024-09-17T03:36:45.265952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:52.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339783+0000","last_change":"2024-09-17T03:36:43.245006+0000","last_active":"2024-09-17T03:36:45.339783+0000","last_peered":"2024-09-17T03:36:45.339783+0000","last_clean":"2024-09-17T03:36:45.339783+0000","last_became_active":"2024-09-17T03:36:43.244723+0000","last_became_peered":"2024-09-17T03:36:43.244723+0000","last_unstale":"2024-09-17T03:36:45.339783+0000","last_undegraded":"2024-09-17T03:36:45.339783+0000","last_fullsized":"2024-09-17T03:36:45.339783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.555456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255636+0000","last_change":"2024-09-17T03:36:43.246360+0000","last_active":"2024-09-17T03:36:45.255636+0000","last_peered":"2024-09-17T03:36:45.255636+0000","last_clean":"2024-09-17T03:36:45.255636+0000","last_became_active":"2024-09-17T03:36:43.243140+0000","last_became_peered":"2024-09-17T03:36:43.243140+0000","last_unstale":"2024-09-17T03:36:45.255636+0000","last_undegraded":"2024-09-17T03:36:45.255636+0000","last_fullsized":"2024-09-17T03:36:45.255636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:14.876381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262543+0000","last_change":"2024-09-17T03:36:44.265309+0000","last_active":"2024-09-17T03:36:45.262543+0000","last_peered":"2024-09-17T03:36:45.262543+0000","last_clean":"2024-09-17T03:36:45.262543+0000","last_became_active":"2024-09-17T03:36:44.264925+0000","last_became_peered":"2024-09-17T03:36:44.264925+0000","last_unstale":"2024-09-17T03:36:45.262543+0000","last_undegraded":"2024-09-17T03:36:45.262543+0000","last_fullsized":"2024-09-17T03:36:45.262543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:35.512783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258272+0000","last_change":"2024-09-17T03:36:43.249727+0000","last_active":"2024-09-17T03:36:45.258272+0000","last_peered":"2024-09-17T03:36:45.258272+0000","last_clean":"2024-09-17T03:36:45.258272+0000","last_became_active":"2024-09-17T03:36:43.249376+0000","last_became_peered":"2024-09-17T03:36:43.249376+0000","last_unstale":"2024-09-17T03:36:45.258272+0000","last_undegraded":"2024-09-17T03:36:45.258272+0000","last_fullsized":"2024-09-17T03:36:45.258272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:13.054687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266096+0000","last_change":"2024-09-17T03:36:44.269381+0000","last_active":"2024-09-17T03:36:45.266096+0000","last_peered":"2024-09-17T03:36:45.266096+0000","last_clean":"2024-09-17T03:36:45.266096+0000","last_became_active":"2024-09-17T03:36:44.264227+0000","last_became_peered":"2024-09-17T03:36:44.264227+0000","last_unstale":"2024-09-17T03:36:45.266096+0000","last_undegraded":"2024-09-17T03:36:45.266096+0000","last_fullsized":"2024-09-17T03:36:45.266096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:56.489758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.264284+0000","last_change":"2024-09-17T03:36:43.242092+0000","last_active":"2024-09-17T03:36:45.264284+0000","last_peered":"2024-09-17T03:36:45.264284+0000","last_clean":"2024-09-17T03:36:45.264284+0000","last_became_active":"2024-09-17T03:36:43.241759+0000","last_became_peered":"2024-09-17T03:36:43.241759+0000","last_unstale":"2024-09-17T03:36:45.264284+0000","last_undegraded":"2024-09-17T03:36:45.264284+0000","last_fullsized":"2024-09-17T03:36:45.264284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:30.046741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340741+0000","last_change":"2024-09-17T03:36:44.273690+0000","last_active":"2024-09-17T03:36:45.340741+0000","last_peered":"2024-09-17T03:36:45.340741+0000","last_clean":"2024-09-17T03:36:45.340741+0000","last_became_active":"2024-09-17T03:36:44.273364+0000","last_became_peered":"2024-09-17T03:36:44.273364+0000","last_unstale":"2024-09-17T03:36:45.340741+0000","last_undegraded":"2024-09-17T03:36:45.340741+0000","last_fullsized":"2024-09-17T03:36:45.340741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:37.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262362+0000","last_change":"2024-09-17T03:36:43.233724+0000","last_active":"2024-09-17T03:36:45.262362+0000","last_peered":"2024-09-17T03:36:45.262362+0000","last_clean":"2024-09-17T03:36:45.262362+0000","last_became_active":"2024-09-17T03:36:43.232853+0000","last_became_peered":"2024-09-17T03:36:43.232853+0000","last_unstale":"2024-09-17T03:36:45.262362+0000","last_undegraded":"2024-09-17T03:36:45.262362+0000","last_fullsized":"2024-09-17T03:36:45.262362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:10.474554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262290+0000","last_change":"2024-09-17T03:36:44.256195+0000","last_active":"2024-09-17T03:36:45.262290+0000","last_peered":"2024-09-17T03:36:45.262290+0000","last_clean":"2024-09-17T03:36:45.262290+0000","last_became_active":"2024-09-17T03:36:44.255895+0000","last_became_peered":"2024-09-17T03:36:44.255895+0000","last_unstale":"2024-09-17T03:36:45.262290+0000","last_undegraded":"2024-09-17T03:36:45.262290+0000","last_fullsized":"2024-09-17T03:36:45.262290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:54.588941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.220582+0000","last_change":"2024-09-17T03:36:42.220582+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.220582+0000","last_undegraded":"2024-09-17T03:36:42.220582+0000","last_fullsized":"2024-09-17T03:36:42.220582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257954+0000","last_change":"2024-09-17T03:36:44.251549+0000","last_active":"2024-09-17T03:36:45.257954+0000","last_peered":"2024-09-17T03:36:45.257954+0000","last_clean":"2024-09-17T03:36:45.257954+0000","last_became_active":"2024-09-17T03:36:44.249170+0000","last_became_peered":"2024-09-17T03:36:44.249170+0000","last_unstale":"2024-09-17T03:36:45.257954+0000","last_undegraded":"2024-09-17T03:36:45.257954+0000","last_fullsized":"2024-09-17T03:36:45.257954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.234298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266059+0000","last_change":"2024-09-17T03:36:43.250361+0000","last_active":"2024-09-17T03:36:45.266059+0000","last_peered":"2024-09-17T03:36:45.266059+0000","last_clean":"2024-09-17T03:36:45.266059+0000","last_became_active":"2024-09-17T03:36:43.250046+0000","last_became_peered":"2024-09-17T03:36:43.250046+0000","last_unstale":"2024-09-17T03:36:45.266059+0000","last_undegraded":"2024-09-17T03:36:45.266059+0000","last_fullsized":"2024-09-17T03:36:45.266059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:13.925305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258201+0000","last_change":"2024-09-17T03:36:44.245554+0000","last_active":"2024-09-17T03:36:45.258201+0000","last_peered":"2024-09-17T03:36:45.258201+0000","last_clean":"2024-09-17T03:36:45.258201+0000","last_became_active":"2024-09-17T03:36:44.243706+0000","last_became_peered":"2024-09-17T03:36:44.243706+0000","last_unstale":"2024-09-17T03:36:45.258201+0000","last_undegraded":"2024-09-17T03:36:45.258201+0000","last_fullsized":"2024-09-17T03:36:45.258201+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:57.050681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258133+0000","last_change":"2024-09-17T03:36:43.251317+0000","last_active":"2024-09-17T03:36:45.258133+0000","last_peered":"2024-09-17T03:36:45.258133+0000","last_clean":"2024-09-17T03:36:45.258133+0000","last_became_active":"2024-09-17T03:36:43.250948+0000","last_became_peered":"2024-09-17T03:36:43.250948+0000","last_unstale":"2024-09-17T03:36:45.258133+0000","last_undegraded":"2024-09-17T03:36:45.258133+0000","last_fullsized":"2024-09-17T03:36:45.258133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:14.413534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265908+0000","last_change":"2024-09-17T03:36:44.254879+0000","last_active":"2024-09-17T03:36:45.265908+0000","last_peered":"2024-09-17T03:36:45.265908+0000","last_clean":"2024-09-17T03:36:45.265908+0000","last_became_active":"2024-09-17T03:36:44.254211+0000","last_became_peered":"2024-09-17T03:36:44.254211+0000","last_unstale":"2024-09-17T03:36:45.265908+0000","last_undegraded":"2024-09-17T03:36:45.265908+0000","last_fullsized":"2024-09-17T03:36:45.265908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:25.422746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.220998+0000","last_change":"2024-09-17T03:36:42.220998+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.220998+0000","last_undegraded":"2024-09-17T03:36:42.220998+0000","last_fullsized":"2024-09-17T03:36:42.220998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258159+0000","last_change":"2024-09-17T03:36:44.250558+0000","last_active":"2024-09-17T03:36:45.258159+0000","last_peered":"2024-09-17T03:36:45.258159+0000","last_clean":"2024-09-17T03:36:45.258159+0000","last_became_active":"2024-09-17T03:36:44.250256+0000","last_became_peered":"2024-09-17T03:36:44.250256+0000","last_unstale":"2024-09-17T03:36:45.258159+0000","last_undegraded":"2024-09-17T03:36:45.258159+0000","last_fullsized":"2024-09-17T03:36:45.258159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:16.391925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265969+0000","last_change":"2024-09-17T03:36:43.250824+0000","last_active":"2024-09-17T03:36:45.265969+0000","last_peered":"2024-09-17T03:36:45.265969+0000","last_clean":"2024-09-17T03:36:45.265969+0000","last_became_active":"2024-09-17T03:36:43.250296+0000","last_became_peered":"2024-09-17T03:36:43.250296+0000","last_unstale":"2024-09-17T03:36:45.265969+0000","last_undegraded":"2024-09-17T03:36:45.265969+0000","last_fullsized":"2024-09-17T03:36:45.265969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:34.505999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339553+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:36:45.339553+0000","last_peered":"2024-09-17T03:36:45.339553+0000","last_clean":"2024-09-17T03:36:45.339553+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:36:45.339553+0000","last_undegraded":"2024-09-17T03:36:45.339553+0000","last_fullsized":"2024-09-17T03:36:45.339553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":102,"acting":102,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":188124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":779040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":188180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":196976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":778480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":194874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":405504,"data_stored":168047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:48.661 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.919+0000 7fb999c00640 1 -- 172.21.15.121:0/862818761 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb99415ebc0 msgr2=0x7fb9940b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.919+0000 7fb999c00640 1 --2- 172.21.15.121:0/862818761 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb99415ebc0 0x7fb9940b4e90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb99406a070 tx=0x7fb97c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.919+0000 7fb999c00640 1 -- 172.21.15.121:0/862818761 shutdown_connections 2024-09-17T03:36:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.919+0000 7fb999c00640 1 --2- 172.21.15.121:0/862818761 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9941621b0 0x7fb9940b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.919+0000 7fb999c00640 1 --2- 172.21.15.121:0/862818761 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb99415ebc0 0x7fb9940b4e90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.919+0000 7fb999c00640 1 --2- 172.21.15.121:0/862818761 >> v2:172.21.15.176:3300/0 conn(0x7fb994162df0 0x7fb9940cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.919+0000 7fb999c00640 1 -- 172.21.15.121:0/862818761 >> 172.21.15.121:0/862818761 conn(0x7fb9940b3b30 msgr2=0x7fb9940b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.919+0000 7fb999c00640 1 -- 172.21.15.121:0/862818761 shutdown_connections 2024-09-17T03:36:48.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.919+0000 7fb999c00640 1 -- 172.21.15.121:0/862818761 wait complete. 2024-09-17T03:36:48.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.921+0000 7fb999c00640 1 Processor -- start 2024-09-17T03:36:48.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.921+0000 7fb999c00640 1 -- start start 2024-09-17T03:36:48.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb999c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb99415ebc0 0x7fb9941f9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb999c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9941621b0 0x7fb9940c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb999c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb994162df0 0x7fb9941532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb999c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb9940b75d0 con 0x7fb9941621b0 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb999c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9940b7450 con 0x7fb99415ebc0 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb999c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb9940b7750 con 0x7fb994162df0 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb98b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9941621b0 0x7fb9940c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb98b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9941621b0 0x7fb9940c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46200/0 (socket says 172.21.15.121:46200) 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb98b400640 1 -- 172.21.15.121:0/2315964868 learned_addr learned my addr 172.21.15.121:0/2315964868 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb993e00640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb99415ebc0 0x7fb9941f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.923+0000 7fb999200640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb994162df0 0x7fb9941532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb98b400640 1 -- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb994162df0 msgr2=0x7fb9941532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb98b400640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb994162df0 0x7fb9941532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb98b400640 1 -- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb99415ebc0 msgr2=0x7fb9941f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb98b400640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb99415ebc0 0x7fb9941f9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb98b400640 1 -- 172.21.15.121:0/2315964868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9940c8470 con 0x7fb9941621b0 2024-09-17T03:36:48.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb98b400640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9941621b0 0x7fb9940c5b70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb97c034040 tx=0x7fb97c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:48.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb990c00640 1 -- 172.21.15.121:0/2315964868 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c03e030 con 0x7fb9941621b0 2024-09-17T03:36:48.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb990c00640 1 -- 172.21.15.121:0/2315964868 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb97c003ca0 con 0x7fb9941621b0 2024-09-17T03:36:48.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb990c00640 1 -- 172.21.15.121:0/2315964868 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c035040 con 0x7fb9941621b0 2024-09-17T03:36:48.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb999c00640 1 -- 172.21.15.121:0/2315964868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9940c8750 con 0x7fb9941621b0 2024-09-17T03:36:48.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.924+0000 7fb999c00640 1 -- 172.21.15.121:0/2315964868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9941f9440 con 0x7fb9941621b0 2024-09-17T03:36:48.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.925+0000 7fb999c00640 1 -- 172.21.15.121:0/2315964868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9940b7ce0 con 0x7fb9941621b0 2024-09-17T03:36:48.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.926+0000 7fb990c00640 1 -- 172.21.15.121:0/2315964868 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb97c041030 con 0x7fb9941621b0 2024-09-17T03:36:48.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.927+0000 7fb990c00640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb970078bc0 0x7fb97007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.928+0000 7fb990c00640 1 -- 172.21.15.121:0/2315964868 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fb97c0bb610 con 0x7fb9941621b0 2024-09-17T03:36:48.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.928+0000 7fb993e00640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb970078bc0 0x7fb97007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.929+0000 7fb993e00640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb970078bc0 0x7fb97007b0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb984009ac0 tx=0x7fb984005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:48.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:48.932+0000 7fb990c00640 1 -- 172.21.15.121:0/2315964868 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb97c083830 con 0x7fb9941621b0 2024-09-17T03:36:49.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.111+0000 7fb999c00640 1 -- 172.21.15.121:0/2315964868 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9940cc110 con 0x7fb970078bc0 2024-09-17T03:36:49.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.117+0000 7fb990c00640 1 -- 172.21.15.121:0/2315964868 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249630 (secure 0 0 0) 0x7fb9940cc110 con 0x7fb970078bc0 2024-09-17T03:36:49.119 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:49.121 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:36:49.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.120+0000 7fb999c00640 1 -- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb970078bc0 msgr2=0x7fb97007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.120+0000 7fb999c00640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb970078bc0 0x7fb97007b0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb984009ac0 tx=0x7fb984005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:49.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.120+0000 7fb999c00640 1 -- 172.21.15.121:0/2315964868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9941621b0 msgr2=0x7fb9940c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.120+0000 7fb999c00640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9941621b0 0x7fb9940c5b70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb97c034040 tx=0x7fb97c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.120+0000 7fb999c00640 1 -- 172.21.15.121:0/2315964868 shutdown_connections 2024-09-17T03:36:49.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.120+0000 7fb999c00640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb994162df0 0x7fb9941532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.120+0000 7fb999c00640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb970078bc0 0x7fb97007b0d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.120+0000 7fb999c00640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9941621b0 0x7fb9940c5b70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.120+0000 7fb999c00640 1 --2- 172.21.15.121:0/2315964868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb99415ebc0 0x7fb9941f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.120+0000 7fb999c00640 1 -- 172.21.15.121:0/2315964868 >> 172.21.15.121:0/2315964868 conn(0x7fb9940b3b30 msgr2=0x7fb9940ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:49.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.121+0000 7fb999c00640 1 -- 172.21.15.121:0/2315964868 shutdown_connections 2024-09-17T03:36:49.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.121+0000 7fb999c00640 1 -- 172.21.15.121:0/2315964868 wait complete. 2024-09-17T03:36:49.142 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-09-17T03:36:47.297374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220940,"kb_used_data":4660,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753780,"statfs":{"total":773094113280,"available":772867870720,"internally_reserved":0,"allocated":4771840,"data_stored":2688573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.079846"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257666+0000","last_change":"2024-09-17T03:36:44.254536+0000","last_active":"2024-09-17T03:36:45.257666+0000","last_peered":"2024-09-17T03:36:45.257666+0000","last_clean":"2024-09-17T03:36:45.257666+0000","last_became_active":"2024-09-17T03:36:44.253988+0000","last_became_peered":"2024-09-17T03:36:44.253988+0000","last_unstale":"2024-09-17T03:36:45.257666+0000","last_undegraded":"2024-09-17T03:36:45.257666+0000","last_fullsized":"2024-09-17T03:36:45.257666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:13.241349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262421+0000","last_change":"2024-09-17T03:36:44.270961+0000","last_active":"2024-09-17T03:36:45.262421+0000","last_peered":"2024-09-17T03:36:45.262421+0000","last_clean":"2024-09-17T03:36:45.262421+0000","last_became_active":"2024-09-17T03:36:44.270715+0000","last_became_peered":"2024-09-17T03:36:44.270715+0000","last_unstale":"2024-09-17T03:36:45.262421+0000","last_undegraded":"2024-09-17T03:36:45.262421+0000","last_fullsized":"2024-09-17T03:36:45.262421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:28.602443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256080+0000","last_change":"2024-09-17T03:36:44.252818+0000","last_active":"2024-09-17T03:36:45.256080+0000","last_peered":"2024-09-17T03:36:45.256080+0000","last_clean":"2024-09-17T03:36:45.256080+0000","last_became_active":"2024-09-17T03:36:44.252517+0000","last_became_peered":"2024-09-17T03:36:44.252517+0000","last_unstale":"2024-09-17T03:36:45.256080+0000","last_undegraded":"2024-09-17T03:36:45.256080+0000","last_fullsized":"2024-09-17T03:36:45.256080+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:52.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339570+0000","last_change":"2024-09-17T03:36:44.258990+0000","last_active":"2024-09-17T03:36:45.339570+0000","last_peered":"2024-09-17T03:36:45.339570+0000","last_clean":"2024-09-17T03:36:45.339570+0000","last_became_active":"2024-09-17T03:36:44.257521+0000","last_became_peered":"2024-09-17T03:36:44.257521+0000","last_unstale":"2024-09-17T03:36:45.339570+0000","last_undegraded":"2024-09-17T03:36:45.339570+0000","last_fullsized":"2024-09-17T03:36:45.339570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:15.883165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262780+0000","last_change":"2024-09-17T03:36:44.262837+0000","last_active":"2024-09-17T03:36:45.262780+0000","last_peered":"2024-09-17T03:36:45.262780+0000","last_clean":"2024-09-17T03:36:45.262780+0000","last_became_active":"2024-09-17T03:36:44.262509+0000","last_became_peered":"2024-09-17T03:36:44.262509+0000","last_unstale":"2024-09-17T03:36:45.262780+0000","last_undegraded":"2024-09-17T03:36:45.262780+0000","last_fullsized":"2024-09-17T03:36:45.262780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:10.421129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340043+0000","last_change":"2024-09-17T03:36:44.265401+0000","last_active":"2024-09-17T03:36:45.340043+0000","last_peered":"2024-09-17T03:36:45.340043+0000","last_clean":"2024-09-17T03:36:45.340043+0000","last_became_active":"2024-09-17T03:36:44.264977+0000","last_became_peered":"2024-09-17T03:36:44.264977+0000","last_unstale":"2024-09-17T03:36:45.340043+0000","last_undegraded":"2024-09-17T03:36:45.340043+0000","last_fullsized":"2024-09-17T03:36:45.340043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:12.406230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266229+0000","last_change":"2024-09-17T03:36:44.263719+0000","last_active":"2024-09-17T03:36:45.266229+0000","last_peered":"2024-09-17T03:36:45.266229+0000","last_clean":"2024-09-17T03:36:45.266229+0000","last_became_active":"2024-09-17T03:36:44.263036+0000","last_became_peered":"2024-09-17T03:36:44.263036+0000","last_unstale":"2024-09-17T03:36:45.266229+0000","last_undegraded":"2024-09-17T03:36:45.266229+0000","last_fullsized":"2024-09-17T03:36:45.266229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:17.529967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262471+0000","last_change":"2024-09-17T03:36:44.256960+0000","last_active":"2024-09-17T03:36:45.262471+0000","last_peered":"2024-09-17T03:36:45.262471+0000","last_clean":"2024-09-17T03:36:45.262471+0000","last_became_active":"2024-09-17T03:36:44.256672+0000","last_became_peered":"2024-09-17T03:36:44.256672+0000","last_unstale":"2024-09-17T03:36:45.262471+0000","last_undegraded":"2024-09-17T03:36:45.262471+0000","last_fullsized":"2024-09-17T03:36:45.262471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:04.996521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339625+0000","last_change":"2024-09-17T03:36:44.256119+0000","last_active":"2024-09-17T03:36:45.339625+0000","last_peered":"2024-09-17T03:36:45.339625+0000","last_clean":"2024-09-17T03:36:45.339625+0000","last_became_active":"2024-09-17T03:36:44.255740+0000","last_became_peered":"2024-09-17T03:36:44.255740+0000","last_unstale":"2024-09-17T03:36:45.339625+0000","last_undegraded":"2024-09-17T03:36:45.339625+0000","last_fullsized":"2024-09-17T03:36:45.339625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:53.649917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339888+0000","last_change":"2024-09-17T03:36:44.257717+0000","last_active":"2024-09-17T03:36:45.339888+0000","last_peered":"2024-09-17T03:36:45.339888+0000","last_clean":"2024-09-17T03:36:45.339888+0000","last_became_active":"2024-09-17T03:36:44.257422+0000","last_became_peered":"2024-09-17T03:36:44.257422+0000","last_unstale":"2024-09-17T03:36:45.339888+0000","last_undegraded":"2024-09-17T03:36:45.339888+0000","last_fullsized":"2024-09-17T03:36:45.339888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:47.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257792+0000","last_change":"2024-09-17T03:36:44.244112+0000","last_active":"2024-09-17T03:36:45.257792+0000","last_peered":"2024-09-17T03:36:45.257792+0000","last_clean":"2024-09-17T03:36:45.257792+0000","last_became_active":"2024-09-17T03:36:44.243734+0000","last_became_peered":"2024-09-17T03:36:44.243734+0000","last_unstale":"2024-09-17T03:36:45.257792+0000","last_undegraded":"2024-09-17T03:36:45.257792+0000","last_fullsized":"2024-09-17T03:36:45.257792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:10.602532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339489+0000","last_change":"2024-09-17T03:36:44.254142+0000","last_active":"2024-09-17T03:36:45.339489+0000","last_peered":"2024-09-17T03:36:45.339489+0000","last_clean":"2024-09-17T03:36:45.339489+0000","last_became_active":"2024-09-17T03:36:44.253871+0000","last_became_peered":"2024-09-17T03:36:44.253871+0000","last_unstale":"2024-09-17T03:36:45.339489+0000","last_undegraded":"2024-09-17T03:36:45.339489+0000","last_fullsized":"2024-09-17T03:36:45.339489+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:27.123960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258233+0000","last_change":"2024-09-17T03:36:44.267635+0000","last_active":"2024-09-17T03:36:45.258233+0000","last_peered":"2024-09-17T03:36:45.258233+0000","last_clean":"2024-09-17T03:36:45.258233+0000","last_became_active":"2024-09-17T03:36:44.267199+0000","last_became_peered":"2024-09-17T03:36:44.267199+0000","last_unstale":"2024-09-17T03:36:45.258233+0000","last_undegraded":"2024-09-17T03:36:45.258233+0000","last_fullsized":"2024-09-17T03:36:45.258233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:44.085686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258400+0000","last_change":"2024-09-17T03:36:44.249470+0000","last_active":"2024-09-17T03:36:45.258400+0000","last_peered":"2024-09-17T03:36:45.258400+0000","last_clean":"2024-09-17T03:36:45.258400+0000","last_became_active":"2024-09-17T03:36:44.248597+0000","last_became_peered":"2024-09-17T03:36:44.248597+0000","last_unstale":"2024-09-17T03:36:45.258400+0000","last_undegraded":"2024-09-17T03:36:45.258400+0000","last_fullsized":"2024-09-17T03:36:45.258400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:54.287309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340772+0000","last_change":"2024-09-17T03:36:44.262318+0000","last_active":"2024-09-17T03:36:45.340772+0000","last_peered":"2024-09-17T03:36:45.340772+0000","last_clean":"2024-09-17T03:36:45.340772+0000","last_became_active":"2024-09-17T03:36:44.261979+0000","last_became_peered":"2024-09-17T03:36:44.261979+0000","last_unstale":"2024-09-17T03:36:45.340772+0000","last_undegraded":"2024-09-17T03:36:45.340772+0000","last_fullsized":"2024-09-17T03:36:45.340772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:52.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265813+0000","last_change":"2024-09-17T03:36:44.264562+0000","last_active":"2024-09-17T03:36:45.265813+0000","last_peered":"2024-09-17T03:36:45.265813+0000","last_clean":"2024-09-17T03:36:45.265813+0000","last_became_active":"2024-09-17T03:36:44.264273+0000","last_became_peered":"2024-09-17T03:36:44.264273+0000","last_unstale":"2024-09-17T03:36:45.265813+0000","last_undegraded":"2024-09-17T03:36:45.265813+0000","last_fullsized":"2024-09-17T03:36:45.265813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:44.688328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265788+0000","last_change":"2024-09-17T03:36:44.255197+0000","last_active":"2024-09-17T03:36:45.265788+0000","last_peered":"2024-09-17T03:36:45.265788+0000","last_clean":"2024-09-17T03:36:45.265788+0000","last_became_active":"2024-09-17T03:36:44.254536+0000","last_became_peered":"2024-09-17T03:36:44.254536+0000","last_unstale":"2024-09-17T03:36:45.265788+0000","last_undegraded":"2024-09-17T03:36:45.265788+0000","last_fullsized":"2024-09-17T03:36:45.265788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.442706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265693+0000","last_change":"2024-09-17T03:36:44.264660+0000","last_active":"2024-09-17T03:36:45.265693+0000","last_peered":"2024-09-17T03:36:45.265693+0000","last_clean":"2024-09-17T03:36:45.265693+0000","last_became_active":"2024-09-17T03:36:44.257929+0000","last_became_peered":"2024-09-17T03:36:44.257929+0000","last_unstale":"2024-09-17T03:36:45.265693+0000","last_undegraded":"2024-09-17T03:36:45.265693+0000","last_fullsized":"2024-09-17T03:36:45.265693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:34.451288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257806+0000","last_change":"2024-09-17T03:36:44.263605+0000","last_active":"2024-09-17T03:36:45.257806+0000","last_peered":"2024-09-17T03:36:45.257806+0000","last_clean":"2024-09-17T03:36:45.257806+0000","last_became_active":"2024-09-17T03:36:44.255877+0000","last_became_peered":"2024-09-17T03:36:44.255877+0000","last_unstale":"2024-09-17T03:36:45.257806+0000","last_undegraded":"2024-09-17T03:36:45.257806+0000","last_fullsized":"2024-09-17T03:36:45.257806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:03.771519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340781+0000","last_change":"2024-09-17T03:36:44.253003+0000","last_active":"2024-09-17T03:36:45.340781+0000","last_peered":"2024-09-17T03:36:45.340781+0000","last_clean":"2024-09-17T03:36:45.340781+0000","last_became_active":"2024-09-17T03:36:44.252680+0000","last_became_peered":"2024-09-17T03:36:44.252680+0000","last_unstale":"2024-09-17T03:36:45.340781+0000","last_undegraded":"2024-09-17T03:36:45.340781+0000","last_fullsized":"2024-09-17T03:36:45.340781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:43.947306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266123+0000","last_change":"2024-09-17T03:36:44.270263+0000","last_active":"2024-09-17T03:36:45.266123+0000","last_peered":"2024-09-17T03:36:45.266123+0000","last_clean":"2024-09-17T03:36:45.266123+0000","last_became_active":"2024-09-17T03:36:44.269849+0000","last_became_peered":"2024-09-17T03:36:44.269849+0000","last_unstale":"2024-09-17T03:36:45.266123+0000","last_undegraded":"2024-09-17T03:36:45.266123+0000","last_fullsized":"2024-09-17T03:36:45.266123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:34.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340142+0000","last_change":"2024-09-17T03:36:44.257142+0000","last_active":"2024-09-17T03:36:45.340142+0000","last_peered":"2024-09-17T03:36:45.340142+0000","last_clean":"2024-09-17T03:36:45.340142+0000","last_became_active":"2024-09-17T03:36:44.256859+0000","last_became_peered":"2024-09-17T03:36:44.256859+0000","last_unstale":"2024-09-17T03:36:45.340142+0000","last_undegraded":"2024-09-17T03:36:45.340142+0000","last_fullsized":"2024-09-17T03:36:45.340142+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:10.452184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257870+0000","last_change":"2024-09-17T03:36:44.250935+0000","last_active":"2024-09-17T03:36:45.257870+0000","last_peered":"2024-09-17T03:36:45.257870+0000","last_clean":"2024-09-17T03:36:45.257870+0000","last_became_active":"2024-09-17T03:36:44.250594+0000","last_became_peered":"2024-09-17T03:36:44.250594+0000","last_unstale":"2024-09-17T03:36:45.257870+0000","last_undegraded":"2024-09-17T03:36:45.257870+0000","last_fullsized":"2024-09-17T03:36:45.257870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:46.657454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258428+0000","last_change":"2024-09-17T03:36:44.253829+0000","last_active":"2024-09-17T03:36:45.258428+0000","last_peered":"2024-09-17T03:36:45.258428+0000","last_clean":"2024-09-17T03:36:45.258428+0000","last_became_active":"2024-09-17T03:36:44.253489+0000","last_became_peered":"2024-09-17T03:36:44.253489+0000","last_unstale":"2024-09-17T03:36:45.258428+0000","last_undegraded":"2024-09-17T03:36:45.258428+0000","last_fullsized":"2024-09-17T03:36:45.258428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:18.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339864+0000","last_change":"2024-09-17T03:36:44.257862+0000","last_active":"2024-09-17T03:36:45.339864+0000","last_peered":"2024-09-17T03:36:45.339864+0000","last_clean":"2024-09-17T03:36:45.339864+0000","last_became_active":"2024-09-17T03:36:44.256454+0000","last_became_peered":"2024-09-17T03:36:44.256454+0000","last_unstale":"2024-09-17T03:36:45.339864+0000","last_undegraded":"2024-09-17T03:36:45.339864+0000","last_fullsized":"2024-09-17T03:36:45.339864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:31.416993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258326+0000","last_change":"2024-09-17T03:36:44.245754+0000","last_active":"2024-09-17T03:36:45.258326+0000","last_peered":"2024-09-17T03:36:45.258326+0000","last_clean":"2024-09-17T03:36:45.258326+0000","last_became_active":"2024-09-17T03:36:44.245408+0000","last_became_peered":"2024-09-17T03:36:44.245408+0000","last_unstale":"2024-09-17T03:36:45.258326+0000","last_undegraded":"2024-09-17T03:36:45.258326+0000","last_fullsized":"2024-09-17T03:36:45.258326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:44.165481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340900+0000","last_change":"2024-09-17T03:36:43.245126+0000","last_active":"2024-09-17T03:36:45.340900+0000","last_peered":"2024-09-17T03:36:45.340900+0000","last_clean":"2024-09-17T03:36:45.340900+0000","last_became_active":"2024-09-17T03:36:43.244672+0000","last_became_peered":"2024-09-17T03:36:43.244672+0000","last_unstale":"2024-09-17T03:36:45.340900+0000","last_undegraded":"2024-09-17T03:36:45.340900+0000","last_fullsized":"2024-09-17T03:36:45.340900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257397+0000","last_change":"2024-09-17T03:36:44.268310+0000","last_active":"2024-09-17T03:36:45.257397+0000","last_peered":"2024-09-17T03:36:45.257397+0000","last_clean":"2024-09-17T03:36:45.257397+0000","last_became_active":"2024-09-17T03:36:44.265610+0000","last_became_peered":"2024-09-17T03:36:44.265610+0000","last_unstale":"2024-09-17T03:36:45.257397+0000","last_undegraded":"2024-09-17T03:36:45.257397+0000","last_fullsized":"2024-09-17T03:36:45.257397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:24.017008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257820+0000","last_change":"2024-09-17T03:36:43.244589+0000","last_active":"2024-09-17T03:36:45.257820+0000","last_peered":"2024-09-17T03:36:45.257820+0000","last_clean":"2024-09-17T03:36:45.257820+0000","last_became_active":"2024-09-17T03:36:43.244277+0000","last_became_peered":"2024-09-17T03:36:43.244277+0000","last_unstale":"2024-09-17T03:36:45.257820+0000","last_undegraded":"2024-09-17T03:36:45.257820+0000","last_fullsized":"2024-09-17T03:36:45.257820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258699+0000","last_change":"2024-09-17T03:36:44.259012+0000","last_active":"2024-09-17T03:36:45.258699+0000","last_peered":"2024-09-17T03:36:45.258699+0000","last_clean":"2024-09-17T03:36:45.258699+0000","last_became_active":"2024-09-17T03:36:44.258013+0000","last_became_peered":"2024-09-17T03:36:44.258013+0000","last_unstale":"2024-09-17T03:36:45.258699+0000","last_undegraded":"2024-09-17T03:36:45.258699+0000","last_fullsized":"2024-09-17T03:36:45.258699+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:37.644719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.221535+0000","last_change":"2024-09-17T03:36:42.221535+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.221535+0000","last_undegraded":"2024-09-17T03:36:42.221535+0000","last_fullsized":"2024-09-17T03:36:42.221535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258015+0000","last_change":"2024-09-17T03:36:44.265627+0000","last_active":"2024-09-17T03:36:45.258015+0000","last_peered":"2024-09-17T03:36:45.258015+0000","last_clean":"2024-09-17T03:36:45.258015+0000","last_became_active":"2024-09-17T03:36:44.265268+0000","last_became_peered":"2024-09-17T03:36:44.265268+0000","last_unstale":"2024-09-17T03:36:45.258015+0000","last_undegraded":"2024-09-17T03:36:45.258015+0000","last_fullsized":"2024-09-17T03:36:45.258015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:56.232153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340576+0000","last_change":"2024-09-17T03:36:43.243254+0000","last_active":"2024-09-17T03:36:45.340576+0000","last_peered":"2024-09-17T03:36:45.340576+0000","last_clean":"2024-09-17T03:36:45.340576+0000","last_became_active":"2024-09-17T03:36:43.242906+0000","last_became_peered":"2024-09-17T03:36:43.242906+0000","last_unstale":"2024-09-17T03:36:45.340576+0000","last_undegraded":"2024-09-17T03:36:45.340576+0000","last_fullsized":"2024-09-17T03:36:45.340576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340298+0000","last_change":"2024-09-17T03:36:43.239775+0000","last_active":"2024-09-17T03:36:45.340298+0000","last_peered":"2024-09-17T03:36:45.340298+0000","last_clean":"2024-09-17T03:36:45.340298+0000","last_became_active":"2024-09-17T03:36:43.239466+0000","last_became_peered":"2024-09-17T03:36:43.239466+0000","last_unstale":"2024-09-17T03:36:45.340298+0000","last_undegraded":"2024-09-17T03:36:45.340298+0000","last_fullsized":"2024-09-17T03:36:45.340298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:14.876381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265496+0000","last_change":"2024-09-17T03:36:44.257169+0000","last_active":"2024-09-17T03:36:45.265496+0000","last_peered":"2024-09-17T03:36:45.265496+0000","last_clean":"2024-09-17T03:36:45.265496+0000","last_became_active":"2024-09-17T03:36:44.256569+0000","last_became_peered":"2024-09-17T03:36:44.256569+0000","last_unstale":"2024-09-17T03:36:45.265496+0000","last_undegraded":"2024-09-17T03:36:45.265496+0000","last_fullsized":"2024-09-17T03:36:45.265496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:36.847491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339665+0000","last_change":"2024-09-17T03:36:43.238069+0000","last_active":"2024-09-17T03:36:45.339665+0000","last_peered":"2024-09-17T03:36:45.339665+0000","last_clean":"2024-09-17T03:36:45.339665+0000","last_became_active":"2024-09-17T03:36:43.237720+0000","last_became_peered":"2024-09-17T03:36:43.237720+0000","last_unstale":"2024-09-17T03:36:45.339665+0000","last_undegraded":"2024-09-17T03:36:45.339665+0000","last_fullsized":"2024-09-17T03:36:45.339665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:46.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257884+0000","last_change":"2024-09-17T03:36:44.265836+0000","last_active":"2024-09-17T03:36:45.257884+0000","last_peered":"2024-09-17T03:36:45.257884+0000","last_clean":"2024-09-17T03:36:45.257884+0000","last_became_active":"2024-09-17T03:36:44.265525+0000","last_became_peered":"2024-09-17T03:36:44.265525+0000","last_unstale":"2024-09-17T03:36:45.257884+0000","last_undegraded":"2024-09-17T03:36:45.257884+0000","last_fullsized":"2024-09-17T03:36:45.257884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:08.571368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.220650+0000","last_change":"2024-09-17T03:36:42.220650+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.220650+0000","last_undegraded":"2024-09-17T03:36:42.220650+0000","last_fullsized":"2024-09-17T03:36:42.220650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258114+0000","last_change":"2024-09-17T03:36:44.258467+0000","last_active":"2024-09-17T03:36:45.258114+0000","last_peered":"2024-09-17T03:36:45.258114+0000","last_clean":"2024-09-17T03:36:45.258114+0000","last_became_active":"2024-09-17T03:36:44.258054+0000","last_became_peered":"2024-09-17T03:36:44.258054+0000","last_unstale":"2024-09-17T03:36:45.258114+0000","last_undegraded":"2024-09-17T03:36:45.258114+0000","last_fullsized":"2024-09-17T03:36:45.258114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:53.739833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339566+0000","last_change":"2024-09-17T03:36:43.242724+0000","last_active":"2024-09-17T03:36:45.339566+0000","last_peered":"2024-09-17T03:36:45.339566+0000","last_clean":"2024-09-17T03:36:45.339566+0000","last_became_active":"2024-09-17T03:36:43.242438+0000","last_became_peered":"2024-09-17T03:36:43.242438+0000","last_unstale":"2024-09-17T03:36:45.339566+0000","last_undegraded":"2024-09-17T03:36:45.339566+0000","last_fullsized":"2024-09-17T03:36:45.339566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:51.471274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.222663+0000","last_change":"2024-09-17T03:36:42.222663+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.222663+0000","last_undegraded":"2024-09-17T03:36:42.222663+0000","last_fullsized":"2024-09-17T03:36:42.222663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340631+0000","last_change":"2024-09-17T03:36:44.266455+0000","last_active":"2024-09-17T03:36:45.340631+0000","last_peered":"2024-09-17T03:36:45.340631+0000","last_clean":"2024-09-17T03:36:45.340631+0000","last_became_active":"2024-09-17T03:36:44.266153+0000","last_became_peered":"2024-09-17T03:36:44.266153+0000","last_unstale":"2024-09-17T03:36:45.340631+0000","last_undegraded":"2024-09-17T03:36:45.340631+0000","last_fullsized":"2024-09-17T03:36:45.340631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:01.286771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258504+0000","last_change":"2024-09-17T03:36:43.251663+0000","last_active":"2024-09-17T03:36:45.258504+0000","last_peered":"2024-09-17T03:36:45.258504+0000","last_clean":"2024-09-17T03:36:45.258504+0000","last_became_active":"2024-09-17T03:36:43.249590+0000","last_became_peered":"2024-09-17T03:36:43.249590+0000","last_unstale":"2024-09-17T03:36:45.258504+0000","last_undegraded":"2024-09-17T03:36:45.258504+0000","last_fullsized":"2024-09-17T03:36:45.258504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:28.331414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257931+0000","last_change":"2024-09-17T03:36:43.250402+0000","last_active":"2024-09-17T03:36:45.257931+0000","last_peered":"2024-09-17T03:36:45.257931+0000","last_clean":"2024-09-17T03:36:45.257931+0000","last_became_active":"2024-09-17T03:36:43.250094+0000","last_became_peered":"2024-09-17T03:36:43.250094+0000","last_unstale":"2024-09-17T03:36:45.257931+0000","last_undegraded":"2024-09-17T03:36:45.257931+0000","last_fullsized":"2024-09-17T03:36:45.257931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:04.120350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340018+0000","last_change":"2024-09-17T03:36:44.256373+0000","last_active":"2024-09-17T03:36:45.340018+0000","last_peered":"2024-09-17T03:36:45.340018+0000","last_clean":"2024-09-17T03:36:45.340018+0000","last_became_active":"2024-09-17T03:36:44.256013+0000","last_became_peered":"2024-09-17T03:36:44.256013+0000","last_unstale":"2024-09-17T03:36:45.340018+0000","last_undegraded":"2024-09-17T03:36:45.340018+0000","last_fullsized":"2024-09-17T03:36:45.340018+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:05.669667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.222177+0000","last_change":"2024-09-17T03:36:42.222177+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.222177+0000","last_undegraded":"2024-09-17T03:36:42.222177+0000","last_fullsized":"2024-09-17T03:36:42.222177+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.221723+0000","last_change":"2024-09-17T03:36:42.221723+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.221723+0000","last_undegraded":"2024-09-17T03:36:42.221723+0000","last_fullsized":"2024-09-17T03:36:42.221723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256090+0000","last_change":"2024-09-17T03:36:44.257966+0000","last_active":"2024-09-17T03:36:45.256090+0000","last_peered":"2024-09-17T03:36:45.256090+0000","last_clean":"2024-09-17T03:36:45.256090+0000","last_became_active":"2024-09-17T03:36:44.257627+0000","last_became_peered":"2024-09-17T03:36:44.257627+0000","last_unstale":"2024-09-17T03:36:45.256090+0000","last_undegraded":"2024-09-17T03:36:45.256090+0000","last_fullsized":"2024-09-17T03:36:45.256090+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:07.526657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257449+0000","last_change":"2024-09-17T03:36:43.242166+0000","last_active":"2024-09-17T03:36:45.257449+0000","last_peered":"2024-09-17T03:36:45.257449+0000","last_clean":"2024-09-17T03:36:45.257449+0000","last_became_active":"2024-09-17T03:36:43.241720+0000","last_became_peered":"2024-09-17T03:36:43.241720+0000","last_unstale":"2024-09-17T03:36:45.257449+0000","last_undegraded":"2024-09-17T03:36:45.257449+0000","last_fullsized":"2024-09-17T03:36:45.257449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:30.410210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265941+0000","last_change":"2024-09-17T03:36:44.253537+0000","last_active":"2024-09-17T03:36:45.265941+0000","last_peered":"2024-09-17T03:36:45.265941+0000","last_clean":"2024-09-17T03:36:45.265941+0000","last_became_active":"2024-09-17T03:36:44.253232+0000","last_became_peered":"2024-09-17T03:36:44.253232+0000","last_unstale":"2024-09-17T03:36:45.265941+0000","last_undegraded":"2024-09-17T03:36:45.265941+0000","last_fullsized":"2024-09-17T03:36:45.265941+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:20.976361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258034+0000","last_change":"2024-09-17T03:36:43.245321+0000","last_active":"2024-09-17T03:36:45.258034+0000","last_peered":"2024-09-17T03:36:45.258034+0000","last_clean":"2024-09-17T03:36:45.258034+0000","last_became_active":"2024-09-17T03:36:43.245000+0000","last_became_peered":"2024-09-17T03:36:43.245000+0000","last_unstale":"2024-09-17T03:36:45.258034+0000","last_undegraded":"2024-09-17T03:36:45.258034+0000","last_fullsized":"2024-09-17T03:36:45.258034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:06.451160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262584+0000","last_change":"2024-09-17T03:36:44.255583+0000","last_active":"2024-09-17T03:36:45.262584+0000","last_peered":"2024-09-17T03:36:45.262584+0000","last_clean":"2024-09-17T03:36:45.262584+0000","last_became_active":"2024-09-17T03:36:44.255259+0000","last_became_peered":"2024-09-17T03:36:44.255259+0000","last_unstale":"2024-09-17T03:36:45.262584+0000","last_undegraded":"2024-09-17T03:36:45.262584+0000","last_fullsized":"2024-09-17T03:36:45.262584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:14.932088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339312+0000","last_change":"2024-09-17T03:36:43.239640+0000","last_active":"2024-09-17T03:36:45.339312+0000","last_peered":"2024-09-17T03:36:45.339312+0000","last_clean":"2024-09-17T03:36:45.339312+0000","last_became_active":"2024-09-17T03:36:43.239321+0000","last_became_peered":"2024-09-17T03:36:43.239321+0000","last_unstale":"2024-09-17T03:36:45.339312+0000","last_undegraded":"2024-09-17T03:36:45.339312+0000","last_fullsized":"2024-09-17T03:36:45.339312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:30.410210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257073+0000","last_change":"2024-09-17T03:36:44.260816+0000","last_active":"2024-09-17T03:36:45.257073+0000","last_peered":"2024-09-17T03:36:45.257073+0000","last_clean":"2024-09-17T03:36:45.257073+0000","last_became_active":"2024-09-17T03:36:44.260481+0000","last_became_peered":"2024-09-17T03:36:44.260481+0000","last_unstale":"2024-09-17T03:36:45.257073+0000","last_undegraded":"2024-09-17T03:36:45.257073+0000","last_fullsized":"2024-09-17T03:36:45.257073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:04.179982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340101+0000","last_change":"2024-09-17T03:36:43.250977+0000","last_active":"2024-09-17T03:36:45.340101+0000","last_peered":"2024-09-17T03:36:45.340101+0000","last_clean":"2024-09-17T03:36:45.340101+0000","last_became_active":"2024-09-17T03:36:43.250638+0000","last_became_peered":"2024-09-17T03:36:43.250638+0000","last_unstale":"2024-09-17T03:36:45.340101+0000","last_undegraded":"2024-09-17T03:36:45.340101+0000","last_fullsized":"2024-09-17T03:36:45.340101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:54.928131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340247+0000","last_change":"2024-09-17T03:36:44.261046+0000","last_active":"2024-09-17T03:36:45.340247+0000","last_peered":"2024-09-17T03:36:45.340247+0000","last_clean":"2024-09-17T03:36:45.340247+0000","last_became_active":"2024-09-17T03:36:44.260749+0000","last_became_peered":"2024-09-17T03:36:44.260749+0000","last_unstale":"2024-09-17T03:36:45.340247+0000","last_undegraded":"2024-09-17T03:36:45.340247+0000","last_fullsized":"2024-09-17T03:36:45.340247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:47.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258597+0000","last_change":"2024-09-17T03:36:43.248274+0000","last_active":"2024-09-17T03:36:45.258597+0000","last_peered":"2024-09-17T03:36:45.258597+0000","last_clean":"2024-09-17T03:36:45.258597+0000","last_became_active":"2024-09-17T03:36:43.247287+0000","last_became_peered":"2024-09-17T03:36:43.247287+0000","last_unstale":"2024-09-17T03:36:45.258597+0000","last_undegraded":"2024-09-17T03:36:45.258597+0000","last_fullsized":"2024-09-17T03:36:45.258597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:08.860204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340228+0000","last_change":"2024-09-17T03:36:44.260449+0000","last_active":"2024-09-17T03:36:45.340228+0000","last_peered":"2024-09-17T03:36:45.340228+0000","last_clean":"2024-09-17T03:36:45.340228+0000","last_became_active":"2024-09-17T03:36:44.260163+0000","last_became_peered":"2024-09-17T03:36:44.260163+0000","last_unstale":"2024-09-17T03:36:45.340228+0000","last_undegraded":"2024-09-17T03:36:45.340228+0000","last_fullsized":"2024-09-17T03:36:45.340228+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:49.493460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262410+0000","last_change":"2024-09-17T03:36:43.242358+0000","last_active":"2024-09-17T03:36:45.262410+0000","last_peered":"2024-09-17T03:36:45.262410+0000","last_clean":"2024-09-17T03:36:45.262410+0000","last_became_active":"2024-09-17T03:36:43.241998+0000","last_became_peered":"2024-09-17T03:36:43.241998+0000","last_unstale":"2024-09-17T03:36:45.262410+0000","last_undegraded":"2024-09-17T03:36:45.262410+0000","last_fullsized":"2024-09-17T03:36:45.262410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:02.266116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340839+0000","last_change":"2024-09-17T03:36:44.255735+0000","last_active":"2024-09-17T03:36:45.340839+0000","last_peered":"2024-09-17T03:36:45.340839+0000","last_clean":"2024-09-17T03:36:45.340839+0000","last_became_active":"2024-09-17T03:36:44.254710+0000","last_became_peered":"2024-09-17T03:36:44.254710+0000","last_unstale":"2024-09-17T03:36:45.340839+0000","last_undegraded":"2024-09-17T03:36:45.340839+0000","last_fullsized":"2024-09-17T03:36:45.340839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:14.497107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340523+0000","last_change":"2024-09-17T03:36:43.246790+0000","last_active":"2024-09-17T03:36:45.340523+0000","last_peered":"2024-09-17T03:36:45.340523+0000","last_clean":"2024-09-17T03:36:45.340523+0000","last_became_active":"2024-09-17T03:36:43.246506+0000","last_became_peered":"2024-09-17T03:36:43.246506+0000","last_unstale":"2024-09-17T03:36:45.340523+0000","last_undegraded":"2024-09-17T03:36:45.340523+0000","last_fullsized":"2024-09-17T03:36:45.340523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:36.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257782+0000","last_change":"2024-09-17T03:36:44.251074+0000","last_active":"2024-09-17T03:36:45.257782+0000","last_peered":"2024-09-17T03:36:45.257782+0000","last_clean":"2024-09-17T03:36:45.257782+0000","last_became_active":"2024-09-17T03:36:44.249327+0000","last_became_peered":"2024-09-17T03:36:44.249327+0000","last_unstale":"2024-09-17T03:36:45.257782+0000","last_undegraded":"2024-09-17T03:36:45.257782+0000","last_fullsized":"2024-09-17T03:36:45.257782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:12.553359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340586+0000","last_change":"2024-09-17T03:36:43.244507+0000","last_active":"2024-09-17T03:36:45.340586+0000","last_peered":"2024-09-17T03:36:45.340586+0000","last_clean":"2024-09-17T03:36:45.340586+0000","last_became_active":"2024-09-17T03:36:43.244138+0000","last_became_peered":"2024-09-17T03:36:43.244138+0000","last_unstale":"2024-09-17T03:36:45.340586+0000","last_undegraded":"2024-09-17T03:36:45.340586+0000","last_fullsized":"2024-09-17T03:36:45.340586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:37.711102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257330+0000","last_change":"2024-09-17T03:36:43.245115+0000","last_active":"2024-09-17T03:36:45.257330+0000","last_peered":"2024-09-17T03:36:45.257330+0000","last_clean":"2024-09-17T03:36:45.257330+0000","last_became_active":"2024-09-17T03:36:43.244800+0000","last_became_peered":"2024-09-17T03:36:43.244800+0000","last_unstale":"2024-09-17T03:36:45.257330+0000","last_undegraded":"2024-09-17T03:36:45.257330+0000","last_fullsized":"2024-09-17T03:36:45.257330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265952+0000","last_change":"2024-09-17T03:36:44.263078+0000","last_active":"2024-09-17T03:36:45.265952+0000","last_peered":"2024-09-17T03:36:45.265952+0000","last_clean":"2024-09-17T03:36:45.265952+0000","last_became_active":"2024-09-17T03:36:44.262753+0000","last_became_peered":"2024-09-17T03:36:44.262753+0000","last_unstale":"2024-09-17T03:36:45.265952+0000","last_undegraded":"2024-09-17T03:36:45.265952+0000","last_fullsized":"2024-09-17T03:36:45.265952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:52.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339783+0000","last_change":"2024-09-17T03:36:43.245006+0000","last_active":"2024-09-17T03:36:45.339783+0000","last_peered":"2024-09-17T03:36:45.339783+0000","last_clean":"2024-09-17T03:36:45.339783+0000","last_became_active":"2024-09-17T03:36:43.244723+0000","last_became_peered":"2024-09-17T03:36:43.244723+0000","last_unstale":"2024-09-17T03:36:45.339783+0000","last_undegraded":"2024-09-17T03:36:45.339783+0000","last_fullsized":"2024-09-17T03:36:45.339783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.555456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:43.215636+0000","last_change":"2024-09-17T03:36:43.215636+0000","last_active":"2024-09-17T03:36:43.215636+0000","last_peered":"2024-09-17T03:36:43.215636+0000","last_clean":"2024-09-17T03:36:43.215636+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:43.215636+0000","last_undegraded":"2024-09-17T03:36:43.215636+0000","last_fullsized":"2024-09-17T03:36:43.215636+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255636+0000","last_change":"2024-09-17T03:36:43.246360+0000","last_active":"2024-09-17T03:36:45.255636+0000","last_peered":"2024-09-17T03:36:45.255636+0000","last_clean":"2024-09-17T03:36:45.255636+0000","last_became_active":"2024-09-17T03:36:43.243140+0000","last_became_peered":"2024-09-17T03:36:43.243140+0000","last_unstale":"2024-09-17T03:36:45.255636+0000","last_undegraded":"2024-09-17T03:36:45.255636+0000","last_fullsized":"2024-09-17T03:36:45.255636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:14.876381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262543+0000","last_change":"2024-09-17T03:36:44.265309+0000","last_active":"2024-09-17T03:36:45.262543+0000","last_peered":"2024-09-17T03:36:45.262543+0000","last_clean":"2024-09-17T03:36:45.262543+0000","last_became_active":"2024-09-17T03:36:44.264925+0000","last_became_peered":"2024-09-17T03:36:44.264925+0000","last_unstale":"2024-09-17T03:36:45.262543+0000","last_undegraded":"2024-09-17T03:36:45.262543+0000","last_fullsized":"2024-09-17T03:36:45.262543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:35.512783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258272+0000","last_change":"2024-09-17T03:36:43.249727+0000","last_active":"2024-09-17T03:36:45.258272+0000","last_peered":"2024-09-17T03:36:45.258272+0000","last_clean":"2024-09-17T03:36:45.258272+0000","last_became_active":"2024-09-17T03:36:43.249376+0000","last_became_peered":"2024-09-17T03:36:43.249376+0000","last_unstale":"2024-09-17T03:36:45.258272+0000","last_undegraded":"2024-09-17T03:36:45.258272+0000","last_fullsized":"2024-09-17T03:36:45.258272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:13.054687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266096+0000","last_change":"2024-09-17T03:36:44.269381+0000","last_active":"2024-09-17T03:36:45.266096+0000","last_peered":"2024-09-17T03:36:45.266096+0000","last_clean":"2024-09-17T03:36:45.266096+0000","last_became_active":"2024-09-17T03:36:44.264227+0000","last_became_peered":"2024-09-17T03:36:44.264227+0000","last_unstale":"2024-09-17T03:36:45.266096+0000","last_undegraded":"2024-09-17T03:36:45.266096+0000","last_fullsized":"2024-09-17T03:36:45.266096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:56.489758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.264284+0000","last_change":"2024-09-17T03:36:43.242092+0000","last_active":"2024-09-17T03:36:45.264284+0000","last_peered":"2024-09-17T03:36:45.264284+0000","last_clean":"2024-09-17T03:36:45.264284+0000","last_became_active":"2024-09-17T03:36:43.241759+0000","last_became_peered":"2024-09-17T03:36:43.241759+0000","last_unstale":"2024-09-17T03:36:45.264284+0000","last_undegraded":"2024-09-17T03:36:45.264284+0000","last_fullsized":"2024-09-17T03:36:45.264284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:30.046741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340741+0000","last_change":"2024-09-17T03:36:44.273690+0000","last_active":"2024-09-17T03:36:45.340741+0000","last_peered":"2024-09-17T03:36:45.340741+0000","last_clean":"2024-09-17T03:36:45.340741+0000","last_became_active":"2024-09-17T03:36:44.273364+0000","last_became_peered":"2024-09-17T03:36:44.273364+0000","last_unstale":"2024-09-17T03:36:45.340741+0000","last_undegraded":"2024-09-17T03:36:45.340741+0000","last_fullsized":"2024-09-17T03:36:45.340741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:37.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262362+0000","last_change":"2024-09-17T03:36:43.233724+0000","last_active":"2024-09-17T03:36:45.262362+0000","last_peered":"2024-09-17T03:36:45.262362+0000","last_clean":"2024-09-17T03:36:45.262362+0000","last_became_active":"2024-09-17T03:36:43.232853+0000","last_became_peered":"2024-09-17T03:36:43.232853+0000","last_unstale":"2024-09-17T03:36:45.262362+0000","last_undegraded":"2024-09-17T03:36:45.262362+0000","last_fullsized":"2024-09-17T03:36:45.262362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:10.474554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262290+0000","last_change":"2024-09-17T03:36:44.256195+0000","last_active":"2024-09-17T03:36:45.262290+0000","last_peered":"2024-09-17T03:36:45.262290+0000","last_clean":"2024-09-17T03:36:45.262290+0000","last_became_active":"2024-09-17T03:36:44.255895+0000","last_became_peered":"2024-09-17T03:36:44.255895+0000","last_unstale":"2024-09-17T03:36:45.262290+0000","last_undegraded":"2024-09-17T03:36:45.262290+0000","last_fullsized":"2024-09-17T03:36:45.262290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:54.588941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.220582+0000","last_change":"2024-09-17T03:36:42.220582+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.220582+0000","last_undegraded":"2024-09-17T03:36:42.220582+0000","last_fullsized":"2024-09-17T03:36:42.220582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257954+0000","last_change":"2024-09-17T03:36:44.251549+0000","last_active":"2024-09-17T03:36:45.257954+0000","last_peered":"2024-09-17T03:36:45.257954+0000","last_clean":"2024-09-17T03:36:45.257954+0000","last_became_active":"2024-09-17T03:36:44.249170+0000","last_became_peered":"2024-09-17T03:36:44.249170+0000","last_unstale":"2024-09-17T03:36:45.257954+0000","last_undegraded":"2024-09-17T03:36:45.257954+0000","last_fullsized":"2024-09-17T03:36:45.257954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.234298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266059+0000","last_change":"2024-09-17T03:36:43.250361+0000","last_active":"2024-09-17T03:36:45.266059+0000","last_peered":"2024-09-17T03:36:45.266059+0000","last_clean":"2024-09-17T03:36:45.266059+0000","last_became_active":"2024-09-17T03:36:43.250046+0000","last_became_peered":"2024-09-17T03:36:43.250046+0000","last_unstale":"2024-09-17T03:36:45.266059+0000","last_undegraded":"2024-09-17T03:36:45.266059+0000","last_fullsized":"2024-09-17T03:36:45.266059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:13.925305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258201+0000","last_change":"2024-09-17T03:36:44.245554+0000","last_active":"2024-09-17T03:36:45.258201+0000","last_peered":"2024-09-17T03:36:45.258201+0000","last_clean":"2024-09-17T03:36:45.258201+0000","last_became_active":"2024-09-17T03:36:44.243706+0000","last_became_peered":"2024-09-17T03:36:44.243706+0000","last_unstale":"2024-09-17T03:36:45.258201+0000","last_undegraded":"2024-09-17T03:36:45.258201+0000","last_fullsized":"2024-09-17T03:36:45.258201+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:57.050681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258133+0000","last_change":"2024-09-17T03:36:43.251317+0000","last_active":"2024-09-17T03:36:45.258133+0000","last_peered":"2024-09-17T03:36:45.258133+0000","last_clean":"2024-09-17T03:36:45.258133+0000","last_became_active":"2024-09-17T03:36:43.250948+0000","last_became_peered":"2024-09-17T03:36:43.250948+0000","last_unstale":"2024-09-17T03:36:45.258133+0000","last_undegraded":"2024-09-17T03:36:45.258133+0000","last_fullsized":"2024-09-17T03:36:45.258133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:14.413534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265908+0000","last_change":"2024-09-17T03:36:44.254879+0000","last_active":"2024-09-17T03:36:45.265908+0000","last_peered":"2024-09-17T03:36:45.265908+0000","last_clean":"2024-09-17T03:36:45.265908+0000","last_became_active":"2024-09-17T03:36:44.254211+0000","last_became_peered":"2024-09-17T03:36:44.254211+0000","last_unstale":"2024-09-17T03:36:45.265908+0000","last_undegraded":"2024-09-17T03:36:45.265908+0000","last_fullsized":"2024-09-17T03:36:45.265908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:25.422746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-17T03:36:42.220998+0000","last_change":"2024-09-17T03:36:42.220998+0000","last_active":"2024-09-17T03:36:42.208852+0000","last_peered":"2024-09-17T03:36:42.208852+0000","last_clean":"2024-09-17T03:36:42.208852+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:42.220998+0000","last_undegraded":"2024-09-17T03:36:42.220998+0000","last_fullsized":"2024-09-17T03:36:42.220998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258159+0000","last_change":"2024-09-17T03:36:44.250558+0000","last_active":"2024-09-17T03:36:45.258159+0000","last_peered":"2024-09-17T03:36:45.258159+0000","last_clean":"2024-09-17T03:36:45.258159+0000","last_became_active":"2024-09-17T03:36:44.250256+0000","last_became_peered":"2024-09-17T03:36:44.250256+0000","last_unstale":"2024-09-17T03:36:45.258159+0000","last_undegraded":"2024-09-17T03:36:45.258159+0000","last_fullsized":"2024-09-17T03:36:45.258159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:16.391925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265969+0000","last_change":"2024-09-17T03:36:43.250824+0000","last_active":"2024-09-17T03:36:45.265969+0000","last_peered":"2024-09-17T03:36:45.265969+0000","last_clean":"2024-09-17T03:36:45.265969+0000","last_became_active":"2024-09-17T03:36:43.250296+0000","last_became_peered":"2024-09-17T03:36:43.250296+0000","last_unstale":"2024-09-17T03:36:45.265969+0000","last_undegraded":"2024-09-17T03:36:45.265969+0000","last_fullsized":"2024-09-17T03:36:45.265969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:34.505999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339553+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:36:45.339553+0000","last_peered":"2024-09-17T03:36:45.339553+0000","last_clean":"2024-09-17T03:36:45.339553+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:36:45.339553+0000","last_undegraded":"2024-09-17T03:36:45.339553+0000","last_fullsized":"2024-09-17T03:36:45.339553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":102,"acting":102,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":188124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":779040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":188180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":196976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":778480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":194874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":405504,"data_stored":168047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:49.145 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:49.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.405+0000 7f8f56600640 1 -- 172.21.15.121:0/235590405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f500cc8d0 msgr2=0x7f8f500ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.405+0000 7f8f56600640 1 --2- 172.21.15.121:0/235590405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f500cc8d0 0x7f8f500ccce0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c005fd0 tx=0x7f8f3c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.405+0000 7f8f56600640 1 -- 172.21.15.121:0/235590405 shutdown_connections 2024-09-17T03:36:49.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.405+0000 7f8f56600640 1 --2- 172.21.15.121:0/235590405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f500cc8d0 0x7f8f500ccce0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.405+0000 7f8f56600640 1 --2- 172.21.15.121:0/235590405 >> v2:172.21.15.176:3300/0 conn(0x7f8f5015cb20 0x7f8f500cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.405+0000 7f8f56600640 1 -- 172.21.15.121:0/235590405 >> 172.21.15.121:0/235590405 conn(0x7f8f5006f940 msgr2=0x7f8f500b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:49.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.405+0000 7f8f56600640 1 -- 172.21.15.121:0/235590405 shutdown_connections 2024-09-17T03:36:49.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.406+0000 7f8f56600640 1 -- 172.21.15.121:0/235590405 wait complete. 2024-09-17T03:36:49.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.408+0000 7f8f56600640 1 Processor -- start 2024-09-17T03:36:49.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.408+0000 7f8f56600640 1 -- start start 2024-09-17T03:36:49.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.409+0000 7f8f56600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f500b4990 0x7f8f501f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.409+0000 7f8f56600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f500cc8d0 0x7f8f501f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.409+0000 7f8f56600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f5015cb20 0x7f8f500737c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.409+0000 7f8f56600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5006d600 con 0x7f8f500cc8d0 2024-09-17T03:36:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.409+0000 7f8f56600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5006d480 con 0x7f8f5015cb20 2024-09-17T03:36:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.409+0000 7f8f56600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5006d780 con 0x7f8f500b4990 2024-09-17T03:36:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f4fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f500cc8d0 0x7f8f501f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f4fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f500cc8d0 0x7f8f501f92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46202/0 (socket says 172.21.15.121:46202) 2024-09-17T03:36:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f55200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f500b4990 0x7f8f501f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f4fe00640 1 -- 172.21.15.121:0/783558212 learned_addr learned my addr 172.21.15.121:0/783558212 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f55c00640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f5015cb20 0x7f8f500737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f4fe00640 1 -- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f500b4990 msgr2=0x7f8f501f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f4fe00640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f500b4990 0x7f8f501f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f4fe00640 1 -- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f5015cb20 msgr2=0x7f8f500737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f4fe00640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f5015cb20 0x7f8f500737c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f4fe00640 1 -- 172.21.15.121:0/783558212 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f500cb9d0 con 0x7f8f500cc8d0 2024-09-17T03:36:49.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.410+0000 7f8f4fe00640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f500cc8d0 0x7f8f501f92d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c034040 tx=0x7f8f3c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:49.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.411+0000 7f8f4cc00640 1 -- 172.21.15.121:0/783558212 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c03e030 con 0x7f8f500cc8d0 2024-09-17T03:36:49.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.411+0000 7f8f4cc00640 1 -- 172.21.15.121:0/783558212 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f3c003ae0 con 0x7f8f500cc8d0 2024-09-17T03:36:49.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.411+0000 7f8f56600640 1 -- 172.21.15.121:0/783558212 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f50074be0 con 0x7f8f500cc8d0 2024-09-17T03:36:49.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.411+0000 7f8f4cc00640 1 -- 172.21.15.121:0/783558212 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c035040 con 0x7f8f500cc8d0 2024-09-17T03:36:49.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.411+0000 7f8f56600640 1 -- 172.21.15.121:0/783558212 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f5015bbf0 con 0x7f8f500cc8d0 2024-09-17T03:36:49.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.412+0000 7f8f56600640 1 -- 172.21.15.121:0/783558212 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f5006dc30 con 0x7f8f500cc8d0 2024-09-17T03:36:49.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.413+0000 7f8f4cc00640 1 -- 172.21.15.121:0/783558212 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f3c041030 con 0x7f8f500cc8d0 2024-09-17T03:36:49.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.414+0000 7f8f4cc00640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f30078bc0 0x7f8f3007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.414+0000 7f8f4cc00640 1 -- 172.21.15.121:0/783558212 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f8f3c0bb7b0 con 0x7f8f500cc8d0 2024-09-17T03:36:49.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.414+0000 7f8f55200640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f30078bc0 0x7f8f3007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.415+0000 7f8f55200640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f30078bc0 0x7f8f3007b0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009b30 tx=0x7f8f40005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:49.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.419+0000 7f8f4cc00640 1 -- 172.21.15.121:0/783558212 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f3c083370 con 0x7f8f500cc8d0 2024-09-17T03:36:49.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.597+0000 7f8f56600640 1 -- 172.21.15.121:0/783558212 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f5006fdc0 con 0x7f8f30078bc0 2024-09-17T03:36:49.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.602+0000 7f8f4cc00640 1 -- 172.21.15.121:0/783558212 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7f8f5006fdc0 con 0x7f8f30078bc0 2024-09-17T03:36:49.604 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:49.606 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:36:49.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 -- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f30078bc0 msgr2=0x7f8f3007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f30078bc0 0x7f8f3007b0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009b30 tx=0x7f8f40005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:49.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 -- 172.21.15.121:0/783558212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f500cc8d0 msgr2=0x7f8f501f92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f500cc8d0 0x7f8f501f92d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c034040 tx=0x7f8f3c0035f0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 -- 172.21.15.121:0/783558212 shutdown_connections 2024-09-17T03:36:49.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f5015cb20 0x7f8f500737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f30078bc0 0x7f8f3007b0d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f500cc8d0 0x7f8f501f92d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 --2- 172.21.15.121:0/783558212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f500b4990 0x7f8f501f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 -- 172.21.15.121:0/783558212 >> 172.21.15.121:0/783558212 conn(0x7f8f5006f940 msgr2=0x7f8f50144420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:49.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 -- 172.21.15.121:0/783558212 shutdown_connections 2024-09-17T03:36:49.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.606+0000 7f8f56600640 1 -- 172.21.15.121:0/783558212 wait complete. 2024-09-17T03:36:49.630 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-09-17T03:36:49.297941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220992,"kb_used_data":4728,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753728,"statfs":{"total":773094113280,"available":772867817472,"internally_reserved":0,"allocated":4841472,"data_stored":2717044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.077646"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257472+0000","last_change":"2024-09-17T03:36:44.253555+0000","last_active":"2024-09-17T03:36:45.257472+0000","last_peered":"2024-09-17T03:36:45.257472+0000","last_clean":"2024-09-17T03:36:45.257472+0000","last_became_active":"2024-09-17T03:36:44.253229+0000","last_became_peered":"2024-09-17T03:36:44.253229+0000","last_unstale":"2024-09-17T03:36:45.257472+0000","last_undegraded":"2024-09-17T03:36:45.257472+0000","last_fullsized":"2024-09-17T03:36:45.257472+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:06.783442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257666+0000","last_change":"2024-09-17T03:36:44.254536+0000","last_active":"2024-09-17T03:36:45.257666+0000","last_peered":"2024-09-17T03:36:45.257666+0000","last_clean":"2024-09-17T03:36:45.257666+0000","last_became_active":"2024-09-17T03:36:44.253988+0000","last_became_peered":"2024-09-17T03:36:44.253988+0000","last_unstale":"2024-09-17T03:36:45.257666+0000","last_undegraded":"2024-09-17T03:36:45.257666+0000","last_fullsized":"2024-09-17T03:36:45.257666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:13.241349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257410+0000","last_change":"2024-09-17T03:36:44.269911+0000","last_active":"2024-09-17T03:36:45.257410+0000","last_peered":"2024-09-17T03:36:45.257410+0000","last_clean":"2024-09-17T03:36:45.257410+0000","last_became_active":"2024-09-17T03:36:44.268580+0000","last_became_peered":"2024-09-17T03:36:44.268580+0000","last_unstale":"2024-09-17T03:36:45.257410+0000","last_undegraded":"2024-09-17T03:36:45.257410+0000","last_fullsized":"2024-09-17T03:36:45.257410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.450766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257448+0000","last_change":"2024-09-17T03:36:44.265556+0000","last_active":"2024-09-17T03:36:45.257448+0000","last_peered":"2024-09-17T03:36:45.257448+0000","last_clean":"2024-09-17T03:36:45.257448+0000","last_became_active":"2024-09-17T03:36:44.263396+0000","last_became_peered":"2024-09-17T03:36:44.263396+0000","last_unstale":"2024-09-17T03:36:45.257448+0000","last_undegraded":"2024-09-17T03:36:45.257448+0000","last_fullsized":"2024-09-17T03:36:45.257448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:52.560792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262421+0000","last_change":"2024-09-17T03:36:44.270961+0000","last_active":"2024-09-17T03:36:45.262421+0000","last_peered":"2024-09-17T03:36:45.262421+0000","last_clean":"2024-09-17T03:36:45.262421+0000","last_became_active":"2024-09-17T03:36:44.270715+0000","last_became_peered":"2024-09-17T03:36:44.270715+0000","last_unstale":"2024-09-17T03:36:45.262421+0000","last_undegraded":"2024-09-17T03:36:45.262421+0000","last_fullsized":"2024-09-17T03:36:45.262421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:28.602443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256080+0000","last_change":"2024-09-17T03:36:44.252818+0000","last_active":"2024-09-17T03:36:45.256080+0000","last_peered":"2024-09-17T03:36:45.256080+0000","last_clean":"2024-09-17T03:36:45.256080+0000","last_became_active":"2024-09-17T03:36:44.252517+0000","last_became_peered":"2024-09-17T03:36:44.252517+0000","last_unstale":"2024-09-17T03:36:45.256080+0000","last_undegraded":"2024-09-17T03:36:45.256080+0000","last_fullsized":"2024-09-17T03:36:45.256080+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:52.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339570+0000","last_change":"2024-09-17T03:36:44.258990+0000","last_active":"2024-09-17T03:36:45.339570+0000","last_peered":"2024-09-17T03:36:45.339570+0000","last_clean":"2024-09-17T03:36:45.339570+0000","last_became_active":"2024-09-17T03:36:44.257521+0000","last_became_peered":"2024-09-17T03:36:44.257521+0000","last_unstale":"2024-09-17T03:36:45.339570+0000","last_undegraded":"2024-09-17T03:36:45.339570+0000","last_fullsized":"2024-09-17T03:36:45.339570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:15.883165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255683+0000","last_change":"2024-09-17T03:36:44.261118+0000","last_active":"2024-09-17T03:36:45.255683+0000","last_peered":"2024-09-17T03:36:45.255683+0000","last_clean":"2024-09-17T03:36:45.255683+0000","last_became_active":"2024-09-17T03:36:44.260797+0000","last_became_peered":"2024-09-17T03:36:44.260797+0000","last_unstale":"2024-09-17T03:36:45.255683+0000","last_undegraded":"2024-09-17T03:36:45.255683+0000","last_fullsized":"2024-09-17T03:36:45.255683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:02.600076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262780+0000","last_change":"2024-09-17T03:36:44.262837+0000","last_active":"2024-09-17T03:36:45.262780+0000","last_peered":"2024-09-17T03:36:45.262780+0000","last_clean":"2024-09-17T03:36:45.262780+0000","last_became_active":"2024-09-17T03:36:44.262509+0000","last_became_peered":"2024-09-17T03:36:44.262509+0000","last_unstale":"2024-09-17T03:36:45.262780+0000","last_undegraded":"2024-09-17T03:36:45.262780+0000","last_fullsized":"2024-09-17T03:36:45.262780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:10.421129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340043+0000","last_change":"2024-09-17T03:36:44.265401+0000","last_active":"2024-09-17T03:36:45.340043+0000","last_peered":"2024-09-17T03:36:45.340043+0000","last_clean":"2024-09-17T03:36:45.340043+0000","last_became_active":"2024-09-17T03:36:44.264977+0000","last_became_peered":"2024-09-17T03:36:44.264977+0000","last_unstale":"2024-09-17T03:36:45.340043+0000","last_undegraded":"2024-09-17T03:36:45.340043+0000","last_fullsized":"2024-09-17T03:36:45.340043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:12.406230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266229+0000","last_change":"2024-09-17T03:36:44.263719+0000","last_active":"2024-09-17T03:36:45.266229+0000","last_peered":"2024-09-17T03:36:45.266229+0000","last_clean":"2024-09-17T03:36:45.266229+0000","last_became_active":"2024-09-17T03:36:44.263036+0000","last_became_peered":"2024-09-17T03:36:44.263036+0000","last_unstale":"2024-09-17T03:36:45.266229+0000","last_undegraded":"2024-09-17T03:36:45.266229+0000","last_fullsized":"2024-09-17T03:36:45.266229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:17.529967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262471+0000","last_change":"2024-09-17T03:36:44.256960+0000","last_active":"2024-09-17T03:36:45.262471+0000","last_peered":"2024-09-17T03:36:45.262471+0000","last_clean":"2024-09-17T03:36:45.262471+0000","last_became_active":"2024-09-17T03:36:44.256672+0000","last_became_peered":"2024-09-17T03:36:44.256672+0000","last_unstale":"2024-09-17T03:36:45.262471+0000","last_undegraded":"2024-09-17T03:36:45.262471+0000","last_fullsized":"2024-09-17T03:36:45.262471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:04.996521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339625+0000","last_change":"2024-09-17T03:36:44.256119+0000","last_active":"2024-09-17T03:36:45.339625+0000","last_peered":"2024-09-17T03:36:45.339625+0000","last_clean":"2024-09-17T03:36:45.339625+0000","last_became_active":"2024-09-17T03:36:44.255740+0000","last_became_peered":"2024-09-17T03:36:44.255740+0000","last_unstale":"2024-09-17T03:36:45.339625+0000","last_undegraded":"2024-09-17T03:36:45.339625+0000","last_fullsized":"2024-09-17T03:36:45.339625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:53.649917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339888+0000","last_change":"2024-09-17T03:36:44.257717+0000","last_active":"2024-09-17T03:36:45.339888+0000","last_peered":"2024-09-17T03:36:45.339888+0000","last_clean":"2024-09-17T03:36:45.339888+0000","last_became_active":"2024-09-17T03:36:44.257422+0000","last_became_peered":"2024-09-17T03:36:44.257422+0000","last_unstale":"2024-09-17T03:36:45.339888+0000","last_undegraded":"2024-09-17T03:36:45.339888+0000","last_fullsized":"2024-09-17T03:36:45.339888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:47.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257792+0000","last_change":"2024-09-17T03:36:44.244112+0000","last_active":"2024-09-17T03:36:45.257792+0000","last_peered":"2024-09-17T03:36:45.257792+0000","last_clean":"2024-09-17T03:36:45.257792+0000","last_became_active":"2024-09-17T03:36:44.243734+0000","last_became_peered":"2024-09-17T03:36:44.243734+0000","last_unstale":"2024-09-17T03:36:45.257792+0000","last_undegraded":"2024-09-17T03:36:45.257792+0000","last_fullsized":"2024-09-17T03:36:45.257792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:10.602532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339489+0000","last_change":"2024-09-17T03:36:44.254142+0000","last_active":"2024-09-17T03:36:45.339489+0000","last_peered":"2024-09-17T03:36:45.339489+0000","last_clean":"2024-09-17T03:36:45.339489+0000","last_became_active":"2024-09-17T03:36:44.253871+0000","last_became_peered":"2024-09-17T03:36:44.253871+0000","last_unstale":"2024-09-17T03:36:45.339489+0000","last_undegraded":"2024-09-17T03:36:45.339489+0000","last_fullsized":"2024-09-17T03:36:45.339489+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:27.123960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258233+0000","last_change":"2024-09-17T03:36:44.267635+0000","last_active":"2024-09-17T03:36:45.258233+0000","last_peered":"2024-09-17T03:36:45.258233+0000","last_clean":"2024-09-17T03:36:45.258233+0000","last_became_active":"2024-09-17T03:36:44.267199+0000","last_became_peered":"2024-09-17T03:36:44.267199+0000","last_unstale":"2024-09-17T03:36:45.258233+0000","last_undegraded":"2024-09-17T03:36:45.258233+0000","last_fullsized":"2024-09-17T03:36:45.258233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:44.085686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258400+0000","last_change":"2024-09-17T03:36:44.249470+0000","last_active":"2024-09-17T03:36:45.258400+0000","last_peered":"2024-09-17T03:36:45.258400+0000","last_clean":"2024-09-17T03:36:45.258400+0000","last_became_active":"2024-09-17T03:36:44.248597+0000","last_became_peered":"2024-09-17T03:36:44.248597+0000","last_unstale":"2024-09-17T03:36:45.258400+0000","last_undegraded":"2024-09-17T03:36:45.258400+0000","last_fullsized":"2024-09-17T03:36:45.258400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:54.287309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340772+0000","last_change":"2024-09-17T03:36:44.262318+0000","last_active":"2024-09-17T03:36:45.340772+0000","last_peered":"2024-09-17T03:36:45.340772+0000","last_clean":"2024-09-17T03:36:45.340772+0000","last_became_active":"2024-09-17T03:36:44.261979+0000","last_became_peered":"2024-09-17T03:36:44.261979+0000","last_unstale":"2024-09-17T03:36:45.340772+0000","last_undegraded":"2024-09-17T03:36:45.340772+0000","last_fullsized":"2024-09-17T03:36:45.340772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:52.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265813+0000","last_change":"2024-09-17T03:36:44.264562+0000","last_active":"2024-09-17T03:36:45.265813+0000","last_peered":"2024-09-17T03:36:45.265813+0000","last_clean":"2024-09-17T03:36:45.265813+0000","last_became_active":"2024-09-17T03:36:44.264273+0000","last_became_peered":"2024-09-17T03:36:44.264273+0000","last_unstale":"2024-09-17T03:36:45.265813+0000","last_undegraded":"2024-09-17T03:36:45.265813+0000","last_fullsized":"2024-09-17T03:36:45.265813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:44.688328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265788+0000","last_change":"2024-09-17T03:36:44.255197+0000","last_active":"2024-09-17T03:36:45.265788+0000","last_peered":"2024-09-17T03:36:45.265788+0000","last_clean":"2024-09-17T03:36:45.265788+0000","last_became_active":"2024-09-17T03:36:44.254536+0000","last_became_peered":"2024-09-17T03:36:44.254536+0000","last_unstale":"2024-09-17T03:36:45.265788+0000","last_undegraded":"2024-09-17T03:36:45.265788+0000","last_fullsized":"2024-09-17T03:36:45.265788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.442706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265693+0000","last_change":"2024-09-17T03:36:44.264660+0000","last_active":"2024-09-17T03:36:45.265693+0000","last_peered":"2024-09-17T03:36:45.265693+0000","last_clean":"2024-09-17T03:36:45.265693+0000","last_became_active":"2024-09-17T03:36:44.257929+0000","last_became_peered":"2024-09-17T03:36:44.257929+0000","last_unstale":"2024-09-17T03:36:45.265693+0000","last_undegraded":"2024-09-17T03:36:45.265693+0000","last_fullsized":"2024-09-17T03:36:45.265693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:34.451288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257806+0000","last_change":"2024-09-17T03:36:44.263605+0000","last_active":"2024-09-17T03:36:45.257806+0000","last_peered":"2024-09-17T03:36:45.257806+0000","last_clean":"2024-09-17T03:36:45.257806+0000","last_became_active":"2024-09-17T03:36:44.255877+0000","last_became_peered":"2024-09-17T03:36:44.255877+0000","last_unstale":"2024-09-17T03:36:45.257806+0000","last_undegraded":"2024-09-17T03:36:45.257806+0000","last_fullsized":"2024-09-17T03:36:45.257806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:03.771519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255975+0000","last_change":"2024-09-17T03:36:44.260449+0000","last_active":"2024-09-17T03:36:45.255975+0000","last_peered":"2024-09-17T03:36:45.255975+0000","last_clean":"2024-09-17T03:36:45.255975+0000","last_became_active":"2024-09-17T03:36:44.258669+0000","last_became_peered":"2024-09-17T03:36:44.258669+0000","last_unstale":"2024-09-17T03:36:45.255975+0000","last_undegraded":"2024-09-17T03:36:45.255975+0000","last_fullsized":"2024-09-17T03:36:45.255975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:37.603760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340781+0000","last_change":"2024-09-17T03:36:44.253003+0000","last_active":"2024-09-17T03:36:45.340781+0000","last_peered":"2024-09-17T03:36:45.340781+0000","last_clean":"2024-09-17T03:36:45.340781+0000","last_became_active":"2024-09-17T03:36:44.252680+0000","last_became_peered":"2024-09-17T03:36:44.252680+0000","last_unstale":"2024-09-17T03:36:45.340781+0000","last_undegraded":"2024-09-17T03:36:45.340781+0000","last_fullsized":"2024-09-17T03:36:45.340781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:43.947306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257791+0000","last_change":"2024-09-17T03:36:44.258976+0000","last_active":"2024-09-17T03:36:45.257791+0000","last_peered":"2024-09-17T03:36:45.257791+0000","last_clean":"2024-09-17T03:36:45.257791+0000","last_became_active":"2024-09-17T03:36:44.258614+0000","last_became_peered":"2024-09-17T03:36:44.258614+0000","last_unstale":"2024-09-17T03:36:45.257791+0000","last_undegraded":"2024-09-17T03:36:45.257791+0000","last_fullsized":"2024-09-17T03:36:45.257791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:47.717532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266123+0000","last_change":"2024-09-17T03:36:44.270263+0000","last_active":"2024-09-17T03:36:45.266123+0000","last_peered":"2024-09-17T03:36:45.266123+0000","last_clean":"2024-09-17T03:36:45.266123+0000","last_became_active":"2024-09-17T03:36:44.269849+0000","last_became_peered":"2024-09-17T03:36:44.269849+0000","last_unstale":"2024-09-17T03:36:45.266123+0000","last_undegraded":"2024-09-17T03:36:45.266123+0000","last_fullsized":"2024-09-17T03:36:45.266123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:34.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340142+0000","last_change":"2024-09-17T03:36:44.257142+0000","last_active":"2024-09-17T03:36:45.340142+0000","last_peered":"2024-09-17T03:36:45.340142+0000","last_clean":"2024-09-17T03:36:45.340142+0000","last_became_active":"2024-09-17T03:36:44.256859+0000","last_became_peered":"2024-09-17T03:36:44.256859+0000","last_unstale":"2024-09-17T03:36:45.340142+0000","last_undegraded":"2024-09-17T03:36:45.340142+0000","last_fullsized":"2024-09-17T03:36:45.340142+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:10.452184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257870+0000","last_change":"2024-09-17T03:36:44.250935+0000","last_active":"2024-09-17T03:36:45.257870+0000","last_peered":"2024-09-17T03:36:45.257870+0000","last_clean":"2024-09-17T03:36:45.257870+0000","last_became_active":"2024-09-17T03:36:44.250594+0000","last_became_peered":"2024-09-17T03:36:44.250594+0000","last_unstale":"2024-09-17T03:36:45.257870+0000","last_undegraded":"2024-09-17T03:36:45.257870+0000","last_fullsized":"2024-09-17T03:36:45.257870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:46.657454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258428+0000","last_change":"2024-09-17T03:36:44.253829+0000","last_active":"2024-09-17T03:36:45.258428+0000","last_peered":"2024-09-17T03:36:45.258428+0000","last_clean":"2024-09-17T03:36:45.258428+0000","last_became_active":"2024-09-17T03:36:44.253489+0000","last_became_peered":"2024-09-17T03:36:44.253489+0000","last_unstale":"2024-09-17T03:36:45.258428+0000","last_undegraded":"2024-09-17T03:36:45.258428+0000","last_fullsized":"2024-09-17T03:36:45.258428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:18.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339864+0000","last_change":"2024-09-17T03:36:44.257862+0000","last_active":"2024-09-17T03:36:45.339864+0000","last_peered":"2024-09-17T03:36:45.339864+0000","last_clean":"2024-09-17T03:36:45.339864+0000","last_became_active":"2024-09-17T03:36:44.256454+0000","last_became_peered":"2024-09-17T03:36:44.256454+0000","last_unstale":"2024-09-17T03:36:45.339864+0000","last_undegraded":"2024-09-17T03:36:45.339864+0000","last_fullsized":"2024-09-17T03:36:45.339864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:31.416993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256092+0000","last_change":"2024-09-17T03:36:44.261133+0000","last_active":"2024-09-17T03:36:45.256092+0000","last_peered":"2024-09-17T03:36:45.256092+0000","last_clean":"2024-09-17T03:36:45.256092+0000","last_became_active":"2024-09-17T03:36:44.260820+0000","last_became_peered":"2024-09-17T03:36:44.260820+0000","last_unstale":"2024-09-17T03:36:45.256092+0000","last_undegraded":"2024-09-17T03:36:45.256092+0000","last_fullsized":"2024-09-17T03:36:45.256092+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:35.003652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258326+0000","last_change":"2024-09-17T03:36:44.245754+0000","last_active":"2024-09-17T03:36:45.258326+0000","last_peered":"2024-09-17T03:36:45.258326+0000","last_clean":"2024-09-17T03:36:45.258326+0000","last_became_active":"2024-09-17T03:36:44.245408+0000","last_became_peered":"2024-09-17T03:36:44.245408+0000","last_unstale":"2024-09-17T03:36:45.258326+0000","last_undegraded":"2024-09-17T03:36:45.258326+0000","last_fullsized":"2024-09-17T03:36:45.258326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:44.165481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340900+0000","last_change":"2024-09-17T03:36:43.245126+0000","last_active":"2024-09-17T03:36:45.340900+0000","last_peered":"2024-09-17T03:36:45.340900+0000","last_clean":"2024-09-17T03:36:45.340900+0000","last_became_active":"2024-09-17T03:36:43.244672+0000","last_became_peered":"2024-09-17T03:36:43.244672+0000","last_unstale":"2024-09-17T03:36:45.340900+0000","last_undegraded":"2024-09-17T03:36:45.340900+0000","last_fullsized":"2024-09-17T03:36:45.340900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257397+0000","last_change":"2024-09-17T03:36:44.268310+0000","last_active":"2024-09-17T03:36:45.257397+0000","last_peered":"2024-09-17T03:36:45.257397+0000","last_clean":"2024-09-17T03:36:45.257397+0000","last_became_active":"2024-09-17T03:36:44.265610+0000","last_became_peered":"2024-09-17T03:36:44.265610+0000","last_unstale":"2024-09-17T03:36:45.257397+0000","last_undegraded":"2024-09-17T03:36:45.257397+0000","last_fullsized":"2024-09-17T03:36:45.257397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:24.017008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257820+0000","last_change":"2024-09-17T03:36:43.244589+0000","last_active":"2024-09-17T03:36:45.257820+0000","last_peered":"2024-09-17T03:36:45.257820+0000","last_clean":"2024-09-17T03:36:45.257820+0000","last_became_active":"2024-09-17T03:36:43.244277+0000","last_became_peered":"2024-09-17T03:36:43.244277+0000","last_unstale":"2024-09-17T03:36:45.257820+0000","last_undegraded":"2024-09-17T03:36:45.257820+0000","last_fullsized":"2024-09-17T03:36:45.257820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258699+0000","last_change":"2024-09-17T03:36:44.259012+0000","last_active":"2024-09-17T03:36:45.258699+0000","last_peered":"2024-09-17T03:36:45.258699+0000","last_clean":"2024-09-17T03:36:45.258699+0000","last_became_active":"2024-09-17T03:36:44.258013+0000","last_became_peered":"2024-09-17T03:36:44.258013+0000","last_unstale":"2024-09-17T03:36:45.258699+0000","last_undegraded":"2024-09-17T03:36:45.258699+0000","last_fullsized":"2024-09-17T03:36:45.258699+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:37.644719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257542+0000","last_change":"2024-09-17T03:36:43.238389+0000","last_active":"2024-09-17T03:36:45.257542+0000","last_peered":"2024-09-17T03:36:45.257542+0000","last_clean":"2024-09-17T03:36:45.257542+0000","last_became_active":"2024-09-17T03:36:43.236175+0000","last_became_peered":"2024-09-17T03:36:43.236175+0000","last_unstale":"2024-09-17T03:36:45.257542+0000","last_undegraded":"2024-09-17T03:36:45.257542+0000","last_fullsized":"2024-09-17T03:36:45.257542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:03.593859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258015+0000","last_change":"2024-09-17T03:36:44.265627+0000","last_active":"2024-09-17T03:36:45.258015+0000","last_peered":"2024-09-17T03:36:45.258015+0000","last_clean":"2024-09-17T03:36:45.258015+0000","last_became_active":"2024-09-17T03:36:44.265268+0000","last_became_peered":"2024-09-17T03:36:44.265268+0000","last_unstale":"2024-09-17T03:36:45.258015+0000","last_undegraded":"2024-09-17T03:36:45.258015+0000","last_fullsized":"2024-09-17T03:36:45.258015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:56.232153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340576+0000","last_change":"2024-09-17T03:36:43.243254+0000","last_active":"2024-09-17T03:36:45.340576+0000","last_peered":"2024-09-17T03:36:45.340576+0000","last_clean":"2024-09-17T03:36:45.340576+0000","last_became_active":"2024-09-17T03:36:43.242906+0000","last_became_peered":"2024-09-17T03:36:43.242906+0000","last_unstale":"2024-09-17T03:36:45.340576+0000","last_undegraded":"2024-09-17T03:36:45.340576+0000","last_fullsized":"2024-09-17T03:36:45.340576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256261+0000","last_change":"2024-09-17T03:36:44.250908+0000","last_active":"2024-09-17T03:36:45.256261+0000","last_peered":"2024-09-17T03:36:45.256261+0000","last_clean":"2024-09-17T03:36:45.256261+0000","last_became_active":"2024-09-17T03:36:44.250597+0000","last_became_peered":"2024-09-17T03:36:44.250597+0000","last_unstale":"2024-09-17T03:36:45.256261+0000","last_undegraded":"2024-09-17T03:36:45.256261+0000","last_fullsized":"2024-09-17T03:36:45.256261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:34.203214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340298+0000","last_change":"2024-09-17T03:36:43.239775+0000","last_active":"2024-09-17T03:36:45.340298+0000","last_peered":"2024-09-17T03:36:45.340298+0000","last_clean":"2024-09-17T03:36:45.340298+0000","last_became_active":"2024-09-17T03:36:43.239466+0000","last_became_peered":"2024-09-17T03:36:43.239466+0000","last_unstale":"2024-09-17T03:36:45.340298+0000","last_undegraded":"2024-09-17T03:36:45.340298+0000","last_fullsized":"2024-09-17T03:36:45.340298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:14.876381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265496+0000","last_change":"2024-09-17T03:36:44.257169+0000","last_active":"2024-09-17T03:36:45.265496+0000","last_peered":"2024-09-17T03:36:45.265496+0000","last_clean":"2024-09-17T03:36:45.265496+0000","last_became_active":"2024-09-17T03:36:44.256569+0000","last_became_peered":"2024-09-17T03:36:44.256569+0000","last_unstale":"2024-09-17T03:36:45.265496+0000","last_undegraded":"2024-09-17T03:36:45.265496+0000","last_fullsized":"2024-09-17T03:36:45.265496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:36.847491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339665+0000","last_change":"2024-09-17T03:36:43.238069+0000","last_active":"2024-09-17T03:36:45.339665+0000","last_peered":"2024-09-17T03:36:45.339665+0000","last_clean":"2024-09-17T03:36:45.339665+0000","last_became_active":"2024-09-17T03:36:43.237720+0000","last_became_peered":"2024-09-17T03:36:43.237720+0000","last_unstale":"2024-09-17T03:36:45.339665+0000","last_undegraded":"2024-09-17T03:36:45.339665+0000","last_fullsized":"2024-09-17T03:36:45.339665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:46.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257884+0000","last_change":"2024-09-17T03:36:44.265836+0000","last_active":"2024-09-17T03:36:45.257884+0000","last_peered":"2024-09-17T03:36:45.257884+0000","last_clean":"2024-09-17T03:36:45.257884+0000","last_became_active":"2024-09-17T03:36:44.265525+0000","last_became_peered":"2024-09-17T03:36:44.265525+0000","last_unstale":"2024-09-17T03:36:45.257884+0000","last_undegraded":"2024-09-17T03:36:45.257884+0000","last_fullsized":"2024-09-17T03:36:45.257884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:08.571368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256577+0000","last_change":"2024-09-17T03:36:43.247308+0000","last_active":"2024-09-17T03:36:45.256577+0000","last_peered":"2024-09-17T03:36:45.256577+0000","last_clean":"2024-09-17T03:36:45.256577+0000","last_became_active":"2024-09-17T03:36:43.246995+0000","last_became_peered":"2024-09-17T03:36:43.246995+0000","last_unstale":"2024-09-17T03:36:45.256577+0000","last_undegraded":"2024-09-17T03:36:45.256577+0000","last_fullsized":"2024-09-17T03:36:45.256577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:25.438322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258114+0000","last_change":"2024-09-17T03:36:44.258467+0000","last_active":"2024-09-17T03:36:45.258114+0000","last_peered":"2024-09-17T03:36:45.258114+0000","last_clean":"2024-09-17T03:36:45.258114+0000","last_became_active":"2024-09-17T03:36:44.258054+0000","last_became_peered":"2024-09-17T03:36:44.258054+0000","last_unstale":"2024-09-17T03:36:45.258114+0000","last_undegraded":"2024-09-17T03:36:45.258114+0000","last_fullsized":"2024-09-17T03:36:45.258114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:53.739833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339566+0000","last_change":"2024-09-17T03:36:43.242724+0000","last_active":"2024-09-17T03:36:45.339566+0000","last_peered":"2024-09-17T03:36:45.339566+0000","last_clean":"2024-09-17T03:36:45.339566+0000","last_became_active":"2024-09-17T03:36:43.242438+0000","last_became_peered":"2024-09-17T03:36:43.242438+0000","last_unstale":"2024-09-17T03:36:45.339566+0000","last_undegraded":"2024-09-17T03:36:45.339566+0000","last_fullsized":"2024-09-17T03:36:45.339566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:51.471274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257742+0000","last_change":"2024-09-17T03:36:44.263729+0000","last_active":"2024-09-17T03:36:45.257742+0000","last_peered":"2024-09-17T03:36:45.257742+0000","last_clean":"2024-09-17T03:36:45.257742+0000","last_became_active":"2024-09-17T03:36:44.263448+0000","last_became_peered":"2024-09-17T03:36:44.263448+0000","last_unstale":"2024-09-17T03:36:45.257742+0000","last_undegraded":"2024-09-17T03:36:45.257742+0000","last_fullsized":"2024-09-17T03:36:45.257742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:37.282878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257555+0000","last_change":"2024-09-17T03:36:43.246866+0000","last_active":"2024-09-17T03:36:45.257555+0000","last_peered":"2024-09-17T03:36:45.257555+0000","last_clean":"2024-09-17T03:36:45.257555+0000","last_became_active":"2024-09-17T03:36:43.246475+0000","last_became_peered":"2024-09-17T03:36:43.246475+0000","last_unstale":"2024-09-17T03:36:45.257555+0000","last_undegraded":"2024-09-17T03:36:45.257555+0000","last_fullsized":"2024-09-17T03:36:45.257555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:48.456727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340631+0000","last_change":"2024-09-17T03:36:44.266455+0000","last_active":"2024-09-17T03:36:45.340631+0000","last_peered":"2024-09-17T03:36:45.340631+0000","last_clean":"2024-09-17T03:36:45.340631+0000","last_became_active":"2024-09-17T03:36:44.266153+0000","last_became_peered":"2024-09-17T03:36:44.266153+0000","last_unstale":"2024-09-17T03:36:45.340631+0000","last_undegraded":"2024-09-17T03:36:45.340631+0000","last_fullsized":"2024-09-17T03:36:45.340631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:01.286771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258504+0000","last_change":"2024-09-17T03:36:43.251663+0000","last_active":"2024-09-17T03:36:45.258504+0000","last_peered":"2024-09-17T03:36:45.258504+0000","last_clean":"2024-09-17T03:36:45.258504+0000","last_became_active":"2024-09-17T03:36:43.249590+0000","last_became_peered":"2024-09-17T03:36:43.249590+0000","last_unstale":"2024-09-17T03:36:45.258504+0000","last_undegraded":"2024-09-17T03:36:45.258504+0000","last_fullsized":"2024-09-17T03:36:45.258504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:28.331414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257802+0000","last_change":"2024-09-17T03:36:44.259992+0000","last_active":"2024-09-17T03:36:45.257802+0000","last_peered":"2024-09-17T03:36:45.257802+0000","last_clean":"2024-09-17T03:36:45.257802+0000","last_became_active":"2024-09-17T03:36:44.259512+0000","last_became_peered":"2024-09-17T03:36:44.259512+0000","last_unstale":"2024-09-17T03:36:45.257802+0000","last_undegraded":"2024-09-17T03:36:45.257802+0000","last_fullsized":"2024-09-17T03:36:45.257802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:57.312821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257931+0000","last_change":"2024-09-17T03:36:43.250402+0000","last_active":"2024-09-17T03:36:45.257931+0000","last_peered":"2024-09-17T03:36:45.257931+0000","last_clean":"2024-09-17T03:36:45.257931+0000","last_became_active":"2024-09-17T03:36:43.250094+0000","last_became_peered":"2024-09-17T03:36:43.250094+0000","last_unstale":"2024-09-17T03:36:45.257931+0000","last_undegraded":"2024-09-17T03:36:45.257931+0000","last_fullsized":"2024-09-17T03:36:45.257931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:04.120350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340018+0000","last_change":"2024-09-17T03:36:44.256373+0000","last_active":"2024-09-17T03:36:45.340018+0000","last_peered":"2024-09-17T03:36:45.340018+0000","last_clean":"2024-09-17T03:36:45.340018+0000","last_became_active":"2024-09-17T03:36:44.256013+0000","last_became_peered":"2024-09-17T03:36:44.256013+0000","last_unstale":"2024-09-17T03:36:45.340018+0000","last_undegraded":"2024-09-17T03:36:45.340018+0000","last_fullsized":"2024-09-17T03:36:45.340018+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:05.669667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257531+0000","last_change":"2024-09-17T03:36:43.238750+0000","last_active":"2024-09-17T03:36:45.257531+0000","last_peered":"2024-09-17T03:36:45.257531+0000","last_clean":"2024-09-17T03:36:45.257531+0000","last_became_active":"2024-09-17T03:36:43.237712+0000","last_became_peered":"2024-09-17T03:36:43.237712+0000","last_unstale":"2024-09-17T03:36:45.257531+0000","last_undegraded":"2024-09-17T03:36:45.257531+0000","last_fullsized":"2024-09-17T03:36:45.257531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:31.004371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256461+0000","last_change":"2024-09-17T03:36:44.257208+0000","last_active":"2024-09-17T03:36:45.256461+0000","last_peered":"2024-09-17T03:36:45.256461+0000","last_clean":"2024-09-17T03:36:45.256461+0000","last_became_active":"2024-09-17T03:36:44.256776+0000","last_became_peered":"2024-09-17T03:36:44.256776+0000","last_unstale":"2024-09-17T03:36:45.256461+0000","last_undegraded":"2024-09-17T03:36:45.256461+0000","last_fullsized":"2024-09-17T03:36:45.256461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:52.227091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256866+0000","last_change":"2024-09-17T03:36:43.246552+0000","last_active":"2024-09-17T03:36:45.256866+0000","last_peered":"2024-09-17T03:36:45.256866+0000","last_clean":"2024-09-17T03:36:45.256866+0000","last_became_active":"2024-09-17T03:36:43.243938+0000","last_became_peered":"2024-09-17T03:36:43.243938+0000","last_unstale":"2024-09-17T03:36:45.256866+0000","last_undegraded":"2024-09-17T03:36:45.256866+0000","last_fullsized":"2024-09-17T03:36:45.256866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:32.019221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256090+0000","last_change":"2024-09-17T03:36:44.257966+0000","last_active":"2024-09-17T03:36:45.256090+0000","last_peered":"2024-09-17T03:36:45.256090+0000","last_clean":"2024-09-17T03:36:45.256090+0000","last_became_active":"2024-09-17T03:36:44.257627+0000","last_became_peered":"2024-09-17T03:36:44.257627+0000","last_unstale":"2024-09-17T03:36:45.256090+0000","last_undegraded":"2024-09-17T03:36:45.256090+0000","last_fullsized":"2024-09-17T03:36:45.256090+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:07.526657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257449+0000","last_change":"2024-09-17T03:36:43.242166+0000","last_active":"2024-09-17T03:36:45.257449+0000","last_peered":"2024-09-17T03:36:45.257449+0000","last_clean":"2024-09-17T03:36:45.257449+0000","last_became_active":"2024-09-17T03:36:43.241720+0000","last_became_peered":"2024-09-17T03:36:43.241720+0000","last_unstale":"2024-09-17T03:36:45.257449+0000","last_undegraded":"2024-09-17T03:36:45.257449+0000","last_fullsized":"2024-09-17T03:36:45.257449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:30.410210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265941+0000","last_change":"2024-09-17T03:36:44.253537+0000","last_active":"2024-09-17T03:36:45.265941+0000","last_peered":"2024-09-17T03:36:45.265941+0000","last_clean":"2024-09-17T03:36:45.265941+0000","last_became_active":"2024-09-17T03:36:44.253232+0000","last_became_peered":"2024-09-17T03:36:44.253232+0000","last_unstale":"2024-09-17T03:36:45.265941+0000","last_undegraded":"2024-09-17T03:36:45.265941+0000","last_fullsized":"2024-09-17T03:36:45.265941+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:20.976361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258034+0000","last_change":"2024-09-17T03:36:43.245321+0000","last_active":"2024-09-17T03:36:45.258034+0000","last_peered":"2024-09-17T03:36:45.258034+0000","last_clean":"2024-09-17T03:36:45.258034+0000","last_became_active":"2024-09-17T03:36:43.245000+0000","last_became_peered":"2024-09-17T03:36:43.245000+0000","last_unstale":"2024-09-17T03:36:45.258034+0000","last_undegraded":"2024-09-17T03:36:45.258034+0000","last_fullsized":"2024-09-17T03:36:45.258034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:06.451160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262584+0000","last_change":"2024-09-17T03:36:44.255583+0000","last_active":"2024-09-17T03:36:45.262584+0000","last_peered":"2024-09-17T03:36:45.262584+0000","last_clean":"2024-09-17T03:36:45.262584+0000","last_became_active":"2024-09-17T03:36:44.255259+0000","last_became_peered":"2024-09-17T03:36:44.255259+0000","last_unstale":"2024-09-17T03:36:45.262584+0000","last_undegraded":"2024-09-17T03:36:45.262584+0000","last_fullsized":"2024-09-17T03:36:45.262584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:14.932088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339312+0000","last_change":"2024-09-17T03:36:43.239640+0000","last_active":"2024-09-17T03:36:45.339312+0000","last_peered":"2024-09-17T03:36:45.339312+0000","last_clean":"2024-09-17T03:36:45.339312+0000","last_became_active":"2024-09-17T03:36:43.239321+0000","last_became_peered":"2024-09-17T03:36:43.239321+0000","last_unstale":"2024-09-17T03:36:45.339312+0000","last_undegraded":"2024-09-17T03:36:45.339312+0000","last_fullsized":"2024-09-17T03:36:45.339312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:30.410210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257073+0000","last_change":"2024-09-17T03:36:44.260816+0000","last_active":"2024-09-17T03:36:45.257073+0000","last_peered":"2024-09-17T03:36:45.257073+0000","last_clean":"2024-09-17T03:36:45.257073+0000","last_became_active":"2024-09-17T03:36:44.260481+0000","last_became_peered":"2024-09-17T03:36:44.260481+0000","last_unstale":"2024-09-17T03:36:45.257073+0000","last_undegraded":"2024-09-17T03:36:45.257073+0000","last_fullsized":"2024-09-17T03:36:45.257073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:04.179982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340101+0000","last_change":"2024-09-17T03:36:43.250977+0000","last_active":"2024-09-17T03:36:45.340101+0000","last_peered":"2024-09-17T03:36:45.340101+0000","last_clean":"2024-09-17T03:36:45.340101+0000","last_became_active":"2024-09-17T03:36:43.250638+0000","last_became_peered":"2024-09-17T03:36:43.250638+0000","last_unstale":"2024-09-17T03:36:45.340101+0000","last_undegraded":"2024-09-17T03:36:45.340101+0000","last_fullsized":"2024-09-17T03:36:45.340101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:54.928131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340247+0000","last_change":"2024-09-17T03:36:44.261046+0000","last_active":"2024-09-17T03:36:45.340247+0000","last_peered":"2024-09-17T03:36:45.340247+0000","last_clean":"2024-09-17T03:36:45.340247+0000","last_became_active":"2024-09-17T03:36:44.260749+0000","last_became_peered":"2024-09-17T03:36:44.260749+0000","last_unstale":"2024-09-17T03:36:45.340247+0000","last_undegraded":"2024-09-17T03:36:45.340247+0000","last_fullsized":"2024-09-17T03:36:45.340247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:47.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258597+0000","last_change":"2024-09-17T03:36:43.248274+0000","last_active":"2024-09-17T03:36:45.258597+0000","last_peered":"2024-09-17T03:36:45.258597+0000","last_clean":"2024-09-17T03:36:45.258597+0000","last_became_active":"2024-09-17T03:36:43.247287+0000","last_became_peered":"2024-09-17T03:36:43.247287+0000","last_unstale":"2024-09-17T03:36:45.258597+0000","last_undegraded":"2024-09-17T03:36:45.258597+0000","last_fullsized":"2024-09-17T03:36:45.258597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:08.860204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340228+0000","last_change":"2024-09-17T03:36:44.260449+0000","last_active":"2024-09-17T03:36:45.340228+0000","last_peered":"2024-09-17T03:36:45.340228+0000","last_clean":"2024-09-17T03:36:45.340228+0000","last_became_active":"2024-09-17T03:36:44.260163+0000","last_became_peered":"2024-09-17T03:36:44.260163+0000","last_unstale":"2024-09-17T03:36:45.340228+0000","last_undegraded":"2024-09-17T03:36:45.340228+0000","last_fullsized":"2024-09-17T03:36:45.340228+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:49.493460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262410+0000","last_change":"2024-09-17T03:36:43.242358+0000","last_active":"2024-09-17T03:36:45.262410+0000","last_peered":"2024-09-17T03:36:45.262410+0000","last_clean":"2024-09-17T03:36:45.262410+0000","last_became_active":"2024-09-17T03:36:43.241998+0000","last_became_peered":"2024-09-17T03:36:43.241998+0000","last_unstale":"2024-09-17T03:36:45.262410+0000","last_undegraded":"2024-09-17T03:36:45.262410+0000","last_fullsized":"2024-09-17T03:36:45.262410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:02.266116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340839+0000","last_change":"2024-09-17T03:36:44.255735+0000","last_active":"2024-09-17T03:36:45.340839+0000","last_peered":"2024-09-17T03:36:45.340839+0000","last_clean":"2024-09-17T03:36:45.340839+0000","last_became_active":"2024-09-17T03:36:44.254710+0000","last_became_peered":"2024-09-17T03:36:44.254710+0000","last_unstale":"2024-09-17T03:36:45.340839+0000","last_undegraded":"2024-09-17T03:36:45.340839+0000","last_fullsized":"2024-09-17T03:36:45.340839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:14.497107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340523+0000","last_change":"2024-09-17T03:36:43.246790+0000","last_active":"2024-09-17T03:36:45.340523+0000","last_peered":"2024-09-17T03:36:45.340523+0000","last_clean":"2024-09-17T03:36:45.340523+0000","last_became_active":"2024-09-17T03:36:43.246506+0000","last_became_peered":"2024-09-17T03:36:43.246506+0000","last_unstale":"2024-09-17T03:36:45.340523+0000","last_undegraded":"2024-09-17T03:36:45.340523+0000","last_fullsized":"2024-09-17T03:36:45.340523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:36.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257782+0000","last_change":"2024-09-17T03:36:44.251074+0000","last_active":"2024-09-17T03:36:45.257782+0000","last_peered":"2024-09-17T03:36:45.257782+0000","last_clean":"2024-09-17T03:36:45.257782+0000","last_became_active":"2024-09-17T03:36:44.249327+0000","last_became_peered":"2024-09-17T03:36:44.249327+0000","last_unstale":"2024-09-17T03:36:45.257782+0000","last_undegraded":"2024-09-17T03:36:45.257782+0000","last_fullsized":"2024-09-17T03:36:45.257782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:12.553359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340586+0000","last_change":"2024-09-17T03:36:43.244507+0000","last_active":"2024-09-17T03:36:45.340586+0000","last_peered":"2024-09-17T03:36:45.340586+0000","last_clean":"2024-09-17T03:36:45.340586+0000","last_became_active":"2024-09-17T03:36:43.244138+0000","last_became_peered":"2024-09-17T03:36:43.244138+0000","last_unstale":"2024-09-17T03:36:45.340586+0000","last_undegraded":"2024-09-17T03:36:45.340586+0000","last_fullsized":"2024-09-17T03:36:45.340586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:37.711102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255403+0000","last_change":"2024-09-17T03:36:44.253706+0000","last_active":"2024-09-17T03:36:45.255403+0000","last_peered":"2024-09-17T03:36:45.255403+0000","last_clean":"2024-09-17T03:36:45.255403+0000","last_became_active":"2024-09-17T03:36:44.253406+0000","last_became_peered":"2024-09-17T03:36:44.253406+0000","last_unstale":"2024-09-17T03:36:45.255403+0000","last_undegraded":"2024-09-17T03:36:45.255403+0000","last_fullsized":"2024-09-17T03:36:45.255403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:59.355486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257330+0000","last_change":"2024-09-17T03:36:43.245115+0000","last_active":"2024-09-17T03:36:45.257330+0000","last_peered":"2024-09-17T03:36:45.257330+0000","last_clean":"2024-09-17T03:36:45.257330+0000","last_became_active":"2024-09-17T03:36:43.244800+0000","last_became_peered":"2024-09-17T03:36:43.244800+0000","last_unstale":"2024-09-17T03:36:45.257330+0000","last_undegraded":"2024-09-17T03:36:45.257330+0000","last_fullsized":"2024-09-17T03:36:45.257330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265952+0000","last_change":"2024-09-17T03:36:44.263078+0000","last_active":"2024-09-17T03:36:45.265952+0000","last_peered":"2024-09-17T03:36:45.265952+0000","last_clean":"2024-09-17T03:36:45.265952+0000","last_became_active":"2024-09-17T03:36:44.262753+0000","last_became_peered":"2024-09-17T03:36:44.262753+0000","last_unstale":"2024-09-17T03:36:45.265952+0000","last_undegraded":"2024-09-17T03:36:45.265952+0000","last_fullsized":"2024-09-17T03:36:45.265952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:52.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339783+0000","last_change":"2024-09-17T03:36:43.245006+0000","last_active":"2024-09-17T03:36:45.339783+0000","last_peered":"2024-09-17T03:36:45.339783+0000","last_clean":"2024-09-17T03:36:45.339783+0000","last_became_active":"2024-09-17T03:36:43.244723+0000","last_became_peered":"2024-09-17T03:36:43.244723+0000","last_unstale":"2024-09-17T03:36:45.339783+0000","last_undegraded":"2024-09-17T03:36:45.339783+0000","last_fullsized":"2024-09-17T03:36:45.339783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.555456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256781+0000","last_change":"2024-09-17T03:36:44.259397+0000","last_active":"2024-09-17T03:36:45.256781+0000","last_peered":"2024-09-17T03:36:45.256781+0000","last_clean":"2024-09-17T03:36:45.256781+0000","last_became_active":"2024-09-17T03:36:44.259042+0000","last_became_peered":"2024-09-17T03:36:44.259042+0000","last_unstale":"2024-09-17T03:36:45.256781+0000","last_undegraded":"2024-09-17T03:36:45.256781+0000","last_fullsized":"2024-09-17T03:36:45.256781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.440414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255636+0000","last_change":"2024-09-17T03:36:43.246360+0000","last_active":"2024-09-17T03:36:45.255636+0000","last_peered":"2024-09-17T03:36:45.255636+0000","last_clean":"2024-09-17T03:36:45.255636+0000","last_became_active":"2024-09-17T03:36:43.243140+0000","last_became_peered":"2024-09-17T03:36:43.243140+0000","last_unstale":"2024-09-17T03:36:45.255636+0000","last_undegraded":"2024-09-17T03:36:45.255636+0000","last_fullsized":"2024-09-17T03:36:45.255636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:14.876381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262543+0000","last_change":"2024-09-17T03:36:44.265309+0000","last_active":"2024-09-17T03:36:45.262543+0000","last_peered":"2024-09-17T03:36:45.262543+0000","last_clean":"2024-09-17T03:36:45.262543+0000","last_became_active":"2024-09-17T03:36:44.264925+0000","last_became_peered":"2024-09-17T03:36:44.264925+0000","last_unstale":"2024-09-17T03:36:45.262543+0000","last_undegraded":"2024-09-17T03:36:45.262543+0000","last_fullsized":"2024-09-17T03:36:45.262543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:35.512783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258272+0000","last_change":"2024-09-17T03:36:43.249727+0000","last_active":"2024-09-17T03:36:45.258272+0000","last_peered":"2024-09-17T03:36:45.258272+0000","last_clean":"2024-09-17T03:36:45.258272+0000","last_became_active":"2024-09-17T03:36:43.249376+0000","last_became_peered":"2024-09-17T03:36:43.249376+0000","last_unstale":"2024-09-17T03:36:45.258272+0000","last_undegraded":"2024-09-17T03:36:45.258272+0000","last_fullsized":"2024-09-17T03:36:45.258272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:13.054687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266096+0000","last_change":"2024-09-17T03:36:44.269381+0000","last_active":"2024-09-17T03:36:45.266096+0000","last_peered":"2024-09-17T03:36:45.266096+0000","last_clean":"2024-09-17T03:36:45.266096+0000","last_became_active":"2024-09-17T03:36:44.264227+0000","last_became_peered":"2024-09-17T03:36:44.264227+0000","last_unstale":"2024-09-17T03:36:45.266096+0000","last_undegraded":"2024-09-17T03:36:45.266096+0000","last_fullsized":"2024-09-17T03:36:45.266096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:56.489758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.264284+0000","last_change":"2024-09-17T03:36:43.242092+0000","last_active":"2024-09-17T03:36:45.264284+0000","last_peered":"2024-09-17T03:36:45.264284+0000","last_clean":"2024-09-17T03:36:45.264284+0000","last_became_active":"2024-09-17T03:36:43.241759+0000","last_became_peered":"2024-09-17T03:36:43.241759+0000","last_unstale":"2024-09-17T03:36:45.264284+0000","last_undegraded":"2024-09-17T03:36:45.264284+0000","last_fullsized":"2024-09-17T03:36:45.264284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:30.046741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340741+0000","last_change":"2024-09-17T03:36:44.273690+0000","last_active":"2024-09-17T03:36:45.340741+0000","last_peered":"2024-09-17T03:36:45.340741+0000","last_clean":"2024-09-17T03:36:45.340741+0000","last_became_active":"2024-09-17T03:36:44.273364+0000","last_became_peered":"2024-09-17T03:36:44.273364+0000","last_unstale":"2024-09-17T03:36:45.340741+0000","last_undegraded":"2024-09-17T03:36:45.340741+0000","last_fullsized":"2024-09-17T03:36:45.340741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:37.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262362+0000","last_change":"2024-09-17T03:36:43.233724+0000","last_active":"2024-09-17T03:36:45.262362+0000","last_peered":"2024-09-17T03:36:45.262362+0000","last_clean":"2024-09-17T03:36:45.262362+0000","last_became_active":"2024-09-17T03:36:43.232853+0000","last_became_peered":"2024-09-17T03:36:43.232853+0000","last_unstale":"2024-09-17T03:36:45.262362+0000","last_undegraded":"2024-09-17T03:36:45.262362+0000","last_fullsized":"2024-09-17T03:36:45.262362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:10.474554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262290+0000","last_change":"2024-09-17T03:36:44.256195+0000","last_active":"2024-09-17T03:36:45.262290+0000","last_peered":"2024-09-17T03:36:45.262290+0000","last_clean":"2024-09-17T03:36:45.262290+0000","last_became_active":"2024-09-17T03:36:44.255895+0000","last_became_peered":"2024-09-17T03:36:44.255895+0000","last_unstale":"2024-09-17T03:36:45.262290+0000","last_undegraded":"2024-09-17T03:36:45.262290+0000","last_fullsized":"2024-09-17T03:36:45.262290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:54.588941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256997+0000","last_change":"2024-09-17T03:36:43.237705+0000","last_active":"2024-09-17T03:36:45.256997+0000","last_peered":"2024-09-17T03:36:45.256997+0000","last_clean":"2024-09-17T03:36:45.256997+0000","last_became_active":"2024-09-17T03:36:43.236308+0000","last_became_peered":"2024-09-17T03:36:43.236308+0000","last_unstale":"2024-09-17T03:36:45.256997+0000","last_undegraded":"2024-09-17T03:36:45.256997+0000","last_fullsized":"2024-09-17T03:36:45.256997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:35.939675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257954+0000","last_change":"2024-09-17T03:36:44.251549+0000","last_active":"2024-09-17T03:36:45.257954+0000","last_peered":"2024-09-17T03:36:45.257954+0000","last_clean":"2024-09-17T03:36:45.257954+0000","last_became_active":"2024-09-17T03:36:44.249170+0000","last_became_peered":"2024-09-17T03:36:44.249170+0000","last_unstale":"2024-09-17T03:36:45.257954+0000","last_undegraded":"2024-09-17T03:36:45.257954+0000","last_fullsized":"2024-09-17T03:36:45.257954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.234298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266059+0000","last_change":"2024-09-17T03:36:43.250361+0000","last_active":"2024-09-17T03:36:45.266059+0000","last_peered":"2024-09-17T03:36:45.266059+0000","last_clean":"2024-09-17T03:36:45.266059+0000","last_became_active":"2024-09-17T03:36:43.250046+0000","last_became_peered":"2024-09-17T03:36:43.250046+0000","last_unstale":"2024-09-17T03:36:45.266059+0000","last_undegraded":"2024-09-17T03:36:45.266059+0000","last_fullsized":"2024-09-17T03:36:45.266059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:13.925305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258201+0000","last_change":"2024-09-17T03:36:44.245554+0000","last_active":"2024-09-17T03:36:45.258201+0000","last_peered":"2024-09-17T03:36:45.258201+0000","last_clean":"2024-09-17T03:36:45.258201+0000","last_became_active":"2024-09-17T03:36:44.243706+0000","last_became_peered":"2024-09-17T03:36:44.243706+0000","last_unstale":"2024-09-17T03:36:45.258201+0000","last_undegraded":"2024-09-17T03:36:45.258201+0000","last_fullsized":"2024-09-17T03:36:45.258201+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:57.050681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258133+0000","last_change":"2024-09-17T03:36:43.251317+0000","last_active":"2024-09-17T03:36:45.258133+0000","last_peered":"2024-09-17T03:36:45.258133+0000","last_clean":"2024-09-17T03:36:45.258133+0000","last_became_active":"2024-09-17T03:36:43.250948+0000","last_became_peered":"2024-09-17T03:36:43.250948+0000","last_unstale":"2024-09-17T03:36:45.258133+0000","last_undegraded":"2024-09-17T03:36:45.258133+0000","last_fullsized":"2024-09-17T03:36:45.258133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:14.413534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265908+0000","last_change":"2024-09-17T03:36:44.254879+0000","last_active":"2024-09-17T03:36:45.265908+0000","last_peered":"2024-09-17T03:36:45.265908+0000","last_clean":"2024-09-17T03:36:45.265908+0000","last_became_active":"2024-09-17T03:36:44.254211+0000","last_became_peered":"2024-09-17T03:36:44.254211+0000","last_unstale":"2024-09-17T03:36:45.265908+0000","last_undegraded":"2024-09-17T03:36:45.265908+0000","last_fullsized":"2024-09-17T03:36:45.265908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:25.422746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256342+0000","last_change":"2024-09-17T03:36:43.247619+0000","last_active":"2024-09-17T03:36:45.256342+0000","last_peered":"2024-09-17T03:36:45.256342+0000","last_clean":"2024-09-17T03:36:45.256342+0000","last_became_active":"2024-09-17T03:36:43.247248+0000","last_became_peered":"2024-09-17T03:36:43.247248+0000","last_unstale":"2024-09-17T03:36:45.256342+0000","last_undegraded":"2024-09-17T03:36:45.256342+0000","last_fullsized":"2024-09-17T03:36:45.256342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:39.124865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258159+0000","last_change":"2024-09-17T03:36:44.250558+0000","last_active":"2024-09-17T03:36:45.258159+0000","last_peered":"2024-09-17T03:36:45.258159+0000","last_clean":"2024-09-17T03:36:45.258159+0000","last_became_active":"2024-09-17T03:36:44.250256+0000","last_became_peered":"2024-09-17T03:36:44.250256+0000","last_unstale":"2024-09-17T03:36:45.258159+0000","last_undegraded":"2024-09-17T03:36:45.258159+0000","last_fullsized":"2024-09-17T03:36:45.258159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:16.391925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265969+0000","last_change":"2024-09-17T03:36:43.250824+0000","last_active":"2024-09-17T03:36:45.265969+0000","last_peered":"2024-09-17T03:36:45.265969+0000","last_clean":"2024-09-17T03:36:45.265969+0000","last_became_active":"2024-09-17T03:36:43.250296+0000","last_became_peered":"2024-09-17T03:36:43.250296+0000","last_unstale":"2024-09-17T03:36:45.265969+0000","last_undegraded":"2024-09-17T03:36:45.265969+0000","last_fullsized":"2024-09-17T03:36:45.265969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:34.505999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339553+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:36:45.339553+0000","last_peered":"2024-09-17T03:36:45.339553+0000","last_clean":"2024-09-17T03:36:45.339553+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:36:45.339553+0000","last_undegraded":"2024-09-17T03:36:45.339553+0000","last_fullsized":"2024-09-17T03:36:45.339553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":188124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":779040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":188180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":196976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":778480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":194874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":196518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:49.634 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:36:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.889+0000 7f1081000640 1 -- 172.21.15.121:0/1813130440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f107c15b9f0 msgr2=0x7f107c0cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.889+0000 7f1081000640 1 --2- 172.21.15.121:0/1813130440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f107c15b9f0 0x7f107c0cf930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f106c009830 tx=0x7f106c02a510 comp rx=0 tx=0).stop 2024-09-17T03:36:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.889+0000 7f1081000640 1 -- 172.21.15.121:0/1813130440 shutdown_connections 2024-09-17T03:36:49.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.889+0000 7f1081000640 1 --2- 172.21.15.121:0/1813130440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f107c15f5a0 0x7f107c15f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.889+0000 7f1081000640 1 --2- 172.21.15.121:0/1813130440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f107c15b9f0 0x7f107c0cf930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.889+0000 7f1081000640 1 -- 172.21.15.121:0/1813130440 >> 172.21.15.121:0/1813130440 conn(0x7f107c0cca40 msgr2=0x7f107c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:49.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.889+0000 7f1081000640 1 -- 172.21.15.121:0/1813130440 shutdown_connections 2024-09-17T03:36:49.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.889+0000 7f1081000640 1 -- 172.21.15.121:0/1813130440 wait complete. 2024-09-17T03:36:49.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.891+0000 7f1081000640 1 Processor -- start 2024-09-17T03:36:49.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.891+0000 7f1081000640 1 -- start start 2024-09-17T03:36:49.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f1081000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f107c0cefa0 0x7f107c09fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f1081000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f107c15b9f0 0x7f107c1e9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f1081000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f107c15f5a0 0x7f107c1e9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f1081000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f107c06df70 con 0x7f107c15b9f0 2024-09-17T03:36:49.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f1081000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f107c06ddf0 con 0x7f107c0cefa0 2024-09-17T03:36:49.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f1081000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f107c06e0f0 con 0x7f107c15f5a0 2024-09-17T03:36:49.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f1079400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f107c15b9f0 0x7f107c1e9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f1079400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f107c15b9f0 0x7f107c1e9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46204/0 (socket says 172.21.15.121:46204) 2024-09-17T03:36:49.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f1079400640 1 -- 172.21.15.121:0/2117770673 learned_addr learned my addr 172.21.15.121:0/2117770673 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:49.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f107a800640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f107c15f5a0 0x7f107c1e9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.893+0000 7f1079e00640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f107c0cefa0 0x7f107c09fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1079400640 1 -- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f107c15f5a0 msgr2=0x7f107c1e9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1079400640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f107c15f5a0 0x7f107c1e9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1079400640 1 -- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f107c0cefa0 msgr2=0x7f107c09fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1079400640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f107c0cefa0 0x7f107c09fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1079400640 1 -- 172.21.15.121:0/2117770673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c0b3ce0 con 0x7f107c15b9f0 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f107a800640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f107c15f5a0 0x7f107c1e9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1079400640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f107c15b9f0 0x7f107c1e9150 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f106800c3d0 tx=0x7f106800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1072000640 1 -- 172.21.15.121:0/2117770673 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068011790 con 0x7f107c15b9f0 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1072000640 1 -- 172.21.15.121:0/2117770673 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1068017070 con 0x7f107c15b9f0 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1081000640 1 -- 172.21.15.121:0/2117770673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c0b3fc0 con 0x7f107c15b9f0 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1072000640 1 -- 172.21.15.121:0/2117770673 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068011cc0 con 0x7f107c15b9f0 2024-09-17T03:36:49.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.894+0000 7f1081000640 1 -- 172.21.15.121:0/2117770673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c09e020 con 0x7f107c15b9f0 2024-09-17T03:36:49.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.895+0000 7f1081000640 1 -- 172.21.15.121:0/2117770673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107c0a0c20 con 0x7f107c15b9f0 2024-09-17T03:36:49.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.896+0000 7f1072000640 1 -- 172.21.15.121:0/2117770673 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f106801c460 con 0x7f107c15b9f0 2024-09-17T03:36:49.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.898+0000 7f1072000640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f105c078bc0 0x7f105c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.898+0000 7f1072000640 1 -- 172.21.15.121:0/2117770673 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f106809ac50 con 0x7f107c15b9f0 2024-09-17T03:36:49.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.898+0000 7f1079e00640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f105c078bc0 0x7f105c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.899+0000 7f1079e00640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f105c078bc0 0x7f105c07b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f106c034000 tx=0x7f106c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:49.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:49.902+0000 7f1072000640 1 -- 172.21.15.121:0/2117770673 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f10680a0020 con 0x7f107c15b9f0 2024-09-17T03:36:50.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.153+0000 7f1081000640 1 -- 172.21.15.121:0/2117770673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f107c0b4680 con 0x7f107c15b9f0 2024-09-17T03:36:50.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.154+0000 7f1072000640 1 -- 172.21.15.121:0/2117770673 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1376 (secure 0 0 0) 0x7f1068062f00 con 0x7f107c15b9f0 2024-09-17T03:36:50.153 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:50.154 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":106,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1726544120,"num_in_osds":8,"osd_in_since":1726544109,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":77},{"state_name":"unknown","count":13},{"state_name":"creating+peering","count":7}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":591132,"bytes_used":226242560,"bytes_avail":772867870720,"bytes_total":773094113280,"unknown_pgs_ratio":0.1340206116437912,"inactive_pgs_ratio":0.072164945304393768,"write_bytes_sec":806,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":18,"btime":"2024-09-17T03:36:47:258731+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5019}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-17T03:36:29.292718+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:36:50.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 -- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f105c078bc0 msgr2=0x7f105c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f105c078bc0 0x7f105c07b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f106c034000 tx=0x7f106c004730 comp rx=0 tx=0).stop 2024-09-17T03:36:50.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 -- 172.21.15.121:0/2117770673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f107c15b9f0 msgr2=0x7f107c1e9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f107c15b9f0 0x7f107c1e9150 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f106800c3d0 tx=0x7f106800c890 comp rx=0 tx=0).stop 2024-09-17T03:36:50.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 -- 172.21.15.121:0/2117770673 shutdown_connections 2024-09-17T03:36:50.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f107c15f5a0 0x7f107c1e9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f105c078bc0 0x7f105c07b0d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f107c15b9f0 0x7f107c1e9150 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 --2- 172.21.15.121:0/2117770673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f107c0cefa0 0x7f107c09fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 -- 172.21.15.121:0/2117770673 >> 172.21.15.121:0/2117770673 conn(0x7f107c0cca40 msgr2=0x7f107c0afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:50.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 -- 172.21.15.121:0/2117770673 shutdown_connections 2024-09-17T03:36:50.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.156+0000 7f1081000640 1 -- 172.21.15.121:0/2117770673 wait complete. 2024-09-17T03:36:50.178 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:36:50.178 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:50.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.401+0000 7fc09b000640 1 -- 172.21.15.121:0/971933100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07c004800 msgr2=0x7fc07c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.401+0000 7fc09b000640 1 --2- 172.21.15.121:0/971933100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07c004800 0x7fc07c004c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc080009b50 tx=0x7fc07c005830 comp rx=0 tx=0).stop 2024-09-17T03:36:50.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.401+0000 7fc09a600640 1 -- 172.21.15.121:0/971933100 reap_dead start 2024-09-17T03:36:50.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.402+0000 7fc09b000640 1 -- 172.21.15.121:0/971933100 shutdown_connections 2024-09-17T03:36:50.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.402+0000 7fc09b000640 1 -- 172.21.15.121:0/971933100 >> 172.21.15.121:0/971933100 conn(0x7fc09406f940 msgr2=0x7fc0940b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:50.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.402+0000 7fc09b000640 1 -- 172.21.15.121:0/971933100 shutdown_connections 2024-09-17T03:36:50.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.402+0000 7fc09b000640 1 -- 172.21.15.121:0/971933100 wait complete. 2024-09-17T03:36:50.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.404+0000 7fc09b000640 1 Processor -- start 2024-09-17T03:36:50.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.404+0000 7fc09b000640 1 -- start start 2024-09-17T03:36:50.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc09b000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07c004800 0x7fc0940aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc09b000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0941f2ed0 0x7fc09415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc09b000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc09415d730 0x7fc0940c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc09b000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc0940cf3a0 con 0x7fc07c004800 2024-09-17T03:36:50.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc09b000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0940cf220 con 0x7fc09415d730 2024-09-17T03:36:50.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc09b000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc0940cf520 con 0x7fc0941f2ed0 2024-09-17T03:36:50.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc099c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07c004800 0x7fc0940aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:50.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc099c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07c004800 0x7fc0940aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46230/0 (socket says 172.21.15.121:46230) 2024-09-17T03:36:50.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc099c00640 1 -- 172.21.15.121:0/3433918576 learned_addr learned my addr 172.21.15.121:0/3433918576 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:50.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc099c00640 1 -- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0941f2ed0 msgr2=0x7fc09415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc099c00640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0941f2ed0 0x7fc09415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc099c00640 1 -- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc09415d730 msgr2=0x7fc0940c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc099c00640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc09415d730 0x7fc0940c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc099c00640 1 -- 172.21.15.121:0/3433918576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0940ae480 con 0x7fc07c004800 2024-09-17T03:36:50.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.406+0000 7fc099c00640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07c004800 0x7fc0940aec90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc088004e00 tx=0x7fc088001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.407+0000 7fc091600640 1 -- 172.21.15.121:0/3433918576 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc088010890 con 0x7fc07c004800 2024-09-17T03:36:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.407+0000 7fc091600640 1 -- 172.21.15.121:0/3433918576 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc088016070 con 0x7fc07c004800 2024-09-17T03:36:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.407+0000 7fc091600640 1 -- 172.21.15.121:0/3433918576 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc088010dc0 con 0x7fc07c004800 2024-09-17T03:36:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.407+0000 7fc09b000640 1 -- 172.21.15.121:0/3433918576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0940ad900 con 0x7fc07c004800 2024-09-17T03:36:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.407+0000 7fc09b000640 1 -- 172.21.15.121:0/3433918576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0940adec0 con 0x7fc07c004800 2024-09-17T03:36:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.408+0000 7fc09b000640 1 -- 172.21.15.121:0/3433918576 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0940cfab0 con 0x7fc07c004800 2024-09-17T03:36:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.409+0000 7fc091600640 1 -- 172.21.15.121:0/3433918576 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc08801b460 con 0x7fc07c004800 2024-09-17T03:36:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.410+0000 7fc091600640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc074078b90 0x7fc07407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.410+0000 7fc091600640 1 -- 172.21.15.121:0/3433918576 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc08809b8c0 con 0x7fc07c004800 2024-09-17T03:36:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.411+0000 7fc099200640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc074078b90 0x7fc07407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:50.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.411+0000 7fc099200640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc074078b90 0x7fc07407b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc080035000 tx=0x7fc080004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:50.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.414+0000 7fc091600640 1 -- 172.21.15.121:0/3433918576 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0880635a0 con 0x7fc07c004800 2024-09-17T03:36:50.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.593+0000 7fc09b000640 1 -- 172.21.15.121:0/3433918576 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0940af1d0 con 0x7fc074078b90 2024-09-17T03:36:50.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.598+0000 7fc091600640 1 -- 172.21.15.121:0/3433918576 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7fc0940af1d0 con 0x7fc074078b90 2024-09-17T03:36:50.601 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:50.602 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:36:50.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.602+0000 7fc09b000640 1 -- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc074078b90 msgr2=0x7fc07407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.602+0000 7fc09b000640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc074078b90 0x7fc07407b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc080035000 tx=0x7fc080004730 comp rx=0 tx=0).stop 2024-09-17T03:36:50.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.602+0000 7fc09b000640 1 -- 172.21.15.121:0/3433918576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07c004800 msgr2=0x7fc0940aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.602+0000 7fc09b000640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07c004800 0x7fc0940aec90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc088004e00 tx=0x7fc088001800 comp rx=0 tx=0).stop 2024-09-17T03:36:50.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.602+0000 7fc09b000640 1 -- 172.21.15.121:0/3433918576 shutdown_connections 2024-09-17T03:36:50.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.602+0000 7fc09b000640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc09415d730 0x7fc0940c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.602+0000 7fc09b000640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0941f2ed0 0x7fc09415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.602+0000 7fc09b000640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc074078b90 0x7fc07407b0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.602+0000 7fc09b000640 1 --2- 172.21.15.121:0/3433918576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07c004800 0x7fc0940aec90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.602+0000 7fc09b000640 1 -- 172.21.15.121:0/3433918576 >> 172.21.15.121:0/3433918576 conn(0x7fc09406f940 msgr2=0x7fc09415bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:50.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.603+0000 7fc09b000640 1 -- 172.21.15.121:0/3433918576 shutdown_connections 2024-09-17T03:36:50.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:50.603+0000 7fc09b000640 1 -- 172.21.15.121:0/3433918576 wait complete. 2024-09-17T03:36:50.625 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-09-17T03:36:49.297941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220992,"kb_used_data":4728,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753728,"statfs":{"total":773094113280,"available":772867817472,"internally_reserved":0,"allocated":4841472,"data_stored":2717044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.077646"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257472+0000","last_change":"2024-09-17T03:36:44.253555+0000","last_active":"2024-09-17T03:36:45.257472+0000","last_peered":"2024-09-17T03:36:45.257472+0000","last_clean":"2024-09-17T03:36:45.257472+0000","last_became_active":"2024-09-17T03:36:44.253229+0000","last_became_peered":"2024-09-17T03:36:44.253229+0000","last_unstale":"2024-09-17T03:36:45.257472+0000","last_undegraded":"2024-09-17T03:36:45.257472+0000","last_fullsized":"2024-09-17T03:36:45.257472+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:06.783442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257666+0000","last_change":"2024-09-17T03:36:44.254536+0000","last_active":"2024-09-17T03:36:45.257666+0000","last_peered":"2024-09-17T03:36:45.257666+0000","last_clean":"2024-09-17T03:36:45.257666+0000","last_became_active":"2024-09-17T03:36:44.253988+0000","last_became_peered":"2024-09-17T03:36:44.253988+0000","last_unstale":"2024-09-17T03:36:45.257666+0000","last_undegraded":"2024-09-17T03:36:45.257666+0000","last_fullsized":"2024-09-17T03:36:45.257666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:13.241349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257410+0000","last_change":"2024-09-17T03:36:44.269911+0000","last_active":"2024-09-17T03:36:45.257410+0000","last_peered":"2024-09-17T03:36:45.257410+0000","last_clean":"2024-09-17T03:36:45.257410+0000","last_became_active":"2024-09-17T03:36:44.268580+0000","last_became_peered":"2024-09-17T03:36:44.268580+0000","last_unstale":"2024-09-17T03:36:45.257410+0000","last_undegraded":"2024-09-17T03:36:45.257410+0000","last_fullsized":"2024-09-17T03:36:45.257410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.450766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257448+0000","last_change":"2024-09-17T03:36:44.265556+0000","last_active":"2024-09-17T03:36:45.257448+0000","last_peered":"2024-09-17T03:36:45.257448+0000","last_clean":"2024-09-17T03:36:45.257448+0000","last_became_active":"2024-09-17T03:36:44.263396+0000","last_became_peered":"2024-09-17T03:36:44.263396+0000","last_unstale":"2024-09-17T03:36:45.257448+0000","last_undegraded":"2024-09-17T03:36:45.257448+0000","last_fullsized":"2024-09-17T03:36:45.257448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:52.560792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262421+0000","last_change":"2024-09-17T03:36:44.270961+0000","last_active":"2024-09-17T03:36:45.262421+0000","last_peered":"2024-09-17T03:36:45.262421+0000","last_clean":"2024-09-17T03:36:45.262421+0000","last_became_active":"2024-09-17T03:36:44.270715+0000","last_became_peered":"2024-09-17T03:36:44.270715+0000","last_unstale":"2024-09-17T03:36:45.262421+0000","last_undegraded":"2024-09-17T03:36:45.262421+0000","last_fullsized":"2024-09-17T03:36:45.262421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:28.602443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256080+0000","last_change":"2024-09-17T03:36:44.252818+0000","last_active":"2024-09-17T03:36:45.256080+0000","last_peered":"2024-09-17T03:36:45.256080+0000","last_clean":"2024-09-17T03:36:45.256080+0000","last_became_active":"2024-09-17T03:36:44.252517+0000","last_became_peered":"2024-09-17T03:36:44.252517+0000","last_unstale":"2024-09-17T03:36:45.256080+0000","last_undegraded":"2024-09-17T03:36:45.256080+0000","last_fullsized":"2024-09-17T03:36:45.256080+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:52.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339570+0000","last_change":"2024-09-17T03:36:44.258990+0000","last_active":"2024-09-17T03:36:45.339570+0000","last_peered":"2024-09-17T03:36:45.339570+0000","last_clean":"2024-09-17T03:36:45.339570+0000","last_became_active":"2024-09-17T03:36:44.257521+0000","last_became_peered":"2024-09-17T03:36:44.257521+0000","last_unstale":"2024-09-17T03:36:45.339570+0000","last_undegraded":"2024-09-17T03:36:45.339570+0000","last_fullsized":"2024-09-17T03:36:45.339570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:15.883165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255683+0000","last_change":"2024-09-17T03:36:44.261118+0000","last_active":"2024-09-17T03:36:45.255683+0000","last_peered":"2024-09-17T03:36:45.255683+0000","last_clean":"2024-09-17T03:36:45.255683+0000","last_became_active":"2024-09-17T03:36:44.260797+0000","last_became_peered":"2024-09-17T03:36:44.260797+0000","last_unstale":"2024-09-17T03:36:45.255683+0000","last_undegraded":"2024-09-17T03:36:45.255683+0000","last_fullsized":"2024-09-17T03:36:45.255683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:02.600076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262780+0000","last_change":"2024-09-17T03:36:44.262837+0000","last_active":"2024-09-17T03:36:45.262780+0000","last_peered":"2024-09-17T03:36:45.262780+0000","last_clean":"2024-09-17T03:36:45.262780+0000","last_became_active":"2024-09-17T03:36:44.262509+0000","last_became_peered":"2024-09-17T03:36:44.262509+0000","last_unstale":"2024-09-17T03:36:45.262780+0000","last_undegraded":"2024-09-17T03:36:45.262780+0000","last_fullsized":"2024-09-17T03:36:45.262780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:10.421129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340043+0000","last_change":"2024-09-17T03:36:44.265401+0000","last_active":"2024-09-17T03:36:45.340043+0000","last_peered":"2024-09-17T03:36:45.340043+0000","last_clean":"2024-09-17T03:36:45.340043+0000","last_became_active":"2024-09-17T03:36:44.264977+0000","last_became_peered":"2024-09-17T03:36:44.264977+0000","last_unstale":"2024-09-17T03:36:45.340043+0000","last_undegraded":"2024-09-17T03:36:45.340043+0000","last_fullsized":"2024-09-17T03:36:45.340043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:12.406230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266229+0000","last_change":"2024-09-17T03:36:44.263719+0000","last_active":"2024-09-17T03:36:45.266229+0000","last_peered":"2024-09-17T03:36:45.266229+0000","last_clean":"2024-09-17T03:36:45.266229+0000","last_became_active":"2024-09-17T03:36:44.263036+0000","last_became_peered":"2024-09-17T03:36:44.263036+0000","last_unstale":"2024-09-17T03:36:45.266229+0000","last_undegraded":"2024-09-17T03:36:45.266229+0000","last_fullsized":"2024-09-17T03:36:45.266229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:17.529967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262471+0000","last_change":"2024-09-17T03:36:44.256960+0000","last_active":"2024-09-17T03:36:45.262471+0000","last_peered":"2024-09-17T03:36:45.262471+0000","last_clean":"2024-09-17T03:36:45.262471+0000","last_became_active":"2024-09-17T03:36:44.256672+0000","last_became_peered":"2024-09-17T03:36:44.256672+0000","last_unstale":"2024-09-17T03:36:45.262471+0000","last_undegraded":"2024-09-17T03:36:45.262471+0000","last_fullsized":"2024-09-17T03:36:45.262471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:04.996521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339625+0000","last_change":"2024-09-17T03:36:44.256119+0000","last_active":"2024-09-17T03:36:45.339625+0000","last_peered":"2024-09-17T03:36:45.339625+0000","last_clean":"2024-09-17T03:36:45.339625+0000","last_became_active":"2024-09-17T03:36:44.255740+0000","last_became_peered":"2024-09-17T03:36:44.255740+0000","last_unstale":"2024-09-17T03:36:45.339625+0000","last_undegraded":"2024-09-17T03:36:45.339625+0000","last_fullsized":"2024-09-17T03:36:45.339625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:53.649917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339888+0000","last_change":"2024-09-17T03:36:44.257717+0000","last_active":"2024-09-17T03:36:45.339888+0000","last_peered":"2024-09-17T03:36:45.339888+0000","last_clean":"2024-09-17T03:36:45.339888+0000","last_became_active":"2024-09-17T03:36:44.257422+0000","last_became_peered":"2024-09-17T03:36:44.257422+0000","last_unstale":"2024-09-17T03:36:45.339888+0000","last_undegraded":"2024-09-17T03:36:45.339888+0000","last_fullsized":"2024-09-17T03:36:45.339888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:47.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257792+0000","last_change":"2024-09-17T03:36:44.244112+0000","last_active":"2024-09-17T03:36:45.257792+0000","last_peered":"2024-09-17T03:36:45.257792+0000","last_clean":"2024-09-17T03:36:45.257792+0000","last_became_active":"2024-09-17T03:36:44.243734+0000","last_became_peered":"2024-09-17T03:36:44.243734+0000","last_unstale":"2024-09-17T03:36:45.257792+0000","last_undegraded":"2024-09-17T03:36:45.257792+0000","last_fullsized":"2024-09-17T03:36:45.257792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:10.602532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339489+0000","last_change":"2024-09-17T03:36:44.254142+0000","last_active":"2024-09-17T03:36:45.339489+0000","last_peered":"2024-09-17T03:36:45.339489+0000","last_clean":"2024-09-17T03:36:45.339489+0000","last_became_active":"2024-09-17T03:36:44.253871+0000","last_became_peered":"2024-09-17T03:36:44.253871+0000","last_unstale":"2024-09-17T03:36:45.339489+0000","last_undegraded":"2024-09-17T03:36:45.339489+0000","last_fullsized":"2024-09-17T03:36:45.339489+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:27.123960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258233+0000","last_change":"2024-09-17T03:36:44.267635+0000","last_active":"2024-09-17T03:36:45.258233+0000","last_peered":"2024-09-17T03:36:45.258233+0000","last_clean":"2024-09-17T03:36:45.258233+0000","last_became_active":"2024-09-17T03:36:44.267199+0000","last_became_peered":"2024-09-17T03:36:44.267199+0000","last_unstale":"2024-09-17T03:36:45.258233+0000","last_undegraded":"2024-09-17T03:36:45.258233+0000","last_fullsized":"2024-09-17T03:36:45.258233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:44.085686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258400+0000","last_change":"2024-09-17T03:36:44.249470+0000","last_active":"2024-09-17T03:36:45.258400+0000","last_peered":"2024-09-17T03:36:45.258400+0000","last_clean":"2024-09-17T03:36:45.258400+0000","last_became_active":"2024-09-17T03:36:44.248597+0000","last_became_peered":"2024-09-17T03:36:44.248597+0000","last_unstale":"2024-09-17T03:36:45.258400+0000","last_undegraded":"2024-09-17T03:36:45.258400+0000","last_fullsized":"2024-09-17T03:36:45.258400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:54.287309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340772+0000","last_change":"2024-09-17T03:36:44.262318+0000","last_active":"2024-09-17T03:36:45.340772+0000","last_peered":"2024-09-17T03:36:45.340772+0000","last_clean":"2024-09-17T03:36:45.340772+0000","last_became_active":"2024-09-17T03:36:44.261979+0000","last_became_peered":"2024-09-17T03:36:44.261979+0000","last_unstale":"2024-09-17T03:36:45.340772+0000","last_undegraded":"2024-09-17T03:36:45.340772+0000","last_fullsized":"2024-09-17T03:36:45.340772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:52.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265813+0000","last_change":"2024-09-17T03:36:44.264562+0000","last_active":"2024-09-17T03:36:45.265813+0000","last_peered":"2024-09-17T03:36:45.265813+0000","last_clean":"2024-09-17T03:36:45.265813+0000","last_became_active":"2024-09-17T03:36:44.264273+0000","last_became_peered":"2024-09-17T03:36:44.264273+0000","last_unstale":"2024-09-17T03:36:45.265813+0000","last_undegraded":"2024-09-17T03:36:45.265813+0000","last_fullsized":"2024-09-17T03:36:45.265813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:44.688328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265788+0000","last_change":"2024-09-17T03:36:44.255197+0000","last_active":"2024-09-17T03:36:45.265788+0000","last_peered":"2024-09-17T03:36:45.265788+0000","last_clean":"2024-09-17T03:36:45.265788+0000","last_became_active":"2024-09-17T03:36:44.254536+0000","last_became_peered":"2024-09-17T03:36:44.254536+0000","last_unstale":"2024-09-17T03:36:45.265788+0000","last_undegraded":"2024-09-17T03:36:45.265788+0000","last_fullsized":"2024-09-17T03:36:45.265788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.442706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265693+0000","last_change":"2024-09-17T03:36:44.264660+0000","last_active":"2024-09-17T03:36:45.265693+0000","last_peered":"2024-09-17T03:36:45.265693+0000","last_clean":"2024-09-17T03:36:45.265693+0000","last_became_active":"2024-09-17T03:36:44.257929+0000","last_became_peered":"2024-09-17T03:36:44.257929+0000","last_unstale":"2024-09-17T03:36:45.265693+0000","last_undegraded":"2024-09-17T03:36:45.265693+0000","last_fullsized":"2024-09-17T03:36:45.265693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:34.451288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257806+0000","last_change":"2024-09-17T03:36:44.263605+0000","last_active":"2024-09-17T03:36:45.257806+0000","last_peered":"2024-09-17T03:36:45.257806+0000","last_clean":"2024-09-17T03:36:45.257806+0000","last_became_active":"2024-09-17T03:36:44.255877+0000","last_became_peered":"2024-09-17T03:36:44.255877+0000","last_unstale":"2024-09-17T03:36:45.257806+0000","last_undegraded":"2024-09-17T03:36:45.257806+0000","last_fullsized":"2024-09-17T03:36:45.257806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:03.771519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255975+0000","last_change":"2024-09-17T03:36:44.260449+0000","last_active":"2024-09-17T03:36:45.255975+0000","last_peered":"2024-09-17T03:36:45.255975+0000","last_clean":"2024-09-17T03:36:45.255975+0000","last_became_active":"2024-09-17T03:36:44.258669+0000","last_became_peered":"2024-09-17T03:36:44.258669+0000","last_unstale":"2024-09-17T03:36:45.255975+0000","last_undegraded":"2024-09-17T03:36:45.255975+0000","last_fullsized":"2024-09-17T03:36:45.255975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:37.603760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340781+0000","last_change":"2024-09-17T03:36:44.253003+0000","last_active":"2024-09-17T03:36:45.340781+0000","last_peered":"2024-09-17T03:36:45.340781+0000","last_clean":"2024-09-17T03:36:45.340781+0000","last_became_active":"2024-09-17T03:36:44.252680+0000","last_became_peered":"2024-09-17T03:36:44.252680+0000","last_unstale":"2024-09-17T03:36:45.340781+0000","last_undegraded":"2024-09-17T03:36:45.340781+0000","last_fullsized":"2024-09-17T03:36:45.340781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:43.947306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257791+0000","last_change":"2024-09-17T03:36:44.258976+0000","last_active":"2024-09-17T03:36:45.257791+0000","last_peered":"2024-09-17T03:36:45.257791+0000","last_clean":"2024-09-17T03:36:45.257791+0000","last_became_active":"2024-09-17T03:36:44.258614+0000","last_became_peered":"2024-09-17T03:36:44.258614+0000","last_unstale":"2024-09-17T03:36:45.257791+0000","last_undegraded":"2024-09-17T03:36:45.257791+0000","last_fullsized":"2024-09-17T03:36:45.257791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:47.717532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266123+0000","last_change":"2024-09-17T03:36:44.270263+0000","last_active":"2024-09-17T03:36:45.266123+0000","last_peered":"2024-09-17T03:36:45.266123+0000","last_clean":"2024-09-17T03:36:45.266123+0000","last_became_active":"2024-09-17T03:36:44.269849+0000","last_became_peered":"2024-09-17T03:36:44.269849+0000","last_unstale":"2024-09-17T03:36:45.266123+0000","last_undegraded":"2024-09-17T03:36:45.266123+0000","last_fullsized":"2024-09-17T03:36:45.266123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:34.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340142+0000","last_change":"2024-09-17T03:36:44.257142+0000","last_active":"2024-09-17T03:36:45.340142+0000","last_peered":"2024-09-17T03:36:45.340142+0000","last_clean":"2024-09-17T03:36:45.340142+0000","last_became_active":"2024-09-17T03:36:44.256859+0000","last_became_peered":"2024-09-17T03:36:44.256859+0000","last_unstale":"2024-09-17T03:36:45.340142+0000","last_undegraded":"2024-09-17T03:36:45.340142+0000","last_fullsized":"2024-09-17T03:36:45.340142+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:10.452184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257870+0000","last_change":"2024-09-17T03:36:44.250935+0000","last_active":"2024-09-17T03:36:45.257870+0000","last_peered":"2024-09-17T03:36:45.257870+0000","last_clean":"2024-09-17T03:36:45.257870+0000","last_became_active":"2024-09-17T03:36:44.250594+0000","last_became_peered":"2024-09-17T03:36:44.250594+0000","last_unstale":"2024-09-17T03:36:45.257870+0000","last_undegraded":"2024-09-17T03:36:45.257870+0000","last_fullsized":"2024-09-17T03:36:45.257870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:46.657454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258428+0000","last_change":"2024-09-17T03:36:44.253829+0000","last_active":"2024-09-17T03:36:45.258428+0000","last_peered":"2024-09-17T03:36:45.258428+0000","last_clean":"2024-09-17T03:36:45.258428+0000","last_became_active":"2024-09-17T03:36:44.253489+0000","last_became_peered":"2024-09-17T03:36:44.253489+0000","last_unstale":"2024-09-17T03:36:45.258428+0000","last_undegraded":"2024-09-17T03:36:45.258428+0000","last_fullsized":"2024-09-17T03:36:45.258428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:18.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339864+0000","last_change":"2024-09-17T03:36:44.257862+0000","last_active":"2024-09-17T03:36:45.339864+0000","last_peered":"2024-09-17T03:36:45.339864+0000","last_clean":"2024-09-17T03:36:45.339864+0000","last_became_active":"2024-09-17T03:36:44.256454+0000","last_became_peered":"2024-09-17T03:36:44.256454+0000","last_unstale":"2024-09-17T03:36:45.339864+0000","last_undegraded":"2024-09-17T03:36:45.339864+0000","last_fullsized":"2024-09-17T03:36:45.339864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:31.416993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256092+0000","last_change":"2024-09-17T03:36:44.261133+0000","last_active":"2024-09-17T03:36:45.256092+0000","last_peered":"2024-09-17T03:36:45.256092+0000","last_clean":"2024-09-17T03:36:45.256092+0000","last_became_active":"2024-09-17T03:36:44.260820+0000","last_became_peered":"2024-09-17T03:36:44.260820+0000","last_unstale":"2024-09-17T03:36:45.256092+0000","last_undegraded":"2024-09-17T03:36:45.256092+0000","last_fullsized":"2024-09-17T03:36:45.256092+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:35.003652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258326+0000","last_change":"2024-09-17T03:36:44.245754+0000","last_active":"2024-09-17T03:36:45.258326+0000","last_peered":"2024-09-17T03:36:45.258326+0000","last_clean":"2024-09-17T03:36:45.258326+0000","last_became_active":"2024-09-17T03:36:44.245408+0000","last_became_peered":"2024-09-17T03:36:44.245408+0000","last_unstale":"2024-09-17T03:36:45.258326+0000","last_undegraded":"2024-09-17T03:36:45.258326+0000","last_fullsized":"2024-09-17T03:36:45.258326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:44.165481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340900+0000","last_change":"2024-09-17T03:36:43.245126+0000","last_active":"2024-09-17T03:36:45.340900+0000","last_peered":"2024-09-17T03:36:45.340900+0000","last_clean":"2024-09-17T03:36:45.340900+0000","last_became_active":"2024-09-17T03:36:43.244672+0000","last_became_peered":"2024-09-17T03:36:43.244672+0000","last_unstale":"2024-09-17T03:36:45.340900+0000","last_undegraded":"2024-09-17T03:36:45.340900+0000","last_fullsized":"2024-09-17T03:36:45.340900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257397+0000","last_change":"2024-09-17T03:36:44.268310+0000","last_active":"2024-09-17T03:36:45.257397+0000","last_peered":"2024-09-17T03:36:45.257397+0000","last_clean":"2024-09-17T03:36:45.257397+0000","last_became_active":"2024-09-17T03:36:44.265610+0000","last_became_peered":"2024-09-17T03:36:44.265610+0000","last_unstale":"2024-09-17T03:36:45.257397+0000","last_undegraded":"2024-09-17T03:36:45.257397+0000","last_fullsized":"2024-09-17T03:36:45.257397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:24.017008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257820+0000","last_change":"2024-09-17T03:36:43.244589+0000","last_active":"2024-09-17T03:36:45.257820+0000","last_peered":"2024-09-17T03:36:45.257820+0000","last_clean":"2024-09-17T03:36:45.257820+0000","last_became_active":"2024-09-17T03:36:43.244277+0000","last_became_peered":"2024-09-17T03:36:43.244277+0000","last_unstale":"2024-09-17T03:36:45.257820+0000","last_undegraded":"2024-09-17T03:36:45.257820+0000","last_fullsized":"2024-09-17T03:36:45.257820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258699+0000","last_change":"2024-09-17T03:36:44.259012+0000","last_active":"2024-09-17T03:36:45.258699+0000","last_peered":"2024-09-17T03:36:45.258699+0000","last_clean":"2024-09-17T03:36:45.258699+0000","last_became_active":"2024-09-17T03:36:44.258013+0000","last_became_peered":"2024-09-17T03:36:44.258013+0000","last_unstale":"2024-09-17T03:36:45.258699+0000","last_undegraded":"2024-09-17T03:36:45.258699+0000","last_fullsized":"2024-09-17T03:36:45.258699+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:37.644719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257542+0000","last_change":"2024-09-17T03:36:43.238389+0000","last_active":"2024-09-17T03:36:45.257542+0000","last_peered":"2024-09-17T03:36:45.257542+0000","last_clean":"2024-09-17T03:36:45.257542+0000","last_became_active":"2024-09-17T03:36:43.236175+0000","last_became_peered":"2024-09-17T03:36:43.236175+0000","last_unstale":"2024-09-17T03:36:45.257542+0000","last_undegraded":"2024-09-17T03:36:45.257542+0000","last_fullsized":"2024-09-17T03:36:45.257542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:03.593859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258015+0000","last_change":"2024-09-17T03:36:44.265627+0000","last_active":"2024-09-17T03:36:45.258015+0000","last_peered":"2024-09-17T03:36:45.258015+0000","last_clean":"2024-09-17T03:36:45.258015+0000","last_became_active":"2024-09-17T03:36:44.265268+0000","last_became_peered":"2024-09-17T03:36:44.265268+0000","last_unstale":"2024-09-17T03:36:45.258015+0000","last_undegraded":"2024-09-17T03:36:45.258015+0000","last_fullsized":"2024-09-17T03:36:45.258015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:56.232153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340576+0000","last_change":"2024-09-17T03:36:43.243254+0000","last_active":"2024-09-17T03:36:45.340576+0000","last_peered":"2024-09-17T03:36:45.340576+0000","last_clean":"2024-09-17T03:36:45.340576+0000","last_became_active":"2024-09-17T03:36:43.242906+0000","last_became_peered":"2024-09-17T03:36:43.242906+0000","last_unstale":"2024-09-17T03:36:45.340576+0000","last_undegraded":"2024-09-17T03:36:45.340576+0000","last_fullsized":"2024-09-17T03:36:45.340576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256261+0000","last_change":"2024-09-17T03:36:44.250908+0000","last_active":"2024-09-17T03:36:45.256261+0000","last_peered":"2024-09-17T03:36:45.256261+0000","last_clean":"2024-09-17T03:36:45.256261+0000","last_became_active":"2024-09-17T03:36:44.250597+0000","last_became_peered":"2024-09-17T03:36:44.250597+0000","last_unstale":"2024-09-17T03:36:45.256261+0000","last_undegraded":"2024-09-17T03:36:45.256261+0000","last_fullsized":"2024-09-17T03:36:45.256261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:34.203214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340298+0000","last_change":"2024-09-17T03:36:43.239775+0000","last_active":"2024-09-17T03:36:45.340298+0000","last_peered":"2024-09-17T03:36:45.340298+0000","last_clean":"2024-09-17T03:36:45.340298+0000","last_became_active":"2024-09-17T03:36:43.239466+0000","last_became_peered":"2024-09-17T03:36:43.239466+0000","last_unstale":"2024-09-17T03:36:45.340298+0000","last_undegraded":"2024-09-17T03:36:45.340298+0000","last_fullsized":"2024-09-17T03:36:45.340298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:14.876381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265496+0000","last_change":"2024-09-17T03:36:44.257169+0000","last_active":"2024-09-17T03:36:45.265496+0000","last_peered":"2024-09-17T03:36:45.265496+0000","last_clean":"2024-09-17T03:36:45.265496+0000","last_became_active":"2024-09-17T03:36:44.256569+0000","last_became_peered":"2024-09-17T03:36:44.256569+0000","last_unstale":"2024-09-17T03:36:45.265496+0000","last_undegraded":"2024-09-17T03:36:45.265496+0000","last_fullsized":"2024-09-17T03:36:45.265496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:36.847491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339665+0000","last_change":"2024-09-17T03:36:43.238069+0000","last_active":"2024-09-17T03:36:45.339665+0000","last_peered":"2024-09-17T03:36:45.339665+0000","last_clean":"2024-09-17T03:36:45.339665+0000","last_became_active":"2024-09-17T03:36:43.237720+0000","last_became_peered":"2024-09-17T03:36:43.237720+0000","last_unstale":"2024-09-17T03:36:45.339665+0000","last_undegraded":"2024-09-17T03:36:45.339665+0000","last_fullsized":"2024-09-17T03:36:45.339665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:46.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257884+0000","last_change":"2024-09-17T03:36:44.265836+0000","last_active":"2024-09-17T03:36:45.257884+0000","last_peered":"2024-09-17T03:36:45.257884+0000","last_clean":"2024-09-17T03:36:45.257884+0000","last_became_active":"2024-09-17T03:36:44.265525+0000","last_became_peered":"2024-09-17T03:36:44.265525+0000","last_unstale":"2024-09-17T03:36:45.257884+0000","last_undegraded":"2024-09-17T03:36:45.257884+0000","last_fullsized":"2024-09-17T03:36:45.257884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:08.571368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256577+0000","last_change":"2024-09-17T03:36:43.247308+0000","last_active":"2024-09-17T03:36:45.256577+0000","last_peered":"2024-09-17T03:36:45.256577+0000","last_clean":"2024-09-17T03:36:45.256577+0000","last_became_active":"2024-09-17T03:36:43.246995+0000","last_became_peered":"2024-09-17T03:36:43.246995+0000","last_unstale":"2024-09-17T03:36:45.256577+0000","last_undegraded":"2024-09-17T03:36:45.256577+0000","last_fullsized":"2024-09-17T03:36:45.256577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:25.438322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258114+0000","last_change":"2024-09-17T03:36:44.258467+0000","last_active":"2024-09-17T03:36:45.258114+0000","last_peered":"2024-09-17T03:36:45.258114+0000","last_clean":"2024-09-17T03:36:45.258114+0000","last_became_active":"2024-09-17T03:36:44.258054+0000","last_became_peered":"2024-09-17T03:36:44.258054+0000","last_unstale":"2024-09-17T03:36:45.258114+0000","last_undegraded":"2024-09-17T03:36:45.258114+0000","last_fullsized":"2024-09-17T03:36:45.258114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:53.739833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339566+0000","last_change":"2024-09-17T03:36:43.242724+0000","last_active":"2024-09-17T03:36:45.339566+0000","last_peered":"2024-09-17T03:36:45.339566+0000","last_clean":"2024-09-17T03:36:45.339566+0000","last_became_active":"2024-09-17T03:36:43.242438+0000","last_became_peered":"2024-09-17T03:36:43.242438+0000","last_unstale":"2024-09-17T03:36:45.339566+0000","last_undegraded":"2024-09-17T03:36:45.339566+0000","last_fullsized":"2024-09-17T03:36:45.339566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:51.471274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257742+0000","last_change":"2024-09-17T03:36:44.263729+0000","last_active":"2024-09-17T03:36:45.257742+0000","last_peered":"2024-09-17T03:36:45.257742+0000","last_clean":"2024-09-17T03:36:45.257742+0000","last_became_active":"2024-09-17T03:36:44.263448+0000","last_became_peered":"2024-09-17T03:36:44.263448+0000","last_unstale":"2024-09-17T03:36:45.257742+0000","last_undegraded":"2024-09-17T03:36:45.257742+0000","last_fullsized":"2024-09-17T03:36:45.257742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:37.282878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257555+0000","last_change":"2024-09-17T03:36:43.246866+0000","last_active":"2024-09-17T03:36:45.257555+0000","last_peered":"2024-09-17T03:36:45.257555+0000","last_clean":"2024-09-17T03:36:45.257555+0000","last_became_active":"2024-09-17T03:36:43.246475+0000","last_became_peered":"2024-09-17T03:36:43.246475+0000","last_unstale":"2024-09-17T03:36:45.257555+0000","last_undegraded":"2024-09-17T03:36:45.257555+0000","last_fullsized":"2024-09-17T03:36:45.257555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:48.456727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340631+0000","last_change":"2024-09-17T03:36:44.266455+0000","last_active":"2024-09-17T03:36:45.340631+0000","last_peered":"2024-09-17T03:36:45.340631+0000","last_clean":"2024-09-17T03:36:45.340631+0000","last_became_active":"2024-09-17T03:36:44.266153+0000","last_became_peered":"2024-09-17T03:36:44.266153+0000","last_unstale":"2024-09-17T03:36:45.340631+0000","last_undegraded":"2024-09-17T03:36:45.340631+0000","last_fullsized":"2024-09-17T03:36:45.340631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:01.286771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258504+0000","last_change":"2024-09-17T03:36:43.251663+0000","last_active":"2024-09-17T03:36:45.258504+0000","last_peered":"2024-09-17T03:36:45.258504+0000","last_clean":"2024-09-17T03:36:45.258504+0000","last_became_active":"2024-09-17T03:36:43.249590+0000","last_became_peered":"2024-09-17T03:36:43.249590+0000","last_unstale":"2024-09-17T03:36:45.258504+0000","last_undegraded":"2024-09-17T03:36:45.258504+0000","last_fullsized":"2024-09-17T03:36:45.258504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:28.331414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257802+0000","last_change":"2024-09-17T03:36:44.259992+0000","last_active":"2024-09-17T03:36:45.257802+0000","last_peered":"2024-09-17T03:36:45.257802+0000","last_clean":"2024-09-17T03:36:45.257802+0000","last_became_active":"2024-09-17T03:36:44.259512+0000","last_became_peered":"2024-09-17T03:36:44.259512+0000","last_unstale":"2024-09-17T03:36:45.257802+0000","last_undegraded":"2024-09-17T03:36:45.257802+0000","last_fullsized":"2024-09-17T03:36:45.257802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:57.312821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257931+0000","last_change":"2024-09-17T03:36:43.250402+0000","last_active":"2024-09-17T03:36:45.257931+0000","last_peered":"2024-09-17T03:36:45.257931+0000","last_clean":"2024-09-17T03:36:45.257931+0000","last_became_active":"2024-09-17T03:36:43.250094+0000","last_became_peered":"2024-09-17T03:36:43.250094+0000","last_unstale":"2024-09-17T03:36:45.257931+0000","last_undegraded":"2024-09-17T03:36:45.257931+0000","last_fullsized":"2024-09-17T03:36:45.257931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:04.120350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340018+0000","last_change":"2024-09-17T03:36:44.256373+0000","last_active":"2024-09-17T03:36:45.340018+0000","last_peered":"2024-09-17T03:36:45.340018+0000","last_clean":"2024-09-17T03:36:45.340018+0000","last_became_active":"2024-09-17T03:36:44.256013+0000","last_became_peered":"2024-09-17T03:36:44.256013+0000","last_unstale":"2024-09-17T03:36:45.340018+0000","last_undegraded":"2024-09-17T03:36:45.340018+0000","last_fullsized":"2024-09-17T03:36:45.340018+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:05.669667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257531+0000","last_change":"2024-09-17T03:36:43.238750+0000","last_active":"2024-09-17T03:36:45.257531+0000","last_peered":"2024-09-17T03:36:45.257531+0000","last_clean":"2024-09-17T03:36:45.257531+0000","last_became_active":"2024-09-17T03:36:43.237712+0000","last_became_peered":"2024-09-17T03:36:43.237712+0000","last_unstale":"2024-09-17T03:36:45.257531+0000","last_undegraded":"2024-09-17T03:36:45.257531+0000","last_fullsized":"2024-09-17T03:36:45.257531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:31.004371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256461+0000","last_change":"2024-09-17T03:36:44.257208+0000","last_active":"2024-09-17T03:36:45.256461+0000","last_peered":"2024-09-17T03:36:45.256461+0000","last_clean":"2024-09-17T03:36:45.256461+0000","last_became_active":"2024-09-17T03:36:44.256776+0000","last_became_peered":"2024-09-17T03:36:44.256776+0000","last_unstale":"2024-09-17T03:36:45.256461+0000","last_undegraded":"2024-09-17T03:36:45.256461+0000","last_fullsized":"2024-09-17T03:36:45.256461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:52.227091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256866+0000","last_change":"2024-09-17T03:36:43.246552+0000","last_active":"2024-09-17T03:36:45.256866+0000","last_peered":"2024-09-17T03:36:45.256866+0000","last_clean":"2024-09-17T03:36:45.256866+0000","last_became_active":"2024-09-17T03:36:43.243938+0000","last_became_peered":"2024-09-17T03:36:43.243938+0000","last_unstale":"2024-09-17T03:36:45.256866+0000","last_undegraded":"2024-09-17T03:36:45.256866+0000","last_fullsized":"2024-09-17T03:36:45.256866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:32.019221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256090+0000","last_change":"2024-09-17T03:36:44.257966+0000","last_active":"2024-09-17T03:36:45.256090+0000","last_peered":"2024-09-17T03:36:45.256090+0000","last_clean":"2024-09-17T03:36:45.256090+0000","last_became_active":"2024-09-17T03:36:44.257627+0000","last_became_peered":"2024-09-17T03:36:44.257627+0000","last_unstale":"2024-09-17T03:36:45.256090+0000","last_undegraded":"2024-09-17T03:36:45.256090+0000","last_fullsized":"2024-09-17T03:36:45.256090+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:07.526657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257449+0000","last_change":"2024-09-17T03:36:43.242166+0000","last_active":"2024-09-17T03:36:45.257449+0000","last_peered":"2024-09-17T03:36:45.257449+0000","last_clean":"2024-09-17T03:36:45.257449+0000","last_became_active":"2024-09-17T03:36:43.241720+0000","last_became_peered":"2024-09-17T03:36:43.241720+0000","last_unstale":"2024-09-17T03:36:45.257449+0000","last_undegraded":"2024-09-17T03:36:45.257449+0000","last_fullsized":"2024-09-17T03:36:45.257449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:30.410210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265941+0000","last_change":"2024-09-17T03:36:44.253537+0000","last_active":"2024-09-17T03:36:45.265941+0000","last_peered":"2024-09-17T03:36:45.265941+0000","last_clean":"2024-09-17T03:36:45.265941+0000","last_became_active":"2024-09-17T03:36:44.253232+0000","last_became_peered":"2024-09-17T03:36:44.253232+0000","last_unstale":"2024-09-17T03:36:45.265941+0000","last_undegraded":"2024-09-17T03:36:45.265941+0000","last_fullsized":"2024-09-17T03:36:45.265941+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:20.976361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258034+0000","last_change":"2024-09-17T03:36:43.245321+0000","last_active":"2024-09-17T03:36:45.258034+0000","last_peered":"2024-09-17T03:36:45.258034+0000","last_clean":"2024-09-17T03:36:45.258034+0000","last_became_active":"2024-09-17T03:36:43.245000+0000","last_became_peered":"2024-09-17T03:36:43.245000+0000","last_unstale":"2024-09-17T03:36:45.258034+0000","last_undegraded":"2024-09-17T03:36:45.258034+0000","last_fullsized":"2024-09-17T03:36:45.258034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:06.451160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262584+0000","last_change":"2024-09-17T03:36:44.255583+0000","last_active":"2024-09-17T03:36:45.262584+0000","last_peered":"2024-09-17T03:36:45.262584+0000","last_clean":"2024-09-17T03:36:45.262584+0000","last_became_active":"2024-09-17T03:36:44.255259+0000","last_became_peered":"2024-09-17T03:36:44.255259+0000","last_unstale":"2024-09-17T03:36:45.262584+0000","last_undegraded":"2024-09-17T03:36:45.262584+0000","last_fullsized":"2024-09-17T03:36:45.262584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:14.932088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339312+0000","last_change":"2024-09-17T03:36:43.239640+0000","last_active":"2024-09-17T03:36:45.339312+0000","last_peered":"2024-09-17T03:36:45.339312+0000","last_clean":"2024-09-17T03:36:45.339312+0000","last_became_active":"2024-09-17T03:36:43.239321+0000","last_became_peered":"2024-09-17T03:36:43.239321+0000","last_unstale":"2024-09-17T03:36:45.339312+0000","last_undegraded":"2024-09-17T03:36:45.339312+0000","last_fullsized":"2024-09-17T03:36:45.339312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:30.410210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257073+0000","last_change":"2024-09-17T03:36:44.260816+0000","last_active":"2024-09-17T03:36:45.257073+0000","last_peered":"2024-09-17T03:36:45.257073+0000","last_clean":"2024-09-17T03:36:45.257073+0000","last_became_active":"2024-09-17T03:36:44.260481+0000","last_became_peered":"2024-09-17T03:36:44.260481+0000","last_unstale":"2024-09-17T03:36:45.257073+0000","last_undegraded":"2024-09-17T03:36:45.257073+0000","last_fullsized":"2024-09-17T03:36:45.257073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:04.179982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340101+0000","last_change":"2024-09-17T03:36:43.250977+0000","last_active":"2024-09-17T03:36:45.340101+0000","last_peered":"2024-09-17T03:36:45.340101+0000","last_clean":"2024-09-17T03:36:45.340101+0000","last_became_active":"2024-09-17T03:36:43.250638+0000","last_became_peered":"2024-09-17T03:36:43.250638+0000","last_unstale":"2024-09-17T03:36:45.340101+0000","last_undegraded":"2024-09-17T03:36:45.340101+0000","last_fullsized":"2024-09-17T03:36:45.340101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:54.928131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340247+0000","last_change":"2024-09-17T03:36:44.261046+0000","last_active":"2024-09-17T03:36:45.340247+0000","last_peered":"2024-09-17T03:36:45.340247+0000","last_clean":"2024-09-17T03:36:45.340247+0000","last_became_active":"2024-09-17T03:36:44.260749+0000","last_became_peered":"2024-09-17T03:36:44.260749+0000","last_unstale":"2024-09-17T03:36:45.340247+0000","last_undegraded":"2024-09-17T03:36:45.340247+0000","last_fullsized":"2024-09-17T03:36:45.340247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:47.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258597+0000","last_change":"2024-09-17T03:36:43.248274+0000","last_active":"2024-09-17T03:36:45.258597+0000","last_peered":"2024-09-17T03:36:45.258597+0000","last_clean":"2024-09-17T03:36:45.258597+0000","last_became_active":"2024-09-17T03:36:43.247287+0000","last_became_peered":"2024-09-17T03:36:43.247287+0000","last_unstale":"2024-09-17T03:36:45.258597+0000","last_undegraded":"2024-09-17T03:36:45.258597+0000","last_fullsized":"2024-09-17T03:36:45.258597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:08.860204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340228+0000","last_change":"2024-09-17T03:36:44.260449+0000","last_active":"2024-09-17T03:36:45.340228+0000","last_peered":"2024-09-17T03:36:45.340228+0000","last_clean":"2024-09-17T03:36:45.340228+0000","last_became_active":"2024-09-17T03:36:44.260163+0000","last_became_peered":"2024-09-17T03:36:44.260163+0000","last_unstale":"2024-09-17T03:36:45.340228+0000","last_undegraded":"2024-09-17T03:36:45.340228+0000","last_fullsized":"2024-09-17T03:36:45.340228+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:49.493460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262410+0000","last_change":"2024-09-17T03:36:43.242358+0000","last_active":"2024-09-17T03:36:45.262410+0000","last_peered":"2024-09-17T03:36:45.262410+0000","last_clean":"2024-09-17T03:36:45.262410+0000","last_became_active":"2024-09-17T03:36:43.241998+0000","last_became_peered":"2024-09-17T03:36:43.241998+0000","last_unstale":"2024-09-17T03:36:45.262410+0000","last_undegraded":"2024-09-17T03:36:45.262410+0000","last_fullsized":"2024-09-17T03:36:45.262410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:02.266116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340839+0000","last_change":"2024-09-17T03:36:44.255735+0000","last_active":"2024-09-17T03:36:45.340839+0000","last_peered":"2024-09-17T03:36:45.340839+0000","last_clean":"2024-09-17T03:36:45.340839+0000","last_became_active":"2024-09-17T03:36:44.254710+0000","last_became_peered":"2024-09-17T03:36:44.254710+0000","last_unstale":"2024-09-17T03:36:45.340839+0000","last_undegraded":"2024-09-17T03:36:45.340839+0000","last_fullsized":"2024-09-17T03:36:45.340839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:14.497107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340523+0000","last_change":"2024-09-17T03:36:43.246790+0000","last_active":"2024-09-17T03:36:45.340523+0000","last_peered":"2024-09-17T03:36:45.340523+0000","last_clean":"2024-09-17T03:36:45.340523+0000","last_became_active":"2024-09-17T03:36:43.246506+0000","last_became_peered":"2024-09-17T03:36:43.246506+0000","last_unstale":"2024-09-17T03:36:45.340523+0000","last_undegraded":"2024-09-17T03:36:45.340523+0000","last_fullsized":"2024-09-17T03:36:45.340523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:36.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257782+0000","last_change":"2024-09-17T03:36:44.251074+0000","last_active":"2024-09-17T03:36:45.257782+0000","last_peered":"2024-09-17T03:36:45.257782+0000","last_clean":"2024-09-17T03:36:45.257782+0000","last_became_active":"2024-09-17T03:36:44.249327+0000","last_became_peered":"2024-09-17T03:36:44.249327+0000","last_unstale":"2024-09-17T03:36:45.257782+0000","last_undegraded":"2024-09-17T03:36:45.257782+0000","last_fullsized":"2024-09-17T03:36:45.257782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:12.553359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340586+0000","last_change":"2024-09-17T03:36:43.244507+0000","last_active":"2024-09-17T03:36:45.340586+0000","last_peered":"2024-09-17T03:36:45.340586+0000","last_clean":"2024-09-17T03:36:45.340586+0000","last_became_active":"2024-09-17T03:36:43.244138+0000","last_became_peered":"2024-09-17T03:36:43.244138+0000","last_unstale":"2024-09-17T03:36:45.340586+0000","last_undegraded":"2024-09-17T03:36:45.340586+0000","last_fullsized":"2024-09-17T03:36:45.340586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:37.711102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255403+0000","last_change":"2024-09-17T03:36:44.253706+0000","last_active":"2024-09-17T03:36:45.255403+0000","last_peered":"2024-09-17T03:36:45.255403+0000","last_clean":"2024-09-17T03:36:45.255403+0000","last_became_active":"2024-09-17T03:36:44.253406+0000","last_became_peered":"2024-09-17T03:36:44.253406+0000","last_unstale":"2024-09-17T03:36:45.255403+0000","last_undegraded":"2024-09-17T03:36:45.255403+0000","last_fullsized":"2024-09-17T03:36:45.255403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:59.355486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257330+0000","last_change":"2024-09-17T03:36:43.245115+0000","last_active":"2024-09-17T03:36:45.257330+0000","last_peered":"2024-09-17T03:36:45.257330+0000","last_clean":"2024-09-17T03:36:45.257330+0000","last_became_active":"2024-09-17T03:36:43.244800+0000","last_became_peered":"2024-09-17T03:36:43.244800+0000","last_unstale":"2024-09-17T03:36:45.257330+0000","last_undegraded":"2024-09-17T03:36:45.257330+0000","last_fullsized":"2024-09-17T03:36:45.257330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265952+0000","last_change":"2024-09-17T03:36:44.263078+0000","last_active":"2024-09-17T03:36:45.265952+0000","last_peered":"2024-09-17T03:36:45.265952+0000","last_clean":"2024-09-17T03:36:45.265952+0000","last_became_active":"2024-09-17T03:36:44.262753+0000","last_became_peered":"2024-09-17T03:36:44.262753+0000","last_unstale":"2024-09-17T03:36:45.265952+0000","last_undegraded":"2024-09-17T03:36:45.265952+0000","last_fullsized":"2024-09-17T03:36:45.265952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:52.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339783+0000","last_change":"2024-09-17T03:36:43.245006+0000","last_active":"2024-09-17T03:36:45.339783+0000","last_peered":"2024-09-17T03:36:45.339783+0000","last_clean":"2024-09-17T03:36:45.339783+0000","last_became_active":"2024-09-17T03:36:43.244723+0000","last_became_peered":"2024-09-17T03:36:43.244723+0000","last_unstale":"2024-09-17T03:36:45.339783+0000","last_undegraded":"2024-09-17T03:36:45.339783+0000","last_fullsized":"2024-09-17T03:36:45.339783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.555456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256781+0000","last_change":"2024-09-17T03:36:44.259397+0000","last_active":"2024-09-17T03:36:45.256781+0000","last_peered":"2024-09-17T03:36:45.256781+0000","last_clean":"2024-09-17T03:36:45.256781+0000","last_became_active":"2024-09-17T03:36:44.259042+0000","last_became_peered":"2024-09-17T03:36:44.259042+0000","last_unstale":"2024-09-17T03:36:45.256781+0000","last_undegraded":"2024-09-17T03:36:45.256781+0000","last_fullsized":"2024-09-17T03:36:45.256781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.440414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255636+0000","last_change":"2024-09-17T03:36:43.246360+0000","last_active":"2024-09-17T03:36:45.255636+0000","last_peered":"2024-09-17T03:36:45.255636+0000","last_clean":"2024-09-17T03:36:45.255636+0000","last_became_active":"2024-09-17T03:36:43.243140+0000","last_became_peered":"2024-09-17T03:36:43.243140+0000","last_unstale":"2024-09-17T03:36:45.255636+0000","last_undegraded":"2024-09-17T03:36:45.255636+0000","last_fullsized":"2024-09-17T03:36:45.255636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:14.876381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262543+0000","last_change":"2024-09-17T03:36:44.265309+0000","last_active":"2024-09-17T03:36:45.262543+0000","last_peered":"2024-09-17T03:36:45.262543+0000","last_clean":"2024-09-17T03:36:45.262543+0000","last_became_active":"2024-09-17T03:36:44.264925+0000","last_became_peered":"2024-09-17T03:36:44.264925+0000","last_unstale":"2024-09-17T03:36:45.262543+0000","last_undegraded":"2024-09-17T03:36:45.262543+0000","last_fullsized":"2024-09-17T03:36:45.262543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:35.512783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258272+0000","last_change":"2024-09-17T03:36:43.249727+0000","last_active":"2024-09-17T03:36:45.258272+0000","last_peered":"2024-09-17T03:36:45.258272+0000","last_clean":"2024-09-17T03:36:45.258272+0000","last_became_active":"2024-09-17T03:36:43.249376+0000","last_became_peered":"2024-09-17T03:36:43.249376+0000","last_unstale":"2024-09-17T03:36:45.258272+0000","last_undegraded":"2024-09-17T03:36:45.258272+0000","last_fullsized":"2024-09-17T03:36:45.258272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:13.054687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266096+0000","last_change":"2024-09-17T03:36:44.269381+0000","last_active":"2024-09-17T03:36:45.266096+0000","last_peered":"2024-09-17T03:36:45.266096+0000","last_clean":"2024-09-17T03:36:45.266096+0000","last_became_active":"2024-09-17T03:36:44.264227+0000","last_became_peered":"2024-09-17T03:36:44.264227+0000","last_unstale":"2024-09-17T03:36:45.266096+0000","last_undegraded":"2024-09-17T03:36:45.266096+0000","last_fullsized":"2024-09-17T03:36:45.266096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:56.489758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.264284+0000","last_change":"2024-09-17T03:36:43.242092+0000","last_active":"2024-09-17T03:36:45.264284+0000","last_peered":"2024-09-17T03:36:45.264284+0000","last_clean":"2024-09-17T03:36:45.264284+0000","last_became_active":"2024-09-17T03:36:43.241759+0000","last_became_peered":"2024-09-17T03:36:43.241759+0000","last_unstale":"2024-09-17T03:36:45.264284+0000","last_undegraded":"2024-09-17T03:36:45.264284+0000","last_fullsized":"2024-09-17T03:36:45.264284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:30.046741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340741+0000","last_change":"2024-09-17T03:36:44.273690+0000","last_active":"2024-09-17T03:36:45.340741+0000","last_peered":"2024-09-17T03:36:45.340741+0000","last_clean":"2024-09-17T03:36:45.340741+0000","last_became_active":"2024-09-17T03:36:44.273364+0000","last_became_peered":"2024-09-17T03:36:44.273364+0000","last_unstale":"2024-09-17T03:36:45.340741+0000","last_undegraded":"2024-09-17T03:36:45.340741+0000","last_fullsized":"2024-09-17T03:36:45.340741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:37.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262362+0000","last_change":"2024-09-17T03:36:43.233724+0000","last_active":"2024-09-17T03:36:45.262362+0000","last_peered":"2024-09-17T03:36:45.262362+0000","last_clean":"2024-09-17T03:36:45.262362+0000","last_became_active":"2024-09-17T03:36:43.232853+0000","last_became_peered":"2024-09-17T03:36:43.232853+0000","last_unstale":"2024-09-17T03:36:45.262362+0000","last_undegraded":"2024-09-17T03:36:45.262362+0000","last_fullsized":"2024-09-17T03:36:45.262362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:10.474554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262290+0000","last_change":"2024-09-17T03:36:44.256195+0000","last_active":"2024-09-17T03:36:45.262290+0000","last_peered":"2024-09-17T03:36:45.262290+0000","last_clean":"2024-09-17T03:36:45.262290+0000","last_became_active":"2024-09-17T03:36:44.255895+0000","last_became_peered":"2024-09-17T03:36:44.255895+0000","last_unstale":"2024-09-17T03:36:45.262290+0000","last_undegraded":"2024-09-17T03:36:45.262290+0000","last_fullsized":"2024-09-17T03:36:45.262290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:54.588941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256997+0000","last_change":"2024-09-17T03:36:43.237705+0000","last_active":"2024-09-17T03:36:45.256997+0000","last_peered":"2024-09-17T03:36:45.256997+0000","last_clean":"2024-09-17T03:36:45.256997+0000","last_became_active":"2024-09-17T03:36:43.236308+0000","last_became_peered":"2024-09-17T03:36:43.236308+0000","last_unstale":"2024-09-17T03:36:45.256997+0000","last_undegraded":"2024-09-17T03:36:45.256997+0000","last_fullsized":"2024-09-17T03:36:45.256997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:35.939675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257954+0000","last_change":"2024-09-17T03:36:44.251549+0000","last_active":"2024-09-17T03:36:45.257954+0000","last_peered":"2024-09-17T03:36:45.257954+0000","last_clean":"2024-09-17T03:36:45.257954+0000","last_became_active":"2024-09-17T03:36:44.249170+0000","last_became_peered":"2024-09-17T03:36:44.249170+0000","last_unstale":"2024-09-17T03:36:45.257954+0000","last_undegraded":"2024-09-17T03:36:45.257954+0000","last_fullsized":"2024-09-17T03:36:45.257954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.234298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266059+0000","last_change":"2024-09-17T03:36:43.250361+0000","last_active":"2024-09-17T03:36:45.266059+0000","last_peered":"2024-09-17T03:36:45.266059+0000","last_clean":"2024-09-17T03:36:45.266059+0000","last_became_active":"2024-09-17T03:36:43.250046+0000","last_became_peered":"2024-09-17T03:36:43.250046+0000","last_unstale":"2024-09-17T03:36:45.266059+0000","last_undegraded":"2024-09-17T03:36:45.266059+0000","last_fullsized":"2024-09-17T03:36:45.266059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:13.925305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258201+0000","last_change":"2024-09-17T03:36:44.245554+0000","last_active":"2024-09-17T03:36:45.258201+0000","last_peered":"2024-09-17T03:36:45.258201+0000","last_clean":"2024-09-17T03:36:45.258201+0000","last_became_active":"2024-09-17T03:36:44.243706+0000","last_became_peered":"2024-09-17T03:36:44.243706+0000","last_unstale":"2024-09-17T03:36:45.258201+0000","last_undegraded":"2024-09-17T03:36:45.258201+0000","last_fullsized":"2024-09-17T03:36:45.258201+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:57.050681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258133+0000","last_change":"2024-09-17T03:36:43.251317+0000","last_active":"2024-09-17T03:36:45.258133+0000","last_peered":"2024-09-17T03:36:45.258133+0000","last_clean":"2024-09-17T03:36:45.258133+0000","last_became_active":"2024-09-17T03:36:43.250948+0000","last_became_peered":"2024-09-17T03:36:43.250948+0000","last_unstale":"2024-09-17T03:36:45.258133+0000","last_undegraded":"2024-09-17T03:36:45.258133+0000","last_fullsized":"2024-09-17T03:36:45.258133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:14.413534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265908+0000","last_change":"2024-09-17T03:36:44.254879+0000","last_active":"2024-09-17T03:36:45.265908+0000","last_peered":"2024-09-17T03:36:45.265908+0000","last_clean":"2024-09-17T03:36:45.265908+0000","last_became_active":"2024-09-17T03:36:44.254211+0000","last_became_peered":"2024-09-17T03:36:44.254211+0000","last_unstale":"2024-09-17T03:36:45.265908+0000","last_undegraded":"2024-09-17T03:36:45.265908+0000","last_fullsized":"2024-09-17T03:36:45.265908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:25.422746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256342+0000","last_change":"2024-09-17T03:36:43.247619+0000","last_active":"2024-09-17T03:36:45.256342+0000","last_peered":"2024-09-17T03:36:45.256342+0000","last_clean":"2024-09-17T03:36:45.256342+0000","last_became_active":"2024-09-17T03:36:43.247248+0000","last_became_peered":"2024-09-17T03:36:43.247248+0000","last_unstale":"2024-09-17T03:36:45.256342+0000","last_undegraded":"2024-09-17T03:36:45.256342+0000","last_fullsized":"2024-09-17T03:36:45.256342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:39.124865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258159+0000","last_change":"2024-09-17T03:36:44.250558+0000","last_active":"2024-09-17T03:36:45.258159+0000","last_peered":"2024-09-17T03:36:45.258159+0000","last_clean":"2024-09-17T03:36:45.258159+0000","last_became_active":"2024-09-17T03:36:44.250256+0000","last_became_peered":"2024-09-17T03:36:44.250256+0000","last_unstale":"2024-09-17T03:36:45.258159+0000","last_undegraded":"2024-09-17T03:36:45.258159+0000","last_fullsized":"2024-09-17T03:36:45.258159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:16.391925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265969+0000","last_change":"2024-09-17T03:36:43.250824+0000","last_active":"2024-09-17T03:36:45.265969+0000","last_peered":"2024-09-17T03:36:45.265969+0000","last_clean":"2024-09-17T03:36:45.265969+0000","last_became_active":"2024-09-17T03:36:43.250296+0000","last_became_peered":"2024-09-17T03:36:43.250296+0000","last_unstale":"2024-09-17T03:36:45.265969+0000","last_undegraded":"2024-09-17T03:36:45.265969+0000","last_fullsized":"2024-09-17T03:36:45.265969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:34.505999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339553+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:36:45.339553+0000","last_peered":"2024-09-17T03:36:45.339553+0000","last_clean":"2024-09-17T03:36:45.339553+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:36:45.339553+0000","last_undegraded":"2024-09-17T03:36:45.339553+0000","last_fullsized":"2024-09-17T03:36:45.339553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":188124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":779040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":188180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":196976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":778480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":194874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":196518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:51.002 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:36:51.007 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:36:53.630 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.861+0000 7f43f1000640 1 -- 172.21.15.121:0/1883682460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec073dd0 msgr2=0x7f43ec06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.861+0000 7f43f1000640 1 --2- 172.21.15.121:0/1883682460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec073dd0 0x7f43ec06ddf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f43d4005fd0 tx=0x7f43d402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.861+0000 7f43f1000640 1 -- 172.21.15.121:0/1883682460 shutdown_connections 2024-09-17T03:36:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.861+0000 7f43f1000640 1 --2- 172.21.15.121:0/1883682460 >> v2:172.21.15.176:3300/0 conn(0x7f43ec06e330 0x7f43ec06ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.861+0000 7f43f1000640 1 --2- 172.21.15.121:0/1883682460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec073dd0 0x7f43ec06ddf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.861+0000 7f43f1000640 1 -- 172.21.15.121:0/1883682460 >> 172.21.15.121:0/1883682460 conn(0x7f43ec0cca40 msgr2=0x7f43ec0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:53.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.861+0000 7f43f1000640 1 -- 172.21.15.121:0/1883682460 shutdown_connections 2024-09-17T03:36:53.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.861+0000 7f43f1000640 1 -- 172.21.15.121:0/1883682460 wait complete. 2024-09-17T03:36:53.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.863+0000 7f43f1000640 1 Processor -- start 2024-09-17T03:36:53.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.863+0000 7f43f1000640 1 -- start start 2024-09-17T03:36:53.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43f1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec06e330 0x7f43ec157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43f1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec073dd0 0x7f43ec09ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43f1000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074cb0 0x7f43ec09b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43f1000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec06f4a0 con 0x7f43ec06e330 2024-09-17T03:36:53.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43f1000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec06f320 con 0x7f43ec073dd0 2024-09-17T03:36:53.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43f1000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f43ec06f620 con 0x7f43ec074cb0 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43e9e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec06e330 0x7f43ec157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43e9e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec06e330 0x7f43ec157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47622/0 (socket says 172.21.15.121:47622) 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43e9e00640 1 -- 172.21.15.121:0/1792325989 learned_addr learned my addr 172.21.15.121:0/1792325989 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43e1400640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec073dd0 0x7f43ec09ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.865+0000 7f43ea800640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074cb0 0x7f43ec09b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43e9e00640 1 -- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074cb0 msgr2=0x7f43ec09b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43e9e00640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074cb0 0x7f43ec09b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43e9e00640 1 -- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec073dd0 msgr2=0x7f43ec09ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43e9e00640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec073dd0 0x7f43ec09ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43e9e00640 1 -- 172.21.15.121:0/1792325989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ec1f5fa0 con 0x7f43ec06e330 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43e9e00640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec06e330 0x7f43ec157980 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00c370 tx=0x7f43dc00c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43e2a00640 1 -- 172.21.15.121:0/1792325989 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc017070 con 0x7f43ec06e330 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43e2a00640 1 -- 172.21.15.121:0/1792325989 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43dc0053c0 con 0x7f43ec06e330 2024-09-17T03:36:53.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43f1000640 1 -- 172.21.15.121:0/1792325989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ec1f6280 con 0x7f43ec06e330 2024-09-17T03:36:53.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43e2a00640 1 -- 172.21.15.121:0/1792325989 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc003850 con 0x7f43ec06e330 2024-09-17T03:36:53.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.866+0000 7f43f1000640 1 -- 172.21.15.121:0/1792325989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ec1f5c80 con 0x7f43ec06e330 2024-09-17T03:36:53.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.867+0000 7f43f1000640 1 -- 172.21.15.121:0/1792325989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ec06fb60 con 0x7f43ec06e330 2024-09-17T03:36:53.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.868+0000 7f43e2a00640 1 -- 172.21.15.121:0/1792325989 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43dc01a070 con 0x7f43ec06e330 2024-09-17T03:36:53.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.870+0000 7f43e2a00640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43c8078b90 0x7f43c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.870+0000 7f43e2a00640 1 -- 172.21.15.121:0/1792325989 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f43dc09a1d0 con 0x7f43ec06e330 2024-09-17T03:36:53.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.870+0000 7f43e1400640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43c8078b90 0x7f43c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.871+0000 7f43e1400640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43c8078b90 0x7f43c807b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43d4033000 tx=0x7f43d4004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:53.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:53.874+0000 7f43e2a00640 1 -- 172.21.15.121:0/1792325989 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f43dc061d90 con 0x7f43ec06e330 2024-09-17T03:36:54.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.053+0000 7f43f1000640 1 -- 172.21.15.121:0/1792325989 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43ec09df50 con 0x7f43c8078b90 2024-09-17T03:36:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.058+0000 7f43e2a00640 1 -- 172.21.15.121:0/1792325989 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251834 (secure 0 0 0) 0x7f43d4005610 con 0x7f43c8078b90 2024-09-17T03:36:54.061 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:54.062 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:36:54.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 -- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43c8078b90 msgr2=0x7f43c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43c8078b90 0x7f43c807b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43d4033000 tx=0x7f43d4004730 comp rx=0 tx=0).stop 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 -- 172.21.15.121:0/1792325989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec06e330 msgr2=0x7f43ec157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec06e330 0x7f43ec157980 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00c370 tx=0x7f43dc00c770 comp rx=0 tx=0).stop 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 -- 172.21.15.121:0/1792325989 shutdown_connections 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43ec074cb0 0x7f43ec09b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43ec073dd0 0x7f43ec09ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43c8078b90 0x7f43c807b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 --2- 172.21.15.121:0/1792325989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec06e330 0x7f43ec157980 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 -- 172.21.15.121:0/1792325989 >> 172.21.15.121:0/1792325989 conn(0x7f43ec0cca40 msgr2=0x7f43ec15aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 -- 172.21.15.121:0/1792325989 shutdown_connections 2024-09-17T03:36:54.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.062+0000 7f43f1000640 1 -- 172.21.15.121:0/1792325989 wait complete. 2024-09-17T03:36:54.083 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-17T03:36:53.299262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221048,"kb_used_data":4776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753672,"statfs":{"total":773094113280,"available":772867760128,"internally_reserved":0,"allocated":4890624,"data_stored":2743812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.066446"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257472+0000","last_change":"2024-09-17T03:36:44.253555+0000","last_active":"2024-09-17T03:36:45.257472+0000","last_peered":"2024-09-17T03:36:45.257472+0000","last_clean":"2024-09-17T03:36:45.257472+0000","last_became_active":"2024-09-17T03:36:44.253229+0000","last_became_peered":"2024-09-17T03:36:44.253229+0000","last_unstale":"2024-09-17T03:36:45.257472+0000","last_undegraded":"2024-09-17T03:36:45.257472+0000","last_fullsized":"2024-09-17T03:36:45.257472+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:06.783442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257666+0000","last_change":"2024-09-17T03:36:44.254536+0000","last_active":"2024-09-17T03:36:45.257666+0000","last_peered":"2024-09-17T03:36:45.257666+0000","last_clean":"2024-09-17T03:36:45.257666+0000","last_became_active":"2024-09-17T03:36:44.253988+0000","last_became_peered":"2024-09-17T03:36:44.253988+0000","last_unstale":"2024-09-17T03:36:45.257666+0000","last_undegraded":"2024-09-17T03:36:45.257666+0000","last_fullsized":"2024-09-17T03:36:45.257666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:13.241349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257410+0000","last_change":"2024-09-17T03:36:44.269911+0000","last_active":"2024-09-17T03:36:45.257410+0000","last_peered":"2024-09-17T03:36:45.257410+0000","last_clean":"2024-09-17T03:36:45.257410+0000","last_became_active":"2024-09-17T03:36:44.268580+0000","last_became_peered":"2024-09-17T03:36:44.268580+0000","last_unstale":"2024-09-17T03:36:45.257410+0000","last_undegraded":"2024-09-17T03:36:45.257410+0000","last_fullsized":"2024-09-17T03:36:45.257410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.450766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257448+0000","last_change":"2024-09-17T03:36:44.265556+0000","last_active":"2024-09-17T03:36:45.257448+0000","last_peered":"2024-09-17T03:36:45.257448+0000","last_clean":"2024-09-17T03:36:45.257448+0000","last_became_active":"2024-09-17T03:36:44.263396+0000","last_became_peered":"2024-09-17T03:36:44.263396+0000","last_unstale":"2024-09-17T03:36:45.257448+0000","last_undegraded":"2024-09-17T03:36:45.257448+0000","last_fullsized":"2024-09-17T03:36:45.257448+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:52.560792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262421+0000","last_change":"2024-09-17T03:36:44.270961+0000","last_active":"2024-09-17T03:36:45.262421+0000","last_peered":"2024-09-17T03:36:45.262421+0000","last_clean":"2024-09-17T03:36:45.262421+0000","last_became_active":"2024-09-17T03:36:44.270715+0000","last_became_peered":"2024-09-17T03:36:44.270715+0000","last_unstale":"2024-09-17T03:36:45.262421+0000","last_undegraded":"2024-09-17T03:36:45.262421+0000","last_fullsized":"2024-09-17T03:36:45.262421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:28.602443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256080+0000","last_change":"2024-09-17T03:36:44.252818+0000","last_active":"2024-09-17T03:36:45.256080+0000","last_peered":"2024-09-17T03:36:45.256080+0000","last_clean":"2024-09-17T03:36:45.256080+0000","last_became_active":"2024-09-17T03:36:44.252517+0000","last_became_peered":"2024-09-17T03:36:44.252517+0000","last_unstale":"2024-09-17T03:36:45.256080+0000","last_undegraded":"2024-09-17T03:36:45.256080+0000","last_fullsized":"2024-09-17T03:36:45.256080+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:52.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339570+0000","last_change":"2024-09-17T03:36:44.258990+0000","last_active":"2024-09-17T03:36:45.339570+0000","last_peered":"2024-09-17T03:36:45.339570+0000","last_clean":"2024-09-17T03:36:45.339570+0000","last_became_active":"2024-09-17T03:36:44.257521+0000","last_became_peered":"2024-09-17T03:36:44.257521+0000","last_unstale":"2024-09-17T03:36:45.339570+0000","last_undegraded":"2024-09-17T03:36:45.339570+0000","last_fullsized":"2024-09-17T03:36:45.339570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:15.883165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255683+0000","last_change":"2024-09-17T03:36:44.261118+0000","last_active":"2024-09-17T03:36:45.255683+0000","last_peered":"2024-09-17T03:36:45.255683+0000","last_clean":"2024-09-17T03:36:45.255683+0000","last_became_active":"2024-09-17T03:36:44.260797+0000","last_became_peered":"2024-09-17T03:36:44.260797+0000","last_unstale":"2024-09-17T03:36:45.255683+0000","last_undegraded":"2024-09-17T03:36:45.255683+0000","last_fullsized":"2024-09-17T03:36:45.255683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:02.600076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262780+0000","last_change":"2024-09-17T03:36:44.262837+0000","last_active":"2024-09-17T03:36:45.262780+0000","last_peered":"2024-09-17T03:36:45.262780+0000","last_clean":"2024-09-17T03:36:45.262780+0000","last_became_active":"2024-09-17T03:36:44.262509+0000","last_became_peered":"2024-09-17T03:36:44.262509+0000","last_unstale":"2024-09-17T03:36:45.262780+0000","last_undegraded":"2024-09-17T03:36:45.262780+0000","last_fullsized":"2024-09-17T03:36:45.262780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:10.421129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340043+0000","last_change":"2024-09-17T03:36:44.265401+0000","last_active":"2024-09-17T03:36:45.340043+0000","last_peered":"2024-09-17T03:36:45.340043+0000","last_clean":"2024-09-17T03:36:45.340043+0000","last_became_active":"2024-09-17T03:36:44.264977+0000","last_became_peered":"2024-09-17T03:36:44.264977+0000","last_unstale":"2024-09-17T03:36:45.340043+0000","last_undegraded":"2024-09-17T03:36:45.340043+0000","last_fullsized":"2024-09-17T03:36:45.340043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:12.406230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266229+0000","last_change":"2024-09-17T03:36:44.263719+0000","last_active":"2024-09-17T03:36:45.266229+0000","last_peered":"2024-09-17T03:36:45.266229+0000","last_clean":"2024-09-17T03:36:45.266229+0000","last_became_active":"2024-09-17T03:36:44.263036+0000","last_became_peered":"2024-09-17T03:36:44.263036+0000","last_unstale":"2024-09-17T03:36:45.266229+0000","last_undegraded":"2024-09-17T03:36:45.266229+0000","last_fullsized":"2024-09-17T03:36:45.266229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:17.529967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262471+0000","last_change":"2024-09-17T03:36:44.256960+0000","last_active":"2024-09-17T03:36:45.262471+0000","last_peered":"2024-09-17T03:36:45.262471+0000","last_clean":"2024-09-17T03:36:45.262471+0000","last_became_active":"2024-09-17T03:36:44.256672+0000","last_became_peered":"2024-09-17T03:36:44.256672+0000","last_unstale":"2024-09-17T03:36:45.262471+0000","last_undegraded":"2024-09-17T03:36:45.262471+0000","last_fullsized":"2024-09-17T03:36:45.262471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:04.996521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339625+0000","last_change":"2024-09-17T03:36:44.256119+0000","last_active":"2024-09-17T03:36:45.339625+0000","last_peered":"2024-09-17T03:36:45.339625+0000","last_clean":"2024-09-17T03:36:45.339625+0000","last_became_active":"2024-09-17T03:36:44.255740+0000","last_became_peered":"2024-09-17T03:36:44.255740+0000","last_unstale":"2024-09-17T03:36:45.339625+0000","last_undegraded":"2024-09-17T03:36:45.339625+0000","last_fullsized":"2024-09-17T03:36:45.339625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:53.649917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339888+0000","last_change":"2024-09-17T03:36:44.257717+0000","last_active":"2024-09-17T03:36:45.339888+0000","last_peered":"2024-09-17T03:36:45.339888+0000","last_clean":"2024-09-17T03:36:45.339888+0000","last_became_active":"2024-09-17T03:36:44.257422+0000","last_became_peered":"2024-09-17T03:36:44.257422+0000","last_unstale":"2024-09-17T03:36:45.339888+0000","last_undegraded":"2024-09-17T03:36:45.339888+0000","last_fullsized":"2024-09-17T03:36:45.339888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:47.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257792+0000","last_change":"2024-09-17T03:36:44.244112+0000","last_active":"2024-09-17T03:36:45.257792+0000","last_peered":"2024-09-17T03:36:45.257792+0000","last_clean":"2024-09-17T03:36:45.257792+0000","last_became_active":"2024-09-17T03:36:44.243734+0000","last_became_peered":"2024-09-17T03:36:44.243734+0000","last_unstale":"2024-09-17T03:36:45.257792+0000","last_undegraded":"2024-09-17T03:36:45.257792+0000","last_fullsized":"2024-09-17T03:36:45.257792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:10.602532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339489+0000","last_change":"2024-09-17T03:36:44.254142+0000","last_active":"2024-09-17T03:36:45.339489+0000","last_peered":"2024-09-17T03:36:45.339489+0000","last_clean":"2024-09-17T03:36:45.339489+0000","last_became_active":"2024-09-17T03:36:44.253871+0000","last_became_peered":"2024-09-17T03:36:44.253871+0000","last_unstale":"2024-09-17T03:36:45.339489+0000","last_undegraded":"2024-09-17T03:36:45.339489+0000","last_fullsized":"2024-09-17T03:36:45.339489+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:27.123960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258233+0000","last_change":"2024-09-17T03:36:44.267635+0000","last_active":"2024-09-17T03:36:45.258233+0000","last_peered":"2024-09-17T03:36:45.258233+0000","last_clean":"2024-09-17T03:36:45.258233+0000","last_became_active":"2024-09-17T03:36:44.267199+0000","last_became_peered":"2024-09-17T03:36:44.267199+0000","last_unstale":"2024-09-17T03:36:45.258233+0000","last_undegraded":"2024-09-17T03:36:45.258233+0000","last_fullsized":"2024-09-17T03:36:45.258233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:44.085686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258400+0000","last_change":"2024-09-17T03:36:44.249470+0000","last_active":"2024-09-17T03:36:45.258400+0000","last_peered":"2024-09-17T03:36:45.258400+0000","last_clean":"2024-09-17T03:36:45.258400+0000","last_became_active":"2024-09-17T03:36:44.248597+0000","last_became_peered":"2024-09-17T03:36:44.248597+0000","last_unstale":"2024-09-17T03:36:45.258400+0000","last_undegraded":"2024-09-17T03:36:45.258400+0000","last_fullsized":"2024-09-17T03:36:45.258400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:54.287309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340772+0000","last_change":"2024-09-17T03:36:44.262318+0000","last_active":"2024-09-17T03:36:45.340772+0000","last_peered":"2024-09-17T03:36:45.340772+0000","last_clean":"2024-09-17T03:36:45.340772+0000","last_became_active":"2024-09-17T03:36:44.261979+0000","last_became_peered":"2024-09-17T03:36:44.261979+0000","last_unstale":"2024-09-17T03:36:45.340772+0000","last_undegraded":"2024-09-17T03:36:45.340772+0000","last_fullsized":"2024-09-17T03:36:45.340772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:52.462976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265813+0000","last_change":"2024-09-17T03:36:44.264562+0000","last_active":"2024-09-17T03:36:45.265813+0000","last_peered":"2024-09-17T03:36:45.265813+0000","last_clean":"2024-09-17T03:36:45.265813+0000","last_became_active":"2024-09-17T03:36:44.264273+0000","last_became_peered":"2024-09-17T03:36:44.264273+0000","last_unstale":"2024-09-17T03:36:45.265813+0000","last_undegraded":"2024-09-17T03:36:45.265813+0000","last_fullsized":"2024-09-17T03:36:45.265813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:44.688328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265788+0000","last_change":"2024-09-17T03:36:44.255197+0000","last_active":"2024-09-17T03:36:45.265788+0000","last_peered":"2024-09-17T03:36:45.265788+0000","last_clean":"2024-09-17T03:36:45.265788+0000","last_became_active":"2024-09-17T03:36:44.254536+0000","last_became_peered":"2024-09-17T03:36:44.254536+0000","last_unstale":"2024-09-17T03:36:45.265788+0000","last_undegraded":"2024-09-17T03:36:45.265788+0000","last_fullsized":"2024-09-17T03:36:45.265788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:01.442706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265693+0000","last_change":"2024-09-17T03:36:44.264660+0000","last_active":"2024-09-17T03:36:45.265693+0000","last_peered":"2024-09-17T03:36:45.265693+0000","last_clean":"2024-09-17T03:36:45.265693+0000","last_became_active":"2024-09-17T03:36:44.257929+0000","last_became_peered":"2024-09-17T03:36:44.257929+0000","last_unstale":"2024-09-17T03:36:45.265693+0000","last_undegraded":"2024-09-17T03:36:45.265693+0000","last_fullsized":"2024-09-17T03:36:45.265693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:34.451288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257806+0000","last_change":"2024-09-17T03:36:44.263605+0000","last_active":"2024-09-17T03:36:45.257806+0000","last_peered":"2024-09-17T03:36:45.257806+0000","last_clean":"2024-09-17T03:36:45.257806+0000","last_became_active":"2024-09-17T03:36:44.255877+0000","last_became_peered":"2024-09-17T03:36:44.255877+0000","last_unstale":"2024-09-17T03:36:45.257806+0000","last_undegraded":"2024-09-17T03:36:45.257806+0000","last_fullsized":"2024-09-17T03:36:45.257806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:03.771519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255975+0000","last_change":"2024-09-17T03:36:44.260449+0000","last_active":"2024-09-17T03:36:45.255975+0000","last_peered":"2024-09-17T03:36:45.255975+0000","last_clean":"2024-09-17T03:36:45.255975+0000","last_became_active":"2024-09-17T03:36:44.258669+0000","last_became_peered":"2024-09-17T03:36:44.258669+0000","last_unstale":"2024-09-17T03:36:45.255975+0000","last_undegraded":"2024-09-17T03:36:45.255975+0000","last_fullsized":"2024-09-17T03:36:45.255975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:37.603760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340781+0000","last_change":"2024-09-17T03:36:44.253003+0000","last_active":"2024-09-17T03:36:45.340781+0000","last_peered":"2024-09-17T03:36:45.340781+0000","last_clean":"2024-09-17T03:36:45.340781+0000","last_became_active":"2024-09-17T03:36:44.252680+0000","last_became_peered":"2024-09-17T03:36:44.252680+0000","last_unstale":"2024-09-17T03:36:45.340781+0000","last_undegraded":"2024-09-17T03:36:45.340781+0000","last_fullsized":"2024-09-17T03:36:45.340781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:43.947306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257791+0000","last_change":"2024-09-17T03:36:44.258976+0000","last_active":"2024-09-17T03:36:45.257791+0000","last_peered":"2024-09-17T03:36:45.257791+0000","last_clean":"2024-09-17T03:36:45.257791+0000","last_became_active":"2024-09-17T03:36:44.258614+0000","last_became_peered":"2024-09-17T03:36:44.258614+0000","last_unstale":"2024-09-17T03:36:45.257791+0000","last_undegraded":"2024-09-17T03:36:45.257791+0000","last_fullsized":"2024-09-17T03:36:45.257791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:47.717532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266123+0000","last_change":"2024-09-17T03:36:44.270263+0000","last_active":"2024-09-17T03:36:45.266123+0000","last_peered":"2024-09-17T03:36:45.266123+0000","last_clean":"2024-09-17T03:36:45.266123+0000","last_became_active":"2024-09-17T03:36:44.269849+0000","last_became_peered":"2024-09-17T03:36:44.269849+0000","last_unstale":"2024-09-17T03:36:45.266123+0000","last_undegraded":"2024-09-17T03:36:45.266123+0000","last_fullsized":"2024-09-17T03:36:45.266123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:34.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340142+0000","last_change":"2024-09-17T03:36:44.257142+0000","last_active":"2024-09-17T03:36:45.340142+0000","last_peered":"2024-09-17T03:36:45.340142+0000","last_clean":"2024-09-17T03:36:45.340142+0000","last_became_active":"2024-09-17T03:36:44.256859+0000","last_became_peered":"2024-09-17T03:36:44.256859+0000","last_unstale":"2024-09-17T03:36:45.340142+0000","last_undegraded":"2024-09-17T03:36:45.340142+0000","last_fullsized":"2024-09-17T03:36:45.340142+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:10.452184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257870+0000","last_change":"2024-09-17T03:36:44.250935+0000","last_active":"2024-09-17T03:36:45.257870+0000","last_peered":"2024-09-17T03:36:45.257870+0000","last_clean":"2024-09-17T03:36:45.257870+0000","last_became_active":"2024-09-17T03:36:44.250594+0000","last_became_peered":"2024-09-17T03:36:44.250594+0000","last_unstale":"2024-09-17T03:36:45.257870+0000","last_undegraded":"2024-09-17T03:36:45.257870+0000","last_fullsized":"2024-09-17T03:36:45.257870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:46.657454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258428+0000","last_change":"2024-09-17T03:36:44.253829+0000","last_active":"2024-09-17T03:36:45.258428+0000","last_peered":"2024-09-17T03:36:45.258428+0000","last_clean":"2024-09-17T03:36:45.258428+0000","last_became_active":"2024-09-17T03:36:44.253489+0000","last_became_peered":"2024-09-17T03:36:44.253489+0000","last_unstale":"2024-09-17T03:36:45.258428+0000","last_undegraded":"2024-09-17T03:36:45.258428+0000","last_fullsized":"2024-09-17T03:36:45.258428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:18.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339864+0000","last_change":"2024-09-17T03:36:44.257862+0000","last_active":"2024-09-17T03:36:45.339864+0000","last_peered":"2024-09-17T03:36:45.339864+0000","last_clean":"2024-09-17T03:36:45.339864+0000","last_became_active":"2024-09-17T03:36:44.256454+0000","last_became_peered":"2024-09-17T03:36:44.256454+0000","last_unstale":"2024-09-17T03:36:45.339864+0000","last_undegraded":"2024-09-17T03:36:45.339864+0000","last_fullsized":"2024-09-17T03:36:45.339864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:31.416993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256092+0000","last_change":"2024-09-17T03:36:44.261133+0000","last_active":"2024-09-17T03:36:45.256092+0000","last_peered":"2024-09-17T03:36:45.256092+0000","last_clean":"2024-09-17T03:36:45.256092+0000","last_became_active":"2024-09-17T03:36:44.260820+0000","last_became_peered":"2024-09-17T03:36:44.260820+0000","last_unstale":"2024-09-17T03:36:45.256092+0000","last_undegraded":"2024-09-17T03:36:45.256092+0000","last_fullsized":"2024-09-17T03:36:45.256092+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:35.003652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258326+0000","last_change":"2024-09-17T03:36:44.245754+0000","last_active":"2024-09-17T03:36:45.258326+0000","last_peered":"2024-09-17T03:36:45.258326+0000","last_clean":"2024-09-17T03:36:45.258326+0000","last_became_active":"2024-09-17T03:36:44.245408+0000","last_became_peered":"2024-09-17T03:36:44.245408+0000","last_unstale":"2024-09-17T03:36:45.258326+0000","last_undegraded":"2024-09-17T03:36:45.258326+0000","last_fullsized":"2024-09-17T03:36:45.258326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:44.165481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340900+0000","last_change":"2024-09-17T03:36:43.245126+0000","last_active":"2024-09-17T03:36:45.340900+0000","last_peered":"2024-09-17T03:36:45.340900+0000","last_clean":"2024-09-17T03:36:45.340900+0000","last_became_active":"2024-09-17T03:36:43.244672+0000","last_became_peered":"2024-09-17T03:36:43.244672+0000","last_unstale":"2024-09-17T03:36:45.340900+0000","last_undegraded":"2024-09-17T03:36:45.340900+0000","last_fullsized":"2024-09-17T03:36:45.340900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257397+0000","last_change":"2024-09-17T03:36:44.268310+0000","last_active":"2024-09-17T03:36:45.257397+0000","last_peered":"2024-09-17T03:36:45.257397+0000","last_clean":"2024-09-17T03:36:45.257397+0000","last_became_active":"2024-09-17T03:36:44.265610+0000","last_became_peered":"2024-09-17T03:36:44.265610+0000","last_unstale":"2024-09-17T03:36:45.257397+0000","last_undegraded":"2024-09-17T03:36:45.257397+0000","last_fullsized":"2024-09-17T03:36:45.257397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:24.017008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257820+0000","last_change":"2024-09-17T03:36:43.244589+0000","last_active":"2024-09-17T03:36:45.257820+0000","last_peered":"2024-09-17T03:36:45.257820+0000","last_clean":"2024-09-17T03:36:45.257820+0000","last_became_active":"2024-09-17T03:36:43.244277+0000","last_became_peered":"2024-09-17T03:36:43.244277+0000","last_unstale":"2024-09-17T03:36:45.257820+0000","last_undegraded":"2024-09-17T03:36:45.257820+0000","last_fullsized":"2024-09-17T03:36:45.257820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258699+0000","last_change":"2024-09-17T03:36:44.259012+0000","last_active":"2024-09-17T03:36:45.258699+0000","last_peered":"2024-09-17T03:36:45.258699+0000","last_clean":"2024-09-17T03:36:45.258699+0000","last_became_active":"2024-09-17T03:36:44.258013+0000","last_became_peered":"2024-09-17T03:36:44.258013+0000","last_unstale":"2024-09-17T03:36:45.258699+0000","last_undegraded":"2024-09-17T03:36:45.258699+0000","last_fullsized":"2024-09-17T03:36:45.258699+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:37.644719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257542+0000","last_change":"2024-09-17T03:36:43.238389+0000","last_active":"2024-09-17T03:36:45.257542+0000","last_peered":"2024-09-17T03:36:45.257542+0000","last_clean":"2024-09-17T03:36:45.257542+0000","last_became_active":"2024-09-17T03:36:43.236175+0000","last_became_peered":"2024-09-17T03:36:43.236175+0000","last_unstale":"2024-09-17T03:36:45.257542+0000","last_undegraded":"2024-09-17T03:36:45.257542+0000","last_fullsized":"2024-09-17T03:36:45.257542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:03.593859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258015+0000","last_change":"2024-09-17T03:36:44.265627+0000","last_active":"2024-09-17T03:36:45.258015+0000","last_peered":"2024-09-17T03:36:45.258015+0000","last_clean":"2024-09-17T03:36:45.258015+0000","last_became_active":"2024-09-17T03:36:44.265268+0000","last_became_peered":"2024-09-17T03:36:44.265268+0000","last_unstale":"2024-09-17T03:36:45.258015+0000","last_undegraded":"2024-09-17T03:36:45.258015+0000","last_fullsized":"2024-09-17T03:36:45.258015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:56.232153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340576+0000","last_change":"2024-09-17T03:36:43.243254+0000","last_active":"2024-09-17T03:36:45.340576+0000","last_peered":"2024-09-17T03:36:45.340576+0000","last_clean":"2024-09-17T03:36:45.340576+0000","last_became_active":"2024-09-17T03:36:43.242906+0000","last_became_peered":"2024-09-17T03:36:43.242906+0000","last_unstale":"2024-09-17T03:36:45.340576+0000","last_undegraded":"2024-09-17T03:36:45.340576+0000","last_fullsized":"2024-09-17T03:36:45.340576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256261+0000","last_change":"2024-09-17T03:36:44.250908+0000","last_active":"2024-09-17T03:36:45.256261+0000","last_peered":"2024-09-17T03:36:45.256261+0000","last_clean":"2024-09-17T03:36:45.256261+0000","last_became_active":"2024-09-17T03:36:44.250597+0000","last_became_peered":"2024-09-17T03:36:44.250597+0000","last_unstale":"2024-09-17T03:36:45.256261+0000","last_undegraded":"2024-09-17T03:36:45.256261+0000","last_fullsized":"2024-09-17T03:36:45.256261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:34.203214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340298+0000","last_change":"2024-09-17T03:36:43.239775+0000","last_active":"2024-09-17T03:36:45.340298+0000","last_peered":"2024-09-17T03:36:45.340298+0000","last_clean":"2024-09-17T03:36:45.340298+0000","last_became_active":"2024-09-17T03:36:43.239466+0000","last_became_peered":"2024-09-17T03:36:43.239466+0000","last_unstale":"2024-09-17T03:36:45.340298+0000","last_undegraded":"2024-09-17T03:36:45.340298+0000","last_fullsized":"2024-09-17T03:36:45.340298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:14.876381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265496+0000","last_change":"2024-09-17T03:36:44.257169+0000","last_active":"2024-09-17T03:36:45.265496+0000","last_peered":"2024-09-17T03:36:45.265496+0000","last_clean":"2024-09-17T03:36:45.265496+0000","last_became_active":"2024-09-17T03:36:44.256569+0000","last_became_peered":"2024-09-17T03:36:44.256569+0000","last_unstale":"2024-09-17T03:36:45.265496+0000","last_undegraded":"2024-09-17T03:36:45.265496+0000","last_fullsized":"2024-09-17T03:36:45.265496+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:36.847491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339665+0000","last_change":"2024-09-17T03:36:43.238069+0000","last_active":"2024-09-17T03:36:45.339665+0000","last_peered":"2024-09-17T03:36:45.339665+0000","last_clean":"2024-09-17T03:36:45.339665+0000","last_became_active":"2024-09-17T03:36:43.237720+0000","last_became_peered":"2024-09-17T03:36:43.237720+0000","last_unstale":"2024-09-17T03:36:45.339665+0000","last_undegraded":"2024-09-17T03:36:45.339665+0000","last_fullsized":"2024-09-17T03:36:45.339665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:46.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257884+0000","last_change":"2024-09-17T03:36:44.265836+0000","last_active":"2024-09-17T03:36:45.257884+0000","last_peered":"2024-09-17T03:36:45.257884+0000","last_clean":"2024-09-17T03:36:45.257884+0000","last_became_active":"2024-09-17T03:36:44.265525+0000","last_became_peered":"2024-09-17T03:36:44.265525+0000","last_unstale":"2024-09-17T03:36:45.257884+0000","last_undegraded":"2024-09-17T03:36:45.257884+0000","last_fullsized":"2024-09-17T03:36:45.257884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:08.571368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256577+0000","last_change":"2024-09-17T03:36:43.247308+0000","last_active":"2024-09-17T03:36:45.256577+0000","last_peered":"2024-09-17T03:36:45.256577+0000","last_clean":"2024-09-17T03:36:45.256577+0000","last_became_active":"2024-09-17T03:36:43.246995+0000","last_became_peered":"2024-09-17T03:36:43.246995+0000","last_unstale":"2024-09-17T03:36:45.256577+0000","last_undegraded":"2024-09-17T03:36:45.256577+0000","last_fullsized":"2024-09-17T03:36:45.256577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:25.438322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258114+0000","last_change":"2024-09-17T03:36:44.258467+0000","last_active":"2024-09-17T03:36:45.258114+0000","last_peered":"2024-09-17T03:36:45.258114+0000","last_clean":"2024-09-17T03:36:45.258114+0000","last_became_active":"2024-09-17T03:36:44.258054+0000","last_became_peered":"2024-09-17T03:36:44.258054+0000","last_unstale":"2024-09-17T03:36:45.258114+0000","last_undegraded":"2024-09-17T03:36:45.258114+0000","last_fullsized":"2024-09-17T03:36:45.258114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:53.739833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339566+0000","last_change":"2024-09-17T03:36:43.242724+0000","last_active":"2024-09-17T03:36:45.339566+0000","last_peered":"2024-09-17T03:36:45.339566+0000","last_clean":"2024-09-17T03:36:45.339566+0000","last_became_active":"2024-09-17T03:36:43.242438+0000","last_became_peered":"2024-09-17T03:36:43.242438+0000","last_unstale":"2024-09-17T03:36:45.339566+0000","last_undegraded":"2024-09-17T03:36:45.339566+0000","last_fullsized":"2024-09-17T03:36:45.339566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:51.471274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257742+0000","last_change":"2024-09-17T03:36:44.263729+0000","last_active":"2024-09-17T03:36:45.257742+0000","last_peered":"2024-09-17T03:36:45.257742+0000","last_clean":"2024-09-17T03:36:45.257742+0000","last_became_active":"2024-09-17T03:36:44.263448+0000","last_became_peered":"2024-09-17T03:36:44.263448+0000","last_unstale":"2024-09-17T03:36:45.257742+0000","last_undegraded":"2024-09-17T03:36:45.257742+0000","last_fullsized":"2024-09-17T03:36:45.257742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:37.282878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257555+0000","last_change":"2024-09-17T03:36:43.246866+0000","last_active":"2024-09-17T03:36:45.257555+0000","last_peered":"2024-09-17T03:36:45.257555+0000","last_clean":"2024-09-17T03:36:45.257555+0000","last_became_active":"2024-09-17T03:36:43.246475+0000","last_became_peered":"2024-09-17T03:36:43.246475+0000","last_unstale":"2024-09-17T03:36:45.257555+0000","last_undegraded":"2024-09-17T03:36:45.257555+0000","last_fullsized":"2024-09-17T03:36:45.257555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:48.456727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340631+0000","last_change":"2024-09-17T03:36:44.266455+0000","last_active":"2024-09-17T03:36:45.340631+0000","last_peered":"2024-09-17T03:36:45.340631+0000","last_clean":"2024-09-17T03:36:45.340631+0000","last_became_active":"2024-09-17T03:36:44.266153+0000","last_became_peered":"2024-09-17T03:36:44.266153+0000","last_unstale":"2024-09-17T03:36:45.340631+0000","last_undegraded":"2024-09-17T03:36:45.340631+0000","last_fullsized":"2024-09-17T03:36:45.340631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:01.286771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258504+0000","last_change":"2024-09-17T03:36:43.251663+0000","last_active":"2024-09-17T03:36:45.258504+0000","last_peered":"2024-09-17T03:36:45.258504+0000","last_clean":"2024-09-17T03:36:45.258504+0000","last_became_active":"2024-09-17T03:36:43.249590+0000","last_became_peered":"2024-09-17T03:36:43.249590+0000","last_unstale":"2024-09-17T03:36:45.258504+0000","last_undegraded":"2024-09-17T03:36:45.258504+0000","last_fullsized":"2024-09-17T03:36:45.258504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:28.331414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257802+0000","last_change":"2024-09-17T03:36:44.259992+0000","last_active":"2024-09-17T03:36:45.257802+0000","last_peered":"2024-09-17T03:36:45.257802+0000","last_clean":"2024-09-17T03:36:45.257802+0000","last_became_active":"2024-09-17T03:36:44.259512+0000","last_became_peered":"2024-09-17T03:36:44.259512+0000","last_unstale":"2024-09-17T03:36:45.257802+0000","last_undegraded":"2024-09-17T03:36:45.257802+0000","last_fullsized":"2024-09-17T03:36:45.257802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:57.312821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257931+0000","last_change":"2024-09-17T03:36:43.250402+0000","last_active":"2024-09-17T03:36:45.257931+0000","last_peered":"2024-09-17T03:36:45.257931+0000","last_clean":"2024-09-17T03:36:45.257931+0000","last_became_active":"2024-09-17T03:36:43.250094+0000","last_became_peered":"2024-09-17T03:36:43.250094+0000","last_unstale":"2024-09-17T03:36:45.257931+0000","last_undegraded":"2024-09-17T03:36:45.257931+0000","last_fullsized":"2024-09-17T03:36:45.257931+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:04.120350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340018+0000","last_change":"2024-09-17T03:36:44.256373+0000","last_active":"2024-09-17T03:36:45.340018+0000","last_peered":"2024-09-17T03:36:45.340018+0000","last_clean":"2024-09-17T03:36:45.340018+0000","last_became_active":"2024-09-17T03:36:44.256013+0000","last_became_peered":"2024-09-17T03:36:44.256013+0000","last_unstale":"2024-09-17T03:36:45.340018+0000","last_undegraded":"2024-09-17T03:36:45.340018+0000","last_fullsized":"2024-09-17T03:36:45.340018+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:05.669667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257531+0000","last_change":"2024-09-17T03:36:43.238750+0000","last_active":"2024-09-17T03:36:45.257531+0000","last_peered":"2024-09-17T03:36:45.257531+0000","last_clean":"2024-09-17T03:36:45.257531+0000","last_became_active":"2024-09-17T03:36:43.237712+0000","last_became_peered":"2024-09-17T03:36:43.237712+0000","last_unstale":"2024-09-17T03:36:45.257531+0000","last_undegraded":"2024-09-17T03:36:45.257531+0000","last_fullsized":"2024-09-17T03:36:45.257531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:31.004371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256461+0000","last_change":"2024-09-17T03:36:44.257208+0000","last_active":"2024-09-17T03:36:45.256461+0000","last_peered":"2024-09-17T03:36:45.256461+0000","last_clean":"2024-09-17T03:36:45.256461+0000","last_became_active":"2024-09-17T03:36:44.256776+0000","last_became_peered":"2024-09-17T03:36:44.256776+0000","last_unstale":"2024-09-17T03:36:45.256461+0000","last_undegraded":"2024-09-17T03:36:45.256461+0000","last_fullsized":"2024-09-17T03:36:45.256461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:52.227091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256866+0000","last_change":"2024-09-17T03:36:43.246552+0000","last_active":"2024-09-17T03:36:45.256866+0000","last_peered":"2024-09-17T03:36:45.256866+0000","last_clean":"2024-09-17T03:36:45.256866+0000","last_became_active":"2024-09-17T03:36:43.243938+0000","last_became_peered":"2024-09-17T03:36:43.243938+0000","last_unstale":"2024-09-17T03:36:45.256866+0000","last_undegraded":"2024-09-17T03:36:45.256866+0000","last_fullsized":"2024-09-17T03:36:45.256866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:32.019221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256090+0000","last_change":"2024-09-17T03:36:44.257966+0000","last_active":"2024-09-17T03:36:45.256090+0000","last_peered":"2024-09-17T03:36:45.256090+0000","last_clean":"2024-09-17T03:36:45.256090+0000","last_became_active":"2024-09-17T03:36:44.257627+0000","last_became_peered":"2024-09-17T03:36:44.257627+0000","last_unstale":"2024-09-17T03:36:45.256090+0000","last_undegraded":"2024-09-17T03:36:45.256090+0000","last_fullsized":"2024-09-17T03:36:45.256090+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:07.526657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257449+0000","last_change":"2024-09-17T03:36:43.242166+0000","last_active":"2024-09-17T03:36:45.257449+0000","last_peered":"2024-09-17T03:36:45.257449+0000","last_clean":"2024-09-17T03:36:45.257449+0000","last_became_active":"2024-09-17T03:36:43.241720+0000","last_became_peered":"2024-09-17T03:36:43.241720+0000","last_unstale":"2024-09-17T03:36:45.257449+0000","last_undegraded":"2024-09-17T03:36:45.257449+0000","last_fullsized":"2024-09-17T03:36:45.257449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:30.410210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265941+0000","last_change":"2024-09-17T03:36:44.253537+0000","last_active":"2024-09-17T03:36:45.265941+0000","last_peered":"2024-09-17T03:36:45.265941+0000","last_clean":"2024-09-17T03:36:45.265941+0000","last_became_active":"2024-09-17T03:36:44.253232+0000","last_became_peered":"2024-09-17T03:36:44.253232+0000","last_unstale":"2024-09-17T03:36:45.265941+0000","last_undegraded":"2024-09-17T03:36:45.265941+0000","last_fullsized":"2024-09-17T03:36:45.265941+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:20.976361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258034+0000","last_change":"2024-09-17T03:36:43.245321+0000","last_active":"2024-09-17T03:36:45.258034+0000","last_peered":"2024-09-17T03:36:45.258034+0000","last_clean":"2024-09-17T03:36:45.258034+0000","last_became_active":"2024-09-17T03:36:43.245000+0000","last_became_peered":"2024-09-17T03:36:43.245000+0000","last_unstale":"2024-09-17T03:36:45.258034+0000","last_undegraded":"2024-09-17T03:36:45.258034+0000","last_fullsized":"2024-09-17T03:36:45.258034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:06.451160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262584+0000","last_change":"2024-09-17T03:36:44.255583+0000","last_active":"2024-09-17T03:36:45.262584+0000","last_peered":"2024-09-17T03:36:45.262584+0000","last_clean":"2024-09-17T03:36:45.262584+0000","last_became_active":"2024-09-17T03:36:44.255259+0000","last_became_peered":"2024-09-17T03:36:44.255259+0000","last_unstale":"2024-09-17T03:36:45.262584+0000","last_undegraded":"2024-09-17T03:36:45.262584+0000","last_fullsized":"2024-09-17T03:36:45.262584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:14.932088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339312+0000","last_change":"2024-09-17T03:36:43.239640+0000","last_active":"2024-09-17T03:36:45.339312+0000","last_peered":"2024-09-17T03:36:45.339312+0000","last_clean":"2024-09-17T03:36:45.339312+0000","last_became_active":"2024-09-17T03:36:43.239321+0000","last_became_peered":"2024-09-17T03:36:43.239321+0000","last_unstale":"2024-09-17T03:36:45.339312+0000","last_undegraded":"2024-09-17T03:36:45.339312+0000","last_fullsized":"2024-09-17T03:36:45.339312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:30.410210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257073+0000","last_change":"2024-09-17T03:36:44.260816+0000","last_active":"2024-09-17T03:36:45.257073+0000","last_peered":"2024-09-17T03:36:45.257073+0000","last_clean":"2024-09-17T03:36:45.257073+0000","last_became_active":"2024-09-17T03:36:44.260481+0000","last_became_peered":"2024-09-17T03:36:44.260481+0000","last_unstale":"2024-09-17T03:36:45.257073+0000","last_undegraded":"2024-09-17T03:36:45.257073+0000","last_fullsized":"2024-09-17T03:36:45.257073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:04.179982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340101+0000","last_change":"2024-09-17T03:36:43.250977+0000","last_active":"2024-09-17T03:36:45.340101+0000","last_peered":"2024-09-17T03:36:45.340101+0000","last_clean":"2024-09-17T03:36:45.340101+0000","last_became_active":"2024-09-17T03:36:43.250638+0000","last_became_peered":"2024-09-17T03:36:43.250638+0000","last_unstale":"2024-09-17T03:36:45.340101+0000","last_undegraded":"2024-09-17T03:36:45.340101+0000","last_fullsized":"2024-09-17T03:36:45.340101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:54.928131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340247+0000","last_change":"2024-09-17T03:36:44.261046+0000","last_active":"2024-09-17T03:36:45.340247+0000","last_peered":"2024-09-17T03:36:45.340247+0000","last_clean":"2024-09-17T03:36:45.340247+0000","last_became_active":"2024-09-17T03:36:44.260749+0000","last_became_peered":"2024-09-17T03:36:44.260749+0000","last_unstale":"2024-09-17T03:36:45.340247+0000","last_undegraded":"2024-09-17T03:36:45.340247+0000","last_fullsized":"2024-09-17T03:36:45.340247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:47.077136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258597+0000","last_change":"2024-09-17T03:36:43.248274+0000","last_active":"2024-09-17T03:36:45.258597+0000","last_peered":"2024-09-17T03:36:45.258597+0000","last_clean":"2024-09-17T03:36:45.258597+0000","last_became_active":"2024-09-17T03:36:43.247287+0000","last_became_peered":"2024-09-17T03:36:43.247287+0000","last_unstale":"2024-09-17T03:36:45.258597+0000","last_undegraded":"2024-09-17T03:36:45.258597+0000","last_fullsized":"2024-09-17T03:36:45.258597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:08.860204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340228+0000","last_change":"2024-09-17T03:36:44.260449+0000","last_active":"2024-09-17T03:36:45.340228+0000","last_peered":"2024-09-17T03:36:45.340228+0000","last_clean":"2024-09-17T03:36:45.340228+0000","last_became_active":"2024-09-17T03:36:44.260163+0000","last_became_peered":"2024-09-17T03:36:44.260163+0000","last_unstale":"2024-09-17T03:36:45.340228+0000","last_undegraded":"2024-09-17T03:36:45.340228+0000","last_fullsized":"2024-09-17T03:36:45.340228+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:49.493460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262410+0000","last_change":"2024-09-17T03:36:43.242358+0000","last_active":"2024-09-17T03:36:45.262410+0000","last_peered":"2024-09-17T03:36:45.262410+0000","last_clean":"2024-09-17T03:36:45.262410+0000","last_became_active":"2024-09-17T03:36:43.241998+0000","last_became_peered":"2024-09-17T03:36:43.241998+0000","last_unstale":"2024-09-17T03:36:45.262410+0000","last_undegraded":"2024-09-17T03:36:45.262410+0000","last_fullsized":"2024-09-17T03:36:45.262410+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:02.266116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340839+0000","last_change":"2024-09-17T03:36:44.255735+0000","last_active":"2024-09-17T03:36:45.340839+0000","last_peered":"2024-09-17T03:36:45.340839+0000","last_clean":"2024-09-17T03:36:45.340839+0000","last_became_active":"2024-09-17T03:36:44.254710+0000","last_became_peered":"2024-09-17T03:36:44.254710+0000","last_unstale":"2024-09-17T03:36:45.340839+0000","last_undegraded":"2024-09-17T03:36:45.340839+0000","last_fullsized":"2024-09-17T03:36:45.340839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:14.497107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340523+0000","last_change":"2024-09-17T03:36:43.246790+0000","last_active":"2024-09-17T03:36:45.340523+0000","last_peered":"2024-09-17T03:36:45.340523+0000","last_clean":"2024-09-17T03:36:45.340523+0000","last_became_active":"2024-09-17T03:36:43.246506+0000","last_became_peered":"2024-09-17T03:36:43.246506+0000","last_unstale":"2024-09-17T03:36:45.340523+0000","last_undegraded":"2024-09-17T03:36:45.340523+0000","last_fullsized":"2024-09-17T03:36:45.340523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:36.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257782+0000","last_change":"2024-09-17T03:36:44.251074+0000","last_active":"2024-09-17T03:36:45.257782+0000","last_peered":"2024-09-17T03:36:45.257782+0000","last_clean":"2024-09-17T03:36:45.257782+0000","last_became_active":"2024-09-17T03:36:44.249327+0000","last_became_peered":"2024-09-17T03:36:44.249327+0000","last_unstale":"2024-09-17T03:36:45.257782+0000","last_undegraded":"2024-09-17T03:36:45.257782+0000","last_fullsized":"2024-09-17T03:36:45.257782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:12.553359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340586+0000","last_change":"2024-09-17T03:36:43.244507+0000","last_active":"2024-09-17T03:36:45.340586+0000","last_peered":"2024-09-17T03:36:45.340586+0000","last_clean":"2024-09-17T03:36:45.340586+0000","last_became_active":"2024-09-17T03:36:43.244138+0000","last_became_peered":"2024-09-17T03:36:43.244138+0000","last_unstale":"2024-09-17T03:36:45.340586+0000","last_undegraded":"2024-09-17T03:36:45.340586+0000","last_fullsized":"2024-09-17T03:36:45.340586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:37.711102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255403+0000","last_change":"2024-09-17T03:36:44.253706+0000","last_active":"2024-09-17T03:36:45.255403+0000","last_peered":"2024-09-17T03:36:45.255403+0000","last_clean":"2024-09-17T03:36:45.255403+0000","last_became_active":"2024-09-17T03:36:44.253406+0000","last_became_peered":"2024-09-17T03:36:44.253406+0000","last_unstale":"2024-09-17T03:36:45.255403+0000","last_undegraded":"2024-09-17T03:36:45.255403+0000","last_fullsized":"2024-09-17T03:36:45.255403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:59.355486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257330+0000","last_change":"2024-09-17T03:36:43.245115+0000","last_active":"2024-09-17T03:36:45.257330+0000","last_peered":"2024-09-17T03:36:45.257330+0000","last_clean":"2024-09-17T03:36:45.257330+0000","last_became_active":"2024-09-17T03:36:43.244800+0000","last_became_peered":"2024-09-17T03:36:43.244800+0000","last_unstale":"2024-09-17T03:36:45.257330+0000","last_undegraded":"2024-09-17T03:36:45.257330+0000","last_fullsized":"2024-09-17T03:36:45.257330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.662883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265952+0000","last_change":"2024-09-17T03:36:44.263078+0000","last_active":"2024-09-17T03:36:45.265952+0000","last_peered":"2024-09-17T03:36:45.265952+0000","last_clean":"2024-09-17T03:36:45.265952+0000","last_became_active":"2024-09-17T03:36:44.262753+0000","last_became_peered":"2024-09-17T03:36:44.262753+0000","last_unstale":"2024-09-17T03:36:45.265952+0000","last_undegraded":"2024-09-17T03:36:45.265952+0000","last_fullsized":"2024-09-17T03:36:45.265952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:52.628239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339783+0000","last_change":"2024-09-17T03:36:43.245006+0000","last_active":"2024-09-17T03:36:45.339783+0000","last_peered":"2024-09-17T03:36:45.339783+0000","last_clean":"2024-09-17T03:36:45.339783+0000","last_became_active":"2024-09-17T03:36:43.244723+0000","last_became_peered":"2024-09-17T03:36:43.244723+0000","last_unstale":"2024-09-17T03:36:45.339783+0000","last_undegraded":"2024-09-17T03:36:45.339783+0000","last_fullsized":"2024-09-17T03:36:45.339783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.555456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256781+0000","last_change":"2024-09-17T03:36:44.259397+0000","last_active":"2024-09-17T03:36:45.256781+0000","last_peered":"2024-09-17T03:36:45.256781+0000","last_clean":"2024-09-17T03:36:45.256781+0000","last_became_active":"2024-09-17T03:36:44.259042+0000","last_became_peered":"2024-09-17T03:36:44.259042+0000","last_unstale":"2024-09-17T03:36:45.256781+0000","last_undegraded":"2024-09-17T03:36:45.256781+0000","last_fullsized":"2024-09-17T03:36:45.256781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.440414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.255636+0000","last_change":"2024-09-17T03:36:43.246360+0000","last_active":"2024-09-17T03:36:45.255636+0000","last_peered":"2024-09-17T03:36:45.255636+0000","last_clean":"2024-09-17T03:36:45.255636+0000","last_became_active":"2024-09-17T03:36:43.243140+0000","last_became_peered":"2024-09-17T03:36:43.243140+0000","last_unstale":"2024-09-17T03:36:45.255636+0000","last_undegraded":"2024-09-17T03:36:45.255636+0000","last_fullsized":"2024-09-17T03:36:45.255636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:14.876381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262543+0000","last_change":"2024-09-17T03:36:44.265309+0000","last_active":"2024-09-17T03:36:45.262543+0000","last_peered":"2024-09-17T03:36:45.262543+0000","last_clean":"2024-09-17T03:36:45.262543+0000","last_became_active":"2024-09-17T03:36:44.264925+0000","last_became_peered":"2024-09-17T03:36:44.264925+0000","last_unstale":"2024-09-17T03:36:45.262543+0000","last_undegraded":"2024-09-17T03:36:45.262543+0000","last_fullsized":"2024-09-17T03:36:45.262543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:35.512783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258272+0000","last_change":"2024-09-17T03:36:43.249727+0000","last_active":"2024-09-17T03:36:45.258272+0000","last_peered":"2024-09-17T03:36:45.258272+0000","last_clean":"2024-09-17T03:36:45.258272+0000","last_became_active":"2024-09-17T03:36:43.249376+0000","last_became_peered":"2024-09-17T03:36:43.249376+0000","last_unstale":"2024-09-17T03:36:45.258272+0000","last_undegraded":"2024-09-17T03:36:45.258272+0000","last_fullsized":"2024-09-17T03:36:45.258272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:13.054687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266096+0000","last_change":"2024-09-17T03:36:44.269381+0000","last_active":"2024-09-17T03:36:45.266096+0000","last_peered":"2024-09-17T03:36:45.266096+0000","last_clean":"2024-09-17T03:36:45.266096+0000","last_became_active":"2024-09-17T03:36:44.264227+0000","last_became_peered":"2024-09-17T03:36:44.264227+0000","last_unstale":"2024-09-17T03:36:45.266096+0000","last_undegraded":"2024-09-17T03:36:45.266096+0000","last_fullsized":"2024-09-17T03:36:45.266096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:56.489758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.264284+0000","last_change":"2024-09-17T03:36:43.242092+0000","last_active":"2024-09-17T03:36:45.264284+0000","last_peered":"2024-09-17T03:36:45.264284+0000","last_clean":"2024-09-17T03:36:45.264284+0000","last_became_active":"2024-09-17T03:36:43.241759+0000","last_became_peered":"2024-09-17T03:36:43.241759+0000","last_unstale":"2024-09-17T03:36:45.264284+0000","last_undegraded":"2024-09-17T03:36:45.264284+0000","last_fullsized":"2024-09-17T03:36:45.264284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:30.046741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.340741+0000","last_change":"2024-09-17T03:36:44.273690+0000","last_active":"2024-09-17T03:36:45.340741+0000","last_peered":"2024-09-17T03:36:45.340741+0000","last_clean":"2024-09-17T03:36:45.340741+0000","last_became_active":"2024-09-17T03:36:44.273364+0000","last_became_peered":"2024-09-17T03:36:44.273364+0000","last_unstale":"2024-09-17T03:36:45.340741+0000","last_undegraded":"2024-09-17T03:36:45.340741+0000","last_fullsized":"2024-09-17T03:36:45.340741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:37.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262362+0000","last_change":"2024-09-17T03:36:43.233724+0000","last_active":"2024-09-17T03:36:45.262362+0000","last_peered":"2024-09-17T03:36:45.262362+0000","last_clean":"2024-09-17T03:36:45.262362+0000","last_became_active":"2024-09-17T03:36:43.232853+0000","last_became_peered":"2024-09-17T03:36:43.232853+0000","last_unstale":"2024-09-17T03:36:45.262362+0000","last_undegraded":"2024-09-17T03:36:45.262362+0000","last_fullsized":"2024-09-17T03:36:45.262362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:10.474554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.262290+0000","last_change":"2024-09-17T03:36:44.256195+0000","last_active":"2024-09-17T03:36:45.262290+0000","last_peered":"2024-09-17T03:36:45.262290+0000","last_clean":"2024-09-17T03:36:45.262290+0000","last_became_active":"2024-09-17T03:36:44.255895+0000","last_became_peered":"2024-09-17T03:36:44.255895+0000","last_unstale":"2024-09-17T03:36:45.262290+0000","last_undegraded":"2024-09-17T03:36:45.262290+0000","last_fullsized":"2024-09-17T03:36:45.262290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:54.588941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256997+0000","last_change":"2024-09-17T03:36:43.237705+0000","last_active":"2024-09-17T03:36:45.256997+0000","last_peered":"2024-09-17T03:36:45.256997+0000","last_clean":"2024-09-17T03:36:45.256997+0000","last_became_active":"2024-09-17T03:36:43.236308+0000","last_became_peered":"2024-09-17T03:36:43.236308+0000","last_unstale":"2024-09-17T03:36:45.256997+0000","last_undegraded":"2024-09-17T03:36:45.256997+0000","last_fullsized":"2024-09-17T03:36:45.256997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:35.939675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.257954+0000","last_change":"2024-09-17T03:36:44.251549+0000","last_active":"2024-09-17T03:36:45.257954+0000","last_peered":"2024-09-17T03:36:45.257954+0000","last_clean":"2024-09-17T03:36:45.257954+0000","last_became_active":"2024-09-17T03:36:44.249170+0000","last_became_peered":"2024-09-17T03:36:44.249170+0000","last_unstale":"2024-09-17T03:36:45.257954+0000","last_undegraded":"2024-09-17T03:36:45.257954+0000","last_fullsized":"2024-09-17T03:36:45.257954+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.234298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.266059+0000","last_change":"2024-09-17T03:36:43.250361+0000","last_active":"2024-09-17T03:36:45.266059+0000","last_peered":"2024-09-17T03:36:45.266059+0000","last_clean":"2024-09-17T03:36:45.266059+0000","last_became_active":"2024-09-17T03:36:43.250046+0000","last_became_peered":"2024-09-17T03:36:43.250046+0000","last_unstale":"2024-09-17T03:36:45.266059+0000","last_undegraded":"2024-09-17T03:36:45.266059+0000","last_fullsized":"2024-09-17T03:36:45.266059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:13.925305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258201+0000","last_change":"2024-09-17T03:36:44.245554+0000","last_active":"2024-09-17T03:36:45.258201+0000","last_peered":"2024-09-17T03:36:45.258201+0000","last_clean":"2024-09-17T03:36:45.258201+0000","last_became_active":"2024-09-17T03:36:44.243706+0000","last_became_peered":"2024-09-17T03:36:44.243706+0000","last_unstale":"2024-09-17T03:36:45.258201+0000","last_undegraded":"2024-09-17T03:36:45.258201+0000","last_fullsized":"2024-09-17T03:36:45.258201+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:57.050681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258133+0000","last_change":"2024-09-17T03:36:43.251317+0000","last_active":"2024-09-17T03:36:45.258133+0000","last_peered":"2024-09-17T03:36:45.258133+0000","last_clean":"2024-09-17T03:36:45.258133+0000","last_became_active":"2024-09-17T03:36:43.250948+0000","last_became_peered":"2024-09-17T03:36:43.250948+0000","last_unstale":"2024-09-17T03:36:45.258133+0000","last_undegraded":"2024-09-17T03:36:45.258133+0000","last_fullsized":"2024-09-17T03:36:45.258133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:14.413534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265908+0000","last_change":"2024-09-17T03:36:44.254879+0000","last_active":"2024-09-17T03:36:45.265908+0000","last_peered":"2024-09-17T03:36:45.265908+0000","last_clean":"2024-09-17T03:36:45.265908+0000","last_became_active":"2024-09-17T03:36:44.254211+0000","last_became_peered":"2024-09-17T03:36:44.254211+0000","last_unstale":"2024-09-17T03:36:45.265908+0000","last_undegraded":"2024-09-17T03:36:45.265908+0000","last_fullsized":"2024-09-17T03:36:45.265908+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:25.422746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.256342+0000","last_change":"2024-09-17T03:36:43.247619+0000","last_active":"2024-09-17T03:36:45.256342+0000","last_peered":"2024-09-17T03:36:45.256342+0000","last_clean":"2024-09-17T03:36:45.256342+0000","last_became_active":"2024-09-17T03:36:43.247248+0000","last_became_peered":"2024-09-17T03:36:43.247248+0000","last_unstale":"2024-09-17T03:36:45.256342+0000","last_undegraded":"2024-09-17T03:36:45.256342+0000","last_fullsized":"2024-09-17T03:36:45.256342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:39.124865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.258159+0000","last_change":"2024-09-17T03:36:44.250558+0000","last_active":"2024-09-17T03:36:45.258159+0000","last_peered":"2024-09-17T03:36:45.258159+0000","last_clean":"2024-09-17T03:36:45.258159+0000","last_became_active":"2024-09-17T03:36:44.250256+0000","last_became_peered":"2024-09-17T03:36:44.250256+0000","last_unstale":"2024-09-17T03:36:45.258159+0000","last_undegraded":"2024-09-17T03:36:45.258159+0000","last_fullsized":"2024-09-17T03:36:45.258159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:43.215636+0000","last_clean_scrub_stamp":"2024-09-17T03:36:43.215636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:16.391925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.265969+0000","last_change":"2024-09-17T03:36:43.250824+0000","last_active":"2024-09-17T03:36:45.265969+0000","last_peered":"2024-09-17T03:36:45.265969+0000","last_clean":"2024-09-17T03:36:45.265969+0000","last_became_active":"2024-09-17T03:36:43.250296+0000","last_became_peered":"2024-09-17T03:36:43.250296+0000","last_unstale":"2024-09-17T03:36:45.265969+0000","last_undegraded":"2024-09-17T03:36:45.265969+0000","last_fullsized":"2024-09-17T03:36:45.265969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:42.208852+0000","last_clean_scrub_stamp":"2024-09-17T03:36:42.208852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:34.505999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T03:36:45.339553+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:36:45.339553+0000","last_peered":"2024-09-17T03:36:45.339553+0000","last_clean":"2024-09-17T03:36:45.339553+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:36:45.339553+0000","last_undegraded":"2024-09-17T03:36:45.339553+0000","last_fullsized":"2024-09-17T03:36:45.339553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1052672,"data_stored":785732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":196976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":785172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":194874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":196518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:54.087 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:36:54.087 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:36:54.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.356+0000 7fe359000640 1 -- 172.21.15.121:0/2555970002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe338003a00 msgr2=0x7fe338003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.356+0000 7fe359000640 1 --2- 172.21.15.121:0/2555970002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe338003a00 0x7fe338003e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c290 tx=0x7fe338005830 comp rx=0 tx=0).stop 2024-09-17T03:36:54.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.356+0000 7fe352800640 1 -- 172.21.15.121:0/2555970002 reap_dead start 2024-09-17T03:36:54.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.357+0000 7fe359000640 1 -- 172.21.15.121:0/2555970002 shutdown_connections 2024-09-17T03:36:54.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.357+0000 7fe359000640 1 -- 172.21.15.121:0/2555970002 >> 172.21.15.121:0/2555970002 conn(0x7fe3540d0a30 msgr2=0x7fe3540d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:54.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.357+0000 7fe359000640 1 -- 172.21.15.121:0/2555970002 shutdown_connections 2024-09-17T03:36:54.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.357+0000 7fe359000640 1 -- 172.21.15.121:0/2555970002 wait complete. 2024-09-17T03:36:54.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.359+0000 7fe359000640 1 Processor -- start 2024-09-17T03:36:54.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.359+0000 7fe359000640 1 -- start start 2024-09-17T03:36:54.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.360+0000 7fe359000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe338003a00 0x7fe354150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.360+0000 7fe359000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541f52b0 0x7fe354150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.360+0000 7fe359000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe354151560 0x7fe3541f8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe359000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe35415acb0 con 0x7fe354151560 2024-09-17T03:36:54.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe359000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe35415ab30 con 0x7fe3541f52b0 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe359000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe35415ae30 con 0x7fe338003a00 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe352800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe354151560 0x7fe3541f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe351e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe338003a00 0x7fe354150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe349400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541f52b0 0x7fe354150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe351e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe338003a00 0x7fe354150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:51132/0 (socket says 172.21.15.121:51132) 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe351e00640 1 -- 172.21.15.121:0/1846038005 learned_addr learned my addr 172.21.15.121:0/1846038005 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe351e00640 1 -- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541f52b0 msgr2=0x7fe354150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe351e00640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541f52b0 0x7fe354150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe351e00640 1 -- 172.21.15.121:0/1846038005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe354151560 msgr2=0x7fe3541f8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe351e00640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe354151560 0x7fe3541f8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe351e00640 1 -- 172.21.15.121:0/1846038005 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3541f5a10 con 0x7fe338003a00 2024-09-17T03:36:54.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.361+0000 7fe352800640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe354151560 0x7fe3541f8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:54.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.362+0000 7fe351e00640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe338003a00 0x7fe354150fc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe34402b130 tx=0x7fe344006d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:54.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.362+0000 7fe34aa00640 1 -- 172.21.15.121:0/1846038005 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344031040 con 0x7fe338003a00 2024-09-17T03:36:54.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.362+0000 7fe34aa00640 1 -- 172.21.15.121:0/1846038005 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3440035f0 con 0x7fe338003a00 2024-09-17T03:36:54.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.362+0000 7fe359000640 1 -- 172.21.15.121:0/1846038005 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3541f5cf0 con 0x7fe338003a00 2024-09-17T03:36:54.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.362+0000 7fe34aa00640 1 -- 172.21.15.121:0/1846038005 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344003a00 con 0x7fe338003a00 2024-09-17T03:36:54.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.362+0000 7fe359000640 1 -- 172.21.15.121:0/1846038005 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35415e320 con 0x7fe338003a00 2024-09-17T03:36:54.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.363+0000 7fe359000640 1 -- 172.21.15.121:0/1846038005 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe35406f350 con 0x7fe338003a00 2024-09-17T03:36:54.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.365+0000 7fe34aa00640 1 -- 172.21.15.121:0/1846038005 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe344034070 con 0x7fe338003a00 2024-09-17T03:36:54.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.365+0000 7fe34aa00640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe330078b90 0x7fe33007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.366+0000 7fe34aa00640 1 -- 172.21.15.121:0/1846038005 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fe3440bb3b0 con 0x7fe338003a00 2024-09-17T03:36:54.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.366+0000 7fe349400640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe330078b90 0x7fe33007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.367+0000 7fe349400640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe330078b90 0x7fe33007b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe3540aeee0 tx=0x7fe33c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:54.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.370+0000 7fe34aa00640 1 -- 172.21.15.121:0/1846038005 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe344083840 con 0x7fe338003a00 2024-09-17T03:36:54.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.621+0000 7fe359000640 1 -- 172.21.15.121:0/1846038005 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe35415e840 con 0x7fe338003a00 2024-09-17T03:36:54.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.629+0000 7fe34aa00640 1 -- 172.21.15.121:0/1846038005 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7fe344083140 con 0x7fe338003a00 2024-09-17T03:36:54.628 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-17T03:36:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw== 2024-09-17T03:36:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-17T03:36:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-17T03:36:54.629 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:36:54.629 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-17T03:36:54.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 -- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe330078b90 msgr2=0x7fe33007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe330078b90 0x7fe33007b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe3540aeee0 tx=0x7fe33c005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:54.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 -- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe338003a00 msgr2=0x7fe354150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe338003a00 0x7fe354150fc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe34402b130 tx=0x7fe344006d70 comp rx=0 tx=0).stop 2024-09-17T03:36:54.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 -- 172.21.15.121:0/1846038005 shutdown_connections 2024-09-17T03:36:54.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe330078b90 0x7fe33007b0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe354151560 0x7fe3541f8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541f52b0 0x7fe354150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 --2- 172.21.15.121:0/1846038005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe338003a00 0x7fe354150fc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 -- 172.21.15.121:0/1846038005 >> 172.21.15.121:0/1846038005 conn(0x7fe3540d0a30 msgr2=0x7fe354151ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:54.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 -- 172.21.15.121:0/1846038005 shutdown_connections 2024-09-17T03:36:54.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.631+0000 7fe359000640 1 -- 172.21.15.121:0/1846038005 wait complete. 2024-09-17T03:36:54.656 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:54.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.876+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2926828700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1cc15cb20 msgr2=0x7fe1cc0cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.876+0000 7fe1d0a00640 1 --2- 172.21.15.121:0/2926828700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1cc15cb20 0x7fe1cc0cddc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0b2c90 tx=0x7fe1bc02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.876+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2926828700 shutdown_connections 2024-09-17T03:36:54.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.876+0000 7fe1d0a00640 1 --2- 172.21.15.121:0/2926828700 >> v2:172.21.15.176:3300/0 conn(0x7fe1cc0b4a20 0x7fe1cc0b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.876+0000 7fe1d0a00640 1 --2- 172.21.15.121:0/2926828700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1cc15cb20 0x7fe1cc0cddc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.876+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2926828700 >> 172.21.15.121:0/2926828700 conn(0x7fe1cc06f940 msgr2=0x7fe1cc0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:54.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.876+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2926828700 shutdown_connections 2024-09-17T03:36:54.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.876+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2926828700 wait complete. 2024-09-17T03:36:54.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.879+0000 7fe1d0a00640 1 Processor -- start 2024-09-17T03:36:54.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.879+0000 7fe1d0a00640 1 -- start start 2024-09-17T03:36:54.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.880+0000 7fe1d0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1cc0b4a20 0x7fe1cc151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.880+0000 7fe1d0a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1cc0cc8d0 0x7fe1cc1e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.880+0000 7fe1d0a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1cc15cb20 0x7fe1cc1e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.880+0000 7fe1d0a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc06d6c0 con 0x7fe1cc0cc8d0 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.880+0000 7fe1d0a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc06d540 con 0x7fe1cc15cb20 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.880+0000 7fe1d0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc06d840 con 0x7fe1cc0b4a20 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.880+0000 7fe1c9e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1cc0cc8d0 0x7fe1cc1e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.880+0000 7fe1ca800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1cc0b4a20 0x7fe1cc151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.880+0000 7fe1c9e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1cc0cc8d0 0x7fe1cc1e8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47664/0 (socket says 172.21.15.121:47664) 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.880+0000 7fe1c9e00640 1 -- 172.21.15.121:0/2465912413 learned_addr learned my addr 172.21.15.121:0/2465912413 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1cb200640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1cc15cb20 0x7fe1cc1e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1c9e00640 1 -- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1cc0b4a20 msgr2=0x7fe1cc151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1c9e00640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1cc0b4a20 0x7fe1cc151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1c9e00640 1 -- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1cc15cb20 msgr2=0x7fe1cc1e9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1c9e00640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1cc15cb20 0x7fe1cc1e9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1c9e00640 1 -- 172.21.15.121:0/2465912413 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc1f65a0 con 0x7fe1cc0cc8d0 2024-09-17T03:36:54.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1cb200640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1cc15cb20 0x7fe1cc1e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:54.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1c9e00640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1cc0cc8d0 0x7fe1cc1e8e30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800d720 tx=0x7fe1b800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:54.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1c2a00640 1 -- 172.21.15.121:0/2465912413 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8017070 con 0x7fe1cc0cc8d0 2024-09-17T03:36:54.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1c2a00640 1 -- 172.21.15.121:0/2465912413 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1b8009b10 con 0x7fe1cc0cc8d0 2024-09-17T03:36:54.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.881+0000 7fe1c2a00640 1 -- 172.21.15.121:0/2465912413 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8010460 con 0x7fe1cc0cc8d0 2024-09-17T03:36:54.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.882+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2465912413 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc1e6fd0 con 0x7fe1cc0cc8d0 2024-09-17T03:36:54.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.882+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2465912413 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc1e7590 con 0x7fe1cc0cc8d0 2024-09-17T03:36:54.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.883+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2465912413 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1cc06ab30 con 0x7fe1cc0cc8d0 2024-09-17T03:36:54.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.884+0000 7fe1c2a00640 1 -- 172.21.15.121:0/2465912413 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1b801a070 con 0x7fe1cc0cc8d0 2024-09-17T03:36:54.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.885+0000 7fe1c2a00640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe1ac078bc0 0x7fe1ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.886+0000 7fe1c2a00640 1 -- 172.21.15.121:0/2465912413 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fe1b809afa0 con 0x7fe1cc0cc8d0 2024-09-17T03:36:54.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.886+0000 7fe1ca800640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe1ac078bc0 0x7fe1ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.887+0000 7fe1ca800640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe1ac078bc0 0x7fe1ac07b0d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc033000 tx=0x7fe1bc004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:54.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:54.890+0000 7fe1c2a00640 1 -- 172.21.15.121:0/2465912413 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1b8062bf0 con 0x7fe1cc0cc8d0 2024-09-17T03:36:55.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.111+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2465912413 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1cc06dd60 con 0x7fe1cc0cc8d0 2024-09-17T03:36:55.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.112+0000 7fe1c2a00640 1 -- 172.21.15.121:0/2465912413 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7fe1b8067620 con 0x7fe1cc0cc8d0 2024-09-17T03:36:55.112 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:36:55.112 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"btime":"2024-09-17T03:36:47:258731+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3162771203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3162771203},{"type":"v1","addr":"172.21.15.176:6837","nonce":3162771203}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4101257140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4101257140},{"type":"v1","addr":"172.21.15.176:6836","nonce":4101257140}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/4075176322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4075176322},{"type":"v1","addr":"172.21.15.121:6834","nonce":4075176322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:43.718129+0000","modified":"2024-09-17T03:36:46.740327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3665568713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":3665568713},{"type":"v1","addr":"172.21.15.121:6835","nonce":3665568713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5019,"qdb_cluster":[5019]},"id":2}]} 2024-09-17T03:36:55.112 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-09-17T03:36:55.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.114+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe1ac078bc0 msgr2=0x7fe1ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.114+0000 7fe1d0a00640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe1ac078bc0 0x7fe1ac07b0d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc033000 tx=0x7fe1bc004730 comp rx=0 tx=0).stop 2024-09-17T03:36:55.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.114+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2465912413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1cc0cc8d0 msgr2=0x7fe1cc1e8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.114+0000 7fe1d0a00640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1cc0cc8d0 0x7fe1cc1e8e30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800d720 tx=0x7fe1b800dbe0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.114+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2465912413 shutdown_connections 2024-09-17T03:36:55.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.114+0000 7fe1d0a00640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1cc15cb20 0x7fe1cc1e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.114+0000 7fe1d0a00640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe1ac078bc0 0x7fe1ac07b0d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.114+0000 7fe1d0a00640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1cc0cc8d0 0x7fe1cc1e8e30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.114+0000 7fe1d0a00640 1 --2- 172.21.15.121:0/2465912413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1cc0b4a20 0x7fe1cc151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.114+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2465912413 >> 172.21.15.121:0/2465912413 conn(0x7fe1cc06f940 msgr2=0x7fe1cc15f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:55.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.115+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2465912413 shutdown_connections 2024-09-17T03:36:55.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.115+0000 7fe1d0a00640 1 -- 172.21.15.121:0/2465912413 wait complete. 2024-09-17T03:36:55.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:36:43.718129+0000', 'modified': '2024-09-17T03:36:46.740327+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5019}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5019': {'gid': 5019, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6835/3665568713', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6833', 'nonce': 3665568713}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 3665568713}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5019, 'qdb_cluster': [5019]} 2024-09-17T03:36:55.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:36:55.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:36:55.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.765+0000 7f3d68400640 1 -- 172.21.15.121:0/4196626867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d6006e500 msgr2=0x7f3d600ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.765+0000 7f3d68400640 1 --2- 172.21.15.121:0/4196626867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d6006e500 0x7f3d600ce510 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3d58005fd0 tx=0x7f3d5802aaa0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.765+0000 7f3d68400640 1 -- 172.21.15.121:0/4196626867 shutdown_connections 2024-09-17T03:36:55.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.765+0000 7f3d68400640 1 --2- 172.21.15.121:0/4196626867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d6006e500 0x7f3d600ce510 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.765+0000 7f3d68400640 1 --2- 172.21.15.121:0/4196626867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d600cc530 0x7f3d6015ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.765+0000 7f3d68400640 1 -- 172.21.15.121:0/4196626867 >> 172.21.15.121:0/4196626867 conn(0x7f3d600b1b90 msgr2=0x7f3d600b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:55.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.765+0000 7f3d68400640 1 -- 172.21.15.121:0/4196626867 shutdown_connections 2024-09-17T03:36:55.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.765+0000 7f3d68400640 1 -- 172.21.15.121:0/4196626867 wait complete. 2024-09-17T03:36:55.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.767+0000 7f3d68400640 1 Processor -- start 2024-09-17T03:36:55.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.767+0000 7f3d68400640 1 -- start start 2024-09-17T03:36:55.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d68400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d600af5b0 0x7f3d600c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d68400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d600cc530 0x7f3d6015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d68400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d600c5ad0 0x7f3d6015de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d68400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d600cede0 con 0x7f3d600cc530 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d68400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d600cec60 con 0x7f3d600af5b0 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d68400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3d600cef60 con 0x7f3d600c5ad0 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d65a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d600af5b0 0x7f3d600c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d65000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d600cc530 0x7f3d6015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d65a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d600af5b0 0x7f3d600c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:44786/0 (socket says 172.21.15.121:44786) 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d65a00640 1 -- 172.21.15.121:0/4186404633 learned_addr learned my addr 172.21.15.121:0/4186404633 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.769+0000 7f3d66400640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d600c5ad0 0x7f3d6015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d65000640 1 -- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d600c5ad0 msgr2=0x7f3d6015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d65000640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d600c5ad0 0x7f3d6015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d65000640 1 -- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d600af5b0 msgr2=0x7f3d600c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d65000640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d600af5b0 0x7f3d600c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d65000640 1 -- 172.21.15.121:0/4186404633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d600c3c70 con 0x7f3d600cc530 2024-09-17T03:36:55.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d65000640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d600cc530 0x7f3d6015d8c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3d60072560 tx=0x7f3d4c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:55.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d5d600640 1 -- 172.21.15.121:0/4186404633 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c017070 con 0x7f3d600cc530 2024-09-17T03:36:55.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d5d600640 1 -- 172.21.15.121:0/4186404633 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d4c0053c0 con 0x7f3d600cc530 2024-09-17T03:36:55.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d68400640 1 -- 172.21.15.121:0/4186404633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d600c3f50 con 0x7f3d600cc530 2024-09-17T03:36:55.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d5d600640 1 -- 172.21.15.121:0/4186404633 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c003850 con 0x7f3d600cc530 2024-09-17T03:36:55.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.770+0000 7f3d68400640 1 -- 172.21.15.121:0/4186404633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d600c4510 con 0x7f3d600cc530 2024-09-17T03:36:55.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.773+0000 7f3d5d600640 1 -- 172.21.15.121:0/4186404633 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d4c01a070 con 0x7f3d600cc530 2024-09-17T03:36:55.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.774+0000 7f3d5d600640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d40078b90 0x7f3d4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.774+0000 7f3d5d600640 1 -- 172.21.15.121:0/4186404633 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f3d4c09a0d0 con 0x7f3d600cc530 2024-09-17T03:36:55.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.774+0000 7f3d6f461740 1 Processor -- start 2024-09-17T03:36:55.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.774+0000 7f3d65a00640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d40078b90 0x7f3d4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.774+0000 7f3d6f461740 1 -- start start 2024-09-17T03:36:55.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.775+0000 7f3d65a00640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d40078b90 0x7f3d4007b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400bc00 tx=0x7f3d5400b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:55.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 0x5651426fa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x5651426faeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d6f461740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x565142654430 con 0x565142309590 2024-09-17T03:36:55.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d6f461740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5651426445d0 con 0x5651423013b0 2024-09-17T03:36:55.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d6f461740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x565142633a00 con 0x56514232a270 2024-09-17T03:36:55.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d65a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 0x5651426fa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d66400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d65000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x5651426faeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d65a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 0x5651426fa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:51180/0 (socket says 172.21.15.121:51180) 2024-09-17T03:36:55.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.776+0000 7f3d65a00640 1 -- 172.21.15.121:0/1504495123 learned_addr learned my addr 172.21.15.121:0/1504495123 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:55.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d66400640 1 -- 172.21.15.121:0/1504495123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 msgr2=0x5651426fa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:55.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d66400640 1 --2- 172.21.15.121:0/1504495123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 0x5651426fa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d66400640 1 -- 172.21.15.121:0/1504495123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 msgr2=0x5651426faeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:55.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d66400640 1 --2- 172.21.15.121:0/1504495123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x5651426faeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d66400640 1 -- 172.21.15.121:0/1504495123 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651425fc520 con 0x565142309590 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d65a00640 1 --2- 172.21.15.121:0/1504495123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 0x5651426fa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d65000640 1 --2- 172.21.15.121:0/1504495123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x5651426faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d66400640 1 --2- 172.21.15.121:0/1504495123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426caf60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3d58032000 tx=0x7f3d58004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd8217f059f001b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d52000640 1 -- 172.21.15.121:0/1504495123 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5802ecf0 con 0x565142309590 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d52000640 1 -- 172.21.15.121:0/1504495123 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d58045070 con 0x565142309590 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.777+0000 7f3d52000640 1 -- 172.21.15.121:0/1504495123 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58003bd0 con 0x565142309590 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.778+0000 7f3d6f461740 1 -- 172.21.15.121:0/1504495123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 msgr2=0x5651426caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.778+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1504495123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426caf60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3d58032000 tx=0x7f3d58004ab0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.778+0000 7f3d6f461740 1 -- 172.21.15.121:0/1504495123 shutdown_connections 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.778+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1504495123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426caf60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.778+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1504495123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x5651426faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.778+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1504495123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 0x5651426fa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.778+0000 7f3d6f461740 1 -- 172.21.15.121:0/1504495123 >> 172.21.15.121:0/1504495123 conn(0x56514231e3c0 msgr2=0x5651426d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:55.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.778+0000 7f3d6f461740 1 -- 172.21.15.121:0/1504495123 shutdown_connections 2024-09-17T03:36:55.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.778+0000 7f3d6f461740 1 -- 172.21.15.121:0/1504495123 wait complete. 2024-09-17T03:36:55.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.779+0000 7f3d6f461740 1 -- start start 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.779+0000 7f3d6f461740 1 Processor -- start 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x56514270fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 0x565142716820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d6f461740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5651425da330 con 0x565142309590 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d6f461740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x565142637810 con 0x5651423013b0 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d6f461740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5651423a4620 con 0x56514232a270 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d6f461740 10 client.0 _ll_register_callbacks cb 0x5651425df420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d65000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d65000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426e4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47706/0 (socket says 172.21.15.121:47706) 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d65000640 1 -- 172.21.15.121:0/3910978565 learned_addr learned my addr 172.21.15.121:0/3910978565 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d66400640 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 0x565142716820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.781+0000 7f3d65a00640 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x56514270fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d65000640 1 -- 172.21.15.121:0/3910978565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 msgr2=0x565142716820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d65000640 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 0x565142716820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d65000640 1 -- 172.21.15.121:0/3910978565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 msgr2=0x56514270fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d65000640 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x56514270fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d65000640 1 -- 172.21.15.121:0/3910978565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565142395850 con 0x565142309590 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d65000640 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426e4e80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c05ef00 tx=0x7f3d4c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203f995dddddd1e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d46a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d46a00640 1 -- 172.21.15.121:0/3910978565 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0666c0 con 0x565142309590 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d46a00640 1 -- 172.21.15.121:0/3910978565 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f3d4c066150 con 0x565142309590 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d6f461740 1 -- 172.21.15.121:0/3910978565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d58045070 con 0x565142309590 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d46a00640 1 -- 172.21.15.121:0/3910978565 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f3d4c082050 con 0x565142309590 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d6f461740 10 client.5193 fetch_fsmap learned FSMap version 18 2024-09-17T03:36:55.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.782+0000 7f3d6f461740 1 -- 172.21.15.121:0/3910978565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56514240c6b0 con 0x565142309590 2024-09-17T03:36:55.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.783+0000 7f3d46a00640 1 -- 172.21.15.121:0/3910978565 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d58045070 con 0x565142309590 2024-09-17T03:36:55.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.783+0000 7f3d46a00640 1 -- 172.21.15.121:0/3910978565 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f3d4c05d5e0 con 0x565142309590 2024-09-17T03:36:55.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.783+0000 7f3d6f461740 10 client.5193 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T03:36:55.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.783+0000 7f3d6f461740 10 client.5193 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:36:55.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.783+0000 7f3d6f461740 20 client.5193 populate_metadata read hostname 'smithi121' 2024-09-17T03:36:55.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.783+0000 7f3d6f461740 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.121:6833/3665568713,v1:172.21.15.121:6835/3665568713] conn(0x5651422e8e40 0x5651426f6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.783+0000 7f3d6f461740 4 client.5193 mds_command: new command op to 5019 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:36:55.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.783+0000 7f3d6f461740 1 -- 172.21.15.121:0/3910978565 --> [v2:172.21.15.121:6833/3665568713,v1:172.21.15.121:6835/3665568713] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565142646520 con 0x5651422e8e40 2024-09-17T03:36:55.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.783+0000 7f3d65a00640 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.121:6833/3665568713,v1:172.21.15.121:6835/3665568713] conn(0x5651422e8e40 0x5651426f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.784+0000 7f3d65a00640 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.121:6833/3665568713,v1:172.21.15.121:6835/3665568713] conn(0x5651422e8e40 0x5651426f6450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a11edc83ddc5baf8 server_cookie=3e8a8af3f927c9fb in_seq=0 out_seq=0 2024-09-17T03:36:55.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.784+0000 7f3d46a00640 10 client.5193 ms_handle_connect on v2:172.21.15.121:6833/3665568713 2024-09-17T03:36:55.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.784+0000 7f3d46a00640 1 -- 172.21.15.121:0/3910978565 <== mds.0 v2:172.21.15.121:6833/3665568713 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565142646520 con 0x5651422e8e40 2024-09-17T03:36:55.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.784+0000 7f3d46a00640 10 client.5193 handle_command_reply: tid=0 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 client.5193 shutdown 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 -- 172.21.15.121:0/3910978565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 msgr2=0x5651426e4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426e4e80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c05ef00 tx=0x7f3d4c000ed0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 -- 172.21.15.121:0/3910978565 shutdown_connections 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.121:6833/3665568713,v1:172.21.15.121:6835/3665568713] conn(0x5651422e8e40 0x5651426f6450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56514232a270 0x565142716820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x565142309590 0x5651426e4e80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 --2- 172.21.15.121:0/3910978565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x56514270fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d46a00640 0 client.5193 ms_handle_reset on v2:172.21.15.121:6833/3665568713 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 -- 172.21.15.121:0/3910978565 >> 172.21.15.121:0/3910978565 conn(0x56514231e3c0 msgr2=0x5651426cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 -- 172.21.15.121:0/3910978565 shutdown_connections 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 1 -- 172.21.15.121:0/3910978565 wait complete. 2024-09-17T03:36:55.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.785+0000 7f3d6f461740 20 client.5193 trim_cache size 0 max 16384 2024-09-17T03:36:55.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.804+0000 7f3d6f461740 1 Processor -- start 2024-09-17T03:36:55.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.804+0000 7f3d6f461740 1 -- start start 2024-09-17T03:36:55.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.805+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x5651426cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.805+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x565142309590 0x5651426f6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.805+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d6f461740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d601f5e20 con 0x56514232a270 2024-09-17T03:36:55.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d6f461740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d601f5160 con 0x5651423013b0 2024-09-17T03:36:55.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d6f461740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3d601f57b0 con 0x565142309590 2024-09-17T03:36:55.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d66400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d66400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47712/0 (socket says 172.21.15.121:47712) 2024-09-17T03:36:55.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d66400640 1 -- 172.21.15.121:0/1465168863 learned_addr learned my addr 172.21.15.121:0/1465168863 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:55.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d65000640 1 --2- 172.21.15.121:0/1465168863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x565142309590 0x5651426f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d65a00640 1 --2- 172.21.15.121:0/1465168863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x5651426cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d66400640 1 -- 172.21.15.121:0/1465168863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x565142309590 msgr2=0x5651426f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:55.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d66400640 1 --2- 172.21.15.121:0/1465168863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x565142309590 0x5651426f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d66400640 1 -- 172.21.15.121:0/1465168863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 msgr2=0x5651426cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:55.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d66400640 1 --2- 172.21.15.121:0/1465168863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x5651426cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.806+0000 7f3d66400640 1 -- 172.21.15.121:0/1465168863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651427100b0 con 0x56514232a270 2024-09-17T03:36:55.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.807+0000 7f3d66400640 1 --2- 172.21.15.121:0/1465168863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009d90 tx=0x7f3d58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b649cf7c76a6091 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:55.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.807+0000 7f3d51600640 1 -- 172.21.15.121:0/1465168863 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5802ecf0 con 0x56514232a270 2024-09-17T03:36:55.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.807+0000 7f3d51600640 1 -- 172.21.15.121:0/1465168863 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d5804e030 con 0x56514232a270 2024-09-17T03:36:55.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.807+0000 7f3d51600640 1 -- 172.21.15.121:0/1465168863 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58003bd0 con 0x56514232a270 2024-09-17T03:36:55.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.807+0000 7f3d6f461740 1 -- 172.21.15.121:0/1465168863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 msgr2=0x5651426f6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.807+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1465168863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009d90 tx=0x7f3d58004a40 comp rx=0 tx=0).stop 2024-09-17T03:36:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.808+0000 7f3d6f461740 1 -- 172.21.15.121:0/1465168863 shutdown_connections 2024-09-17T03:36:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.808+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1465168863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6cb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.808+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1465168863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x565142309590 0x5651426f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.808+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1465168863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651423013b0 0x5651426cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.808+0000 7f3d6f461740 1 -- 172.21.15.121:0/1465168863 >> 172.21.15.121:0/1465168863 conn(0x56514231e3c0 msgr2=0x5651426ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.808+0000 7f3d6f461740 1 -- 172.21.15.121:0/1465168863 shutdown_connections 2024-09-17T03:36:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.808+0000 7f3d6f461740 1 -- 172.21.15.121:0/1465168863 wait complete. 2024-09-17T03:36:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.809+0000 7f3d6f461740 1 -- start start 2024-09-17T03:36:55.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.809+0000 7f3d6f461740 1 Processor -- start 2024-09-17T03:36:55.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.810+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651423013b0 0x5651427299d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.810+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x565142309590 0x565142716110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.810+0000 7f3d6f461740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.810+0000 7f3d6f461740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5651426f72f0 con 0x56514232a270 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.810+0000 7f3d6f461740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5651426f5790 con 0x565142309590 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.810+0000 7f3d6f461740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x565142728470 con 0x5651423013b0 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.810+0000 7f3d6f461740 10 client.0 _ll_register_callbacks cb 0x7f3d4c0616b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.810+0000 7f3d66400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.810+0000 7f3d65a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651423013b0 0x5651427299d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d66400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47714/0 (socket says 172.21.15.121:47714) 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d66400640 1 -- 172.21.15.121:0/1055124174 learned_addr learned my addr 172.21.15.121:0/1055124174 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d65000640 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x565142309590 0x565142716110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d66400640 1 -- 172.21.15.121:0/1055124174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651423013b0 msgr2=0x5651427299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d66400640 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651423013b0 0x5651427299d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d66400640 1 -- 172.21.15.121:0/1055124174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x565142309590 msgr2=0x565142716110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d66400640 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x565142309590 0x565142716110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d66400640 1 -- 172.21.15.121:0/1055124174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651426d0940 con 0x56514232a270 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d66400640 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6640 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009d60 tx=0x7f3d5802afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4809a607c2ec7bc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d46a00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d46a00640 1 -- 172.21.15.121:0/1055124174 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58003d80 con 0x56514232a270 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d46a00640 1 -- 172.21.15.121:0/1055124174 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f3d58004040 con 0x56514232a270 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.811+0000 7f3d6f461740 1 -- 172.21.15.121:0/1055124174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d5804e030 con 0x56514232a270 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d46a00640 1 -- 172.21.15.121:0/1055124174 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f3d58009800 con 0x56514232a270 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d6f461740 10 client.5199 fetch_fsmap learned FSMap version 18 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d6f461740 1 -- 172.21.15.121:0/1055124174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x565142716650 con 0x56514232a270 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d46a00640 1 -- 172.21.15.121:0/1055124174 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d5804e030 con 0x56514232a270 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d46a00640 1 -- 172.21.15.121:0/1055124174 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f3d58067020 con 0x56514232a270 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d6f461740 10 client.5199 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T03:36:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d6f461740 10 client.5199 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d6f461740 20 client.5199 populate_metadata read hostname 'smithi121' 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.121:6833/3665568713,v1:172.21.15.121:6835/3665568713] conn(0x5651427980a0 0x5651427984b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d6f461740 4 client.5199 mds_command: new command op to 5019 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d6f461740 1 -- 172.21.15.121:0/1055124174 --> [v2:172.21.15.121:6833/3665568713,v1:172.21.15.121:6835/3665568713] -- command(tid 0: {"prefix": "status"}) -- 0x5651426cffb0 con 0x5651427980a0 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.812+0000 7f3d65a00640 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.121:6833/3665568713,v1:172.21.15.121:6835/3665568713] conn(0x5651427980a0 0x5651427984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d65a00640 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.121:6833/3665568713,v1:172.21.15.121:6835/3665568713] conn(0x5651427980a0 0x5651427984b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c85c0dea05be21a6 server_cookie=3d310c6a4988d85a in_seq=0 out_seq=0 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d46a00640 10 client.5199 ms_handle_connect on v2:172.21.15.121:6833/3665568713 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d46a00640 1 -- 172.21.15.121:0/1055124174 <== mds.0 v2:172.21.15.121:6833/3665568713 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x5651426cffb0 con 0x5651427980a0 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d46a00640 10 client.5199 handle_command_reply: tid=0 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d6f461740 1 client.5199 shutdown 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d6f461740 1 -- 172.21.15.121:0/1055124174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 msgr2=0x5651426f6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6640 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009d60 tx=0x7f3d5802afa0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d6f461740 1 -- 172.21.15.121:0/1055124174 shutdown_connections 2024-09-17T03:36:55.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.121:6833/3665568713,v1:172.21.15.121:6835/3665568713] conn(0x5651427980a0 0x5651427984b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56514232a270 0x5651426f6640 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d46a00640 0 client.5199 ms_handle_reset on v2:172.21.15.121:6833/3665568713 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x565142309590 0x565142716110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d6f461740 1 --2- 172.21.15.121:0/1055124174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651423013b0 0x5651427299d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.813+0000 7f3d6f461740 1 -- 172.21.15.121:0/1055124174 >> 172.21.15.121:0/1055124174 conn(0x56514231e3c0 msgr2=0x5651426f3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d6f461740 1 -- 172.21.15.121:0/1055124174 shutdown_connections 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d6f461740 1 -- 172.21.15.121:0/1055124174 wait complete. 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d6f461740 20 client.5199 trim_cache size 0 max 16384 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:36:55.819 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:36:55.820 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 5019, 2024-09-17T03:36:55.820 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:36:55.820 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:36:55.820 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:36:55.820 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 11.567780458, 2024-09-17T03:36:55.820 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 18, 2024-09-17T03:36:55.820 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 40, 2024-09-17T03:36:55.820 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 40, 2024-09-17T03:36:55.820 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 19.355130355 2024-09-17T03:36:55.820 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:36:55.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d68400640 1 -- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d40078b90 msgr2=0x7f3d4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d68400640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d40078b90 0x7f3d4007b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400bc00 tx=0x7f3d5400b390 comp rx=0 tx=0).stop 2024-09-17T03:36:55.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d68400640 1 -- 172.21.15.121:0/4186404633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d600cc530 msgr2=0x7f3d6015d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d68400640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d600cc530 0x7f3d6015d8c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3d60072560 tx=0x7f3d4c00c820 comp rx=0 tx=0).stop 2024-09-17T03:36:55.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d68400640 1 -- 172.21.15.121:0/4186404633 shutdown_connections 2024-09-17T03:36:55.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d68400640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d600c5ad0 0x7f3d6015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d68400640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d40078b90 0x7f3d4007b0a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d68400640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d600cc530 0x7f3d6015d8c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d68400640 1 --2- 172.21.15.121:0/4186404633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d600af5b0 0x7f3d600c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.814+0000 7f3d68400640 1 -- 172.21.15.121:0/4186404633 >> 172.21.15.121:0/4186404633 conn(0x7f3d600b1b90 msgr2=0x7f3d6006fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:55.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.815+0000 7f3d68400640 1 -- 172.21.15.121:0/4186404633 shutdown_connections 2024-09-17T03:36:55.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:55.815+0000 7f3d68400640 1 -- 172.21.15.121:0/4186404633 wait complete. 2024-09-17T03:36:55.839 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:36:56.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.058+0000 7fd6a0800640 1 -- 172.21.15.121:0/1920264003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd698074cb0 msgr2=0x7fd698073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:56.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.058+0000 7fd6a0800640 1 --2- 172.21.15.121:0/1920264003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd698074cb0 0x7fd698073dd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd690005fd0 tx=0x7fd69002aa90 comp rx=0 tx=0).stop 2024-09-17T03:36:56.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.058+0000 7fd6a0800640 1 -- 172.21.15.121:0/1920264003 shutdown_connections 2024-09-17T03:36:56.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.058+0000 7fd6a0800640 1 --2- 172.21.15.121:0/1920264003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd69806e500 0x7fd6980cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.058+0000 7fd6a0800640 1 --2- 172.21.15.121:0/1920264003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd698074cb0 0x7fd698073dd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.058+0000 7fd6a0800640 1 -- 172.21.15.121:0/1920264003 >> 172.21.15.121:0/1920264003 conn(0x7fd6980cca40 msgr2=0x7fd6980cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:56.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.058+0000 7fd6a0800640 1 -- 172.21.15.121:0/1920264003 shutdown_connections 2024-09-17T03:36:56.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.058+0000 7fd6a0800640 1 -- 172.21.15.121:0/1920264003 wait complete. 2024-09-17T03:36:56.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.061+0000 7fd6a0800640 1 Processor -- start 2024-09-17T03:36:56.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.061+0000 7fd6a0800640 1 -- start start 2024-09-17T03:36:56.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.062+0000 7fd6a0800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd698074cb0 0x7fd6980a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:56.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.062+0000 7fd6a0800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6980cbc10 0x7fd6981f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:56.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.062+0000 7fd6a0800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd69815b5f0 0x7fd69815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:56.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.062+0000 7fd6a0800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd69806f3a0 con 0x7fd69815b5f0 2024-09-17T03:36:56.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.062+0000 7fd6a0800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd69806f220 con 0x7fd6980cbc10 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.062+0000 7fd6a0800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd69806f520 con 0x7fd698074cb0 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.062+0000 7fd69e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd69815b5f0 0x7fd69815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.062+0000 7fd69e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd69815b5f0 0x7fd69815ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47730/0 (socket says 172.21.15.121:47730) 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.062+0000 7fd69e800640 1 -- 172.21.15.121:0/3000253697 learned_addr learned my addr 172.21.15.121:0/3000253697 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.063+0000 7fd69de00640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd698074cb0 0x7fd6980a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.063+0000 7fd69d400640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6980cbc10 0x7fd6981f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.063+0000 7fd69e800640 1 -- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd698074cb0 msgr2=0x7fd6980a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.063+0000 7fd69e800640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd698074cb0 0x7fd6980a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.063+0000 7fd69e800640 1 -- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6980cbc10 msgr2=0x7fd6981f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.063+0000 7fd69e800640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6980cbc10 0x7fd6981f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.063+0000 7fd69e800640 1 -- 172.21.15.121:0/3000253697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69815bf40 con 0x7fd69815b5f0 2024-09-17T03:36:56.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.063+0000 7fd69e800640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd69815b5f0 0x7fd69815ba00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd69400c940 tx=0x7fd69400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:56.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.063+0000 7fd68e000640 1 -- 172.21.15.121:0/3000253697 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694004460 con 0x7fd69815b5f0 2024-09-17T03:36:56.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.064+0000 7fd68e000640 1 -- 172.21.15.121:0/3000253697 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6940077a0 con 0x7fd69815b5f0 2024-09-17T03:36:56.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.064+0000 7fd68e000640 1 -- 172.21.15.121:0/3000253697 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694007c10 con 0x7fd69815b5f0 2024-09-17T03:36:56.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.064+0000 7fd6a0800640 1 -- 172.21.15.121:0/3000253697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6981f5920 con 0x7fd69815b5f0 2024-09-17T03:36:56.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.064+0000 7fd6a0800640 1 -- 172.21.15.121:0/3000253697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6981f5ee0 con 0x7fd69815b5f0 2024-09-17T03:36:56.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.065+0000 7fd6a0800640 1 -- 172.21.15.121:0/3000253697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6980745d0 con 0x7fd69815b5f0 2024-09-17T03:36:56.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.066+0000 7fd68e000640 1 -- 172.21.15.121:0/3000253697 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd6940035f0 con 0x7fd69815b5f0 2024-09-17T03:36:56.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.067+0000 7fd68e000640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd67c078b90 0x7fd67c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:56.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.067+0000 7fd68e000640 1 -- 172.21.15.121:0/3000253697 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd69409b4a0 con 0x7fd69815b5f0 2024-09-17T03:36:56.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.068+0000 7fd69de00640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd67c078b90 0x7fd67c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:56.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.069+0000 7fd69de00640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd67c078b90 0x7fd67c07b0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd690035000 tx=0x7fd690038040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:56.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.072+0000 7fd68e000640 1 -- 172.21.15.121:0/3000253697 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd6980745d0 con 0x7fd69815b5f0 2024-09-17T03:36:56.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.293+0000 7fd6a0800640 1 -- 172.21.15.121:0/3000253697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd69806fa60 con 0x7fd69815b5f0 2024-09-17T03:36:56.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.294+0000 7fd68e000640 1 -- 172.21.15.121:0/3000253697 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7fd69815bf40 con 0x7fd69815b5f0 2024-09-17T03:36:56.294 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:36:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 -- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd67c078b90 msgr2=0x7fd67c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd67c078b90 0x7fd67c07b0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd690035000 tx=0x7fd690038040 comp rx=0 tx=0).stop 2024-09-17T03:36:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 -- 172.21.15.121:0/3000253697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd69815b5f0 msgr2=0x7fd69815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd69815b5f0 0x7fd69815ba00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd69400c940 tx=0x7fd69400ce00 comp rx=0 tx=0).stop 2024-09-17T03:36:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 -- 172.21.15.121:0/3000253697 shutdown_connections 2024-09-17T03:36:56.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd67c078b90 0x7fd67c07b0a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd69815b5f0 0x7fd69815ba00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6980cbc10 0x7fd6981f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 --2- 172.21.15.121:0/3000253697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd698074cb0 0x7fd6980a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 -- 172.21.15.121:0/3000253697 >> 172.21.15.121:0/3000253697 conn(0x7fd6980cca40 msgr2=0x7fd69815f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 -- 172.21.15.121:0/3000253697 shutdown_connections 2024-09-17T03:36:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56.296+0000 7fd6a0800640 1 -- 172.21.15.121:0/3000253697 wait complete. 2024-09-17T03:36:56.321 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:36:56.321 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:36:56.321 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:36:56.321 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:36:56.321 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:56.321 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:36:56.321 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:36:56.321 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:36:56.321 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:36:56.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:56.322 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:36:56.357 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:56.358 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42640sec preferred_lft 42640sec 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:36:56.359 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:56.360 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:36:56.360 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:56.360 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:36:56.360 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:36:56.360 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:36:56.360 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:56.360 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:36:56.360 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:36:56.360 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:36:56.360 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:56.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:56.361 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:36:56.451 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:36:56.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:56.454 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:36:56.491 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:36:56.491 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:36:56.491 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:36:56.491 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:36:56.491 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:36:56.492 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:56.492 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:36:56.492 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:36:56.492 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:36:56.492 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:36:56.492 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:36:56.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:56.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:56.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:56.690 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:36:56.725 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:36:56.725 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:36:56.725 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:36:56.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:56.725 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:36:56.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:56.822 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:56.858 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:36:56.858 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:56.858 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:56.934 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:36:56.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:56.934 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:57.129 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:57.129 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:36:57.129 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:36:57.149 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:57.150 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:36:57.150 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:36:57.150 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:57.150 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:57.182 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:57.182 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:36:57.182 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:36:57.182 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:57.182 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:57.182 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:36:57.183 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:36:57.183 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:36:57.183 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:36:57.183 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:36:57.184 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:36:57.184 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:36:57.184 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:36:57.186 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:36:57.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:57.187 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:57.244 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:57.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:57.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:57.340 INFO:teuthology.orchestra.run.smithi121.stdout:client5146 2024-09-17T03:36:57.341 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:57.341 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:57.376 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:36:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.637+0000 7f9af4a00640 1 -- 172.21.15.121:0/3074871651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af00b2e60 msgr2=0x7f9af00b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.637+0000 7f9af4a00640 1 --2- 172.21.15.121:0/3074871651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af00b2e60 0x7f9af00b3270 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9af008d3b0 tx=0x7f9ae802aac0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.637+0000 7f9af4a00640 1 -- 172.21.15.121:0/3074871651 shutdown_connections 2024-09-17T03:36:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.637+0000 7f9af4a00640 1 --2- 172.21.15.121:0/3074871651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af00b2e60 0x7f9af00b3270 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.637+0000 7f9af4a00640 1 --2- 172.21.15.121:0/3074871651 >> v2:172.21.15.176:3300/0 conn(0x7f9af00cfe00 0x7f9af00d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.637+0000 7f9af4a00640 1 -- 172.21.15.121:0/3074871651 >> 172.21.15.121:0/3074871651 conn(0x7f9af00d4440 msgr2=0x7f9af00d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.637+0000 7f9af4a00640 1 -- 172.21.15.121:0/3074871651 shutdown_connections 2024-09-17T03:36:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.637+0000 7f9af4a00640 1 -- 172.21.15.121:0/3074871651 wait complete. 2024-09-17T03:36:57.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.639+0000 7f9af4a00640 1 Processor -- start 2024-09-17T03:36:57.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.639+0000 7f9af4a00640 1 -- start start 2024-09-17T03:36:57.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9af4a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af00b2e60 0x7f9af0159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:57.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9af4a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af00cfe00 0x7f9af01f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9af4a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af0162590 0x7f9af01f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9af4a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9af00b3930 con 0x7f9af00b2e60 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9af4a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9af00b37b0 con 0x7f9af00cfe00 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9af4a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9af00b3ab0 con 0x7f9af0162590 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af00b2e60 0x7f9af0159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af00b2e60 0x7f9af0159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47750/0 (socket says 172.21.15.121:47750) 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aede00640 1 -- 172.21.15.121:0/648462823 learned_addr learned my addr 172.21.15.121:0/648462823 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aed400640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af00cfe00 0x7f9af01f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aede00640 1 -- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af0162590 msgr2=0x7f9af01f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aee800640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af0162590 0x7f9af01f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aede00640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af0162590 0x7f9af01f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aede00640 1 -- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af00cfe00 msgr2=0x7f9af01f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aede00640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af00cfe00 0x7f9af01f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aede00640 1 -- 172.21.15.121:0/648462823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af01f9450 con 0x7f9af00b2e60 2024-09-17T03:36:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aed400640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af00cfe00 0x7f9af01f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.641+0000 7f9aee800640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af0162590 0x7f9af01f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.642+0000 7f9aede00640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af00b2e60 0x7f9af0159be0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000e790 tx=0x7f9ae000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.642+0000 7f9ae6000640 1 -- 172.21.15.121:0/648462823 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000eea0 con 0x7f9af00b2e60 2024-09-17T03:36:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.642+0000 7f9ae6000640 1 -- 172.21.15.121:0/648462823 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ae000cdb0 con 0x7f9af00b2e60 2024-09-17T03:36:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.642+0000 7f9af4a00640 1 -- 172.21.15.121:0/648462823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af01f9730 con 0x7f9af00b2e60 2024-09-17T03:36:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.642+0000 7f9ae6000640 1 -- 172.21.15.121:0/648462823 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0010690 con 0x7f9af00b2e60 2024-09-17T03:36:57.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.642+0000 7f9af4a00640 1 -- 172.21.15.121:0/648462823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af01f5a10 con 0x7f9af00b2e60 2024-09-17T03:36:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.643+0000 7f9af4a00640 1 -- 172.21.15.121:0/648462823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af00b3270 con 0x7f9af00b2e60 2024-09-17T03:36:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.644+0000 7f9ae6000640 1 -- 172.21.15.121:0/648462823 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ae0010830 con 0x7f9af00b2e60 2024-09-17T03:36:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.645+0000 7f9ae6000640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9ad0078b90 0x7f9ad007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.645+0000 7f9ae6000640 1 -- 172.21.15.121:0/648462823 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f9ae009b890 con 0x7f9af00b2e60 2024-09-17T03:36:57.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.646+0000 7f9aed400640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9ad0078b90 0x7f9ad007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:57.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.646+0000 7f9aed400640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9ad0078b90 0x7f9ad007b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0016a0 tx=0x7f9adc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:57.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.650+0000 7f9ae6000640 1 -- 172.21.15.121:0/648462823 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9ae0063bd0 con 0x7f9af00b2e60 2024-09-17T03:36:57.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.867+0000 7f9af4a00640 1 -- 172.21.15.121:0/648462823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9af00d4bd0 con 0x7f9af00b2e60 2024-09-17T03:36:57.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.868+0000 7f9ae6000640 1 -- 172.21.15.121:0/648462823 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f9ae00634d0 con 0x7f9af00b2e60 2024-09-17T03:36:57.869 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:36:57.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 -- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9ad0078b90 msgr2=0x7f9ad007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9ad0078b90 0x7f9ad007b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0016a0 tx=0x7f9adc009040 comp rx=0 tx=0).stop 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 -- 172.21.15.121:0/648462823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af00b2e60 msgr2=0x7f9af0159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af00b2e60 0x7f9af0159be0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000e790 tx=0x7f9ae000ec50 comp rx=0 tx=0).stop 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 -- 172.21.15.121:0/648462823 shutdown_connections 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af0162590 0x7f9af01f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af00cfe00 0x7f9af01f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9ad0078b90 0x7f9ad007b0a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 --2- 172.21.15.121:0/648462823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9af00b2e60 0x7f9af0159be0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 -- 172.21.15.121:0/648462823 >> 172.21.15.121:0/648462823 conn(0x7f9af00d4440 msgr2=0x7f9af006dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 -- 172.21.15.121:0/648462823 shutdown_connections 2024-09-17T03:36:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:57.870+0000 7f9af4a00640 1 -- 172.21.15.121:0/648462823 wait complete. 2024-09-17T03:36:57.892 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:36:57.892 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:36:57.892 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:36:57.892 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:36:57.892 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:36:57.892 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:36:57.893 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:36:57.893 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:36:57.893 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:36:57.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:57.893 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:36:57.933 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:57.934 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42636sec preferred_lft 42636sec 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::80c9:d6ff:fe9f:5926/64 scope link 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:57.935 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:36:57.936 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:36:57.936 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d4cd:10ff:feb7:d68f/64 scope link 2024-09-17T03:36:57.936 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:57.936 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:36:57.936 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether fe:db:9e:03:5a:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:36:57.936 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::fcdb:9eff:fe03:5a3e/64 scope link 2024-09-17T03:36:57.936 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:57.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:57.936 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:36:58.032 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:36:58.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:58.035 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:36:58.074 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:36:58.074 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:36:58.074 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:36:58.074 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:36:58.074 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:36:58.074 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:58.075 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:36:58.075 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:36:58.075 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:36:58.075 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:36:58.075 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:36:58.192 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:58.263 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:58.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:58.271 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:36:58.307 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:36:58.307 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:36:58.307 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:36:58.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:58.307 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T03:36:58.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:58.403 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:36:58.438 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:36:58.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:58.438 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:36:58.514 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:36:58.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:58.514 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:36:58.708 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:36:58.708 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:36:58.708 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:36:58.728 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:36:58.728 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:36:58.729 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:36:58.729 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:58.729 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:58.759 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:36:58.759 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:36:58.759 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:36:58.759 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:36:58.760 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:58.760 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:36:58.760 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:36:58.760 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:36:58.761 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:36:58.761 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:36:58.761 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:36:58.761 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:36:58.761 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:36:58.764 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:36:58.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:58.764 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:36:58.820 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:58.900 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:58.903 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:36:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:58.911 INFO:teuthology.orchestra.run.smithi176.stdout:client5217 2024-09-17T03:36:58.912 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:36:58.912 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:58.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-09-17T03:36:59.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.181+0000 7efec8400640 1 -- 172.21.15.121:0/2843273962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efec00cc530 msgr2=0x7efec015ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.181+0000 7efec8400640 1 --2- 172.21.15.121:0/2843273962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efec00cc530 0x7efec015ead0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efec01624c0 tx=0x7efeb402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.181+0000 7efec8400640 1 -- 172.21.15.121:0/2843273962 shutdown_connections 2024-09-17T03:36:59.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.181+0000 7efec8400640 1 --2- 172.21.15.121:0/2843273962 >> v2:172.21.15.176:3300/0 conn(0x7efec00af5b0 0x7efec006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.181+0000 7efec8400640 1 --2- 172.21.15.121:0/2843273962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efec00cc530 0x7efec015ead0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.181+0000 7efec8400640 1 -- 172.21.15.121:0/2843273962 >> 172.21.15.121:0/2843273962 conn(0x7efec00b1b90 msgr2=0x7efec00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:59.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.182+0000 7efec8400640 1 -- 172.21.15.121:0/2843273962 shutdown_connections 2024-09-17T03:36:59.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.182+0000 7efec8400640 1 -- 172.21.15.121:0/2843273962 wait complete. 2024-09-17T03:36:59.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.184+0000 7efec8400640 1 Processor -- start 2024-09-17T03:36:59.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.184+0000 7efec8400640 1 -- start start 2024-09-17T03:36:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.185+0000 7efec8400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efec006e330 0x7efec01f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.185+0000 7efec8400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efec00af5b0 0x7efec015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.185+0000 7efec8400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efec00cc530 0x7efec015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.185+0000 7efec8400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efec00cae00 con 0x7efec006e330 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.185+0000 7efec8400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efec00cbd60 con 0x7efec00cc530 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.185+0000 7efec8400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efec00caf80 con 0x7efec00af5b0 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec5a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efec006e330 0x7efec01f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec5a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efec006e330 0x7efec01f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47758/0 (socket says 172.21.15.121:47758) 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec5a00640 1 -- 172.21.15.121:0/2058523029 learned_addr learned my addr 172.21.15.121:0/2058523029 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec6400640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efec00cc530 0x7efec015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec5000640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efec00af5b0 0x7efec015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec5a00640 1 -- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efec00af5b0 msgr2=0x7efec015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec5a00640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efec00af5b0 0x7efec015af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec5a00640 1 -- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efec00cc530 msgr2=0x7efec015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec5a00640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efec00cc530 0x7efec015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec5a00640 1 -- 172.21.15.121:0/2058523029 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec00b5d00 con 0x7efec006e330 2024-09-17T03:36:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.186+0000 7efec5a00640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efec006e330 0x7efec01f52d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efeb4034040 tx=0x7efeb40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.187+0000 7efebd600640 1 -- 172.21.15.121:0/2058523029 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb403e030 con 0x7efec006e330 2024-09-17T03:36:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.187+0000 7efebd600640 1 -- 172.21.15.121:0/2058523029 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efeb4003db0 con 0x7efec006e330 2024-09-17T03:36:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.187+0000 7efec8400640 1 -- 172.21.15.121:0/2058523029 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec015a1c0 con 0x7efec006e330 2024-09-17T03:36:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.187+0000 7efebd600640 1 -- 172.21.15.121:0/2058523029 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4035040 con 0x7efec006e330 2024-09-17T03:36:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.187+0000 7efec8400640 1 -- 172.21.15.121:0/2058523029 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec015a780 con 0x7efec006e330 2024-09-17T03:36:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.188+0000 7efec8400640 1 -- 172.21.15.121:0/2058523029 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec00cb4a0 con 0x7efec006e330 2024-09-17T03:36:59.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.189+0000 7efebd600640 1 -- 172.21.15.121:0/2058523029 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efeb4041030 con 0x7efec006e330 2024-09-17T03:36:59.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.190+0000 7efebd600640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efea0078b90 0x7efea007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.190+0000 7efebd600640 1 -- 172.21.15.121:0/2058523029 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7efeb40bb970 con 0x7efec006e330 2024-09-17T03:36:59.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.190+0000 7efec5000640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efea0078b90 0x7efea007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.191+0000 7efec5000640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efea0078b90 0x7efea007b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efec015e6d0 tx=0x7efeac005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:59.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.195+0000 7efebd600640 1 -- 172.21.15.121:0/2058523029 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efeb40835c0 con 0x7efec006e330 2024-09-17T03:36:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.383+0000 7efec8400640 1 -- 172.21.15.121:0/2058523029 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) -- 0x7efec00aeb10 con 0x7efec006e330 2024-09-17T03:36:59.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.388+0000 7efebd600640 1 -- 172.21.15.121:0/2058523029 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7efeb4087ff0 con 0x7efec006e330 2024-09-17T03:36:59.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.391+0000 7efec8400640 1 -- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efea0078b90 msgr2=0x7efea007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.391+0000 7efec8400640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efea0078b90 0x7efea007b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efec015e6d0 tx=0x7efeac005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.391+0000 7efec8400640 1 -- 172.21.15.121:0/2058523029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efec006e330 msgr2=0x7efec01f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.391+0000 7efec8400640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efec006e330 0x7efec01f52d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efeb4034040 tx=0x7efeb40038a0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.392+0000 7efec8400640 1 -- 172.21.15.121:0/2058523029 shutdown_connections 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.392+0000 7efec8400640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efec00cc530 0x7efec015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.392+0000 7efec8400640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efec00af5b0 0x7efec015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.392+0000 7efec8400640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efea0078b90 0x7efea007b0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.392+0000 7efec8400640 1 --2- 172.21.15.121:0/2058523029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efec006e330 0x7efec01f52d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.392+0000 7efec8400640 1 -- 172.21.15.121:0/2058523029 >> 172.21.15.121:0/2058523029 conn(0x7efec00b1b90 msgr2=0x7efec006d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.392+0000 7efec8400640 1 -- 172.21.15.121:0/2058523029 shutdown_connections 2024-09-17T03:36:59.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.392+0000 7efec8400640 1 -- 172.21.15.121:0/2058523029 wait complete. 2024-09-17T03:36:59.414 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:59.414 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:59.449 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:36:59.449 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:59.525 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:36:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.785+0000 7fc88de00640 1 -- 172.21.15.121:0/3467511459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc88806ddf0 msgr2=0x7fc88806e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.785+0000 7fc88de00640 1 --2- 172.21.15.121:0/3467511459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc88806ddf0 0x7fc88806e200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc874005fd0 tx=0x7fc87402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.785+0000 7fc88de00640 1 -- 172.21.15.121:0/3467511459 shutdown_connections 2024-09-17T03:36:59.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.785+0000 7fc88de00640 1 --2- 172.21.15.121:0/3467511459 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8880cef00 0x7fc8880cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.785+0000 7fc88de00640 1 --2- 172.21.15.121:0/3467511459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc88806ddf0 0x7fc88806e200 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.785+0000 7fc88de00640 1 -- 172.21.15.121:0/3467511459 >> 172.21.15.121:0/3467511459 conn(0x7fc8880b1b90 msgr2=0x7fc8880b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:59.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.785+0000 7fc88de00640 1 -- 172.21.15.121:0/3467511459 shutdown_connections 2024-09-17T03:36:59.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.785+0000 7fc88de00640 1 -- 172.21.15.121:0/3467511459 wait complete. 2024-09-17T03:36:59.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.787+0000 7fc88de00640 1 Processor -- start 2024-09-17T03:36:59.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.788+0000 7fc88de00640 1 -- start start 2024-09-17T03:36:59.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.789+0000 7fc88de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc88806ddf0 0x7fc8881f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.789+0000 7fc88de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8880cef00 0x7fc8881f8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.789+0000 7fc88de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc888156a50 0x7fc88809fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.789+0000 7fc88de00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8880cf850 con 0x7fc8880cef00 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.789+0000 7fc88de00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc888161060 con 0x7fc88806ddf0 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.789+0000 7fc88de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8880cf9d0 con 0x7fc888156a50 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.789+0000 7fc886000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8880cef00 0x7fc8881f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.789+0000 7fc886000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8880cef00 0x7fc8881f8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47776/0 (socket says 172.21.15.121:47776) 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.789+0000 7fc886000640 1 -- 172.21.15.121:0/3991280724 learned_addr learned my addr 172.21.15.121:0/3991280724 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.789+0000 7fc886a00640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc88806ddf0 0x7fc8881f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.790+0000 7fc887400640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc888156a50 0x7fc88809fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.790+0000 7fc886000640 1 -- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc888156a50 msgr2=0x7fc88809fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.790+0000 7fc886000640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc888156a50 0x7fc88809fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.790+0000 7fc886000640 1 -- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc88806ddf0 msgr2=0x7fc8881f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.790+0000 7fc886000640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc88806ddf0 0x7fc8881f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.790+0000 7fc886000640 1 -- 172.21.15.121:0/3991280724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8881f9850 con 0x7fc8880cef00 2024-09-17T03:36:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.790+0000 7fc886000640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8880cef00 0x7fc8881f8f10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc874000c00 tx=0x7fc8740035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.790+0000 7fc87f400640 1 -- 172.21.15.121:0/3991280724 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87403e030 con 0x7fc8880cef00 2024-09-17T03:36:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.791+0000 7fc87f400640 1 -- 172.21.15.121:0/3991280724 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc874003ae0 con 0x7fc8880cef00 2024-09-17T03:36:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.791+0000 7fc87f400640 1 -- 172.21.15.121:0/3991280724 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874035040 con 0x7fc8880cef00 2024-09-17T03:36:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.791+0000 7fc88de00640 1 -- 172.21.15.121:0/3991280724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8880b5c50 con 0x7fc8880cef00 2024-09-17T03:36:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.791+0000 7fc88de00640 1 -- 172.21.15.121:0/3991280724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88809f0d0 con 0x7fc8880cef00 2024-09-17T03:36:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.792+0000 7fc88de00640 1 -- 172.21.15.121:0/3991280724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88806e200 con 0x7fc8880cef00 2024-09-17T03:36:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.793+0000 7fc87f400640 1 -- 172.21.15.121:0/3991280724 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc874041030 con 0x7fc8880cef00 2024-09-17T03:36:59.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.794+0000 7fc87f400640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc868078b90 0x7fc86807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.794+0000 7fc87f400640 1 -- 172.21.15.121:0/3991280724 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc8740bb440 con 0x7fc8880cef00 2024-09-17T03:36:59.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.795+0000 7fc886a00640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc868078b90 0x7fc86807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.796+0000 7fc886a00640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc868078b90 0x7fc86807b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc878000f60 tx=0x7fc878009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:59.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.799+0000 7fc87f400640 1 -- 172.21.15.121:0/3991280724 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc874083000 con 0x7fc8880cef00 2024-09-17T03:36:59.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.994+0000 7fc88de00640 1 -- 172.21.15.121:0/3991280724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc888156490 con 0x7fc8880cef00 2024-09-17T03:36:59.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.995+0000 7fc87f400640 1 -- 172.21.15.121:0/3991280724 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7fc874087a30 con 0x7fc8880cef00 2024-09-17T03:36:59.995 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:36:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 -- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc868078b90 msgr2=0x7fc86807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc868078b90 0x7fc86807b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc878000f60 tx=0x7fc878009040 comp rx=0 tx=0).stop 2024-09-17T03:36:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 -- 172.21.15.121:0/3991280724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8880cef00 msgr2=0x7fc8881f8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8880cef00 0x7fc8881f8f10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc874000c00 tx=0x7fc8740035f0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 -- 172.21.15.121:0/3991280724 shutdown_connections 2024-09-17T03:36:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc888156a50 0x7fc88809fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc868078b90 0x7fc86807b0a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8880cef00 0x7fc8881f8f10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 --2- 172.21.15.121:0/3991280724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc88806ddf0 0x7fc8881f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 -- 172.21.15.121:0/3991280724 >> 172.21.15.121:0/3991280724 conn(0x7fc8880b1b90 msgr2=0x7fc8880b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:59.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 -- 172.21.15.121:0/3991280724 shutdown_connections 2024-09-17T03:36:59.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:36:59.997+0000 7fc88de00640 1 -- 172.21.15.121:0/3991280724 wait complete. 2024-09-17T03:37:00.019 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:37:00.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:00.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:00.083 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:37:00.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:00.083 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:37:00.119 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:00.119 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:00.156 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:00.157 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:00.234 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:37:00.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.461+0000 7f1a7d200640 1 -- 172.21.15.121:0/2302771277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a7806e500 msgr2=0x7f1a780cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:00.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.461+0000 7f1a7d200640 1 --2- 172.21.15.121:0/2302771277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a7806e500 0x7f1a780cf290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009830 tx=0x7f1a6402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.462+0000 7f1a7d200640 1 -- 172.21.15.121:0/2302771277 shutdown_connections 2024-09-17T03:37:00.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.462+0000 7f1a7d200640 1 --2- 172.21.15.121:0/2302771277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a7806e500 0x7f1a780cf290 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.462+0000 7f1a7d200640 1 -- 172.21.15.121:0/2302771277 >> 172.21.15.121:0/2302771277 conn(0x7f1a780b1b90 msgr2=0x7f1a780b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:00.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.462+0000 7f1a7d200640 1 -- 172.21.15.121:0/2302771277 shutdown_connections 2024-09-17T03:37:00.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.462+0000 7f1a7d200640 1 -- 172.21.15.121:0/2302771277 wait complete. 2024-09-17T03:37:00.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.464+0000 7f1a7d200640 1 Processor -- start 2024-09-17T03:37:00.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.464+0000 7f1a7d200640 1 -- start start 2024-09-17T03:37:00.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.465+0000 7f1a7d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a780cf7d0 0x7f1a7809b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:00.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.465+0000 7f1a7d200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a7815fc50 0x7f1a7809d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:00.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.465+0000 7f1a7d200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a7809d750 0x7f1a780a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:00.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.465+0000 7f1a7d200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a780734a0 con 0x7f1a7815fc50 2024-09-17T03:37:00.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.465+0000 7f1a7d200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a780cfcf0 con 0x7f1a7809d750 2024-09-17T03:37:00.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.465+0000 7f1a7d200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1a78073620 con 0x7f1a780cf7d0 2024-09-17T03:37:00.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a7815fc50 0x7f1a7809d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:00.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a7815fc50 0x7f1a7809d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47780/0 (socket says 172.21.15.121:47780) 2024-09-17T03:37:00.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75400640 1 -- 172.21.15.121:0/258940579 learned_addr learned my addr 172.21.15.121:0/258940579 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:00.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a76800640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a7809d750 0x7f1a780a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:00.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75e00640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a780cf7d0 0x7f1a7809b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:00.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75400640 1 -- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a780cf7d0 msgr2=0x7f1a7809b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:00.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75400640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a780cf7d0 0x7f1a7809b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75400640 1 -- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a7809d750 msgr2=0x7f1a780a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:00.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75400640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a7809d750 0x7f1a780a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75400640 1 -- 172.21.15.121:0/258940579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a781f6a00 con 0x7f1a7815fc50 2024-09-17T03:37:00.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75e00640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a780cf7d0 0x7f1a7809b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:00.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.466+0000 7f1a75400640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a7815fc50 0x7f1a7809d210 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009950 tx=0x7f1a64033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.467+0000 7f1a6e000640 1 -- 172.21.15.121:0/258940579 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64005c90 con 0x7f1a7815fc50 2024-09-17T03:37:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.467+0000 7f1a6e000640 1 -- 172.21.15.121:0/258940579 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a64031e50 con 0x7f1a7815fc50 2024-09-17T03:37:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.467+0000 7f1a6e000640 1 -- 172.21.15.121:0/258940579 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64005280 con 0x7f1a7815fc50 2024-09-17T03:37:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.467+0000 7f1a7d200640 1 -- 172.21.15.121:0/258940579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a781f6ce0 con 0x7f1a7815fc50 2024-09-17T03:37:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.467+0000 7f1a7d200640 1 -- 172.21.15.121:0/258940579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a781f72a0 con 0x7f1a7815fc50 2024-09-17T03:37:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.468+0000 7f1a7d200640 1 -- 172.21.15.121:0/258940579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a780cf290 con 0x7f1a7815fc50 2024-09-17T03:37:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.469+0000 7f1a6e000640 1 -- 172.21.15.121:0/258940579 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a64005420 con 0x7f1a7815fc50 2024-09-17T03:37:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.471+0000 7f1a6e000640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a58078b90 0x7f1a5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.471+0000 7f1a6e000640 1 -- 172.21.15.121:0/258940579 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f1a640bbeb0 con 0x7f1a7815fc50 2024-09-17T03:37:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.471+0000 7f1a75e00640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a58078b90 0x7f1a5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.472+0000 7f1a75e00640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a58078b90 0x7f1a5807b0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1a68001120 tx=0x7f1a68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:00.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.475+0000 7f1a6e000640 1 -- 172.21.15.121:0/258940579 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1a6403f030 con 0x7f1a7815fc50 2024-09-17T03:37:00.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.673+0000 7f1a7d200640 1 -- 172.21.15.121:0/258940579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1a7815ebf0 con 0x7f1a7815fc50 2024-09-17T03:37:00.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.674+0000 7f1a6e000640 1 -- 172.21.15.121:0/258940579 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7f1a64083b10 con 0x7f1a7815fc50 2024-09-17T03:37:00.674 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:37:00.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 -- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a58078b90 msgr2=0x7f1a5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:00.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a58078b90 0x7f1a5807b0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1a68001120 tx=0x7f1a68009040 comp rx=0 tx=0).stop 2024-09-17T03:37:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 -- 172.21.15.121:0/258940579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a7815fc50 msgr2=0x7f1a7809d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a7815fc50 0x7f1a7809d210 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009950 tx=0x7f1a64033c20 comp rx=0 tx=0).stop 2024-09-17T03:37:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 -- 172.21.15.121:0/258940579 shutdown_connections 2024-09-17T03:37:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a7809d750 0x7f1a780a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a58078b90 0x7f1a5807b0a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a7815fc50 0x7f1a7809d210 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 --2- 172.21.15.121:0/258940579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a780cf7d0 0x7f1a7809b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 -- 172.21.15.121:0/258940579 >> 172.21.15.121:0/258940579 conn(0x7f1a780b1b90 msgr2=0x7f1a780b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.676+0000 7f1a7d200640 1 -- 172.21.15.121:0/258940579 shutdown_connections 2024-09-17T03:37:00.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:00.677+0000 7f1a7d200640 1 -- 172.21.15.121:0/258940579 wait complete. 2024-09-17T03:37:00.697 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:37:00.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:00.698 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:37:00.763 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:37:00.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:00.764 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:37:00.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:01.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.020+0000 7f7fed200640 1 -- 172.21.15.121:0/2978116872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe8073dd0 msgr2=0x7f7fe806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.020+0000 7f7fed200640 1 --2- 172.21.15.121:0/2978116872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe8073dd0 0x7f7fe806ddf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7fe815d980 tx=0x7f7fd402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.020+0000 7f7fed200640 1 -- 172.21.15.121:0/2978116872 shutdown_connections 2024-09-17T03:37:01.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.020+0000 7f7fed200640 1 --2- 172.21.15.121:0/2978116872 >> v2:172.21.15.176:3300/0 conn(0x7f7fe806e330 0x7f7fe806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.020+0000 7f7fed200640 1 --2- 172.21.15.121:0/2978116872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe8073dd0 0x7f7fe806ddf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.020+0000 7f7fed200640 1 -- 172.21.15.121:0/2978116872 >> 172.21.15.121:0/2978116872 conn(0x7f7fe80cca40 msgr2=0x7f7fe80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:01.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.020+0000 7f7fed200640 1 -- 172.21.15.121:0/2978116872 shutdown_connections 2024-09-17T03:37:01.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.020+0000 7f7fed200640 1 -- 172.21.15.121:0/2978116872 wait complete. 2024-09-17T03:37:01.022 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.022+0000 7f7fed200640 1 Processor -- start 2024-09-17T03:37:01.022 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.023+0000 7f7fed200640 1 -- start start 2024-09-17T03:37:01.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fed200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe806e330 0x7f7fe81e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fed200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe8073dd0 0x7f7fe8158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fed200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe8074cb0 0x7f7fe81e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fed200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe806f4a0 con 0x7f7fe8074cb0 2024-09-17T03:37:01.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fed200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe806f320 con 0x7f7fe806e330 2024-09-17T03:37:01.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fed200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe806f620 con 0x7f7fe8073dd0 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fe6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe8074cb0 0x7f7fe81e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fe5e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe806e330 0x7f7fe81e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fe6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe8074cb0 0x7f7fe81e6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47806/0 (socket says 172.21.15.121:47806) 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fe6800640 1 -- 172.21.15.121:0/2819189216 learned_addr learned my addr 172.21.15.121:0/2819189216 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.024+0000 7f7fe5400640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe8073dd0 0x7f7fe8158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fe6800640 1 -- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe8073dd0 msgr2=0x7f7fe8158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fe6800640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe8073dd0 0x7f7fe8158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fe6800640 1 -- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe806e330 msgr2=0x7f7fe81e5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fe6800640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe806e330 0x7f7fe81e5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fe6800640 1 -- 172.21.15.121:0/2819189216 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe81e62f0 con 0x7f7fe8074cb0 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fe5e00640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe806e330 0x7f7fe81e5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fe6800640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe8074cb0 0x7f7fe81e6a10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e990 tx=0x7f7fe000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fde000640 1 -- 172.21.15.121:0/2819189216 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0004d20 con 0x7f7fe8074cb0 2024-09-17T03:37:01.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fde000640 1 -- 172.21.15.121:0/2819189216 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fe000caa0 con 0x7f7fe8074cb0 2024-09-17T03:37:01.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fde000640 1 -- 172.21.15.121:0/2819189216 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0005020 con 0x7f7fe8074cb0 2024-09-17T03:37:01.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.025+0000 7f7fed200640 1 -- 172.21.15.121:0/2819189216 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe81f5aa0 con 0x7f7fe8074cb0 2024-09-17T03:37:01.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.026+0000 7f7fed200640 1 -- 172.21.15.121:0/2819189216 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe81f6060 con 0x7f7fe8074cb0 2024-09-17T03:37:01.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.027+0000 7f7fed200640 1 -- 172.21.15.121:0/2819189216 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe81f5810 con 0x7f7fe8074cb0 2024-09-17T03:37:01.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.028+0000 7f7fde000640 1 -- 172.21.15.121:0/2819189216 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fe00051c0 con 0x7f7fe8074cb0 2024-09-17T03:37:01.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.029+0000 7f7fde000640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc8078b90 0x7f7fc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.030+0000 7f7fde000640 1 -- 172.21.15.121:0/2819189216 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f7fe009b760 con 0x7f7fe8074cb0 2024-09-17T03:37:01.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.030+0000 7f7fe5e00640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc8078b90 0x7f7fc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.030+0000 7f7fe5e00640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc8078b90 0x7f7fc807b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7fe815a730 tx=0x7f7fd8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:01.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.034+0000 7f7fde000640 1 -- 172.21.15.121:0/2819189216 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7fe0016030 con 0x7f7fe8074cb0 2024-09-17T03:37:01.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.252+0000 7f7fed200640 1 -- 172.21.15.121:0/2819189216 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fe80ce500 con 0x7f7fe8074cb0 2024-09-17T03:37:01.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.252+0000 7f7fde000640 1 -- 172.21.15.121:0/2819189216 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7f7fe0063320 con 0x7f7fe8074cb0 2024-09-17T03:37:01.252 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:01.252 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"btime":"2024-09-17T03:36:47:258731+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3162771203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3162771203},{"type":"v1","addr":"172.21.15.176:6837","nonce":3162771203}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4101257140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4101257140},{"type":"v1","addr":"172.21.15.176:6836","nonce":4101257140}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/4075176322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4075176322},{"type":"v1","addr":"172.21.15.121:6834","nonce":4075176322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:43.718129+0000","modified":"2024-09-17T03:36:46.740327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3665568713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":3665568713},{"type":"v1","addr":"172.21.15.121:6835","nonce":3665568713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5019,"qdb_cluster":[5019]},"id":2}]} 2024-09-17T03:37:01.253 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-09-17T03:37:01.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 -- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc8078b90 msgr2=0x7f7fc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc8078b90 0x7f7fc807b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7fe815a730 tx=0x7f7fd8009040 comp rx=0 tx=0).stop 2024-09-17T03:37:01.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 -- 172.21.15.121:0/2819189216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe8074cb0 msgr2=0x7f7fe81e6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe8074cb0 0x7f7fe81e6a10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e990 tx=0x7f7fe000ee50 comp rx=0 tx=0).stop 2024-09-17T03:37:01.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 -- 172.21.15.121:0/2819189216 shutdown_connections 2024-09-17T03:37:01.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc8078b90 0x7f7fc807b0a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe8074cb0 0x7f7fe81e6a10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe8073dd0 0x7f7fe8158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 --2- 172.21.15.121:0/2819189216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe806e330 0x7f7fe81e5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 -- 172.21.15.121:0/2819189216 >> 172.21.15.121:0/2819189216 conn(0x7f7fe80cca40 msgr2=0x7f7fe815bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:01.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 -- 172.21.15.121:0/2819189216 shutdown_connections 2024-09-17T03:37:01.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.255+0000 7f7fed200640 1 -- 172.21.15.121:0/2819189216 wait complete. 2024-09-17T03:37:01.277 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-17T03:37:01.518 INFO:teuthology.orchestra.run.smithi121.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":23,"msgr_send_messages":25,"msgr_recv_bytes":6125,"msgr_send_bytes":18839,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.012299948,"msgr_running_send_time":0.002270667,"msgr_running_recv_time":0.004183365,"msgr_running_fast_dispatch_time":0.000737623,"msgr_send_messages_queue_lat":{"avgcount":24,"sum":0.095619854,"avgtime":0.003984160},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":95,"msgr_send_messages":87,"msgr_recv_bytes":135367,"msgr_send_bytes":51123,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.016319276,"msgr_running_send_time":0.006551516,"msgr_running_recv_time":0.014053969,"msgr_running_fast_dispatch_time":0.000260826,"msgr_send_messages_queue_lat":{"avgcount":86,"sum":0.063318833,"avgtime":0.000736265},"msgr_handle_ack_lat":{"avgcount":29,"sum":0.000010957,"avgtime":0.000000377},"msgr_recv_encrypted_bytes":126000,"msgr_send_encrypted_bytes":12368},"AsyncMessenger::Worker-2":{"msgr_recv_messages":30,"msgr_send_messages":33,"msgr_recv_bytes":8709,"msgr_send_bytes":73408,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.012530303,"msgr_running_send_time":0.001467482,"msgr_running_recv_time":0.010690273,"msgr_running_fast_dispatch_time":0.000378734,"msgr_send_messages_queue_lat":{"avgcount":32,"sum":0.263795774,"avgtime":0.008243617},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000002912,"avgtime":0.000000582},"msgr_recv_encrypted_bytes":2032,"msgr_send_encrypted_bytes":62304},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":62,"sum":0.002805442,"avgtime":0.000045249}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000047267,"avgtime":0.000023633}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.005153073,"avgtime":0.000177692},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":0,"caps":0,"subtrees":2,"traverse":55,"traverse_hit":53,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197031,"rdpos":0,"jlat":{"avgcount":5,"sum":0.013984165,"avgtime":0.002796833},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":109848,"heap":332230656},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":26,"sum":0.004533553,"avgtime":0.000174367},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000283642,"avgtime":0.000141821},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000335878,"avgtime":0.000335878},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":28,"average_load":14,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":217129,"buffer_anon_items":77,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53360,"mds_co_items":216,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":44,"op_send_bytes":13937,"op_resend":37,"op_reply":44,"op_latency":{"avgcount":44,"sum":0.829988899,"avgtime":0.018863384},"op_inflight":0,"oplen_avg":{"avgcount":44,"sum":68},"op":44,"op_r":0,"op_w":44,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":40,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":144,"get_sum":133173,"get_or_fail_fail":0,"get_or_fail_success":144,"take":0,"take_sum":0,"put":144,"put_sum":133173,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":13937,"put":44,"put_sum":13937,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":44,"take_sum":44,"put":44,"put_sum":44,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x56032b59b5f0":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2727,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":5,"put_sum":2727,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:37:01.519 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 6125, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 23, "msgr_running_fast_dispatch_time": 0.000737623, "msgr_running_recv_time": 0.004183365, "msgr_running_send_time": 0.002270667, "msgr_running_total_time": 0.012299948, "msgr_send_bytes": 18839, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 25, "msgr_send_messages_queue_lat": { "avgcount": 24, "avgtime": 0.00398416, "sum": 0.095619854 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 29, "avgtime": 3.77e-07, "sum": 1.0957e-05 }, "msgr_recv_bytes": 135367, "msgr_recv_encrypted_bytes": 126000, "msgr_recv_messages": 95, "msgr_running_fast_dispatch_time": 0.000260826, "msgr_running_recv_time": 0.014053969, "msgr_running_send_time": 0.006551516, "msgr_running_total_time": 0.016319276, "msgr_send_bytes": 51123, "msgr_send_encrypted_bytes": 12368, "msgr_send_messages": 87, "msgr_send_messages_queue_lat": { "avgcount": 86, "avgtime": 0.000736265, "sum": 0.063318833 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 5.82e-07, "sum": 2.912e-06 }, "msgr_recv_bytes": 8709, "msgr_recv_encrypted_bytes": 2032, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.000378734, "msgr_running_recv_time": 0.010690273, "msgr_running_send_time": 0.001467482, "msgr_running_total_time": 0.012530303, "msgr_send_bytes": 73408, "msgr_send_encrypted_bytes": 62304, "msgr_send_messages": 33, "msgr_send_messages_queue_lat": { "avgcount": 32, "avgtime": 0.008243617, "sum": 0.263795774 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 62, "avgtime": 4.5249e-05, "sum": 0.002805442 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 2.3633e-05, "sum": 4.7267e-05 }, "queue_len": 0 }, "mds": { "caps": 0, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 0, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000177692, "sum": 0.005153073 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 55, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 53, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002796833, "sum": 0.013984165 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197031 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 332230656, "ino": 13, "ino+": 13, "ino-": 0, "rss": 109848 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 26, "avgtime": 0.000174367, "sum": 0.004533553 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000141821, "sum": 0.000283642 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000335878, "sum": 0.000335878 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 14, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 28 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 217129, "buffer_anon_items": 77, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53360, "mds_co_items": 216, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 40, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 44, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 44, "avgtime": 0.018863384, "sum": 0.829988899 }, "op_pg": 0, "op_r": 0, "op_reply": 44, "op_resend": 37, "op_rmw": 0, "op_send": 44, "op_send_bytes": 13937, "op_w": 44, "oplen_avg": { "avgcount": 44, "sum": 68 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 144, "get_or_fail_fail": 0, "get_or_fail_success": 144, "get_started": 0, "get_sum": 133173, "max": 104857600, "put": 144, "put_sum": 133173, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 44, "put_sum": 13937, "take": 44, "take_sum": 13937, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 44, "put_sum": 44, "take": 44, "take_sum": 44, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x56032b59b5f0": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2727, "max": 3758096384, "put": 5, "put_sum": 2727, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:37:01.520 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:37:01.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.739+0000 7fd3cce00640 1 -- 172.21.15.121:0/2847418193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c806e500 msgr2=0x7fd3c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.739+0000 7fd3cce00640 1 --2- 172.21.15.121:0/2847418193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c806e500 0x7fd3c806ede0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0005fd0 tx=0x7fd3c002a940 comp rx=0 tx=0).stop 2024-09-17T03:37:01.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.739+0000 7fd3cce00640 1 -- 172.21.15.121:0/2847418193 shutdown_connections 2024-09-17T03:37:01.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.739+0000 7fd3cce00640 1 --2- 172.21.15.121:0/2847418193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c806e500 0x7fd3c806ede0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.739+0000 7fd3cce00640 1 -- 172.21.15.121:0/2847418193 >> 172.21.15.121:0/2847418193 conn(0x7fd3c80cca40 msgr2=0x7fd3c80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:01.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.740+0000 7fd3cce00640 1 -- 172.21.15.121:0/2847418193 shutdown_connections 2024-09-17T03:37:01.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.740+0000 7fd3cce00640 1 -- 172.21.15.121:0/2847418193 wait complete. 2024-09-17T03:37:01.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.742+0000 7fd3cce00640 1 Processor -- start 2024-09-17T03:37:01.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.742+0000 7fd3cce00640 1 -- start start 2024-09-17T03:37:01.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.743+0000 7fd3cce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8073dd0 0x7fd3c81f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.743+0000 7fd3cce00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8074cb0 0x7fd3c81f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.743+0000 7fd3cce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c8157c40 0x7fd3c8157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.743+0000 7fd3cce00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c806f6b0 con 0x7fd3c8157c40 2024-09-17T03:37:01.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.743+0000 7fd3cce00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c806f530 con 0x7fd3c8073dd0 2024-09-17T03:37:01.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.743+0000 7fd3cce00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c806f830 con 0x7fd3c8074cb0 2024-09-17T03:37:01.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3c6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c8157c40 0x7fd3c8157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3c6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c8157c40 0x7fd3c8157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47816/0 (socket says 172.21.15.121:47816) 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3c6800640 1 -- 172.21.15.121:0/3413878566 learned_addr learned my addr 172.21.15.121:0/3413878566 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3c5e00640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8073dd0 0x7fd3c81f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3bd400640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8074cb0 0x7fd3c81f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3c6800640 1 -- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8074cb0 msgr2=0x7fd3c81f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3c6800640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8074cb0 0x7fd3c81f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3c6800640 1 -- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8073dd0 msgr2=0x7fd3c81f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3c6800640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8073dd0 0x7fd3c81f8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3c6800640 1 -- 172.21.15.121:0/3413878566 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c81f5360 con 0x7fd3c8157c40 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3bd400640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8074cb0 0x7fd3c81f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.744+0000 7fd3c6800640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c8157c40 0x7fd3c8157380 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0006010 tx=0x7fd3c0031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.745+0000 7fd3bea00640 1 -- 172.21.15.121:0/3413878566 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c003e070 con 0x7fd3c8157c40 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.745+0000 7fd3bea00640 1 -- 172.21.15.121:0/3413878566 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3c0004540 con 0x7fd3c8157c40 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.745+0000 7fd3cce00640 1 -- 172.21.15.121:0/3413878566 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c80cdd30 con 0x7fd3c8157c40 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.745+0000 7fd3bea00640 1 -- 172.21.15.121:0/3413878566 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0043460 con 0x7fd3c8157c40 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.745+0000 7fd3cce00640 1 -- 172.21.15.121:0/3413878566 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c81583c0 con 0x7fd3c8157c40 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.746+0000 7fd3cce00640 1 -- 172.21.15.121:0/3413878566 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c806ede0 con 0x7fd3c8157c40 2024-09-17T03:37:01.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.747+0000 7fd3bea00640 1 -- 172.21.15.121:0/3413878566 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3c0043600 con 0x7fd3c8157c40 2024-09-17T03:37:01.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.748+0000 7fd3bea00640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3a4078b90 0x7fd3a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.748+0000 7fd3bea00640 1 -- 172.21.15.121:0/3413878566 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd3c00bcc40 con 0x7fd3c8157c40 2024-09-17T03:37:01.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.749+0000 7fd3c5e00640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3a4078b90 0x7fd3a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.749+0000 7fd3c5e00640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3a4078b90 0x7fd3a407b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd3c815a730 tx=0x7fd3b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:01.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.753+0000 7fd3bea00640 1 -- 172.21.15.121:0/3413878566 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd3c0084e50 con 0x7fd3c8157c40 2024-09-17T03:37:01.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.972+0000 7fd3cce00640 1 -- 172.21.15.121:0/3413878566 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd3c806dde0 con 0x7fd3c8157c40 2024-09-17T03:37:01.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.972+0000 7fd3bea00640 1 -- 172.21.15.121:0/3413878566 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7fd3c0084750 con 0x7fd3c8157c40 2024-09-17T03:37:01.973 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:37:01.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 -- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3a4078b90 msgr2=0x7fd3a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3a4078b90 0x7fd3a407b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd3c815a730 tx=0x7fd3b8009040 comp rx=0 tx=0).stop 2024-09-17T03:37:01.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 -- 172.21.15.121:0/3413878566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c8157c40 msgr2=0x7fd3c8157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c8157c40 0x7fd3c8157380 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0006010 tx=0x7fd3c0031e20 comp rx=0 tx=0).stop 2024-09-17T03:37:01.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 -- 172.21.15.121:0/3413878566 shutdown_connections 2024-09-17T03:37:01.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3a4078b90 0x7fd3a407b0a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c8157c40 0x7fd3c8157380 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8074cb0 0x7fd3c81f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 --2- 172.21.15.121:0/3413878566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8073dd0 0x7fd3c81f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 -- 172.21.15.121:0/3413878566 >> 172.21.15.121:0/3413878566 conn(0x7fd3c80cca40 msgr2=0x7fd3c806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:01.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 -- 172.21.15.121:0/3413878566 shutdown_connections 2024-09-17T03:37:01.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:01.975+0000 7fd3cce00640 1 -- 172.21.15.121:0/3413878566 wait complete. 2024-09-17T03:37:01.999 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:37:01.999 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:37:01.999 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:37:02.000 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:37:02.000 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:02.000 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:37:02.000 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:37:02.000 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:37:02.000 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:02.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:02.001 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:37:02.038 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:37:02.126 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:37:02.126 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:37:02.126 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:02.127 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:37:02.128 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:02.128 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:37:02.128 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42634sec preferred_lft 42634sec 2024-09-17T03:37:02.128 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:37:02.128 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:02.128 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:37:02.128 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:02.128 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:37:02.128 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:02.129 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:37:02.129 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:02.129 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:02.129 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:37:02.129 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:37:02.129 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:02.129 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:02.129 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:37:02.129 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:37:02.129 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:02.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:02.130 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:37:02.183 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:37:02.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:02.187 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:37:02.224 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:37:02.225 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:37:02.225 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:37:02.225 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:37:02.225 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:37:02.225 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:37:02.225 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:37:02.225 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:37:02.225 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:37:02.225 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:37:02.225 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:37:02.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:37:02.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:02.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:02.422 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:37:02.457 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:37:02.457 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:37:02.457 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:02.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:02.457 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:37:02.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:02.554 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:02.590 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:02.590 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:02.590 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:02.665 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:37:02.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:02.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:02.860 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:02.861 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:02.861 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:37:02.881 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:02.881 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:02.881 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:37:02.881 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:37:02.881 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:02.912 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:02.912 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:02.912 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:37:02.912 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:37:02.912 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:02.913 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:37:02.913 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:37:02.913 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:37:02.914 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:37:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:37:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:37:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:37:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:37:02.917 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:37:02.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:02.917 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:02.973 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:37:03.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:37:03.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:03.062 INFO:teuthology.orchestra.run.smithi121.stdout:client5191 2024-09-17T03:37:03.063 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:03.063 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:03.098 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-17T03:37:03.379 INFO:teuthology.orchestra.run.smithi121.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":24,"msgr_send_messages":26,"msgr_recv_bytes":6371,"msgr_send_bytes":19416,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.012506061,"msgr_running_send_time":0.002324913,"msgr_running_recv_time":0.004208855,"msgr_running_fast_dispatch_time":0.000767105,"msgr_send_messages_queue_lat":{"avgcount":25,"sum":0.095647415,"avgtime":0.003825896},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":100,"msgr_send_messages":92,"msgr_recv_bytes":136703,"msgr_send_bytes":53287,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.017308315,"msgr_running_send_time":0.007005244,"msgr_running_recv_time":0.014694044,"msgr_running_fast_dispatch_time":0.000260826,"msgr_send_messages_queue_lat":{"avgcount":91,"sum":0.063464258,"avgtime":0.000697409},"msgr_handle_ack_lat":{"avgcount":34,"sum":0.000013789,"avgtime":0.000000405},"msgr_recv_encrypted_bytes":126000,"msgr_send_encrypted_bytes":12368},"AsyncMessenger::Worker-2":{"msgr_recv_messages":30,"msgr_send_messages":34,"msgr_recv_bytes":8709,"msgr_send_bytes":77168,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.012620659,"msgr_running_send_time":0.001545597,"msgr_running_recv_time":0.010690273,"msgr_running_fast_dispatch_time":0.000378734,"msgr_send_messages_queue_lat":{"avgcount":33,"sum":0.263842832,"avgtime":0.007995237},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000002912,"avgtime":0.000000582},"msgr_recv_encrypted_bytes":2032,"msgr_send_encrypted_bytes":66064},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":64,"sum":0.002857051,"avgtime":0.000044641}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000047267,"avgtime":0.000023633}},"mds":{"request":33,"reply":33,"reply_latency":{"avgcount":33,"sum":0.005782606,"avgtime":0.000175230},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":62,"traverse_hit":59,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":9,"evex":0,"evtrm":0,"ev":9,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197290,"rdpos":0,"jlat":{"avgcount":6,"sum":0.016505475,"avgtime":0.002750912},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":3,"cap-":2,"rss":110232,"heap":332230656},"mds_server":{"dispatch_client_request":33,"dispatch_server_request":0,"handle_client_request":33,"handle_client_session":7,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":29,"sum":0.004970839,"avgtime":0.000171408},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":3,"sum":0.000475889,"avgtime":0.000158629},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000335878,"avgtime":0.000335878},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":3,"session_remove":2,"sessions_open":1,"sessions_stale":0,"total_load":31,"average_load":31,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":217129,"buffer_anon_items":77,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53360,"mds_co_items":216,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":45,"op_send_bytes":14196,"op_resend":37,"op_reply":45,"op_latency":{"avgcount":45,"sum":0.831988872,"avgtime":0.018488641},"op_inflight":0,"oplen_avg":{"avgcount":45,"sum":69},"op":45,"op_r":0,"op_w":45,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":6,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":40,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":150,"get_sum":134295,"get_or_fail_fail":0,"get_or_fail_success":150,"take":0,"take_sum":0,"put":150,"put_sum":134295,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":14196,"put":45,"put_sum":14196,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":45,"take_sum":45,"put":45,"put_sum":45,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x56032b59b5f0":{"val":0,"max":3758096384,"get_started":0,"get":9,"get_sum":2986,"get_or_fail_fail":0,"get_or_fail_success":9,"take":0,"take_sum":0,"put":6,"put_sum":2986,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:37:03.381 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 6371, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 24, "msgr_running_fast_dispatch_time": 0.000767105, "msgr_running_recv_time": 0.004208855, "msgr_running_send_time": 0.002324913, "msgr_running_total_time": 0.012506061, "msgr_send_bytes": 19416, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 26, "msgr_send_messages_queue_lat": { "avgcount": 25, "avgtime": 0.003825896, "sum": 0.095647415 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 34, "avgtime": 4.05e-07, "sum": 1.3789e-05 }, "msgr_recv_bytes": 136703, "msgr_recv_encrypted_bytes": 126000, "msgr_recv_messages": 100, "msgr_running_fast_dispatch_time": 0.000260826, "msgr_running_recv_time": 0.014694044, "msgr_running_send_time": 0.007005244, "msgr_running_total_time": 0.017308315, "msgr_send_bytes": 53287, "msgr_send_encrypted_bytes": 12368, "msgr_send_messages": 92, "msgr_send_messages_queue_lat": { "avgcount": 91, "avgtime": 0.000697409, "sum": 0.063464258 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 5.82e-07, "sum": 2.912e-06 }, "msgr_recv_bytes": 8709, "msgr_recv_encrypted_bytes": 2032, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.000378734, "msgr_running_recv_time": 0.010690273, "msgr_running_send_time": 0.001545597, "msgr_running_total_time": 0.012620659, "msgr_send_bytes": 77168, "msgr_send_encrypted_bytes": 66064, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 33, "avgtime": 0.007995237, "sum": 0.263842832 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 64, "avgtime": 4.4641e-05, "sum": 0.002857051 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 2.3633e-05, "sum": 4.7267e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 33, "reply_latency": { "avgcount": 33, "avgtime": 0.00017523, "sum": 0.005782606 }, "request": 33, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 62, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 59, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 9, "evadd": 9, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 6, "avgtime": 0.002750912, "sum": 0.016505475 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197290 }, "mds_mem": { "cap": 1, "cap+": 3, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 332230656, "ino": 13, "ino+": 13, "ino-": 0, "rss": 110232 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 33, "dispatch_server_request": 0, "handle_client_request": 33, "handle_client_session": 7, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 29, "avgtime": 0.000171408, "sum": 0.004970839 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 3, "avgtime": 0.000158629, "sum": 0.000475889 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000335878, "sum": 0.000335878 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 31, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 3, "session_count": 1, "session_remove": 2, "sessions_open": 1, "sessions_stale": 0, "total_load": 31 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 217129, "buffer_anon_items": 77, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53360, "mds_co_items": 216, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 40, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 45, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 45, "avgtime": 0.018488641, "sum": 0.831988872 }, "op_pg": 0, "op_r": 0, "op_reply": 45, "op_resend": 37, "op_rmw": 0, "op_send": 45, "op_send_bytes": 14196, "op_w": 45, "oplen_avg": { "avgcount": 45, "sum": 69 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 6, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 150, "get_or_fail_fail": 0, "get_or_fail_success": 150, "get_started": 0, "get_sum": 134295, "max": 104857600, "put": 150, "put_sum": 134295, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 45, "put_sum": 14196, "take": 45, "take_sum": 14196, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 45, "put_sum": 45, "take": 45, "take_sum": 45, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x56032b59b5f0": { "get": 9, "get_or_fail_fail": 0, "get_or_fail_success": 9, "get_started": 0, "get_sum": 2986, "max": 3758096384, "put": 6, "put_sum": 2986, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:37:03.381 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:03.381 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:03.418 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:03.418 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:03.494 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:37:03.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.752+0000 7fc2f5e00640 1 -- 172.21.15.121:0/4061229630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f00cf6d0 msgr2=0x7fc2f00b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.752+0000 7fc2f5e00640 1 --2- 172.21.15.121:0/4061229630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f00cf6d0 0x7fc2f00b3110 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8005fd0 tx=0x7fc2e802a9f0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.753+0000 7fc2f5e00640 1 -- 172.21.15.121:0/4061229630 shutdown_connections 2024-09-17T03:37:03.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.753+0000 7fc2f5e00640 1 --2- 172.21.15.121:0/4061229630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f00cf6d0 0x7fc2f00b3110 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.753+0000 7fc2f5e00640 1 --2- 172.21.15.121:0/4061229630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2f01605f0 0x7fc2f00702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.753+0000 7fc2f5e00640 1 -- 172.21.15.121:0/4061229630 >> 172.21.15.121:0/4061229630 conn(0x7fc2f00d05c0 msgr2=0x7fc2f006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:03.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.753+0000 7fc2f5e00640 1 -- 172.21.15.121:0/4061229630 shutdown_connections 2024-09-17T03:37:03.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.753+0000 7fc2f5e00640 1 -- 172.21.15.121:0/4061229630 wait complete. 2024-09-17T03:37:03.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.755+0000 7fc2f5e00640 1 Processor -- start 2024-09-17T03:37:03.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.755+0000 7fc2f5e00640 1 -- start start 2024-09-17T03:37:03.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.756+0000 7fc2f5e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2f00cc0e0 0x7fc2f01f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.756+0000 7fc2f5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f00cf6d0 0x7fc2f01313f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.756+0000 7fc2f5e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2f015b3f0 0x7fc2f012f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.756+0000 7fc2f5e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f00b3c30 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.756+0000 7fc2f5e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f00b3ab0 con 0x7fc2f015b3f0 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.756+0000 7fc2f5e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f00b3db0 con 0x7fc2f00cc0e0 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2efe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f00cf6d0 0x7fc2f01313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2efe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f00cf6d0 0x7fc2f01313f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47430/0 (socket says 172.21.15.121:47430) 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2efe00640 1 -- 172.21.15.121:0/168232405 learned_addr learned my addr 172.21.15.121:0/168232405 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2f4a00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2f00cc0e0 0x7fc2f01f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2f5400640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2f015b3f0 0x7fc2f012f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2efe00640 1 -- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2f00cc0e0 msgr2=0x7fc2f01f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2efe00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2f00cc0e0 0x7fc2f01f6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2efe00640 1 -- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2f015b3f0 msgr2=0x7fc2f012f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2efe00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2f015b3f0 0x7fc2f012f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2efe00640 1 -- 172.21.15.121:0/168232405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f01f63d0 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2f5400640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2f015b3f0 0x7fc2f012f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.757+0000 7fc2efe00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f00cf6d0 0x7fc2f01313f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00c9a0 tx=0x7fc2dc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.758+0000 7fc2ecc00640 1 -- 172.21.15.121:0/168232405 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc007bb0 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.758+0000 7fc2ecc00640 1 -- 172.21.15.121:0/168232405 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2dc007e40 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.758+0000 7fc2f5e00640 1 -- 172.21.15.121:0/168232405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f0131f40 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.758+0000 7fc2ecc00640 1 -- 172.21.15.121:0/168232405 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00f690 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.758+0000 7fc2f5e00640 1 -- 172.21.15.121:0/168232405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f01f6690 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.759+0000 7fc2f5e00640 1 -- 172.21.15.121:0/168232405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f00b4260 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.760+0000 7fc2ecc00640 1 -- 172.21.15.121:0/168232405 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc2dc00f830 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.761+0000 7fc2ecc00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc2d0078bc0 0x7fc2d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.761+0000 7fc2ecc00640 1 -- 172.21.15.121:0/168232405 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc2dc09b730 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.762+0000 7fc2f4a00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc2d0078bc0 0x7fc2d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.762+0000 7fc2f4a00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc2d0078bc0 0x7fc2d007b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4006fd0 tx=0x7fc2e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:03.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.766+0000 7fc2ecc00640 1 -- 172.21.15.121:0/168232405 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc2dc014030 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.959+0000 7fc2f5e00640 1 -- 172.21.15.121:0/168232405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc2f006f990 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.960+0000 7fc2ecc00640 1 -- 172.21.15.121:0/168232405 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7fc2dc063940 con 0x7fc2f00cf6d0 2024-09-17T03:37:03.959 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:37:03.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 -- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc2d0078bc0 msgr2=0x7fc2d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc2d0078bc0 0x7fc2d007b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4006fd0 tx=0x7fc2e4008040 comp rx=0 tx=0).stop 2024-09-17T03:37:03.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 -- 172.21.15.121:0/168232405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f00cf6d0 msgr2=0x7fc2f01313f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f00cf6d0 0x7fc2f01313f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00c9a0 tx=0x7fc2dc00ce60 comp rx=0 tx=0).stop 2024-09-17T03:37:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 -- 172.21.15.121:0/168232405 shutdown_connections 2024-09-17T03:37:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2f015b3f0 0x7fc2f012f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc2d0078bc0 0x7fc2d007b0d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f00cf6d0 0x7fc2f01313f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 --2- 172.21.15.121:0/168232405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2f00cc0e0 0x7fc2f01f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 -- 172.21.15.121:0/168232405 >> 172.21.15.121:0/168232405 conn(0x7fc2f00d05c0 msgr2=0x7fc2f006d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 -- 172.21.15.121:0/168232405 shutdown_connections 2024-09-17T03:37:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:03.962+0000 7fc2f5e00640 1 -- 172.21.15.121:0/168232405 wait complete. 2024-09-17T03:37:03.985 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:37:03.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:03.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:04.047 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:37:04.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:04.047 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:37:04.083 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2024-09-17T03:37:04.363 INFO:teuthology.orchestra.run.smithi121.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":25,"msgr_send_messages":27,"msgr_recv_bytes":6617,"msgr_send_bytes":19875,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.012732712,"msgr_running_send_time":0.002406513,"msgr_running_recv_time":0.004262753,"msgr_running_fast_dispatch_time":0.000826882,"msgr_send_messages_queue_lat":{"avgcount":26,"sum":0.095684852,"avgtime":0.003680186},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":104,"msgr_send_messages":94,"msgr_recv_bytes":137581,"msgr_send_bytes":54030,"msgr_created_connections":8,"msgr_active_connections":3,"msgr_running_total_time":0.017988617,"msgr_running_send_time":0.007359826,"msgr_running_recv_time":0.014922820,"msgr_running_fast_dispatch_time":0.000309797,"msgr_send_messages_queue_lat":{"avgcount":93,"sum":0.063598696,"avgtime":0.000683856},"msgr_handle_ack_lat":{"avgcount":34,"sum":0.000013789,"avgtime":0.000000405},"msgr_recv_encrypted_bytes":126272,"msgr_send_encrypted_bytes":13008},"AsyncMessenger::Worker-2":{"msgr_recv_messages":30,"msgr_send_messages":34,"msgr_recv_bytes":8709,"msgr_send_bytes":77168,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.012620659,"msgr_running_send_time":0.001545597,"msgr_running_recv_time":0.010690273,"msgr_running_fast_dispatch_time":0.000378734,"msgr_send_messages_queue_lat":{"avgcount":33,"sum":0.263842832,"avgtime":0.007995237},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000002912,"avgtime":0.000000582},"msgr_recv_encrypted_bytes":2032,"msgr_send_encrypted_bytes":66064},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":66,"sum":0.002987370,"avgtime":0.000045263}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000047267,"avgtime":0.000023633}},"mds":{"request":33,"reply":33,"reply_latency":{"avgcount":33,"sum":0.005782606,"avgtime":0.000175230},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":62,"traverse_hit":59,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":10,"evex":0,"evtrm":0,"ev":10,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197431,"rdpos":0,"jlat":{"avgcount":7,"sum":0.019276974,"avgtime":0.002753853},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":0,"cap+":3,"cap-":3,"rss":110232,"heap":332230656},"mds_server":{"dispatch_client_request":33,"dispatch_server_request":0,"handle_client_request":33,"handle_client_session":9,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":29,"sum":0.004970839,"avgtime":0.000171408},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":3,"sum":0.000475889,"avgtime":0.000158629},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000335878,"avgtime":0.000335878},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":3,"session_remove":3,"sessions_open":0,"sessions_stale":0,"total_load":31,"average_load":31,"avg_session_uptime":0,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":217129,"buffer_anon_items":77,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53360,"mds_co_items":216,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":46,"op_send_bytes":14337,"op_resend":37,"op_reply":46,"op_latency":{"avgcount":46,"sum":0.834988832,"avgtime":0.018151931},"op_inflight":0,"oplen_avg":{"avgcount":46,"sum":70},"op":46,"op_r":0,"op_w":46,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":7,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":40,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":155,"get_sum":134965,"get_or_fail_fail":0,"get_or_fail_success":155,"take":0,"take_sum":0,"put":155,"put_sum":134965,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":14337,"put":46,"put_sum":14337,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":46,"put":46,"put_sum":46,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x56032b59b5f0":{"val":0,"max":3758096384,"get_started":0,"get":10,"get_sum":3127,"get_or_fail_fail":0,"get_or_fail_success":10,"take":0,"take_sum":0,"put":7,"put_sum":3127,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:37:04.365 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 6617, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 25, "msgr_running_fast_dispatch_time": 0.000826882, "msgr_running_recv_time": 0.004262753, "msgr_running_send_time": 0.002406513, "msgr_running_total_time": 0.012732712, "msgr_send_bytes": 19875, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 26, "avgtime": 0.003680186, "sum": 0.095684852 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 34, "avgtime": 4.05e-07, "sum": 1.3789e-05 }, "msgr_recv_bytes": 137581, "msgr_recv_encrypted_bytes": 126272, "msgr_recv_messages": 104, "msgr_running_fast_dispatch_time": 0.000309797, "msgr_running_recv_time": 0.01492282, "msgr_running_send_time": 0.007359826, "msgr_running_total_time": 0.017988617, "msgr_send_bytes": 54030, "msgr_send_encrypted_bytes": 13008, "msgr_send_messages": 94, "msgr_send_messages_queue_lat": { "avgcount": 93, "avgtime": 0.000683856, "sum": 0.063598696 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 5.82e-07, "sum": 2.912e-06 }, "msgr_recv_bytes": 8709, "msgr_recv_encrypted_bytes": 2032, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.000378734, "msgr_running_recv_time": 0.010690273, "msgr_running_send_time": 0.001545597, "msgr_running_total_time": 0.012620659, "msgr_send_bytes": 77168, "msgr_send_encrypted_bytes": 66064, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 33, "avgtime": 0.007995237, "sum": 0.263842832 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 66, "avgtime": 4.5263e-05, "sum": 0.00298737 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 2.3633e-05, "sum": 4.7267e-05 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 33, "reply_latency": { "avgcount": 33, "avgtime": 0.00017523, "sum": 0.005782606 }, "request": 33, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 62, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 59, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 10, "evadd": 10, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 7, "avgtime": 0.002753853, "sum": 0.019276974 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197431 }, "mds_mem": { "cap": 0, "cap+": 3, "cap-": 3, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 332230656, "ino": 13, "ino+": 13, "ino-": 0, "rss": 110232 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 33, "dispatch_server_request": 0, "handle_client_request": 33, "handle_client_session": 9, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 29, "avgtime": 0.000171408, "sum": 0.004970839 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 3, "avgtime": 0.000158629, "sum": 0.000475889 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000335878, "sum": 0.000335878 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 31, "avg_session_uptime": 0, "mdthresh_evicted": 0, "session_add": 3, "session_count": 0, "session_remove": 3, "sessions_open": 0, "sessions_stale": 0, "total_load": 31 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 217129, "buffer_anon_items": 77, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53360, "mds_co_items": 216, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 40, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 46, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 46, "avgtime": 0.018151931, "sum": 0.834988832 }, "op_pg": 0, "op_r": 0, "op_reply": 46, "op_resend": 37, "op_rmw": 0, "op_send": 46, "op_send_bytes": 14337, "op_w": 46, "oplen_avg": { "avgcount": 46, "sum": 70 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 7, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 155, "get_or_fail_fail": 0, "get_or_fail_success": 155, "get_started": 0, "get_sum": 134965, "max": 104857600, "put": 155, "put_sum": 134965, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 46, "put_sum": 14337, "take": 46, "take_sum": 14337, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 46, "put_sum": 46, "take": 46, "take_sum": 46, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x56032b59b5f0": { "get": 10, "get_or_fail_fail": 0, "get_or_fail_success": 10, "get_started": 0, "get_sum": 3127, "max": 3758096384, "put": 7, "put_sum": 3127, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:37:04.365 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T03:37:04.365 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:37:04.365 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:04.443 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:04.538 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:37:04.538 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:04.539 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:04.539 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:04.574 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:37:04.574 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:04.574 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:04.575 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:04.611 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:04.611 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:04.612 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:04.612 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:04.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:37:04.649 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:04.650 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:04.650 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:04.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:04.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:04.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.909+0000 7f8373200640 1 -- 172.21.15.121:0/726405792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f836c074cb0 msgr2=0x7f836c073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:04.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.909+0000 7f8373200640 1 --2- 172.21.15.121:0/726405792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f836c074cb0 0x7f836c073dd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f835c009830 tx=0x7f835c02a5c0 comp rx=0 tx=0).stop 2024-09-17T03:37:04.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.909+0000 7f8373200640 1 -- 172.21.15.121:0/726405792 shutdown_connections 2024-09-17T03:37:04.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.909+0000 7f8373200640 1 --2- 172.21.15.121:0/726405792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f836c074cb0 0x7f836c073dd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:04.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.909+0000 7f8373200640 1 -- 172.21.15.121:0/726405792 >> 172.21.15.121:0/726405792 conn(0x7f836c0cca40 msgr2=0x7f836c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:04.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.910+0000 7f8373200640 1 -- 172.21.15.121:0/726405792 shutdown_connections 2024-09-17T03:37:04.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.910+0000 7f8373200640 1 -- 172.21.15.121:0/726405792 wait complete. 2024-09-17T03:37:04.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.912+0000 7f8373200640 1 Processor -- start 2024-09-17T03:37:04.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.912+0000 7f8373200640 1 -- start start 2024-09-17T03:37:04.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.913+0000 7f8373200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f836c074cb0 0x7f836c153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:04.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.913+0000 7f8373200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836c0cbc10 0x7f836c0b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:04.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.913+0000 7f8373200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f836c0b1060 0x7f836c0b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.913+0000 7f8373200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f836c06f670 con 0x7f836c074cb0 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.913+0000 7f8373200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f836c06f4f0 con 0x7f836c0b1060 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.913+0000 7f8373200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f836c06f7f0 con 0x7f836c0cbc10 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.914+0000 7f836be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f836c074cb0 0x7f836c153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.914+0000 7f836be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f836c074cb0 0x7f836c153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47440/0 (socket says 172.21.15.121:47440) 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.914+0000 7f836be00640 1 -- 172.21.15.121:0/816478931 learned_addr learned my addr 172.21.15.121:0/816478931 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.914+0000 7f836be00640 1 -- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836c0cbc10 msgr2=0x7f836c0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.914+0000 7f836be00640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836c0cbc10 0x7f836c0b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.914+0000 7f836be00640 1 -- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f836c0b1060 msgr2=0x7f836c0b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.914+0000 7f836be00640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f836c0b1060 0x7f836c0b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.914+0000 7f836be00640 1 -- 172.21.15.121:0/816478931 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c159970 con 0x7f836c074cb0 2024-09-17T03:37:04.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.914+0000 7f836be00640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f836c074cb0 0x7f836c153e00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f835c009950 tx=0x7f835c033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:04.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.915+0000 7f8363e00640 1 -- 172.21.15.121:0/816478931 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c031b60 con 0x7f836c074cb0 2024-09-17T03:37:04.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.915+0000 7f8363e00640 1 -- 172.21.15.121:0/816478931 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f835c031df0 con 0x7f836c074cb0 2024-09-17T03:37:04.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.915+0000 7f8363e00640 1 -- 172.21.15.121:0/816478931 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c005280 con 0x7f836c074cb0 2024-09-17T03:37:04.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.915+0000 7f8373200640 1 -- 172.21.15.121:0/816478931 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836c0b4f90 con 0x7f836c074cb0 2024-09-17T03:37:04.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.915+0000 7f8373200640 1 -- 172.21.15.121:0/816478931 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f836c0b4c90 con 0x7f836c074cb0 2024-09-17T03:37:04.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.916+0000 7f8373200640 1 -- 172.21.15.121:0/816478931 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f836c073dd0 con 0x7f836c074cb0 2024-09-17T03:37:04.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.917+0000 7f8363e00640 1 -- 172.21.15.121:0/816478931 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f835c005420 con 0x7f836c074cb0 2024-09-17T03:37:04.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.918+0000 7f8363e00640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f834c078bc0 0x7f834c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:04.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.918+0000 7f8363e00640 1 -- 172.21.15.121:0/816478931 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f835c0bc1b0 con 0x7f836c074cb0 2024-09-17T03:37:04.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.918+0000 7f836b400640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f834c078bc0 0x7f834c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:04.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.919+0000 7f836b400640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f834c078bc0 0x7f834c07b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f836c0ca0b0 tx=0x7f8358007970 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:04.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:04.923+0000 7f8363e00640 1 -- 172.21.15.121:0/816478931 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f835c03f030 con 0x7f836c074cb0 2024-09-17T03:37:05.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.140+0000 7f8373200640 1 -- 172.21.15.121:0/816478931 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f836c0747b0 con 0x7f836c074cb0 2024-09-17T03:37:05.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.140+0000 7f8363e00640 1 -- 172.21.15.121:0/816478931 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7f835c031770 con 0x7f836c074cb0 2024-09-17T03:37:05.140 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:05.140 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"btime":"2024-09-17T03:36:47:258731+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3162771203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3162771203},{"type":"v1","addr":"172.21.15.176:6837","nonce":3162771203}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4101257140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4101257140},{"type":"v1","addr":"172.21.15.176:6836","nonce":4101257140}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/4075176322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4075176322},{"type":"v1","addr":"172.21.15.121:6834","nonce":4075176322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:43.718129+0000","modified":"2024-09-17T03:36:46.740327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3665568713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":3665568713},{"type":"v1","addr":"172.21.15.121:6835","nonce":3665568713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5019,"qdb_cluster":[5019]},"id":2}]} 2024-09-17T03:37:05.141 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-09-17T03:37:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 -- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f834c078bc0 msgr2=0x7f834c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f834c078bc0 0x7f834c07b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f836c0ca0b0 tx=0x7f8358007970 comp rx=0 tx=0).stop 2024-09-17T03:37:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 -- 172.21.15.121:0/816478931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f836c074cb0 msgr2=0x7f836c153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f836c074cb0 0x7f836c153e00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f835c009950 tx=0x7f835c033c10 comp rx=0 tx=0).stop 2024-09-17T03:37:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 -- 172.21.15.121:0/816478931 shutdown_connections 2024-09-17T03:37:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f836c0b1060 0x7f836c0b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836c0cbc10 0x7f836c0b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f834c078bc0 0x7f834c07b0d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 --2- 172.21.15.121:0/816478931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f836c074cb0 0x7f836c153e00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 -- 172.21.15.121:0/816478931 >> 172.21.15.121:0/816478931 conn(0x7f836c0cca40 msgr2=0x7f836c09edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 -- 172.21.15.121:0/816478931 shutdown_connections 2024-09-17T03:37:05.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.143+0000 7f8373200640 1 -- 172.21.15.121:0/816478931 wait complete. 2024-09-17T03:37:05.166 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.387+0000 7fc0e0e00640 1 -- 172.21.15.121:0/447907792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc152450 msgr2=0x7fc0dc06e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.387+0000 7fc0e0e00640 1 --2- 172.21.15.121:0/447907792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc152450 0x7fc0dc06e720 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc15fea0 tx=0x7fc0c402a410 comp rx=0 tx=0).stop 2024-09-17T03:37:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.387+0000 7fc0e0e00640 1 -- 172.21.15.121:0/447907792 shutdown_connections 2024-09-17T03:37:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.387+0000 7fc0e0e00640 1 --2- 172.21.15.121:0/447907792 >> v2:172.21.15.176:3300/0 conn(0x7fc0dc071160 0x7fc0dc071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.387+0000 7fc0e0e00640 1 --2- 172.21.15.121:0/447907792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc152450 0x7fc0dc06e720 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.387+0000 7fc0e0e00640 1 -- 172.21.15.121:0/447907792 >> 172.21.15.121:0/447907792 conn(0x7fc0dc0d1020 msgr2=0x7fc0dc0d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.387+0000 7fc0e0e00640 1 -- 172.21.15.121:0/447907792 shutdown_connections 2024-09-17T03:37:05.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.387+0000 7fc0e0e00640 1 -- 172.21.15.121:0/447907792 wait complete. 2024-09-17T03:37:05.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.389+0000 7fc0e0e00640 1 Processor -- start 2024-09-17T03:37:05.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.389+0000 7fc0e0e00640 1 -- start start 2024-09-17T03:37:05.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0e0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc071160 0x7fc0dc1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:05.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0e0e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0dc072320 0x7fc0dc1e9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:05.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0e0e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0dc152450 0x7fc0dc1e9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:05.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0e0e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc0b40d0 con 0x7fc0dc071160 2024-09-17T03:37:05.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0e0e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc0b3f50 con 0x7fc0dc072320 2024-09-17T03:37:05.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0e0e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc0dc0b4250 con 0x7fc0dc152450 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0db400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc071160 0x7fc0dc1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0db400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc071160 0x7fc0dc1544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47454/0 (socket says 172.21.15.121:47454) 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0db400640 1 -- 172.21.15.121:0/3671766073 learned_addr learned my addr 172.21.15.121:0/3671766073 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0dbe00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0dc152450 0x7fc0dc1e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.391+0000 7fc0d2a00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0dc072320 0x7fc0dc1e9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0db400640 1 -- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0dc152450 msgr2=0x7fc0dc1e9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0db400640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0dc152450 0x7fc0dc1e9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0db400640 1 -- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0dc072320 msgr2=0x7fc0dc1e9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0db400640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0dc072320 0x7fc0dc1e9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0db400640 1 -- 172.21.15.121:0/3671766073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc150bd0 con 0x7fc0dc071160 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0dbe00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0dc152450 0x7fc0dc1e9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0d2a00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0dc072320 0x7fc0dc1e9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0db400640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc071160 0x7fc0dc1544a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc00ba50 tx=0x7fc0cc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:05.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0d3e00640 1 -- 172.21.15.121:0/3671766073 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc019070 con 0x7fc0dc071160 2024-09-17T03:37:05.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0d3e00640 1 -- 172.21.15.121:0/3671766073 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0cc00cd10 con 0x7fc0dc071160 2024-09-17T03:37:05.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0e0e00640 1 -- 172.21.15.121:0/3671766073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0dc1f5a90 con 0x7fc0dc071160 2024-09-17T03:37:05.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0d3e00640 1 -- 172.21.15.121:0/3671766073 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc0146a0 con 0x7fc0dc071160 2024-09-17T03:37:05.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.392+0000 7fc0e0e00640 1 -- 172.21.15.121:0/3671766073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0dc1f6050 con 0x7fc0dc071160 2024-09-17T03:37:05.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.393+0000 7fc0e0e00640 1 -- 172.21.15.121:0/3671766073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0dc0b47d0 con 0x7fc0dc071160 2024-09-17T03:37:05.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.394+0000 7fc0d3e00640 1 -- 172.21.15.121:0/3671766073 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0cc01c070 con 0x7fc0dc071160 2024-09-17T03:37:05.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.395+0000 7fc0d3e00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0b8078b90 0x7fc0b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:05.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.395+0000 7fc0d3e00640 1 -- 172.21.15.121:0/3671766073 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc0cc09aad0 con 0x7fc0dc071160 2024-09-17T03:37:05.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.396+0000 7fc0d2a00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0b8078b90 0x7fc0b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:05.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.397+0000 7fc0d2a00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0b8078b90 0x7fc0b807b0a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4033000 tx=0x7fc0c4004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:05.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.400+0000 7fc0d3e00640 1 -- 172.21.15.121:0/3671766073 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0cc0627b0 con 0x7fc0dc071160 2024-09-17T03:37:05.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.623+0000 7fc0e0e00640 1 -- 172.21.15.121:0/3671766073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0dc15ca90 con 0x7fc0dc071160 2024-09-17T03:37:05.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.623+0000 7fc0d3e00640 1 -- 172.21.15.121:0/3671766073 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7fc0cc0671e0 con 0x7fc0dc071160 2024-09-17T03:37:05.623 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:05.623 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"btime":"2024-09-17T03:36:47:258731+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3162771203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3162771203},{"type":"v1","addr":"172.21.15.176:6837","nonce":3162771203}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4101257140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4101257140},{"type":"v1","addr":"172.21.15.176:6836","nonce":4101257140}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/4075176322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4075176322},{"type":"v1","addr":"172.21.15.121:6834","nonce":4075176322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:43.718129+0000","modified":"2024-09-17T03:36:46.740327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3665568713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":3665568713},{"type":"v1","addr":"172.21.15.121:6835","nonce":3665568713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5019,"qdb_cluster":[5019]},"id":2}]} 2024-09-17T03:37:05.624 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-09-17T03:37:05.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 -- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0b8078b90 msgr2=0x7fc0b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:05.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0b8078b90 0x7fc0b807b0a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4033000 tx=0x7fc0c4004730 comp rx=0 tx=0).stop 2024-09-17T03:37:05.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 -- 172.21.15.121:0/3671766073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc071160 msgr2=0x7fc0dc1544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:05.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc071160 0x7fc0dc1544a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc00ba50 tx=0x7fc0cc00bf10 comp rx=0 tx=0).stop 2024-09-17T03:37:05.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 -- 172.21.15.121:0/3671766073 shutdown_connections 2024-09-17T03:37:05.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc0dc152450 0x7fc0dc1e9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0dc072320 0x7fc0dc1e9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc0b8078b90 0x7fc0b807b0a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 --2- 172.21.15.121:0/3671766073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0dc071160 0x7fc0dc1544a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 -- 172.21.15.121:0/3671766073 >> 172.21.15.121:0/3671766073 conn(0x7fc0dc0d1020 msgr2=0x7fc0dc06d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:05.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 -- 172.21.15.121:0/3671766073 shutdown_connections 2024-09-17T03:37:05.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.626+0000 7fc0e0e00640 1 -- 172.21.15.121:0/3671766073 wait complete. 2024-09-17T03:37:05.648 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:05.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.869+0000 7fc2b8800640 1 -- 172.21.15.121:0/919351568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b00cefa0 msgr2=0x7fc2b00ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:05.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.869+0000 7fc2b8800640 1 --2- 172.21.15.121:0/919351568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b00cefa0 0x7fc2b00ce320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0072560 tx=0x7fc2a002a560 comp rx=0 tx=0).stop 2024-09-17T03:37:05.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.869+0000 7fc2b8800640 1 -- 172.21.15.121:0/919351568 shutdown_connections 2024-09-17T03:37:05.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.869+0000 7fc2b8800640 1 --2- 172.21.15.121:0/919351568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b00cefa0 0x7fc2b00ce320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.869+0000 7fc2b8800640 1 --2- 172.21.15.121:0/919351568 >> v2:172.21.15.176:3300/0 conn(0x7fc2b015b9f0 0x7fc2b00cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.869+0000 7fc2b8800640 1 -- 172.21.15.121:0/919351568 >> 172.21.15.121:0/919351568 conn(0x7fc2b00cca40 msgr2=0x7fc2b00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:05.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.869+0000 7fc2b8800640 1 -- 172.21.15.121:0/919351568 shutdown_connections 2024-09-17T03:37:05.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.869+0000 7fc2b8800640 1 -- 172.21.15.121:0/919351568 wait complete. 2024-09-17T03:37:05.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.871+0000 7fc2b8800640 1 Processor -- start 2024-09-17T03:37:05.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.872+0000 7fc2b8800640 1 -- start start 2024-09-17T03:37:05.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b8800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00ce860 0x7fc2b01f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:05.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b8800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b00cefa0 0x7fc2b01f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:05.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b8800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b015b9f0 0x7fc2b01f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:05.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b8800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b006ddf0 con 0x7fc2b00cefa0 2024-09-17T03:37:05.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b8800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b006df70 con 0x7fc2b00ce860 2024-09-17T03:37:05.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b8800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b006e0f0 con 0x7fc2b015b9f0 2024-09-17T03:37:05.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b00cefa0 0x7fc2b01f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:05.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b00cefa0 0x7fc2b01f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47484/0 (socket says 172.21.15.121:47484) 2024-09-17T03:37:05.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b5400640 1 -- 172.21.15.121:0/4232953107 learned_addr learned my addr 172.21.15.121:0/4232953107 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:05.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b5e00640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00ce860 0x7fc2b01f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:05.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.873+0000 7fc2b6800640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b015b9f0 0x7fc2b01f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:05.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2b5400640 1 -- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b015b9f0 msgr2=0x7fc2b01f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2b5400640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b015b9f0 0x7fc2b01f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2b5400640 1 -- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00ce860 msgr2=0x7fc2b01f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2b5400640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00ce860 0x7fc2b01f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2b5400640 1 -- 172.21.15.121:0/4232953107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b0153f60 con 0x7fc2b00cefa0 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2b5e00640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00ce860 0x7fc2b01f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2b6800640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b015b9f0 0x7fc2b01f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2b5400640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b00cefa0 0x7fc2b01f7420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0034040 tx=0x7fc2a00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2aa000640 1 -- 172.21.15.121:0/4232953107 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a003e030 con 0x7fc2b00cefa0 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2aa000640 1 -- 172.21.15.121:0/4232953107 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2a00047a0 con 0x7fc2b00cefa0 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2aa000640 1 -- 172.21.15.121:0/4232953107 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0035040 con 0x7fc2b00cefa0 2024-09-17T03:37:05.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.874+0000 7fc2b8800640 1 -- 172.21.15.121:0/4232953107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b0154240 con 0x7fc2b00cefa0 2024-09-17T03:37:05.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.875+0000 7fc2b8800640 1 -- 172.21.15.121:0/4232953107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b0154800 con 0x7fc2b00cefa0 2024-09-17T03:37:05.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.876+0000 7fc2b8800640 1 -- 172.21.15.121:0/4232953107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b0153cd0 con 0x7fc2b00cefa0 2024-09-17T03:37:05.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.877+0000 7fc2aa000640 1 -- 172.21.15.121:0/4232953107 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc2a0041030 con 0x7fc2b00cefa0 2024-09-17T03:37:05.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.878+0000 7fc2aa000640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc294078b90 0x7fc29407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:05.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.878+0000 7fc2aa000640 1 -- 172.21.15.121:0/4232953107 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc2a00bb710 con 0x7fc2b00cefa0 2024-09-17T03:37:05.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.878+0000 7fc2b5e00640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc294078b90 0x7fc29407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:05.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.879+0000 7fc2b5e00640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc294078b90 0x7fc29407b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009890 tx=0x7fc2a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:05.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:05.882+0000 7fc2aa000640 1 -- 172.21.15.121:0/4232953107 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc2a0083a50 con 0x7fc2b00cefa0 2024-09-17T03:37:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.066+0000 7fc2b8800640 1 -- 172.21.15.121:0/4232953107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2b006e620 con 0x7fc2b00cefa0 2024-09-17T03:37:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.067+0000 7fc2aa000640 1 -- 172.21.15.121:0/4232953107 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17062 (secure 0 0 0) 0x7fc2a0083350 con 0x7fc2b00cefa0 2024-09-17T03:37:06.069 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:06.069 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":40,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:36:45.243335+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:41.651337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:42.683336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 -- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc294078b90 msgr2=0x7fc29407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc294078b90 0x7fc29407b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009890 tx=0x7fc2a4008040 comp rx=0 tx=0).stop 2024-09-17T03:37:06.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 -- 172.21.15.121:0/4232953107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b00cefa0 msgr2=0x7fc2b01f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:06.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b00cefa0 0x7fc2b01f7420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0034040 tx=0x7fc2a00039e0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 -- 172.21.15.121:0/4232953107 shutdown_connections 2024-09-17T03:37:06.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2b015b9f0 0x7fc2b01f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc294078b90 0x7fc29407b0a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2b00cefa0 0x7fc2b01f7420 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 --2- 172.21.15.121:0/4232953107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2b00ce860 0x7fc2b01f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 -- 172.21.15.121:0/4232953107 >> 172.21.15.121:0/4232953107 conn(0x7fc2b00cca40 msgr2=0x7fc2b0159560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:06.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 -- 172.21.15.121:0/4232953107 shutdown_connections 2024-09-17T03:37:06.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.070+0000 7fc2b8800640 1 -- 172.21.15.121:0/4232953107 wait complete. 2024-09-17T03:37:06.095 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:37:06.095 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:06.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.317+0000 7f3883200640 1 -- 172.21.15.121:0/54906854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38840cede0 msgr2=0x7f38840cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:06.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.317+0000 7f3883200640 1 --2- 172.21.15.121:0/54906854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38840cede0 0x7f38840cf7d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3874009830 tx=0x7f387402a510 comp rx=0 tx=0).stop 2024-09-17T03:37:06.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.317+0000 7f3883200640 1 -- 172.21.15.121:0/54906854 shutdown_connections 2024-09-17T03:37:06.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.317+0000 7f3883200640 1 --2- 172.21.15.121:0/54906854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3884154f20 0x7f3884155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.317+0000 7f3883200640 1 --2- 172.21.15.121:0/54906854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38840cede0 0x7f38840cf7d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.317+0000 7f3883200640 1 -- 172.21.15.121:0/54906854 >> 172.21.15.121:0/54906854 conn(0x7f38840d4360 msgr2=0x7f38840d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:06.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.317+0000 7f3883200640 1 -- 172.21.15.121:0/54906854 shutdown_connections 2024-09-17T03:37:06.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.317+0000 7f3883200640 1 -- 172.21.15.121:0/54906854 wait complete. 2024-09-17T03:37:06.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.320+0000 7f3883200640 1 Processor -- start 2024-09-17T03:37:06.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.320+0000 7f3883200640 1 -- start start 2024-09-17T03:37:06.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.321+0000 7f3883200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38840cede0 0x7f3884156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:06.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.321+0000 7f3883200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3884154f20 0x7f38841f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:06.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.321+0000 7f3883200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38841622a0 0x7f38840b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:06.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.321+0000 7f3883200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3884155870 con 0x7f38840cede0 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.321+0000 7f3883200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38841559f0 con 0x7f3884154f20 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.321+0000 7f3883200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3884155b70 con 0x7f38841622a0 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.322+0000 7f3881e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38840cede0 0x7f3884156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.322+0000 7f3881e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38840cede0 0x7f3884156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47486/0 (socket says 172.21.15.121:47486) 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.322+0000 7f3881e00640 1 -- 172.21.15.121:0/991776659 learned_addr learned my addr 172.21.15.121:0/991776659 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.322+0000 7f3881e00640 1 -- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38841622a0 msgr2=0x7f38840b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.322+0000 7f3881e00640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38841622a0 0x7f38840b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.322+0000 7f3881e00640 1 -- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3884154f20 msgr2=0x7f38841f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.322+0000 7f3881e00640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3884154f20 0x7f38841f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.322+0000 7f3881e00640 1 -- 172.21.15.121:0/991776659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38841f5eb0 con 0x7f38840cede0 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.322+0000 7f3881e00640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38840cede0 0x7f3884156710 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3874009950 tx=0x7f3874033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.322+0000 7f387a000640 1 -- 172.21.15.121:0/991776659 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3874005c90 con 0x7f38840cede0 2024-09-17T03:37:06.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.323+0000 7f387a000640 1 -- 172.21.15.121:0/991776659 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3874031e50 con 0x7f38840cede0 2024-09-17T03:37:06.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.323+0000 7f3883200640 1 -- 172.21.15.121:0/991776659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38841f6190 con 0x7f38840cede0 2024-09-17T03:37:06.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.323+0000 7f387a000640 1 -- 172.21.15.121:0/991776659 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3874005260 con 0x7f38840cede0 2024-09-17T03:37:06.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.323+0000 7f3883200640 1 -- 172.21.15.121:0/991776659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38841f6750 con 0x7f38840cede0 2024-09-17T03:37:06.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.324+0000 7f3883200640 1 -- 172.21.15.121:0/991776659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38840cf7d0 con 0x7f38840cede0 2024-09-17T03:37:06.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.325+0000 7f387a000640 1 -- 172.21.15.121:0/991776659 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3874005400 con 0x7f38840cede0 2024-09-17T03:37:06.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.326+0000 7f387a000640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3864078b90 0x7f386407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:06.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.326+0000 7f387a000640 1 -- 172.21.15.121:0/991776659 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f38740bbfa0 con 0x7f38840cede0 2024-09-17T03:37:06.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.326+0000 7f3881400640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3864078b90 0x7f386407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:06.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.327+0000 7f3881400640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3864078b90 0x7f386407b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3870007fd0 tx=0x7f3870007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:06.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.330+0000 7f387a000640 1 -- 172.21.15.121:0/991776659 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f387403f030 con 0x7f38840cede0 2024-09-17T03:37:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.548+0000 7f3883200640 1 -- 172.21.15.121:0/991776659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3884162080 con 0x7f38840cede0 2024-09-17T03:37:06.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.548+0000 7f387a000640 1 -- 172.21.15.121:0/991776659 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7f3874084240 con 0x7f38840cede0 2024-09-17T03:37:06.548 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:06.548 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"btime":"2024-09-17T03:36:47:258731+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3162771203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3162771203},{"type":"v1","addr":"172.21.15.176:6837","nonce":3162771203}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4101257140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4101257140},{"type":"v1","addr":"172.21.15.176:6836","nonce":4101257140}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/4075176322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4075176322},{"type":"v1","addr":"172.21.15.121:6834","nonce":4075176322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:43.718129+0000","modified":"2024-09-17T03:36:46.740327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3665568713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":3665568713},{"type":"v1","addr":"172.21.15.121:6835","nonce":3665568713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5019,"qdb_cluster":[5019]},"id":2}]} 2024-09-17T03:37:06.549 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-09-17T03:37:06.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 -- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3864078b90 msgr2=0x7f386407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:06.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3864078b90 0x7f386407b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3870007fd0 tx=0x7f3870007900 comp rx=0 tx=0).stop 2024-09-17T03:37:06.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 -- 172.21.15.121:0/991776659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38840cede0 msgr2=0x7f3884156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:06.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38840cede0 0x7f3884156710 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3874009950 tx=0x7f3874033c20 comp rx=0 tx=0).stop 2024-09-17T03:37:06.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 -- 172.21.15.121:0/991776659 shutdown_connections 2024-09-17T03:37:06.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38841622a0 0x7f38840b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3884154f20 0x7f38841f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3864078b90 0x7f386407b0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 --2- 172.21.15.121:0/991776659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38840cede0 0x7f3884156710 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 -- 172.21.15.121:0/991776659 >> 172.21.15.121:0/991776659 conn(0x7f38840d4360 msgr2=0x7f388415c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:06.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 -- 172.21.15.121:0/991776659 shutdown_connections 2024-09-17T03:37:06.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.551+0000 7f3883200640 1 -- 172.21.15.121:0/991776659 wait complete. 2024-09-17T03:37:06.576 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.799+0000 7f5e31200640 1 -- 172.21.15.121:0/652700268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e10004020 msgr2=0x7f5e10004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.799+0000 7f5e31200640 1 --2- 172.21.15.121:0/652700268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e10004020 0x7f5e10004800 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009b50 tx=0x7f5e10005830 comp rx=0 tx=0).stop 2024-09-17T03:37:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.799+0000 7f5e2be00640 1 -- 172.21.15.121:0/652700268 reap_dead start 2024-09-17T03:37:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.799+0000 7f5e31200640 1 -- 172.21.15.121:0/652700268 shutdown_connections 2024-09-17T03:37:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.799+0000 7f5e31200640 1 -- 172.21.15.121:0/652700268 >> 172.21.15.121:0/652700268 conn(0x7f5e2c06f940 msgr2=0x7f5e2c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.799+0000 7f5e31200640 1 -- 172.21.15.121:0/652700268 shutdown_connections 2024-09-17T03:37:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.799+0000 7f5e31200640 1 -- 172.21.15.121:0/652700268 wait complete. 2024-09-17T03:37:06.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.802+0000 7f5e31200640 1 Processor -- start 2024-09-17T03:37:06.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.802+0000 7f5e31200640 1 -- start start 2024-09-17T03:37:06.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.803+0000 7f5e31200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e10004020 0x7f5e2c0ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:06.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.803+0000 7f5e31200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e2c072c00 0x7f5e2c073c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:06.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.803+0000 7f5e31200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e2c1f5bf0 0x7f5e2c1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:06.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.803+0000 7f5e31200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c06d270 con 0x7f5e2c1f5bf0 2024-09-17T03:37:06.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.803+0000 7f5e31200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c0cd000 con 0x7f5e2c072c00 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.803+0000 7f5e31200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c06d3f0 con 0x7f5e10004020 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.803+0000 7f5e2be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e2c1f5bf0 0x7f5e2c1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.803+0000 7f5e2be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e2c1f5bf0 0x7f5e2c1600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47500/0 (socket says 172.21.15.121:47500) 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.803+0000 7f5e2be00640 1 -- 172.21.15.121:0/4193021133 learned_addr learned my addr 172.21.15.121:0/4193021133 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e2b400640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e10004020 0x7f5e2c0ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e22a00640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e2c072c00 0x7f5e2c073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e2be00640 1 -- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e10004020 msgr2=0x7f5e2c0ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e2be00640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e10004020 0x7f5e2c0ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e2be00640 1 -- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e2c072c00 msgr2=0x7f5e2c073c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e2be00640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e2c072c00 0x7f5e2c073c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e2be00640 1 -- 172.21.15.121:0/4193021133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c0c51a0 con 0x7f5e2c1f5bf0 2024-09-17T03:37:06.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e2be00640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e2c1f5bf0 0x7f5e2c1600b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5e24002230 tx=0x7f5e24006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:06.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e23e00640 1 -- 172.21.15.121:0/4193021133 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24016070 con 0x7f5e2c1f5bf0 2024-09-17T03:37:06.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e23e00640 1 -- 172.21.15.121:0/4193021133 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e240109a0 con 0x7f5e2c1f5bf0 2024-09-17T03:37:06.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.804+0000 7f5e23e00640 1 -- 172.21.15.121:0/4193021133 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24010df0 con 0x7f5e2c1f5bf0 2024-09-17T03:37:06.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.805+0000 7f5e31200640 1 -- 172.21.15.121:0/4193021133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c0c5480 con 0x7f5e2c1f5bf0 2024-09-17T03:37:06.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.805+0000 7f5e31200640 1 -- 172.21.15.121:0/4193021133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c0adb30 con 0x7f5e2c1f5bf0 2024-09-17T03:37:06.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.806+0000 7f5e31200640 1 -- 172.21.15.121:0/4193021133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e2c06d950 con 0x7f5e2c1f5bf0 2024-09-17T03:37:06.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.807+0000 7f5e23e00640 1 -- 172.21.15.121:0/4193021133 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e24019070 con 0x7f5e2c1f5bf0 2024-09-17T03:37:06.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.808+0000 7f5e23e00640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e08078bc0 0x7f5e0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:06.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.808+0000 7f5e23e00640 1 -- 172.21.15.121:0/4193021133 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f5e2409aec0 con 0x7f5e2c1f5bf0 2024-09-17T03:37:06.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.808+0000 7f5e2b400640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e08078bc0 0x7f5e0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:06.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.809+0000 7f5e2b400640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e08078bc0 0x7f5e0807b0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c000c00 tx=0x7f5e1c006d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:06.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:06.812+0000 7f5e23e00640 1 -- 172.21.15.121:0/4193021133 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e2c0cd220 con 0x7f5e2c1f5bf0 2024-09-17T03:37:07.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.031+0000 7f5e31200640 1 -- 172.21.15.121:0/4193021133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e2c160c80 con 0x7f5e2c1f5bf0 2024-09-17T03:37:07.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.031+0000 7f5e23e00640 1 -- 172.21.15.121:0/4193021133 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7f5e24062a80 con 0x7f5e2c1f5bf0 2024-09-17T03:37:07.031 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:07.031 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"btime":"2024-09-17T03:36:47:258731+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3162771203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3162771203},{"type":"v1","addr":"172.21.15.176:6837","nonce":3162771203}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4101257140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4101257140},{"type":"v1","addr":"172.21.15.176:6836","nonce":4101257140}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/4075176322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4075176322},{"type":"v1","addr":"172.21.15.121:6834","nonce":4075176322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:43.718129+0000","modified":"2024-09-17T03:36:46.740327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3665568713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":3665568713},{"type":"v1","addr":"172.21.15.121:6835","nonce":3665568713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5019,"qdb_cluster":[5019]},"id":2}]} 2024-09-17T03:37:07.032 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-09-17T03:37:07.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 -- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e08078bc0 msgr2=0x7f5e0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e08078bc0 0x7f5e0807b0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c000c00 tx=0x7f5e1c006d60 comp rx=0 tx=0).stop 2024-09-17T03:37:07.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 -- 172.21.15.121:0/4193021133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e2c1f5bf0 msgr2=0x7f5e2c1600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e2c1f5bf0 0x7f5e2c1600b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5e24002230 tx=0x7f5e24006420 comp rx=0 tx=0).stop 2024-09-17T03:37:07.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 -- 172.21.15.121:0/4193021133 shutdown_connections 2024-09-17T03:37:07.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e08078bc0 0x7f5e0807b0d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e2c1f5bf0 0x7f5e2c1600b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e2c072c00 0x7f5e2c073c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 --2- 172.21.15.121:0/4193021133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e10004020 0x7f5e2c0ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 -- 172.21.15.121:0/4193021133 >> 172.21.15.121:0/4193021133 conn(0x7f5e2c06f940 msgr2=0x7f5e2c0cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:07.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 -- 172.21.15.121:0/4193021133 shutdown_connections 2024-09-17T03:37:07.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.034+0000 7f5e31200640 1 -- 172.21.15.121:0/4193021133 wait complete. 2024-09-17T03:37:07.060 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:07.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.285+0000 7f60abe00640 1 -- 172.21.15.121:0/1601943703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6090004800 msgr2=0x7f6090004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.285+0000 7f60abe00640 1 --2- 172.21.15.121:0/1601943703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6090004800 0x7f6090004c10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f609400c3c0 tx=0x7f6090005830 comp rx=0 tx=0).stop 2024-09-17T03:37:07.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.285+0000 7f60ab400640 1 -- 172.21.15.121:0/1601943703 reap_dead start 2024-09-17T03:37:07.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.285+0000 7f60abe00640 1 -- 172.21.15.121:0/1601943703 shutdown_connections 2024-09-17T03:37:07.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.285+0000 7f60abe00640 1 -- 172.21.15.121:0/1601943703 >> 172.21.15.121:0/1601943703 conn(0x7f60ac0d1930 msgr2=0x7f60ac0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:07.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.285+0000 7f60abe00640 1 -- 172.21.15.121:0/1601943703 shutdown_connections 2024-09-17T03:37:07.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.285+0000 7f60abe00640 1 -- 172.21.15.121:0/1601943703 wait complete. 2024-09-17T03:37:07.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.287+0000 7f60abe00640 1 Processor -- start 2024-09-17T03:37:07.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.287+0000 7f60abe00640 1 -- start start 2024-09-17T03:37:07.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60abe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6090004800 0x7f60ac0ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60abe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60ac1f4890 0x7f60ac152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60abe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60ac1f4ca0 0x7f60ac152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60abe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac155020 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60abe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac154ea0 con 0x7f60ac1f4890 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60abe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f60ac1551a0 con 0x7f6090004800 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60ab400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60ac1f4ca0 0x7f60ac152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60ab400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60ac1f4ca0 0x7f60ac152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47530/0 (socket says 172.21.15.121:47530) 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60ab400640 1 -- 172.21.15.121:0/665693490 learned_addr learned my addr 172.21.15.121:0/665693490 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60aaa00640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6090004800 0x7f60ac0ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60a2000640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60ac1f4890 0x7f60ac152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60ab400640 1 -- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6090004800 msgr2=0x7f60ac0ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60ab400640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6090004800 0x7f60ac0ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60ab400640 1 -- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60ac1f4890 msgr2=0x7f60ac152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60ab400640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60ac1f4890 0x7f60ac152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.289+0000 7f60ab400640 1 -- 172.21.15.121:0/665693490 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac0caab0 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.290+0000 7f60ab400640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60ac1f4ca0 0x7f60ac152e70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f60a4005fd0 tx=0x7f60a4011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:07.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.290+0000 7f60a3400640 1 -- 172.21.15.121:0/665693490 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4004b20 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.290+0000 7f60a3400640 1 -- 172.21.15.121:0/665693490 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60a4004cc0 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.290+0000 7f60abe00640 1 -- 172.21.15.121:0/665693490 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ac1f5210 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.290+0000 7f60a3400640 1 -- 172.21.15.121:0/665693490 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4003bd0 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.290+0000 7f60abe00640 1 -- 172.21.15.121:0/665693490 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ac1f57d0 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.291+0000 7f60abe00640 1 -- 172.21.15.121:0/665693490 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ac0cac80 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.293+0000 7f60a3400640 1 -- 172.21.15.121:0/665693490 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60a4004030 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.293+0000 7f60a3400640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6088078bc0 0x7f608807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.294+0000 7f60a3400640 1 -- 172.21.15.121:0/665693490 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f60a409b8d0 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.294+0000 7f60aaa00640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6088078bc0 0x7f608807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.295+0000 7f60aaa00640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6088078bc0 0x7f608807b0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f609c006560 tx=0x7f609c006b10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:07.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.298+0000 7f60a3400640 1 -- 172.21.15.121:0/665693490 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f60a401f060 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.484+0000 7f60abe00640 1 -- 172.21.15.121:0/665693490 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60ac155730 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.485+0000 7f60a3400640 1 -- 172.21.15.121:0/665693490 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17062 (secure 0 0 0) 0x7f60a4063c10 con 0x7f60ac1f4ca0 2024-09-17T03:37:07.485 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:07.486 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":40,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:36:45.243335+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:41.651337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:42.683336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:07.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 -- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6088078bc0 msgr2=0x7f608807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6088078bc0 0x7f608807b0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f609c006560 tx=0x7f609c006b10 comp rx=0 tx=0).stop 2024-09-17T03:37:07.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 -- 172.21.15.121:0/665693490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60ac1f4ca0 msgr2=0x7f60ac152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60ac1f4ca0 0x7f60ac152e70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f60a4005fd0 tx=0x7f60a4011ef0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 -- 172.21.15.121:0/665693490 shutdown_connections 2024-09-17T03:37:07.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6088078bc0 0x7f608807b0d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60ac1f4ca0 0x7f60ac152e70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60ac1f4890 0x7f60ac152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 --2- 172.21.15.121:0/665693490 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6090004800 0x7f60ac0ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 -- 172.21.15.121:0/665693490 >> 172.21.15.121:0/665693490 conn(0x7f60ac0d1930 msgr2=0x7f60ac15ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:07.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 -- 172.21.15.121:0/665693490 shutdown_connections 2024-09-17T03:37:07.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.488+0000 7f60abe00640 1 -- 172.21.15.121:0/665693490 wait complete. 2024-09-17T03:37:07.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:37:07.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.733+0000 7f88f9000640 1 -- 172.21.15.121:0/354275672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f406ddf0 msgr2=0x7f88f406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.733+0000 7f88f9000640 1 --2- 172.21.15.121:0/354275672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f406ddf0 0x7f88f406e200 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f88f406fe40 tx=0x7f88e002a560 comp rx=0 tx=0).stop 2024-09-17T03:37:07.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.733+0000 7f88f9000640 1 -- 172.21.15.121:0/354275672 shutdown_connections 2024-09-17T03:37:07.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.733+0000 7f88f9000640 1 --2- 172.21.15.121:0/354275672 >> v2:172.21.15.176:3300/0 conn(0x7f88f40cef00 0x7f88f40cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.734+0000 7f88f9000640 1 --2- 172.21.15.121:0/354275672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f406ddf0 0x7f88f406e200 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.734+0000 7f88f9000640 1 -- 172.21.15.121:0/354275672 >> 172.21.15.121:0/354275672 conn(0x7f88f40b1b90 msgr2=0x7f88f40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:07.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.734+0000 7f88f9000640 1 -- 172.21.15.121:0/354275672 shutdown_connections 2024-09-17T03:37:07.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.734+0000 7f88f9000640 1 -- 172.21.15.121:0/354275672 wait complete. 2024-09-17T03:37:07.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.736+0000 7f88f9000640 1 Processor -- start 2024-09-17T03:37:07.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.736+0000 7f88f9000640 1 -- start start 2024-09-17T03:37:07.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.737+0000 7f88f9000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88f406ddf0 0x7f88f40c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.737+0000 7f88f9000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88f40cef00 0x7f88f40cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.737+0000 7f88f9000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f4156a50 0x7f88f41581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.737+0000 7f88f9000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f88f40cf850 con 0x7f88f4156a50 2024-09-17T03:37:07.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.737+0000 7f88f9000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88f4161060 con 0x7f88f40cef00 2024-09-17T03:37:07.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.737+0000 7f88f9000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88f40cf9d0 con 0x7f88f406ddf0 2024-09-17T03:37:07.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f2800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f4156a50 0x7f88f41581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f2800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f4156a50 0x7f88f41581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47538/0 (socket says 172.21.15.121:47538) 2024-09-17T03:37:07.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f2800640 1 -- 172.21.15.121:0/1142067436 learned_addr learned my addr 172.21.15.121:0/1142067436 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:07.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f1400640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88f40cef00 0x7f88f40cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f1e00640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88f406ddf0 0x7f88f40c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f2800640 1 -- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88f406ddf0 msgr2=0x7f88f40c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f2800640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88f406ddf0 0x7f88f40c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f2800640 1 -- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88f40cef00 msgr2=0x7f88f40cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f2800640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88f40cef00 0x7f88f40cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f2800640 1 -- 172.21.15.121:0/1142067436 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f40ce210 con 0x7f88f4156a50 2024-09-17T03:37:07.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.738+0000 7f88f2800640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f4156a50 0x7f88f41581b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00caa0 tx=0x7f88ec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:07.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.739+0000 7f88ea000640 1 -- 172.21.15.121:0/1142067436 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00ad30 con 0x7f88f4156a50 2024-09-17T03:37:07.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.739+0000 7f88ea000640 1 -- 172.21.15.121:0/1142067436 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88ec00f450 con 0x7f88f4156a50 2024-09-17T03:37:07.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.739+0000 7f88ea000640 1 -- 172.21.15.121:0/1142067436 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00f8a0 con 0x7f88f4156a50 2024-09-17T03:37:07.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.739+0000 7f88f9000640 1 -- 172.21.15.121:0/1142067436 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f41f5c10 con 0x7f88f4156a50 2024-09-17T03:37:07.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.739+0000 7f88f9000640 1 -- 172.21.15.121:0/1142067436 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f409f190 con 0x7f88f4156a50 2024-09-17T03:37:07.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.740+0000 7f88f9000640 1 -- 172.21.15.121:0/1142067436 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f40c63e0 con 0x7f88f4156a50 2024-09-17T03:37:07.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.741+0000 7f88ea000640 1 -- 172.21.15.121:0/1142067436 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f88ec00fa40 con 0x7f88f4156a50 2024-09-17T03:37:07.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.742+0000 7f88ea000640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f88d4078bc0 0x7f88d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.742+0000 7f88ea000640 1 -- 172.21.15.121:0/1142067436 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f88ec09b7e0 con 0x7f88f4156a50 2024-09-17T03:37:07.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.743+0000 7f88f1e00640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f88d4078bc0 0x7f88d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.743+0000 7f88f1e00640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f88d4078bc0 0x7f88d407b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88e4006fd0 tx=0x7f88e4009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:07.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.746+0000 7f88ea000640 1 -- 172.21.15.121:0/1142067436 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88ec014030 con 0x7f88f4156a50 2024-09-17T03:37:07.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.969+0000 7f88f9000640 1 -- 172.21.15.121:0/1142067436 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f88f406e200 con 0x7f88f4156a50 2024-09-17T03:37:07.969 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-17T03:37:07.969+0000 7f1def400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:37:07.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.971+0000 7f88ea000640 1 -- 172.21.15.121:0/1142067436 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f88ec063440 con 0x7f88f4156a50 2024-09-17T03:37:07.971 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:37:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 -- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f88d4078bc0 msgr2=0x7f88d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f88d4078bc0 0x7f88d407b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88e4006fd0 tx=0x7f88e4009060 comp rx=0 tx=0).stop 2024-09-17T03:37:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 -- 172.21.15.121:0/1142067436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f4156a50 msgr2=0x7f88f41581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f4156a50 0x7f88f41581b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00caa0 tx=0x7f88ec00cf60 comp rx=0 tx=0).stop 2024-09-17T03:37:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 -- 172.21.15.121:0/1142067436 shutdown_connections 2024-09-17T03:37:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f88d4078bc0 0x7f88d407b0d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f4156a50 0x7f88f41581b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88f40cef00 0x7f88f40cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 --2- 172.21.15.121:0/1142067436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88f406ddf0 0x7f88f40c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 -- 172.21.15.121:0/1142067436 >> 172.21.15.121:0/1142067436 conn(0x7f88f40b1b90 msgr2=0x7f88f40b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:07.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 -- 172.21.15.121:0/1142067436 shutdown_connections 2024-09-17T03:37:07.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:07.974+0000 7f88f9000640 1 -- 172.21.15.121:0/1142067436 wait complete. 2024-09-17T03:37:07.980 INFO:tasks.ceph.mds.c.smithi121.stderr: -2706> 2024-09-17T03:36:48.167+0000 7ff859000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:37:08.003 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:37:08.101 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:37:08.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.230+0000 7f454a600640 1 -- 172.21.15.121:0/1817718416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4544074b60 msgr2=0x7f454406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.230+0000 7f454a600640 1 --2- 172.21.15.121:0/1817718416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4544074b60 0x7f454406ddf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f452c005fd0 tx=0x7f452c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.230+0000 7f454a600640 1 -- 172.21.15.121:0/1817718416 shutdown_connections 2024-09-17T03:37:08.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.230+0000 7f454a600640 1 --2- 172.21.15.121:0/1817718416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4544074b60 0x7f454406ddf0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.230+0000 7f454a600640 1 --2- 172.21.15.121:0/1817718416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4544156a50 0x7f4544074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.230+0000 7f454a600640 1 -- 172.21.15.121:0/1817718416 >> 172.21.15.121:0/1817718416 conn(0x7f45440b1b90 msgr2=0x7f45440b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:08.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.230+0000 7f454a600640 1 -- 172.21.15.121:0/1817718416 shutdown_connections 2024-09-17T03:37:08.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.230+0000 7f454a600640 1 -- 172.21.15.121:0/1817718416 wait complete. 2024-09-17T03:37:08.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.233+0000 7f454a600640 1 Processor -- start 2024-09-17T03:37:08.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.233+0000 7f454a600640 1 -- start start 2024-09-17T03:37:08.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.234+0000 7f454a600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f454406e330 0x7f45440bec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.234+0000 7f454a600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4544074b60 0x7f45440b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.234+0000 7f454a600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4544156a50 0x7f45440b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.234+0000 7f454a600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f45440ce500 con 0x7f4544156a50 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.234+0000 7f454a600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f45440ce380 con 0x7f454406e330 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.234+0000 7f454a600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f45440ce680 con 0x7f4544074b60 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.234+0000 7f4543e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4544156a50 0x7f45440b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f4543e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4544156a50 0x7f45440b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47580/0 (socket says 172.21.15.121:47580) 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f4543e00640 1 -- 172.21.15.121:0/4016470455 learned_addr learned my addr 172.21.15.121:0/4016470455 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f453be00640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4544074b60 0x7f45440b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f4543400640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f454406e330 0x7f45440bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f4543e00640 1 -- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4544074b60 msgr2=0x7f45440b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f4543e00640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4544074b60 0x7f45440b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f4543e00640 1 -- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f454406e330 msgr2=0x7f45440bec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f4543e00640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f454406e330 0x7f45440bec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f4543e00640 1 -- 172.21.15.121:0/4016470455 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45440c6700 con 0x7f4544156a50 2024-09-17T03:37:08.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f4543e00640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4544156a50 0x7f45440b50b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f453c00c6b0 tx=0x7f453c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:08.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f453b400640 1 -- 172.21.15.121:0/4016470455 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c003b70 con 0x7f4544156a50 2024-09-17T03:37:08.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.235+0000 7f453b400640 1 -- 172.21.15.121:0/4016470455 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f453c003d30 con 0x7f4544156a50 2024-09-17T03:37:08.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.236+0000 7f454a600640 1 -- 172.21.15.121:0/4016470455 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45441f8fc0 con 0x7f4544156a50 2024-09-17T03:37:08.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.236+0000 7f453b400640 1 -- 172.21.15.121:0/4016470455 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c005330 con 0x7f4544156a50 2024-09-17T03:37:08.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.236+0000 7f454a600640 1 -- 172.21.15.121:0/4016470455 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45441f9580 con 0x7f4544156a50 2024-09-17T03:37:08.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.237+0000 7f454a600640 1 -- 172.21.15.121:0/4016470455 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45441f8d30 con 0x7f4544156a50 2024-09-17T03:37:08.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.238+0000 7f453b400640 1 -- 172.21.15.121:0/4016470455 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f453c0054d0 con 0x7f4544156a50 2024-09-17T03:37:08.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.239+0000 7f453b400640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4520078b90 0x7f452007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.239+0000 7f453b400640 1 -- 172.21.15.121:0/4016470455 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f453c09abe0 con 0x7f4544156a50 2024-09-17T03:37:08.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.239+0000 7f4543400640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4520078b90 0x7f452007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.240+0000 7f4543400640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4520078b90 0x7f452007b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4534004630 tx=0x7f453400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:08.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.243+0000 7f453b400640 1 -- 172.21.15.121:0/4016470455 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f45440c6700 con 0x7f4544156a50 2024-09-17T03:37:08.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.473+0000 7f454a600640 1 -- 172.21.15.121:0/4016470455 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f454406ddf0 con 0x7f4544156a50 2024-09-17T03:37:08.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.973+0000 7f453b400640 1 -- 172.21.15.121:0/4016470455 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f454406e740 con 0x7f4544156a50 2024-09-17T03:37:08.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.976+0000 7f454a600640 1 -- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4520078b90 msgr2=0x7f452007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.976+0000 7f454a600640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4520078b90 0x7f452007b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4534004630 tx=0x7f453400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.976+0000 7f454a600640 1 -- 172.21.15.121:0/4016470455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4544156a50 msgr2=0x7f45440b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.976+0000 7f454a600640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4544156a50 0x7f45440b50b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f453c00c6b0 tx=0x7f453c00cb70 comp rx=0 tx=0).stop 2024-09-17T03:37:08.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.976+0000 7f454a600640 1 -- 172.21.15.121:0/4016470455 shutdown_connections 2024-09-17T03:37:08.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.976+0000 7f454a600640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4520078b90 0x7f452007b0a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.976+0000 7f454a600640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4544156a50 0x7f45440b50b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.976+0000 7f454a600640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4544074b60 0x7f45440b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.976+0000 7f454a600640 1 --2- 172.21.15.121:0/4016470455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f454406e330 0x7f45440bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.976+0000 7f454a600640 1 -- 172.21.15.121:0/4016470455 >> 172.21.15.121:0/4016470455 conn(0x7f45440b1b90 msgr2=0x7f45440b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:08.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.977+0000 7f454a600640 1 -- 172.21.15.121:0/4016470455 shutdown_connections 2024-09-17T03:37:08.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:08.977+0000 7f454a600640 1 -- 172.21.15.121:0/4016470455 wait complete. 2024-09-17T03:37:09.001 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:37:09.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.225+0000 7f121b600640 1 -- 172.21.15.121:0/4016370239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f121406e2f0 msgr2=0x7f1214160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:09.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.225+0000 7f121b600640 1 --2- 172.21.15.121:0/4016370239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f121406e2f0 0x7f1214160a50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1214075dd0 tx=0x7f120c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:37:09.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.225+0000 7f121b600640 1 -- 172.21.15.121:0/4016370239 shutdown_connections 2024-09-17T03:37:09.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.225+0000 7f121b600640 1 --2- 172.21.15.121:0/4016370239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f121406e2f0 0x7f1214160a50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:09.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.225+0000 7f121b600640 1 --2- 172.21.15.121:0/4016370239 >> v2:172.21.15.176:3300/0 conn(0x7f12140ca690 0x7f1214160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:09.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.225+0000 7f121b600640 1 -- 172.21.15.121:0/4016370239 >> 172.21.15.121:0/4016370239 conn(0x7f12140ccac0 msgr2=0x7f12140cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:09.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.225+0000 7f121b600640 1 -- 172.21.15.121:0/4016370239 shutdown_connections 2024-09-17T03:37:09.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.225+0000 7f121b600640 1 -- 172.21.15.121:0/4016370239 wait complete. 2024-09-17T03:37:09.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.228+0000 7f121b600640 1 Processor -- start 2024-09-17T03:37:09.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.228+0000 7f121b600640 1 -- start start 2024-09-17T03:37:09.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.229+0000 7f121b600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f121406e2f0 0x7f12141f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:09.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.229+0000 7f121b600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12140ca690 0x7f1214156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:09.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.229+0000 7f121b600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1214160640 0x7f121415af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:09.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.229+0000 7f121b600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f121406f7c0 con 0x7f1214160640 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.229+0000 7f121b600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f121406f640 con 0x7f121406e2f0 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.229+0000 7f121b600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f121406f940 con 0x7f12140ca690 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.229+0000 7f1219600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1214160640 0x7f121415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1219600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1214160640 0x7f121415af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47610/0 (socket says 172.21.15.121:47610) 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1219600640 1 -- 172.21.15.121:0/343721463 learned_addr learned my addr 172.21.15.121:0/343721463 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1213e00640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12140ca690 0x7f1214156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1218c00640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f121406e2f0 0x7f12141f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1219600640 1 -- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12140ca690 msgr2=0x7f1214156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1219600640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12140ca690 0x7f1214156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1219600640 1 -- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f121406e2f0 msgr2=0x7f12141f9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1219600640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f121406e2f0 0x7f12141f9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1219600640 1 -- 172.21.15.121:0/343721463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12140b4a00 con 0x7f1214160640 2024-09-17T03:37:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1213e00640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12140ca690 0x7f1214156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:09.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.230+0000 7f1219600640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1214160640 0x7f121415af70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f120c009d60 tx=0x7f120c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:09.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.231+0000 7f1210c00640 1 -- 172.21.15.121:0/343721463 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c033050 con 0x7f1214160640 2024-09-17T03:37:09.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.231+0000 7f1210c00640 1 -- 172.21.15.121:0/343721463 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f120c004550 con 0x7f1214160640 2024-09-17T03:37:09.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.231+0000 7f1210c00640 1 -- 172.21.15.121:0/343721463 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c038450 con 0x7f1214160640 2024-09-17T03:37:09.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.231+0000 7f121b600640 1 -- 172.21.15.121:0/343721463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12140b4cc0 con 0x7f1214160640 2024-09-17T03:37:09.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.231+0000 7f121b600640 1 -- 172.21.15.121:0/343721463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12140b5280 con 0x7f1214160640 2024-09-17T03:37:09.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.232+0000 7f121b600640 1 -- 172.21.15.121:0/343721463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1214075780 con 0x7f1214160640 2024-09-17T03:37:09.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.233+0000 7f1210c00640 1 -- 172.21.15.121:0/343721463 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f120c036070 con 0x7f1214160640 2024-09-17T03:37:09.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.234+0000 7f1210c00640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f11f4078bc0 0x7f11f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:09.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.234+0000 7f1210c00640 1 -- 172.21.15.121:0/343721463 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f120c0bc540 con 0x7f1214160640 2024-09-17T03:37:09.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.234+0000 7f1218c00640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f11f4078bc0 0x7f11f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:09.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.235+0000 7f1218c00640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f11f4078bc0 0x7f11f407b0d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f12080098e0 tx=0x7f1208009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:09.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.238+0000 7f1210c00640 1 -- 172.21.15.121:0/343721463 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1214075780 con 0x7f1214160640 2024-09-17T03:37:09.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:09.423+0000 7f121b600640 1 -- 172.21.15.121:0/343721463 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1214160a50 con 0x7f1214160640 2024-09-17T03:37:10.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.427+0000 7f1210c00640 1 -- 172.21.15.121:0/343721463 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7f120c084700 con 0x7f1214160640 2024-09-17T03:37:10.427 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:37:10.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 -- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f11f4078bc0 msgr2=0x7f11f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f11f4078bc0 0x7f11f407b0d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f12080098e0 tx=0x7f1208009060 comp rx=0 tx=0).stop 2024-09-17T03:37:10.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 -- 172.21.15.121:0/343721463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1214160640 msgr2=0x7f121415af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1214160640 0x7f121415af70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f120c009d60 tx=0x7f120c003f10 comp rx=0 tx=0).stop 2024-09-17T03:37:10.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 -- 172.21.15.121:0/343721463 shutdown_connections 2024-09-17T03:37:10.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f11f4078bc0 0x7f11f407b0d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1214160640 0x7f121415af70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12140ca690 0x7f1214156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 --2- 172.21.15.121:0/343721463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f121406e2f0 0x7f12141f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 -- 172.21.15.121:0/343721463 >> 172.21.15.121:0/343721463 conn(0x7f12140ccac0 msgr2=0x7f12140b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:10.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 -- 172.21.15.121:0/343721463 shutdown_connections 2024-09-17T03:37:10.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.430+0000 7f121b600640 1 -- 172.21.15.121:0/343721463 wait complete. 2024-09-17T03:37:10.464 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:37:10.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.694+0000 7ff9c6200640 1 -- 172.21.15.121:0/870037483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9c0160810 msgr2=0x7ff9c006d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.694+0000 7ff9c6200640 1 --2- 172.21.15.121:0/870037483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9c0160810 0x7ff9c006d2e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac005fd0 tx=0x7ff9ac02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.695+0000 7ff9c6200640 1 -- 172.21.15.121:0/870037483 shutdown_connections 2024-09-17T03:37:10.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.695+0000 7ff9c6200640 1 --2- 172.21.15.121:0/870037483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9c0160c20 0x7ff9c006d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.695+0000 7ff9c6200640 1 --2- 172.21.15.121:0/870037483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9c0160810 0x7ff9c006d2e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.695+0000 7ff9c6200640 1 -- 172.21.15.121:0/870037483 >> 172.21.15.121:0/870037483 conn(0x7ff9c00ccac0 msgr2=0x7ff9c00cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:10.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.695+0000 7ff9c6200640 1 -- 172.21.15.121:0/870037483 shutdown_connections 2024-09-17T03:37:10.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.695+0000 7ff9c6200640 1 -- 172.21.15.121:0/870037483 wait complete. 2024-09-17T03:37:10.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.697+0000 7ff9c6200640 1 Processor -- start 2024-09-17T03:37:10.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.697+0000 7ff9c6200640 1 -- start start 2024-09-17T03:37:10.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.698+0000 7ff9c6200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9c00ca690 0x7ff9c0157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.698+0000 7ff9c6200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0160810 0x7ff9c01581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.698+0000 7ff9c6200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9c0160c20 0x7ff9c00c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.698+0000 7ff9c6200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c006e0f0 con 0x7ff9c0160810 2024-09-17T03:37:10.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.698+0000 7ff9c6200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c006df70 con 0x7ff9c0160c20 2024-09-17T03:37:10.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.698+0000 7ff9c6200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c006e270 con 0x7ff9c00ca690 2024-09-17T03:37:10.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.699+0000 7ff9bea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0160810 0x7ff9c01581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.699+0000 7ff9bea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0160810 0x7ff9c01581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47624/0 (socket says 172.21.15.121:47624) 2024-09-17T03:37:10.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.699+0000 7ff9bea00640 1 -- 172.21.15.121:0/1950699891 learned_addr learned my addr 172.21.15.121:0/1950699891 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:10.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.699+0000 7ff9bfe00640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9c0160c20 0x7ff9c00c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.699+0000 7ff9bf400640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9c00ca690 0x7ff9c0157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.699+0000 7ff9bea00640 1 -- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9c00ca690 msgr2=0x7ff9c0157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.699+0000 7ff9bea00640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9c00ca690 0x7ff9c0157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.699+0000 7ff9bea00640 1 -- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9c0160c20 msgr2=0x7ff9c00c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.699+0000 7ff9bea00640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9c0160c20 0x7ff9c00c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.699+0000 7ff9bea00640 1 -- 172.21.15.121:0/1950699891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c00c5e50 con 0x7ff9c0160810 2024-09-17T03:37:10.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.700+0000 7ff9bea00640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0160810 0x7ff9c01581b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac006010 tx=0x7ff9ac0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:10.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.700+0000 7ff9b7400640 1 -- 172.21.15.121:0/1950699891 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac03e030 con 0x7ff9c0160810 2024-09-17T03:37:10.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.700+0000 7ff9b7400640 1 -- 172.21.15.121:0/1950699891 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9ac003ae0 con 0x7ff9c0160810 2024-09-17T03:37:10.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.700+0000 7ff9c6200640 1 -- 172.21.15.121:0/1950699891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c00c62c0 con 0x7ff9c0160810 2024-09-17T03:37:10.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.700+0000 7ff9b7400640 1 -- 172.21.15.121:0/1950699891 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac035040 con 0x7ff9c0160810 2024-09-17T03:37:10.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.700+0000 7ff9c6200640 1 -- 172.21.15.121:0/1950699891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c00c3d80 con 0x7ff9c0160810 2024-09-17T03:37:10.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.701+0000 7ff9c6200640 1 -- 172.21.15.121:0/1950699891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c00c6020 con 0x7ff9c0160810 2024-09-17T03:37:10.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.702+0000 7ff9b7400640 1 -- 172.21.15.121:0/1950699891 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9ac041030 con 0x7ff9c0160810 2024-09-17T03:37:10.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.703+0000 7ff9b7400640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff9a0078b90 0x7ff9a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.703+0000 7ff9b7400640 1 -- 172.21.15.121:0/1950699891 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5836+0+0 (secure 0 0 0) 0x7ff9ac0bb280 con 0x7ff9c0160810 2024-09-17T03:37:10.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.704+0000 7ff9bf400640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff9a0078b90 0x7ff9a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.705+0000 7ff9bf400640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff9a0078b90 0x7ff9a007b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0001720 tx=0x7ff9b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:10.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.708+0000 7ff9b7400640 1 -- 172.21.15.121:0/1950699891 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff9c00c6020 con 0x7ff9c0160810 2024-09-17T03:37:10.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:10.892+0000 7ff9c6200640 1 -- 172.21.15.121:0/1950699891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff9c0160100 con 0x7ff9c0160810 2024-09-17T03:37:11.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.433+0000 7ff9b7400640 1 -- 172.21.15.121:0/1950699891 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7ff9ac082fe0 con 0x7ff9c0160810 2024-09-17T03:37:11.433 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-17T03:37:11.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.438+0000 7ff9c6200640 1 -- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff9a0078b90 msgr2=0x7ff9a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.438+0000 7ff9c6200640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff9a0078b90 0x7ff9a007b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0001720 tx=0x7ff9b0009040 comp rx=0 tx=0).stop 2024-09-17T03:37:11.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.438+0000 7ff9c6200640 1 -- 172.21.15.121:0/1950699891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0160810 msgr2=0x7ff9c01581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.438+0000 7ff9c6200640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0160810 0x7ff9c01581b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac006010 tx=0x7ff9ac0035f0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.439+0000 7ff9c6200640 1 -- 172.21.15.121:0/1950699891 shutdown_connections 2024-09-17T03:37:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.439+0000 7ff9c6200640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9c0160c20 0x7ff9c00c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.439+0000 7ff9c6200640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff9a0078b90 0x7ff9a007b0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.439+0000 7ff9c6200640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0160810 0x7ff9c01581b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.439+0000 7ff9c6200640 1 --2- 172.21.15.121:0/1950699891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9c00ca690 0x7ff9c0157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.439+0000 7ff9c6200640 1 -- 172.21.15.121:0/1950699891 >> 172.21.15.121:0/1950699891 conn(0x7ff9c00ccac0 msgr2=0x7ff9c00b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.439+0000 7ff9c6200640 1 -- 172.21.15.121:0/1950699891 shutdown_connections 2024-09-17T03:37:11.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.439+0000 7ff9c6200640 1 -- 172.21.15.121:0/1950699891 wait complete. 2024-09-17T03:37:11.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:37:11.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.699+0000 7fcc7ee00640 1 -- 172.21.15.121:0/1967139329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc780cc530 msgr2=0x7fcc7815ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.699+0000 7fcc7ee00640 1 --2- 172.21.15.121:0/1967139329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc780cc530 0x7fcc7815ead0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcc7815f010 tx=0x7fcc6802a560 comp rx=0 tx=0).stop 2024-09-17T03:37:11.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.699+0000 7fcc7ee00640 1 -- 172.21.15.121:0/1967139329 shutdown_connections 2024-09-17T03:37:11.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.699+0000 7fcc7ee00640 1 --2- 172.21.15.121:0/1967139329 >> v2:172.21.15.176:3300/0 conn(0x7fcc7806e500 0x7fcc780ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.699+0000 7fcc7ee00640 1 --2- 172.21.15.121:0/1967139329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc780cc530 0x7fcc7815ead0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.699+0000 7fcc7ee00640 1 -- 172.21.15.121:0/1967139329 >> 172.21.15.121:0/1967139329 conn(0x7fcc780b1b90 msgr2=0x7fcc780b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.699+0000 7fcc7ee00640 1 -- 172.21.15.121:0/1967139329 shutdown_connections 2024-09-17T03:37:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.699+0000 7fcc7ee00640 1 -- 172.21.15.121:0/1967139329 wait complete. 2024-09-17T03:37:11.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.701+0000 7fcc7ee00640 1 Processor -- start 2024-09-17T03:37:11.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.701+0000 7fcc7ee00640 1 -- start start 2024-09-17T03:37:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.703+0000 7fcc7ee00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc780af5b0 0x7fcc78150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.703+0000 7fcc7ee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc780cc530 0x7fcc780a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.703+0000 7fcc7ee00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc780b5560 0x7fcc781f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.703+0000 7fcc7ee00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780cec10 con 0x7fcc780af5b0 2024-09-17T03:37:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.703+0000 7fcc7ee00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780cea90 con 0x7fcc780b5560 2024-09-17T03:37:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.703+0000 7fcc7ee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcc780ced90 con 0x7fcc780cc530 2024-09-17T03:37:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.703+0000 7fcc77e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc780af5b0 0x7fcc78150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.703+0000 7fcc77e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc780af5b0 0x7fcc78150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47642/0 (socket says 172.21.15.121:47642) 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.703+0000 7fcc77e00640 1 -- 172.21.15.121:0/2485683635 learned_addr learned my addr 172.21.15.121:0/2485683635 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.703+0000 7fcc77400640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc780cc530 0x7fcc780a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc77e00640 1 -- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc780cc530 msgr2=0x7fcc780a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc7ce00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc780b5560 0x7fcc781f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc77e00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc780cc530 0x7fcc780a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc77e00640 1 -- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc780b5560 msgr2=0x7fcc781f88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc77e00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc780b5560 0x7fcc781f88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc77e00640 1 -- 172.21.15.121:0/2485683635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc78150b70 con 0x7fcc780af5b0 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc77400640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc780cc530 0x7fcc780a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc7ce00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc780b5560 0x7fcc781f88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc77e00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc780af5b0 0x7fcc78150630 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcc68034040 tx=0x7fcc680039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc6fe00640 1 -- 172.21.15.121:0/2485683635 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6803e030 con 0x7fcc780af5b0 2024-09-17T03:37:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc6fe00640 1 -- 172.21.15.121:0/2485683635 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc680047a0 con 0x7fcc780af5b0 2024-09-17T03:37:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc7ee00640 1 -- 172.21.15.121:0/2485683635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc780b44c0 con 0x7fcc780af5b0 2024-09-17T03:37:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc6fe00640 1 -- 172.21.15.121:0/2485683635 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68035040 con 0x7fcc780af5b0 2024-09-17T03:37:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.704+0000 7fcc7ee00640 1 -- 172.21.15.121:0/2485683635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc780b4a80 con 0x7fcc780af5b0 2024-09-17T03:37:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.705+0000 7fcc7ee00640 1 -- 172.21.15.121:0/2485683635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc780ce510 con 0x7fcc780af5b0 2024-09-17T03:37:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.707+0000 7fcc6fe00640 1 -- 172.21.15.121:0/2485683635 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc68041030 con 0x7fcc780af5b0 2024-09-17T03:37:11.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.708+0000 7fcc6fe00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcc58078bc0 0x7fcc5807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.708+0000 7fcc6fe00640 1 -- 172.21.15.121:0/2485683635 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fcc680bb5c0 con 0x7fcc780af5b0 2024-09-17T03:37:11.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.708+0000 7fcc77400640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcc58078bc0 0x7fcc5807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.709+0000 7fcc77400640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcc58078bc0 0x7fcc5807b0d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcc781621e0 tx=0x7fcc64008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.712+0000 7fcc6fe00640 1 -- 172.21.15.121:0/2485683635 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc78150b70 con 0x7fcc780af5b0 2024-09-17T03:37:11.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.895+0000 7fcc7ee00640 1 -- 172.21.15.121:0/2485683635 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fcc7806f2b0 con 0x7fcc780af5b0 2024-09-17T03:37:11.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.900+0000 7fcc6fe00640 1 -- 172.21.15.121:0/2485683635 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v34) ==== 71+0+0 (secure 0 0 0) 0x7fcc68083ad0 con 0x7fcc780af5b0 2024-09-17T03:37:11.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 -- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcc58078bc0 msgr2=0x7fcc5807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcc58078bc0 0x7fcc5807b0d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcc781621e0 tx=0x7fcc64008040 comp rx=0 tx=0).stop 2024-09-17T03:37:11.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 -- 172.21.15.121:0/2485683635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc780af5b0 msgr2=0x7fcc78150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc780af5b0 0x7fcc78150630 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcc68034040 tx=0x7fcc680039e0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 -- 172.21.15.121:0/2485683635 shutdown_connections 2024-09-17T03:37:11.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc780b5560 0x7fcc781f88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcc780cc530 0x7fcc780a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcc58078bc0 0x7fcc5807b0d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 --2- 172.21.15.121:0/2485683635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc780af5b0 0x7fcc78150630 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 -- 172.21.15.121:0/2485683635 >> 172.21.15.121:0/2485683635 conn(0x7fcc780b1b90 msgr2=0x7fcc7809ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 -- 172.21.15.121:0/2485683635 shutdown_connections 2024-09-17T03:37:11.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:11.903+0000 7fcc7ee00640 1 -- 172.21.15.121:0/2485683635 wait complete. 2024-09-17T03:37:11.925 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2024-09-17T03:37:12.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.144+0000 7f7627200640 1 -- 172.21.15.121:0/2917938882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762815b370 msgr2=0x7f762815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.144+0000 7f7627200640 1 --2- 172.21.15.121:0/2917938882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762815b370 0x7f762815c370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7618005fd0 tx=0x7f761802aa10 comp rx=0 tx=0).stop 2024-09-17T03:37:12.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.145+0000 7f7627200640 1 -- 172.21.15.121:0/2917938882 shutdown_connections 2024-09-17T03:37:12.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.145+0000 7f7627200640 1 --2- 172.21.15.121:0/2917938882 >> v2:172.21.15.176:3300/0 conn(0x7f762815c8b0 0x7f762806def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.145+0000 7f7627200640 1 --2- 172.21.15.121:0/2917938882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762815b370 0x7f762815c370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.145+0000 7f7627200640 1 -- 172.21.15.121:0/2917938882 >> 172.21.15.121:0/2917938882 conn(0x7f762806f940 msgr2=0x7f76280b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:12.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.145+0000 7f7627200640 1 -- 172.21.15.121:0/2917938882 shutdown_connections 2024-09-17T03:37:12.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.145+0000 7f7627200640 1 -- 172.21.15.121:0/2917938882 wait complete. 2024-09-17T03:37:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.147+0000 7f7627200640 1 Processor -- start 2024-09-17T03:37:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.147+0000 7f7627200640 1 -- start start 2024-09-17T03:37:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7627200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762806e430 0x7f762815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7627200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762815b370 0x7f762815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7627200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762815c8b0 0x7f76281e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7627200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f762815f7d0 con 0x7f762806e430 2024-09-17T03:37:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7627200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f762815f650 con 0x7f762815b370 2024-09-17T03:37:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7627200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f762815f950 con 0x7f762815c8b0 2024-09-17T03:37:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7625e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762806e430 0x7f762815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7625e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762806e430 0x7f762815d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60892/0 (socket says 172.21.15.121:60892) 2024-09-17T03:37:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7625e00640 1 -- 172.21.15.121:0/3795390652 learned_addr learned my addr 172.21.15.121:0/3795390652 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7626800640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762815c8b0 0x7f76281e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7625400640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762815b370 0x7f762815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7625e00640 1 -- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762815c8b0 msgr2=0x7f76281e8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7625e00640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762815c8b0 0x7f76281e8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7625e00640 1 -- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762815b370 msgr2=0x7f762815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7625e00640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762815b370 0x7f762815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7625e00640 1 -- 172.21.15.121:0/3795390652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762815e560 con 0x7f762806e430 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.149+0000 7f7625400640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762815b370 0x7f762815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.150+0000 7f7625e00640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762806e430 0x7f762815d800 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7618009d90 tx=0x7f7618003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.150+0000 7f761e000640 1 -- 172.21.15.121:0/3795390652 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618033050 con 0x7f762806e430 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.150+0000 7f761e000640 1 -- 172.21.15.121:0/3795390652 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7618004470 con 0x7f762806e430 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.150+0000 7f761e000640 1 -- 172.21.15.121:0/3795390652 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618038450 con 0x7f762806e430 2024-09-17T03:37:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.150+0000 7f7627200640 1 -- 172.21.15.121:0/3795390652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76280afd10 con 0x7f762806e430 2024-09-17T03:37:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.150+0000 7f7627200640 1 -- 172.21.15.121:0/3795390652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76280b02d0 con 0x7f762806e430 2024-09-17T03:37:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.151+0000 7f7627200640 1 -- 172.21.15.121:0/3795390652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762815c370 con 0x7f762806e430 2024-09-17T03:37:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.152+0000 7f761e000640 1 -- 172.21.15.121:0/3795390652 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7618036070 con 0x7f762806e430 2024-09-17T03:37:12.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.153+0000 7f761e000640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7608078b90 0x7f760807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:12.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.154+0000 7f761e000640 1 -- 172.21.15.121:0/3795390652 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f76180bbf80 con 0x7f762806e430 2024-09-17T03:37:12.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.154+0000 7f7625400640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7608078b90 0x7f760807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:12.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.155+0000 7f7625400640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7608078b90 0x7f760807b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7628147490 tx=0x7f7614005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:12.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.158+0000 7f761e000640 1 -- 172.21.15.121:0/3795390652 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7618084540 con 0x7f762806e430 2024-09-17T03:37:12.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.408+0000 7f7627200640 1 -- 172.21.15.121:0/3795390652 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) -- 0x7f76280af310 con 0x7f762806e430 2024-09-17T03:37:12.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.435+0000 7f761e000640 1 -- 172.21.15.121:0/3795390652 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v115) ==== 144+0+0 (secure 0 0 0) 0x7f7618083e40 con 0x7f762806e430 2024-09-17T03:37:12.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.437+0000 7f7627200640 1 -- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7608078b90 msgr2=0x7f760807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.437+0000 7f7627200640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7608078b90 0x7f760807b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7628147490 tx=0x7f7614005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:12.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.437+0000 7f7627200640 1 -- 172.21.15.121:0/3795390652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762806e430 msgr2=0x7f762815d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.437+0000 7f7627200640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762806e430 0x7f762815d800 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7618009d90 tx=0x7f7618003f90 comp rx=0 tx=0).stop 2024-09-17T03:37:12.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.437+0000 7f7627200640 1 -- 172.21.15.121:0/3795390652 shutdown_connections 2024-09-17T03:37:12.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.437+0000 7f7627200640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f762815c8b0 0x7f76281e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.437+0000 7f7627200640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f762815b370 0x7f762815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.437+0000 7f7627200640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7608078b90 0x7f760807b0a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.437+0000 7f7627200640 1 --2- 172.21.15.121:0/3795390652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762806e430 0x7f762815d800 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.437+0000 7f7627200640 1 -- 172.21.15.121:0/3795390652 >> 172.21.15.121:0/3795390652 conn(0x7f762806f940 msgr2=0x7f7628158130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:12.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.438+0000 7f7627200640 1 -- 172.21.15.121:0/3795390652 shutdown_connections 2024-09-17T03:37:12.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.438+0000 7f7627200640 1 -- 172.21.15.121:0/3795390652 wait complete. 2024-09-17T03:37:12.462 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back ... ok 2024-09-17T03:37:12.463 INFO:tasks.cephfs_test_runner:Starting test: test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) Check that mds evicts blocklisted client 2024-09-17T03:37:12.463 INFO:tasks.cephfs_test_runner:test_session_evict_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-17T03:37:12.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.683+0000 7fab67e00640 1 -- 172.21.15.121:0/2018701450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab681629c0 msgr2=0x7fab6806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.683+0000 7fab67e00640 1 --2- 172.21.15.121:0/2018701450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab681629c0 0x7fab6806d2b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fab680c7db0 tx=0x7fab5402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.683+0000 7fab67e00640 1 -- 172.21.15.121:0/2018701450 shutdown_connections 2024-09-17T03:37:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.683+0000 7fab67e00640 1 --2- 172.21.15.121:0/2018701450 >> v2:172.21.15.176:3300/0 conn(0x7fab6806d7f0 0x7fab68154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.683+0000 7fab67e00640 1 --2- 172.21.15.121:0/2018701450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab681629c0 0x7fab6806d2b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.683+0000 7fab67e00640 1 -- 172.21.15.121:0/2018701450 >> 172.21.15.121:0/2018701450 conn(0x7fab680d1930 msgr2=0x7fab680d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.683+0000 7fab67e00640 1 -- 172.21.15.121:0/2018701450 shutdown_connections 2024-09-17T03:37:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.683+0000 7fab67e00640 1 -- 172.21.15.121:0/2018701450 wait complete. 2024-09-17T03:37:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.685+0000 7fab67e00640 1 Processor -- start 2024-09-17T03:37:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.685+0000 7fab67e00640 1 -- start start 2024-09-17T03:37:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab67e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab6806d7f0 0x7fab6814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab67e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab680b9e40 0x7fab68150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab67e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab6814eb00 0x7fab681509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab67e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fab68155770 con 0x7fab6806d7f0 2024-09-17T03:37:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab67e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fab681555f0 con 0x7fab6814eb00 2024-09-17T03:37:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab67e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fab681558f0 con 0x7fab680b9e40 2024-09-17T03:37:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab66a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab6806d7f0 0x7fab6814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab66a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab6806d7f0 0x7fab6814cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60920/0 (socket says 172.21.15.121:60920) 2024-09-17T03:37:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab66a00640 1 -- 172.21.15.121:0/2119088638 learned_addr learned my addr 172.21.15.121:0/2119088638 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab66000640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab680b9e40 0x7fab68150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab67400640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab6814eb00 0x7fab681509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab66a00640 1 -- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab680b9e40 msgr2=0x7fab68150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab66a00640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab680b9e40 0x7fab68150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab66a00640 1 -- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab6814eb00 msgr2=0x7fab681509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab66a00640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab6814eb00 0x7fab681509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.687+0000 7fab66a00640 1 -- 172.21.15.121:0/2119088638 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab68150ee0 con 0x7fab6806d7f0 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.688+0000 7fab66a00640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab6806d7f0 0x7fab6814cb50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c3d0 tx=0x7fab5800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.688+0000 7fab5ea00640 1 -- 172.21.15.121:0/2119088638 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58017070 con 0x7fab6806d7f0 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.688+0000 7fab5ea00640 1 -- 172.21.15.121:0/2119088638 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab580053c0 con 0x7fab6806d7f0 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.688+0000 7fab5ea00640 1 -- 172.21.15.121:0/2119088638 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58003850 con 0x7fab6806d7f0 2024-09-17T03:37:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.688+0000 7fab67e00640 1 -- 172.21.15.121:0/2119088638 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab681511a0 con 0x7fab6806d7f0 2024-09-17T03:37:12.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.688+0000 7fab67e00640 1 -- 172.21.15.121:0/2119088638 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab68156b20 con 0x7fab6806d7f0 2024-09-17T03:37:12.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.689+0000 7fab67e00640 1 -- 172.21.15.121:0/2119088638 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab68154ea0 con 0x7fab6806d7f0 2024-09-17T03:37:12.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.690+0000 7fab5ea00640 1 -- 172.21.15.121:0/2119088638 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab5801a070 con 0x7fab6806d7f0 2024-09-17T03:37:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.691+0000 7fab5ea00640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fab48078bc0 0x7fab4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.691+0000 7fab5ea00640 1 -- 172.21.15.121:0/2119088638 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fab58099e80 con 0x7fab6806d7f0 2024-09-17T03:37:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.692+0000 7fab66000640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fab48078bc0 0x7fab4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:12.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.692+0000 7fab66000640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fab48078bc0 0x7fab4807b0d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab54033000 tx=0x7fab54004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:12.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.695+0000 7fab5ea00640 1 -- 172.21.15.121:0/2119088638 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab68163170 con 0x7fab6806d7f0 2024-09-17T03:37:12.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.878+0000 7fab67e00640 1 -- 172.21.15.121:0/2119088638 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab68161cf0 con 0x7fab6806d7f0 2024-09-17T03:37:12.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.879+0000 7fab5ea00640 1 -- 172.21.15.121:0/2119088638 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+13367 (secure 0 0 0) 0x7fab58061dd0 con 0x7fab6806d7f0 2024-09-17T03:37:12.879 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:12.879 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":43,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:37:11.428388+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6835/3665568713":"2024-09-18T03:37:07.970206+0000","172.21.15.121:6833/3665568713":"2024-09-18T03:37:07.970206+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 -- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fab48078bc0 msgr2=0x7fab4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fab48078bc0 0x7fab4807b0d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab54033000 tx=0x7fab54004730 comp rx=0 tx=0).stop 2024-09-17T03:37:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 -- 172.21.15.121:0/2119088638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab6806d7f0 msgr2=0x7fab6814cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab6806d7f0 0x7fab6814cb50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c3d0 tx=0x7fab5800c890 comp rx=0 tx=0).stop 2024-09-17T03:37:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 -- 172.21.15.121:0/2119088638 shutdown_connections 2024-09-17T03:37:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab6814eb00 0x7fab681509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab680b9e40 0x7fab68150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fab48078bc0 0x7fab4807b0d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 --2- 172.21.15.121:0/2119088638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab6806d7f0 0x7fab6814cb50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 -- 172.21.15.121:0/2119088638 >> 172.21.15.121:0/2119088638 conn(0x7fab680d1930 msgr2=0x7fab681ea8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:12.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 -- 172.21.15.121:0/2119088638 shutdown_connections 2024-09-17T03:37:12.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:12.881+0000 7fab67e00640 1 -- 172.21.15.121:0/2119088638 wait complete. 2024-09-17T03:37:12.903 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:35:21.303701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:37:12.904 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.128+0000 7f27f0a00640 1 -- 172.21.15.121:0/856712900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d0003a50 msgr2=0x7f27d0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.128+0000 7f27f0a00640 1 --2- 172.21.15.121:0/856712900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d0003a50 0x7f27d0003ec0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00c2e0 tx=0x7f27d0005830 comp rx=0 tx=0).stop 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.129+0000 7f27f0a00640 1 -- 172.21.15.121:0/856712900 shutdown_connections 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.129+0000 7f27f0a00640 1 --2- 172.21.15.121:0/856712900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d0003a50 0x7f27d0003ec0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.129+0000 7f27f0a00640 1 -- 172.21.15.121:0/856712900 >> 172.21.15.121:0/856712900 conn(0x7f27ec0cca40 msgr2=0x7f27ec0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.129+0000 7f27f0a00640 1 -- 172.21.15.121:0/856712900 shutdown_connections 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.129+0000 7f27f0a00640 1 -- 172.21.15.121:0/856712900 wait complete. 2024-09-17T03:37:13.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.131+0000 7f27f0a00640 1 Processor -- start 2024-09-17T03:37:13.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.131+0000 7f27f0a00640 1 -- start start 2024-09-17T03:37:13.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.132+0000 7f27f0a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27d0003a50 0x7f27ec09c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.132+0000 7f27f0a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27ec0a07a0 0x7f27ec0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.132+0000 7f27f0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27ec156d80 0x7f27ec157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.132+0000 7f27f0a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec0cc100 con 0x7f27ec0a07a0 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.132+0000 7f27f0a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec0cbf80 con 0x7f27d0003a50 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.132+0000 7f27f0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f27ec0cc280 con 0x7f27ec156d80 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27ec0a07a0 0x7f27ec0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27ec0a07a0 0x7f27ec0b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60938/0 (socket says 172.21.15.121:60938) 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9400640 1 -- 172.21.15.121:0/546892728 learned_addr learned my addr 172.21.15.121:0/546892728 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9e00640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27d0003a50 0x7f27ec09c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27ea800640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27ec156d80 0x7f27ec157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9400640 1 -- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27ec156d80 msgr2=0x7f27ec157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9400640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27ec156d80 0x7f27ec157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9400640 1 -- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27d0003a50 msgr2=0x7f27ec09c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9400640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27d0003a50 0x7f27ec09c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9400640 1 -- 172.21.15.121:0/546892728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec1576d0 con 0x7f27ec0a07a0 2024-09-17T03:37:13.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9e00640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27d0003a50 0x7f27ec09c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:13.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27ea800640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27ec156d80 0x7f27ec157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:13.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.133+0000 7f27e9400640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27ec0a07a0 0x7f27ec0b3050 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f27d8003e90 tx=0x7f27d8001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:13.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.134+0000 7f27e2000640 1 -- 172.21.15.121:0/546892728 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8015070 con 0x7f27ec0a07a0 2024-09-17T03:37:13.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.134+0000 7f27e2000640 1 -- 172.21.15.121:0/546892728 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27d8011840 con 0x7f27ec0a07a0 2024-09-17T03:37:13.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.134+0000 7f27e2000640 1 -- 172.21.15.121:0/546892728 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8011c90 con 0x7f27ec0a07a0 2024-09-17T03:37:13.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.134+0000 7f27f0a00640 1 -- 172.21.15.121:0/546892728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ec09b490 con 0x7f27ec0a07a0 2024-09-17T03:37:13.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.134+0000 7f27f0a00640 1 -- 172.21.15.121:0/546892728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ec09ba10 con 0x7f27ec0a07a0 2024-09-17T03:37:13.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.135+0000 7f27f0a00640 1 -- 172.21.15.121:0/546892728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ec0b5bb0 con 0x7f27ec0a07a0 2024-09-17T03:37:13.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.136+0000 7f27e2000640 1 -- 172.21.15.121:0/546892728 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f27d8018070 con 0x7f27ec0a07a0 2024-09-17T03:37:13.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.137+0000 7f27e2000640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f27cc078b90 0x7f27cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.137+0000 7f27e2000640 1 -- 172.21.15.121:0/546892728 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f27d809b7d0 con 0x7f27ec0a07a0 2024-09-17T03:37:13.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.137+0000 7f27e9e00640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f27cc078b90 0x7f27cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.138+0000 7f27e9e00640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f27cc078b90 0x7f27cc07b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f27dc033000 tx=0x7f27dc0019f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:13.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.142+0000 7f27e2000640 1 -- 172.21.15.121:0/546892728 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f27ec1576d0 con 0x7f27ec0a07a0 2024-09-17T03:37:13.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.325+0000 7f27f0a00640 1 -- 172.21.15.121:0/546892728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f27ec06e000 con 0x7f27ec0a07a0 2024-09-17T03:37:13.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.326+0000 7f27e2000640 1 -- 172.21.15.121:0/546892728 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) ==== 93+0+10 (secure 0 0 0) 0x7f27d8063d80 con 0x7f27ec0a07a0 2024-09-17T03:37:13.326 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-17T03:37:13.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.328+0000 7f27f0a00640 1 -- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f27cc078b90 msgr2=0x7f27cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.328+0000 7f27f0a00640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f27cc078b90 0x7f27cc07b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f27dc033000 tx=0x7f27dc0019f0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.328+0000 7f27f0a00640 1 -- 172.21.15.121:0/546892728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27ec0a07a0 msgr2=0x7f27ec0b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.328+0000 7f27f0a00640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27ec0a07a0 0x7f27ec0b3050 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f27d8003e90 tx=0x7f27d8001630 comp rx=0 tx=0).stop 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.328+0000 7f27f0a00640 1 -- 172.21.15.121:0/546892728 shutdown_connections 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.329+0000 7f27f0a00640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27ec156d80 0x7f27ec157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.329+0000 7f27f0a00640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f27cc078b90 0x7f27cc07b0a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.329+0000 7f27f0a00640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27ec0a07a0 0x7f27ec0b3050 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.329+0000 7f27f0a00640 1 --2- 172.21.15.121:0/546892728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27d0003a50 0x7f27ec09c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.329+0000 7f27f0a00640 1 -- 172.21.15.121:0/546892728 >> 172.21.15.121:0/546892728 conn(0x7f27ec0cca40 msgr2=0x7f27ec15e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.329+0000 7f27f0a00640 1 -- 172.21.15.121:0/546892728 shutdown_connections 2024-09-17T03:37:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.329+0000 7f27f0a00640 1 -- 172.21.15.121:0/546892728 wait complete. 2024-09-17T03:37:13.353 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-09-17T03:37:13.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.573+0000 7f24bf000640 1 -- 172.21.15.121:0/2783811479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24b8074cb0 msgr2=0x7f24b8073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.573+0000 7f24bf000640 1 --2- 172.21.15.121:0/2783811479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24b8074cb0 0x7f24b8073dd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24a8005fd0 tx=0x7f24a802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.573+0000 7f24bf000640 1 -- 172.21.15.121:0/2783811479 shutdown_connections 2024-09-17T03:37:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.573+0000 7f24bf000640 1 --2- 172.21.15.121:0/2783811479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24b806e500 0x7f24b80cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.573+0000 7f24bf000640 1 --2- 172.21.15.121:0/2783811479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24b8074cb0 0x7f24b8073dd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.573+0000 7f24bf000640 1 -- 172.21.15.121:0/2783811479 >> 172.21.15.121:0/2783811479 conn(0x7f24b80cca40 msgr2=0x7f24b80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.573+0000 7f24bf000640 1 -- 172.21.15.121:0/2783811479 shutdown_connections 2024-09-17T03:37:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.573+0000 7f24bf000640 1 -- 172.21.15.121:0/2783811479 wait complete. 2024-09-17T03:37:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.576+0000 7f24bf000640 1 Processor -- start 2024-09-17T03:37:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.576+0000 7f24bf000640 1 -- start start 2024-09-17T03:37:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.577+0000 7f24bf000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24b8074cb0 0x7f24b80a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.577+0000 7f24bf000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24b80cbc10 0x7f24b8158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.577+0000 7f24bf000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24b80b5620 0x7f24b80c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.577+0000 7f24bf000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f24b806f3f0 con 0x7f24b80cbc10 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.577+0000 7f24bf000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24b806f270 con 0x7f24b80b5620 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.577+0000 7f24bf000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24b806f570 con 0x7f24b8074cb0 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.577+0000 7f24b7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24b80cbc10 0x7f24b8158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24b7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24b80cbc10 0x7f24b8158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60962/0 (socket says 172.21.15.121:60962) 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24b7400640 1 -- 172.21.15.121:0/3216083730 learned_addr learned my addr 172.21.15.121:0/3216083730 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24bd000640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24b80b5620 0x7f24b80c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24b7e00640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24b8074cb0 0x7f24b80a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24b7400640 1 -- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24b8074cb0 msgr2=0x7f24b80a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24b7400640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24b8074cb0 0x7f24b80a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24b7400640 1 -- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24b80b5620 msgr2=0x7f24b80c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24b7400640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24b80b5620 0x7f24b80c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24b7400640 1 -- 172.21.15.121:0/3216083730 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b8158ed0 con 0x7f24b80cbc10 2024-09-17T03:37:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24bd000640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24b80b5620 0x7f24b80c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.578+0000 7f24b7400640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24b80cbc10 0x7f24b8158990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f24a400c3f0 tx=0x7f24a400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.579+0000 7f24afe00640 1 -- 172.21.15.121:0/3216083730 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4017070 con 0x7f24b80cbc10 2024-09-17T03:37:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.579+0000 7f24afe00640 1 -- 172.21.15.121:0/3216083730 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24a40035f0 con 0x7f24b80cbc10 2024-09-17T03:37:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.579+0000 7f24afe00640 1 -- 172.21.15.121:0/3216083730 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4003a40 con 0x7f24b80cbc10 2024-09-17T03:37:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.579+0000 7f24bf000640 1 -- 172.21.15.121:0/3216083730 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b80b5d50 con 0x7f24b80cbc10 2024-09-17T03:37:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.579+0000 7f24bf000640 1 -- 172.21.15.121:0/3216083730 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b81f91c0 con 0x7f24b80cbc10 2024-09-17T03:37:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.580+0000 7f24bf000640 1 -- 172.21.15.121:0/3216083730 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b80b5ac0 con 0x7f24b80cbc10 2024-09-17T03:37:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.581+0000 7f24afe00640 1 -- 172.21.15.121:0/3216083730 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24a401a070 con 0x7f24b80cbc10 2024-09-17T03:37:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.582+0000 7f24afe00640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2498078b90 0x7f249807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.582+0000 7f24afe00640 1 -- 172.21.15.121:0/3216083730 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f24a4099de0 con 0x7f24b80cbc10 2024-09-17T03:37:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.582+0000 7f24b7e00640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2498078b90 0x7f249807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.583+0000 7f24b7e00640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2498078b90 0x7f249807b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f24a8033000 tx=0x7f24a8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.586+0000 7f24afe00640 1 -- 172.21.15.121:0/3216083730 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f24a4061df0 con 0x7f24b80cbc10 2024-09-17T03:37:13.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:13.835+0000 7f24bf000640 1 -- 172.21.15.121:0/3216083730 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) -- 0x7f24b806fab0 con 0x7f24b80cbc10 2024-09-17T03:37:14.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.443+0000 7f24afe00640 1 -- 172.21.15.121:0/3216083730 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v117) ==== 156+0+0 (secure 0 0 0) 0x7f24a4066820 con 0x7f24b80cbc10 2024-09-17T03:37:14.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 -- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2498078b90 msgr2=0x7f249807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:14.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2498078b90 0x7f249807b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f24a8033000 tx=0x7f24a8004730 comp rx=0 tx=0).stop 2024-09-17T03:37:14.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 -- 172.21.15.121:0/3216083730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24b80cbc10 msgr2=0x7f24b8158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:14.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24b80cbc10 0x7f24b8158990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f24a400c3f0 tx=0x7f24a400c8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 -- 172.21.15.121:0/3216083730 shutdown_connections 2024-09-17T03:37:14.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24b80b5620 0x7f24b80c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2498078b90 0x7f249807b0a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24b80cbc10 0x7f24b8158990 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 --2- 172.21.15.121:0/3216083730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24b8074cb0 0x7f24b80a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 -- 172.21.15.121:0/3216083730 >> 172.21.15.121:0/3216083730 conn(0x7f24b80cca40 msgr2=0x7f24b815a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:14.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 -- 172.21.15.121:0/3216083730 shutdown_connections 2024-09-17T03:37:14.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.447+0000 7f24bf000640 1 -- 172.21.15.121:0/3216083730 wait complete. 2024-09-17T03:37:14.473 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:37:14.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.695+0000 7fe054000640 1 -- 172.21.15.121:0/4086276015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe04c06e330 msgr2=0x7fe04c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:14.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.695+0000 7fe054000640 1 --2- 172.21.15.121:0/4086276015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe04c06e330 0x7fe04c06ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe044009830 tx=0x7fe04402a510 comp rx=0 tx=0).stop 2024-09-17T03:37:14.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.695+0000 7fe054000640 1 -- 172.21.15.121:0/4086276015 shutdown_connections 2024-09-17T03:37:14.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.695+0000 7fe054000640 1 --2- 172.21.15.121:0/4086276015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe04c06e330 0x7fe04c06ede0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.695+0000 7fe054000640 1 --2- 172.21.15.121:0/4086276015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe04c073dd0 0x7fe04c06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.695+0000 7fe054000640 1 -- 172.21.15.121:0/4086276015 >> 172.21.15.121:0/4086276015 conn(0x7fe04c0cca40 msgr2=0x7fe04c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:14.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.695+0000 7fe054000640 1 -- 172.21.15.121:0/4086276015 shutdown_connections 2024-09-17T03:37:14.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.695+0000 7fe054000640 1 -- 172.21.15.121:0/4086276015 wait complete. 2024-09-17T03:37:14.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.697+0000 7fe054000640 1 Processor -- start 2024-09-17T03:37:14.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.698+0000 7fe054000640 1 -- start start 2024-09-17T03:37:14.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.699+0000 7fe054000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe04c06e330 0x7fe04c1f8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:14.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.699+0000 7fe054000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe04c073dd0 0x7fe04c1f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:14.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.699+0000 7fe054000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe04c074cb0 0x7fe04c1f7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:14.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.699+0000 7fe054000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c06f4a0 con 0x7fe04c074cb0 2024-09-17T03:37:14.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.699+0000 7fe054000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c06f320 con 0x7fe04c06e330 2024-09-17T03:37:14.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.699+0000 7fe054000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe04c06f620 con 0x7fe04c073dd0 2024-09-17T03:37:14.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.699+0000 7fe052000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe04c074cb0 0x7fe04c1f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.699+0000 7fe052000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe04c074cb0 0x7fe04c1f7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60974/0 (socket says 172.21.15.121:60974) 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.699+0000 7fe052000640 1 -- 172.21.15.121:0/3345417883 learned_addr learned my addr 172.21.15.121:0/3345417883 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe051600640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe04c06e330 0x7fe04c1f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe050c00640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe04c073dd0 0x7fe04c1f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe052000640 1 -- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe04c073dd0 msgr2=0x7fe04c1f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe052000640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe04c073dd0 0x7fe04c1f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe052000640 1 -- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe04c06e330 msgr2=0x7fe04c1f8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe052000640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe04c06e330 0x7fe04c1f8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe052000640 1 -- 172.21.15.121:0/3345417883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c1f6790 con 0x7fe04c074cb0 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe051600640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe04c06e330 0x7fe04c1f8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe052000640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe04c074cb0 0x7fe04c1f7510 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe044009950 tx=0x7fe044033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe049600640 1 -- 172.21.15.121:0/3345417883 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe044031b50 con 0x7fe04c074cb0 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe049600640 1 -- 172.21.15.121:0/3345417883 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe044031de0 con 0x7fe04c074cb0 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe049600640 1 -- 172.21.15.121:0/3345417883 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe044005280 con 0x7fe04c074cb0 2024-09-17T03:37:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.700+0000 7fe054000640 1 -- 172.21.15.121:0/3345417883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04c1f99d0 con 0x7fe04c074cb0 2024-09-17T03:37:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.701+0000 7fe054000640 1 -- 172.21.15.121:0/3345417883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04c1f6d10 con 0x7fe04c074cb0 2024-09-17T03:37:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.701+0000 7fe054000640 1 -- 172.21.15.121:0/3345417883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04c06fb60 con 0x7fe04c074cb0 2024-09-17T03:37:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.703+0000 7fe049600640 1 -- 172.21.15.121:0/3345417883 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe044005420 con 0x7fe04c074cb0 2024-09-17T03:37:14.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.704+0000 7fe049600640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe02c078b90 0x7fe02c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:14.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.704+0000 7fe049600640 1 -- 172.21.15.121:0/3345417883 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fe0440bbd40 con 0x7fe04c074cb0 2024-09-17T03:37:14.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.704+0000 7fe051600640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe02c078b90 0x7fe02c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:14.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.705+0000 7fe051600640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe02c078b90 0x7fe02c07b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe0400017a0 tx=0x7fe040009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:14.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.708+0000 7fe049600640 1 -- 172.21.15.121:0/3345417883 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe04403f030 con 0x7fe04c074cb0 2024-09-17T03:37:14.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.891+0000 7fe054000640 1 -- 172.21.15.121:0/3345417883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe04c068e30 con 0x7fe04c074cb0 2024-09-17T03:37:14.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.891+0000 7fe049600640 1 -- 172.21.15.121:0/3345417883 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v34) ==== 59+0+2294 (secure 0 0 0) 0x7fe04c06e740 con 0x7fe04c074cb0 2024-09-17T03:37:14.891 INFO:teuthology.orchestra.run.smithi121.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:37:14.891 INFO:teuthology.orchestra.run.smithi121.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_client 20/20 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3249.879374 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3414.976419 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3347.142673 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3524.210167 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 7230.495988 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4229.547603 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4520.738354 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4185.245448 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds 20/20 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_ms 2/2 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_frag true 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_verify_scatter true 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:37:14.894 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:37:14.894 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:37:14.894 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced client_mount_timeout 600 2024-09-17T03:37:14.894 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_client 20/20 2024-09-17T03:37:14.894 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_ms 1/1 2024-09-17T03:37:14.894 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:37:14.894 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:37:14.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 -- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe02c078b90 msgr2=0x7fe02c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:14.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe02c078b90 0x7fe02c07b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe0400017a0 tx=0x7fe040009040 comp rx=0 tx=0).stop 2024-09-17T03:37:14.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 -- 172.21.15.121:0/3345417883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe04c074cb0 msgr2=0x7fe04c1f7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:14.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe04c074cb0 0x7fe04c1f7510 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe044009950 tx=0x7fe044033ba0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 -- 172.21.15.121:0/3345417883 shutdown_connections 2024-09-17T03:37:14.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe02c078b90 0x7fe02c07b0a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe04c074cb0 0x7fe04c1f7510 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe04c073dd0 0x7fe04c1f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 --2- 172.21.15.121:0/3345417883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe04c06e330 0x7fe04c1f8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 -- 172.21.15.121:0/3345417883 >> 172.21.15.121:0/3345417883 conn(0x7fe04c0cca40 msgr2=0x7fe04c0c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:14.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 -- 172.21.15.121:0/3345417883 shutdown_connections 2024-09-17T03:37:14.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:14.894+0000 7fe054000640 1 -- 172.21.15.121:0/3345417883 wait complete. 2024-09-17T03:37:14.917 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:37:15.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.141+0000 7efd01000640 1 -- 172.21.15.121:0/1792533146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcfc0ccfc0 msgr2=0x7efcfc0cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:15.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.141+0000 7efd01000640 1 --2- 172.21.15.121:0/1792533146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcfc0ccfc0 0x7efcfc0cddc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efcf4005fd0 tx=0x7efcf402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.141+0000 7efd01000640 1 -- 172.21.15.121:0/1792533146 shutdown_connections 2024-09-17T03:37:15.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.141+0000 7efd01000640 1 --2- 172.21.15.121:0/1792533146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcfc0ccfc0 0x7efcfc0cddc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.141+0000 7efd01000640 1 --2- 172.21.15.121:0/1792533146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcfc06e370 0x7efcfc0b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.141+0000 7efd01000640 1 -- 172.21.15.121:0/1792533146 >> 172.21.15.121:0/1792533146 conn(0x7efcfc06f920 msgr2=0x7efcfc0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:15.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.141+0000 7efd01000640 1 -- 172.21.15.121:0/1792533146 shutdown_connections 2024-09-17T03:37:15.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.141+0000 7efd01000640 1 -- 172.21.15.121:0/1792533146 wait complete. 2024-09-17T03:37:15.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.143+0000 7efd01000640 1 Processor -- start 2024-09-17T03:37:15.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.144+0000 7efd01000640 1 -- start start 2024-09-17T03:37:15.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.145+0000 7efd01000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcfc06e370 0x7efcfc0c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:15.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.145+0000 7efd01000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcfc156c60 0x7efcfc0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:15.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.145+0000 7efd01000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcfc0c6120 0x7efcfc0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:15.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.145+0000 7efd01000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc06d510 con 0x7efcfc156c60 2024-09-17T03:37:15.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.145+0000 7efd01000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc06d390 con 0x7efcfc06e370 2024-09-17T03:37:15.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.145+0000 7efd01000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efcfc06d690 con 0x7efcfc0c6120 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.145+0000 7efcf2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcfc156c60 0x7efcfc0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.145+0000 7efcf2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcfc156c60 0x7efcfc0c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60986/0 (socket says 172.21.15.121:60986) 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.145+0000 7efcf2a00640 1 -- 172.21.15.121:0/2280177891 learned_addr learned my addr 172.21.15.121:0/2280177891 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.145+0000 7efcfb400640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcfc06e370 0x7efcfc0c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efcfbe00640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcfc0c6120 0x7efcfc0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efcf2a00640 1 -- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcfc0c6120 msgr2=0x7efcfc0c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efcf2a00640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcfc0c6120 0x7efcfc0c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efcf2a00640 1 -- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcfc06e370 msgr2=0x7efcfc0c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efcf2a00640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcfc06e370 0x7efcfc0c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efcf2a00640 1 -- 172.21.15.121:0/2280177891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc0c4e40 con 0x7efcfc156c60 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efcf2a00640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcfc156c60 0x7efcfc0c5be0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efce400c3f0 tx=0x7efce400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efcf3e00640 1 -- 172.21.15.121:0/2280177891 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce4017070 con 0x7efcfc156c60 2024-09-17T03:37:15.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efcf3e00640 1 -- 172.21.15.121:0/2280177891 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efce40035f0 con 0x7efcfc156c60 2024-09-17T03:37:15.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efcf3e00640 1 -- 172.21.15.121:0/2280177891 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce4003a40 con 0x7efcfc156c60 2024-09-17T03:37:15.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.146+0000 7efd01000640 1 -- 172.21.15.121:0/2280177891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcfc0ca1c0 con 0x7efcfc156c60 2024-09-17T03:37:15.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.147+0000 7efd01000640 1 -- 172.21.15.121:0/2280177891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcfc0c53e0 con 0x7efcfc156c60 2024-09-17T03:37:15.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.148+0000 7efd01000640 1 -- 172.21.15.121:0/2280177891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcfc06dc20 con 0x7efcfc156c60 2024-09-17T03:37:15.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.149+0000 7efcf3e00640 1 -- 172.21.15.121:0/2280177891 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efce401a070 con 0x7efcfc156c60 2024-09-17T03:37:15.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.150+0000 7efcf3e00640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efcd8078b90 0x7efcd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:15.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.150+0000 7efcf3e00640 1 -- 172.21.15.121:0/2280177891 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7efce4099ea0 con 0x7efcfc156c60 2024-09-17T03:37:15.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.150+0000 7efcfb400640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efcd8078b90 0x7efcd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:15.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.151+0000 7efcfb400640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efcd8078b90 0x7efcd807b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efcec00bb50 tx=0x7efcec00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:15.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.154+0000 7efcf3e00640 1 -- 172.21.15.121:0/2280177891 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efce4061df0 con 0x7efcfc156c60 2024-09-17T03:37:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.340+0000 7efd01000640 1 -- 172.21.15.121:0/2280177891 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efcfc0c9f50 con 0x7efcfc156c60 2024-09-17T03:37:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.344+0000 7efcf3e00640 1 -- 172.21.15.121:0/2280177891 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v35)=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7efce4066820 con 0x7efcfc156c60 2024-09-17T03:37:15.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 -- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efcd8078b90 msgr2=0x7efcd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:15.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efcd8078b90 0x7efcd807b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efcec00bb50 tx=0x7efcec00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 -- 172.21.15.121:0/2280177891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcfc156c60 msgr2=0x7efcfc0c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:15.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcfc156c60 0x7efcfc0c5be0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efce400c3f0 tx=0x7efce400c8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 -- 172.21.15.121:0/2280177891 shutdown_connections 2024-09-17T03:37:15.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcfc0c6120 0x7efcfc0c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efcd8078b90 0x7efcd807b0a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcfc156c60 0x7efcfc0c5be0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 --2- 172.21.15.121:0/2280177891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcfc06e370 0x7efcfc0c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 -- 172.21.15.121:0/2280177891 >> 172.21.15.121:0/2280177891 conn(0x7efcfc06f920 msgr2=0x7efcfc15e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:15.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 -- 172.21.15.121:0/2280177891 shutdown_connections 2024-09-17T03:37:15.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.347+0000 7efd01000640 1 -- 172.21.15.121:0/2280177891 wait complete. 2024-09-17T03:37:15.369 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:37:15.369 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:15.458 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:15.556 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:37:15.557 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:15.557 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:15.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:37:15.592 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:15.592 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:15.629 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:15.629 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:15.629 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:15.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:37:15.668 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:15.668 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:15.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:15.705 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:37:15.705 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:15.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.929+0000 7fc81be00640 1 -- 172.21.15.121:0/2017335291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c15dfe0 msgr2=0x7fc81c160a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:15.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.929+0000 7fc81be00640 1 --2- 172.21.15.121:0/2017335291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c15dfe0 0x7fc81c160a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc80c005fd0 tx=0x7fc80c02a540 comp rx=0 tx=0).stop 2024-09-17T03:37:15.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.930+0000 7fc81be00640 1 -- 172.21.15.121:0/2017335291 shutdown_connections 2024-09-17T03:37:15.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.930+0000 7fc81be00640 1 --2- 172.21.15.121:0/2017335291 >> v2:172.21.15.176:3300/0 conn(0x7fc81c06e160 0x7fc81c06e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.930+0000 7fc81be00640 1 --2- 172.21.15.121:0/2017335291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c15dfe0 0x7fc81c160a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.930+0000 7fc81be00640 1 -- 172.21.15.121:0/2017335291 >> 172.21.15.121:0/2017335291 conn(0x7fc81c06f940 msgr2=0x7fc81c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:15.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.930+0000 7fc81be00640 1 -- 172.21.15.121:0/2017335291 shutdown_connections 2024-09-17T03:37:15.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.930+0000 7fc81be00640 1 -- 172.21.15.121:0/2017335291 wait complete. 2024-09-17T03:37:15.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.932+0000 7fc81be00640 1 Processor -- start 2024-09-17T03:37:15.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.932+0000 7fc81be00640 1 -- start start 2024-09-17T03:37:15.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.933+0000 7fc81be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c06e160 0x7fc81c0aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:15.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.933+0000 7fc81be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc81c0cc8d0 0x7fc81c137ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:15.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.933+0000 7fc81be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c15dfe0 0x7fc81c1380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:15.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.933+0000 7fc81be00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c0b4c50 con 0x7fc81c0cc8d0 2024-09-17T03:37:15.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.933+0000 7fc81be00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c0b4ad0 con 0x7fc81c15dfe0 2024-09-17T03:37:15.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.933+0000 7fc81be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc81c0b4dd0 con 0x7fc81c06e160 2024-09-17T03:37:15.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc812000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc81c0cc8d0 0x7fc81c137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:15.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc812000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc81c0cc8d0 0x7fc81c137ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60996/0 (socket says 172.21.15.121:60996) 2024-09-17T03:37:15.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc812000640 1 -- 172.21.15.121:0/3419807820 learned_addr learned my addr 172.21.15.121:0/3419807820 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:15.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc81aa00640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c06e160 0x7fc81c0aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:15.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc81b400640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c15dfe0 0x7fc81c1380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:15.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc812000640 1 -- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c06e160 msgr2=0x7fc81c0aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc812000640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c06e160 0x7fc81c0aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc812000640 1 -- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c15dfe0 msgr2=0x7fc81c1380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc812000640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c15dfe0 0x7fc81c1380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc812000640 1 -- 172.21.15.121:0/3419807820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81c135eb0 con 0x7fc81c0cc8d0 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.934+0000 7fc81b400640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c15dfe0 0x7fc81c1380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.935+0000 7fc812000640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc81c0cc8d0 0x7fc81c137ba0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc80400e9c0 tx=0x7fc80400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.935+0000 7fc813400640 1 -- 172.21.15.121:0/3419807820 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80400cd80 con 0x7fc81c0cc8d0 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.935+0000 7fc813400640 1 -- 172.21.15.121:0/3419807820 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc804004020 con 0x7fc81c0cc8d0 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.935+0000 7fc813400640 1 -- 172.21.15.121:0/3419807820 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804004450 con 0x7fc81c0cc8d0 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.935+0000 7fc81be00640 1 -- 172.21.15.121:0/3419807820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81c136190 con 0x7fc81c0cc8d0 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.935+0000 7fc81be00640 1 -- 172.21.15.121:0/3419807820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81c136750 con 0x7fc81c0cc8d0 2024-09-17T03:37:15.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.936+0000 7fc81be00640 1 -- 172.21.15.121:0/3419807820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc81c0b5310 con 0x7fc81c0cc8d0 2024-09-17T03:37:15.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.937+0000 7fc813400640 1 -- 172.21.15.121:0/3419807820 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc8040035f0 con 0x7fc81c0cc8d0 2024-09-17T03:37:15.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.938+0000 7fc813400640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc7f8078b90 0x7fc7f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:15.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.938+0000 7fc813400640 1 -- 172.21.15.121:0/3419807820 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fc80409b4b0 con 0x7fc81c0cc8d0 2024-09-17T03:37:15.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.939+0000 7fc81aa00640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc7f8078b90 0x7fc7f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:15.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.939+0000 7fc81aa00640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc7f8078b90 0x7fc7f807b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc80c033000 tx=0x7fc80c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:15.943+0000 7fc813400640 1 -- 172.21.15.121:0/3419807820 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc804063a50 con 0x7fc81c0cc8d0 2024-09-17T03:37:16.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.160+0000 7fc81be00640 1 -- 172.21.15.121:0/3419807820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc81c0b4060 con 0x7fc81c0cc8d0 2024-09-17T03:37:16.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.161+0000 7fc813400640 1 -- 172.21.15.121:0/3419807820 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3923 (secure 0 0 0) 0x7fc804063350 con 0x7fc81c0cc8d0 2024-09-17T03:37:16.161 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:16.161 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":20,"btime":"2024-09-17T03:37:08:972568+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3162771203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3162771203},{"type":"v1","addr":"172.21.15.176:6837","nonce":3162771203}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5013,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4101257140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4101257140},{"type":"v1","addr":"172.21.15.176:6836","nonce":4101257140}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5016,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/4075176322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4075176322},{"type":"v1","addr":"172.21.15.121:6834","nonce":4075176322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3787891087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":3787891087},{"type":"v1","addr":"172.21.15.121:6835","nonce":3787891087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-17T03:37:16.161 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 20 2024-09-17T03:37:16.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.163+0000 7fc81be00640 1 -- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc7f8078b90 msgr2=0x7fc7f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:16.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.163+0000 7fc81be00640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc7f8078b90 0x7fc7f807b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc80c033000 tx=0x7fc80c004730 comp rx=0 tx=0).stop 2024-09-17T03:37:16.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.163+0000 7fc81be00640 1 -- 172.21.15.121:0/3419807820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc81c0cc8d0 msgr2=0x7fc81c137ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:16.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.163+0000 7fc81be00640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc81c0cc8d0 0x7fc81c137ba0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc80400e9c0 tx=0x7fc80400ee80 comp rx=0 tx=0).stop 2024-09-17T03:37:16.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.163+0000 7fc81be00640 1 -- 172.21.15.121:0/3419807820 shutdown_connections 2024-09-17T03:37:16.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.163+0000 7fc81be00640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc81c15dfe0 0x7fc81c1380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.163+0000 7fc81be00640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc7f8078b90 0x7fc7f807b0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.163+0000 7fc81be00640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc81c0cc8d0 0x7fc81c137ba0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.163+0000 7fc81be00640 1 --2- 172.21.15.121:0/3419807820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc81c06e160 0x7fc81c0aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.163+0000 7fc81be00640 1 -- 172.21.15.121:0/3419807820 >> 172.21.15.121:0/3419807820 conn(0x7fc81c06f940 msgr2=0x7fc81c073fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:16.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.164+0000 7fc81be00640 1 -- 172.21.15.121:0/3419807820 shutdown_connections 2024-09-17T03:37:16.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:16.164+0000 7fc81be00640 1 -- 172.21.15.121:0/3419807820 wait complete. 2024-09-17T03:37:16.188 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:37:16.188 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:37:16.188 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:37:16.189 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:16.189 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:37:16.189 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:37:16.189 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:37:16.190 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:16.190 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:37:16.190 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:37:16.190 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:37:16.190 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:16.190 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:37:16.190 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:37:16.191 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:37:16.191 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:16.215 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:37:16.215 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:37:16.216 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:37:16.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:37:16.217 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:37:16.217 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:37:16.259 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:37:16.259 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:16.261 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:37:16.261 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:16.261 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:37:16.262 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:16.450 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:37:16.452 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T03:37:16.453 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:37:19.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-17T03:37:21.099 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:37:21.104 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:37:22.215 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:37:22.215 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:37:22.220 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:37:22.220 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:22.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:37:22.423 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:37:22.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.455+0000 7fcb83000640 1 -- 172.21.15.121:0/3079455671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb7c0cef00 msgr2=0x7fcb7c0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:22.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.455+0000 7fcb83000640 1 --2- 172.21.15.121:0/3079455671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb7c0cef00 0x7fcb7c0cf310 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcb74005fd0 tx=0x7fcb7402aa90 comp rx=0 tx=0).stop 2024-09-17T03:37:22.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.455+0000 7fcb83000640 1 -- 172.21.15.121:0/3079455671 shutdown_connections 2024-09-17T03:37:22.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.455+0000 7fcb83000640 1 --2- 172.21.15.121:0/3079455671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb7c0cef00 0x7fcb7c0cf310 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:22.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.455+0000 7fcb83000640 1 --2- 172.21.15.121:0/3079455671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb7c06ddf0 0x7fcb7c06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:22.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.455+0000 7fcb83000640 1 -- 172.21.15.121:0/3079455671 >> 172.21.15.121:0/3079455671 conn(0x7fcb7c0b1b90 msgr2=0x7fcb7c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:22.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.455+0000 7fcb83000640 1 -- 172.21.15.121:0/3079455671 shutdown_connections 2024-09-17T03:37:22.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.456+0000 7fcb83000640 1 -- 172.21.15.121:0/3079455671 wait complete. 2024-09-17T03:37:22.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.458+0000 7fcb83000640 1 Processor -- start 2024-09-17T03:37:22.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.458+0000 7fcb83000640 1 -- start start 2024-09-17T03:37:22.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.459+0000 7fcb83000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb7c06ddf0 0x7fcb7c155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:22.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.459+0000 7fcb83000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb7c0cef00 0x7fcb7c1f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:22.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.459+0000 7fcb83000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb7c156a50 0x7fcb7c1f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:22.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.459+0000 7fcb83000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0cf850 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.459+0000 7fcb83000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1610a0 con 0x7fcb7c156a50 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.459+0000 7fcb83000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7c0cf9d0 con 0x7fcb7c0cef00 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.459+0000 7fcb7be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb7c06ddf0 0x7fcb7c155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.459+0000 7fcb7be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb7c06ddf0 0x7fcb7c155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39088/0 (socket says 172.21.15.121:39088) 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb7be00640 1 -- 172.21.15.121:0/2586560897 learned_addr learned my addr 172.21.15.121:0/2586560897 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb81000640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb7c156a50 0x7fcb7c1f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb7b400640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb7c0cef00 0x7fcb7c1f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb7be00640 1 -- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb7c0cef00 msgr2=0x7fcb7c1f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb7be00640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb7c0cef00 0x7fcb7c1f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb7be00640 1 -- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb7c156a50 msgr2=0x7fcb7c1f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb7be00640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb7c156a50 0x7fcb7c1f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb7be00640 1 -- 172.21.15.121:0/2586560897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c159100 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb7b400640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb7c0cef00 0x7fcb7c1f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:22.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb7be00640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb7c06ddf0 0x7fcb7c155810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00c3a0 tx=0x7fcb6c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:22.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb73e00640 1 -- 172.21.15.121:0/2586560897 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c017070 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb73e00640 1 -- 172.21.15.121:0/2586560897 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb6c0053c0 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.460+0000 7fcb73e00640 1 -- 172.21.15.121:0/2586560897 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c003850 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.461+0000 7fcb83000640 1 -- 172.21.15.121:0/2586560897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c0b52a0 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.461+0000 7fcb83000640 1 -- 172.21.15.121:0/2586560897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c0b59f0 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.462+0000 7fcb83000640 1 -- 172.21.15.121:0/2586560897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7c06e200 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.463+0000 7fcb73e00640 1 -- 172.21.15.121:0/2586560897 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb6c01a070 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.464+0000 7fcb73e00640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb5c078b90 0x7fcb5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:22.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.464+0000 7fcb73e00640 1 -- 172.21.15.121:0/2586560897 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7fcb6c099fe0 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.464+0000 7fcb7b400640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb5c078b90 0x7fcb5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:22.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.465+0000 7fcb7b400640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb5c078b90 0x7fcb5c07b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0b4480 tx=0x7fcb68005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:22.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.469+0000 7fcb73e00640 1 -- 172.21.15.121:0/2586560897 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcb7c06e740 con 0x7fcb7c06ddf0 2024-09-17T03:37:22.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:22.666+0000 7fcb83000640 1 -- 172.21.15.121:0/2586560897 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fcb7c0b0900 con 0x7fcb7c06ddf0 2024-09-17T03:37:23.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.489+0000 7fcb73e00640 1 -- 172.21.15.121:0/2586560897 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) ==== 97+0+0 (secure 0 0 0) 0x7fcb6c062580 con 0x7fcb7c06ddf0 2024-09-17T03:37:23.490 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-17T03:37:23.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.492+0000 7fcb83000640 1 -- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb5c078b90 msgr2=0x7fcb5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.492+0000 7fcb83000640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb5c078b90 0x7fcb5c07b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0b4480 tx=0x7fcb68005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.493+0000 7fcb83000640 1 -- 172.21.15.121:0/2586560897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb7c06ddf0 msgr2=0x7fcb7c155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.493+0000 7fcb83000640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb7c06ddf0 0x7fcb7c155810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00c3a0 tx=0x7fcb6c00c860 comp rx=0 tx=0).stop 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.493+0000 7fcb83000640 1 -- 172.21.15.121:0/2586560897 shutdown_connections 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.493+0000 7fcb83000640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb7c156a50 0x7fcb7c1f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.493+0000 7fcb83000640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb7c0cef00 0x7fcb7c1f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.493+0000 7fcb83000640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcb5c078b90 0x7fcb5c07b0a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.493+0000 7fcb83000640 1 --2- 172.21.15.121:0/2586560897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb7c06ddf0 0x7fcb7c155810 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.493+0000 7fcb83000640 1 -- 172.21.15.121:0/2586560897 >> 172.21.15.121:0/2586560897 conn(0x7fcb7c0b1b90 msgr2=0x7fcb7c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.493+0000 7fcb83000640 1 -- 172.21.15.121:0/2586560897 shutdown_connections 2024-09-17T03:37:23.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.493+0000 7fcb83000640 1 -- 172.21.15.121:0/2586560897 wait complete. 2024-09-17T03:37:23.517 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:37:23.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.738+0000 7f7ab5400640 1 -- 172.21.15.121:0/582982171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ab0073dd0 msgr2=0x7f7ab006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:23.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.738+0000 7f7ab5400640 1 --2- 172.21.15.121:0/582982171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ab0073dd0 0x7f7ab006ddf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009830 tx=0x7f7a9802a540 comp rx=0 tx=0).stop 2024-09-17T03:37:23.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.738+0000 7f7ab5400640 1 -- 172.21.15.121:0/582982171 shutdown_connections 2024-09-17T03:37:23.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.738+0000 7f7ab5400640 1 --2- 172.21.15.121:0/582982171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ab0073dd0 0x7f7ab006ddf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:23.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.738+0000 7f7ab5400640 1 -- 172.21.15.121:0/582982171 >> 172.21.15.121:0/582982171 conn(0x7f7ab00cca40 msgr2=0x7f7ab00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:23.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.738+0000 7f7ab5400640 1 -- 172.21.15.121:0/582982171 shutdown_connections 2024-09-17T03:37:23.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.738+0000 7f7ab5400640 1 -- 172.21.15.121:0/582982171 wait complete. 2024-09-17T03:37:23.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.740+0000 7f7ab5400640 1 Processor -- start 2024-09-17T03:37:23.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.740+0000 7f7ab5400640 1 -- start start 2024-09-17T03:37:23.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.741+0000 7f7ab5400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ab006e330 0x7f7ab00a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:23.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7ab5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ab0073dd0 0x7f7ab00b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7ab5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ab0074cb0 0x7f7ab009b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7ab5400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab006f670 con 0x7f7ab0073dd0 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7ab5400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab006f4f0 con 0x7f7ab0074cb0 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7ab5400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab006f7f0 con 0x7f7ab006e330 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7aa5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ab0073dd0 0x7f7ab00b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7aa5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ab0073dd0 0x7f7ab00b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39090/0 (socket says 172.21.15.121:39090) 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7aa5e00640 1 -- 172.21.15.121:0/1328826430 learned_addr learned my addr 172.21.15.121:0/1328826430 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7aae800640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ab006e330 0x7f7ab00a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7aaf200640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ab0074cb0 0x7f7ab009b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7aa5e00640 1 -- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ab006e330 msgr2=0x7f7ab00a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7aa5e00640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ab006e330 0x7f7ab00a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:23.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7aa5e00640 1 -- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ab0074cb0 msgr2=0x7f7ab009b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7aa5e00640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ab0074cb0 0x7f7ab009b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.742+0000 7f7aa5e00640 1 -- 172.21.15.121:0/1328826430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab01f63c0 con 0x7f7ab0073dd0 2024-09-17T03:37:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.743+0000 7f7aa5e00640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ab0073dd0 0x7f7ab00b45b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7a9802ab30 tx=0x7f7a98033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.743+0000 7f7aa7400640 1 -- 172.21.15.121:0/1328826430 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98005c90 con 0x7f7ab0073dd0 2024-09-17T03:37:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.743+0000 7f7aa7400640 1 -- 172.21.15.121:0/1328826430 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a98031e50 con 0x7f7ab0073dd0 2024-09-17T03:37:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.743+0000 7f7ab5400640 1 -- 172.21.15.121:0/1328826430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab01f5b20 con 0x7f7ab0073dd0 2024-09-17T03:37:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.743+0000 7f7aa7400640 1 -- 172.21.15.121:0/1328826430 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98005280 con 0x7f7ab0073dd0 2024-09-17T03:37:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.743+0000 7f7ab5400640 1 -- 172.21.15.121:0/1328826430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab01f60e0 con 0x7f7ab0073dd0 2024-09-17T03:37:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.744+0000 7f7ab5400640 1 -- 172.21.15.121:0/1328826430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab006ddf0 con 0x7f7ab0073dd0 2024-09-17T03:37:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.745+0000 7f7aa7400640 1 -- 172.21.15.121:0/1328826430 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a98005420 con 0x7f7ab0073dd0 2024-09-17T03:37:23.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.746+0000 7f7aa7400640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a8c078bc0 0x7f7a8c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:23.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.746+0000 7f7aa7400640 1 -- 172.21.15.121:0/1328826430 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5249+0+0 (secure 0 0 0) 0x7f7a980bbd20 con 0x7f7ab0073dd0 2024-09-17T03:37:23.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.747+0000 7f7aae800640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a8c078bc0 0x7f7a8c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:23.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.747+0000 7f7aae800640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a8c078bc0 0x7f7a8c07b0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7ab015a730 tx=0x7f7aa0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:23.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:23.751+0000 7f7aa7400640 1 -- 172.21.15.121:0/1328826430 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7a9803f030 con 0x7f7ab0073dd0 2024-09-17T03:37:24.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.002+0000 7f7ab5400640 1 -- 172.21.15.121:0/1328826430 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7ab0069230 con 0x7f7ab0073dd0 2024-09-17T03:37:24.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.002+0000 7f7aa7400640 1 -- 172.21.15.121:0/1328826430 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+5304 (secure 0 0 0) 0x7f7a98084200 con 0x7f7ab0073dd0 2024-09-17T03:37:24.003 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:24.003 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:37:24.003 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-17T03:37:24.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.003 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohm64sFGhAAJDdFwMDkudwacQaLfvbAdg==", 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmIGvPNRAAvE+tovzn5WadGa9C/P/A3A==", 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.004 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.c", 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmV/btJxAAmhL4jXk0LVdzCPaNi9Hzhg==", 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:37:24.005 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.d", 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmeQccCBAAtTfeUysbtoqrKjwaKRWyvg==", 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.006 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDE+OhmBxJKNRAAGxPaH7R2JtcFVO5kR/Qh2A==", 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDI+OhmRtvFCBAAOG/1XD75Atl6ztUGPw3PKA==", 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:24.007 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL+OhmwzDzIxAA9Z/IIRphtZK1jbS2sIXeJQ==", 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.008 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.3", 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDO+Ohm94g0NBAAmxtHPev4OOM0YfOQt7N5Jg==", 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.4", 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDV+Ohmj7OoCBAA/Hrj9dHVT98lURPWJE3r/g==", 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.009 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.5", 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDY+Ohmc29QFxAAGsMy0+9MviYohok8JpL+ZA==", 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.010 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.6", 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDb+OhmDO8tKRAAq6bn/I54WKTdN6XiviHNsQ==", 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.7", 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDe+OhmUuFwNxAAgAeDJiL/TIGDuDAC+dXCyA==", 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:24.011 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw==", 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.012 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohmec7LKRAAl5nAqPEncglNL2FbRlD0oA==", 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.2", 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohme/hCHxAAdP8DjxaXWMGi/Fw+85zUFA==", 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.013 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.3", 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmivFTNBAA5f47Lq5CE+iXt3i+5fUJGA==", 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:37:24.014 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC/+OhmXWj6GBAAh/FBw0ElmHixSBXm8PPeAg==", 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohmsn9CDxAAzjtaZG1qe4XTnBge+t3vlA==", 2024-09-17T03:37:24.015 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.y", 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmQfYJAxAA6Mc5PiIb5VDamVU5Vhx3aQ==", 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.016 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-17T03:37:24.017 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.004+0000 7f7ab5400640 1 -- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a8c078bc0 msgr2=0x7f7a8c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.004+0000 7f7ab5400640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a8c078bc0 0x7f7a8c07b0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7ab015a730 tx=0x7f7aa0009040 comp rx=0 tx=0).stop 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.004+0000 7f7ab5400640 1 -- 172.21.15.121:0/1328826430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ab0073dd0 msgr2=0x7f7ab00b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.004+0000 7f7ab5400640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ab0073dd0 0x7f7ab00b45b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7a9802ab30 tx=0x7f7a98033c20 comp rx=0 tx=0).stop 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.004+0000 7f7ab5400640 1 -- 172.21.15.121:0/1328826430 shutdown_connections 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.004+0000 7f7ab5400640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ab0074cb0 0x7f7ab009b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.004+0000 7f7ab5400640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a8c078bc0 0x7f7a8c07b0d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.004+0000 7f7ab5400640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ab0073dd0 0x7f7ab00b45b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.004+0000 7f7ab5400640 1 --2- 172.21.15.121:0/1328826430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ab006e330 0x7f7ab00a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.004+0000 7f7ab5400640 1 -- 172.21.15.121:0/1328826430 >> 172.21.15.121:0/1328826430 conn(0x7f7ab00cca40 msgr2=0x7f7ab0070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:24.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.005+0000 7f7ab5400640 1 -- 172.21.15.121:0/1328826430 shutdown_connections 2024-09-17T03:37:24.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.005+0000 7f7ab5400640 1 -- 172.21.15.121:0/1328826430 wait complete. 2024-09-17T03:37:24.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:37:24.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.249+0000 7f1b71400640 1 -- 172.21.15.121:0/288048410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b6c0b4990 msgr2=0x7f1b6c0b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:24.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.249+0000 7f1b71400640 1 --2- 172.21.15.121:0/288048410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b6c0b4990 0x7f1b6c0b4da0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c075090 tx=0x7f1b6402aa30 comp rx=0 tx=0).stop 2024-09-17T03:37:24.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.249+0000 7f1b71400640 1 -- 172.21.15.121:0/288048410 shutdown_connections 2024-09-17T03:37:24.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.249+0000 7f1b71400640 1 --2- 172.21.15.121:0/288048410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b6c0b4990 0x7f1b6c0b4da0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.249+0000 7f1b71400640 1 --2- 172.21.15.121:0/288048410 >> v2:172.21.15.176:3300/0 conn(0x7f1b6c0cc8d0 0x7f1b6c0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.249+0000 7f1b71400640 1 --2- 172.21.15.121:0/288048410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b6c15cb20 0x7f1b6c0cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.249+0000 7f1b71400640 1 -- 172.21.15.121:0/288048410 >> 172.21.15.121:0/288048410 conn(0x7f1b6c06f940 msgr2=0x7f1b6c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:24.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.249+0000 7f1b71400640 1 -- 172.21.15.121:0/288048410 shutdown_connections 2024-09-17T03:37:24.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.249+0000 7f1b71400640 1 -- 172.21.15.121:0/288048410 wait complete. 2024-09-17T03:37:24.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.251+0000 7f1b71400640 1 Processor -- start 2024-09-17T03:37:24.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.251+0000 7f1b71400640 1 -- start start 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b71400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b6c0b4990 0x7f1b6c13f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b71400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b6c0cc8d0 0x7f1b6c1426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b71400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b6c15cb20 0x7f1b6c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b71400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c06d3f0 con 0x7f1b6c0b4990 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b71400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c06d270 con 0x7f1b6c15cb20 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b71400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6c06d570 con 0x7f1b6c0cc8d0 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b6be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b6c0b4990 0x7f1b6c13f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b6be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b6c0b4990 0x7f1b6c13f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39112/0 (socket says 172.21.15.121:39112) 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b6be00640 1 -- 172.21.15.121:0/1911715090 learned_addr learned my addr 172.21.15.121:0/1911715090 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b70a00640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b6c15cb20 0x7f1b6c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.253+0000 7f1b63400640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b6c0cc8d0 0x7f1b6c1426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b6be00640 1 -- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b6c0cc8d0 msgr2=0x7f1b6c1426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b6be00640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b6c0cc8d0 0x7f1b6c1426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b6be00640 1 -- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b6c15cb20 msgr2=0x7f1b6c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b6be00640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b6c15cb20 0x7f1b6c15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b6be00640 1 -- 172.21.15.121:0/1911715090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6c13f940 con 0x7f1b6c0b4990 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b6be00640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b6c0b4990 0x7f1b6c13f400 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00e7f0 tx=0x7f1b5c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b68c00640 1 -- 172.21.15.121:0/1911715090 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00ccc0 con 0x7f1b6c0b4990 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b68c00640 1 -- 172.21.15.121:0/1911715090 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b5c00ce80 con 0x7f1b6c0b4990 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b71400640 1 -- 172.21.15.121:0/1911715090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6c142be0 con 0x7f1b6c0b4990 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b68c00640 1 -- 172.21.15.121:0/1911715090 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c005280 con 0x7f1b6c0b4990 2024-09-17T03:37:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.254+0000 7f1b71400640 1 -- 172.21.15.121:0/1911715090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6c14f4e0 con 0x7f1b6c0b4990 2024-09-17T03:37:24.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.255+0000 7f1b71400640 1 -- 172.21.15.121:0/1911715090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6c06db00 con 0x7f1b6c0b4990 2024-09-17T03:37:24.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.256+0000 7f1b68c00640 1 -- 172.21.15.121:0/1911715090 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b5c005420 con 0x7f1b6c0b4990 2024-09-17T03:37:24.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.257+0000 7f1b68c00640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b48078b90 0x7f1b4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:24.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.257+0000 7f1b68c00640 1 -- 172.21.15.121:0/1911715090 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5249+0+0 (secure 0 0 0) 0x7f1b5c09b670 con 0x7f1b6c0b4990 2024-09-17T03:37:24.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.258+0000 7f1b63400640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b48078b90 0x7f1b4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:24.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.259+0000 7f1b63400640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b48078b90 0x7f1b4807b0a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0b19b0 tx=0x7f1b54005d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:24.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.262+0000 7f1b68c00640 1 -- 172.21.15.121:0/1911715090 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b5c063bd0 con 0x7f1b6c0b4990 2024-09-17T03:37:24.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.447+0000 7f1b71400640 1 -- 172.21.15.121:0/1911715090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1b6c0cbfb0 con 0x7f1b6c0b4990 2024-09-17T03:37:24.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.448+0000 7f1b68c00640 1 -- 172.21.15.121:0/1911715090 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) ==== 84+0+65 (secure 0 0 0) 0x7f1b5c0634d0 con 0x7f1b6c0b4990 2024-09-17T03:37:24.449 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:24.449 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-17T03:37:24.449 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:24.449 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-17T03:37:24.449 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-17T03:37:24.449 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:24.450 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-17T03:37:24.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.450+0000 7f1b71400640 1 -- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b48078b90 msgr2=0x7f1b4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:24.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.450+0000 7f1b71400640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b48078b90 0x7f1b4807b0a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0b19b0 tx=0x7f1b54005d70 comp rx=0 tx=0).stop 2024-09-17T03:37:24.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.450+0000 7f1b71400640 1 -- 172.21.15.121:0/1911715090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b6c0b4990 msgr2=0x7f1b6c13f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:24.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.450+0000 7f1b71400640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b6c0b4990 0x7f1b6c13f400 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00e7f0 tx=0x7f1b5c00ecb0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.450+0000 7f1b71400640 1 -- 172.21.15.121:0/1911715090 shutdown_connections 2024-09-17T03:37:24.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.450+0000 7f1b71400640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b6c15cb20 0x7f1b6c15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.450+0000 7f1b71400640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b6c0cc8d0 0x7f1b6c1426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.450+0000 7f1b71400640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b48078b90 0x7f1b4807b0a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.450+0000 7f1b71400640 1 --2- 172.21.15.121:0/1911715090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b6c0b4990 0x7f1b6c13f400 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.450+0000 7f1b71400640 1 -- 172.21.15.121:0/1911715090 >> 172.21.15.121:0/1911715090 conn(0x7f1b6c06f940 msgr2=0x7f1b6c0ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:24.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.451+0000 7f1b71400640 1 -- 172.21.15.121:0/1911715090 shutdown_connections 2024-09-17T03:37:24.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.451+0000 7f1b71400640 1 -- 172.21.15.121:0/1911715090 wait complete. 2024-09-17T03:37:24.475 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:37:24.475 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:37:24.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.703+0000 7fc635200640 1 -- 172.21.15.121:0/1122999853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc614004800 msgr2=0x7fc614004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:24.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.703+0000 7fc635200640 1 --2- 172.21.15.121:0/1122999853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc614004800 0x7fc614004c10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc6180016c0 tx=0x7fc614005830 comp rx=0 tx=0).stop 2024-09-17T03:37:24.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.703+0000 7fc62fe00640 1 -- 172.21.15.121:0/1122999853 reap_dead start 2024-09-17T03:37:24.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.703+0000 7fc635200640 1 -- 172.21.15.121:0/1122999853 shutdown_connections 2024-09-17T03:37:24.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.703+0000 7fc635200640 1 -- 172.21.15.121:0/1122999853 >> 172.21.15.121:0/1122999853 conn(0x7fc6300d0460 msgr2=0x7fc63006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:24.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.703+0000 7fc635200640 1 -- 172.21.15.121:0/1122999853 shutdown_connections 2024-09-17T03:37:24.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.704+0000 7fc635200640 1 -- 172.21.15.121:0/1122999853 wait complete. 2024-09-17T03:37:24.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.706+0000 7fc635200640 1 Processor -- start 2024-09-17T03:37:24.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.706+0000 7fc635200640 1 -- start start 2024-09-17T03:37:24.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.707+0000 7fc635200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc614004800 0x7fc630072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:24.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.707+0000 7fc635200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc63015b770 0x7fc630142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:24.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.707+0000 7fc635200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc630074680 0x7fc630144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.707+0000 7fc635200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc63006fc10 con 0x7fc630074680 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.707+0000 7fc635200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc63006fa90 con 0x7fc63015b770 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.707+0000 7fc635200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc63006fd90 con 0x7fc614004800 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc62fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc630074680 0x7fc630144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc62fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc630074680 0x7fc630144350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39138/0 (socket says 172.21.15.121:39138) 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc62fe00640 1 -- 172.21.15.121:0/418730822 learned_addr learned my addr 172.21.15.121:0/418730822 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc62fe00640 1 -- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc614004800 msgr2=0x7fc630072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc62fe00640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc614004800 0x7fc630072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc62fe00640 1 -- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc63015b770 msgr2=0x7fc630142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc626a00640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc63015b770 0x7fc630142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc62fe00640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc63015b770 0x7fc630142fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc62fe00640 1 -- 172.21.15.121:0/418730822 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc630143500 con 0x7fc630074680 2024-09-17T03:37:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc62fe00640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc630074680 0x7fc630144350 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc630072b60 tx=0x7fc628010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:24.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.708+0000 7fc627e00640 1 -- 172.21.15.121:0/418730822 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628003970 con 0x7fc630074680 2024-09-17T03:37:24.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.709+0000 7fc627e00640 1 -- 172.21.15.121:0/418730822 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc628015070 con 0x7fc630074680 2024-09-17T03:37:24.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.709+0000 7fc627e00640 1 -- 172.21.15.121:0/418730822 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628004030 con 0x7fc630074680 2024-09-17T03:37:24.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.709+0000 7fc635200640 1 -- 172.21.15.121:0/418730822 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6301f83a0 con 0x7fc630074680 2024-09-17T03:37:24.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.709+0000 7fc635200640 1 -- 172.21.15.121:0/418730822 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6301f8960 con 0x7fc630074680 2024-09-17T03:37:24.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.710+0000 7fc635200640 1 -- 172.21.15.121:0/418730822 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc630070320 con 0x7fc630074680 2024-09-17T03:37:24.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.711+0000 7fc627e00640 1 -- 172.21.15.121:0/418730822 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6280041d0 con 0x7fc630074680 2024-09-17T03:37:24.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.712+0000 7fc627e00640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc60c078bc0 0x7fc60c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:24.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.712+0000 7fc627e00640 1 -- 172.21.15.121:0/418730822 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5249+0+0 (secure 0 0 0) 0x7fc62809b6d0 con 0x7fc630074680 2024-09-17T03:37:24.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.712+0000 7fc62f400640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc60c078bc0 0x7fc60c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:24.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.713+0000 7fc62f400640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc60c078bc0 0x7fc60c07b0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc620001240 tx=0x7fc620001110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:24.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.717+0000 7fc627e00640 1 -- 172.21.15.121:0/418730822 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc628063c30 con 0x7fc630074680 2024-09-17T03:37:24.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:24.901+0000 7fc635200640 1 -- 172.21.15.121:0/418730822 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc63015cec0 con 0x7fc630074680 2024-09-17T03:37:25.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.499+0000 7fc627e00640 1 -- 172.21.15.121:0/418730822 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) ==== 138+0+0 (secure 0 0 0) 0x7fc628063530 con 0x7fc630074680 2024-09-17T03:37:25.500 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 -- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc60c078bc0 msgr2=0x7fc60c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc60c078bc0 0x7fc60c07b0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc620001240 tx=0x7fc620001110 comp rx=0 tx=0).stop 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 -- 172.21.15.121:0/418730822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc630074680 msgr2=0x7fc630144350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc630074680 0x7fc630144350 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc630072b60 tx=0x7fc628010f40 comp rx=0 tx=0).stop 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 -- 172.21.15.121:0/418730822 shutdown_connections 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc60c078bc0 0x7fc60c07b0d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc630074680 0x7fc630144350 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc63015b770 0x7fc630142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 --2- 172.21.15.121:0/418730822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc614004800 0x7fc630072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 -- 172.21.15.121:0/418730822 >> 172.21.15.121:0/418730822 conn(0x7fc6300d0460 msgr2=0x7fc6300b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:25.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 -- 172.21.15.121:0/418730822 shutdown_connections 2024-09-17T03:37:25.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.502+0000 7fc635200640 1 -- 172.21.15.121:0/418730822 wait complete. 2024-09-17T03:37:25.534 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:37:25.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.764+0000 7fc623a00640 1 -- 172.21.15.121:0/3455168673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc61c074cb0 msgr2=0x7fc61c073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:25.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.764+0000 7fc623a00640 1 --2- 172.21.15.121:0/3455168673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc61c074cb0 0x7fc61c073dd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc61c09e110 tx=0x7fc60c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:37:25.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.764+0000 7fc623a00640 1 -- 172.21.15.121:0/3455168673 shutdown_connections 2024-09-17T03:37:25.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.764+0000 7fc623a00640 1 --2- 172.21.15.121:0/3455168673 >> v2:172.21.15.176:3300/0 conn(0x7fc61c0cbc10 0x7fc61c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:25.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.764+0000 7fc623a00640 1 --2- 172.21.15.121:0/3455168673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc61c074cb0 0x7fc61c073dd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:25.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.764+0000 7fc623a00640 1 -- 172.21.15.121:0/3455168673 >> 172.21.15.121:0/3455168673 conn(0x7fc61c0cca40 msgr2=0x7fc61c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:25.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.764+0000 7fc623a00640 1 -- 172.21.15.121:0/3455168673 shutdown_connections 2024-09-17T03:37:25.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.764+0000 7fc623a00640 1 -- 172.21.15.121:0/3455168673 wait complete. 2024-09-17T03:37:25.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.767+0000 7fc623a00640 1 Processor -- start 2024-09-17T03:37:25.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.767+0000 7fc623a00640 1 -- start start 2024-09-17T03:37:25.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.768+0000 7fc623a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c06ddf0 0x7fc61c1577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:25.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.768+0000 7fc623a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c074cb0 0x7fc61c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:25.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.768+0000 7fc623a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc61c0cbc10 0x7fc61c0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:25.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.768+0000 7fc623a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c06f360 con 0x7fc61c0cbc10 2024-09-17T03:37:25.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.768+0000 7fc623a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c06f1e0 con 0x7fc61c06ddf0 2024-09-17T03:37:25.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.768+0000 7fc623a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc61c06f4e0 con 0x7fc61c074cb0 2024-09-17T03:37:25.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc61c0cbc10 0x7fc61c0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:25.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc61c0cbc10 0x7fc61c0b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39144/0 (socket says 172.21.15.121:39144) 2024-09-17T03:37:25.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621a00640 1 -- 172.21.15.121:0/2337947973 learned_addr learned my addr 172.21.15.121:0/2337947973 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:25.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621000640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c06ddf0 0x7fc61c1577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:25.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc613e00640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c074cb0 0x7fc61c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:25.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621a00640 1 -- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c074cb0 msgr2=0x7fc61c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621a00640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c074cb0 0x7fc61c0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621a00640 1 -- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c06ddf0 msgr2=0x7fc61c1577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621a00640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c06ddf0 0x7fc61c1577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621a00640 1 -- 172.21.15.121:0/2337947973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c1f6e50 con 0x7fc61c0cbc10 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621000640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c06ddf0 0x7fc61c1577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.769+0000 7fc621a00640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc61c0cbc10 0x7fc61c0b0ca0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc61400c730 tx=0x7fc61400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.770+0000 7fc619600640 1 -- 172.21.15.121:0/2337947973 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614017070 con 0x7fc61c0cbc10 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.770+0000 7fc619600640 1 -- 172.21.15.121:0/2337947973 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc614003c60 con 0x7fc61c0cbc10 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.770+0000 7fc623a00640 1 -- 172.21.15.121:0/2337947973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61c1f7130 con 0x7fc61c0cbc10 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.770+0000 7fc619600640 1 -- 172.21.15.121:0/2337947973 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6140052d0 con 0x7fc61c0cbc10 2024-09-17T03:37:25.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.770+0000 7fc623a00640 1 -- 172.21.15.121:0/2337947973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61c1f76f0 con 0x7fc61c0cbc10 2024-09-17T03:37:25.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.771+0000 7fc623a00640 1 -- 172.21.15.121:0/2337947973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc61c06f9b0 con 0x7fc61c0cbc10 2024-09-17T03:37:25.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.773+0000 7fc619600640 1 -- 172.21.15.121:0/2337947973 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc61401a070 con 0x7fc61c0cbc10 2024-09-17T03:37:25.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.773+0000 7fc619600640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc5f8078b90 0x7fc5f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:25.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.774+0000 7fc619600640 1 -- 172.21.15.121:0/2337947973 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5619+0+0 (secure 0 0 0) 0x7fc61409a9e0 con 0x7fc61c0cbc10 2024-09-17T03:37:25.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.774+0000 7fc621000640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc5f8078b90 0x7fc5f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:25.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.775+0000 7fc621000640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc5f8078b90 0x7fc5f807b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc60c033000 tx=0x7fc60c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:25.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.777+0000 7fc619600640 1 -- 172.21.15.121:0/2337947973 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc614021020 con 0x7fc61c0cbc10 2024-09-17T03:37:25.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:25.961+0000 7fc623a00640 1 -- 172.21.15.121:0/2337947973 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc61c15a5b0 con 0x7fc61c0cbc10 2024-09-17T03:37:26.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-17T03:37:26.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.501+0000 7fc619600640 1 -- 172.21.15.121:0/2337947973 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) ==== 170+0+0 (secure 0 0 0) 0x7fc614062e50 con 0x7fc61c0cbc10 2024-09-17T03:37:26.503 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-17T03:37:26.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.504+0000 7fc623a00640 1 -- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc5f8078b90 msgr2=0x7fc5f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:26.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.504+0000 7fc623a00640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc5f8078b90 0x7fc5f807b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc60c033000 tx=0x7fc60c004730 comp rx=0 tx=0).stop 2024-09-17T03:37:26.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.504+0000 7fc623a00640 1 -- 172.21.15.121:0/2337947973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc61c0cbc10 msgr2=0x7fc61c0b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:26.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.504+0000 7fc623a00640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc61c0cbc10 0x7fc61c0b0ca0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc61400c730 tx=0x7fc61400cbf0 comp rx=0 tx=0).stop 2024-09-17T03:37:26.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.504+0000 7fc623a00640 1 -- 172.21.15.121:0/2337947973 shutdown_connections 2024-09-17T03:37:26.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.504+0000 7fc623a00640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc5f8078b90 0x7fc5f807b0a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:26.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.504+0000 7fc623a00640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc61c0cbc10 0x7fc61c0b0ca0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:26.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.504+0000 7fc623a00640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c074cb0 0x7fc61c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:26.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.504+0000 7fc623a00640 1 --2- 172.21.15.121:0/2337947973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c06ddf0 0x7fc61c1577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:26.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.504+0000 7fc623a00640 1 -- 172.21.15.121:0/2337947973 >> 172.21.15.121:0/2337947973 conn(0x7fc61c0cca40 msgr2=0x7fc61c15f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:26.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.505+0000 7fc623a00640 1 -- 172.21.15.121:0/2337947973 shutdown_connections 2024-09-17T03:37:26.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.505+0000 7fc623a00640 1 -- 172.21.15.121:0/2337947973 wait complete. 2024-09-17T03:37:26.545 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:37:26.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.769+0000 7f8294e00640 1 -- 172.21.15.121:0/1726284892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82900b4f90 msgr2=0x7f829006d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:26.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.769+0000 7f8294e00640 1 --2- 172.21.15.121:0/1726284892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82900b4f90 0x7f829006d780 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8278009830 tx=0x7f827802a530 comp rx=0 tx=0).stop 2024-09-17T03:37:26.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.769+0000 7f8294e00640 1 -- 172.21.15.121:0/1726284892 shutdown_connections 2024-09-17T03:37:26.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.769+0000 7f8294e00640 1 --2- 172.21.15.121:0/1726284892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82900b4f90 0x7f829006d780 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:26.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.769+0000 7f8294e00640 1 -- 172.21.15.121:0/1726284892 >> 172.21.15.121:0/1726284892 conn(0x7f829006f920 msgr2=0x7f82900b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:26.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.769+0000 7f8294e00640 1 -- 172.21.15.121:0/1726284892 shutdown_connections 2024-09-17T03:37:26.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.769+0000 7f8294e00640 1 -- 172.21.15.121:0/1726284892 wait complete. 2024-09-17T03:37:26.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.772+0000 7f8294e00640 1 Processor -- start 2024-09-17T03:37:26.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.772+0000 7f8294e00640 1 -- start start 2024-09-17T03:37:26.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.773+0000 7f8294e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82900b4f90 0x7f82900735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:26.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.773+0000 7f8294e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900cc8d0 0x7f829013ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:26.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.773+0000 7f8294e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82901456e0 0x7f82901445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:26.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.773+0000 7f8294e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f82900ce1d0 con 0x7f82901456e0 2024-09-17T03:37:26.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.773+0000 7f8294e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f82900ce050 con 0x7f82900cc8d0 2024-09-17T03:37:26.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.773+0000 7f8294e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f82900ce350 con 0x7f82900b4f90 2024-09-17T03:37:26.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f828fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82901456e0 0x7f82901445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:26.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f828fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82901456e0 0x7f82901445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39166/0 (socket says 172.21.15.121:39166) 2024-09-17T03:37:26.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f828fe00640 1 -- 172.21.15.121:0/3143969568 learned_addr learned my addr 172.21.15.121:0/3143969568 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:26.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f8286a00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900cc8d0 0x7f829013ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:26.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f828f400640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82900b4f90 0x7f82900735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:26.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f828fe00640 1 -- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82900b4f90 msgr2=0x7f82900735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:26.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f828fe00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82900b4f90 0x7f82900735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:26.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f828fe00640 1 -- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900cc8d0 msgr2=0x7f829013ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:26.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f828fe00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900cc8d0 0x7f829013ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:26.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f828fe00640 1 -- 172.21.15.121:0/3143969568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8290073f80 con 0x7f82901456e0 2024-09-17T03:37:26.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.774+0000 7f828fe00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82901456e0 0x7f82901445b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f828800c730 tx=0x7f828800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:26.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.775+0000 7f8287e00640 1 -- 172.21.15.121:0/3143969568 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288003b70 con 0x7f82901456e0 2024-09-17T03:37:26.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.775+0000 7f8287e00640 1 -- 172.21.15.121:0/3143969568 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8288003d10 con 0x7f82901456e0 2024-09-17T03:37:26.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.775+0000 7f8294e00640 1 -- 172.21.15.121:0/3143969568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8290074260 con 0x7f82901456e0 2024-09-17T03:37:26.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.775+0000 7f8287e00640 1 -- 172.21.15.121:0/3143969568 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288005330 con 0x7f82901456e0 2024-09-17T03:37:26.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.775+0000 7f8294e00640 1 -- 172.21.15.121:0/3143969568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8290074820 con 0x7f82901456e0 2024-09-17T03:37:26.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.776+0000 7f8294e00640 1 -- 172.21.15.121:0/3143969568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8290073cf0 con 0x7f82901456e0 2024-09-17T03:37:26.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.777+0000 7f8287e00640 1 -- 172.21.15.121:0/3143969568 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82880054d0 con 0x7f82901456e0 2024-09-17T03:37:26.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.778+0000 7f8287e00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f826c078b90 0x7f826c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:26.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.778+0000 7f8287e00640 1 -- 172.21.15.121:0/3143969568 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6001+0+0 (secure 0 0 0) 0x7f828809b540 con 0x7f82901456e0 2024-09-17T03:37:26.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.779+0000 7f828f400640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f826c078b90 0x7f826c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:26.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.780+0000 7f828f400640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f826c078b90 0x7f826c07b0a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8280007fd0 tx=0x7f8280001370 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:26.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.782+0000 7f8287e00640 1 -- 172.21.15.121:0/3143969568 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8288063270 con 0x7f82901456e0 2024-09-17T03:37:26.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:26.998+0000 7f8294e00640 1 -- 172.21.15.121:0/3143969568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8290074a60 con 0x7f82901456e0 2024-09-17T03:37:27.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.515+0000 7f8287e00640 1 -- 172.21.15.121:0/3143969568 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v24) ==== 172+0+0 (secure 0 0 0) 0x7f8290074a60 con 0x7f82901456e0 2024-09-17T03:37:27.516 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 7 and data pool 8 2024-09-17T03:37:27.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.518+0000 7f8294e00640 1 -- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f826c078b90 msgr2=0x7f826c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:27.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.518+0000 7f8294e00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f826c078b90 0x7f826c07b0a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8280007fd0 tx=0x7f8280001370 comp rx=0 tx=0).stop 2024-09-17T03:37:27.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.518+0000 7f8294e00640 1 -- 172.21.15.121:0/3143969568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82901456e0 msgr2=0x7f82901445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:27.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.518+0000 7f8294e00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82901456e0 0x7f82901445b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f828800c730 tx=0x7f828800cb30 comp rx=0 tx=0).stop 2024-09-17T03:37:27.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.519+0000 7f8294e00640 1 -- 172.21.15.121:0/3143969568 shutdown_connections 2024-09-17T03:37:27.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.519+0000 7f8294e00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f826c078b90 0x7f826c07b0a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.519+0000 7f8294e00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82901456e0 0x7f82901445b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.519+0000 7f8294e00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82900cc8d0 0x7f829013ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.519+0000 7f8294e00640 1 --2- 172.21.15.121:0/3143969568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f82900b4f90 0x7f82900735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.519+0000 7f8294e00640 1 -- 172.21.15.121:0/3143969568 >> 172.21.15.121:0/3143969568 conn(0x7f829006f920 msgr2=0x7f8290142da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:27.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.519+0000 7f8294e00640 1 -- 172.21.15.121:0/3143969568 shutdown_connections 2024-09-17T03:37:27.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.520+0000 7f8294e00640 1 -- 172.21.15.121:0/3143969568 wait complete. 2024-09-17T03:37:27.570 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:27.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.791+0000 7fc2b1600640 1 -- 172.21.15.121:0/3341904008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2ac074cb0 msgr2=0x7fc2ac073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:27.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.791+0000 7fc2b1600640 1 --2- 172.21.15.121:0/3341904008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2ac074cb0 0x7fc2ac073dd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009830 tx=0x7fc29c02a5c0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.791+0000 7fc2b1600640 1 -- 172.21.15.121:0/3341904008 shutdown_connections 2024-09-17T03:37:27.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.791+0000 7fc2b1600640 1 --2- 172.21.15.121:0/3341904008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2ac074cb0 0x7fc2ac073dd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.791+0000 7fc2b1600640 1 -- 172.21.15.121:0/3341904008 >> 172.21.15.121:0/3341904008 conn(0x7fc2ac0cca40 msgr2=0x7fc2ac0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:27.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.791+0000 7fc2b1600640 1 -- 172.21.15.121:0/3341904008 shutdown_connections 2024-09-17T03:37:27.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.791+0000 7fc2b1600640 1 -- 172.21.15.121:0/3341904008 wait complete. 2024-09-17T03:37:27.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.794+0000 7fc2b1600640 1 Processor -- start 2024-09-17T03:37:27.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.794+0000 7fc2b1600640 1 -- start start 2024-09-17T03:37:27.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.795+0000 7fc2b1600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2ac074cb0 0x7fc2ac1f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:27.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.795+0000 7fc2b1600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2ac0cbc10 0x7fc2ac15bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.795+0000 7fc2b1600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2ac0b0e40 0x7fc2ac15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.795+0000 7fc2b1600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac06f670 con 0x7fc2ac074cb0 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.795+0000 7fc2b1600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac06f4f0 con 0x7fc2ac0b0e40 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.795+0000 7fc2b1600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ac06f7f0 con 0x7fc2ac0cbc10 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.795+0000 7fc2aaa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2ac074cb0 0x7fc2ac1f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.795+0000 7fc2aaa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2ac074cb0 0x7fc2ac1f8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39184/0 (socket says 172.21.15.121:39184) 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.795+0000 7fc2aaa00640 1 -- 172.21.15.121:0/3478983092 learned_addr learned my addr 172.21.15.121:0/3478983092 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2aa000640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2ac0cbc10 0x7fc2ac15bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2aaa00640 1 -- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2ac0cbc10 msgr2=0x7fc2ac15bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2ab400640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2ac0b0e40 0x7fc2ac15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2aaa00640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2ac0cbc10 0x7fc2ac15bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2aaa00640 1 -- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2ac0b0e40 msgr2=0x7fc2ac15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2aaa00640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2ac0b0e40 0x7fc2ac15c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2aaa00640 1 -- 172.21.15.121:0/3478983092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ac0b08f0 con 0x7fc2ac074cb0 2024-09-17T03:37:27.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2aa000640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2ac0cbc10 0x7fc2ac15bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:27.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2ab400640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2ac0b0e40 0x7fc2ac15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:27.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2aaa00640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2ac074cb0 0x7fc2ac1f8680 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc29c02abb0 tx=0x7fc29c033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:27.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.796+0000 7fc2a2a00640 1 -- 172.21.15.121:0/3478983092 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c031b60 con 0x7fc2ac074cb0 2024-09-17T03:37:27.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.797+0000 7fc2a2a00640 1 -- 172.21.15.121:0/3478983092 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc29c031df0 con 0x7fc2ac074cb0 2024-09-17T03:37:27.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.797+0000 7fc2b1600640 1 -- 172.21.15.121:0/3478983092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ac1f8bc0 con 0x7fc2ac074cb0 2024-09-17T03:37:27.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.797+0000 7fc2a2a00640 1 -- 172.21.15.121:0/3478983092 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c005280 con 0x7fc2ac074cb0 2024-09-17T03:37:27.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.797+0000 7fc2b1600640 1 -- 172.21.15.121:0/3478983092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ac0b5c40 con 0x7fc2ac074cb0 2024-09-17T03:37:27.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.798+0000 7fc2b1600640 1 -- 172.21.15.121:0/3478983092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ac06da40 con 0x7fc2ac074cb0 2024-09-17T03:37:27.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.799+0000 7fc2a2a00640 1 -- 172.21.15.121:0/3478983092 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc29c005420 con 0x7fc2ac074cb0 2024-09-17T03:37:27.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.800+0000 7fc2a2a00640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc28c078bc0 0x7fc28c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:27.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.800+0000 7fc2a2a00640 1 -- 172.21.15.121:0/3478983092 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fc29c0bc0d0 con 0x7fc2ac074cb0 2024-09-17T03:37:27.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.801+0000 7fc2aa000640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc28c078bc0 0x7fc28c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:27.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.802+0000 7fc2aa000640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc28c078bc0 0x7fc28c07b0d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0cf130 tx=0x7fc298009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:27.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.805+0000 7fc2a2a00640 1 -- 172.21.15.121:0/3478983092 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc29c03f030 con 0x7fc2ac074cb0 2024-09-17T03:37:27.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.987+0000 7fc2b1600640 1 -- 172.21.15.121:0/3478983092 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2ac0cf160 con 0x7fc2ac074cb0 2024-09-17T03:37:27.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.989+0000 7fc2a2a00640 1 -- 172.21.15.121:0/3478983092 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17015 (secure 0 0 0) 0x7fc29c031770 con 0x7fc2ac074cb0 2024-09-17T03:37:27.990 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:27.990 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":51,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:37:27.000802+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:24.915132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:25.975087+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:27.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 -- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc28c078bc0 msgr2=0x7fc28c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:27.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc28c078bc0 0x7fc28c07b0d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0cf130 tx=0x7fc298009040 comp rx=0 tx=0).stop 2024-09-17T03:37:27.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 -- 172.21.15.121:0/3478983092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2ac074cb0 msgr2=0x7fc2ac1f8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:27.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2ac074cb0 0x7fc2ac1f8680 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc29c02abb0 tx=0x7fc29c033c10 comp rx=0 tx=0).stop 2024-09-17T03:37:27.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 -- 172.21.15.121:0/3478983092 shutdown_connections 2024-09-17T03:37:27.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2ac0b0e40 0x7fc2ac15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2ac0cbc10 0x7fc2ac15bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc28c078bc0 0x7fc28c07b0d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 --2- 172.21.15.121:0/3478983092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2ac074cb0 0x7fc2ac1f8680 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:27.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 -- 172.21.15.121:0/3478983092 >> 172.21.15.121:0/3478983092 conn(0x7fc2ac0cca40 msgr2=0x7fc2ac06d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:27.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 -- 172.21.15.121:0/3478983092 shutdown_connections 2024-09-17T03:37:27.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:27.991+0000 7fc2b1600640 1 -- 172.21.15.121:0/3478983092 wait complete. 2024-09-17T03:37:28.016 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:28.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.238+0000 7f06dce00640 1 -- 172.21.15.121:0/3766066460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06bc005260 msgr2=0x7f06bc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:28.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.238+0000 7f06dce00640 1 --2- 172.21.15.121:0/3766066460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06bc005260 0x7f06bc00b9c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f06d00020a0 tx=0x7f06bc005830 comp rx=0 tx=0).stop 2024-09-17T03:37:28.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.238+0000 7f06d6800640 1 -- 172.21.15.121:0/3766066460 reap_dead start 2024-09-17T03:37:28.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.238+0000 7f06dce00640 1 -- 172.21.15.121:0/3766066460 shutdown_connections 2024-09-17T03:37:28.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.238+0000 7f06dce00640 1 -- 172.21.15.121:0/3766066460 >> 172.21.15.121:0/3766066460 conn(0x7f06d80cca40 msgr2=0x7f06d80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:28.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.238+0000 7f06dce00640 1 -- 172.21.15.121:0/3766066460 shutdown_connections 2024-09-17T03:37:28.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.238+0000 7f06dce00640 1 -- 172.21.15.121:0/3766066460 wait complete. 2024-09-17T03:37:28.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.240+0000 7f06dce00640 1 Processor -- start 2024-09-17T03:37:28.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.240+0000 7f06dce00640 1 -- start start 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.242+0000 7f06dce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc005260 0x7f06d80a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.242+0000 7f06dce00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d809fd80 0x7f06d8157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.242+0000 7f06dce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d80a0190 0x7f06d8157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.242+0000 7f06dce00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f06d806df70 con 0x7f06d80a0190 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.242+0000 7f06dce00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06d806ddf0 con 0x7f06bc005260 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.242+0000 7f06dce00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06d806e0f0 con 0x7f06d809fd80 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06d6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d80a0190 0x7f06d8157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06d6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d80a0190 0x7f06d8157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39202/0 (socket says 172.21.15.121:39202) 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06d6800640 1 -- 172.21.15.121:0/1165417481 learned_addr learned my addr 172.21.15.121:0/1165417481 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06cfe00640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d809fd80 0x7f06d8157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:28.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06d5e00640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc005260 0x7f06d80a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:28.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06d6800640 1 -- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d809fd80 msgr2=0x7f06d8157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:28.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06d6800640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d809fd80 0x7f06d8157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06d6800640 1 -- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc005260 msgr2=0x7f06d80a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:28.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06d6800640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc005260 0x7f06d80a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06d6800640 1 -- 172.21.15.121:0/1165417481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d81f92c0 con 0x7f06d80a0190 2024-09-17T03:37:28.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.243+0000 7f06d6800640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d80a0190 0x7f06d8157e40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f06d002afa0 tx=0x7f06d0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:28.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.244+0000 7f06ce000640 1 -- 172.21.15.121:0/1165417481 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0001490 con 0x7f06d80a0190 2024-09-17T03:37:28.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.244+0000 7f06ce000640 1 -- 172.21.15.121:0/1165417481 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06d003f070 con 0x7f06d80a0190 2024-09-17T03:37:28.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.244+0000 7f06dce00640 1 -- 172.21.15.121:0/1165417481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d81f95a0 con 0x7f06d80a0190 2024-09-17T03:37:28.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.244+0000 7f06ce000640 1 -- 172.21.15.121:0/1165417481 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0006570 con 0x7f06d80a0190 2024-09-17T03:37:28.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.244+0000 7f06dce00640 1 -- 172.21.15.121:0/1165417481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d81f9b60 con 0x7f06d80a0190 2024-09-17T03:37:28.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.245+0000 7f06dce00640 1 -- 172.21.15.121:0/1165417481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d815a430 con 0x7f06d80a0190 2024-09-17T03:37:28.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.246+0000 7f06ce000640 1 -- 172.21.15.121:0/1165417481 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06d0037070 con 0x7f06d80a0190 2024-09-17T03:37:28.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.247+0000 7f06ce000640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f06b4078bc0 0x7f06b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:28.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.247+0000 7f06ce000640 1 -- 172.21.15.121:0/1165417481 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f06d00baa60 con 0x7f06d80a0190 2024-09-17T03:37:28.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.247+0000 7f06d5e00640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f06b4078bc0 0x7f06b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:28.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.248+0000 7f06d5e00640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f06b4078bc0 0x7f06b407b0d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f06c8001860 tx=0x7f06c8006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:28.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.252+0000 7f06ce000640 1 -- 172.21.15.121:0/1165417481 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06d815a430 con 0x7f06d80a0190 2024-09-17T03:37:28.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.435+0000 7f06dce00640 1 -- 172.21.15.121:0/1165417481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06d806f740 con 0x7f06d80a0190 2024-09-17T03:37:28.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.436+0000 7f06ce000640 1 -- 172.21.15.121:0/1165417481 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17015 (secure 0 0 0) 0x7f06d806e740 con 0x7f06d80a0190 2024-09-17T03:37:28.437 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:28.438 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":51,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:37:27.000802+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:24.915132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:25.975087+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.438+0000 7f06dce00640 1 -- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f06b4078bc0 msgr2=0x7f06b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.438+0000 7f06dce00640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f06b4078bc0 0x7f06b407b0d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f06c8001860 tx=0x7f06c8006040 comp rx=0 tx=0).stop 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.438+0000 7f06dce00640 1 -- 172.21.15.121:0/1165417481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d80a0190 msgr2=0x7f06d8157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.438+0000 7f06dce00640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d80a0190 0x7f06d8157e40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f06d002afa0 tx=0x7f06d0003d50 comp rx=0 tx=0).stop 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.439+0000 7f06dce00640 1 -- 172.21.15.121:0/1165417481 shutdown_connections 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.439+0000 7f06dce00640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f06b4078bc0 0x7f06b407b0d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.439+0000 7f06dce00640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d80a0190 0x7f06d8157e40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.439+0000 7f06dce00640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06d809fd80 0x7f06d8157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.439+0000 7f06dce00640 1 --2- 172.21.15.121:0/1165417481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06bc005260 0x7f06d80a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.439+0000 7f06dce00640 1 -- 172.21.15.121:0/1165417481 >> 172.21.15.121:0/1165417481 conn(0x7f06d80cca40 msgr2=0x7f06d815afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.439+0000 7f06dce00640 1 -- 172.21.15.121:0/1165417481 shutdown_connections 2024-09-17T03:37:28.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.439+0000 7f06dce00640 1 -- 172.21.15.121:0/1165417481 wait complete. 2024-09-17T03:37:28.466 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:37:28.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.689+0000 7efc9b200640 1 -- 172.21.15.121:0/3037077013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc9415fc50 msgr2=0x7efc9406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:28.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.689+0000 7efc9b200640 1 --2- 172.21.15.121:0/3037077013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc9415fc50 0x7efc9406ddf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efc84005fd0 tx=0x7efc8402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.689+0000 7efc9b200640 1 -- 172.21.15.121:0/3037077013 shutdown_connections 2024-09-17T03:37:28.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.689+0000 7efc9b200640 1 --2- 172.21.15.121:0/3037077013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc9406e330 0x7efc940cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.689+0000 7efc9b200640 1 --2- 172.21.15.121:0/3037077013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc9415fc50 0x7efc9406ddf0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.689+0000 7efc9b200640 1 -- 172.21.15.121:0/3037077013 >> 172.21.15.121:0/3037077013 conn(0x7efc940b1b90 msgr2=0x7efc940b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:28.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.689+0000 7efc9b200640 1 -- 172.21.15.121:0/3037077013 shutdown_connections 2024-09-17T03:37:28.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.689+0000 7efc9b200640 1 -- 172.21.15.121:0/3037077013 wait complete. 2024-09-17T03:37:28.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.691+0000 7efc9b200640 1 Processor -- start 2024-09-17T03:37:28.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.692+0000 7efc9b200640 1 -- start start 2024-09-17T03:37:28.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.693+0000 7efc9b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc9406e330 0x7efc940c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:28.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.693+0000 7efc9b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc940cf7d0 0x7efc940cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:28.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.693+0000 7efc9b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc9415fc50 0x7efc940a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.693+0000 7efc9b200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efc94070d20 con 0x7efc940cf7d0 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.693+0000 7efc9b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc94070ba0 con 0x7efc9406e330 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.693+0000 7efc9b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efc940734a0 con 0x7efc9415fc50 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.693+0000 7efc93400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc940cf7d0 0x7efc940cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.693+0000 7efc93400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc940cf7d0 0x7efc940cde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39228/0 (socket says 172.21.15.121:39228) 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.693+0000 7efc93400640 1 -- 172.21.15.121:0/3220660580 learned_addr learned my addr 172.21.15.121:0/3220660580 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc93e00640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc9406e330 0x7efc940c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc99200640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc9415fc50 0x7efc940a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc93400640 1 -- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc9415fc50 msgr2=0x7efc940a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc93400640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc9415fc50 0x7efc940a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc93400640 1 -- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc9406e330 msgr2=0x7efc940c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc93400640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc9406e330 0x7efc940c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc93400640 1 -- 172.21.15.121:0/3220660580 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc940a1030 con 0x7efc940cf7d0 2024-09-17T03:37:28.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc93400640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc940cf7d0 0x7efc940cde50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efc8000d740 tx=0x7efc8000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:28.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc8be00640 1 -- 172.21.15.121:0/3220660580 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc80017070 con 0x7efc940cf7d0 2024-09-17T03:37:28.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc8be00640 1 -- 172.21.15.121:0/3220660580 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc80009d20 con 0x7efc940cf7d0 2024-09-17T03:37:28.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc8be00640 1 -- 172.21.15.121:0/3220660580 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc800106c0 con 0x7efc940cf7d0 2024-09-17T03:37:28.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc9b200640 1 -- 172.21.15.121:0/3220660580 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc941f56e0 con 0x7efc940cf7d0 2024-09-17T03:37:28.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.694+0000 7efc9b200640 1 -- 172.21.15.121:0/3220660580 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc941f7260 con 0x7efc940cf7d0 2024-09-17T03:37:28.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.695+0000 7efc9b200640 1 -- 172.21.15.121:0/3220660580 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc940739c0 con 0x7efc940cf7d0 2024-09-17T03:37:28.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.697+0000 7efc8be00640 1 -- 172.21.15.121:0/3220660580 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efc8001a070 con 0x7efc940cf7d0 2024-09-17T03:37:28.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.698+0000 7efc8be00640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc74078b90 0x7efc7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:28.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.698+0000 7efc8be00640 1 -- 172.21.15.121:0/3220660580 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7efc8009af50 con 0x7efc940cf7d0 2024-09-17T03:37:28.698 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.698+0000 7efc93e00640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc74078b90 0x7efc7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:28.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.699+0000 7efc93e00640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc74078b90 0x7efc7407b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efc84033000 tx=0x7efc84004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:28.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.702+0000 7efc8be00640 1 -- 172.21.15.121:0/3220660580 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efc80063320 con 0x7efc940cf7d0 2024-09-17T03:37:28.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:28.922+0000 7efc9b200640 1 -- 172.21.15.121:0/3220660580 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7efc9406ff40 con 0x7efc940cf7d0 2024-09-17T03:37:29.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.551+0000 7efc8be00640 1 -- 172.21.15.121:0/3220660580 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7efc80062c20 con 0x7efc940cf7d0 2024-09-17T03:37:29.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.554+0000 7efc9b200640 1 -- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc74078b90 msgr2=0x7efc7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.554+0000 7efc9b200640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc74078b90 0x7efc7407b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efc84033000 tx=0x7efc84004730 comp rx=0 tx=0).stop 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.554+0000 7efc9b200640 1 -- 172.21.15.121:0/3220660580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc940cf7d0 msgr2=0x7efc940cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.554+0000 7efc9b200640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc940cf7d0 0x7efc940cde50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efc8000d740 tx=0x7efc8000dc00 comp rx=0 tx=0).stop 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.555+0000 7efc9b200640 1 -- 172.21.15.121:0/3220660580 shutdown_connections 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.555+0000 7efc9b200640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc9415fc50 0x7efc940a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.555+0000 7efc9b200640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc74078b90 0x7efc7407b0a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.555+0000 7efc9b200640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc940cf7d0 0x7efc940cde50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.555+0000 7efc9b200640 1 --2- 172.21.15.121:0/3220660580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc9406e330 0x7efc940c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.555+0000 7efc9b200640 1 -- 172.21.15.121:0/3220660580 >> 172.21.15.121:0/3220660580 conn(0x7efc940b1b90 msgr2=0x7efc94072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.555+0000 7efc9b200640 1 -- 172.21.15.121:0/3220660580 shutdown_connections 2024-09-17T03:37:29.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.555+0000 7efc9b200640 1 -- 172.21.15.121:0/3220660580 wait complete. 2024-09-17T03:37:29.582 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:37:29.583 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:37:29.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.806+0000 7f0dbbe00640 1 -- 172.21.15.121:0/930443959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db406e500 msgr2=0x7f0db40cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.806+0000 7f0dbbe00640 1 --2- 172.21.15.121:0/930443959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db406e500 0x7f0db40cef00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0db40b2c70 tx=0x7f0dac02aa30 comp rx=0 tx=0).stop 2024-09-17T03:37:29.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.807+0000 7f0dbbe00640 1 -- 172.21.15.121:0/930443959 shutdown_connections 2024-09-17T03:37:29.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.807+0000 7f0dbbe00640 1 --2- 172.21.15.121:0/930443959 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db406e500 0x7f0db40cef00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.807+0000 7f0dbbe00640 1 --2- 172.21.15.121:0/930443959 >> v2:172.21.15.176:3300/0 conn(0x7f0db4156a50 0x7f0db4074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.807+0000 7f0dbbe00640 1 -- 172.21.15.121:0/930443959 >> 172.21.15.121:0/930443959 conn(0x7f0db40b1b90 msgr2=0x7f0db40b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:29.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.807+0000 7f0dbbe00640 1 -- 172.21.15.121:0/930443959 shutdown_connections 2024-09-17T03:37:29.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.807+0000 7f0dbbe00640 1 -- 172.21.15.121:0/930443959 wait complete. 2024-09-17T03:37:29.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.809+0000 7f0dbbe00640 1 Processor -- start 2024-09-17T03:37:29.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.809+0000 7f0dbbe00640 1 -- start start 2024-09-17T03:37:29.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.810+0000 7f0dbbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0db4074b60 0x7f0db40c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.810+0000 7f0dbbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0db4156a50 0x7f0db415b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.810+0000 7f0dbbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db40b2ed0 0x7f0db415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.810+0000 7f0dbbe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0db40cf7d0 con 0x7f0db40b2ed0 2024-09-17T03:37:29.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.810+0000 7f0dbbe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0db40cf650 con 0x7f0db4074b60 2024-09-17T03:37:29.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.810+0000 7f0dbbe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0db40cf950 con 0x7f0db4156a50 2024-09-17T03:37:29.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db40b2ed0 0x7f0db415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:29.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db40b2ed0 0x7f0db415bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39240/0 (socket says 172.21.15.121:39240) 2024-09-17T03:37:29.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9e00640 1 -- 172.21.15.121:0/1388542907 learned_addr learned my addr 172.21.15.121:0/1388542907 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:29.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9400640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0db4074b60 0x7f0db40c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:29.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db8a00640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0db4156a50 0x7f0db415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:29.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9e00640 1 -- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0db4156a50 msgr2=0x7f0db415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9e00640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0db4156a50 0x7f0db415b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9e00640 1 -- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0db4074b60 msgr2=0x7f0db40c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9e00640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0db4074b60 0x7f0db40c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9e00640 1 -- 172.21.15.121:0/1388542907 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db41f4fb0 con 0x7f0db40b2ed0 2024-09-17T03:37:29.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9400640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0db4074b60 0x7f0db40c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:29.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.811+0000 7f0db9e00640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db40b2ed0 0x7f0db415bcb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0dac005fd0 tx=0x7f0dac003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:29.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.812+0000 7f0db1600640 1 -- 172.21.15.121:0/1388542907 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac033050 con 0x7f0db40b2ed0 2024-09-17T03:37:29.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.812+0000 7f0db1600640 1 -- 172.21.15.121:0/1388542907 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dac004450 con 0x7f0db40b2ed0 2024-09-17T03:37:29.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.812+0000 7f0db1600640 1 -- 172.21.15.121:0/1388542907 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac004840 con 0x7f0db40b2ed0 2024-09-17T03:37:29.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.812+0000 7f0dbbe00640 1 -- 172.21.15.121:0/1388542907 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db41ea800 con 0x7f0db40b2ed0 2024-09-17T03:37:29.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.812+0000 7f0dbbe00640 1 -- 172.21.15.121:0/1388542907 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db41eadc0 con 0x7f0db40b2ed0 2024-09-17T03:37:29.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.813+0000 7f0dbbe00640 1 -- 172.21.15.121:0/1388542907 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db40cef00 con 0x7f0db40b2ed0 2024-09-17T03:37:29.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.814+0000 7f0db1600640 1 -- 172.21.15.121:0/1388542907 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0dac036070 con 0x7f0db40b2ed0 2024-09-17T03:37:29.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.815+0000 7f0db1600640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d94078bc0 0x7f0d9407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.815+0000 7f0db1600640 1 -- 172.21.15.121:0/1388542907 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f0dac0bc370 con 0x7f0db40b2ed0 2024-09-17T03:37:29.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.816+0000 7f0db9400640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d94078bc0 0x7f0d9407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:29.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.816+0000 7f0db9400640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d94078bc0 0x7f0d9407b0d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009aa0 tx=0x7f0da8005db0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:29.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:29.820+0000 7f0db1600640 1 -- 172.21.15.121:0/1388542907 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0dac0846b0 con 0x7f0db40b2ed0 2024-09-17T03:37:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.038+0000 7f0dbbe00640 1 -- 172.21.15.121:0/1388542907 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0db4070a60 con 0x7f0db40b2ed0 2024-09-17T03:37:30.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.560+0000 7f0db1600640 1 -- 172.21.15.121:0/1388542907 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f0dac083fb0 con 0x7f0db40b2ed0 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 -- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d94078bc0 msgr2=0x7f0d9407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d94078bc0 0x7f0d9407b0d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009aa0 tx=0x7f0da8005db0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 -- 172.21.15.121:0/1388542907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db40b2ed0 msgr2=0x7f0db415bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db40b2ed0 0x7f0db415bcb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0dac005fd0 tx=0x7f0dac003f10 comp rx=0 tx=0).stop 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 -- 172.21.15.121:0/1388542907 shutdown_connections 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d94078bc0 0x7f0d9407b0d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0db40b2ed0 0x7f0db415bcb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0db4156a50 0x7f0db415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 --2- 172.21.15.121:0/1388542907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0db4074b60 0x7f0db40c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 -- 172.21.15.121:0/1388542907 >> 172.21.15.121:0/1388542907 conn(0x7f0db40b1b90 msgr2=0x7f0db415f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:30.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 -- 172.21.15.121:0/1388542907 shutdown_connections 2024-09-17T03:37:30.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.563+0000 7f0dbbe00640 1 -- 172.21.15.121:0/1388542907 wait complete. 2024-09-17T03:37:30.587 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:37:30.587 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:30.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.807+0000 7fa0fc200640 1 -- 172.21.15.121:0/523756314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0f40cf930 msgr2=0x7fa0f40ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.807+0000 7fa0fc200640 1 --2- 172.21.15.121:0/523756314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0f40cf930 0x7fa0f40ce320 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4072b60 tx=0x7fa0e002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.807+0000 7fa0fc200640 1 -- 172.21.15.121:0/523756314 shutdown_connections 2024-09-17T03:37:30.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.807+0000 7fa0fc200640 1 --2- 172.21.15.121:0/523756314 >> v2:172.21.15.176:3300/0 conn(0x7fa0f40ce860 0x7fa0f415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.807+0000 7fa0fc200640 1 --2- 172.21.15.121:0/523756314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0f40cf930 0x7fa0f40ce320 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.807+0000 7fa0fc200640 1 -- 172.21.15.121:0/523756314 >> 172.21.15.121:0/523756314 conn(0x7fa0f40cca40 msgr2=0x7fa0f40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:30.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.807+0000 7fa0fc200640 1 -- 172.21.15.121:0/523756314 shutdown_connections 2024-09-17T03:37:30.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.807+0000 7fa0fc200640 1 -- 172.21.15.121:0/523756314 wait complete. 2024-09-17T03:37:30.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.810+0000 7fa0fc200640 1 Processor -- start 2024-09-17T03:37:30.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.810+0000 7fa0fc200640 1 -- start start 2024-09-17T03:37:30.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.811+0000 7fa0fc200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f40ce860 0x7fa0f40b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.811+0000 7fa0fc200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0f40cf930 0x7fa0f40c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.811+0000 7fa0fc200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0f415b9f0 0x7fa0f40b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.811+0000 7fa0fc200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f406ddf0 con 0x7fa0f40cf930 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.811+0000 7fa0fc200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f415fe60 con 0x7fa0f40ce860 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.811+0000 7fa0fc200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f406df70 con 0x7fa0f415b9f0 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.811+0000 7fa0f8e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0f40cf930 0x7fa0f40c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.812+0000 7fa0f8e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0f40cf930 0x7fa0f40c2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39252/0 (socket says 172.21.15.121:39252) 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.812+0000 7fa0f8e00640 1 -- 172.21.15.121:0/3368937579 learned_addr learned my addr 172.21.15.121:0/3368937579 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.812+0000 7fa0f9800640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f40ce860 0x7fa0f40b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.812+0000 7fa0fa200640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0f415b9f0 0x7fa0f40b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.812+0000 7fa0f8e00640 1 -- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0f415b9f0 msgr2=0x7fa0f40b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.812+0000 7fa0f8e00640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0f415b9f0 0x7fa0f40b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.812+0000 7fa0f8e00640 1 -- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f40ce860 msgr2=0x7fa0f40b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.812+0000 7fa0f8e00640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f40ce860 0x7fa0f40b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.812+0000 7fa0f8e00640 1 -- 172.21.15.121:0/3368937579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f40c61d0 con 0x7fa0f40cf930 2024-09-17T03:37:30.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.812+0000 7fa0f8e00640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0f40cf930 0x7fa0f40c2c20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0000c00 tx=0x7fa0e0003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:30.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.813+0000 7fa0f1600640 1 -- 172.21.15.121:0/3368937579 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e003e030 con 0x7fa0f40cf930 2024-09-17T03:37:30.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.813+0000 7fa0f1600640 1 -- 172.21.15.121:0/3368937579 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0e0003d10 con 0x7fa0f40cf930 2024-09-17T03:37:30.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.813+0000 7fa0fc200640 1 -- 172.21.15.121:0/3368937579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f40c3d90 con 0x7fa0f40cf930 2024-09-17T03:37:30.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.813+0000 7fa0f1600640 1 -- 172.21.15.121:0/3368937579 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0035040 con 0x7fa0f40cf930 2024-09-17T03:37:30.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.813+0000 7fa0fc200640 1 -- 172.21.15.121:0/3368937579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f40c6450 con 0x7fa0f40cf930 2024-09-17T03:37:30.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.814+0000 7fa0fc200640 1 -- 172.21.15.121:0/3368937579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f406e420 con 0x7fa0f40cf930 2024-09-17T03:37:30.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.815+0000 7fa0f1600640 1 -- 172.21.15.121:0/3368937579 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0e0041030 con 0x7fa0f40cf930 2024-09-17T03:37:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.816+0000 7fa0f1600640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa0d4078bc0 0x7fa0d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.816+0000 7fa0f1600640 1 -- 172.21.15.121:0/3368937579 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fa0e00bb580 con 0x7fa0f40cf930 2024-09-17T03:37:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.816+0000 7fa0f9800640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa0d4078bc0 0x7fa0d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.817+0000 7fa0f9800640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa0d4078bc0 0x7fa0d407b0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8001720 tx=0x7fa0e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:30.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:30.821+0000 7fa0f1600640 1 -- 172.21.15.121:0/3368937579 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0f40c61d0 con 0x7fa0f40cf930 2024-09-17T03:37:31.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.040+0000 7fa0fc200640 1 -- 172.21.15.121:0/3368937579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0f40cf5d0 con 0x7fa0f40cf930 2024-09-17T03:37:31.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.041+0000 7fa0f1600640 1 -- 172.21.15.121:0/3368937579 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5235 (secure 0 0 0) 0x7fa0e00831d0 con 0x7fa0f40cf930 2024-09-17T03:37:31.042 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:31.042 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"btime":"2024-09-17T03:37:30:553841+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4041842554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4041842554},{"type":"v1","addr":"172.21.15.176:6837","nonce":4041842554}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5308,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1921105537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1921105537},{"type":"v1","addr":"172.21.15.176:6836","nonce":1921105537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/1479695563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1479695563},{"type":"v1","addr":"172.21.15.121:6833","nonce":1479695563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:27.000747+0000","modified":"2024-09-17T03:37:30.040560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5388},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5388":{"gid":5388,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3704628086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3704628086},{"type":"v1","addr":"172.21.15.121:6835","nonce":3704628086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5388,"qdb_cluster":[5388]},"id":3}]} 2024-09-17T03:37:31.042 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 28 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 -- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa0d4078bc0 msgr2=0x7fa0d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa0d4078bc0 0x7fa0d407b0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8001720 tx=0x7fa0e8009040 comp rx=0 tx=0).stop 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 -- 172.21.15.121:0/3368937579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0f40cf930 msgr2=0x7fa0f40c2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0f40cf930 0x7fa0f40c2c20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0000c00 tx=0x7fa0e0003820 comp rx=0 tx=0).stop 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 -- 172.21.15.121:0/3368937579 shutdown_connections 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0f415b9f0 0x7fa0f40b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa0d4078bc0 0x7fa0d407b0d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0f40cf930 0x7fa0f40c2c20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 --2- 172.21.15.121:0/3368937579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f40ce860 0x7fa0f40b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 -- 172.21.15.121:0/3368937579 >> 172.21.15.121:0/3368937579 conn(0x7fa0f40cca40 msgr2=0x7fa0f4159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 -- 172.21.15.121:0/3368937579 shutdown_connections 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.043+0000 7fa0fc200640 1 -- 172.21.15.121:0/3368937579 wait complete. 2024-09-17T03:37:31.066 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:31.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.285+0000 7f37f3200640 1 -- 172.21.15.121:0/1370053133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37f415cb20 msgr2=0x7f37f40cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.285+0000 7f37f3200640 1 --2- 172.21.15.121:0/1370053133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37f415cb20 0x7f37f40cddc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f37e4005fd0 tx=0x7f37e402aa90 comp rx=0 tx=0).stop 2024-09-17T03:37:31.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.285+0000 7f37f3200640 1 -- 172.21.15.121:0/1370053133 shutdown_connections 2024-09-17T03:37:31.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.285+0000 7f37f3200640 1 --2- 172.21.15.121:0/1370053133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f40cc8d0 0x7f37f40ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.285+0000 7f37f3200640 1 --2- 172.21.15.121:0/1370053133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37f415cb20 0x7f37f40cddc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.285+0000 7f37f3200640 1 -- 172.21.15.121:0/1370053133 >> 172.21.15.121:0/1370053133 conn(0x7f37f406f940 msgr2=0x7f37f40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.285+0000 7f37f3200640 1 -- 172.21.15.121:0/1370053133 shutdown_connections 2024-09-17T03:37:31.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.285+0000 7f37f3200640 1 -- 172.21.15.121:0/1370053133 wait complete. 2024-09-17T03:37:31.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.287+0000 7f37f3200640 1 Processor -- start 2024-09-17T03:37:31.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.288+0000 7f37f3200640 1 -- start start 2024-09-17T03:37:31.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37f3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37f40b4990 0x7f37f40a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37f3200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37f40cc8d0 0x7f37f41f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37f3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f415cb20 0x7f37f4152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37f3200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f37f406d600 con 0x7f37f40cc8d0 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37f3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37f406d480 con 0x7f37f40b4990 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37f3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37f406d780 con 0x7f37f415cb20 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37e9400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37f40cc8d0 0x7f37f41f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37e9400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37f40cc8d0 0x7f37f41f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39270/0 (socket says 172.21.15.121:39270) 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37e9400640 1 -- 172.21.15.121:0/872533784 learned_addr learned my addr 172.21.15.121:0/872533784 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37f1e00640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37f40b4990 0x7f37f40a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.289+0000 7f37f2800640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f415cb20 0x7f37f4152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37e9400640 1 -- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f415cb20 msgr2=0x7f37f4152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37e9400640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f415cb20 0x7f37f4152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37e9400640 1 -- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37f40b4990 msgr2=0x7f37f40a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37e9400640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37f40b4990 0x7f37f40a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37e9400640 1 -- 172.21.15.121:0/872533784 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f41f59e0 con 0x7f37f40cc8d0 2024-09-17T03:37:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37e9400640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37f40cc8d0 0x7f37f41f54a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00d740 tx=0x7f37dc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37eaa00640 1 -- 172.21.15.121:0/872533784 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc017070 con 0x7f37f40cc8d0 2024-09-17T03:37:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37eaa00640 1 -- 172.21.15.121:0/872533784 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37dc009d20 con 0x7f37f40cc8d0 2024-09-17T03:37:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37f3200640 1 -- 172.21.15.121:0/872533784 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f41f5ef0 con 0x7f37f40cc8d0 2024-09-17T03:37:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37eaa00640 1 -- 172.21.15.121:0/872533784 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0106c0 con 0x7f37f40cc8d0 2024-09-17T03:37:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.290+0000 7f37f3200640 1 -- 172.21.15.121:0/872533784 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f4072d80 con 0x7f37f40cc8d0 2024-09-17T03:37:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.291+0000 7f37f3200640 1 -- 172.21.15.121:0/872533784 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f41f5c60 con 0x7f37f40cc8d0 2024-09-17T03:37:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.293+0000 7f37eaa00640 1 -- 172.21.15.121:0/872533784 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f37dc01a070 con 0x7f37f40cc8d0 2024-09-17T03:37:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.294+0000 7f37eaa00640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f37d0078bc0 0x7f37d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.294+0000 7f37eaa00640 1 -- 172.21.15.121:0/872533784 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f37dc09aff0 con 0x7f37f40cc8d0 2024-09-17T03:37:31.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.294+0000 7f37f1e00640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f37d0078bc0 0x7f37d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.295+0000 7f37f1e00640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f37d0078bc0 0x7f37d007b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f37e4035000 tx=0x7f37e4038040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:31.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.298+0000 7f37eaa00640 1 -- 172.21.15.121:0/872533784 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f37dc062b90 con 0x7f37f40cc8d0 2024-09-17T03:37:31.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.481+0000 7f37f3200640 1 -- 172.21.15.121:0/872533784 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37f40cd5b0 con 0x7f37f40cc8d0 2024-09-17T03:37:31.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.482+0000 7f37eaa00640 1 -- 172.21.15.121:0/872533784 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+17002 (secure 0 0 0) 0x7f37dc0675c0 con 0x7f37f40cc8d0 2024-09-17T03:37:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:31.484 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":52,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:37:28.529919+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:24.915132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:25.975087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:31.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 -- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f37d0078bc0 msgr2=0x7f37d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f37d0078bc0 0x7f37d007b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f37e4035000 tx=0x7f37e4038040 comp rx=0 tx=0).stop 2024-09-17T03:37:31.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 -- 172.21.15.121:0/872533784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37f40cc8d0 msgr2=0x7f37f41f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37f40cc8d0 0x7f37f41f54a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00d740 tx=0x7f37dc00dc00 comp rx=0 tx=0).stop 2024-09-17T03:37:31.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 -- 172.21.15.121:0/872533784 shutdown_connections 2024-09-17T03:37:31.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37f415cb20 0x7f37f4152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f37d0078bc0 0x7f37d007b0d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37f40cc8d0 0x7f37f41f54a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 --2- 172.21.15.121:0/872533784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37f40b4990 0x7f37f40a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 -- 172.21.15.121:0/872533784 >> 172.21.15.121:0/872533784 conn(0x7f37f406f940 msgr2=0x7f37f40b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 -- 172.21.15.121:0/872533784 shutdown_connections 2024-09-17T03:37:31.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.485+0000 7f37f3200640 1 -- 172.21.15.121:0/872533784 wait complete. 2024-09-17T03:37:31.508 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:37:31.508 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:31.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.728+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3676229587 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d3406e500 msgr2=0x7f8d340cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.728+0000 7f8d3ac00640 1 --2- 172.21.15.121:0/3676229587 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d3406e500 0x7f8d340cc020 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c005fd0 tx=0x7f8d2c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.728+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3676229587 shutdown_connections 2024-09-17T03:37:31.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.728+0000 7f8d3ac00640 1 --2- 172.21.15.121:0/3676229587 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d3406e500 0x7f8d340cc020 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.728+0000 7f8d3ac00640 1 --2- 172.21.15.121:0/3676229587 >> v2:172.21.15.176:3300/0 conn(0x7f8d34074cb0 0x7f8d34073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.728+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3676229587 >> 172.21.15.121:0/3676229587 conn(0x7f8d340cca40 msgr2=0x7f8d340cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.728+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3676229587 shutdown_connections 2024-09-17T03:37:31.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.728+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3676229587 wait complete. 2024-09-17T03:37:31.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.730+0000 7f8d3ac00640 1 Processor -- start 2024-09-17T03:37:31.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.730+0000 7f8d3ac00640 1 -- start start 2024-09-17T03:37:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d3ac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d34074cb0 0x7f8d3409c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d3ac00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d340cbc10 0x7f8d341e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d3ac00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d34157ca0 0x7f8d3409e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d3ac00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3406f3f0 con 0x7f8d34157ca0 2024-09-17T03:37:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d3ac00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3406f270 con 0x7f8d340cbc10 2024-09-17T03:37:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d3ac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3406f570 con 0x7f8d34074cb0 2024-09-17T03:37:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d38c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d34157ca0 0x7f8d3409e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d38c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d34157ca0 0x7f8d3409e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39278/0 (socket says 172.21.15.121:39278) 2024-09-17T03:37:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d38c00640 1 -- 172.21.15.121:0/3179961733 learned_addr learned my addr 172.21.15.121:0/3179961733 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d33400640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d340cbc10 0x7f8d341e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d33e00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d34074cb0 0x7f8d3409c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d38c00640 1 -- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d34074cb0 msgr2=0x7f8d3409c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d38c00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d34074cb0 0x7f8d3409c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d38c00640 1 -- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d340cbc10 msgr2=0x7f8d341e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d38c00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d340cbc10 0x7f8d341e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.732+0000 7f8d38c00640 1 -- 172.21.15.121:0/3179961733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3409b590 con 0x7f8d34157ca0 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.733+0000 7f8d38c00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d34157ca0 0x7f8d3409e140 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009cd0 tx=0x7f8d2c031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.733+0000 7f8d2be00640 1 -- 172.21.15.121:0/3179961733 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c031990 con 0x7f8d34157ca0 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.733+0000 7f8d2be00640 1 -- 172.21.15.121:0/3179961733 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d2c031c20 con 0x7f8d34157ca0 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.733+0000 7f8d2be00640 1 -- 172.21.15.121:0/3179961733 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0330d0 con 0x7f8d34157ca0 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.733+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3179961733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3409ce80 con 0x7f8d34157ca0 2024-09-17T03:37:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.733+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3179961733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3409c910 con 0x7f8d34157ca0 2024-09-17T03:37:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.734+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3179961733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3406fa90 con 0x7f8d34157ca0 2024-09-17T03:37:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.735+0000 7f8d2be00640 1 -- 172.21.15.121:0/3179961733 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d2c033270 con 0x7f8d34157ca0 2024-09-17T03:37:31.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.736+0000 7f8d2be00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d14078b90 0x7f8d1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.736+0000 7f8d2be00640 1 -- 172.21.15.121:0/3179961733 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f8d2c0bc480 con 0x7f8d34157ca0 2024-09-17T03:37:31.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.737+0000 7f8d33e00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d14078b90 0x7f8d1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.737+0000 7f8d33e00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d14078b90 0x7f8d1407b0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8d3415a730 tx=0x7f8d24009260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:31.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.741+0000 7f8d2be00640 1 -- 172.21.15.121:0/3179961733 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8d2c03f030 con 0x7f8d34157ca0 2024-09-17T03:37:31.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.921+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3179961733 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d341f39a0 con 0x7f8d14078b90 2024-09-17T03:37:31.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.926+0000 7f8d2be00640 1 -- 172.21.15.121:0/3179961733 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251541 (secure 0 0 0) 0x7f8d24011ad0 con 0x7f8d14078b90 2024-09-17T03:37:31.930 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:31.931 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:37:31.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d14078b90 msgr2=0x7f8d1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d14078b90 0x7f8d1407b0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8d3415a730 tx=0x7f8d24009260 comp rx=0 tx=0).stop 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3179961733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d34157ca0 msgr2=0x7f8d3409e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d34157ca0 0x7f8d3409e140 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009cd0 tx=0x7f8d2c031700 comp rx=0 tx=0).stop 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3179961733 shutdown_connections 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d14078b90 0x7f8d1407b0a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d34157ca0 0x7f8d3409e140 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d340cbc10 0x7f8d341e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 --2- 172.21.15.121:0/3179961733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d34074cb0 0x7f8d3409c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3179961733 >> 172.21.15.121:0/3179961733 conn(0x7f8d340cca40 msgr2=0x7f8d3406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3179961733 shutdown_connections 2024-09-17T03:37:31.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:31.930+0000 7f8d3ac00640 1 -- 172.21.15.121:0/3179961733 wait complete. 2024-09-17T03:37:31.954 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-17T03:37:31.308651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222180,"kb_used_data":5948,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752540,"statfs":{"total":773094113280,"available":772866600960,"internally_reserved":0,"allocated":6090752,"data_stored":3315929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.806591"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536989+0000","last_change":"2024-09-17T03:37:27.540668+0000","last_active":"2024-09-17T03:37:28.536989+0000","last_peered":"2024-09-17T03:37:28.536989+0000","last_clean":"2024-09-17T03:37:28.536989+0000","last_became_active":"2024-09-17T03:37:27.537774+0000","last_became_peered":"2024-09-17T03:37:27.537774+0000","last_unstale":"2024-09-17T03:37:28.536989+0000","last_undegraded":"2024-09-17T03:37:28.536989+0000","last_fullsized":"2024-09-17T03:37:28.536989+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:33.857227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921909+0000","last_change":"2024-09-17T03:37:27.545950+0000","last_active":"2024-09-17T03:37:28.921909+0000","last_peered":"2024-09-17T03:37:28.921909+0000","last_clean":"2024-09-17T03:37:28.921909+0000","last_became_active":"2024-09-17T03:37:27.545651+0000","last_became_peered":"2024-09-17T03:37:27.545651+0000","last_unstale":"2024-09-17T03:37:28.921909+0000","last_undegraded":"2024-09-17T03:37:28.921909+0000","last_fullsized":"2024-09-17T03:37:28.921909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:55.838205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.530643+0000","last_change":"2024-09-17T03:37:27.530643+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.530643+0000","last_undegraded":"2024-09-17T03:37:27.530643+0000","last_fullsized":"2024-09-17T03:37:27.530643+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971871+0000","last_change":"2024-09-17T03:37:27.549625+0000","last_active":"2024-09-17T03:37:28.971871+0000","last_peered":"2024-09-17T03:37:28.971871+0000","last_clean":"2024-09-17T03:37:28.971871+0000","last_became_active":"2024-09-17T03:37:27.549336+0000","last_became_peered":"2024-09-17T03:37:27.549336+0000","last_unstale":"2024-09-17T03:37:28.971871+0000","last_undegraded":"2024-09-17T03:37:28.971871+0000","last_fullsized":"2024-09-17T03:37:28.971871+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:53.792718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921565+0000","last_change":"2024-09-17T03:37:27.551257+0000","last_active":"2024-09-17T03:37:28.921565+0000","last_peered":"2024-09-17T03:37:28.921565+0000","last_clean":"2024-09-17T03:37:28.921565+0000","last_became_active":"2024-09-17T03:37:27.550886+0000","last_became_peered":"2024-09-17T03:37:27.550886+0000","last_unstale":"2024-09-17T03:37:28.921565+0000","last_undegraded":"2024-09-17T03:37:28.921565+0000","last_fullsized":"2024-09-17T03:37:28.921565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536419+0000","last_change":"2024-09-17T03:37:27.545772+0000","last_active":"2024-09-17T03:37:28.536419+0000","last_peered":"2024-09-17T03:37:28.536419+0000","last_clean":"2024-09-17T03:37:28.536419+0000","last_became_active":"2024-09-17T03:37:27.545156+0000","last_became_peered":"2024-09-17T03:37:27.545156+0000","last_unstale":"2024-09-17T03:37:28.536419+0000","last_undegraded":"2024-09-17T03:37:28.536419+0000","last_fullsized":"2024-09-17T03:37:28.536419+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:53.792718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972117+0000","last_change":"2024-09-17T03:37:27.549769+0000","last_active":"2024-09-17T03:37:28.972117+0000","last_peered":"2024-09-17T03:37:28.972117+0000","last_clean":"2024-09-17T03:37:28.972117+0000","last_became_active":"2024-09-17T03:37:27.549437+0000","last_became_peered":"2024-09-17T03:37:27.549437+0000","last_unstale":"2024-09-17T03:37:28.972117+0000","last_undegraded":"2024-09-17T03:37:28.972117+0000","last_fullsized":"2024-09-17T03:37:28.972117+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:55.838205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535267+0000","last_change":"2024-09-17T03:37:27.534750+0000","last_active":"2024-09-17T03:37:28.535267+0000","last_peered":"2024-09-17T03:37:28.535267+0000","last_clean":"2024-09-17T03:37:28.535267+0000","last_became_active":"2024-09-17T03:37:27.534326+0000","last_became_peered":"2024-09-17T03:37:27.534326+0000","last_unstale":"2024-09-17T03:37:28.535267+0000","last_undegraded":"2024-09-17T03:37:28.535267+0000","last_fullsized":"2024-09-17T03:37:28.535267+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:25.188857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.531549+0000","last_change":"2024-09-17T03:37:27.531549+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.531549+0000","last_undegraded":"2024-09-17T03:37:27.531549+0000","last_fullsized":"2024-09-17T03:37:27.531549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972624+0000","last_change":"2024-09-17T03:37:27.543273+0000","last_active":"2024-09-17T03:37:28.972624+0000","last_peered":"2024-09-17T03:37:28.972624+0000","last_clean":"2024-09-17T03:37:28.972624+0000","last_became_active":"2024-09-17T03:37:27.542939+0000","last_became_peered":"2024-09-17T03:37:27.542939+0000","last_unstale":"2024-09-17T03:37:28.972624+0000","last_undegraded":"2024-09-17T03:37:28.972624+0000","last_fullsized":"2024-09-17T03:37:28.972624+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:47.056365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536597+0000","last_change":"2024-09-17T03:37:27.537150+0000","last_active":"2024-09-17T03:37:28.536597+0000","last_peered":"2024-09-17T03:37:28.536597+0000","last_clean":"2024-09-17T03:37:28.536597+0000","last_became_active":"2024-09-17T03:37:27.536812+0000","last_became_peered":"2024-09-17T03:37:27.536812+0000","last_unstale":"2024-09-17T03:37:28.536597+0000","last_undegraded":"2024-09-17T03:37:28.536597+0000","last_fullsized":"2024-09-17T03:37:28.536597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:27.755987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537577+0000","last_change":"2024-09-17T03:37:27.554147+0000","last_active":"2024-09-17T03:37:28.537577+0000","last_peered":"2024-09-17T03:37:28.537577+0000","last_clean":"2024-09-17T03:37:28.537577+0000","last_became_active":"2024-09-17T03:37:27.553846+0000","last_became_peered":"2024-09-17T03:37:27.553846+0000","last_unstale":"2024-09-17T03:37:28.537577+0000","last_undegraded":"2024-09-17T03:37:28.537577+0000","last_fullsized":"2024-09-17T03:37:28.537577+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537004+0000","last_change":"2024-09-17T03:37:27.543555+0000","last_active":"2024-09-17T03:37:28.537004+0000","last_peered":"2024-09-17T03:37:28.537004+0000","last_clean":"2024-09-17T03:37:28.537004+0000","last_became_active":"2024-09-17T03:37:27.543195+0000","last_became_peered":"2024-09-17T03:37:27.543195+0000","last_unstale":"2024-09-17T03:37:28.537004+0000","last_undegraded":"2024-09-17T03:37:28.537004+0000","last_fullsized":"2024-09-17T03:37:28.537004+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:27.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536509+0000","last_change":"2024-09-17T03:37:27.542230+0000","last_active":"2024-09-17T03:37:28.536509+0000","last_peered":"2024-09-17T03:37:28.536509+0000","last_clean":"2024-09-17T03:37:28.536509+0000","last_became_active":"2024-09-17T03:37:27.541912+0000","last_became_peered":"2024-09-17T03:37:27.541912+0000","last_unstale":"2024-09-17T03:37:28.536509+0000","last_undegraded":"2024-09-17T03:37:28.536509+0000","last_fullsized":"2024-09-17T03:37:28.536509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:00.468303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971820+0000","last_change":"2024-09-17T03:37:27.546632+0000","last_active":"2024-09-17T03:37:28.971820+0000","last_peered":"2024-09-17T03:37:28.971820+0000","last_clean":"2024-09-17T03:37:28.971820+0000","last_became_active":"2024-09-17T03:37:27.544485+0000","last_became_peered":"2024-09-17T03:37:27.544485+0000","last_unstale":"2024-09-17T03:37:28.971820+0000","last_undegraded":"2024-09-17T03:37:28.971820+0000","last_fullsized":"2024-09-17T03:37:28.971820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:38.995552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535503+0000","last_change":"2024-09-17T03:37:27.538588+0000","last_active":"2024-09-17T03:37:28.535503+0000","last_peered":"2024-09-17T03:37:28.535503+0000","last_clean":"2024-09-17T03:37:28.535503+0000","last_became_active":"2024-09-17T03:37:27.538287+0000","last_became_peered":"2024-09-17T03:37:27.538287+0000","last_unstale":"2024-09-17T03:37:28.535503+0000","last_undegraded":"2024-09-17T03:37:28.535503+0000","last_fullsized":"2024-09-17T03:37:28.535503+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:38.995552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537009+0000","last_change":"2024-09-17T03:37:27.538911+0000","last_active":"2024-09-17T03:37:28.537009+0000","last_peered":"2024-09-17T03:37:28.537009+0000","last_clean":"2024-09-17T03:37:28.537009+0000","last_became_active":"2024-09-17T03:37:27.538020+0000","last_became_peered":"2024-09-17T03:37:27.538020+0000","last_unstale":"2024-09-17T03:37:28.537009+0000","last_undegraded":"2024-09-17T03:37:28.537009+0000","last_fullsized":"2024-09-17T03:37:28.537009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:28.630655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972164+0000","last_change":"2024-09-17T03:37:27.550328+0000","last_active":"2024-09-17T03:37:28.972164+0000","last_peered":"2024-09-17T03:37:28.972164+0000","last_clean":"2024-09-17T03:37:28.972164+0000","last_became_active":"2024-09-17T03:37:27.550060+0000","last_became_peered":"2024-09-17T03:37:27.550060+0000","last_unstale":"2024-09-17T03:37:28.972164+0000","last_undegraded":"2024-09-17T03:37:28.972164+0000","last_fullsized":"2024-09-17T03:37:28.972164+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.530238+0000","last_change":"2024-09-17T03:37:27.530238+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.530238+0000","last_undegraded":"2024-09-17T03:37:27.530238+0000","last_fullsized":"2024-09-17T03:37:27.530238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921606+0000","last_change":"2024-09-17T03:37:27.543944+0000","last_active":"2024-09-17T03:37:28.921606+0000","last_peered":"2024-09-17T03:37:28.921606+0000","last_clean":"2024-09-17T03:37:28.921606+0000","last_became_active":"2024-09-17T03:37:27.543589+0000","last_became_peered":"2024-09-17T03:37:27.543589+0000","last_unstale":"2024-09-17T03:37:28.921606+0000","last_undegraded":"2024-09-17T03:37:28.921606+0000","last_fullsized":"2024-09-17T03:37:28.921606+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971895+0000","last_change":"2024-09-17T03:37:27.552202+0000","last_active":"2024-09-17T03:37:28.971895+0000","last_peered":"2024-09-17T03:37:28.971895+0000","last_clean":"2024-09-17T03:37:28.971895+0000","last_became_active":"2024-09-17T03:37:27.544791+0000","last_became_peered":"2024-09-17T03:37:27.544791+0000","last_unstale":"2024-09-17T03:37:28.971895+0000","last_undegraded":"2024-09-17T03:37:28.971895+0000","last_fullsized":"2024-09-17T03:37:28.971895+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:26.981822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.544978+0000","last_change":"2024-09-17T03:37:27.544863+0000","last_active":"2024-09-17T03:37:27.544978+0000","last_peered":"2024-09-17T03:37:27.544978+0000","last_clean":"2024-09-17T03:37:27.544978+0000","last_became_active":"2024-09-17T03:37:27.544558+0000","last_became_peered":"2024-09-17T03:37:27.544558+0000","last_unstale":"2024-09-17T03:37:27.544978+0000","last_undegraded":"2024-09-17T03:37:27.544978+0000","last_fullsized":"2024-09-17T03:37:27.544978+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:08.297337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.541628+0000","last_change":"2024-09-17T03:37:27.541536+0000","last_active":"2024-09-17T03:37:27.541628+0000","last_peered":"2024-09-17T03:37:27.541628+0000","last_clean":"2024-09-17T03:37:27.541628+0000","last_became_active":"2024-09-17T03:37:27.541232+0000","last_became_peered":"2024-09-17T03:37:27.541232+0000","last_unstale":"2024-09-17T03:37:27.541628+0000","last_undegraded":"2024-09-17T03:37:27.541628+0000","last_fullsized":"2024-09-17T03:37:27.541628+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:48.502039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":4,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.547174+0000","last_change":"2024-09-17T03:37:27.527863+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.547174+0000","last_undegraded":"2024-09-17T03:37:27.547174+0000","last_fullsized":"2024-09-17T03:37:27.547174+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536786+0000","last_change":"2024-09-17T03:37:27.551785+0000","last_active":"2024-09-17T03:37:28.536786+0000","last_peered":"2024-09-17T03:37:28.536786+0000","last_clean":"2024-09-17T03:37:28.536786+0000","last_became_active":"2024-09-17T03:37:27.551351+0000","last_became_peered":"2024-09-17T03:37:27.551351+0000","last_unstale":"2024-09-17T03:37:28.536786+0000","last_undegraded":"2024-09-17T03:37:28.536786+0000","last_fullsized":"2024-09-17T03:37:28.536786+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:22.489576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":6,"reported_epoch":51,"state":"active","last_fresh":"2024-09-17T03:37:27.547753+0000","last_change":"2024-09-17T03:37:27.547681+0000","last_active":"2024-09-17T03:37:27.547753+0000","last_peered":"2024-09-17T03:37:27.547753+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"2024-09-17T03:37:27.547681+0000","last_became_peered":"2024-09-17T03:37:27.547681+0000","last_unstale":"2024-09-17T03:37:27.547753+0000","last_undegraded":"2024-09-17T03:37:27.547753+0000","last_fullsized":"2024-09-17T03:37:27.547753+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537358+0000","last_change":"2024-09-17T03:37:27.547485+0000","last_active":"2024-09-17T03:37:28.537358+0000","last_peered":"2024-09-17T03:37:28.537358+0000","last_clean":"2024-09-17T03:37:28.537358+0000","last_became_active":"2024-09-17T03:37:27.546932+0000","last_became_peered":"2024-09-17T03:37:27.546932+0000","last_unstale":"2024-09-17T03:37:28.537358+0000","last_undegraded":"2024-09-17T03:37:28.537358+0000","last_fullsized":"2024-09-17T03:37:28.537358+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921642+0000","last_change":"2024-09-17T03:37:27.552987+0000","last_active":"2024-09-17T03:37:28.921642+0000","last_peered":"2024-09-17T03:37:28.921642+0000","last_clean":"2024-09-17T03:37:28.921642+0000","last_became_active":"2024-09-17T03:37:27.552509+0000","last_became_peered":"2024-09-17T03:37:27.552509+0000","last_unstale":"2024-09-17T03:37:28.921642+0000","last_undegraded":"2024-09-17T03:37:28.921642+0000","last_fullsized":"2024-09-17T03:37:28.921642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:20.292074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535969+0000","last_change":"2024-09-17T03:37:27.546789+0000","last_active":"2024-09-17T03:37:28.535969+0000","last_peered":"2024-09-17T03:37:28.535969+0000","last_clean":"2024-09-17T03:37:28.535969+0000","last_became_active":"2024-09-17T03:37:27.545462+0000","last_became_peered":"2024-09-17T03:37:27.545462+0000","last_unstale":"2024-09-17T03:37:28.535969+0000","last_undegraded":"2024-09-17T03:37:28.535969+0000","last_fullsized":"2024-09-17T03:37:28.535969+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973019+0000","last_change":"2024-09-17T03:37:27.548434+0000","last_active":"2024-09-17T03:37:28.973019+0000","last_peered":"2024-09-17T03:37:28.973019+0000","last_clean":"2024-09-17T03:37:28.973019+0000","last_became_active":"2024-09-17T03:37:27.548125+0000","last_became_peered":"2024-09-17T03:37:27.548125+0000","last_unstale":"2024-09-17T03:37:28.973019+0000","last_undegraded":"2024-09-17T03:37:28.973019+0000","last_fullsized":"2024-09-17T03:37:28.973019+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:42.573230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.527457+0000","last_change":"2024-09-17T03:37:27.527457+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.527457+0000","last_undegraded":"2024-09-17T03:37:27.527457+0000","last_fullsized":"2024-09-17T03:37:27.527457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921247+0000","last_change":"2024-09-17T03:37:27.533198+0000","last_active":"2024-09-17T03:37:28.921247+0000","last_peered":"2024-09-17T03:37:28.921247+0000","last_clean":"2024-09-17T03:37:28.921247+0000","last_became_active":"2024-09-17T03:37:27.532590+0000","last_became_peered":"2024-09-17T03:37:27.532590+0000","last_unstale":"2024-09-17T03:37:28.921247+0000","last_undegraded":"2024-09-17T03:37:28.921247+0000","last_fullsized":"2024-09-17T03:37:28.921247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:20.412484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972523+0000","last_change":"2024-09-17T03:37:27.557044+0000","last_active":"2024-09-17T03:37:28.972523+0000","last_peered":"2024-09-17T03:37:28.972523+0000","last_clean":"2024-09-17T03:37:28.972523+0000","last_became_active":"2024-09-17T03:37:27.552478+0000","last_became_peered":"2024-09-17T03:37:27.552478+0000","last_unstale":"2024-09-17T03:37:28.972523+0000","last_undegraded":"2024-09-17T03:37:28.972523+0000","last_fullsized":"2024-09-17T03:37:28.972523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:45.217306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973243+0000","last_change":"2024-09-17T03:37:26.531549+0000","last_active":"2024-09-17T03:37:28.973243+0000","last_peered":"2024-09-17T03:37:28.973243+0000","last_clean":"2024-09-17T03:37:28.973243+0000","last_became_active":"2024-09-17T03:37:26.531217+0000","last_became_peered":"2024-09-17T03:37:26.531217+0000","last_unstale":"2024-09-17T03:37:28.973243+0000","last_undegraded":"2024-09-17T03:37:28.973243+0000","last_fullsized":"2024-09-17T03:37:28.973243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:24.181754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972545+0000","last_change":"2024-09-17T03:37:27.543948+0000","last_active":"2024-09-17T03:37:28.972545+0000","last_peered":"2024-09-17T03:37:28.972545+0000","last_clean":"2024-09-17T03:37:28.972545+0000","last_became_active":"2024-09-17T03:37:27.543659+0000","last_became_peered":"2024-09-17T03:37:27.543659+0000","last_unstale":"2024-09-17T03:37:28.972545+0000","last_undegraded":"2024-09-17T03:37:28.972545+0000","last_fullsized":"2024-09-17T03:37:28.972545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:14.055525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537553+0000","last_change":"2024-09-17T03:37:26.536702+0000","last_active":"2024-09-17T03:37:28.537553+0000","last_peered":"2024-09-17T03:37:28.537553+0000","last_clean":"2024-09-17T03:37:28.537553+0000","last_became_active":"2024-09-17T03:37:26.536412+0000","last_became_peered":"2024-09-17T03:37:26.536412+0000","last_unstale":"2024-09-17T03:37:28.537553+0000","last_undegraded":"2024-09-17T03:37:28.537553+0000","last_fullsized":"2024-09-17T03:37:28.537553+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:36.017576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972792+0000","last_change":"2024-09-17T03:37:27.551893+0000","last_active":"2024-09-17T03:37:28.972792+0000","last_peered":"2024-09-17T03:37:28.972792+0000","last_clean":"2024-09-17T03:37:28.972792+0000","last_became_active":"2024-09-17T03:37:27.551602+0000","last_became_peered":"2024-09-17T03:37:27.551602+0000","last_unstale":"2024-09-17T03:37:28.972792+0000","last_undegraded":"2024-09-17T03:37:28.972792+0000","last_fullsized":"2024-09-17T03:37:28.972792+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:57.278615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972464+0000","last_change":"2024-09-17T03:37:26.532271+0000","last_active":"2024-09-17T03:37:28.972464+0000","last_peered":"2024-09-17T03:37:28.972464+0000","last_clean":"2024-09-17T03:37:28.972464+0000","last_became_active":"2024-09-17T03:37:26.531921+0000","last_became_peered":"2024-09-17T03:37:26.531921+0000","last_unstale":"2024-09-17T03:37:28.972464+0000","last_undegraded":"2024-09-17T03:37:28.972464+0000","last_fullsized":"2024-09-17T03:37:28.972464+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:52.144731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972070+0000","last_change":"2024-09-17T03:37:27.553058+0000","last_active":"2024-09-17T03:37:28.972070+0000","last_peered":"2024-09-17T03:37:28.972070+0000","last_clean":"2024-09-17T03:37:28.972070+0000","last_became_active":"2024-09-17T03:37:27.550890+0000","last_became_peered":"2024-09-17T03:37:27.550890+0000","last_unstale":"2024-09-17T03:37:28.972070+0000","last_undegraded":"2024-09-17T03:37:28.972070+0000","last_fullsized":"2024-09-17T03:37:28.972070+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:21.682676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921722+0000","last_change":"2024-09-17T03:37:26.531629+0000","last_active":"2024-09-17T03:37:28.921722+0000","last_peered":"2024-09-17T03:37:28.921722+0000","last_clean":"2024-09-17T03:37:28.921722+0000","last_became_active":"2024-09-17T03:37:26.529987+0000","last_became_peered":"2024-09-17T03:37:26.529987+0000","last_unstale":"2024-09-17T03:37:28.921722+0000","last_undegraded":"2024-09-17T03:37:28.921722+0000","last_fullsized":"2024-09-17T03:37:28.921722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:16.827468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973143+0000","last_change":"2024-09-17T03:37:27.550210+0000","last_active":"2024-09-17T03:37:28.973143+0000","last_peered":"2024-09-17T03:37:28.973143+0000","last_clean":"2024-09-17T03:37:28.973143+0000","last_became_active":"2024-09-17T03:37:27.548300+0000","last_became_peered":"2024-09-17T03:37:27.548300+0000","last_unstale":"2024-09-17T03:37:28.973143+0000","last_undegraded":"2024-09-17T03:37:28.973143+0000","last_fullsized":"2024-09-17T03:37:28.973143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:40.031431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.537703+0000","last_change":"2024-09-17T03:37:26.528848+0000","last_active":"2024-09-17T03:37:27.537703+0000","last_peered":"2024-09-17T03:37:27.537703+0000","last_clean":"2024-09-17T03:37:27.537703+0000","last_became_active":"2024-09-17T03:37:26.528533+0000","last_became_peered":"2024-09-17T03:37:26.528533+0000","last_unstale":"2024-09-17T03:37:27.537703+0000","last_undegraded":"2024-09-17T03:37:27.537703+0000","last_fullsized":"2024-09-17T03:37:27.537703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:02.179951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973031+0000","last_change":"2024-09-17T03:37:27.538085+0000","last_active":"2024-09-17T03:37:28.973031+0000","last_peered":"2024-09-17T03:37:28.973031+0000","last_clean":"2024-09-17T03:37:28.973031+0000","last_became_active":"2024-09-17T03:37:27.537802+0000","last_became_peered":"2024-09-17T03:37:27.537802+0000","last_unstale":"2024-09-17T03:37:28.973031+0000","last_undegraded":"2024-09-17T03:37:28.973031+0000","last_fullsized":"2024-09-17T03:37:28.973031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:46.545182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973089+0000","last_change":"2024-09-17T03:37:26.520225+0000","last_active":"2024-09-17T03:37:28.973089+0000","last_peered":"2024-09-17T03:37:28.973089+0000","last_clean":"2024-09-17T03:37:28.973089+0000","last_became_active":"2024-09-17T03:37:26.519923+0000","last_became_peered":"2024-09-17T03:37:26.519923+0000","last_unstale":"2024-09-17T03:37:28.973089+0000","last_undegraded":"2024-09-17T03:37:28.973089+0000","last_fullsized":"2024-09-17T03:37:28.973089+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:27.401642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972651+0000","last_change":"2024-09-17T03:37:27.552395+0000","last_active":"2024-09-17T03:37:28.972651+0000","last_peered":"2024-09-17T03:37:28.972651+0000","last_clean":"2024-09-17T03:37:28.972651+0000","last_became_active":"2024-09-17T03:37:27.551648+0000","last_became_peered":"2024-09-17T03:37:27.551648+0000","last_unstale":"2024-09-17T03:37:28.972651+0000","last_undegraded":"2024-09-17T03:37:28.972651+0000","last_fullsized":"2024-09-17T03:37:28.972651+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:29.942300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972453+0000","last_change":"2024-09-17T03:37:26.522976+0000","last_active":"2024-09-17T03:37:28.972453+0000","last_peered":"2024-09-17T03:37:28.972453+0000","last_clean":"2024-09-17T03:37:28.972453+0000","last_became_active":"2024-09-17T03:37:26.522640+0000","last_became_peered":"2024-09-17T03:37:26.522640+0000","last_unstale":"2024-09-17T03:37:28.972453+0000","last_undegraded":"2024-09-17T03:37:28.972453+0000","last_fullsized":"2024-09-17T03:37:28.972453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:34.420408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972553+0000","last_change":"2024-09-17T03:37:27.541597+0000","last_active":"2024-09-17T03:37:28.972553+0000","last_peered":"2024-09-17T03:37:28.972553+0000","last_clean":"2024-09-17T03:37:28.972553+0000","last_became_active":"2024-09-17T03:37:27.541315+0000","last_became_peered":"2024-09-17T03:37:27.541315+0000","last_unstale":"2024-09-17T03:37:28.972553+0000","last_undegraded":"2024-09-17T03:37:28.972553+0000","last_fullsized":"2024-09-17T03:37:28.972553+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.531261+0000","last_change":"2024-09-17T03:37:26.528801+0000","last_active":"2024-09-17T03:37:27.531261+0000","last_peered":"2024-09-17T03:37:27.531261+0000","last_clean":"2024-09-17T03:37:27.531261+0000","last_became_active":"2024-09-17T03:37:26.527544+0000","last_became_peered":"2024-09-17T03:37:26.527544+0000","last_unstale":"2024-09-17T03:37:27.531261+0000","last_undegraded":"2024-09-17T03:37:27.531261+0000","last_fullsized":"2024-09-17T03:37:27.531261+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:08.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972162+0000","last_change":"2024-09-17T03:37:27.555015+0000","last_active":"2024-09-17T03:37:28.972162+0000","last_peered":"2024-09-17T03:37:28.972162+0000","last_clean":"2024-09-17T03:37:28.972162+0000","last_became_active":"2024-09-17T03:37:27.554722+0000","last_became_peered":"2024-09-17T03:37:27.554722+0000","last_unstale":"2024-09-17T03:37:28.972162+0000","last_undegraded":"2024-09-17T03:37:28.972162+0000","last_fullsized":"2024-09-17T03:37:28.972162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:29.825087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972627+0000","last_change":"2024-09-17T03:37:26.531272+0000","last_active":"2024-09-17T03:37:28.972627+0000","last_peered":"2024-09-17T03:37:28.972627+0000","last_clean":"2024-09-17T03:37:28.972627+0000","last_became_active":"2024-09-17T03:37:26.530970+0000","last_became_peered":"2024-09-17T03:37:26.530970+0000","last_unstale":"2024-09-17T03:37:28.972627+0000","last_undegraded":"2024-09-17T03:37:28.972627+0000","last_fullsized":"2024-09-17T03:37:28.972627+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:02.686244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972225+0000","last_change":"2024-09-17T03:37:27.543452+0000","last_active":"2024-09-17T03:37:28.972225+0000","last_peered":"2024-09-17T03:37:28.972225+0000","last_clean":"2024-09-17T03:37:28.972225+0000","last_became_active":"2024-09-17T03:37:27.543130+0000","last_became_peered":"2024-09-17T03:37:27.543130+0000","last_unstale":"2024-09-17T03:37:28.972225+0000","last_undegraded":"2024-09-17T03:37:28.972225+0000","last_fullsized":"2024-09-17T03:37:28.972225+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972185+0000","last_change":"2024-09-17T03:37:26.526110+0000","last_active":"2024-09-17T03:37:28.972185+0000","last_peered":"2024-09-17T03:37:28.972185+0000","last_clean":"2024-09-17T03:37:28.972185+0000","last_became_active":"2024-09-17T03:37:26.525393+0000","last_became_peered":"2024-09-17T03:37:26.525393+0000","last_unstale":"2024-09-17T03:37:28.972185+0000","last_undegraded":"2024-09-17T03:37:28.972185+0000","last_fullsized":"2024-09-17T03:37:28.972185+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:59.076040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536897+0000","last_change":"2024-09-17T03:37:27.535178+0000","last_active":"2024-09-17T03:37:28.536897+0000","last_peered":"2024-09-17T03:37:28.536897+0000","last_clean":"2024-09-17T03:37:28.536897+0000","last_became_active":"2024-09-17T03:37:27.534768+0000","last_became_peered":"2024-09-17T03:37:27.534768+0000","last_unstale":"2024-09-17T03:37:28.536897+0000","last_undegraded":"2024-09-17T03:37:28.536897+0000","last_fullsized":"2024-09-17T03:37:28.536897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:57.588193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973091+0000","last_change":"2024-09-17T03:37:26.527185+0000","last_active":"2024-09-17T03:37:28.973091+0000","last_peered":"2024-09-17T03:37:28.973091+0000","last_clean":"2024-09-17T03:37:28.973091+0000","last_became_active":"2024-09-17T03:37:26.526936+0000","last_became_peered":"2024-09-17T03:37:26.526936+0000","last_unstale":"2024-09-17T03:37:28.973091+0000","last_undegraded":"2024-09-17T03:37:28.973091+0000","last_fullsized":"2024-09-17T03:37:28.973091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:37.973137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921633+0000","last_change":"2024-09-17T03:37:27.545218+0000","last_active":"2024-09-17T03:37:28.921633+0000","last_peered":"2024-09-17T03:37:28.921633+0000","last_clean":"2024-09-17T03:37:28.921633+0000","last_became_active":"2024-09-17T03:37:27.544912+0000","last_became_peered":"2024-09-17T03:37:27.544912+0000","last_unstale":"2024-09-17T03:37:28.921633+0000","last_undegraded":"2024-09-17T03:37:28.921633+0000","last_fullsized":"2024-09-17T03:37:28.921633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972382+0000","last_change":"2024-09-17T03:37:26.534022+0000","last_active":"2024-09-17T03:37:28.972382+0000","last_peered":"2024-09-17T03:37:28.972382+0000","last_clean":"2024-09-17T03:37:28.972382+0000","last_became_active":"2024-09-17T03:37:26.533717+0000","last_became_peered":"2024-09-17T03:37:26.533717+0000","last_unstale":"2024-09-17T03:37:28.972382+0000","last_undegraded":"2024-09-17T03:37:28.972382+0000","last_fullsized":"2024-09-17T03:37:28.972382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:49.735686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972915+0000","last_change":"2024-09-17T03:37:27.542974+0000","last_active":"2024-09-17T03:37:28.972915+0000","last_peered":"2024-09-17T03:37:28.972915+0000","last_clean":"2024-09-17T03:37:28.972915+0000","last_became_active":"2024-09-17T03:37:27.542632+0000","last_became_peered":"2024-09-17T03:37:27.542632+0000","last_unstale":"2024-09-17T03:37:28.972915+0000","last_undegraded":"2024-09-17T03:37:28.972915+0000","last_fullsized":"2024-09-17T03:37:28.972915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:11.137194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537602+0000","last_change":"2024-09-17T03:37:26.535866+0000","last_active":"2024-09-17T03:37:28.537602+0000","last_peered":"2024-09-17T03:37:28.537602+0000","last_clean":"2024-09-17T03:37:28.537602+0000","last_became_active":"2024-09-17T03:37:26.535582+0000","last_became_peered":"2024-09-17T03:37:26.535582+0000","last_unstale":"2024-09-17T03:37:28.537602+0000","last_undegraded":"2024-09-17T03:37:28.537602+0000","last_fullsized":"2024-09-17T03:37:28.537602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.509896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536716+0000","last_change":"2024-09-17T03:37:27.541751+0000","last_active":"2024-09-17T03:37:28.536716+0000","last_peered":"2024-09-17T03:37:28.536716+0000","last_clean":"2024-09-17T03:37:28.536716+0000","last_became_active":"2024-09-17T03:37:27.541468+0000","last_became_peered":"2024-09-17T03:37:27.541468+0000","last_unstale":"2024-09-17T03:37:28.536716+0000","last_undegraded":"2024-09-17T03:37:28.536716+0000","last_fullsized":"2024-09-17T03:37:28.536716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:53.887378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971617+0000","last_change":"2024-09-17T03:37:26.527348+0000","last_active":"2024-09-17T03:37:28.971617+0000","last_peered":"2024-09-17T03:37:28.971617+0000","last_clean":"2024-09-17T03:37:28.971617+0000","last_became_active":"2024-09-17T03:37:26.527018+0000","last_became_peered":"2024-09-17T03:37:26.527018+0000","last_unstale":"2024-09-17T03:37:28.971617+0000","last_undegraded":"2024-09-17T03:37:28.971617+0000","last_fullsized":"2024-09-17T03:37:28.971617+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:34.905982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537921+0000","last_change":"2024-09-17T03:37:27.555528+0000","last_active":"2024-09-17T03:37:28.537921+0000","last_peered":"2024-09-17T03:37:28.537921+0000","last_clean":"2024-09-17T03:37:28.537921+0000","last_became_active":"2024-09-17T03:37:27.555178+0000","last_became_peered":"2024-09-17T03:37:27.555178+0000","last_unstale":"2024-09-17T03:37:28.537921+0000","last_undegraded":"2024-09-17T03:37:28.537921+0000","last_fullsized":"2024-09-17T03:37:28.537921+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921173+0000","last_change":"2024-09-17T03:37:26.531987+0000","last_active":"2024-09-17T03:37:28.921173+0000","last_peered":"2024-09-17T03:37:28.921173+0000","last_clean":"2024-09-17T03:37:28.921173+0000","last_became_active":"2024-09-17T03:37:26.531667+0000","last_became_peered":"2024-09-17T03:37:26.531667+0000","last_unstale":"2024-09-17T03:37:28.921173+0000","last_undegraded":"2024-09-17T03:37:28.921173+0000","last_fullsized":"2024-09-17T03:37:28.921173+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:38.767501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.545421+0000","last_change":"2024-09-17T03:37:27.545316+0000","last_active":"2024-09-17T03:37:27.545421+0000","last_peered":"2024-09-17T03:37:27.545421+0000","last_clean":"2024-09-17T03:37:27.545421+0000","last_became_active":"2024-09-17T03:37:27.544131+0000","last_became_peered":"2024-09-17T03:37:27.544131+0000","last_unstale":"2024-09-17T03:37:27.545421+0000","last_undegraded":"2024-09-17T03:37:27.545421+0000","last_fullsized":"2024-09-17T03:37:27.545421+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:25.845785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535515+0000","last_change":"2024-09-17T03:37:26.534154+0000","last_active":"2024-09-17T03:37:28.535515+0000","last_peered":"2024-09-17T03:37:28.535515+0000","last_clean":"2024-09-17T03:37:28.535515+0000","last_became_active":"2024-09-17T03:37:26.533854+0000","last_became_peered":"2024-09-17T03:37:26.533854+0000","last_unstale":"2024-09-17T03:37:28.535515+0000","last_undegraded":"2024-09-17T03:37:28.535515+0000","last_fullsized":"2024-09-17T03:37:28.535515+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:04.512041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971915+0000","last_change":"2024-09-17T03:37:27.549196+0000","last_active":"2024-09-17T03:37:28.971915+0000","last_peered":"2024-09-17T03:37:28.971915+0000","last_clean":"2024-09-17T03:37:28.971915+0000","last_became_active":"2024-09-17T03:37:27.548755+0000","last_became_peered":"2024-09-17T03:37:27.548755+0000","last_unstale":"2024-09-17T03:37:28.971915+0000","last_undegraded":"2024-09-17T03:37:28.971915+0000","last_fullsized":"2024-09-17T03:37:28.971915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538013+0000","last_change":"2024-09-17T03:37:26.536699+0000","last_active":"2024-09-17T03:37:28.538013+0000","last_peered":"2024-09-17T03:37:28.538013+0000","last_clean":"2024-09-17T03:37:28.538013+0000","last_became_active":"2024-09-17T03:37:26.536400+0000","last_became_peered":"2024-09-17T03:37:26.536400+0000","last_unstale":"2024-09-17T03:37:28.538013+0000","last_undegraded":"2024-09-17T03:37:28.538013+0000","last_fullsized":"2024-09-17T03:37:28.538013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:34.905982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535962+0000","last_change":"2024-09-17T03:37:27.545948+0000","last_active":"2024-09-17T03:37:28.535962+0000","last_peered":"2024-09-17T03:37:28.535962+0000","last_clean":"2024-09-17T03:37:28.535962+0000","last_became_active":"2024-09-17T03:37:27.544335+0000","last_became_peered":"2024-09-17T03:37:27.544335+0000","last_unstale":"2024-09-17T03:37:28.535962+0000","last_undegraded":"2024-09-17T03:37:28.535962+0000","last_fullsized":"2024-09-17T03:37:28.535962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:20.292074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537978+0000","last_change":"2024-09-17T03:37:26.532545+0000","last_active":"2024-09-17T03:37:28.537978+0000","last_peered":"2024-09-17T03:37:28.537978+0000","last_clean":"2024-09-17T03:37:28.537978+0000","last_became_active":"2024-09-17T03:37:26.532034+0000","last_became_peered":"2024-09-17T03:37:26.532034+0000","last_unstale":"2024-09-17T03:37:28.537978+0000","last_undegraded":"2024-09-17T03:37:28.537978+0000","last_fullsized":"2024-09-17T03:37:28.537978+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.682503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921360+0000","last_change":"2024-09-17T03:37:27.540180+0000","last_active":"2024-09-17T03:37:28.921360+0000","last_peered":"2024-09-17T03:37:28.921360+0000","last_clean":"2024-09-17T03:37:28.921360+0000","last_became_active":"2024-09-17T03:37:27.536635+0000","last_became_peered":"2024-09-17T03:37:27.536635+0000","last_unstale":"2024-09-17T03:37:28.921360+0000","last_undegraded":"2024-09-17T03:37:28.921360+0000","last_fullsized":"2024-09-17T03:37:28.921360+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:27.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972108+0000","last_change":"2024-09-17T03:37:26.530302+0000","last_active":"2024-09-17T03:37:28.972108+0000","last_peered":"2024-09-17T03:37:28.972108+0000","last_clean":"2024-09-17T03:37:28.972108+0000","last_became_active":"2024-09-17T03:37:26.530025+0000","last_became_peered":"2024-09-17T03:37:26.530025+0000","last_unstale":"2024-09-17T03:37:28.972108+0000","last_undegraded":"2024-09-17T03:37:28.972108+0000","last_fullsized":"2024-09-17T03:37:28.972108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:58.756354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536787+0000","last_change":"2024-09-17T03:37:27.539162+0000","last_active":"2024-09-17T03:37:28.536787+0000","last_peered":"2024-09-17T03:37:28.536787+0000","last_clean":"2024-09-17T03:37:28.536787+0000","last_became_active":"2024-09-17T03:37:27.538843+0000","last_became_peered":"2024-09-17T03:37:27.538843+0000","last_unstale":"2024-09-17T03:37:28.536787+0000","last_undegraded":"2024-09-17T03:37:28.536787+0000","last_fullsized":"2024-09-17T03:37:28.536787+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:20.412484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921850+0000","last_change":"2024-09-17T03:37:26.536689+0000","last_active":"2024-09-17T03:37:28.921850+0000","last_peered":"2024-09-17T03:37:28.921850+0000","last_clean":"2024-09-17T03:37:28.921850+0000","last_became_active":"2024-09-17T03:37:26.536406+0000","last_became_peered":"2024-09-17T03:37:26.536406+0000","last_unstale":"2024-09-17T03:37:28.921850+0000","last_undegraded":"2024-09-17T03:37:28.921850+0000","last_fullsized":"2024-09-17T03:37:28.921850+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:59.807710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921852+0000","last_change":"2024-09-17T03:37:27.546981+0000","last_active":"2024-09-17T03:37:28.921852+0000","last_peered":"2024-09-17T03:37:28.921852+0000","last_clean":"2024-09-17T03:37:28.921852+0000","last_became_active":"2024-09-17T03:37:27.546676+0000","last_became_peered":"2024-09-17T03:37:27.546676+0000","last_unstale":"2024-09-17T03:37:28.921852+0000","last_undegraded":"2024-09-17T03:37:28.921852+0000","last_fullsized":"2024-09-17T03:37:28.921852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:21.682676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536042+0000","last_change":"2024-09-17T03:37:26.531962+0000","last_active":"2024-09-17T03:37:28.536042+0000","last_peered":"2024-09-17T03:37:28.536042+0000","last_clean":"2024-09-17T03:37:28.536042+0000","last_became_active":"2024-09-17T03:37:26.531665+0000","last_became_peered":"2024-09-17T03:37:26.531665+0000","last_unstale":"2024-09-17T03:37:28.536042+0000","last_undegraded":"2024-09-17T03:37:28.536042+0000","last_fullsized":"2024-09-17T03:37:28.536042+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:20.863280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972031+0000","last_change":"2024-09-17T03:37:27.548909+0000","last_active":"2024-09-17T03:37:28.972031+0000","last_peered":"2024-09-17T03:37:28.972031+0000","last_clean":"2024-09-17T03:37:28.972031+0000","last_became_active":"2024-09-17T03:37:27.543481+0000","last_became_peered":"2024-09-17T03:37:27.543481+0000","last_unstale":"2024-09-17T03:37:28.972031+0000","last_undegraded":"2024-09-17T03:37:28.972031+0000","last_fullsized":"2024-09-17T03:37:28.972031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.531306+0000","last_change":"2024-09-17T03:37:26.531193+0000","last_active":"2024-09-17T03:37:27.531306+0000","last_peered":"2024-09-17T03:37:27.531306+0000","last_clean":"2024-09-17T03:37:27.531306+0000","last_became_active":"2024-09-17T03:37:26.529872+0000","last_became_peered":"2024-09-17T03:37:26.529872+0000","last_unstale":"2024-09-17T03:37:27.531306+0000","last_undegraded":"2024-09-17T03:37:27.531306+0000","last_fullsized":"2024-09-17T03:37:27.531306+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:13.560768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535922+0000","last_change":"2024-09-17T03:37:27.534498+0000","last_active":"2024-09-17T03:37:28.535922+0000","last_peered":"2024-09-17T03:37:28.535922+0000","last_clean":"2024-09-17T03:37:28.535922+0000","last_became_active":"2024-09-17T03:37:27.534156+0000","last_became_peered":"2024-09-17T03:37:27.534156+0000","last_unstale":"2024-09-17T03:37:28.535922+0000","last_undegraded":"2024-09-17T03:37:28.535922+0000","last_fullsized":"2024-09-17T03:37:28.535922+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:40.031431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971932+0000","last_change":"2024-09-17T03:37:26.528782+0000","last_active":"2024-09-17T03:37:28.971932+0000","last_peered":"2024-09-17T03:37:28.971932+0000","last_clean":"2024-09-17T03:37:28.971932+0000","last_became_active":"2024-09-17T03:37:26.528187+0000","last_became_peered":"2024-09-17T03:37:26.528187+0000","last_unstale":"2024-09-17T03:37:28.971932+0000","last_undegraded":"2024-09-17T03:37:28.971932+0000","last_fullsized":"2024-09-17T03:37:28.971932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:57.698060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537927+0000","last_change":"2024-09-17T03:37:27.555855+0000","last_active":"2024-09-17T03:37:28.537927+0000","last_peered":"2024-09-17T03:37:28.537927+0000","last_clean":"2024-09-17T03:37:28.537927+0000","last_became_active":"2024-09-17T03:37:27.555564+0000","last_became_peered":"2024-09-17T03:37:27.555564+0000","last_unstale":"2024-09-17T03:37:28.537927+0000","last_undegraded":"2024-09-17T03:37:28.537927+0000","last_fullsized":"2024-09-17T03:37:28.537927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:13.789016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971883+0000","last_change":"2024-09-17T03:37:26.530376+0000","last_active":"2024-09-17T03:37:28.971883+0000","last_peered":"2024-09-17T03:37:28.971883+0000","last_clean":"2024-09-17T03:37:28.971883+0000","last_became_active":"2024-09-17T03:37:26.526932+0000","last_became_peered":"2024-09-17T03:37:26.526932+0000","last_unstale":"2024-09-17T03:37:28.971883+0000","last_undegraded":"2024-09-17T03:37:28.971883+0000","last_fullsized":"2024-09-17T03:37:28.971883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:56.339214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971888+0000","last_change":"2024-09-17T03:37:27.539745+0000","last_active":"2024-09-17T03:37:28.971888+0000","last_peered":"2024-09-17T03:37:28.971888+0000","last_clean":"2024-09-17T03:37:28.971888+0000","last_became_active":"2024-09-17T03:37:27.539434+0000","last_became_peered":"2024-09-17T03:37:27.539434+0000","last_unstale":"2024-09-17T03:37:28.971888+0000","last_undegraded":"2024-09-17T03:37:28.971888+0000","last_fullsized":"2024-09-17T03:37:28.971888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:49.519749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973003+0000","last_change":"2024-09-17T03:37:26.523031+0000","last_active":"2024-09-17T03:37:28.973003+0000","last_peered":"2024-09-17T03:37:28.973003+0000","last_clean":"2024-09-17T03:37:28.973003+0000","last_became_active":"2024-09-17T03:37:26.522699+0000","last_became_peered":"2024-09-17T03:37:26.522699+0000","last_unstale":"2024-09-17T03:37:28.973003+0000","last_undegraded":"2024-09-17T03:37:28.973003+0000","last_fullsized":"2024-09-17T03:37:28.973003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:45.288058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972050+0000","last_change":"2024-09-17T03:37:27.552225+0000","last_active":"2024-09-17T03:37:28.972050+0000","last_peered":"2024-09-17T03:37:28.972050+0000","last_clean":"2024-09-17T03:37:28.972050+0000","last_became_active":"2024-09-17T03:37:27.550676+0000","last_became_peered":"2024-09-17T03:37:27.550676+0000","last_unstale":"2024-09-17T03:37:28.972050+0000","last_undegraded":"2024-09-17T03:37:28.972050+0000","last_fullsized":"2024-09-17T03:37:28.972050+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:56.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973217+0000","last_change":"2024-09-17T03:37:26.525668+0000","last_active":"2024-09-17T03:37:28.973217+0000","last_peered":"2024-09-17T03:37:28.973217+0000","last_clean":"2024-09-17T03:37:28.973217+0000","last_became_active":"2024-09-17T03:37:26.525388+0000","last_became_peered":"2024-09-17T03:37:26.525388+0000","last_unstale":"2024-09-17T03:37:28.973217+0000","last_undegraded":"2024-09-17T03:37:28.973217+0000","last_fullsized":"2024-09-17T03:37:28.973217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:14.255452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.546516+0000","last_change":"2024-09-17T03:37:27.546413+0000","last_active":"2024-09-17T03:37:27.546516+0000","last_peered":"2024-09-17T03:37:27.546516+0000","last_clean":"2024-09-17T03:37:27.546516+0000","last_became_active":"2024-09-17T03:37:27.546090+0000","last_became_peered":"2024-09-17T03:37:27.546090+0000","last_unstale":"2024-09-17T03:37:27.546516+0000","last_undegraded":"2024-09-17T03:37:27.546516+0000","last_fullsized":"2024-09-17T03:37:27.546516+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:02.207266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.536164+0000","last_change":"2024-09-17T03:37:26.527912+0000","last_active":"2024-09-17T03:37:27.536164+0000","last_peered":"2024-09-17T03:37:27.536164+0000","last_clean":"2024-09-17T03:37:27.536164+0000","last_became_active":"2024-09-17T03:37:26.527563+0000","last_became_peered":"2024-09-17T03:37:26.527563+0000","last_unstale":"2024-09-17T03:37:27.536164+0000","last_undegraded":"2024-09-17T03:37:27.536164+0000","last_fullsized":"2024-09-17T03:37:27.536164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:55.494026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972538+0000","last_change":"2024-09-17T03:37:27.551533+0000","last_active":"2024-09-17T03:37:28.972538+0000","last_peered":"2024-09-17T03:37:28.972538+0000","last_clean":"2024-09-17T03:37:28.972538+0000","last_became_active":"2024-09-17T03:37:27.551145+0000","last_became_peered":"2024-09-17T03:37:27.551145+0000","last_unstale":"2024-09-17T03:37:28.972538+0000","last_undegraded":"2024-09-17T03:37:28.972538+0000","last_fullsized":"2024-09-17T03:37:28.972538+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:33.345886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972160+0000","last_change":"2024-09-17T03:37:26.535010+0000","last_active":"2024-09-17T03:37:28.972160+0000","last_peered":"2024-09-17T03:37:28.972160+0000","last_clean":"2024-09-17T03:37:28.972160+0000","last_became_active":"2024-09-17T03:37:26.534652+0000","last_became_peered":"2024-09-17T03:37:26.534652+0000","last_unstale":"2024-09-17T03:37:28.972160+0000","last_undegraded":"2024-09-17T03:37:28.972160+0000","last_fullsized":"2024-09-17T03:37:28.972160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:11.615940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921823+0000","last_change":"2024-09-17T03:37:27.537360+0000","last_active":"2024-09-17T03:37:28.921823+0000","last_peered":"2024-09-17T03:37:28.921823+0000","last_clean":"2024-09-17T03:37:28.921823+0000","last_became_active":"2024-09-17T03:37:27.536792+0000","last_became_peered":"2024-09-17T03:37:27.536792+0000","last_unstale":"2024-09-17T03:37:28.921823+0000","last_undegraded":"2024-09-17T03:37:28.921823+0000","last_fullsized":"2024-09-17T03:37:28.921823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:56.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.531569+0000","last_change":"2024-09-17T03:37:26.529448+0000","last_active":"2024-09-17T03:37:27.531569+0000","last_peered":"2024-09-17T03:37:27.531569+0000","last_clean":"2024-09-17T03:37:27.531569+0000","last_became_active":"2024-09-17T03:37:26.529137+0000","last_became_peered":"2024-09-17T03:37:26.529137+0000","last_unstale":"2024-09-17T03:37:27.531569+0000","last_undegraded":"2024-09-17T03:37:27.531569+0000","last_fullsized":"2024-09-17T03:37:27.531569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:52.570921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972784+0000","last_change":"2024-09-17T03:37:27.551975+0000","last_active":"2024-09-17T03:37:28.972784+0000","last_peered":"2024-09-17T03:37:28.972784+0000","last_clean":"2024-09-17T03:37:28.972784+0000","last_became_active":"2024-09-17T03:37:27.551180+0000","last_became_peered":"2024-09-17T03:37:27.551180+0000","last_unstale":"2024-09-17T03:37:28.972784+0000","last_undegraded":"2024-09-17T03:37:28.972784+0000","last_fullsized":"2024-09-17T03:37:28.972784+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:51.856214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921248+0000","last_change":"2024-09-17T03:37:26.525209+0000","last_active":"2024-09-17T03:37:28.921248+0000","last_peered":"2024-09-17T03:37:28.921248+0000","last_clean":"2024-09-17T03:37:28.921248+0000","last_became_active":"2024-09-17T03:37:26.524908+0000","last_became_peered":"2024-09-17T03:37:26.524908+0000","last_unstale":"2024-09-17T03:37:28.921248+0000","last_undegraded":"2024-09-17T03:37:28.921248+0000","last_fullsized":"2024-09-17T03:37:28.921248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:04.960327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537907+0000","last_change":"2024-09-17T03:37:27.551523+0000","last_active":"2024-09-17T03:37:28.537907+0000","last_peered":"2024-09-17T03:37:28.537907+0000","last_clean":"2024-09-17T03:37:28.537907+0000","last_became_active":"2024-09-17T03:37:27.549402+0000","last_became_peered":"2024-09-17T03:37:27.549402+0000","last_unstale":"2024-09-17T03:37:28.537907+0000","last_undegraded":"2024-09-17T03:37:28.537907+0000","last_fullsized":"2024-09-17T03:37:28.537907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971532+0000","last_change":"2024-09-17T03:37:26.521825+0000","last_active":"2024-09-17T03:37:28.971532+0000","last_peered":"2024-09-17T03:37:28.971532+0000","last_clean":"2024-09-17T03:37:28.971532+0000","last_became_active":"2024-09-17T03:37:26.520727+0000","last_became_peered":"2024-09-17T03:37:26.520727+0000","last_unstale":"2024-09-17T03:37:28.971532+0000","last_undegraded":"2024-09-17T03:37:28.971532+0000","last_fullsized":"2024-09-17T03:37:28.971532+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.682503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972667+0000","last_change":"2024-09-17T03:37:27.542593+0000","last_active":"2024-09-17T03:37:28.972667+0000","last_peered":"2024-09-17T03:37:28.972667+0000","last_clean":"2024-09-17T03:37:28.972667+0000","last_became_active":"2024-09-17T03:37:27.542312+0000","last_became_peered":"2024-09-17T03:37:27.542312+0000","last_unstale":"2024-09-17T03:37:28.972667+0000","last_undegraded":"2024-09-17T03:37:28.972667+0000","last_fullsized":"2024-09-17T03:37:28.972667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:00.543429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972743+0000","last_change":"2024-09-17T03:37:26.531805+0000","last_active":"2024-09-17T03:37:28.972743+0000","last_peered":"2024-09-17T03:37:28.972743+0000","last_clean":"2024-09-17T03:37:28.972743+0000","last_became_active":"2024-09-17T03:37:26.531514+0000","last_became_peered":"2024-09-17T03:37:26.531514+0000","last_unstale":"2024-09-17T03:37:28.972743+0000","last_undegraded":"2024-09-17T03:37:28.972743+0000","last_fullsized":"2024-09-17T03:37:28.972743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:12.294261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":169,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971655+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:37:28.971655+0000","last_peered":"2024-09-17T03:37:28.971655+0000","last_clean":"2024-09-17T03:37:28.971655+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:37:28.971655+0000","last_undegraded":"2024-09-17T03:37:28.971655+0000","last_fullsized":"2024-09-17T03:37:28.971655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":618496,"data_stored":268298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1220608,"data_stored":860312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1208320,"data_stored":858680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":585728,"data_stored":254383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:31.958 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:32.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.213+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1326747152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eac06e500 msgr2=0x7f2eac0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.213+0000 7f2eb2a00640 1 --2- 172.21.15.121:0/1326747152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eac06e500 0x7f2eac0cc020 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4005fd0 tx=0x7f2ea402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.214+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1326747152 shutdown_connections 2024-09-17T03:37:32.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.214+0000 7f2eb2a00640 1 --2- 172.21.15.121:0/1326747152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eac06e500 0x7f2eac0cc020 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.214+0000 7f2eb2a00640 1 --2- 172.21.15.121:0/1326747152 >> v2:172.21.15.176:3300/0 conn(0x7f2eac074cb0 0x7f2eac073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.214+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1326747152 >> 172.21.15.121:0/1326747152 conn(0x7f2eac0cca40 msgr2=0x7f2eac0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:32.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.214+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1326747152 shutdown_connections 2024-09-17T03:37:32.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.214+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1326747152 wait complete. 2024-09-17T03:37:32.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.216+0000 7f2eb2a00640 1 Processor -- start 2024-09-17T03:37:32.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.216+0000 7f2eb2a00640 1 -- start start 2024-09-17T03:37:32.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.217+0000 7f2eb2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eac074cb0 0x7f2eac0cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.217+0000 7f2eb2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac0cbc10 0x7f2eac1e7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.217+0000 7f2eb2a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eac1e7890 0x7f2eac09b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.217+0000 7f2eb2a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac06f3f0 con 0x7f2eac0cbc10 2024-09-17T03:37:32.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.217+0000 7f2eb2a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac06f270 con 0x7f2eac074cb0 2024-09-17T03:37:32.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.217+0000 7f2eb2a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac06f570 con 0x7f2eac1e7890 2024-09-17T03:37:32.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2ea3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac0cbc10 0x7f2eac1e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2ea3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac0cbc10 0x7f2eac1e7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52970/0 (socket says 172.21.15.121:52970) 2024-09-17T03:37:32.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2ea3400640 1 -- 172.21.15.121:0/1556218680 learned_addr learned my addr 172.21.15.121:0/1556218680 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:32.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2eabe00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eac074cb0 0x7f2eac0cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2eb0a00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eac1e7890 0x7f2eac09b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2ea3400640 1 -- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eac1e7890 msgr2=0x7f2eac09b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2ea3400640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eac1e7890 0x7f2eac09b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2ea3400640 1 -- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eac074cb0 msgr2=0x7f2eac0cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2ea3400640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eac074cb0 0x7f2eac0cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2ea3400640 1 -- 172.21.15.121:0/1556218680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac0cdf30 con 0x7f2eac0cbc10 2024-09-17T03:37:32.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.218+0000 7f2ea3400640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac0cbc10 0x7f2eac1e7350 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400c370 tx=0x7f2e9400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.219+0000 7f2ea8c00640 1 -- 172.21.15.121:0/1556218680 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94017070 con 0x7f2eac0cbc10 2024-09-17T03:37:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.219+0000 7f2ea8c00640 1 -- 172.21.15.121:0/1556218680 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e940053c0 con 0x7f2eac0cbc10 2024-09-17T03:37:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.219+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1556218680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eac0ce210 con 0x7f2eac0cbc10 2024-09-17T03:37:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.219+0000 7f2ea8c00640 1 -- 172.21.15.121:0/1556218680 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94003850 con 0x7f2eac0cbc10 2024-09-17T03:37:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.219+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1556218680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eac0ce7d0 con 0x7f2eac0cbc10 2024-09-17T03:37:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.220+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1556218680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eac06fa90 con 0x7f2eac0cbc10 2024-09-17T03:37:32.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.221+0000 7f2ea8c00640 1 -- 172.21.15.121:0/1556218680 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2e9401a070 con 0x7f2eac0cbc10 2024-09-17T03:37:32.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.223+0000 7f2ea8c00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2e88078b90 0x7f2e8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.223+0000 7f2ea8c00640 1 -- 172.21.15.121:0/1556218680 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f2e9409a2e0 con 0x7f2eac0cbc10 2024-09-17T03:37:32.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.223+0000 7f2eabe00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2e88078b90 0x7f2e8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.224+0000 7f2eabe00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2e88078b90 0x7f2e8807b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2eac15a730 tx=0x7f2e9c009260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.227+0000 7f2ea8c00640 1 -- 172.21.15.121:0/1556218680 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e940624f0 con 0x7f2eac0cbc10 2024-09-17T03:37:32.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.407+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1556218680 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2eac15c3e0 con 0x7f2e88078b90 2024-09-17T03:37:32.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.412+0000 7f2ea8c00640 1 -- 172.21.15.121:0/1556218680 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251541 (secure 0 0 0) 0x7f2eac15c3e0 con 0x7f2e88078b90 2024-09-17T03:37:32.415 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:32.417 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:37:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2e88078b90 msgr2=0x7f2e8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2e88078b90 0x7f2e8807b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2eac15a730 tx=0x7f2e9c009260 comp rx=0 tx=0).stop 2024-09-17T03:37:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1556218680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac0cbc10 msgr2=0x7f2eac1e7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac0cbc10 0x7f2eac1e7350 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400c370 tx=0x7f2e9400c830 comp rx=0 tx=0).stop 2024-09-17T03:37:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1556218680 shutdown_connections 2024-09-17T03:37:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eac1e7890 0x7f2eac09b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2e88078b90 0x7f2e8807b0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac0cbc10 0x7f2eac1e7350 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 --2- 172.21.15.121:0/1556218680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eac074cb0 0x7f2eac0cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1556218680 >> 172.21.15.121:0/1556218680 conn(0x7f2eac0cca40 msgr2=0x7f2eac15b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:32.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1556218680 shutdown_connections 2024-09-17T03:37:32.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.416+0000 7f2eb2a00640 1 -- 172.21.15.121:0/1556218680 wait complete. 2024-09-17T03:37:32.439 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-17T03:37:31.308651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222180,"kb_used_data":5948,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752540,"statfs":{"total":773094113280,"available":772866600960,"internally_reserved":0,"allocated":6090752,"data_stored":3315929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.806591"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536989+0000","last_change":"2024-09-17T03:37:27.540668+0000","last_active":"2024-09-17T03:37:28.536989+0000","last_peered":"2024-09-17T03:37:28.536989+0000","last_clean":"2024-09-17T03:37:28.536989+0000","last_became_active":"2024-09-17T03:37:27.537774+0000","last_became_peered":"2024-09-17T03:37:27.537774+0000","last_unstale":"2024-09-17T03:37:28.536989+0000","last_undegraded":"2024-09-17T03:37:28.536989+0000","last_fullsized":"2024-09-17T03:37:28.536989+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:33.857227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921909+0000","last_change":"2024-09-17T03:37:27.545950+0000","last_active":"2024-09-17T03:37:28.921909+0000","last_peered":"2024-09-17T03:37:28.921909+0000","last_clean":"2024-09-17T03:37:28.921909+0000","last_became_active":"2024-09-17T03:37:27.545651+0000","last_became_peered":"2024-09-17T03:37:27.545651+0000","last_unstale":"2024-09-17T03:37:28.921909+0000","last_undegraded":"2024-09-17T03:37:28.921909+0000","last_fullsized":"2024-09-17T03:37:28.921909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:55.838205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.530643+0000","last_change":"2024-09-17T03:37:27.530643+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.530643+0000","last_undegraded":"2024-09-17T03:37:27.530643+0000","last_fullsized":"2024-09-17T03:37:27.530643+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971871+0000","last_change":"2024-09-17T03:37:27.549625+0000","last_active":"2024-09-17T03:37:28.971871+0000","last_peered":"2024-09-17T03:37:28.971871+0000","last_clean":"2024-09-17T03:37:28.971871+0000","last_became_active":"2024-09-17T03:37:27.549336+0000","last_became_peered":"2024-09-17T03:37:27.549336+0000","last_unstale":"2024-09-17T03:37:28.971871+0000","last_undegraded":"2024-09-17T03:37:28.971871+0000","last_fullsized":"2024-09-17T03:37:28.971871+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:53.792718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921565+0000","last_change":"2024-09-17T03:37:27.551257+0000","last_active":"2024-09-17T03:37:28.921565+0000","last_peered":"2024-09-17T03:37:28.921565+0000","last_clean":"2024-09-17T03:37:28.921565+0000","last_became_active":"2024-09-17T03:37:27.550886+0000","last_became_peered":"2024-09-17T03:37:27.550886+0000","last_unstale":"2024-09-17T03:37:28.921565+0000","last_undegraded":"2024-09-17T03:37:28.921565+0000","last_fullsized":"2024-09-17T03:37:28.921565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536419+0000","last_change":"2024-09-17T03:37:27.545772+0000","last_active":"2024-09-17T03:37:28.536419+0000","last_peered":"2024-09-17T03:37:28.536419+0000","last_clean":"2024-09-17T03:37:28.536419+0000","last_became_active":"2024-09-17T03:37:27.545156+0000","last_became_peered":"2024-09-17T03:37:27.545156+0000","last_unstale":"2024-09-17T03:37:28.536419+0000","last_undegraded":"2024-09-17T03:37:28.536419+0000","last_fullsized":"2024-09-17T03:37:28.536419+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:53.792718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972117+0000","last_change":"2024-09-17T03:37:27.549769+0000","last_active":"2024-09-17T03:37:28.972117+0000","last_peered":"2024-09-17T03:37:28.972117+0000","last_clean":"2024-09-17T03:37:28.972117+0000","last_became_active":"2024-09-17T03:37:27.549437+0000","last_became_peered":"2024-09-17T03:37:27.549437+0000","last_unstale":"2024-09-17T03:37:28.972117+0000","last_undegraded":"2024-09-17T03:37:28.972117+0000","last_fullsized":"2024-09-17T03:37:28.972117+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:55.838205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535267+0000","last_change":"2024-09-17T03:37:27.534750+0000","last_active":"2024-09-17T03:37:28.535267+0000","last_peered":"2024-09-17T03:37:28.535267+0000","last_clean":"2024-09-17T03:37:28.535267+0000","last_became_active":"2024-09-17T03:37:27.534326+0000","last_became_peered":"2024-09-17T03:37:27.534326+0000","last_unstale":"2024-09-17T03:37:28.535267+0000","last_undegraded":"2024-09-17T03:37:28.535267+0000","last_fullsized":"2024-09-17T03:37:28.535267+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:25.188857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.531549+0000","last_change":"2024-09-17T03:37:27.531549+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.531549+0000","last_undegraded":"2024-09-17T03:37:27.531549+0000","last_fullsized":"2024-09-17T03:37:27.531549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972624+0000","last_change":"2024-09-17T03:37:27.543273+0000","last_active":"2024-09-17T03:37:28.972624+0000","last_peered":"2024-09-17T03:37:28.972624+0000","last_clean":"2024-09-17T03:37:28.972624+0000","last_became_active":"2024-09-17T03:37:27.542939+0000","last_became_peered":"2024-09-17T03:37:27.542939+0000","last_unstale":"2024-09-17T03:37:28.972624+0000","last_undegraded":"2024-09-17T03:37:28.972624+0000","last_fullsized":"2024-09-17T03:37:28.972624+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:47.056365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536597+0000","last_change":"2024-09-17T03:37:27.537150+0000","last_active":"2024-09-17T03:37:28.536597+0000","last_peered":"2024-09-17T03:37:28.536597+0000","last_clean":"2024-09-17T03:37:28.536597+0000","last_became_active":"2024-09-17T03:37:27.536812+0000","last_became_peered":"2024-09-17T03:37:27.536812+0000","last_unstale":"2024-09-17T03:37:28.536597+0000","last_undegraded":"2024-09-17T03:37:28.536597+0000","last_fullsized":"2024-09-17T03:37:28.536597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:27.755987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537577+0000","last_change":"2024-09-17T03:37:27.554147+0000","last_active":"2024-09-17T03:37:28.537577+0000","last_peered":"2024-09-17T03:37:28.537577+0000","last_clean":"2024-09-17T03:37:28.537577+0000","last_became_active":"2024-09-17T03:37:27.553846+0000","last_became_peered":"2024-09-17T03:37:27.553846+0000","last_unstale":"2024-09-17T03:37:28.537577+0000","last_undegraded":"2024-09-17T03:37:28.537577+0000","last_fullsized":"2024-09-17T03:37:28.537577+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537004+0000","last_change":"2024-09-17T03:37:27.543555+0000","last_active":"2024-09-17T03:37:28.537004+0000","last_peered":"2024-09-17T03:37:28.537004+0000","last_clean":"2024-09-17T03:37:28.537004+0000","last_became_active":"2024-09-17T03:37:27.543195+0000","last_became_peered":"2024-09-17T03:37:27.543195+0000","last_unstale":"2024-09-17T03:37:28.537004+0000","last_undegraded":"2024-09-17T03:37:28.537004+0000","last_fullsized":"2024-09-17T03:37:28.537004+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:27.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536509+0000","last_change":"2024-09-17T03:37:27.542230+0000","last_active":"2024-09-17T03:37:28.536509+0000","last_peered":"2024-09-17T03:37:28.536509+0000","last_clean":"2024-09-17T03:37:28.536509+0000","last_became_active":"2024-09-17T03:37:27.541912+0000","last_became_peered":"2024-09-17T03:37:27.541912+0000","last_unstale":"2024-09-17T03:37:28.536509+0000","last_undegraded":"2024-09-17T03:37:28.536509+0000","last_fullsized":"2024-09-17T03:37:28.536509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:00.468303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971820+0000","last_change":"2024-09-17T03:37:27.546632+0000","last_active":"2024-09-17T03:37:28.971820+0000","last_peered":"2024-09-17T03:37:28.971820+0000","last_clean":"2024-09-17T03:37:28.971820+0000","last_became_active":"2024-09-17T03:37:27.544485+0000","last_became_peered":"2024-09-17T03:37:27.544485+0000","last_unstale":"2024-09-17T03:37:28.971820+0000","last_undegraded":"2024-09-17T03:37:28.971820+0000","last_fullsized":"2024-09-17T03:37:28.971820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:38.995552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535503+0000","last_change":"2024-09-17T03:37:27.538588+0000","last_active":"2024-09-17T03:37:28.535503+0000","last_peered":"2024-09-17T03:37:28.535503+0000","last_clean":"2024-09-17T03:37:28.535503+0000","last_became_active":"2024-09-17T03:37:27.538287+0000","last_became_peered":"2024-09-17T03:37:27.538287+0000","last_unstale":"2024-09-17T03:37:28.535503+0000","last_undegraded":"2024-09-17T03:37:28.535503+0000","last_fullsized":"2024-09-17T03:37:28.535503+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:38.995552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537009+0000","last_change":"2024-09-17T03:37:27.538911+0000","last_active":"2024-09-17T03:37:28.537009+0000","last_peered":"2024-09-17T03:37:28.537009+0000","last_clean":"2024-09-17T03:37:28.537009+0000","last_became_active":"2024-09-17T03:37:27.538020+0000","last_became_peered":"2024-09-17T03:37:27.538020+0000","last_unstale":"2024-09-17T03:37:28.537009+0000","last_undegraded":"2024-09-17T03:37:28.537009+0000","last_fullsized":"2024-09-17T03:37:28.537009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:28.630655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972164+0000","last_change":"2024-09-17T03:37:27.550328+0000","last_active":"2024-09-17T03:37:28.972164+0000","last_peered":"2024-09-17T03:37:28.972164+0000","last_clean":"2024-09-17T03:37:28.972164+0000","last_became_active":"2024-09-17T03:37:27.550060+0000","last_became_peered":"2024-09-17T03:37:27.550060+0000","last_unstale":"2024-09-17T03:37:28.972164+0000","last_undegraded":"2024-09-17T03:37:28.972164+0000","last_fullsized":"2024-09-17T03:37:28.972164+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.530238+0000","last_change":"2024-09-17T03:37:27.530238+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.530238+0000","last_undegraded":"2024-09-17T03:37:27.530238+0000","last_fullsized":"2024-09-17T03:37:27.530238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921606+0000","last_change":"2024-09-17T03:37:27.543944+0000","last_active":"2024-09-17T03:37:28.921606+0000","last_peered":"2024-09-17T03:37:28.921606+0000","last_clean":"2024-09-17T03:37:28.921606+0000","last_became_active":"2024-09-17T03:37:27.543589+0000","last_became_peered":"2024-09-17T03:37:27.543589+0000","last_unstale":"2024-09-17T03:37:28.921606+0000","last_undegraded":"2024-09-17T03:37:28.921606+0000","last_fullsized":"2024-09-17T03:37:28.921606+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971895+0000","last_change":"2024-09-17T03:37:27.552202+0000","last_active":"2024-09-17T03:37:28.971895+0000","last_peered":"2024-09-17T03:37:28.971895+0000","last_clean":"2024-09-17T03:37:28.971895+0000","last_became_active":"2024-09-17T03:37:27.544791+0000","last_became_peered":"2024-09-17T03:37:27.544791+0000","last_unstale":"2024-09-17T03:37:28.971895+0000","last_undegraded":"2024-09-17T03:37:28.971895+0000","last_fullsized":"2024-09-17T03:37:28.971895+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:26.981822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.544978+0000","last_change":"2024-09-17T03:37:27.544863+0000","last_active":"2024-09-17T03:37:27.544978+0000","last_peered":"2024-09-17T03:37:27.544978+0000","last_clean":"2024-09-17T03:37:27.544978+0000","last_became_active":"2024-09-17T03:37:27.544558+0000","last_became_peered":"2024-09-17T03:37:27.544558+0000","last_unstale":"2024-09-17T03:37:27.544978+0000","last_undegraded":"2024-09-17T03:37:27.544978+0000","last_fullsized":"2024-09-17T03:37:27.544978+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:08.297337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.541628+0000","last_change":"2024-09-17T03:37:27.541536+0000","last_active":"2024-09-17T03:37:27.541628+0000","last_peered":"2024-09-17T03:37:27.541628+0000","last_clean":"2024-09-17T03:37:27.541628+0000","last_became_active":"2024-09-17T03:37:27.541232+0000","last_became_peered":"2024-09-17T03:37:27.541232+0000","last_unstale":"2024-09-17T03:37:27.541628+0000","last_undegraded":"2024-09-17T03:37:27.541628+0000","last_fullsized":"2024-09-17T03:37:27.541628+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:48.502039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":4,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.547174+0000","last_change":"2024-09-17T03:37:27.527863+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.547174+0000","last_undegraded":"2024-09-17T03:37:27.547174+0000","last_fullsized":"2024-09-17T03:37:27.547174+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536786+0000","last_change":"2024-09-17T03:37:27.551785+0000","last_active":"2024-09-17T03:37:28.536786+0000","last_peered":"2024-09-17T03:37:28.536786+0000","last_clean":"2024-09-17T03:37:28.536786+0000","last_became_active":"2024-09-17T03:37:27.551351+0000","last_became_peered":"2024-09-17T03:37:27.551351+0000","last_unstale":"2024-09-17T03:37:28.536786+0000","last_undegraded":"2024-09-17T03:37:28.536786+0000","last_fullsized":"2024-09-17T03:37:28.536786+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:22.489576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":6,"reported_epoch":51,"state":"active","last_fresh":"2024-09-17T03:37:27.547753+0000","last_change":"2024-09-17T03:37:27.547681+0000","last_active":"2024-09-17T03:37:27.547753+0000","last_peered":"2024-09-17T03:37:27.547753+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"2024-09-17T03:37:27.547681+0000","last_became_peered":"2024-09-17T03:37:27.547681+0000","last_unstale":"2024-09-17T03:37:27.547753+0000","last_undegraded":"2024-09-17T03:37:27.547753+0000","last_fullsized":"2024-09-17T03:37:27.547753+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537358+0000","last_change":"2024-09-17T03:37:27.547485+0000","last_active":"2024-09-17T03:37:28.537358+0000","last_peered":"2024-09-17T03:37:28.537358+0000","last_clean":"2024-09-17T03:37:28.537358+0000","last_became_active":"2024-09-17T03:37:27.546932+0000","last_became_peered":"2024-09-17T03:37:27.546932+0000","last_unstale":"2024-09-17T03:37:28.537358+0000","last_undegraded":"2024-09-17T03:37:28.537358+0000","last_fullsized":"2024-09-17T03:37:28.537358+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921642+0000","last_change":"2024-09-17T03:37:27.552987+0000","last_active":"2024-09-17T03:37:28.921642+0000","last_peered":"2024-09-17T03:37:28.921642+0000","last_clean":"2024-09-17T03:37:28.921642+0000","last_became_active":"2024-09-17T03:37:27.552509+0000","last_became_peered":"2024-09-17T03:37:27.552509+0000","last_unstale":"2024-09-17T03:37:28.921642+0000","last_undegraded":"2024-09-17T03:37:28.921642+0000","last_fullsized":"2024-09-17T03:37:28.921642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:20.292074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535969+0000","last_change":"2024-09-17T03:37:27.546789+0000","last_active":"2024-09-17T03:37:28.535969+0000","last_peered":"2024-09-17T03:37:28.535969+0000","last_clean":"2024-09-17T03:37:28.535969+0000","last_became_active":"2024-09-17T03:37:27.545462+0000","last_became_peered":"2024-09-17T03:37:27.545462+0000","last_unstale":"2024-09-17T03:37:28.535969+0000","last_undegraded":"2024-09-17T03:37:28.535969+0000","last_fullsized":"2024-09-17T03:37:28.535969+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973019+0000","last_change":"2024-09-17T03:37:27.548434+0000","last_active":"2024-09-17T03:37:28.973019+0000","last_peered":"2024-09-17T03:37:28.973019+0000","last_clean":"2024-09-17T03:37:28.973019+0000","last_became_active":"2024-09-17T03:37:27.548125+0000","last_became_peered":"2024-09-17T03:37:27.548125+0000","last_unstale":"2024-09-17T03:37:28.973019+0000","last_undegraded":"2024-09-17T03:37:28.973019+0000","last_fullsized":"2024-09-17T03:37:28.973019+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:42.573230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.527457+0000","last_change":"2024-09-17T03:37:27.527457+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.527457+0000","last_undegraded":"2024-09-17T03:37:27.527457+0000","last_fullsized":"2024-09-17T03:37:27.527457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921247+0000","last_change":"2024-09-17T03:37:27.533198+0000","last_active":"2024-09-17T03:37:28.921247+0000","last_peered":"2024-09-17T03:37:28.921247+0000","last_clean":"2024-09-17T03:37:28.921247+0000","last_became_active":"2024-09-17T03:37:27.532590+0000","last_became_peered":"2024-09-17T03:37:27.532590+0000","last_unstale":"2024-09-17T03:37:28.921247+0000","last_undegraded":"2024-09-17T03:37:28.921247+0000","last_fullsized":"2024-09-17T03:37:28.921247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:20.412484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972523+0000","last_change":"2024-09-17T03:37:27.557044+0000","last_active":"2024-09-17T03:37:28.972523+0000","last_peered":"2024-09-17T03:37:28.972523+0000","last_clean":"2024-09-17T03:37:28.972523+0000","last_became_active":"2024-09-17T03:37:27.552478+0000","last_became_peered":"2024-09-17T03:37:27.552478+0000","last_unstale":"2024-09-17T03:37:28.972523+0000","last_undegraded":"2024-09-17T03:37:28.972523+0000","last_fullsized":"2024-09-17T03:37:28.972523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:45.217306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973243+0000","last_change":"2024-09-17T03:37:26.531549+0000","last_active":"2024-09-17T03:37:28.973243+0000","last_peered":"2024-09-17T03:37:28.973243+0000","last_clean":"2024-09-17T03:37:28.973243+0000","last_became_active":"2024-09-17T03:37:26.531217+0000","last_became_peered":"2024-09-17T03:37:26.531217+0000","last_unstale":"2024-09-17T03:37:28.973243+0000","last_undegraded":"2024-09-17T03:37:28.973243+0000","last_fullsized":"2024-09-17T03:37:28.973243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:24.181754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972545+0000","last_change":"2024-09-17T03:37:27.543948+0000","last_active":"2024-09-17T03:37:28.972545+0000","last_peered":"2024-09-17T03:37:28.972545+0000","last_clean":"2024-09-17T03:37:28.972545+0000","last_became_active":"2024-09-17T03:37:27.543659+0000","last_became_peered":"2024-09-17T03:37:27.543659+0000","last_unstale":"2024-09-17T03:37:28.972545+0000","last_undegraded":"2024-09-17T03:37:28.972545+0000","last_fullsized":"2024-09-17T03:37:28.972545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:14.055525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537553+0000","last_change":"2024-09-17T03:37:26.536702+0000","last_active":"2024-09-17T03:37:28.537553+0000","last_peered":"2024-09-17T03:37:28.537553+0000","last_clean":"2024-09-17T03:37:28.537553+0000","last_became_active":"2024-09-17T03:37:26.536412+0000","last_became_peered":"2024-09-17T03:37:26.536412+0000","last_unstale":"2024-09-17T03:37:28.537553+0000","last_undegraded":"2024-09-17T03:37:28.537553+0000","last_fullsized":"2024-09-17T03:37:28.537553+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:36.017576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972792+0000","last_change":"2024-09-17T03:37:27.551893+0000","last_active":"2024-09-17T03:37:28.972792+0000","last_peered":"2024-09-17T03:37:28.972792+0000","last_clean":"2024-09-17T03:37:28.972792+0000","last_became_active":"2024-09-17T03:37:27.551602+0000","last_became_peered":"2024-09-17T03:37:27.551602+0000","last_unstale":"2024-09-17T03:37:28.972792+0000","last_undegraded":"2024-09-17T03:37:28.972792+0000","last_fullsized":"2024-09-17T03:37:28.972792+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:57.278615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972464+0000","last_change":"2024-09-17T03:37:26.532271+0000","last_active":"2024-09-17T03:37:28.972464+0000","last_peered":"2024-09-17T03:37:28.972464+0000","last_clean":"2024-09-17T03:37:28.972464+0000","last_became_active":"2024-09-17T03:37:26.531921+0000","last_became_peered":"2024-09-17T03:37:26.531921+0000","last_unstale":"2024-09-17T03:37:28.972464+0000","last_undegraded":"2024-09-17T03:37:28.972464+0000","last_fullsized":"2024-09-17T03:37:28.972464+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:52.144731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972070+0000","last_change":"2024-09-17T03:37:27.553058+0000","last_active":"2024-09-17T03:37:28.972070+0000","last_peered":"2024-09-17T03:37:28.972070+0000","last_clean":"2024-09-17T03:37:28.972070+0000","last_became_active":"2024-09-17T03:37:27.550890+0000","last_became_peered":"2024-09-17T03:37:27.550890+0000","last_unstale":"2024-09-17T03:37:28.972070+0000","last_undegraded":"2024-09-17T03:37:28.972070+0000","last_fullsized":"2024-09-17T03:37:28.972070+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:21.682676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921722+0000","last_change":"2024-09-17T03:37:26.531629+0000","last_active":"2024-09-17T03:37:28.921722+0000","last_peered":"2024-09-17T03:37:28.921722+0000","last_clean":"2024-09-17T03:37:28.921722+0000","last_became_active":"2024-09-17T03:37:26.529987+0000","last_became_peered":"2024-09-17T03:37:26.529987+0000","last_unstale":"2024-09-17T03:37:28.921722+0000","last_undegraded":"2024-09-17T03:37:28.921722+0000","last_fullsized":"2024-09-17T03:37:28.921722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:16.827468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973143+0000","last_change":"2024-09-17T03:37:27.550210+0000","last_active":"2024-09-17T03:37:28.973143+0000","last_peered":"2024-09-17T03:37:28.973143+0000","last_clean":"2024-09-17T03:37:28.973143+0000","last_became_active":"2024-09-17T03:37:27.548300+0000","last_became_peered":"2024-09-17T03:37:27.548300+0000","last_unstale":"2024-09-17T03:37:28.973143+0000","last_undegraded":"2024-09-17T03:37:28.973143+0000","last_fullsized":"2024-09-17T03:37:28.973143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:40.031431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.537703+0000","last_change":"2024-09-17T03:37:26.528848+0000","last_active":"2024-09-17T03:37:27.537703+0000","last_peered":"2024-09-17T03:37:27.537703+0000","last_clean":"2024-09-17T03:37:27.537703+0000","last_became_active":"2024-09-17T03:37:26.528533+0000","last_became_peered":"2024-09-17T03:37:26.528533+0000","last_unstale":"2024-09-17T03:37:27.537703+0000","last_undegraded":"2024-09-17T03:37:27.537703+0000","last_fullsized":"2024-09-17T03:37:27.537703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:02.179951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973031+0000","last_change":"2024-09-17T03:37:27.538085+0000","last_active":"2024-09-17T03:37:28.973031+0000","last_peered":"2024-09-17T03:37:28.973031+0000","last_clean":"2024-09-17T03:37:28.973031+0000","last_became_active":"2024-09-17T03:37:27.537802+0000","last_became_peered":"2024-09-17T03:37:27.537802+0000","last_unstale":"2024-09-17T03:37:28.973031+0000","last_undegraded":"2024-09-17T03:37:28.973031+0000","last_fullsized":"2024-09-17T03:37:28.973031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:46.545182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973089+0000","last_change":"2024-09-17T03:37:26.520225+0000","last_active":"2024-09-17T03:37:28.973089+0000","last_peered":"2024-09-17T03:37:28.973089+0000","last_clean":"2024-09-17T03:37:28.973089+0000","last_became_active":"2024-09-17T03:37:26.519923+0000","last_became_peered":"2024-09-17T03:37:26.519923+0000","last_unstale":"2024-09-17T03:37:28.973089+0000","last_undegraded":"2024-09-17T03:37:28.973089+0000","last_fullsized":"2024-09-17T03:37:28.973089+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:27.401642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972651+0000","last_change":"2024-09-17T03:37:27.552395+0000","last_active":"2024-09-17T03:37:28.972651+0000","last_peered":"2024-09-17T03:37:28.972651+0000","last_clean":"2024-09-17T03:37:28.972651+0000","last_became_active":"2024-09-17T03:37:27.551648+0000","last_became_peered":"2024-09-17T03:37:27.551648+0000","last_unstale":"2024-09-17T03:37:28.972651+0000","last_undegraded":"2024-09-17T03:37:28.972651+0000","last_fullsized":"2024-09-17T03:37:28.972651+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:29.942300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972453+0000","last_change":"2024-09-17T03:37:26.522976+0000","last_active":"2024-09-17T03:37:28.972453+0000","last_peered":"2024-09-17T03:37:28.972453+0000","last_clean":"2024-09-17T03:37:28.972453+0000","last_became_active":"2024-09-17T03:37:26.522640+0000","last_became_peered":"2024-09-17T03:37:26.522640+0000","last_unstale":"2024-09-17T03:37:28.972453+0000","last_undegraded":"2024-09-17T03:37:28.972453+0000","last_fullsized":"2024-09-17T03:37:28.972453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:34.420408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972553+0000","last_change":"2024-09-17T03:37:27.541597+0000","last_active":"2024-09-17T03:37:28.972553+0000","last_peered":"2024-09-17T03:37:28.972553+0000","last_clean":"2024-09-17T03:37:28.972553+0000","last_became_active":"2024-09-17T03:37:27.541315+0000","last_became_peered":"2024-09-17T03:37:27.541315+0000","last_unstale":"2024-09-17T03:37:28.972553+0000","last_undegraded":"2024-09-17T03:37:28.972553+0000","last_fullsized":"2024-09-17T03:37:28.972553+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.531261+0000","last_change":"2024-09-17T03:37:26.528801+0000","last_active":"2024-09-17T03:37:27.531261+0000","last_peered":"2024-09-17T03:37:27.531261+0000","last_clean":"2024-09-17T03:37:27.531261+0000","last_became_active":"2024-09-17T03:37:26.527544+0000","last_became_peered":"2024-09-17T03:37:26.527544+0000","last_unstale":"2024-09-17T03:37:27.531261+0000","last_undegraded":"2024-09-17T03:37:27.531261+0000","last_fullsized":"2024-09-17T03:37:27.531261+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:08.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972162+0000","last_change":"2024-09-17T03:37:27.555015+0000","last_active":"2024-09-17T03:37:28.972162+0000","last_peered":"2024-09-17T03:37:28.972162+0000","last_clean":"2024-09-17T03:37:28.972162+0000","last_became_active":"2024-09-17T03:37:27.554722+0000","last_became_peered":"2024-09-17T03:37:27.554722+0000","last_unstale":"2024-09-17T03:37:28.972162+0000","last_undegraded":"2024-09-17T03:37:28.972162+0000","last_fullsized":"2024-09-17T03:37:28.972162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:29.825087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972627+0000","last_change":"2024-09-17T03:37:26.531272+0000","last_active":"2024-09-17T03:37:28.972627+0000","last_peered":"2024-09-17T03:37:28.972627+0000","last_clean":"2024-09-17T03:37:28.972627+0000","last_became_active":"2024-09-17T03:37:26.530970+0000","last_became_peered":"2024-09-17T03:37:26.530970+0000","last_unstale":"2024-09-17T03:37:28.972627+0000","last_undegraded":"2024-09-17T03:37:28.972627+0000","last_fullsized":"2024-09-17T03:37:28.972627+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:02.686244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972225+0000","last_change":"2024-09-17T03:37:27.543452+0000","last_active":"2024-09-17T03:37:28.972225+0000","last_peered":"2024-09-17T03:37:28.972225+0000","last_clean":"2024-09-17T03:37:28.972225+0000","last_became_active":"2024-09-17T03:37:27.543130+0000","last_became_peered":"2024-09-17T03:37:27.543130+0000","last_unstale":"2024-09-17T03:37:28.972225+0000","last_undegraded":"2024-09-17T03:37:28.972225+0000","last_fullsized":"2024-09-17T03:37:28.972225+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972185+0000","last_change":"2024-09-17T03:37:26.526110+0000","last_active":"2024-09-17T03:37:28.972185+0000","last_peered":"2024-09-17T03:37:28.972185+0000","last_clean":"2024-09-17T03:37:28.972185+0000","last_became_active":"2024-09-17T03:37:26.525393+0000","last_became_peered":"2024-09-17T03:37:26.525393+0000","last_unstale":"2024-09-17T03:37:28.972185+0000","last_undegraded":"2024-09-17T03:37:28.972185+0000","last_fullsized":"2024-09-17T03:37:28.972185+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:59.076040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536897+0000","last_change":"2024-09-17T03:37:27.535178+0000","last_active":"2024-09-17T03:37:28.536897+0000","last_peered":"2024-09-17T03:37:28.536897+0000","last_clean":"2024-09-17T03:37:28.536897+0000","last_became_active":"2024-09-17T03:37:27.534768+0000","last_became_peered":"2024-09-17T03:37:27.534768+0000","last_unstale":"2024-09-17T03:37:28.536897+0000","last_undegraded":"2024-09-17T03:37:28.536897+0000","last_fullsized":"2024-09-17T03:37:28.536897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:57.588193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973091+0000","last_change":"2024-09-17T03:37:26.527185+0000","last_active":"2024-09-17T03:37:28.973091+0000","last_peered":"2024-09-17T03:37:28.973091+0000","last_clean":"2024-09-17T03:37:28.973091+0000","last_became_active":"2024-09-17T03:37:26.526936+0000","last_became_peered":"2024-09-17T03:37:26.526936+0000","last_unstale":"2024-09-17T03:37:28.973091+0000","last_undegraded":"2024-09-17T03:37:28.973091+0000","last_fullsized":"2024-09-17T03:37:28.973091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:37.973137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921633+0000","last_change":"2024-09-17T03:37:27.545218+0000","last_active":"2024-09-17T03:37:28.921633+0000","last_peered":"2024-09-17T03:37:28.921633+0000","last_clean":"2024-09-17T03:37:28.921633+0000","last_became_active":"2024-09-17T03:37:27.544912+0000","last_became_peered":"2024-09-17T03:37:27.544912+0000","last_unstale":"2024-09-17T03:37:28.921633+0000","last_undegraded":"2024-09-17T03:37:28.921633+0000","last_fullsized":"2024-09-17T03:37:28.921633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972382+0000","last_change":"2024-09-17T03:37:26.534022+0000","last_active":"2024-09-17T03:37:28.972382+0000","last_peered":"2024-09-17T03:37:28.972382+0000","last_clean":"2024-09-17T03:37:28.972382+0000","last_became_active":"2024-09-17T03:37:26.533717+0000","last_became_peered":"2024-09-17T03:37:26.533717+0000","last_unstale":"2024-09-17T03:37:28.972382+0000","last_undegraded":"2024-09-17T03:37:28.972382+0000","last_fullsized":"2024-09-17T03:37:28.972382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:49.735686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972915+0000","last_change":"2024-09-17T03:37:27.542974+0000","last_active":"2024-09-17T03:37:28.972915+0000","last_peered":"2024-09-17T03:37:28.972915+0000","last_clean":"2024-09-17T03:37:28.972915+0000","last_became_active":"2024-09-17T03:37:27.542632+0000","last_became_peered":"2024-09-17T03:37:27.542632+0000","last_unstale":"2024-09-17T03:37:28.972915+0000","last_undegraded":"2024-09-17T03:37:28.972915+0000","last_fullsized":"2024-09-17T03:37:28.972915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:11.137194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537602+0000","last_change":"2024-09-17T03:37:26.535866+0000","last_active":"2024-09-17T03:37:28.537602+0000","last_peered":"2024-09-17T03:37:28.537602+0000","last_clean":"2024-09-17T03:37:28.537602+0000","last_became_active":"2024-09-17T03:37:26.535582+0000","last_became_peered":"2024-09-17T03:37:26.535582+0000","last_unstale":"2024-09-17T03:37:28.537602+0000","last_undegraded":"2024-09-17T03:37:28.537602+0000","last_fullsized":"2024-09-17T03:37:28.537602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.509896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536716+0000","last_change":"2024-09-17T03:37:27.541751+0000","last_active":"2024-09-17T03:37:28.536716+0000","last_peered":"2024-09-17T03:37:28.536716+0000","last_clean":"2024-09-17T03:37:28.536716+0000","last_became_active":"2024-09-17T03:37:27.541468+0000","last_became_peered":"2024-09-17T03:37:27.541468+0000","last_unstale":"2024-09-17T03:37:28.536716+0000","last_undegraded":"2024-09-17T03:37:28.536716+0000","last_fullsized":"2024-09-17T03:37:28.536716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:53.887378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971617+0000","last_change":"2024-09-17T03:37:26.527348+0000","last_active":"2024-09-17T03:37:28.971617+0000","last_peered":"2024-09-17T03:37:28.971617+0000","last_clean":"2024-09-17T03:37:28.971617+0000","last_became_active":"2024-09-17T03:37:26.527018+0000","last_became_peered":"2024-09-17T03:37:26.527018+0000","last_unstale":"2024-09-17T03:37:28.971617+0000","last_undegraded":"2024-09-17T03:37:28.971617+0000","last_fullsized":"2024-09-17T03:37:28.971617+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:34.905982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537921+0000","last_change":"2024-09-17T03:37:27.555528+0000","last_active":"2024-09-17T03:37:28.537921+0000","last_peered":"2024-09-17T03:37:28.537921+0000","last_clean":"2024-09-17T03:37:28.537921+0000","last_became_active":"2024-09-17T03:37:27.555178+0000","last_became_peered":"2024-09-17T03:37:27.555178+0000","last_unstale":"2024-09-17T03:37:28.537921+0000","last_undegraded":"2024-09-17T03:37:28.537921+0000","last_fullsized":"2024-09-17T03:37:28.537921+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921173+0000","last_change":"2024-09-17T03:37:26.531987+0000","last_active":"2024-09-17T03:37:28.921173+0000","last_peered":"2024-09-17T03:37:28.921173+0000","last_clean":"2024-09-17T03:37:28.921173+0000","last_became_active":"2024-09-17T03:37:26.531667+0000","last_became_peered":"2024-09-17T03:37:26.531667+0000","last_unstale":"2024-09-17T03:37:28.921173+0000","last_undegraded":"2024-09-17T03:37:28.921173+0000","last_fullsized":"2024-09-17T03:37:28.921173+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:38.767501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.545421+0000","last_change":"2024-09-17T03:37:27.545316+0000","last_active":"2024-09-17T03:37:27.545421+0000","last_peered":"2024-09-17T03:37:27.545421+0000","last_clean":"2024-09-17T03:37:27.545421+0000","last_became_active":"2024-09-17T03:37:27.544131+0000","last_became_peered":"2024-09-17T03:37:27.544131+0000","last_unstale":"2024-09-17T03:37:27.545421+0000","last_undegraded":"2024-09-17T03:37:27.545421+0000","last_fullsized":"2024-09-17T03:37:27.545421+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:25.845785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535515+0000","last_change":"2024-09-17T03:37:26.534154+0000","last_active":"2024-09-17T03:37:28.535515+0000","last_peered":"2024-09-17T03:37:28.535515+0000","last_clean":"2024-09-17T03:37:28.535515+0000","last_became_active":"2024-09-17T03:37:26.533854+0000","last_became_peered":"2024-09-17T03:37:26.533854+0000","last_unstale":"2024-09-17T03:37:28.535515+0000","last_undegraded":"2024-09-17T03:37:28.535515+0000","last_fullsized":"2024-09-17T03:37:28.535515+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:04.512041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971915+0000","last_change":"2024-09-17T03:37:27.549196+0000","last_active":"2024-09-17T03:37:28.971915+0000","last_peered":"2024-09-17T03:37:28.971915+0000","last_clean":"2024-09-17T03:37:28.971915+0000","last_became_active":"2024-09-17T03:37:27.548755+0000","last_became_peered":"2024-09-17T03:37:27.548755+0000","last_unstale":"2024-09-17T03:37:28.971915+0000","last_undegraded":"2024-09-17T03:37:28.971915+0000","last_fullsized":"2024-09-17T03:37:28.971915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538013+0000","last_change":"2024-09-17T03:37:26.536699+0000","last_active":"2024-09-17T03:37:28.538013+0000","last_peered":"2024-09-17T03:37:28.538013+0000","last_clean":"2024-09-17T03:37:28.538013+0000","last_became_active":"2024-09-17T03:37:26.536400+0000","last_became_peered":"2024-09-17T03:37:26.536400+0000","last_unstale":"2024-09-17T03:37:28.538013+0000","last_undegraded":"2024-09-17T03:37:28.538013+0000","last_fullsized":"2024-09-17T03:37:28.538013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:34.905982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535962+0000","last_change":"2024-09-17T03:37:27.545948+0000","last_active":"2024-09-17T03:37:28.535962+0000","last_peered":"2024-09-17T03:37:28.535962+0000","last_clean":"2024-09-17T03:37:28.535962+0000","last_became_active":"2024-09-17T03:37:27.544335+0000","last_became_peered":"2024-09-17T03:37:27.544335+0000","last_unstale":"2024-09-17T03:37:28.535962+0000","last_undegraded":"2024-09-17T03:37:28.535962+0000","last_fullsized":"2024-09-17T03:37:28.535962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:20.292074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537978+0000","last_change":"2024-09-17T03:37:26.532545+0000","last_active":"2024-09-17T03:37:28.537978+0000","last_peered":"2024-09-17T03:37:28.537978+0000","last_clean":"2024-09-17T03:37:28.537978+0000","last_became_active":"2024-09-17T03:37:26.532034+0000","last_became_peered":"2024-09-17T03:37:26.532034+0000","last_unstale":"2024-09-17T03:37:28.537978+0000","last_undegraded":"2024-09-17T03:37:28.537978+0000","last_fullsized":"2024-09-17T03:37:28.537978+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.682503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921360+0000","last_change":"2024-09-17T03:37:27.540180+0000","last_active":"2024-09-17T03:37:28.921360+0000","last_peered":"2024-09-17T03:37:28.921360+0000","last_clean":"2024-09-17T03:37:28.921360+0000","last_became_active":"2024-09-17T03:37:27.536635+0000","last_became_peered":"2024-09-17T03:37:27.536635+0000","last_unstale":"2024-09-17T03:37:28.921360+0000","last_undegraded":"2024-09-17T03:37:28.921360+0000","last_fullsized":"2024-09-17T03:37:28.921360+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:27.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972108+0000","last_change":"2024-09-17T03:37:26.530302+0000","last_active":"2024-09-17T03:37:28.972108+0000","last_peered":"2024-09-17T03:37:28.972108+0000","last_clean":"2024-09-17T03:37:28.972108+0000","last_became_active":"2024-09-17T03:37:26.530025+0000","last_became_peered":"2024-09-17T03:37:26.530025+0000","last_unstale":"2024-09-17T03:37:28.972108+0000","last_undegraded":"2024-09-17T03:37:28.972108+0000","last_fullsized":"2024-09-17T03:37:28.972108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:58.756354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536787+0000","last_change":"2024-09-17T03:37:27.539162+0000","last_active":"2024-09-17T03:37:28.536787+0000","last_peered":"2024-09-17T03:37:28.536787+0000","last_clean":"2024-09-17T03:37:28.536787+0000","last_became_active":"2024-09-17T03:37:27.538843+0000","last_became_peered":"2024-09-17T03:37:27.538843+0000","last_unstale":"2024-09-17T03:37:28.536787+0000","last_undegraded":"2024-09-17T03:37:28.536787+0000","last_fullsized":"2024-09-17T03:37:28.536787+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:20.412484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921850+0000","last_change":"2024-09-17T03:37:26.536689+0000","last_active":"2024-09-17T03:37:28.921850+0000","last_peered":"2024-09-17T03:37:28.921850+0000","last_clean":"2024-09-17T03:37:28.921850+0000","last_became_active":"2024-09-17T03:37:26.536406+0000","last_became_peered":"2024-09-17T03:37:26.536406+0000","last_unstale":"2024-09-17T03:37:28.921850+0000","last_undegraded":"2024-09-17T03:37:28.921850+0000","last_fullsized":"2024-09-17T03:37:28.921850+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:59.807710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921852+0000","last_change":"2024-09-17T03:37:27.546981+0000","last_active":"2024-09-17T03:37:28.921852+0000","last_peered":"2024-09-17T03:37:28.921852+0000","last_clean":"2024-09-17T03:37:28.921852+0000","last_became_active":"2024-09-17T03:37:27.546676+0000","last_became_peered":"2024-09-17T03:37:27.546676+0000","last_unstale":"2024-09-17T03:37:28.921852+0000","last_undegraded":"2024-09-17T03:37:28.921852+0000","last_fullsized":"2024-09-17T03:37:28.921852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:21.682676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536042+0000","last_change":"2024-09-17T03:37:26.531962+0000","last_active":"2024-09-17T03:37:28.536042+0000","last_peered":"2024-09-17T03:37:28.536042+0000","last_clean":"2024-09-17T03:37:28.536042+0000","last_became_active":"2024-09-17T03:37:26.531665+0000","last_became_peered":"2024-09-17T03:37:26.531665+0000","last_unstale":"2024-09-17T03:37:28.536042+0000","last_undegraded":"2024-09-17T03:37:28.536042+0000","last_fullsized":"2024-09-17T03:37:28.536042+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:20.863280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972031+0000","last_change":"2024-09-17T03:37:27.548909+0000","last_active":"2024-09-17T03:37:28.972031+0000","last_peered":"2024-09-17T03:37:28.972031+0000","last_clean":"2024-09-17T03:37:28.972031+0000","last_became_active":"2024-09-17T03:37:27.543481+0000","last_became_peered":"2024-09-17T03:37:27.543481+0000","last_unstale":"2024-09-17T03:37:28.972031+0000","last_undegraded":"2024-09-17T03:37:28.972031+0000","last_fullsized":"2024-09-17T03:37:28.972031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.531306+0000","last_change":"2024-09-17T03:37:26.531193+0000","last_active":"2024-09-17T03:37:27.531306+0000","last_peered":"2024-09-17T03:37:27.531306+0000","last_clean":"2024-09-17T03:37:27.531306+0000","last_became_active":"2024-09-17T03:37:26.529872+0000","last_became_peered":"2024-09-17T03:37:26.529872+0000","last_unstale":"2024-09-17T03:37:27.531306+0000","last_undegraded":"2024-09-17T03:37:27.531306+0000","last_fullsized":"2024-09-17T03:37:27.531306+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:13.560768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535922+0000","last_change":"2024-09-17T03:37:27.534498+0000","last_active":"2024-09-17T03:37:28.535922+0000","last_peered":"2024-09-17T03:37:28.535922+0000","last_clean":"2024-09-17T03:37:28.535922+0000","last_became_active":"2024-09-17T03:37:27.534156+0000","last_became_peered":"2024-09-17T03:37:27.534156+0000","last_unstale":"2024-09-17T03:37:28.535922+0000","last_undegraded":"2024-09-17T03:37:28.535922+0000","last_fullsized":"2024-09-17T03:37:28.535922+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:40.031431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971932+0000","last_change":"2024-09-17T03:37:26.528782+0000","last_active":"2024-09-17T03:37:28.971932+0000","last_peered":"2024-09-17T03:37:28.971932+0000","last_clean":"2024-09-17T03:37:28.971932+0000","last_became_active":"2024-09-17T03:37:26.528187+0000","last_became_peered":"2024-09-17T03:37:26.528187+0000","last_unstale":"2024-09-17T03:37:28.971932+0000","last_undegraded":"2024-09-17T03:37:28.971932+0000","last_fullsized":"2024-09-17T03:37:28.971932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:57.698060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537927+0000","last_change":"2024-09-17T03:37:27.555855+0000","last_active":"2024-09-17T03:37:28.537927+0000","last_peered":"2024-09-17T03:37:28.537927+0000","last_clean":"2024-09-17T03:37:28.537927+0000","last_became_active":"2024-09-17T03:37:27.555564+0000","last_became_peered":"2024-09-17T03:37:27.555564+0000","last_unstale":"2024-09-17T03:37:28.537927+0000","last_undegraded":"2024-09-17T03:37:28.537927+0000","last_fullsized":"2024-09-17T03:37:28.537927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:13.789016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971883+0000","last_change":"2024-09-17T03:37:26.530376+0000","last_active":"2024-09-17T03:37:28.971883+0000","last_peered":"2024-09-17T03:37:28.971883+0000","last_clean":"2024-09-17T03:37:28.971883+0000","last_became_active":"2024-09-17T03:37:26.526932+0000","last_became_peered":"2024-09-17T03:37:26.526932+0000","last_unstale":"2024-09-17T03:37:28.971883+0000","last_undegraded":"2024-09-17T03:37:28.971883+0000","last_fullsized":"2024-09-17T03:37:28.971883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:56.339214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971888+0000","last_change":"2024-09-17T03:37:27.539745+0000","last_active":"2024-09-17T03:37:28.971888+0000","last_peered":"2024-09-17T03:37:28.971888+0000","last_clean":"2024-09-17T03:37:28.971888+0000","last_became_active":"2024-09-17T03:37:27.539434+0000","last_became_peered":"2024-09-17T03:37:27.539434+0000","last_unstale":"2024-09-17T03:37:28.971888+0000","last_undegraded":"2024-09-17T03:37:28.971888+0000","last_fullsized":"2024-09-17T03:37:28.971888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:49.519749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973003+0000","last_change":"2024-09-17T03:37:26.523031+0000","last_active":"2024-09-17T03:37:28.973003+0000","last_peered":"2024-09-17T03:37:28.973003+0000","last_clean":"2024-09-17T03:37:28.973003+0000","last_became_active":"2024-09-17T03:37:26.522699+0000","last_became_peered":"2024-09-17T03:37:26.522699+0000","last_unstale":"2024-09-17T03:37:28.973003+0000","last_undegraded":"2024-09-17T03:37:28.973003+0000","last_fullsized":"2024-09-17T03:37:28.973003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:45.288058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972050+0000","last_change":"2024-09-17T03:37:27.552225+0000","last_active":"2024-09-17T03:37:28.972050+0000","last_peered":"2024-09-17T03:37:28.972050+0000","last_clean":"2024-09-17T03:37:28.972050+0000","last_became_active":"2024-09-17T03:37:27.550676+0000","last_became_peered":"2024-09-17T03:37:27.550676+0000","last_unstale":"2024-09-17T03:37:28.972050+0000","last_undegraded":"2024-09-17T03:37:28.972050+0000","last_fullsized":"2024-09-17T03:37:28.972050+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:56.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973217+0000","last_change":"2024-09-17T03:37:26.525668+0000","last_active":"2024-09-17T03:37:28.973217+0000","last_peered":"2024-09-17T03:37:28.973217+0000","last_clean":"2024-09-17T03:37:28.973217+0000","last_became_active":"2024-09-17T03:37:26.525388+0000","last_became_peered":"2024-09-17T03:37:26.525388+0000","last_unstale":"2024-09-17T03:37:28.973217+0000","last_undegraded":"2024-09-17T03:37:28.973217+0000","last_fullsized":"2024-09-17T03:37:28.973217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:14.255452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.546516+0000","last_change":"2024-09-17T03:37:27.546413+0000","last_active":"2024-09-17T03:37:27.546516+0000","last_peered":"2024-09-17T03:37:27.546516+0000","last_clean":"2024-09-17T03:37:27.546516+0000","last_became_active":"2024-09-17T03:37:27.546090+0000","last_became_peered":"2024-09-17T03:37:27.546090+0000","last_unstale":"2024-09-17T03:37:27.546516+0000","last_undegraded":"2024-09-17T03:37:27.546516+0000","last_fullsized":"2024-09-17T03:37:27.546516+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:02.207266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.536164+0000","last_change":"2024-09-17T03:37:26.527912+0000","last_active":"2024-09-17T03:37:27.536164+0000","last_peered":"2024-09-17T03:37:27.536164+0000","last_clean":"2024-09-17T03:37:27.536164+0000","last_became_active":"2024-09-17T03:37:26.527563+0000","last_became_peered":"2024-09-17T03:37:26.527563+0000","last_unstale":"2024-09-17T03:37:27.536164+0000","last_undegraded":"2024-09-17T03:37:27.536164+0000","last_fullsized":"2024-09-17T03:37:27.536164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:55.494026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972538+0000","last_change":"2024-09-17T03:37:27.551533+0000","last_active":"2024-09-17T03:37:28.972538+0000","last_peered":"2024-09-17T03:37:28.972538+0000","last_clean":"2024-09-17T03:37:28.972538+0000","last_became_active":"2024-09-17T03:37:27.551145+0000","last_became_peered":"2024-09-17T03:37:27.551145+0000","last_unstale":"2024-09-17T03:37:28.972538+0000","last_undegraded":"2024-09-17T03:37:28.972538+0000","last_fullsized":"2024-09-17T03:37:28.972538+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:33.345886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972160+0000","last_change":"2024-09-17T03:37:26.535010+0000","last_active":"2024-09-17T03:37:28.972160+0000","last_peered":"2024-09-17T03:37:28.972160+0000","last_clean":"2024-09-17T03:37:28.972160+0000","last_became_active":"2024-09-17T03:37:26.534652+0000","last_became_peered":"2024-09-17T03:37:26.534652+0000","last_unstale":"2024-09-17T03:37:28.972160+0000","last_undegraded":"2024-09-17T03:37:28.972160+0000","last_fullsized":"2024-09-17T03:37:28.972160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:11.615940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921823+0000","last_change":"2024-09-17T03:37:27.537360+0000","last_active":"2024-09-17T03:37:28.921823+0000","last_peered":"2024-09-17T03:37:28.921823+0000","last_clean":"2024-09-17T03:37:28.921823+0000","last_became_active":"2024-09-17T03:37:27.536792+0000","last_became_peered":"2024-09-17T03:37:27.536792+0000","last_unstale":"2024-09-17T03:37:28.921823+0000","last_undegraded":"2024-09-17T03:37:28.921823+0000","last_fullsized":"2024-09-17T03:37:28.921823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:56.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.531569+0000","last_change":"2024-09-17T03:37:26.529448+0000","last_active":"2024-09-17T03:37:27.531569+0000","last_peered":"2024-09-17T03:37:27.531569+0000","last_clean":"2024-09-17T03:37:27.531569+0000","last_became_active":"2024-09-17T03:37:26.529137+0000","last_became_peered":"2024-09-17T03:37:26.529137+0000","last_unstale":"2024-09-17T03:37:27.531569+0000","last_undegraded":"2024-09-17T03:37:27.531569+0000","last_fullsized":"2024-09-17T03:37:27.531569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:52.570921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972784+0000","last_change":"2024-09-17T03:37:27.551975+0000","last_active":"2024-09-17T03:37:28.972784+0000","last_peered":"2024-09-17T03:37:28.972784+0000","last_clean":"2024-09-17T03:37:28.972784+0000","last_became_active":"2024-09-17T03:37:27.551180+0000","last_became_peered":"2024-09-17T03:37:27.551180+0000","last_unstale":"2024-09-17T03:37:28.972784+0000","last_undegraded":"2024-09-17T03:37:28.972784+0000","last_fullsized":"2024-09-17T03:37:28.972784+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:51.856214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921248+0000","last_change":"2024-09-17T03:37:26.525209+0000","last_active":"2024-09-17T03:37:28.921248+0000","last_peered":"2024-09-17T03:37:28.921248+0000","last_clean":"2024-09-17T03:37:28.921248+0000","last_became_active":"2024-09-17T03:37:26.524908+0000","last_became_peered":"2024-09-17T03:37:26.524908+0000","last_unstale":"2024-09-17T03:37:28.921248+0000","last_undegraded":"2024-09-17T03:37:28.921248+0000","last_fullsized":"2024-09-17T03:37:28.921248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:04.960327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537907+0000","last_change":"2024-09-17T03:37:27.551523+0000","last_active":"2024-09-17T03:37:28.537907+0000","last_peered":"2024-09-17T03:37:28.537907+0000","last_clean":"2024-09-17T03:37:28.537907+0000","last_became_active":"2024-09-17T03:37:27.549402+0000","last_became_peered":"2024-09-17T03:37:27.549402+0000","last_unstale":"2024-09-17T03:37:28.537907+0000","last_undegraded":"2024-09-17T03:37:28.537907+0000","last_fullsized":"2024-09-17T03:37:28.537907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971532+0000","last_change":"2024-09-17T03:37:26.521825+0000","last_active":"2024-09-17T03:37:28.971532+0000","last_peered":"2024-09-17T03:37:28.971532+0000","last_clean":"2024-09-17T03:37:28.971532+0000","last_became_active":"2024-09-17T03:37:26.520727+0000","last_became_peered":"2024-09-17T03:37:26.520727+0000","last_unstale":"2024-09-17T03:37:28.971532+0000","last_undegraded":"2024-09-17T03:37:28.971532+0000","last_fullsized":"2024-09-17T03:37:28.971532+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.682503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972667+0000","last_change":"2024-09-17T03:37:27.542593+0000","last_active":"2024-09-17T03:37:28.972667+0000","last_peered":"2024-09-17T03:37:28.972667+0000","last_clean":"2024-09-17T03:37:28.972667+0000","last_became_active":"2024-09-17T03:37:27.542312+0000","last_became_peered":"2024-09-17T03:37:27.542312+0000","last_unstale":"2024-09-17T03:37:28.972667+0000","last_undegraded":"2024-09-17T03:37:28.972667+0000","last_fullsized":"2024-09-17T03:37:28.972667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:00.543429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972743+0000","last_change":"2024-09-17T03:37:26.531805+0000","last_active":"2024-09-17T03:37:28.972743+0000","last_peered":"2024-09-17T03:37:28.972743+0000","last_clean":"2024-09-17T03:37:28.972743+0000","last_became_active":"2024-09-17T03:37:26.531514+0000","last_became_peered":"2024-09-17T03:37:26.531514+0000","last_unstale":"2024-09-17T03:37:28.972743+0000","last_undegraded":"2024-09-17T03:37:28.972743+0000","last_fullsized":"2024-09-17T03:37:28.972743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:12.294261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":169,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971655+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:37:28.971655+0000","last_peered":"2024-09-17T03:37:28.971655+0000","last_clean":"2024-09-17T03:37:28.971655+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:37:28.971655+0000","last_undegraded":"2024-09-17T03:37:28.971655+0000","last_fullsized":"2024-09-17T03:37:28.971655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":618496,"data_stored":268298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1220608,"data_stored":860312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1208320,"data_stored":858680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":585728,"data_stored":254383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:32.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:32.492 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-17T03:37:32.491+0000 7fd862a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:37:32.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.701+0000 7f164ee00640 1 -- 172.21.15.121:0/2121085914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f162c004800 msgr2=0x7f162c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.701+0000 7f164ee00640 1 --2- 172.21.15.121:0/2121085914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f162c004800 0x7f162c004c10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f16480cd8c0 tx=0x7f162c005830 comp rx=0 tx=0).stop 2024-09-17T03:37:32.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.701+0000 7f164ce00640 1 -- 172.21.15.121:0/2121085914 reap_dead start 2024-09-17T03:37:32.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.701+0000 7f164ee00640 1 -- 172.21.15.121:0/2121085914 shutdown_connections 2024-09-17T03:37:32.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.701+0000 7f164ee00640 1 -- 172.21.15.121:0/2121085914 >> 172.21.15.121:0/2121085914 conn(0x7f16480cca40 msgr2=0x7f16480cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:32.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.701+0000 7f164ee00640 1 -- 172.21.15.121:0/2121085914 shutdown_connections 2024-09-17T03:37:32.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.701+0000 7f164ee00640 1 -- 172.21.15.121:0/2121085914 wait complete. 2024-09-17T03:37:32.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.704+0000 7f164ee00640 1 Processor -- start 2024-09-17T03:37:32.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.704+0000 7f164ee00640 1 -- start start 2024-09-17T03:37:32.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.705+0000 7f164ee00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f162c004800 0x7f16481e7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.705+0000 7f164ee00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16480cdb90 0x7f16480cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.705+0000 7f164ee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1648156d10 0x7f1648157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.705+0000 7f164ee00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f16480cc230 con 0x7f16480cdb90 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.705+0000 7f164ee00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f164806e7a0 con 0x7f162c004800 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.705+0000 7f164ee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16480cc3b0 con 0x7f1648156d10 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.705+0000 7f163f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16480cdb90 0x7f16480cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.705+0000 7f163f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16480cdb90 0x7f16480cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52998/0 (socket says 172.21.15.121:52998) 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.705+0000 7f163f400640 1 -- 172.21.15.121:0/4021897641 learned_addr learned my addr 172.21.15.121:0/4021897641 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f1647e00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f162c004800 0x7f16481e7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f164ce00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1648156d10 0x7f1648157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f163f400640 1 -- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1648156d10 msgr2=0x7f1648157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f163f400640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1648156d10 0x7f1648157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f163f400640 1 -- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f162c004800 msgr2=0x7f16481e7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f163f400640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f162c004800 0x7f16481e7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f163f400640 1 -- 172.21.15.121:0/4021897641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1648157660 con 0x7f16480cdb90 2024-09-17T03:37:32.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f1647e00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f162c004800 0x7f16481e7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:32.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f164ce00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1648156d10 0x7f1648157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:32.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f163f400640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16480cdb90 0x7f16480cebe0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f163000c350 tx=0x7f1630006d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:32.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f1644c00640 1 -- 172.21.15.121:0/4021897641 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630031040 con 0x7f16480cdb90 2024-09-17T03:37:32.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.706+0000 7f1644c00640 1 -- 172.21.15.121:0/4021897641 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16300035f0 con 0x7f16480cdb90 2024-09-17T03:37:32.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.707+0000 7f164ee00640 1 -- 172.21.15.121:0/4021897641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164809ee90 con 0x7f16480cdb90 2024-09-17T03:37:32.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.707+0000 7f1644c00640 1 -- 172.21.15.121:0/4021897641 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630003a00 con 0x7f16480cdb90 2024-09-17T03:37:32.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.707+0000 7f164ee00640 1 -- 172.21.15.121:0/4021897641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16480b55b0 con 0x7f16480cdb90 2024-09-17T03:37:32.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.708+0000 7f164ee00640 1 -- 172.21.15.121:0/4021897641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16480ce300 con 0x7f16480cdb90 2024-09-17T03:37:32.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.709+0000 7f1644c00640 1 -- 172.21.15.121:0/4021897641 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1630034070 con 0x7f16480cdb90 2024-09-17T03:37:32.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.710+0000 7f1644c00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1624078b90 0x7f162407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.710+0000 7f1644c00640 1 -- 172.21.15.121:0/4021897641 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f16300bb040 con 0x7f16480cdb90 2024-09-17T03:37:32.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.710+0000 7f1647e00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1624078b90 0x7f162407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.711+0000 7f1647e00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1624078b90 0x7f162407b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f164815a730 tx=0x7f1638005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:32.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.715+0000 7f1644c00640 1 -- 172.21.15.121:0/4021897641 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1648157660 con 0x7f16480cdb90 2024-09-17T03:37:32.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.894+0000 7f164ee00640 1 -- 172.21.15.121:0/4021897641 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16480b5310 con 0x7f1624078b90 2024-09-17T03:37:32.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.899+0000 7f1644c00640 1 -- 172.21.15.121:0/4021897641 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251541 (secure 0 0 0) 0x7f16480b5310 con 0x7f1624078b90 2024-09-17T03:37:32.905 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:32.906 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:37:32.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 -- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1624078b90 msgr2=0x7f162407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1624078b90 0x7f162407b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f164815a730 tx=0x7f1638005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:32.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 -- 172.21.15.121:0/4021897641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16480cdb90 msgr2=0x7f16480cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16480cdb90 0x7f16480cebe0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f163000c350 tx=0x7f1630006d70 comp rx=0 tx=0).stop 2024-09-17T03:37:32.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 -- 172.21.15.121:0/4021897641 shutdown_connections 2024-09-17T03:37:32.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1648156d10 0x7f1648157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1624078b90 0x7f162407b0a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16480cdb90 0x7f16480cebe0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 --2- 172.21.15.121:0/4021897641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f162c004800 0x7f16481e7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 -- 172.21.15.121:0/4021897641 >> 172.21.15.121:0/4021897641 conn(0x7f16480cca40 msgr2=0x7f1648159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:32.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 -- 172.21.15.121:0/4021897641 shutdown_connections 2024-09-17T03:37:32.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:32.904+0000 7f164ee00640 1 -- 172.21.15.121:0/4021897641 wait complete. 2024-09-17T03:37:32.927 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-17T03:37:31.308651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222180,"kb_used_data":5948,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752540,"statfs":{"total":773094113280,"available":772866600960,"internally_reserved":0,"allocated":6090752,"data_stored":3315929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.806591"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536989+0000","last_change":"2024-09-17T03:37:27.540668+0000","last_active":"2024-09-17T03:37:28.536989+0000","last_peered":"2024-09-17T03:37:28.536989+0000","last_clean":"2024-09-17T03:37:28.536989+0000","last_became_active":"2024-09-17T03:37:27.537774+0000","last_became_peered":"2024-09-17T03:37:27.537774+0000","last_unstale":"2024-09-17T03:37:28.536989+0000","last_undegraded":"2024-09-17T03:37:28.536989+0000","last_fullsized":"2024-09-17T03:37:28.536989+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:33.857227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921909+0000","last_change":"2024-09-17T03:37:27.545950+0000","last_active":"2024-09-17T03:37:28.921909+0000","last_peered":"2024-09-17T03:37:28.921909+0000","last_clean":"2024-09-17T03:37:28.921909+0000","last_became_active":"2024-09-17T03:37:27.545651+0000","last_became_peered":"2024-09-17T03:37:27.545651+0000","last_unstale":"2024-09-17T03:37:28.921909+0000","last_undegraded":"2024-09-17T03:37:28.921909+0000","last_fullsized":"2024-09-17T03:37:28.921909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:55.838205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.530643+0000","last_change":"2024-09-17T03:37:27.530643+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.530643+0000","last_undegraded":"2024-09-17T03:37:27.530643+0000","last_fullsized":"2024-09-17T03:37:27.530643+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971871+0000","last_change":"2024-09-17T03:37:27.549625+0000","last_active":"2024-09-17T03:37:28.971871+0000","last_peered":"2024-09-17T03:37:28.971871+0000","last_clean":"2024-09-17T03:37:28.971871+0000","last_became_active":"2024-09-17T03:37:27.549336+0000","last_became_peered":"2024-09-17T03:37:27.549336+0000","last_unstale":"2024-09-17T03:37:28.971871+0000","last_undegraded":"2024-09-17T03:37:28.971871+0000","last_fullsized":"2024-09-17T03:37:28.971871+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:53.792718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921565+0000","last_change":"2024-09-17T03:37:27.551257+0000","last_active":"2024-09-17T03:37:28.921565+0000","last_peered":"2024-09-17T03:37:28.921565+0000","last_clean":"2024-09-17T03:37:28.921565+0000","last_became_active":"2024-09-17T03:37:27.550886+0000","last_became_peered":"2024-09-17T03:37:27.550886+0000","last_unstale":"2024-09-17T03:37:28.921565+0000","last_undegraded":"2024-09-17T03:37:28.921565+0000","last_fullsized":"2024-09-17T03:37:28.921565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536419+0000","last_change":"2024-09-17T03:37:27.545772+0000","last_active":"2024-09-17T03:37:28.536419+0000","last_peered":"2024-09-17T03:37:28.536419+0000","last_clean":"2024-09-17T03:37:28.536419+0000","last_became_active":"2024-09-17T03:37:27.545156+0000","last_became_peered":"2024-09-17T03:37:27.545156+0000","last_unstale":"2024-09-17T03:37:28.536419+0000","last_undegraded":"2024-09-17T03:37:28.536419+0000","last_fullsized":"2024-09-17T03:37:28.536419+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:53.792718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972117+0000","last_change":"2024-09-17T03:37:27.549769+0000","last_active":"2024-09-17T03:37:28.972117+0000","last_peered":"2024-09-17T03:37:28.972117+0000","last_clean":"2024-09-17T03:37:28.972117+0000","last_became_active":"2024-09-17T03:37:27.549437+0000","last_became_peered":"2024-09-17T03:37:27.549437+0000","last_unstale":"2024-09-17T03:37:28.972117+0000","last_undegraded":"2024-09-17T03:37:28.972117+0000","last_fullsized":"2024-09-17T03:37:28.972117+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:55.838205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535267+0000","last_change":"2024-09-17T03:37:27.534750+0000","last_active":"2024-09-17T03:37:28.535267+0000","last_peered":"2024-09-17T03:37:28.535267+0000","last_clean":"2024-09-17T03:37:28.535267+0000","last_became_active":"2024-09-17T03:37:27.534326+0000","last_became_peered":"2024-09-17T03:37:27.534326+0000","last_unstale":"2024-09-17T03:37:28.535267+0000","last_undegraded":"2024-09-17T03:37:28.535267+0000","last_fullsized":"2024-09-17T03:37:28.535267+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:25.188857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.531549+0000","last_change":"2024-09-17T03:37:27.531549+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.531549+0000","last_undegraded":"2024-09-17T03:37:27.531549+0000","last_fullsized":"2024-09-17T03:37:27.531549+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972624+0000","last_change":"2024-09-17T03:37:27.543273+0000","last_active":"2024-09-17T03:37:28.972624+0000","last_peered":"2024-09-17T03:37:28.972624+0000","last_clean":"2024-09-17T03:37:28.972624+0000","last_became_active":"2024-09-17T03:37:27.542939+0000","last_became_peered":"2024-09-17T03:37:27.542939+0000","last_unstale":"2024-09-17T03:37:28.972624+0000","last_undegraded":"2024-09-17T03:37:28.972624+0000","last_fullsized":"2024-09-17T03:37:28.972624+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:47.056365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536597+0000","last_change":"2024-09-17T03:37:27.537150+0000","last_active":"2024-09-17T03:37:28.536597+0000","last_peered":"2024-09-17T03:37:28.536597+0000","last_clean":"2024-09-17T03:37:28.536597+0000","last_became_active":"2024-09-17T03:37:27.536812+0000","last_became_peered":"2024-09-17T03:37:27.536812+0000","last_unstale":"2024-09-17T03:37:28.536597+0000","last_undegraded":"2024-09-17T03:37:28.536597+0000","last_fullsized":"2024-09-17T03:37:28.536597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:27.755987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537577+0000","last_change":"2024-09-17T03:37:27.554147+0000","last_active":"2024-09-17T03:37:28.537577+0000","last_peered":"2024-09-17T03:37:28.537577+0000","last_clean":"2024-09-17T03:37:28.537577+0000","last_became_active":"2024-09-17T03:37:27.553846+0000","last_became_peered":"2024-09-17T03:37:27.553846+0000","last_unstale":"2024-09-17T03:37:28.537577+0000","last_undegraded":"2024-09-17T03:37:28.537577+0000","last_fullsized":"2024-09-17T03:37:28.537577+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537004+0000","last_change":"2024-09-17T03:37:27.543555+0000","last_active":"2024-09-17T03:37:28.537004+0000","last_peered":"2024-09-17T03:37:28.537004+0000","last_clean":"2024-09-17T03:37:28.537004+0000","last_became_active":"2024-09-17T03:37:27.543195+0000","last_became_peered":"2024-09-17T03:37:27.543195+0000","last_unstale":"2024-09-17T03:37:28.537004+0000","last_undegraded":"2024-09-17T03:37:28.537004+0000","last_fullsized":"2024-09-17T03:37:28.537004+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:27.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536509+0000","last_change":"2024-09-17T03:37:27.542230+0000","last_active":"2024-09-17T03:37:28.536509+0000","last_peered":"2024-09-17T03:37:28.536509+0000","last_clean":"2024-09-17T03:37:28.536509+0000","last_became_active":"2024-09-17T03:37:27.541912+0000","last_became_peered":"2024-09-17T03:37:27.541912+0000","last_unstale":"2024-09-17T03:37:28.536509+0000","last_undegraded":"2024-09-17T03:37:28.536509+0000","last_fullsized":"2024-09-17T03:37:28.536509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:00.468303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971820+0000","last_change":"2024-09-17T03:37:27.546632+0000","last_active":"2024-09-17T03:37:28.971820+0000","last_peered":"2024-09-17T03:37:28.971820+0000","last_clean":"2024-09-17T03:37:28.971820+0000","last_became_active":"2024-09-17T03:37:27.544485+0000","last_became_peered":"2024-09-17T03:37:27.544485+0000","last_unstale":"2024-09-17T03:37:28.971820+0000","last_undegraded":"2024-09-17T03:37:28.971820+0000","last_fullsized":"2024-09-17T03:37:28.971820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:38.995552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535503+0000","last_change":"2024-09-17T03:37:27.538588+0000","last_active":"2024-09-17T03:37:28.535503+0000","last_peered":"2024-09-17T03:37:28.535503+0000","last_clean":"2024-09-17T03:37:28.535503+0000","last_became_active":"2024-09-17T03:37:27.538287+0000","last_became_peered":"2024-09-17T03:37:27.538287+0000","last_unstale":"2024-09-17T03:37:28.535503+0000","last_undegraded":"2024-09-17T03:37:28.535503+0000","last_fullsized":"2024-09-17T03:37:28.535503+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:38.995552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537009+0000","last_change":"2024-09-17T03:37:27.538911+0000","last_active":"2024-09-17T03:37:28.537009+0000","last_peered":"2024-09-17T03:37:28.537009+0000","last_clean":"2024-09-17T03:37:28.537009+0000","last_became_active":"2024-09-17T03:37:27.538020+0000","last_became_peered":"2024-09-17T03:37:27.538020+0000","last_unstale":"2024-09-17T03:37:28.537009+0000","last_undegraded":"2024-09-17T03:37:28.537009+0000","last_fullsized":"2024-09-17T03:37:28.537009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:28.630655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972164+0000","last_change":"2024-09-17T03:37:27.550328+0000","last_active":"2024-09-17T03:37:28.972164+0000","last_peered":"2024-09-17T03:37:28.972164+0000","last_clean":"2024-09-17T03:37:28.972164+0000","last_became_active":"2024-09-17T03:37:27.550060+0000","last_became_peered":"2024-09-17T03:37:27.550060+0000","last_unstale":"2024-09-17T03:37:28.972164+0000","last_undegraded":"2024-09-17T03:37:28.972164+0000","last_fullsized":"2024-09-17T03:37:28.972164+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.530238+0000","last_change":"2024-09-17T03:37:27.530238+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.530238+0000","last_undegraded":"2024-09-17T03:37:27.530238+0000","last_fullsized":"2024-09-17T03:37:27.530238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921606+0000","last_change":"2024-09-17T03:37:27.543944+0000","last_active":"2024-09-17T03:37:28.921606+0000","last_peered":"2024-09-17T03:37:28.921606+0000","last_clean":"2024-09-17T03:37:28.921606+0000","last_became_active":"2024-09-17T03:37:27.543589+0000","last_became_peered":"2024-09-17T03:37:27.543589+0000","last_unstale":"2024-09-17T03:37:28.921606+0000","last_undegraded":"2024-09-17T03:37:28.921606+0000","last_fullsized":"2024-09-17T03:37:28.921606+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971895+0000","last_change":"2024-09-17T03:37:27.552202+0000","last_active":"2024-09-17T03:37:28.971895+0000","last_peered":"2024-09-17T03:37:28.971895+0000","last_clean":"2024-09-17T03:37:28.971895+0000","last_became_active":"2024-09-17T03:37:27.544791+0000","last_became_peered":"2024-09-17T03:37:27.544791+0000","last_unstale":"2024-09-17T03:37:28.971895+0000","last_undegraded":"2024-09-17T03:37:28.971895+0000","last_fullsized":"2024-09-17T03:37:28.971895+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:26.981822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.544978+0000","last_change":"2024-09-17T03:37:27.544863+0000","last_active":"2024-09-17T03:37:27.544978+0000","last_peered":"2024-09-17T03:37:27.544978+0000","last_clean":"2024-09-17T03:37:27.544978+0000","last_became_active":"2024-09-17T03:37:27.544558+0000","last_became_peered":"2024-09-17T03:37:27.544558+0000","last_unstale":"2024-09-17T03:37:27.544978+0000","last_undegraded":"2024-09-17T03:37:27.544978+0000","last_fullsized":"2024-09-17T03:37:27.544978+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:08.297337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.541628+0000","last_change":"2024-09-17T03:37:27.541536+0000","last_active":"2024-09-17T03:37:27.541628+0000","last_peered":"2024-09-17T03:37:27.541628+0000","last_clean":"2024-09-17T03:37:27.541628+0000","last_became_active":"2024-09-17T03:37:27.541232+0000","last_became_peered":"2024-09-17T03:37:27.541232+0000","last_unstale":"2024-09-17T03:37:27.541628+0000","last_undegraded":"2024-09-17T03:37:27.541628+0000","last_fullsized":"2024-09-17T03:37:27.541628+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:48.502039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":4,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.547174+0000","last_change":"2024-09-17T03:37:27.527863+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.547174+0000","last_undegraded":"2024-09-17T03:37:27.547174+0000","last_fullsized":"2024-09-17T03:37:27.547174+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536786+0000","last_change":"2024-09-17T03:37:27.551785+0000","last_active":"2024-09-17T03:37:28.536786+0000","last_peered":"2024-09-17T03:37:28.536786+0000","last_clean":"2024-09-17T03:37:28.536786+0000","last_became_active":"2024-09-17T03:37:27.551351+0000","last_became_peered":"2024-09-17T03:37:27.551351+0000","last_unstale":"2024-09-17T03:37:28.536786+0000","last_undegraded":"2024-09-17T03:37:28.536786+0000","last_fullsized":"2024-09-17T03:37:28.536786+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:22.489576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":6,"reported_epoch":51,"state":"active","last_fresh":"2024-09-17T03:37:27.547753+0000","last_change":"2024-09-17T03:37:27.547681+0000","last_active":"2024-09-17T03:37:27.547753+0000","last_peered":"2024-09-17T03:37:27.547753+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"2024-09-17T03:37:27.547681+0000","last_became_peered":"2024-09-17T03:37:27.547681+0000","last_unstale":"2024-09-17T03:37:27.547753+0000","last_undegraded":"2024-09-17T03:37:27.547753+0000","last_fullsized":"2024-09-17T03:37:27.547753+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537358+0000","last_change":"2024-09-17T03:37:27.547485+0000","last_active":"2024-09-17T03:37:28.537358+0000","last_peered":"2024-09-17T03:37:28.537358+0000","last_clean":"2024-09-17T03:37:28.537358+0000","last_became_active":"2024-09-17T03:37:27.546932+0000","last_became_peered":"2024-09-17T03:37:27.546932+0000","last_unstale":"2024-09-17T03:37:28.537358+0000","last_undegraded":"2024-09-17T03:37:28.537358+0000","last_fullsized":"2024-09-17T03:37:28.537358+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921642+0000","last_change":"2024-09-17T03:37:27.552987+0000","last_active":"2024-09-17T03:37:28.921642+0000","last_peered":"2024-09-17T03:37:28.921642+0000","last_clean":"2024-09-17T03:37:28.921642+0000","last_became_active":"2024-09-17T03:37:27.552509+0000","last_became_peered":"2024-09-17T03:37:27.552509+0000","last_unstale":"2024-09-17T03:37:28.921642+0000","last_undegraded":"2024-09-17T03:37:28.921642+0000","last_fullsized":"2024-09-17T03:37:28.921642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:20.292074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535969+0000","last_change":"2024-09-17T03:37:27.546789+0000","last_active":"2024-09-17T03:37:28.535969+0000","last_peered":"2024-09-17T03:37:28.535969+0000","last_clean":"2024-09-17T03:37:28.535969+0000","last_became_active":"2024-09-17T03:37:27.545462+0000","last_became_peered":"2024-09-17T03:37:27.545462+0000","last_unstale":"2024-09-17T03:37:28.535969+0000","last_undegraded":"2024-09-17T03:37:28.535969+0000","last_fullsized":"2024-09-17T03:37:28.535969+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973019+0000","last_change":"2024-09-17T03:37:27.548434+0000","last_active":"2024-09-17T03:37:28.973019+0000","last_peered":"2024-09-17T03:37:28.973019+0000","last_clean":"2024-09-17T03:37:28.973019+0000","last_became_active":"2024-09-17T03:37:27.548125+0000","last_became_peered":"2024-09-17T03:37:27.548125+0000","last_unstale":"2024-09-17T03:37:28.973019+0000","last_undegraded":"2024-09-17T03:37:28.973019+0000","last_fullsized":"2024-09-17T03:37:28.973019+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:42.573230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":3,"reported_epoch":51,"state":"creating+activating","last_fresh":"2024-09-17T03:37:27.527457+0000","last_change":"2024-09-17T03:37:27.527457+0000","last_active":"2024-09-17T03:37:26.500482+0000","last_peered":"2024-09-17T03:37:26.500482+0000","last_clean":"2024-09-17T03:37:26.500482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:37:27.527457+0000","last_undegraded":"2024-09-17T03:37:27.527457+0000","last_fullsized":"2024-09-17T03:37:27.527457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921247+0000","last_change":"2024-09-17T03:37:27.533198+0000","last_active":"2024-09-17T03:37:28.921247+0000","last_peered":"2024-09-17T03:37:28.921247+0000","last_clean":"2024-09-17T03:37:28.921247+0000","last_became_active":"2024-09-17T03:37:27.532590+0000","last_became_peered":"2024-09-17T03:37:27.532590+0000","last_unstale":"2024-09-17T03:37:28.921247+0000","last_undegraded":"2024-09-17T03:37:28.921247+0000","last_fullsized":"2024-09-17T03:37:28.921247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:20.412484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972523+0000","last_change":"2024-09-17T03:37:27.557044+0000","last_active":"2024-09-17T03:37:28.972523+0000","last_peered":"2024-09-17T03:37:28.972523+0000","last_clean":"2024-09-17T03:37:28.972523+0000","last_became_active":"2024-09-17T03:37:27.552478+0000","last_became_peered":"2024-09-17T03:37:27.552478+0000","last_unstale":"2024-09-17T03:37:28.972523+0000","last_undegraded":"2024-09-17T03:37:28.972523+0000","last_fullsized":"2024-09-17T03:37:28.972523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:45.217306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973243+0000","last_change":"2024-09-17T03:37:26.531549+0000","last_active":"2024-09-17T03:37:28.973243+0000","last_peered":"2024-09-17T03:37:28.973243+0000","last_clean":"2024-09-17T03:37:28.973243+0000","last_became_active":"2024-09-17T03:37:26.531217+0000","last_became_peered":"2024-09-17T03:37:26.531217+0000","last_unstale":"2024-09-17T03:37:28.973243+0000","last_undegraded":"2024-09-17T03:37:28.973243+0000","last_fullsized":"2024-09-17T03:37:28.973243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:24.181754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972545+0000","last_change":"2024-09-17T03:37:27.543948+0000","last_active":"2024-09-17T03:37:28.972545+0000","last_peered":"2024-09-17T03:37:28.972545+0000","last_clean":"2024-09-17T03:37:28.972545+0000","last_became_active":"2024-09-17T03:37:27.543659+0000","last_became_peered":"2024-09-17T03:37:27.543659+0000","last_unstale":"2024-09-17T03:37:28.972545+0000","last_undegraded":"2024-09-17T03:37:28.972545+0000","last_fullsized":"2024-09-17T03:37:28.972545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:14.055525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537553+0000","last_change":"2024-09-17T03:37:26.536702+0000","last_active":"2024-09-17T03:37:28.537553+0000","last_peered":"2024-09-17T03:37:28.537553+0000","last_clean":"2024-09-17T03:37:28.537553+0000","last_became_active":"2024-09-17T03:37:26.536412+0000","last_became_peered":"2024-09-17T03:37:26.536412+0000","last_unstale":"2024-09-17T03:37:28.537553+0000","last_undegraded":"2024-09-17T03:37:28.537553+0000","last_fullsized":"2024-09-17T03:37:28.537553+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:36.017576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972792+0000","last_change":"2024-09-17T03:37:27.551893+0000","last_active":"2024-09-17T03:37:28.972792+0000","last_peered":"2024-09-17T03:37:28.972792+0000","last_clean":"2024-09-17T03:37:28.972792+0000","last_became_active":"2024-09-17T03:37:27.551602+0000","last_became_peered":"2024-09-17T03:37:27.551602+0000","last_unstale":"2024-09-17T03:37:28.972792+0000","last_undegraded":"2024-09-17T03:37:28.972792+0000","last_fullsized":"2024-09-17T03:37:28.972792+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:57.278615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972464+0000","last_change":"2024-09-17T03:37:26.532271+0000","last_active":"2024-09-17T03:37:28.972464+0000","last_peered":"2024-09-17T03:37:28.972464+0000","last_clean":"2024-09-17T03:37:28.972464+0000","last_became_active":"2024-09-17T03:37:26.531921+0000","last_became_peered":"2024-09-17T03:37:26.531921+0000","last_unstale":"2024-09-17T03:37:28.972464+0000","last_undegraded":"2024-09-17T03:37:28.972464+0000","last_fullsized":"2024-09-17T03:37:28.972464+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:52.144731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972070+0000","last_change":"2024-09-17T03:37:27.553058+0000","last_active":"2024-09-17T03:37:28.972070+0000","last_peered":"2024-09-17T03:37:28.972070+0000","last_clean":"2024-09-17T03:37:28.972070+0000","last_became_active":"2024-09-17T03:37:27.550890+0000","last_became_peered":"2024-09-17T03:37:27.550890+0000","last_unstale":"2024-09-17T03:37:28.972070+0000","last_undegraded":"2024-09-17T03:37:28.972070+0000","last_fullsized":"2024-09-17T03:37:28.972070+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:21.682676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921722+0000","last_change":"2024-09-17T03:37:26.531629+0000","last_active":"2024-09-17T03:37:28.921722+0000","last_peered":"2024-09-17T03:37:28.921722+0000","last_clean":"2024-09-17T03:37:28.921722+0000","last_became_active":"2024-09-17T03:37:26.529987+0000","last_became_peered":"2024-09-17T03:37:26.529987+0000","last_unstale":"2024-09-17T03:37:28.921722+0000","last_undegraded":"2024-09-17T03:37:28.921722+0000","last_fullsized":"2024-09-17T03:37:28.921722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:16.827468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973143+0000","last_change":"2024-09-17T03:37:27.550210+0000","last_active":"2024-09-17T03:37:28.973143+0000","last_peered":"2024-09-17T03:37:28.973143+0000","last_clean":"2024-09-17T03:37:28.973143+0000","last_became_active":"2024-09-17T03:37:27.548300+0000","last_became_peered":"2024-09-17T03:37:27.548300+0000","last_unstale":"2024-09-17T03:37:28.973143+0000","last_undegraded":"2024-09-17T03:37:28.973143+0000","last_fullsized":"2024-09-17T03:37:28.973143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:40.031431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.537703+0000","last_change":"2024-09-17T03:37:26.528848+0000","last_active":"2024-09-17T03:37:27.537703+0000","last_peered":"2024-09-17T03:37:27.537703+0000","last_clean":"2024-09-17T03:37:27.537703+0000","last_became_active":"2024-09-17T03:37:26.528533+0000","last_became_peered":"2024-09-17T03:37:26.528533+0000","last_unstale":"2024-09-17T03:37:27.537703+0000","last_undegraded":"2024-09-17T03:37:27.537703+0000","last_fullsized":"2024-09-17T03:37:27.537703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:02.179951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973031+0000","last_change":"2024-09-17T03:37:27.538085+0000","last_active":"2024-09-17T03:37:28.973031+0000","last_peered":"2024-09-17T03:37:28.973031+0000","last_clean":"2024-09-17T03:37:28.973031+0000","last_became_active":"2024-09-17T03:37:27.537802+0000","last_became_peered":"2024-09-17T03:37:27.537802+0000","last_unstale":"2024-09-17T03:37:28.973031+0000","last_undegraded":"2024-09-17T03:37:28.973031+0000","last_fullsized":"2024-09-17T03:37:28.973031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:46.545182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973089+0000","last_change":"2024-09-17T03:37:26.520225+0000","last_active":"2024-09-17T03:37:28.973089+0000","last_peered":"2024-09-17T03:37:28.973089+0000","last_clean":"2024-09-17T03:37:28.973089+0000","last_became_active":"2024-09-17T03:37:26.519923+0000","last_became_peered":"2024-09-17T03:37:26.519923+0000","last_unstale":"2024-09-17T03:37:28.973089+0000","last_undegraded":"2024-09-17T03:37:28.973089+0000","last_fullsized":"2024-09-17T03:37:28.973089+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:27.401642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972651+0000","last_change":"2024-09-17T03:37:27.552395+0000","last_active":"2024-09-17T03:37:28.972651+0000","last_peered":"2024-09-17T03:37:28.972651+0000","last_clean":"2024-09-17T03:37:28.972651+0000","last_became_active":"2024-09-17T03:37:27.551648+0000","last_became_peered":"2024-09-17T03:37:27.551648+0000","last_unstale":"2024-09-17T03:37:28.972651+0000","last_undegraded":"2024-09-17T03:37:28.972651+0000","last_fullsized":"2024-09-17T03:37:28.972651+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:29.942300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972453+0000","last_change":"2024-09-17T03:37:26.522976+0000","last_active":"2024-09-17T03:37:28.972453+0000","last_peered":"2024-09-17T03:37:28.972453+0000","last_clean":"2024-09-17T03:37:28.972453+0000","last_became_active":"2024-09-17T03:37:26.522640+0000","last_became_peered":"2024-09-17T03:37:26.522640+0000","last_unstale":"2024-09-17T03:37:28.972453+0000","last_undegraded":"2024-09-17T03:37:28.972453+0000","last_fullsized":"2024-09-17T03:37:28.972453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:34.420408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972553+0000","last_change":"2024-09-17T03:37:27.541597+0000","last_active":"2024-09-17T03:37:28.972553+0000","last_peered":"2024-09-17T03:37:28.972553+0000","last_clean":"2024-09-17T03:37:28.972553+0000","last_became_active":"2024-09-17T03:37:27.541315+0000","last_became_peered":"2024-09-17T03:37:27.541315+0000","last_unstale":"2024-09-17T03:37:28.972553+0000","last_undegraded":"2024-09-17T03:37:28.972553+0000","last_fullsized":"2024-09-17T03:37:28.972553+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.531261+0000","last_change":"2024-09-17T03:37:26.528801+0000","last_active":"2024-09-17T03:37:27.531261+0000","last_peered":"2024-09-17T03:37:27.531261+0000","last_clean":"2024-09-17T03:37:27.531261+0000","last_became_active":"2024-09-17T03:37:26.527544+0000","last_became_peered":"2024-09-17T03:37:26.527544+0000","last_unstale":"2024-09-17T03:37:27.531261+0000","last_undegraded":"2024-09-17T03:37:27.531261+0000","last_fullsized":"2024-09-17T03:37:27.531261+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:08.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972162+0000","last_change":"2024-09-17T03:37:27.555015+0000","last_active":"2024-09-17T03:37:28.972162+0000","last_peered":"2024-09-17T03:37:28.972162+0000","last_clean":"2024-09-17T03:37:28.972162+0000","last_became_active":"2024-09-17T03:37:27.554722+0000","last_became_peered":"2024-09-17T03:37:27.554722+0000","last_unstale":"2024-09-17T03:37:28.972162+0000","last_undegraded":"2024-09-17T03:37:28.972162+0000","last_fullsized":"2024-09-17T03:37:28.972162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:29.825087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972627+0000","last_change":"2024-09-17T03:37:26.531272+0000","last_active":"2024-09-17T03:37:28.972627+0000","last_peered":"2024-09-17T03:37:28.972627+0000","last_clean":"2024-09-17T03:37:28.972627+0000","last_became_active":"2024-09-17T03:37:26.530970+0000","last_became_peered":"2024-09-17T03:37:26.530970+0000","last_unstale":"2024-09-17T03:37:28.972627+0000","last_undegraded":"2024-09-17T03:37:28.972627+0000","last_fullsized":"2024-09-17T03:37:28.972627+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:02.686244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972225+0000","last_change":"2024-09-17T03:37:27.543452+0000","last_active":"2024-09-17T03:37:28.972225+0000","last_peered":"2024-09-17T03:37:28.972225+0000","last_clean":"2024-09-17T03:37:28.972225+0000","last_became_active":"2024-09-17T03:37:27.543130+0000","last_became_peered":"2024-09-17T03:37:27.543130+0000","last_unstale":"2024-09-17T03:37:28.972225+0000","last_undegraded":"2024-09-17T03:37:28.972225+0000","last_fullsized":"2024-09-17T03:37:28.972225+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972185+0000","last_change":"2024-09-17T03:37:26.526110+0000","last_active":"2024-09-17T03:37:28.972185+0000","last_peered":"2024-09-17T03:37:28.972185+0000","last_clean":"2024-09-17T03:37:28.972185+0000","last_became_active":"2024-09-17T03:37:26.525393+0000","last_became_peered":"2024-09-17T03:37:26.525393+0000","last_unstale":"2024-09-17T03:37:28.972185+0000","last_undegraded":"2024-09-17T03:37:28.972185+0000","last_fullsized":"2024-09-17T03:37:28.972185+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:59.076040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536897+0000","last_change":"2024-09-17T03:37:27.535178+0000","last_active":"2024-09-17T03:37:28.536897+0000","last_peered":"2024-09-17T03:37:28.536897+0000","last_clean":"2024-09-17T03:37:28.536897+0000","last_became_active":"2024-09-17T03:37:27.534768+0000","last_became_peered":"2024-09-17T03:37:27.534768+0000","last_unstale":"2024-09-17T03:37:28.536897+0000","last_undegraded":"2024-09-17T03:37:28.536897+0000","last_fullsized":"2024-09-17T03:37:28.536897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:57.588193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973091+0000","last_change":"2024-09-17T03:37:26.527185+0000","last_active":"2024-09-17T03:37:28.973091+0000","last_peered":"2024-09-17T03:37:28.973091+0000","last_clean":"2024-09-17T03:37:28.973091+0000","last_became_active":"2024-09-17T03:37:26.526936+0000","last_became_peered":"2024-09-17T03:37:26.526936+0000","last_unstale":"2024-09-17T03:37:28.973091+0000","last_undegraded":"2024-09-17T03:37:28.973091+0000","last_fullsized":"2024-09-17T03:37:28.973091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:37.973137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921633+0000","last_change":"2024-09-17T03:37:27.545218+0000","last_active":"2024-09-17T03:37:28.921633+0000","last_peered":"2024-09-17T03:37:28.921633+0000","last_clean":"2024-09-17T03:37:28.921633+0000","last_became_active":"2024-09-17T03:37:27.544912+0000","last_became_peered":"2024-09-17T03:37:27.544912+0000","last_unstale":"2024-09-17T03:37:28.921633+0000","last_undegraded":"2024-09-17T03:37:28.921633+0000","last_fullsized":"2024-09-17T03:37:28.921633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972382+0000","last_change":"2024-09-17T03:37:26.534022+0000","last_active":"2024-09-17T03:37:28.972382+0000","last_peered":"2024-09-17T03:37:28.972382+0000","last_clean":"2024-09-17T03:37:28.972382+0000","last_became_active":"2024-09-17T03:37:26.533717+0000","last_became_peered":"2024-09-17T03:37:26.533717+0000","last_unstale":"2024-09-17T03:37:28.972382+0000","last_undegraded":"2024-09-17T03:37:28.972382+0000","last_fullsized":"2024-09-17T03:37:28.972382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:49.735686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972915+0000","last_change":"2024-09-17T03:37:27.542974+0000","last_active":"2024-09-17T03:37:28.972915+0000","last_peered":"2024-09-17T03:37:28.972915+0000","last_clean":"2024-09-17T03:37:28.972915+0000","last_became_active":"2024-09-17T03:37:27.542632+0000","last_became_peered":"2024-09-17T03:37:27.542632+0000","last_unstale":"2024-09-17T03:37:28.972915+0000","last_undegraded":"2024-09-17T03:37:28.972915+0000","last_fullsized":"2024-09-17T03:37:28.972915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:11.137194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537602+0000","last_change":"2024-09-17T03:37:26.535866+0000","last_active":"2024-09-17T03:37:28.537602+0000","last_peered":"2024-09-17T03:37:28.537602+0000","last_clean":"2024-09-17T03:37:28.537602+0000","last_became_active":"2024-09-17T03:37:26.535582+0000","last_became_peered":"2024-09-17T03:37:26.535582+0000","last_unstale":"2024-09-17T03:37:28.537602+0000","last_undegraded":"2024-09-17T03:37:28.537602+0000","last_fullsized":"2024-09-17T03:37:28.537602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.509896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536716+0000","last_change":"2024-09-17T03:37:27.541751+0000","last_active":"2024-09-17T03:37:28.536716+0000","last_peered":"2024-09-17T03:37:28.536716+0000","last_clean":"2024-09-17T03:37:28.536716+0000","last_became_active":"2024-09-17T03:37:27.541468+0000","last_became_peered":"2024-09-17T03:37:27.541468+0000","last_unstale":"2024-09-17T03:37:28.536716+0000","last_undegraded":"2024-09-17T03:37:28.536716+0000","last_fullsized":"2024-09-17T03:37:28.536716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:53.887378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971617+0000","last_change":"2024-09-17T03:37:26.527348+0000","last_active":"2024-09-17T03:37:28.971617+0000","last_peered":"2024-09-17T03:37:28.971617+0000","last_clean":"2024-09-17T03:37:28.971617+0000","last_became_active":"2024-09-17T03:37:26.527018+0000","last_became_peered":"2024-09-17T03:37:26.527018+0000","last_unstale":"2024-09-17T03:37:28.971617+0000","last_undegraded":"2024-09-17T03:37:28.971617+0000","last_fullsized":"2024-09-17T03:37:28.971617+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:34.905982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537921+0000","last_change":"2024-09-17T03:37:27.555528+0000","last_active":"2024-09-17T03:37:28.537921+0000","last_peered":"2024-09-17T03:37:28.537921+0000","last_clean":"2024-09-17T03:37:28.537921+0000","last_became_active":"2024-09-17T03:37:27.555178+0000","last_became_peered":"2024-09-17T03:37:27.555178+0000","last_unstale":"2024-09-17T03:37:28.537921+0000","last_undegraded":"2024-09-17T03:37:28.537921+0000","last_fullsized":"2024-09-17T03:37:28.537921+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921173+0000","last_change":"2024-09-17T03:37:26.531987+0000","last_active":"2024-09-17T03:37:28.921173+0000","last_peered":"2024-09-17T03:37:28.921173+0000","last_clean":"2024-09-17T03:37:28.921173+0000","last_became_active":"2024-09-17T03:37:26.531667+0000","last_became_peered":"2024-09-17T03:37:26.531667+0000","last_unstale":"2024-09-17T03:37:28.921173+0000","last_undegraded":"2024-09-17T03:37:28.921173+0000","last_fullsized":"2024-09-17T03:37:28.921173+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:38.767501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.545421+0000","last_change":"2024-09-17T03:37:27.545316+0000","last_active":"2024-09-17T03:37:27.545421+0000","last_peered":"2024-09-17T03:37:27.545421+0000","last_clean":"2024-09-17T03:37:27.545421+0000","last_became_active":"2024-09-17T03:37:27.544131+0000","last_became_peered":"2024-09-17T03:37:27.544131+0000","last_unstale":"2024-09-17T03:37:27.545421+0000","last_undegraded":"2024-09-17T03:37:27.545421+0000","last_fullsized":"2024-09-17T03:37:27.545421+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:25.845785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535515+0000","last_change":"2024-09-17T03:37:26.534154+0000","last_active":"2024-09-17T03:37:28.535515+0000","last_peered":"2024-09-17T03:37:28.535515+0000","last_clean":"2024-09-17T03:37:28.535515+0000","last_became_active":"2024-09-17T03:37:26.533854+0000","last_became_peered":"2024-09-17T03:37:26.533854+0000","last_unstale":"2024-09-17T03:37:28.535515+0000","last_undegraded":"2024-09-17T03:37:28.535515+0000","last_fullsized":"2024-09-17T03:37:28.535515+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:04.512041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971915+0000","last_change":"2024-09-17T03:37:27.549196+0000","last_active":"2024-09-17T03:37:28.971915+0000","last_peered":"2024-09-17T03:37:28.971915+0000","last_clean":"2024-09-17T03:37:28.971915+0000","last_became_active":"2024-09-17T03:37:27.548755+0000","last_became_peered":"2024-09-17T03:37:27.548755+0000","last_unstale":"2024-09-17T03:37:28.971915+0000","last_undegraded":"2024-09-17T03:37:28.971915+0000","last_fullsized":"2024-09-17T03:37:28.971915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538013+0000","last_change":"2024-09-17T03:37:26.536699+0000","last_active":"2024-09-17T03:37:28.538013+0000","last_peered":"2024-09-17T03:37:28.538013+0000","last_clean":"2024-09-17T03:37:28.538013+0000","last_became_active":"2024-09-17T03:37:26.536400+0000","last_became_peered":"2024-09-17T03:37:26.536400+0000","last_unstale":"2024-09-17T03:37:28.538013+0000","last_undegraded":"2024-09-17T03:37:28.538013+0000","last_fullsized":"2024-09-17T03:37:28.538013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:34.905982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535962+0000","last_change":"2024-09-17T03:37:27.545948+0000","last_active":"2024-09-17T03:37:28.535962+0000","last_peered":"2024-09-17T03:37:28.535962+0000","last_clean":"2024-09-17T03:37:28.535962+0000","last_became_active":"2024-09-17T03:37:27.544335+0000","last_became_peered":"2024-09-17T03:37:27.544335+0000","last_unstale":"2024-09-17T03:37:28.535962+0000","last_undegraded":"2024-09-17T03:37:28.535962+0000","last_fullsized":"2024-09-17T03:37:28.535962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:20.292074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537978+0000","last_change":"2024-09-17T03:37:26.532545+0000","last_active":"2024-09-17T03:37:28.537978+0000","last_peered":"2024-09-17T03:37:28.537978+0000","last_clean":"2024-09-17T03:37:28.537978+0000","last_became_active":"2024-09-17T03:37:26.532034+0000","last_became_peered":"2024-09-17T03:37:26.532034+0000","last_unstale":"2024-09-17T03:37:28.537978+0000","last_undegraded":"2024-09-17T03:37:28.537978+0000","last_fullsized":"2024-09-17T03:37:28.537978+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.682503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921360+0000","last_change":"2024-09-17T03:37:27.540180+0000","last_active":"2024-09-17T03:37:28.921360+0000","last_peered":"2024-09-17T03:37:28.921360+0000","last_clean":"2024-09-17T03:37:28.921360+0000","last_became_active":"2024-09-17T03:37:27.536635+0000","last_became_peered":"2024-09-17T03:37:27.536635+0000","last_unstale":"2024-09-17T03:37:28.921360+0000","last_undegraded":"2024-09-17T03:37:28.921360+0000","last_fullsized":"2024-09-17T03:37:28.921360+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:27.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972108+0000","last_change":"2024-09-17T03:37:26.530302+0000","last_active":"2024-09-17T03:37:28.972108+0000","last_peered":"2024-09-17T03:37:28.972108+0000","last_clean":"2024-09-17T03:37:28.972108+0000","last_became_active":"2024-09-17T03:37:26.530025+0000","last_became_peered":"2024-09-17T03:37:26.530025+0000","last_unstale":"2024-09-17T03:37:28.972108+0000","last_undegraded":"2024-09-17T03:37:28.972108+0000","last_fullsized":"2024-09-17T03:37:28.972108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:58.756354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536787+0000","last_change":"2024-09-17T03:37:27.539162+0000","last_active":"2024-09-17T03:37:28.536787+0000","last_peered":"2024-09-17T03:37:28.536787+0000","last_clean":"2024-09-17T03:37:28.536787+0000","last_became_active":"2024-09-17T03:37:27.538843+0000","last_became_peered":"2024-09-17T03:37:27.538843+0000","last_unstale":"2024-09-17T03:37:28.536787+0000","last_undegraded":"2024-09-17T03:37:28.536787+0000","last_fullsized":"2024-09-17T03:37:28.536787+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:20.412484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921850+0000","last_change":"2024-09-17T03:37:26.536689+0000","last_active":"2024-09-17T03:37:28.921850+0000","last_peered":"2024-09-17T03:37:28.921850+0000","last_clean":"2024-09-17T03:37:28.921850+0000","last_became_active":"2024-09-17T03:37:26.536406+0000","last_became_peered":"2024-09-17T03:37:26.536406+0000","last_unstale":"2024-09-17T03:37:28.921850+0000","last_undegraded":"2024-09-17T03:37:28.921850+0000","last_fullsized":"2024-09-17T03:37:28.921850+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:59.807710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921852+0000","last_change":"2024-09-17T03:37:27.546981+0000","last_active":"2024-09-17T03:37:28.921852+0000","last_peered":"2024-09-17T03:37:28.921852+0000","last_clean":"2024-09-17T03:37:28.921852+0000","last_became_active":"2024-09-17T03:37:27.546676+0000","last_became_peered":"2024-09-17T03:37:27.546676+0000","last_unstale":"2024-09-17T03:37:28.921852+0000","last_undegraded":"2024-09-17T03:37:28.921852+0000","last_fullsized":"2024-09-17T03:37:28.921852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:21.682676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536042+0000","last_change":"2024-09-17T03:37:26.531962+0000","last_active":"2024-09-17T03:37:28.536042+0000","last_peered":"2024-09-17T03:37:28.536042+0000","last_clean":"2024-09-17T03:37:28.536042+0000","last_became_active":"2024-09-17T03:37:26.531665+0000","last_became_peered":"2024-09-17T03:37:26.531665+0000","last_unstale":"2024-09-17T03:37:28.536042+0000","last_undegraded":"2024-09-17T03:37:28.536042+0000","last_fullsized":"2024-09-17T03:37:28.536042+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:20.863280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972031+0000","last_change":"2024-09-17T03:37:27.548909+0000","last_active":"2024-09-17T03:37:28.972031+0000","last_peered":"2024-09-17T03:37:28.972031+0000","last_clean":"2024-09-17T03:37:28.972031+0000","last_became_active":"2024-09-17T03:37:27.543481+0000","last_became_peered":"2024-09-17T03:37:27.543481+0000","last_unstale":"2024-09-17T03:37:28.972031+0000","last_undegraded":"2024-09-17T03:37:28.972031+0000","last_fullsized":"2024-09-17T03:37:28.972031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.531306+0000","last_change":"2024-09-17T03:37:26.531193+0000","last_active":"2024-09-17T03:37:27.531306+0000","last_peered":"2024-09-17T03:37:27.531306+0000","last_clean":"2024-09-17T03:37:27.531306+0000","last_became_active":"2024-09-17T03:37:26.529872+0000","last_became_peered":"2024-09-17T03:37:26.529872+0000","last_unstale":"2024-09-17T03:37:27.531306+0000","last_undegraded":"2024-09-17T03:37:27.531306+0000","last_fullsized":"2024-09-17T03:37:27.531306+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:13.560768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535922+0000","last_change":"2024-09-17T03:37:27.534498+0000","last_active":"2024-09-17T03:37:28.535922+0000","last_peered":"2024-09-17T03:37:28.535922+0000","last_clean":"2024-09-17T03:37:28.535922+0000","last_became_active":"2024-09-17T03:37:27.534156+0000","last_became_peered":"2024-09-17T03:37:27.534156+0000","last_unstale":"2024-09-17T03:37:28.535922+0000","last_undegraded":"2024-09-17T03:37:28.535922+0000","last_fullsized":"2024-09-17T03:37:28.535922+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:40.031431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971932+0000","last_change":"2024-09-17T03:37:26.528782+0000","last_active":"2024-09-17T03:37:28.971932+0000","last_peered":"2024-09-17T03:37:28.971932+0000","last_clean":"2024-09-17T03:37:28.971932+0000","last_became_active":"2024-09-17T03:37:26.528187+0000","last_became_peered":"2024-09-17T03:37:26.528187+0000","last_unstale":"2024-09-17T03:37:28.971932+0000","last_undegraded":"2024-09-17T03:37:28.971932+0000","last_fullsized":"2024-09-17T03:37:28.971932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:57.698060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537927+0000","last_change":"2024-09-17T03:37:27.555855+0000","last_active":"2024-09-17T03:37:28.537927+0000","last_peered":"2024-09-17T03:37:28.537927+0000","last_clean":"2024-09-17T03:37:28.537927+0000","last_became_active":"2024-09-17T03:37:27.555564+0000","last_became_peered":"2024-09-17T03:37:27.555564+0000","last_unstale":"2024-09-17T03:37:28.537927+0000","last_undegraded":"2024-09-17T03:37:28.537927+0000","last_fullsized":"2024-09-17T03:37:28.537927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:13.789016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971883+0000","last_change":"2024-09-17T03:37:26.530376+0000","last_active":"2024-09-17T03:37:28.971883+0000","last_peered":"2024-09-17T03:37:28.971883+0000","last_clean":"2024-09-17T03:37:28.971883+0000","last_became_active":"2024-09-17T03:37:26.526932+0000","last_became_peered":"2024-09-17T03:37:26.526932+0000","last_unstale":"2024-09-17T03:37:28.971883+0000","last_undegraded":"2024-09-17T03:37:28.971883+0000","last_fullsized":"2024-09-17T03:37:28.971883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:56.339214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971888+0000","last_change":"2024-09-17T03:37:27.539745+0000","last_active":"2024-09-17T03:37:28.971888+0000","last_peered":"2024-09-17T03:37:28.971888+0000","last_clean":"2024-09-17T03:37:28.971888+0000","last_became_active":"2024-09-17T03:37:27.539434+0000","last_became_peered":"2024-09-17T03:37:27.539434+0000","last_unstale":"2024-09-17T03:37:28.971888+0000","last_undegraded":"2024-09-17T03:37:28.971888+0000","last_fullsized":"2024-09-17T03:37:28.971888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:49.519749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973003+0000","last_change":"2024-09-17T03:37:26.523031+0000","last_active":"2024-09-17T03:37:28.973003+0000","last_peered":"2024-09-17T03:37:28.973003+0000","last_clean":"2024-09-17T03:37:28.973003+0000","last_became_active":"2024-09-17T03:37:26.522699+0000","last_became_peered":"2024-09-17T03:37:26.522699+0000","last_unstale":"2024-09-17T03:37:28.973003+0000","last_undegraded":"2024-09-17T03:37:28.973003+0000","last_fullsized":"2024-09-17T03:37:28.973003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:45.288058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972050+0000","last_change":"2024-09-17T03:37:27.552225+0000","last_active":"2024-09-17T03:37:28.972050+0000","last_peered":"2024-09-17T03:37:28.972050+0000","last_clean":"2024-09-17T03:37:28.972050+0000","last_became_active":"2024-09-17T03:37:27.550676+0000","last_became_peered":"2024-09-17T03:37:27.550676+0000","last_unstale":"2024-09-17T03:37:28.972050+0000","last_undegraded":"2024-09-17T03:37:28.972050+0000","last_fullsized":"2024-09-17T03:37:28.972050+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:56.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973217+0000","last_change":"2024-09-17T03:37:26.525668+0000","last_active":"2024-09-17T03:37:28.973217+0000","last_peered":"2024-09-17T03:37:28.973217+0000","last_clean":"2024-09-17T03:37:28.973217+0000","last_became_active":"2024-09-17T03:37:26.525388+0000","last_became_peered":"2024-09-17T03:37:26.525388+0000","last_unstale":"2024-09-17T03:37:28.973217+0000","last_undegraded":"2024-09-17T03:37:28.973217+0000","last_fullsized":"2024-09-17T03:37:28.973217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:14.255452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.546516+0000","last_change":"2024-09-17T03:37:27.546413+0000","last_active":"2024-09-17T03:37:27.546516+0000","last_peered":"2024-09-17T03:37:27.546516+0000","last_clean":"2024-09-17T03:37:27.546516+0000","last_became_active":"2024-09-17T03:37:27.546090+0000","last_became_peered":"2024-09-17T03:37:27.546090+0000","last_unstale":"2024-09-17T03:37:27.546516+0000","last_undegraded":"2024-09-17T03:37:27.546516+0000","last_fullsized":"2024-09-17T03:37:27.546516+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:02.207266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.536164+0000","last_change":"2024-09-17T03:37:26.527912+0000","last_active":"2024-09-17T03:37:27.536164+0000","last_peered":"2024-09-17T03:37:27.536164+0000","last_clean":"2024-09-17T03:37:27.536164+0000","last_became_active":"2024-09-17T03:37:26.527563+0000","last_became_peered":"2024-09-17T03:37:26.527563+0000","last_unstale":"2024-09-17T03:37:27.536164+0000","last_undegraded":"2024-09-17T03:37:27.536164+0000","last_fullsized":"2024-09-17T03:37:27.536164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:55.494026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972538+0000","last_change":"2024-09-17T03:37:27.551533+0000","last_active":"2024-09-17T03:37:28.972538+0000","last_peered":"2024-09-17T03:37:28.972538+0000","last_clean":"2024-09-17T03:37:28.972538+0000","last_became_active":"2024-09-17T03:37:27.551145+0000","last_became_peered":"2024-09-17T03:37:27.551145+0000","last_unstale":"2024-09-17T03:37:28.972538+0000","last_undegraded":"2024-09-17T03:37:28.972538+0000","last_fullsized":"2024-09-17T03:37:28.972538+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:33.345886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972160+0000","last_change":"2024-09-17T03:37:26.535010+0000","last_active":"2024-09-17T03:37:28.972160+0000","last_peered":"2024-09-17T03:37:28.972160+0000","last_clean":"2024-09-17T03:37:28.972160+0000","last_became_active":"2024-09-17T03:37:26.534652+0000","last_became_peered":"2024-09-17T03:37:26.534652+0000","last_unstale":"2024-09-17T03:37:28.972160+0000","last_undegraded":"2024-09-17T03:37:28.972160+0000","last_fullsized":"2024-09-17T03:37:28.972160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:11.615940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921823+0000","last_change":"2024-09-17T03:37:27.537360+0000","last_active":"2024-09-17T03:37:28.921823+0000","last_peered":"2024-09-17T03:37:28.921823+0000","last_clean":"2024-09-17T03:37:28.921823+0000","last_became_active":"2024-09-17T03:37:27.536792+0000","last_became_peered":"2024-09-17T03:37:27.536792+0000","last_unstale":"2024-09-17T03:37:28.921823+0000","last_undegraded":"2024-09-17T03:37:28.921823+0000","last_fullsized":"2024-09-17T03:37:28.921823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:56.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T03:37:27.531569+0000","last_change":"2024-09-17T03:37:26.529448+0000","last_active":"2024-09-17T03:37:27.531569+0000","last_peered":"2024-09-17T03:37:27.531569+0000","last_clean":"2024-09-17T03:37:27.531569+0000","last_became_active":"2024-09-17T03:37:26.529137+0000","last_became_peered":"2024-09-17T03:37:26.529137+0000","last_unstale":"2024-09-17T03:37:27.531569+0000","last_undegraded":"2024-09-17T03:37:27.531569+0000","last_fullsized":"2024-09-17T03:37:27.531569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:52.570921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972784+0000","last_change":"2024-09-17T03:37:27.551975+0000","last_active":"2024-09-17T03:37:28.972784+0000","last_peered":"2024-09-17T03:37:28.972784+0000","last_clean":"2024-09-17T03:37:28.972784+0000","last_became_active":"2024-09-17T03:37:27.551180+0000","last_became_peered":"2024-09-17T03:37:27.551180+0000","last_unstale":"2024-09-17T03:37:28.972784+0000","last_undegraded":"2024-09-17T03:37:28.972784+0000","last_fullsized":"2024-09-17T03:37:28.972784+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:51.856214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921248+0000","last_change":"2024-09-17T03:37:26.525209+0000","last_active":"2024-09-17T03:37:28.921248+0000","last_peered":"2024-09-17T03:37:28.921248+0000","last_clean":"2024-09-17T03:37:28.921248+0000","last_became_active":"2024-09-17T03:37:26.524908+0000","last_became_peered":"2024-09-17T03:37:26.524908+0000","last_unstale":"2024-09-17T03:37:28.921248+0000","last_undegraded":"2024-09-17T03:37:28.921248+0000","last_fullsized":"2024-09-17T03:37:28.921248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:04.960327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537907+0000","last_change":"2024-09-17T03:37:27.551523+0000","last_active":"2024-09-17T03:37:28.537907+0000","last_peered":"2024-09-17T03:37:28.537907+0000","last_clean":"2024-09-17T03:37:28.537907+0000","last_became_active":"2024-09-17T03:37:27.549402+0000","last_became_peered":"2024-09-17T03:37:27.549402+0000","last_unstale":"2024-09-17T03:37:28.537907+0000","last_undegraded":"2024-09-17T03:37:28.537907+0000","last_fullsized":"2024-09-17T03:37:28.537907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971532+0000","last_change":"2024-09-17T03:37:26.521825+0000","last_active":"2024-09-17T03:37:28.971532+0000","last_peered":"2024-09-17T03:37:28.971532+0000","last_clean":"2024-09-17T03:37:28.971532+0000","last_became_active":"2024-09-17T03:37:26.520727+0000","last_became_peered":"2024-09-17T03:37:26.520727+0000","last_unstale":"2024-09-17T03:37:28.971532+0000","last_undegraded":"2024-09-17T03:37:28.971532+0000","last_fullsized":"2024-09-17T03:37:28.971532+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.682503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972667+0000","last_change":"2024-09-17T03:37:27.542593+0000","last_active":"2024-09-17T03:37:28.972667+0000","last_peered":"2024-09-17T03:37:28.972667+0000","last_clean":"2024-09-17T03:37:28.972667+0000","last_became_active":"2024-09-17T03:37:27.542312+0000","last_became_peered":"2024-09-17T03:37:27.542312+0000","last_unstale":"2024-09-17T03:37:28.972667+0000","last_undegraded":"2024-09-17T03:37:28.972667+0000","last_fullsized":"2024-09-17T03:37:28.972667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:00.543429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972743+0000","last_change":"2024-09-17T03:37:26.531805+0000","last_active":"2024-09-17T03:37:28.972743+0000","last_peered":"2024-09-17T03:37:28.972743+0000","last_clean":"2024-09-17T03:37:28.972743+0000","last_became_active":"2024-09-17T03:37:26.531514+0000","last_became_peered":"2024-09-17T03:37:26.531514+0000","last_unstale":"2024-09-17T03:37:28.972743+0000","last_undegraded":"2024-09-17T03:37:28.972743+0000","last_fullsized":"2024-09-17T03:37:28.972743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:12.294261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":169,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971655+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:37:28.971655+0000","last_peered":"2024-09-17T03:37:28.971655+0000","last_clean":"2024-09-17T03:37:28.971655+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:37:28.971655+0000","last_undegraded":"2024-09-17T03:37:28.971655+0000","last_fullsized":"2024-09-17T03:37:28.971655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":618496,"data_stored":268298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1220608,"data_stored":860312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1208320,"data_stored":858680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":585728,"data_stored":254383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:32.983 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3d is not active+clean 2024-09-17T03:37:32.983 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2024-09-17T03:37:27.530643+0000', 'last_change': '2024-09-17T03:37:27.530643+0000', 'last_active': '2024-09-17T03:37:26.500482+0000', 'last_peered': '2024-09-17T03:37:26.500482+0000', 'last_clean': '2024-09-17T03:37:26.500482+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:37:27.530643+0000', 'last_undegraded': '2024-09-17T03:37:27.530643+0000', 'last_fullsized': '2024-09-17T03:37:27.530643+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_clean_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:37:32.983 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-09-17T03:37:32.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2024-09-17T03:37:27.531549+0000', 'last_change': '2024-09-17T03:37:27.531549+0000', 'last_active': '2024-09-17T03:37:26.500482+0000', 'last_peered': '2024-09-17T03:37:26.500482+0000', 'last_clean': '2024-09-17T03:37:26.500482+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:37:27.531549+0000', 'last_undegraded': '2024-09-17T03:37:27.531549+0000', 'last_fullsized': '2024-09-17T03:37:27.531549+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_clean_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:37:32.984 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-09-17T03:37:32.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2024-09-17T03:37:27.530238+0000', 'last_change': '2024-09-17T03:37:27.530238+0000', 'last_active': '2024-09-17T03:37:26.500482+0000', 'last_peered': '2024-09-17T03:37:26.500482+0000', 'last_clean': '2024-09-17T03:37:26.500482+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:37:27.530238+0000', 'last_undegraded': '2024-09-17T03:37:27.530238+0000', 'last_fullsized': '2024-09-17T03:37:27.530238+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_clean_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:37:32.984 INFO:tasks.ceph.ceph_manager.ceph:PG 8.28 is not active+clean 2024-09-17T03:37:32.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2024-09-17T03:37:27.547174+0000', 'last_change': '2024-09-17T03:37:27.527863+0000', 'last_active': '2024-09-17T03:37:26.500482+0000', 'last_peered': '2024-09-17T03:37:26.500482+0000', 'last_clean': '2024-09-17T03:37:26.500482+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:37:27.547174+0000', 'last_undegraded': '2024-09-17T03:37:27.547174+0000', 'last_fullsized': '2024-09-17T03:37:27.547174+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_clean_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': ['4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:37:32.984 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-17T03:37:32.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 51, 'state': 'active', 'last_fresh': '2024-09-17T03:37:27.547753+0000', 'last_change': '2024-09-17T03:37:27.547681+0000', 'last_active': '2024-09-17T03:37:27.547753+0000', 'last_peered': '2024-09-17T03:37:27.547753+0000', 'last_clean': '2024-09-17T03:37:26.500482+0000', 'last_became_active': '2024-09-17T03:37:27.547681+0000', 'last_became_peered': '2024-09-17T03:37:27.547681+0000', 'last_unstale': '2024-09-17T03:37:27.547753+0000', 'last_undegraded': '2024-09-17T03:37:27.547753+0000', 'last_fullsized': '2024-09-17T03:37:27.547753+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_clean_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': ['4', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:37:32.984 INFO:tasks.ceph.ceph_manager.ceph:PG 8.21 is not active+clean 2024-09-17T03:37:32.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 51, 'state': 'creating+activating', 'last_fresh': '2024-09-17T03:37:27.527457+0000', 'last_change': '2024-09-17T03:37:27.527457+0000', 'last_active': '2024-09-17T03:37:26.500482+0000', 'last_peered': '2024-09-17T03:37:26.500482+0000', 'last_clean': '2024-09-17T03:37:26.500482+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:37:27.527457+0000', 'last_undegraded': '2024-09-17T03:37:27.527457+0000', 'last_fullsized': '2024-09-17T03:37:27.527457+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'last_clean_scrub_stamp': '2024-09-17T03:37:26.500482+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': ['4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:37:32.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:37:33.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.202+0000 7fb4e7600640 1 -- 172.21.15.121:0/1144181262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4e0074cb0 msgr2=0x7fb4e0073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.202+0000 7fb4e7600640 1 --2- 172.21.15.121:0/1144181262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4e0074cb0 0x7fb4e0073dd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0005fd0 tx=0x7fb4d002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.202+0000 7fb4e7600640 1 -- 172.21.15.121:0/1144181262 shutdown_connections 2024-09-17T03:37:33.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.202+0000 7fb4e7600640 1 --2- 172.21.15.121:0/1144181262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4e0074cb0 0x7fb4e0073dd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.202+0000 7fb4e7600640 1 -- 172.21.15.121:0/1144181262 >> 172.21.15.121:0/1144181262 conn(0x7fb4e00cca40 msgr2=0x7fb4e00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:33.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.202+0000 7fb4e7600640 1 -- 172.21.15.121:0/1144181262 shutdown_connections 2024-09-17T03:37:33.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.202+0000 7fb4e7600640 1 -- 172.21.15.121:0/1144181262 wait complete. 2024-09-17T03:37:33.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.204+0000 7fb4e7600640 1 Processor -- start 2024-09-17T03:37:33.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.204+0000 7fb4e7600640 1 -- start start 2024-09-17T03:37:33.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4e7600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e0074cb0 0x7fb4e00ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4e7600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4e00cbc10 0x7fb4e01f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4e7600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e01f97e0 0x7fb4e0155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4e7600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e006f670 con 0x7fb4e00cbc10 2024-09-17T03:37:33.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4e7600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e006f4f0 con 0x7fb4e0074cb0 2024-09-17T03:37:33.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4e7600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e006f7f0 con 0x7fb4e01f97e0 2024-09-17T03:37:33.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4d7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4e00cbc10 0x7fb4e01f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4d7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4e00cbc10 0x7fb4e01f92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53012/0 (socket says 172.21.15.121:53012) 2024-09-17T03:37:33.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4d7e00640 1 -- 172.21.15.121:0/1217572789 learned_addr learned my addr 172.21.15.121:0/1217572789 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:33.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4e4c00640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e0074cb0 0x7fb4e00ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4e5600640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e01f97e0 0x7fb4e0155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4d7e00640 1 -- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e01f97e0 msgr2=0x7fb4e0155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4d7e00640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e01f97e0 0x7fb4e0155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4d7e00640 1 -- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e0074cb0 msgr2=0x7fb4e00ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4d7e00640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e0074cb0 0x7fb4e00ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.206+0000 7fb4d7e00640 1 -- 172.21.15.121:0/1217572789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e01f9bf0 con 0x7fb4e00cbc10 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.207+0000 7fb4d7e00640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4e00cbc10 0x7fb4e01f92a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800b3e0 tx=0x7fb4c800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.207+0000 7fb4dd600640 1 -- 172.21.15.121:0/1217572789 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8015020 con 0x7fb4e00cbc10 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.207+0000 7fb4dd600640 1 -- 172.21.15.121:0/1217572789 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4c8011920 con 0x7fb4e00cbc10 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.207+0000 7fb4dd600640 1 -- 172.21.15.121:0/1217572789 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8011d70 con 0x7fb4e00cbc10 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.207+0000 7fb4e7600640 1 -- 172.21.15.121:0/1217572789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e01fa0f0 con 0x7fb4e00cbc10 2024-09-17T03:37:33.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.207+0000 7fb4e7600640 1 -- 172.21.15.121:0/1217572789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e00cfaa0 con 0x7fb4e00cbc10 2024-09-17T03:37:33.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.208+0000 7fb4e7600640 1 -- 172.21.15.121:0/1217572789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e0073dd0 con 0x7fb4e00cbc10 2024-09-17T03:37:33.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.210+0000 7fb4dd600640 1 -- 172.21.15.121:0/1217572789 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb4c8018020 con 0x7fb4e00cbc10 2024-09-17T03:37:33.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.210+0000 7fb4dd600640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb4bc078b90 0x7fb4bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.211+0000 7fb4dd600640 1 -- 172.21.15.121:0/1217572789 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fb4c809adf0 con 0x7fb4e00cbc10 2024-09-17T03:37:33.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.211+0000 7fb4e4c00640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb4bc078b90 0x7fb4bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.212+0000 7fb4e4c00640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb4bc078b90 0x7fb4bc07b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0033000 tx=0x7fb4d0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:33.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.215+0000 7fb4dd600640 1 -- 172.21.15.121:0/1217572789 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb4c801f020 con 0x7fb4e00cbc10 2024-09-17T03:37:33.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.468+0000 7fb4e7600640 1 -- 172.21.15.121:0/1217572789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb4e00cf830 con 0x7fb4e00cbc10 2024-09-17T03:37:33.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.468+0000 7fb4dd600640 1 -- 172.21.15.121:0/1217572789 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1339 (secure 0 0 0) 0x7fb4e01f9bf0 con 0x7fb4e00cbc10 2024-09-17T03:37:33.469 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:33.470 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":149,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":52,"num_osds":8,"num_up_osds":8,"osd_up_since":1726544120,"num_in_osds":8,"osd_in_since":1726544109,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"creating+activating","count":5},{"state_name":"active","count":1}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":227512320,"bytes_avail":772866600960,"bytes_total":773094113280,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2468,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":28,"btime":"2024-09-17T03:37:30:553841+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5388}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-17T03:36:29.292718+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:37:33.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 -- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb4bc078b90 msgr2=0x7fb4bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb4bc078b90 0x7fb4bc07b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0033000 tx=0x7fb4d0004730 comp rx=0 tx=0).stop 2024-09-17T03:37:33.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 -- 172.21.15.121:0/1217572789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4e00cbc10 msgr2=0x7fb4e01f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4e00cbc10 0x7fb4e01f92a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800b3e0 tx=0x7fb4c800b8a0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 -- 172.21.15.121:0/1217572789 shutdown_connections 2024-09-17T03:37:33.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4e01f97e0 0x7fb4e0155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb4bc078b90 0x7fb4bc07b0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4e00cbc10 0x7fb4e01f92a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 --2- 172.21.15.121:0/1217572789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4e0074cb0 0x7fb4e00ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 -- 172.21.15.121:0/1217572789 >> 172.21.15.121:0/1217572789 conn(0x7fb4e00cca40 msgr2=0x7fb4e0159d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:33.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 -- 172.21.15.121:0/1217572789 shutdown_connections 2024-09-17T03:37:33.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.471+0000 7fb4e7600640 1 -- 172.21.15.121:0/1217572789 wait complete. 2024-09-17T03:37:33.494 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:37:33.494 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:33.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.713+0000 7f4d7c200640 1 -- 172.21.15.121:0/757852146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d740cbc10 msgr2=0x7f4d740cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.713+0000 7f4d7c200640 1 --2- 172.21.15.121:0/757852146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d740cbc10 0x7f4d740cc020 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4d74076360 tx=0x7f4d6002a560 comp rx=0 tx=0).stop 2024-09-17T03:37:33.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.713+0000 7f4d7c200640 1 -- 172.21.15.121:0/757852146 shutdown_connections 2024-09-17T03:37:33.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.713+0000 7f4d7c200640 1 --2- 172.21.15.121:0/757852146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d7406ddf0 0x7f4d7406e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.713+0000 7f4d7c200640 1 --2- 172.21.15.121:0/757852146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d740cbc10 0x7f4d740cc020 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.713+0000 7f4d7c200640 1 --2- 172.21.15.121:0/757852146 >> v2:172.21.15.176:3300/0 conn(0x7f4d74074cb0 0x7f4d74073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.713+0000 7f4d7c200640 1 -- 172.21.15.121:0/757852146 >> 172.21.15.121:0/757852146 conn(0x7f4d740cca40 msgr2=0x7f4d740cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:33.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.713+0000 7f4d7c200640 1 -- 172.21.15.121:0/757852146 shutdown_connections 2024-09-17T03:37:33.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.713+0000 7f4d7c200640 1 -- 172.21.15.121:0/757852146 wait complete. 2024-09-17T03:37:33.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.716+0000 7f4d7c200640 1 Processor -- start 2024-09-17T03:37:33.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.716+0000 7f4d7c200640 1 -- start start 2024-09-17T03:37:33.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.717+0000 7f4d7c200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d7406ddf0 0x7f4d74157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.717+0000 7f4d7c200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d74074cb0 0x7f4d740b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.717+0000 7f4d7c200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d740cbc10 0x7f4d740b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.717+0000 7f4d7c200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7406f170 con 0x7f4d7406ddf0 2024-09-17T03:37:33.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.717+0000 7f4d7c200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7406eff0 con 0x7f4d74074cb0 2024-09-17T03:37:33.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.717+0000 7f4d7c200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7406f2f0 con 0x7f4d740cbc10 2024-09-17T03:37:33.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.717+0000 7f4d79800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d7406ddf0 0x7f4d74157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d79800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d7406ddf0 0x7f4d74157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53030/0 (socket says 172.21.15.121:53030) 2024-09-17T03:37:33.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d79800640 1 -- 172.21.15.121:0/1854634646 learned_addr learned my addr 172.21.15.121:0/1854634646 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:33.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d78e00640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d74074cb0 0x7f4d740b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d79800640 1 -- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d740cbc10 msgr2=0x7f4d740b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d7a200640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d740cbc10 0x7f4d740b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d79800640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d740cbc10 0x7f4d740b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d79800640 1 -- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d74074cb0 msgr2=0x7f4d740b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d79800640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d74074cb0 0x7f4d740b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d79800640 1 -- 172.21.15.121:0/1854634646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d74157850 con 0x7f4d7406ddf0 2024-09-17T03:37:33.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d78e00640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d74074cb0 0x7f4d740b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:33.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d7a200640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d740cbc10 0x7f4d740b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:33.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.718+0000 7f4d79800640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d7406ddf0 0x7f4d74157310 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c9a0 tx=0x7f4d6800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.719+0000 7f4d71600640 1 -- 172.21.15.121:0/1854634646 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68007bb0 con 0x7f4d7406ddf0 2024-09-17T03:37:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.719+0000 7f4d71600640 1 -- 172.21.15.121:0/1854634646 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d68007e40 con 0x7f4d7406ddf0 2024-09-17T03:37:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.719+0000 7f4d71600640 1 -- 172.21.15.121:0/1854634646 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800f6b0 con 0x7f4d7406ddf0 2024-09-17T03:37:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.719+0000 7f4d7c200640 1 -- 172.21.15.121:0/1854634646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7409b300 con 0x7f4d7406ddf0 2024-09-17T03:37:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.719+0000 7f4d7c200640 1 -- 172.21.15.121:0/1854634646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7409b8c0 con 0x7f4d7406ddf0 2024-09-17T03:37:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.720+0000 7f4d7c200640 1 -- 172.21.15.121:0/1854634646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d74073dd0 con 0x7f4d7406ddf0 2024-09-17T03:37:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.721+0000 7f4d71600640 1 -- 172.21.15.121:0/1854634646 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d6800f850 con 0x7f4d7406ddf0 2024-09-17T03:37:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.722+0000 7f4d71600640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4d54078b90 0x7f4d5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.722+0000 7f4d71600640 1 -- 172.21.15.121:0/1854634646 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f4d6809b780 con 0x7f4d7406ddf0 2024-09-17T03:37:33.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.722+0000 7f4d78e00640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4d54078b90 0x7f4d5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.723+0000 7f4d78e00640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4d54078b90 0x7f4d5407b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d60033000 tx=0x7f4d60004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:33.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.726+0000 7f4d71600640 1 -- 172.21.15.121:0/1854634646 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4d74157850 con 0x7f4d7406ddf0 2024-09-17T03:37:33.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.905+0000 7f4d7c200640 1 -- 172.21.15.121:0/1854634646 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d740696c0 con 0x7f4d54078b90 2024-09-17T03:37:33.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.910+0000 7f4d71600640 1 -- 172.21.15.121:0/1854634646 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f4d740696c0 con 0x7f4d54078b90 2024-09-17T03:37:33.913 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:33.915 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:37:33.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 -- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4d54078b90 msgr2=0x7f4d5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4d54078b90 0x7f4d5407b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d60033000 tx=0x7f4d60004730 comp rx=0 tx=0).stop 2024-09-17T03:37:33.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 -- 172.21.15.121:0/1854634646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d7406ddf0 msgr2=0x7f4d74157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d7406ddf0 0x7f4d74157310 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c9a0 tx=0x7f4d6800ce60 comp rx=0 tx=0).stop 2024-09-17T03:37:33.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 -- 172.21.15.121:0/1854634646 shutdown_connections 2024-09-17T03:37:33.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d740cbc10 0x7f4d740b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d74074cb0 0x7f4d740b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4d54078b90 0x7f4d5407b0a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 --2- 172.21.15.121:0/1854634646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d7406ddf0 0x7f4d74157310 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 -- 172.21.15.121:0/1854634646 >> 172.21.15.121:0/1854634646 conn(0x7f4d740cca40 msgr2=0x7f4d74158260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:33.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 -- 172.21.15.121:0/1854634646 shutdown_connections 2024-09-17T03:37:33.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:33.914+0000 7f4d7c200640 1 -- 172.21.15.121:0/1854634646 wait complete. 2024-09-17T03:37:33.936 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-17T03:37:33.309518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222224,"kb_used_data":5992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752496,"statfs":{"total":773094113280,"available":772866555904,"internally_reserved":0,"allocated":6135808,"data_stored":3331492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.802523"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536989+0000","last_change":"2024-09-17T03:37:27.540668+0000","last_active":"2024-09-17T03:37:28.536989+0000","last_peered":"2024-09-17T03:37:28.536989+0000","last_clean":"2024-09-17T03:37:28.536989+0000","last_became_active":"2024-09-17T03:37:27.537774+0000","last_became_peered":"2024-09-17T03:37:27.537774+0000","last_unstale":"2024-09-17T03:37:28.536989+0000","last_undegraded":"2024-09-17T03:37:28.536989+0000","last_fullsized":"2024-09-17T03:37:28.536989+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:33.857227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921909+0000","last_change":"2024-09-17T03:37:27.545950+0000","last_active":"2024-09-17T03:37:28.921909+0000","last_peered":"2024-09-17T03:37:28.921909+0000","last_clean":"2024-09-17T03:37:28.921909+0000","last_became_active":"2024-09-17T03:37:27.545651+0000","last_became_peered":"2024-09-17T03:37:27.545651+0000","last_unstale":"2024-09-17T03:37:28.921909+0000","last_undegraded":"2024-09-17T03:37:28.921909+0000","last_fullsized":"2024-09-17T03:37:28.921909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:55.838205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538534+0000","last_change":"2024-09-17T03:37:27.558313+0000","last_active":"2024-09-17T03:37:28.538534+0000","last_peered":"2024-09-17T03:37:28.538534+0000","last_clean":"2024-09-17T03:37:28.538534+0000","last_became_active":"2024-09-17T03:37:27.557994+0000","last_became_peered":"2024-09-17T03:37:27.557994+0000","last_unstale":"2024-09-17T03:37:28.538534+0000","last_undegraded":"2024-09-17T03:37:28.538534+0000","last_fullsized":"2024-09-17T03:37:28.538534+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:30.370053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971871+0000","last_change":"2024-09-17T03:37:27.549625+0000","last_active":"2024-09-17T03:37:28.971871+0000","last_peered":"2024-09-17T03:37:28.971871+0000","last_clean":"2024-09-17T03:37:28.971871+0000","last_became_active":"2024-09-17T03:37:27.549336+0000","last_became_peered":"2024-09-17T03:37:27.549336+0000","last_unstale":"2024-09-17T03:37:28.971871+0000","last_undegraded":"2024-09-17T03:37:28.971871+0000","last_fullsized":"2024-09-17T03:37:28.971871+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:53.792718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921565+0000","last_change":"2024-09-17T03:37:27.551257+0000","last_active":"2024-09-17T03:37:28.921565+0000","last_peered":"2024-09-17T03:37:28.921565+0000","last_clean":"2024-09-17T03:37:28.921565+0000","last_became_active":"2024-09-17T03:37:27.550886+0000","last_became_peered":"2024-09-17T03:37:27.550886+0000","last_unstale":"2024-09-17T03:37:28.921565+0000","last_undegraded":"2024-09-17T03:37:28.921565+0000","last_fullsized":"2024-09-17T03:37:28.921565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536419+0000","last_change":"2024-09-17T03:37:27.545772+0000","last_active":"2024-09-17T03:37:28.536419+0000","last_peered":"2024-09-17T03:37:28.536419+0000","last_clean":"2024-09-17T03:37:28.536419+0000","last_became_active":"2024-09-17T03:37:27.545156+0000","last_became_peered":"2024-09-17T03:37:27.545156+0000","last_unstale":"2024-09-17T03:37:28.536419+0000","last_undegraded":"2024-09-17T03:37:28.536419+0000","last_fullsized":"2024-09-17T03:37:28.536419+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:53.792718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972117+0000","last_change":"2024-09-17T03:37:27.549769+0000","last_active":"2024-09-17T03:37:28.972117+0000","last_peered":"2024-09-17T03:37:28.972117+0000","last_clean":"2024-09-17T03:37:28.972117+0000","last_became_active":"2024-09-17T03:37:27.549437+0000","last_became_peered":"2024-09-17T03:37:27.549437+0000","last_unstale":"2024-09-17T03:37:28.972117+0000","last_undegraded":"2024-09-17T03:37:28.972117+0000","last_fullsized":"2024-09-17T03:37:28.972117+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:55.838205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535267+0000","last_change":"2024-09-17T03:37:27.534750+0000","last_active":"2024-09-17T03:37:28.535267+0000","last_peered":"2024-09-17T03:37:28.535267+0000","last_clean":"2024-09-17T03:37:28.535267+0000","last_became_active":"2024-09-17T03:37:27.534326+0000","last_became_peered":"2024-09-17T03:37:27.534326+0000","last_unstale":"2024-09-17T03:37:28.535267+0000","last_undegraded":"2024-09-17T03:37:28.535267+0000","last_fullsized":"2024-09-17T03:37:28.535267+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:25.188857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538962+0000","last_change":"2024-09-17T03:37:27.550014+0000","last_active":"2024-09-17T03:37:28.538962+0000","last_peered":"2024-09-17T03:37:28.538962+0000","last_clean":"2024-09-17T03:37:28.538962+0000","last_became_active":"2024-09-17T03:37:27.549694+0000","last_became_peered":"2024-09-17T03:37:27.549694+0000","last_unstale":"2024-09-17T03:37:28.538962+0000","last_undegraded":"2024-09-17T03:37:28.538962+0000","last_fullsized":"2024-09-17T03:37:28.538962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:45.679763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972624+0000","last_change":"2024-09-17T03:37:27.543273+0000","last_active":"2024-09-17T03:37:28.972624+0000","last_peered":"2024-09-17T03:37:28.972624+0000","last_clean":"2024-09-17T03:37:28.972624+0000","last_became_active":"2024-09-17T03:37:27.542939+0000","last_became_peered":"2024-09-17T03:37:27.542939+0000","last_unstale":"2024-09-17T03:37:28.972624+0000","last_undegraded":"2024-09-17T03:37:28.972624+0000","last_fullsized":"2024-09-17T03:37:28.972624+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:47.056365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536597+0000","last_change":"2024-09-17T03:37:27.537150+0000","last_active":"2024-09-17T03:37:28.536597+0000","last_peered":"2024-09-17T03:37:28.536597+0000","last_clean":"2024-09-17T03:37:28.536597+0000","last_became_active":"2024-09-17T03:37:27.536812+0000","last_became_peered":"2024-09-17T03:37:27.536812+0000","last_unstale":"2024-09-17T03:37:28.536597+0000","last_undegraded":"2024-09-17T03:37:28.536597+0000","last_fullsized":"2024-09-17T03:37:28.536597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:27.755987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537577+0000","last_change":"2024-09-17T03:37:27.554147+0000","last_active":"2024-09-17T03:37:28.537577+0000","last_peered":"2024-09-17T03:37:28.537577+0000","last_clean":"2024-09-17T03:37:28.537577+0000","last_became_active":"2024-09-17T03:37:27.553846+0000","last_became_peered":"2024-09-17T03:37:27.553846+0000","last_unstale":"2024-09-17T03:37:28.537577+0000","last_undegraded":"2024-09-17T03:37:28.537577+0000","last_fullsized":"2024-09-17T03:37:28.537577+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537004+0000","last_change":"2024-09-17T03:37:27.543555+0000","last_active":"2024-09-17T03:37:28.537004+0000","last_peered":"2024-09-17T03:37:28.537004+0000","last_clean":"2024-09-17T03:37:28.537004+0000","last_became_active":"2024-09-17T03:37:27.543195+0000","last_became_peered":"2024-09-17T03:37:27.543195+0000","last_unstale":"2024-09-17T03:37:28.537004+0000","last_undegraded":"2024-09-17T03:37:28.537004+0000","last_fullsized":"2024-09-17T03:37:28.537004+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:27.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536509+0000","last_change":"2024-09-17T03:37:27.542230+0000","last_active":"2024-09-17T03:37:28.536509+0000","last_peered":"2024-09-17T03:37:28.536509+0000","last_clean":"2024-09-17T03:37:28.536509+0000","last_became_active":"2024-09-17T03:37:27.541912+0000","last_became_peered":"2024-09-17T03:37:27.541912+0000","last_unstale":"2024-09-17T03:37:28.536509+0000","last_undegraded":"2024-09-17T03:37:28.536509+0000","last_fullsized":"2024-09-17T03:37:28.536509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:00.468303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971820+0000","last_change":"2024-09-17T03:37:27.546632+0000","last_active":"2024-09-17T03:37:28.971820+0000","last_peered":"2024-09-17T03:37:28.971820+0000","last_clean":"2024-09-17T03:37:28.971820+0000","last_became_active":"2024-09-17T03:37:27.544485+0000","last_became_peered":"2024-09-17T03:37:27.544485+0000","last_unstale":"2024-09-17T03:37:28.971820+0000","last_undegraded":"2024-09-17T03:37:28.971820+0000","last_fullsized":"2024-09-17T03:37:28.971820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:38.995552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535503+0000","last_change":"2024-09-17T03:37:27.538588+0000","last_active":"2024-09-17T03:37:28.535503+0000","last_peered":"2024-09-17T03:37:28.535503+0000","last_clean":"2024-09-17T03:37:28.535503+0000","last_became_active":"2024-09-17T03:37:27.538287+0000","last_became_peered":"2024-09-17T03:37:27.538287+0000","last_unstale":"2024-09-17T03:37:28.535503+0000","last_undegraded":"2024-09-17T03:37:28.535503+0000","last_fullsized":"2024-09-17T03:37:28.535503+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:38.995552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537009+0000","last_change":"2024-09-17T03:37:27.538911+0000","last_active":"2024-09-17T03:37:28.537009+0000","last_peered":"2024-09-17T03:37:28.537009+0000","last_clean":"2024-09-17T03:37:28.537009+0000","last_became_active":"2024-09-17T03:37:27.538020+0000","last_became_peered":"2024-09-17T03:37:27.538020+0000","last_unstale":"2024-09-17T03:37:28.537009+0000","last_undegraded":"2024-09-17T03:37:28.537009+0000","last_fullsized":"2024-09-17T03:37:28.537009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:28.630655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972164+0000","last_change":"2024-09-17T03:37:27.550328+0000","last_active":"2024-09-17T03:37:28.972164+0000","last_peered":"2024-09-17T03:37:28.972164+0000","last_clean":"2024-09-17T03:37:28.972164+0000","last_became_active":"2024-09-17T03:37:27.550060+0000","last_became_peered":"2024-09-17T03:37:27.550060+0000","last_unstale":"2024-09-17T03:37:28.972164+0000","last_undegraded":"2024-09-17T03:37:28.972164+0000","last_fullsized":"2024-09-17T03:37:28.972164+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538664+0000","last_change":"2024-09-17T03:37:27.557330+0000","last_active":"2024-09-17T03:37:28.538664+0000","last_peered":"2024-09-17T03:37:28.538664+0000","last_clean":"2024-09-17T03:37:28.538664+0000","last_became_active":"2024-09-17T03:37:27.548274+0000","last_became_peered":"2024-09-17T03:37:27.548274+0000","last_unstale":"2024-09-17T03:37:28.538664+0000","last_undegraded":"2024-09-17T03:37:28.538664+0000","last_fullsized":"2024-09-17T03:37:28.538664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:16.703349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921606+0000","last_change":"2024-09-17T03:37:27.543944+0000","last_active":"2024-09-17T03:37:28.921606+0000","last_peered":"2024-09-17T03:37:28.921606+0000","last_clean":"2024-09-17T03:37:28.921606+0000","last_became_active":"2024-09-17T03:37:27.543589+0000","last_became_peered":"2024-09-17T03:37:27.543589+0000","last_unstale":"2024-09-17T03:37:28.921606+0000","last_undegraded":"2024-09-17T03:37:28.921606+0000","last_fullsized":"2024-09-17T03:37:28.921606+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971895+0000","last_change":"2024-09-17T03:37:27.552202+0000","last_active":"2024-09-17T03:37:28.971895+0000","last_peered":"2024-09-17T03:37:28.971895+0000","last_clean":"2024-09-17T03:37:28.971895+0000","last_became_active":"2024-09-17T03:37:27.544791+0000","last_became_peered":"2024-09-17T03:37:27.544791+0000","last_unstale":"2024-09-17T03:37:28.971895+0000","last_undegraded":"2024-09-17T03:37:28.971895+0000","last_fullsized":"2024-09-17T03:37:28.971895+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:26.981822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537002+0000","last_change":"2024-09-17T03:37:27.544863+0000","last_active":"2024-09-17T03:37:28.537002+0000","last_peered":"2024-09-17T03:37:28.537002+0000","last_clean":"2024-09-17T03:37:28.537002+0000","last_became_active":"2024-09-17T03:37:27.544558+0000","last_became_peered":"2024-09-17T03:37:27.544558+0000","last_unstale":"2024-09-17T03:37:28.537002+0000","last_undegraded":"2024-09-17T03:37:28.537002+0000","last_fullsized":"2024-09-17T03:37:28.537002+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:31.631639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537254+0000","last_change":"2024-09-17T03:37:27.541536+0000","last_active":"2024-09-17T03:37:28.537254+0000","last_peered":"2024-09-17T03:37:28.537254+0000","last_clean":"2024-09-17T03:37:28.537254+0000","last_became_active":"2024-09-17T03:37:27.541232+0000","last_became_peered":"2024-09-17T03:37:27.541232+0000","last_unstale":"2024-09-17T03:37:28.537254+0000","last_undegraded":"2024-09-17T03:37:28.537254+0000","last_fullsized":"2024-09-17T03:37:28.537254+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:17.894848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535531+0000","last_change":"2024-09-17T03:37:27.548580+0000","last_active":"2024-09-17T03:37:28.535531+0000","last_peered":"2024-09-17T03:37:28.535531+0000","last_clean":"2024-09-17T03:37:28.535531+0000","last_became_active":"2024-09-17T03:37:27.547999+0000","last_became_peered":"2024-09-17T03:37:27.547999+0000","last_unstale":"2024-09-17T03:37:28.535531+0000","last_undegraded":"2024-09-17T03:37:28.535531+0000","last_fullsized":"2024-09-17T03:37:28.535531+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:25.520383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536786+0000","last_change":"2024-09-17T03:37:27.551785+0000","last_active":"2024-09-17T03:37:28.536786+0000","last_peered":"2024-09-17T03:37:28.536786+0000","last_clean":"2024-09-17T03:37:28.536786+0000","last_became_active":"2024-09-17T03:37:27.551351+0000","last_became_peered":"2024-09-17T03:37:27.551351+0000","last_unstale":"2024-09-17T03:37:28.536786+0000","last_undegraded":"2024-09-17T03:37:28.536786+0000","last_fullsized":"2024-09-17T03:37:28.536786+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:22.489576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538734+0000","last_change":"2024-09-17T03:37:27.548165+0000","last_active":"2024-09-17T03:37:28.538734+0000","last_peered":"2024-09-17T03:37:28.538734+0000","last_clean":"2024-09-17T03:37:28.538734+0000","last_became_active":"2024-09-17T03:37:27.547681+0000","last_became_peered":"2024-09-17T03:37:27.547681+0000","last_unstale":"2024-09-17T03:37:28.538734+0000","last_undegraded":"2024-09-17T03:37:28.538734+0000","last_fullsized":"2024-09-17T03:37:28.538734+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:38.918491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537358+0000","last_change":"2024-09-17T03:37:27.547485+0000","last_active":"2024-09-17T03:37:28.537358+0000","last_peered":"2024-09-17T03:37:28.537358+0000","last_clean":"2024-09-17T03:37:28.537358+0000","last_became_active":"2024-09-17T03:37:27.546932+0000","last_became_peered":"2024-09-17T03:37:27.546932+0000","last_unstale":"2024-09-17T03:37:28.537358+0000","last_undegraded":"2024-09-17T03:37:28.537358+0000","last_fullsized":"2024-09-17T03:37:28.537358+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921642+0000","last_change":"2024-09-17T03:37:27.552987+0000","last_active":"2024-09-17T03:37:28.921642+0000","last_peered":"2024-09-17T03:37:28.921642+0000","last_clean":"2024-09-17T03:37:28.921642+0000","last_became_active":"2024-09-17T03:37:27.552509+0000","last_became_peered":"2024-09-17T03:37:27.552509+0000","last_unstale":"2024-09-17T03:37:28.921642+0000","last_undegraded":"2024-09-17T03:37:28.921642+0000","last_fullsized":"2024-09-17T03:37:28.921642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:20.292074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535969+0000","last_change":"2024-09-17T03:37:27.546789+0000","last_active":"2024-09-17T03:37:28.535969+0000","last_peered":"2024-09-17T03:37:28.535969+0000","last_clean":"2024-09-17T03:37:28.535969+0000","last_became_active":"2024-09-17T03:37:27.545462+0000","last_became_peered":"2024-09-17T03:37:27.545462+0000","last_unstale":"2024-09-17T03:37:28.535969+0000","last_undegraded":"2024-09-17T03:37:28.535969+0000","last_fullsized":"2024-09-17T03:37:28.535969+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973019+0000","last_change":"2024-09-17T03:37:27.548434+0000","last_active":"2024-09-17T03:37:28.973019+0000","last_peered":"2024-09-17T03:37:28.973019+0000","last_clean":"2024-09-17T03:37:28.973019+0000","last_became_active":"2024-09-17T03:37:27.548125+0000","last_became_peered":"2024-09-17T03:37:27.548125+0000","last_unstale":"2024-09-17T03:37:28.973019+0000","last_undegraded":"2024-09-17T03:37:28.973019+0000","last_fullsized":"2024-09-17T03:37:28.973019+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:42.573230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537191+0000","last_change":"2024-09-17T03:37:27.554562+0000","last_active":"2024-09-17T03:37:28.537191+0000","last_peered":"2024-09-17T03:37:28.537191+0000","last_clean":"2024-09-17T03:37:28.537191+0000","last_became_active":"2024-09-17T03:37:27.549955+0000","last_became_peered":"2024-09-17T03:37:27.549955+0000","last_unstale":"2024-09-17T03:37:28.537191+0000","last_undegraded":"2024-09-17T03:37:28.537191+0000","last_fullsized":"2024-09-17T03:37:28.537191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:51.664727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921247+0000","last_change":"2024-09-17T03:37:27.533198+0000","last_active":"2024-09-17T03:37:28.921247+0000","last_peered":"2024-09-17T03:37:28.921247+0000","last_clean":"2024-09-17T03:37:28.921247+0000","last_became_active":"2024-09-17T03:37:27.532590+0000","last_became_peered":"2024-09-17T03:37:27.532590+0000","last_unstale":"2024-09-17T03:37:28.921247+0000","last_undegraded":"2024-09-17T03:37:28.921247+0000","last_fullsized":"2024-09-17T03:37:28.921247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:20.412484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972523+0000","last_change":"2024-09-17T03:37:27.557044+0000","last_active":"2024-09-17T03:37:28.972523+0000","last_peered":"2024-09-17T03:37:28.972523+0000","last_clean":"2024-09-17T03:37:28.972523+0000","last_became_active":"2024-09-17T03:37:27.552478+0000","last_became_peered":"2024-09-17T03:37:27.552478+0000","last_unstale":"2024-09-17T03:37:28.972523+0000","last_undegraded":"2024-09-17T03:37:28.972523+0000","last_fullsized":"2024-09-17T03:37:28.972523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:45.217306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973243+0000","last_change":"2024-09-17T03:37:26.531549+0000","last_active":"2024-09-17T03:37:28.973243+0000","last_peered":"2024-09-17T03:37:28.973243+0000","last_clean":"2024-09-17T03:37:28.973243+0000","last_became_active":"2024-09-17T03:37:26.531217+0000","last_became_peered":"2024-09-17T03:37:26.531217+0000","last_unstale":"2024-09-17T03:37:28.973243+0000","last_undegraded":"2024-09-17T03:37:28.973243+0000","last_fullsized":"2024-09-17T03:37:28.973243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:24.181754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972545+0000","last_change":"2024-09-17T03:37:27.543948+0000","last_active":"2024-09-17T03:37:28.972545+0000","last_peered":"2024-09-17T03:37:28.972545+0000","last_clean":"2024-09-17T03:37:28.972545+0000","last_became_active":"2024-09-17T03:37:27.543659+0000","last_became_peered":"2024-09-17T03:37:27.543659+0000","last_unstale":"2024-09-17T03:37:28.972545+0000","last_undegraded":"2024-09-17T03:37:28.972545+0000","last_fullsized":"2024-09-17T03:37:28.972545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:14.055525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537553+0000","last_change":"2024-09-17T03:37:26.536702+0000","last_active":"2024-09-17T03:37:28.537553+0000","last_peered":"2024-09-17T03:37:28.537553+0000","last_clean":"2024-09-17T03:37:28.537553+0000","last_became_active":"2024-09-17T03:37:26.536412+0000","last_became_peered":"2024-09-17T03:37:26.536412+0000","last_unstale":"2024-09-17T03:37:28.537553+0000","last_undegraded":"2024-09-17T03:37:28.537553+0000","last_fullsized":"2024-09-17T03:37:28.537553+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:36.017576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972792+0000","last_change":"2024-09-17T03:37:27.551893+0000","last_active":"2024-09-17T03:37:28.972792+0000","last_peered":"2024-09-17T03:37:28.972792+0000","last_clean":"2024-09-17T03:37:28.972792+0000","last_became_active":"2024-09-17T03:37:27.551602+0000","last_became_peered":"2024-09-17T03:37:27.551602+0000","last_unstale":"2024-09-17T03:37:28.972792+0000","last_undegraded":"2024-09-17T03:37:28.972792+0000","last_fullsized":"2024-09-17T03:37:28.972792+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:57.278615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972464+0000","last_change":"2024-09-17T03:37:26.532271+0000","last_active":"2024-09-17T03:37:28.972464+0000","last_peered":"2024-09-17T03:37:28.972464+0000","last_clean":"2024-09-17T03:37:28.972464+0000","last_became_active":"2024-09-17T03:37:26.531921+0000","last_became_peered":"2024-09-17T03:37:26.531921+0000","last_unstale":"2024-09-17T03:37:28.972464+0000","last_undegraded":"2024-09-17T03:37:28.972464+0000","last_fullsized":"2024-09-17T03:37:28.972464+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:52.144731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972070+0000","last_change":"2024-09-17T03:37:27.553058+0000","last_active":"2024-09-17T03:37:28.972070+0000","last_peered":"2024-09-17T03:37:28.972070+0000","last_clean":"2024-09-17T03:37:28.972070+0000","last_became_active":"2024-09-17T03:37:27.550890+0000","last_became_peered":"2024-09-17T03:37:27.550890+0000","last_unstale":"2024-09-17T03:37:28.972070+0000","last_undegraded":"2024-09-17T03:37:28.972070+0000","last_fullsized":"2024-09-17T03:37:28.972070+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:21.682676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921722+0000","last_change":"2024-09-17T03:37:26.531629+0000","last_active":"2024-09-17T03:37:28.921722+0000","last_peered":"2024-09-17T03:37:28.921722+0000","last_clean":"2024-09-17T03:37:28.921722+0000","last_became_active":"2024-09-17T03:37:26.529987+0000","last_became_peered":"2024-09-17T03:37:26.529987+0000","last_unstale":"2024-09-17T03:37:28.921722+0000","last_undegraded":"2024-09-17T03:37:28.921722+0000","last_fullsized":"2024-09-17T03:37:28.921722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:16.827468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973143+0000","last_change":"2024-09-17T03:37:27.550210+0000","last_active":"2024-09-17T03:37:28.973143+0000","last_peered":"2024-09-17T03:37:28.973143+0000","last_clean":"2024-09-17T03:37:28.973143+0000","last_became_active":"2024-09-17T03:37:27.548300+0000","last_became_peered":"2024-09-17T03:37:27.548300+0000","last_unstale":"2024-09-17T03:37:28.973143+0000","last_undegraded":"2024-09-17T03:37:28.973143+0000","last_fullsized":"2024-09-17T03:37:28.973143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:40.031431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538407+0000","last_change":"2024-09-17T03:37:26.528848+0000","last_active":"2024-09-17T03:37:28.538407+0000","last_peered":"2024-09-17T03:37:28.538407+0000","last_clean":"2024-09-17T03:37:28.538407+0000","last_became_active":"2024-09-17T03:37:26.528533+0000","last_became_peered":"2024-09-17T03:37:26.528533+0000","last_unstale":"2024-09-17T03:37:28.538407+0000","last_undegraded":"2024-09-17T03:37:28.538407+0000","last_fullsized":"2024-09-17T03:37:28.538407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:02.179951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973031+0000","last_change":"2024-09-17T03:37:27.538085+0000","last_active":"2024-09-17T03:37:28.973031+0000","last_peered":"2024-09-17T03:37:28.973031+0000","last_clean":"2024-09-17T03:37:28.973031+0000","last_became_active":"2024-09-17T03:37:27.537802+0000","last_became_peered":"2024-09-17T03:37:27.537802+0000","last_unstale":"2024-09-17T03:37:28.973031+0000","last_undegraded":"2024-09-17T03:37:28.973031+0000","last_fullsized":"2024-09-17T03:37:28.973031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:46.545182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973089+0000","last_change":"2024-09-17T03:37:26.520225+0000","last_active":"2024-09-17T03:37:28.973089+0000","last_peered":"2024-09-17T03:37:28.973089+0000","last_clean":"2024-09-17T03:37:28.973089+0000","last_became_active":"2024-09-17T03:37:26.519923+0000","last_became_peered":"2024-09-17T03:37:26.519923+0000","last_unstale":"2024-09-17T03:37:28.973089+0000","last_undegraded":"2024-09-17T03:37:28.973089+0000","last_fullsized":"2024-09-17T03:37:28.973089+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:27.401642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972651+0000","last_change":"2024-09-17T03:37:27.552395+0000","last_active":"2024-09-17T03:37:28.972651+0000","last_peered":"2024-09-17T03:37:28.972651+0000","last_clean":"2024-09-17T03:37:28.972651+0000","last_became_active":"2024-09-17T03:37:27.551648+0000","last_became_peered":"2024-09-17T03:37:27.551648+0000","last_unstale":"2024-09-17T03:37:28.972651+0000","last_undegraded":"2024-09-17T03:37:28.972651+0000","last_fullsized":"2024-09-17T03:37:28.972651+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:29.942300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972453+0000","last_change":"2024-09-17T03:37:26.522976+0000","last_active":"2024-09-17T03:37:28.972453+0000","last_peered":"2024-09-17T03:37:28.972453+0000","last_clean":"2024-09-17T03:37:28.972453+0000","last_became_active":"2024-09-17T03:37:26.522640+0000","last_became_peered":"2024-09-17T03:37:26.522640+0000","last_unstale":"2024-09-17T03:37:28.972453+0000","last_undegraded":"2024-09-17T03:37:28.972453+0000","last_fullsized":"2024-09-17T03:37:28.972453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:34.420408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972553+0000","last_change":"2024-09-17T03:37:27.541597+0000","last_active":"2024-09-17T03:37:28.972553+0000","last_peered":"2024-09-17T03:37:28.972553+0000","last_clean":"2024-09-17T03:37:28.972553+0000","last_became_active":"2024-09-17T03:37:27.541315+0000","last_became_peered":"2024-09-17T03:37:27.541315+0000","last_unstale":"2024-09-17T03:37:28.972553+0000","last_undegraded":"2024-09-17T03:37:28.972553+0000","last_fullsized":"2024-09-17T03:37:28.972553+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535717+0000","last_change":"2024-09-17T03:37:26.528801+0000","last_active":"2024-09-17T03:37:28.535717+0000","last_peered":"2024-09-17T03:37:28.535717+0000","last_clean":"2024-09-17T03:37:28.535717+0000","last_became_active":"2024-09-17T03:37:26.527544+0000","last_became_peered":"2024-09-17T03:37:26.527544+0000","last_unstale":"2024-09-17T03:37:28.535717+0000","last_undegraded":"2024-09-17T03:37:28.535717+0000","last_fullsized":"2024-09-17T03:37:28.535717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:08.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972162+0000","last_change":"2024-09-17T03:37:27.555015+0000","last_active":"2024-09-17T03:37:28.972162+0000","last_peered":"2024-09-17T03:37:28.972162+0000","last_clean":"2024-09-17T03:37:28.972162+0000","last_became_active":"2024-09-17T03:37:27.554722+0000","last_became_peered":"2024-09-17T03:37:27.554722+0000","last_unstale":"2024-09-17T03:37:28.972162+0000","last_undegraded":"2024-09-17T03:37:28.972162+0000","last_fullsized":"2024-09-17T03:37:28.972162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:29.825087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972627+0000","last_change":"2024-09-17T03:37:26.531272+0000","last_active":"2024-09-17T03:37:28.972627+0000","last_peered":"2024-09-17T03:37:28.972627+0000","last_clean":"2024-09-17T03:37:28.972627+0000","last_became_active":"2024-09-17T03:37:26.530970+0000","last_became_peered":"2024-09-17T03:37:26.530970+0000","last_unstale":"2024-09-17T03:37:28.972627+0000","last_undegraded":"2024-09-17T03:37:28.972627+0000","last_fullsized":"2024-09-17T03:37:28.972627+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:02.686244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972225+0000","last_change":"2024-09-17T03:37:27.543452+0000","last_active":"2024-09-17T03:37:28.972225+0000","last_peered":"2024-09-17T03:37:28.972225+0000","last_clean":"2024-09-17T03:37:28.972225+0000","last_became_active":"2024-09-17T03:37:27.543130+0000","last_became_peered":"2024-09-17T03:37:27.543130+0000","last_unstale":"2024-09-17T03:37:28.972225+0000","last_undegraded":"2024-09-17T03:37:28.972225+0000","last_fullsized":"2024-09-17T03:37:28.972225+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972185+0000","last_change":"2024-09-17T03:37:26.526110+0000","last_active":"2024-09-17T03:37:28.972185+0000","last_peered":"2024-09-17T03:37:28.972185+0000","last_clean":"2024-09-17T03:37:28.972185+0000","last_became_active":"2024-09-17T03:37:26.525393+0000","last_became_peered":"2024-09-17T03:37:26.525393+0000","last_unstale":"2024-09-17T03:37:28.972185+0000","last_undegraded":"2024-09-17T03:37:28.972185+0000","last_fullsized":"2024-09-17T03:37:28.972185+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:59.076040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536897+0000","last_change":"2024-09-17T03:37:27.535178+0000","last_active":"2024-09-17T03:37:28.536897+0000","last_peered":"2024-09-17T03:37:28.536897+0000","last_clean":"2024-09-17T03:37:28.536897+0000","last_became_active":"2024-09-17T03:37:27.534768+0000","last_became_peered":"2024-09-17T03:37:27.534768+0000","last_unstale":"2024-09-17T03:37:28.536897+0000","last_undegraded":"2024-09-17T03:37:28.536897+0000","last_fullsized":"2024-09-17T03:37:28.536897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:57.588193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973091+0000","last_change":"2024-09-17T03:37:26.527185+0000","last_active":"2024-09-17T03:37:28.973091+0000","last_peered":"2024-09-17T03:37:28.973091+0000","last_clean":"2024-09-17T03:37:28.973091+0000","last_became_active":"2024-09-17T03:37:26.526936+0000","last_became_peered":"2024-09-17T03:37:26.526936+0000","last_unstale":"2024-09-17T03:37:28.973091+0000","last_undegraded":"2024-09-17T03:37:28.973091+0000","last_fullsized":"2024-09-17T03:37:28.973091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:37.973137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921633+0000","last_change":"2024-09-17T03:37:27.545218+0000","last_active":"2024-09-17T03:37:28.921633+0000","last_peered":"2024-09-17T03:37:28.921633+0000","last_clean":"2024-09-17T03:37:28.921633+0000","last_became_active":"2024-09-17T03:37:27.544912+0000","last_became_peered":"2024-09-17T03:37:27.544912+0000","last_unstale":"2024-09-17T03:37:28.921633+0000","last_undegraded":"2024-09-17T03:37:28.921633+0000","last_fullsized":"2024-09-17T03:37:28.921633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972382+0000","last_change":"2024-09-17T03:37:26.534022+0000","last_active":"2024-09-17T03:37:28.972382+0000","last_peered":"2024-09-17T03:37:28.972382+0000","last_clean":"2024-09-17T03:37:28.972382+0000","last_became_active":"2024-09-17T03:37:26.533717+0000","last_became_peered":"2024-09-17T03:37:26.533717+0000","last_unstale":"2024-09-17T03:37:28.972382+0000","last_undegraded":"2024-09-17T03:37:28.972382+0000","last_fullsized":"2024-09-17T03:37:28.972382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:49.735686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972915+0000","last_change":"2024-09-17T03:37:27.542974+0000","last_active":"2024-09-17T03:37:28.972915+0000","last_peered":"2024-09-17T03:37:28.972915+0000","last_clean":"2024-09-17T03:37:28.972915+0000","last_became_active":"2024-09-17T03:37:27.542632+0000","last_became_peered":"2024-09-17T03:37:27.542632+0000","last_unstale":"2024-09-17T03:37:28.972915+0000","last_undegraded":"2024-09-17T03:37:28.972915+0000","last_fullsized":"2024-09-17T03:37:28.972915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:11.137194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537602+0000","last_change":"2024-09-17T03:37:26.535866+0000","last_active":"2024-09-17T03:37:28.537602+0000","last_peered":"2024-09-17T03:37:28.537602+0000","last_clean":"2024-09-17T03:37:28.537602+0000","last_became_active":"2024-09-17T03:37:26.535582+0000","last_became_peered":"2024-09-17T03:37:26.535582+0000","last_unstale":"2024-09-17T03:37:28.537602+0000","last_undegraded":"2024-09-17T03:37:28.537602+0000","last_fullsized":"2024-09-17T03:37:28.537602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.509896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536716+0000","last_change":"2024-09-17T03:37:27.541751+0000","last_active":"2024-09-17T03:37:28.536716+0000","last_peered":"2024-09-17T03:37:28.536716+0000","last_clean":"2024-09-17T03:37:28.536716+0000","last_became_active":"2024-09-17T03:37:27.541468+0000","last_became_peered":"2024-09-17T03:37:27.541468+0000","last_unstale":"2024-09-17T03:37:28.536716+0000","last_undegraded":"2024-09-17T03:37:28.536716+0000","last_fullsized":"2024-09-17T03:37:28.536716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:53.887378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971617+0000","last_change":"2024-09-17T03:37:26.527348+0000","last_active":"2024-09-17T03:37:28.971617+0000","last_peered":"2024-09-17T03:37:28.971617+0000","last_clean":"2024-09-17T03:37:28.971617+0000","last_became_active":"2024-09-17T03:37:26.527018+0000","last_became_peered":"2024-09-17T03:37:26.527018+0000","last_unstale":"2024-09-17T03:37:28.971617+0000","last_undegraded":"2024-09-17T03:37:28.971617+0000","last_fullsized":"2024-09-17T03:37:28.971617+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:34.905982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537921+0000","last_change":"2024-09-17T03:37:27.555528+0000","last_active":"2024-09-17T03:37:28.537921+0000","last_peered":"2024-09-17T03:37:28.537921+0000","last_clean":"2024-09-17T03:37:28.537921+0000","last_became_active":"2024-09-17T03:37:27.555178+0000","last_became_peered":"2024-09-17T03:37:27.555178+0000","last_unstale":"2024-09-17T03:37:28.537921+0000","last_undegraded":"2024-09-17T03:37:28.537921+0000","last_fullsized":"2024-09-17T03:37:28.537921+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921173+0000","last_change":"2024-09-17T03:37:26.531987+0000","last_active":"2024-09-17T03:37:28.921173+0000","last_peered":"2024-09-17T03:37:28.921173+0000","last_clean":"2024-09-17T03:37:28.921173+0000","last_became_active":"2024-09-17T03:37:26.531667+0000","last_became_peered":"2024-09-17T03:37:26.531667+0000","last_unstale":"2024-09-17T03:37:28.921173+0000","last_undegraded":"2024-09-17T03:37:28.921173+0000","last_fullsized":"2024-09-17T03:37:28.921173+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:38.767501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.539039+0000","last_change":"2024-09-17T03:37:27.545316+0000","last_active":"2024-09-17T03:37:28.539039+0000","last_peered":"2024-09-17T03:37:28.539039+0000","last_clean":"2024-09-17T03:37:28.539039+0000","last_became_active":"2024-09-17T03:37:27.544131+0000","last_became_peered":"2024-09-17T03:37:27.544131+0000","last_unstale":"2024-09-17T03:37:28.539039+0000","last_undegraded":"2024-09-17T03:37:28.539039+0000","last_fullsized":"2024-09-17T03:37:28.539039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:58.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535515+0000","last_change":"2024-09-17T03:37:26.534154+0000","last_active":"2024-09-17T03:37:28.535515+0000","last_peered":"2024-09-17T03:37:28.535515+0000","last_clean":"2024-09-17T03:37:28.535515+0000","last_became_active":"2024-09-17T03:37:26.533854+0000","last_became_peered":"2024-09-17T03:37:26.533854+0000","last_unstale":"2024-09-17T03:37:28.535515+0000","last_undegraded":"2024-09-17T03:37:28.535515+0000","last_fullsized":"2024-09-17T03:37:28.535515+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:04.512041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971915+0000","last_change":"2024-09-17T03:37:27.549196+0000","last_active":"2024-09-17T03:37:28.971915+0000","last_peered":"2024-09-17T03:37:28.971915+0000","last_clean":"2024-09-17T03:37:28.971915+0000","last_became_active":"2024-09-17T03:37:27.548755+0000","last_became_peered":"2024-09-17T03:37:27.548755+0000","last_unstale":"2024-09-17T03:37:28.971915+0000","last_undegraded":"2024-09-17T03:37:28.971915+0000","last_fullsized":"2024-09-17T03:37:28.971915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538013+0000","last_change":"2024-09-17T03:37:26.536699+0000","last_active":"2024-09-17T03:37:28.538013+0000","last_peered":"2024-09-17T03:37:28.538013+0000","last_clean":"2024-09-17T03:37:28.538013+0000","last_became_active":"2024-09-17T03:37:26.536400+0000","last_became_peered":"2024-09-17T03:37:26.536400+0000","last_unstale":"2024-09-17T03:37:28.538013+0000","last_undegraded":"2024-09-17T03:37:28.538013+0000","last_fullsized":"2024-09-17T03:37:28.538013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:34.905982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535962+0000","last_change":"2024-09-17T03:37:27.545948+0000","last_active":"2024-09-17T03:37:28.535962+0000","last_peered":"2024-09-17T03:37:28.535962+0000","last_clean":"2024-09-17T03:37:28.535962+0000","last_became_active":"2024-09-17T03:37:27.544335+0000","last_became_peered":"2024-09-17T03:37:27.544335+0000","last_unstale":"2024-09-17T03:37:28.535962+0000","last_undegraded":"2024-09-17T03:37:28.535962+0000","last_fullsized":"2024-09-17T03:37:28.535962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:20.292074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537978+0000","last_change":"2024-09-17T03:37:26.532545+0000","last_active":"2024-09-17T03:37:28.537978+0000","last_peered":"2024-09-17T03:37:28.537978+0000","last_clean":"2024-09-17T03:37:28.537978+0000","last_became_active":"2024-09-17T03:37:26.532034+0000","last_became_peered":"2024-09-17T03:37:26.532034+0000","last_unstale":"2024-09-17T03:37:28.537978+0000","last_undegraded":"2024-09-17T03:37:28.537978+0000","last_fullsized":"2024-09-17T03:37:28.537978+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.682503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921360+0000","last_change":"2024-09-17T03:37:27.540180+0000","last_active":"2024-09-17T03:37:28.921360+0000","last_peered":"2024-09-17T03:37:28.921360+0000","last_clean":"2024-09-17T03:37:28.921360+0000","last_became_active":"2024-09-17T03:37:27.536635+0000","last_became_peered":"2024-09-17T03:37:27.536635+0000","last_unstale":"2024-09-17T03:37:28.921360+0000","last_undegraded":"2024-09-17T03:37:28.921360+0000","last_fullsized":"2024-09-17T03:37:28.921360+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:27.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972108+0000","last_change":"2024-09-17T03:37:26.530302+0000","last_active":"2024-09-17T03:37:28.972108+0000","last_peered":"2024-09-17T03:37:28.972108+0000","last_clean":"2024-09-17T03:37:28.972108+0000","last_became_active":"2024-09-17T03:37:26.530025+0000","last_became_peered":"2024-09-17T03:37:26.530025+0000","last_unstale":"2024-09-17T03:37:28.972108+0000","last_undegraded":"2024-09-17T03:37:28.972108+0000","last_fullsized":"2024-09-17T03:37:28.972108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:58.756354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536787+0000","last_change":"2024-09-17T03:37:27.539162+0000","last_active":"2024-09-17T03:37:28.536787+0000","last_peered":"2024-09-17T03:37:28.536787+0000","last_clean":"2024-09-17T03:37:28.536787+0000","last_became_active":"2024-09-17T03:37:27.538843+0000","last_became_peered":"2024-09-17T03:37:27.538843+0000","last_unstale":"2024-09-17T03:37:28.536787+0000","last_undegraded":"2024-09-17T03:37:28.536787+0000","last_fullsized":"2024-09-17T03:37:28.536787+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:20.412484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921850+0000","last_change":"2024-09-17T03:37:26.536689+0000","last_active":"2024-09-17T03:37:28.921850+0000","last_peered":"2024-09-17T03:37:28.921850+0000","last_clean":"2024-09-17T03:37:28.921850+0000","last_became_active":"2024-09-17T03:37:26.536406+0000","last_became_peered":"2024-09-17T03:37:26.536406+0000","last_unstale":"2024-09-17T03:37:28.921850+0000","last_undegraded":"2024-09-17T03:37:28.921850+0000","last_fullsized":"2024-09-17T03:37:28.921850+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:59.807710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921852+0000","last_change":"2024-09-17T03:37:27.546981+0000","last_active":"2024-09-17T03:37:28.921852+0000","last_peered":"2024-09-17T03:37:28.921852+0000","last_clean":"2024-09-17T03:37:28.921852+0000","last_became_active":"2024-09-17T03:37:27.546676+0000","last_became_peered":"2024-09-17T03:37:27.546676+0000","last_unstale":"2024-09-17T03:37:28.921852+0000","last_undegraded":"2024-09-17T03:37:28.921852+0000","last_fullsized":"2024-09-17T03:37:28.921852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:21.682676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536042+0000","last_change":"2024-09-17T03:37:26.531962+0000","last_active":"2024-09-17T03:37:28.536042+0000","last_peered":"2024-09-17T03:37:28.536042+0000","last_clean":"2024-09-17T03:37:28.536042+0000","last_became_active":"2024-09-17T03:37:26.531665+0000","last_became_peered":"2024-09-17T03:37:26.531665+0000","last_unstale":"2024-09-17T03:37:28.536042+0000","last_undegraded":"2024-09-17T03:37:28.536042+0000","last_fullsized":"2024-09-17T03:37:28.536042+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:20.863280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972031+0000","last_change":"2024-09-17T03:37:27.548909+0000","last_active":"2024-09-17T03:37:28.972031+0000","last_peered":"2024-09-17T03:37:28.972031+0000","last_clean":"2024-09-17T03:37:28.972031+0000","last_became_active":"2024-09-17T03:37:27.543481+0000","last_became_peered":"2024-09-17T03:37:27.543481+0000","last_unstale":"2024-09-17T03:37:28.972031+0000","last_undegraded":"2024-09-17T03:37:28.972031+0000","last_fullsized":"2024-09-17T03:37:28.972031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537219+0000","last_change":"2024-09-17T03:37:26.531193+0000","last_active":"2024-09-17T03:37:28.537219+0000","last_peered":"2024-09-17T03:37:28.537219+0000","last_clean":"2024-09-17T03:37:28.537219+0000","last_became_active":"2024-09-17T03:37:26.529872+0000","last_became_peered":"2024-09-17T03:37:26.529872+0000","last_unstale":"2024-09-17T03:37:28.537219+0000","last_undegraded":"2024-09-17T03:37:28.537219+0000","last_fullsized":"2024-09-17T03:37:28.537219+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:13.560768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535922+0000","last_change":"2024-09-17T03:37:27.534498+0000","last_active":"2024-09-17T03:37:28.535922+0000","last_peered":"2024-09-17T03:37:28.535922+0000","last_clean":"2024-09-17T03:37:28.535922+0000","last_became_active":"2024-09-17T03:37:27.534156+0000","last_became_peered":"2024-09-17T03:37:27.534156+0000","last_unstale":"2024-09-17T03:37:28.535922+0000","last_undegraded":"2024-09-17T03:37:28.535922+0000","last_fullsized":"2024-09-17T03:37:28.535922+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:40.031431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971932+0000","last_change":"2024-09-17T03:37:26.528782+0000","last_active":"2024-09-17T03:37:28.971932+0000","last_peered":"2024-09-17T03:37:28.971932+0000","last_clean":"2024-09-17T03:37:28.971932+0000","last_became_active":"2024-09-17T03:37:26.528187+0000","last_became_peered":"2024-09-17T03:37:26.528187+0000","last_unstale":"2024-09-17T03:37:28.971932+0000","last_undegraded":"2024-09-17T03:37:28.971932+0000","last_fullsized":"2024-09-17T03:37:28.971932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:57.698060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537927+0000","last_change":"2024-09-17T03:37:27.555855+0000","last_active":"2024-09-17T03:37:28.537927+0000","last_peered":"2024-09-17T03:37:28.537927+0000","last_clean":"2024-09-17T03:37:28.537927+0000","last_became_active":"2024-09-17T03:37:27.555564+0000","last_became_peered":"2024-09-17T03:37:27.555564+0000","last_unstale":"2024-09-17T03:37:28.537927+0000","last_undegraded":"2024-09-17T03:37:28.537927+0000","last_fullsized":"2024-09-17T03:37:28.537927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:13.789016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971883+0000","last_change":"2024-09-17T03:37:26.530376+0000","last_active":"2024-09-17T03:37:28.971883+0000","last_peered":"2024-09-17T03:37:28.971883+0000","last_clean":"2024-09-17T03:37:28.971883+0000","last_became_active":"2024-09-17T03:37:26.526932+0000","last_became_peered":"2024-09-17T03:37:26.526932+0000","last_unstale":"2024-09-17T03:37:28.971883+0000","last_undegraded":"2024-09-17T03:37:28.971883+0000","last_fullsized":"2024-09-17T03:37:28.971883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:56.339214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971888+0000","last_change":"2024-09-17T03:37:27.539745+0000","last_active":"2024-09-17T03:37:28.971888+0000","last_peered":"2024-09-17T03:37:28.971888+0000","last_clean":"2024-09-17T03:37:28.971888+0000","last_became_active":"2024-09-17T03:37:27.539434+0000","last_became_peered":"2024-09-17T03:37:27.539434+0000","last_unstale":"2024-09-17T03:37:28.971888+0000","last_undegraded":"2024-09-17T03:37:28.971888+0000","last_fullsized":"2024-09-17T03:37:28.971888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:49.519749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973003+0000","last_change":"2024-09-17T03:37:26.523031+0000","last_active":"2024-09-17T03:37:28.973003+0000","last_peered":"2024-09-17T03:37:28.973003+0000","last_clean":"2024-09-17T03:37:28.973003+0000","last_became_active":"2024-09-17T03:37:26.522699+0000","last_became_peered":"2024-09-17T03:37:26.522699+0000","last_unstale":"2024-09-17T03:37:28.973003+0000","last_undegraded":"2024-09-17T03:37:28.973003+0000","last_fullsized":"2024-09-17T03:37:28.973003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:45.288058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972050+0000","last_change":"2024-09-17T03:37:27.552225+0000","last_active":"2024-09-17T03:37:28.972050+0000","last_peered":"2024-09-17T03:37:28.972050+0000","last_clean":"2024-09-17T03:37:28.972050+0000","last_became_active":"2024-09-17T03:37:27.550676+0000","last_became_peered":"2024-09-17T03:37:27.550676+0000","last_unstale":"2024-09-17T03:37:28.972050+0000","last_undegraded":"2024-09-17T03:37:28.972050+0000","last_fullsized":"2024-09-17T03:37:28.972050+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:56.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973217+0000","last_change":"2024-09-17T03:37:26.525668+0000","last_active":"2024-09-17T03:37:28.973217+0000","last_peered":"2024-09-17T03:37:28.973217+0000","last_clean":"2024-09-17T03:37:28.973217+0000","last_became_active":"2024-09-17T03:37:26.525388+0000","last_became_peered":"2024-09-17T03:37:26.525388+0000","last_unstale":"2024-09-17T03:37:28.973217+0000","last_undegraded":"2024-09-17T03:37:28.973217+0000","last_fullsized":"2024-09-17T03:37:28.973217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:14.255452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538349+0000","last_change":"2024-09-17T03:37:27.546413+0000","last_active":"2024-09-17T03:37:28.538349+0000","last_peered":"2024-09-17T03:37:28.538349+0000","last_clean":"2024-09-17T03:37:28.538349+0000","last_became_active":"2024-09-17T03:37:27.546090+0000","last_became_peered":"2024-09-17T03:37:27.546090+0000","last_unstale":"2024-09-17T03:37:28.538349+0000","last_undegraded":"2024-09-17T03:37:28.538349+0000","last_fullsized":"2024-09-17T03:37:28.538349+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:13.556511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538419+0000","last_change":"2024-09-17T03:37:26.527912+0000","last_active":"2024-09-17T03:37:28.538419+0000","last_peered":"2024-09-17T03:37:28.538419+0000","last_clean":"2024-09-17T03:37:28.538419+0000","last_became_active":"2024-09-17T03:37:26.527563+0000","last_became_peered":"2024-09-17T03:37:26.527563+0000","last_unstale":"2024-09-17T03:37:28.538419+0000","last_undegraded":"2024-09-17T03:37:28.538419+0000","last_fullsized":"2024-09-17T03:37:28.538419+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:55.494026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972538+0000","last_change":"2024-09-17T03:37:27.551533+0000","last_active":"2024-09-17T03:37:28.972538+0000","last_peered":"2024-09-17T03:37:28.972538+0000","last_clean":"2024-09-17T03:37:28.972538+0000","last_became_active":"2024-09-17T03:37:27.551145+0000","last_became_peered":"2024-09-17T03:37:27.551145+0000","last_unstale":"2024-09-17T03:37:28.972538+0000","last_undegraded":"2024-09-17T03:37:28.972538+0000","last_fullsized":"2024-09-17T03:37:28.972538+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:33.345886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972160+0000","last_change":"2024-09-17T03:37:26.535010+0000","last_active":"2024-09-17T03:37:28.972160+0000","last_peered":"2024-09-17T03:37:28.972160+0000","last_clean":"2024-09-17T03:37:28.972160+0000","last_became_active":"2024-09-17T03:37:26.534652+0000","last_became_peered":"2024-09-17T03:37:26.534652+0000","last_unstale":"2024-09-17T03:37:28.972160+0000","last_undegraded":"2024-09-17T03:37:28.972160+0000","last_fullsized":"2024-09-17T03:37:28.972160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:11.615940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921823+0000","last_change":"2024-09-17T03:37:27.537360+0000","last_active":"2024-09-17T03:37:28.921823+0000","last_peered":"2024-09-17T03:37:28.921823+0000","last_clean":"2024-09-17T03:37:28.921823+0000","last_became_active":"2024-09-17T03:37:27.536792+0000","last_became_peered":"2024-09-17T03:37:27.536792+0000","last_unstale":"2024-09-17T03:37:28.921823+0000","last_undegraded":"2024-09-17T03:37:28.921823+0000","last_fullsized":"2024-09-17T03:37:28.921823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:56.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537357+0000","last_change":"2024-09-17T03:37:26.529448+0000","last_active":"2024-09-17T03:37:28.537357+0000","last_peered":"2024-09-17T03:37:28.537357+0000","last_clean":"2024-09-17T03:37:28.537357+0000","last_became_active":"2024-09-17T03:37:26.529137+0000","last_became_peered":"2024-09-17T03:37:26.529137+0000","last_unstale":"2024-09-17T03:37:28.537357+0000","last_undegraded":"2024-09-17T03:37:28.537357+0000","last_fullsized":"2024-09-17T03:37:28.537357+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:52.570921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972784+0000","last_change":"2024-09-17T03:37:27.551975+0000","last_active":"2024-09-17T03:37:28.972784+0000","last_peered":"2024-09-17T03:37:28.972784+0000","last_clean":"2024-09-17T03:37:28.972784+0000","last_became_active":"2024-09-17T03:37:27.551180+0000","last_became_peered":"2024-09-17T03:37:27.551180+0000","last_unstale":"2024-09-17T03:37:28.972784+0000","last_undegraded":"2024-09-17T03:37:28.972784+0000","last_fullsized":"2024-09-17T03:37:28.972784+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:51.856214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921248+0000","last_change":"2024-09-17T03:37:26.525209+0000","last_active":"2024-09-17T03:37:28.921248+0000","last_peered":"2024-09-17T03:37:28.921248+0000","last_clean":"2024-09-17T03:37:28.921248+0000","last_became_active":"2024-09-17T03:37:26.524908+0000","last_became_peered":"2024-09-17T03:37:26.524908+0000","last_unstale":"2024-09-17T03:37:28.921248+0000","last_undegraded":"2024-09-17T03:37:28.921248+0000","last_fullsized":"2024-09-17T03:37:28.921248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:04.960327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537907+0000","last_change":"2024-09-17T03:37:27.551523+0000","last_active":"2024-09-17T03:37:28.537907+0000","last_peered":"2024-09-17T03:37:28.537907+0000","last_clean":"2024-09-17T03:37:28.537907+0000","last_became_active":"2024-09-17T03:37:27.549402+0000","last_became_peered":"2024-09-17T03:37:27.549402+0000","last_unstale":"2024-09-17T03:37:28.537907+0000","last_undegraded":"2024-09-17T03:37:28.537907+0000","last_fullsized":"2024-09-17T03:37:28.537907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971532+0000","last_change":"2024-09-17T03:37:26.521825+0000","last_active":"2024-09-17T03:37:28.971532+0000","last_peered":"2024-09-17T03:37:28.971532+0000","last_clean":"2024-09-17T03:37:28.971532+0000","last_became_active":"2024-09-17T03:37:26.520727+0000","last_became_peered":"2024-09-17T03:37:26.520727+0000","last_unstale":"2024-09-17T03:37:28.971532+0000","last_undegraded":"2024-09-17T03:37:28.971532+0000","last_fullsized":"2024-09-17T03:37:28.971532+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.682503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972667+0000","last_change":"2024-09-17T03:37:27.542593+0000","last_active":"2024-09-17T03:37:28.972667+0000","last_peered":"2024-09-17T03:37:28.972667+0000","last_clean":"2024-09-17T03:37:28.972667+0000","last_became_active":"2024-09-17T03:37:27.542312+0000","last_became_peered":"2024-09-17T03:37:27.542312+0000","last_unstale":"2024-09-17T03:37:28.972667+0000","last_undegraded":"2024-09-17T03:37:28.972667+0000","last_fullsized":"2024-09-17T03:37:28.972667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:00.543429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972743+0000","last_change":"2024-09-17T03:37:26.531805+0000","last_active":"2024-09-17T03:37:28.972743+0000","last_peered":"2024-09-17T03:37:28.972743+0000","last_clean":"2024-09-17T03:37:28.972743+0000","last_became_active":"2024-09-17T03:37:26.531514+0000","last_became_peered":"2024-09-17T03:37:26.531514+0000","last_unstale":"2024-09-17T03:37:28.972743+0000","last_undegraded":"2024-09-17T03:37:28.972743+0000","last_fullsized":"2024-09-17T03:37:28.972743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:12.294261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":169,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971655+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:37:28.971655+0000","last_peered":"2024-09-17T03:37:28.971655+0000","last_clean":"2024-09-17T03:37:28.971655+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:37:28.971655+0000","last_undegraded":"2024-09-17T03:37:28.971655+0000","last_fullsized":"2024-09-17T03:37:28.971655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":618496,"data_stored":268298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1220608,"data_stored":860312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1208320,"data_stored":858680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":630784,"data_stored":269946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:36.941 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:37.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.172+0000 7f58f2e00640 1 -- 172.21.15.121:0/925308725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58ec06e160 msgr2=0x7f58ec06e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:37.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.172+0000 7f58f2e00640 1 --2- 172.21.15.121:0/925308725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58ec06e160 0x7f58ec06e570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009830 tx=0x7f58d802a410 comp rx=0 tx=0).stop 2024-09-17T03:37:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.172+0000 7f58f2e00640 1 -- 172.21.15.121:0/925308725 shutdown_connections 2024-09-17T03:37:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.172+0000 7f58f2e00640 1 --2- 172.21.15.121:0/925308725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58ec0cc8d0 0x7f58ec0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.172+0000 7f58f2e00640 1 --2- 172.21.15.121:0/925308725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58ec06e160 0x7f58ec06e570 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.172+0000 7f58f2e00640 1 -- 172.21.15.121:0/925308725 >> 172.21.15.121:0/925308725 conn(0x7f58ec06f940 msgr2=0x7f58ec0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.173+0000 7f58f2e00640 1 -- 172.21.15.121:0/925308725 shutdown_connections 2024-09-17T03:37:37.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.173+0000 7f58f2e00640 1 -- 172.21.15.121:0/925308725 wait complete. 2024-09-17T03:37:37.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.175+0000 7f58f2e00640 1 Processor -- start 2024-09-17T03:37:37.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.175+0000 7f58f2e00640 1 -- start start 2024-09-17T03:37:37.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.176+0000 7f58f2e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58ec06e160 0x7f58ec1449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:37.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.176+0000 7f58f2e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58ec0cc8d0 0x7f58ec1f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:37.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.176+0000 7f58f2e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58ec15dfe0 0x7f58ec1e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:37.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.176+0000 7f58f2e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0b4b80 con 0x7f58ec06e160 2024-09-17T03:37:37.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.176+0000 7f58f2e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec0b4a00 con 0x7f58ec0cc8d0 2024-09-17T03:37:37.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.176+0000 7f58f2e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f58ec0b4d00 con 0x7f58ec15dfe0 2024-09-17T03:37:37.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f1a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58ec06e160 0x7f58ec1449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:37.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f1a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58ec06e160 0x7f58ec1449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53032/0 (socket says 172.21.15.121:53032) 2024-09-17T03:37:37.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f1a00640 1 -- 172.21.15.121:0/989197997 learned_addr learned my addr 172.21.15.121:0/989197997 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:37.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f2400640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58ec15dfe0 0x7f58ec1e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:37.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f1000640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58ec0cc8d0 0x7f58ec1f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:37.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f1a00640 1 -- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58ec15dfe0 msgr2=0x7f58ec1e77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:37.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f1a00640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58ec15dfe0 0x7f58ec1e77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f1a00640 1 -- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58ec0cc8d0 msgr2=0x7f58ec1f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:37.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f1a00640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58ec0cc8d0 0x7f58ec1f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f1a00640 1 -- 172.21.15.121:0/989197997 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec144ee0 con 0x7f58ec06e160 2024-09-17T03:37:37.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.177+0000 7f58f1a00640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58ec06e160 0x7f58ec1449a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f58e000cbc0 tx=0x7f58e000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.178+0000 7f58e9600640 1 -- 172.21.15.121:0/989197997 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0016020 con 0x7f58ec06e160 2024-09-17T03:37:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.178+0000 7f58e9600640 1 -- 172.21.15.121:0/989197997 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58e000ae50 con 0x7f58ec06e160 2024-09-17T03:37:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.178+0000 7f58e9600640 1 -- 172.21.15.121:0/989197997 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0012660 con 0x7f58ec06e160 2024-09-17T03:37:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.178+0000 7f58f2e00640 1 -- 172.21.15.121:0/989197997 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ec1f6f20 con 0x7f58ec06e160 2024-09-17T03:37:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.178+0000 7f58f2e00640 1 -- 172.21.15.121:0/989197997 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ec1e6cd0 con 0x7f58ec06e160 2024-09-17T03:37:37.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.179+0000 7f58f2e00640 1 -- 172.21.15.121:0/989197997 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ec0b51d0 con 0x7f58ec06e160 2024-09-17T03:37:37.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.180+0000 7f58e9600640 1 -- 172.21.15.121:0/989197997 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58e0019020 con 0x7f58ec06e160 2024-09-17T03:37:37.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.181+0000 7f58e9600640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f58cc078bc0 0x7f58cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:37.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.181+0000 7f58e9600640 1 -- 172.21.15.121:0/989197997 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f58e009b750 con 0x7f58ec06e160 2024-09-17T03:37:37.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.181+0000 7f58f1000640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f58cc078bc0 0x7f58cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:37.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.182+0000 7f58f1000640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f58cc078bc0 0x7f58cc07b0d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f58d8034000 tx=0x7f58d8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:37.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.186+0000 7f58e9600640 1 -- 172.21.15.121:0/989197997 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f58e0020020 con 0x7f58ec06e160 2024-09-17T03:37:37.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.365+0000 7f58f2e00640 1 -- 172.21.15.121:0/989197997 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58ec1e67a0 con 0x7f58cc078bc0 2024-09-17T03:37:37.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.371+0000 7f58e9600640 1 -- 172.21.15.121:0/989197997 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251860 (secure 0 0 0) 0x7f58ec1e67a0 con 0x7f58cc078bc0 2024-09-17T03:37:37.374 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:37.375 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:37:37.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 -- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f58cc078bc0 msgr2=0x7f58cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f58cc078bc0 0x7f58cc07b0d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f58d8034000 tx=0x7f58d8004730 comp rx=0 tx=0).stop 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 -- 172.21.15.121:0/989197997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58ec06e160 msgr2=0x7f58ec1449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58ec06e160 0x7f58ec1449a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f58e000cbc0 tx=0x7f58e000a430 comp rx=0 tx=0).stop 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 -- 172.21.15.121:0/989197997 shutdown_connections 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58ec15dfe0 0x7f58ec1e77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58ec0cc8d0 0x7f58ec1f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f58cc078bc0 0x7f58cc07b0d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 --2- 172.21.15.121:0/989197997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58ec06e160 0x7f58ec1449a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 -- 172.21.15.121:0/989197997 >> 172.21.15.121:0/989197997 conn(0x7f58ec06f940 msgr2=0x7f58ec155950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 -- 172.21.15.121:0/989197997 shutdown_connections 2024-09-17T03:37:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.375+0000 7f58f2e00640 1 -- 172.21.15.121:0/989197997 wait complete. 2024-09-17T03:37:37.396 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-17T03:37:37.310610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222224,"kb_used_data":5992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752496,"statfs":{"total":773094113280,"available":772866555904,"internally_reserved":0,"allocated":6135808,"data_stored":3331492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.789145"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536989+0000","last_change":"2024-09-17T03:37:27.540668+0000","last_active":"2024-09-17T03:37:28.536989+0000","last_peered":"2024-09-17T03:37:28.536989+0000","last_clean":"2024-09-17T03:37:28.536989+0000","last_became_active":"2024-09-17T03:37:27.537774+0000","last_became_peered":"2024-09-17T03:37:27.537774+0000","last_unstale":"2024-09-17T03:37:28.536989+0000","last_undegraded":"2024-09-17T03:37:28.536989+0000","last_fullsized":"2024-09-17T03:37:28.536989+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:33.857227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921909+0000","last_change":"2024-09-17T03:37:27.545950+0000","last_active":"2024-09-17T03:37:28.921909+0000","last_peered":"2024-09-17T03:37:28.921909+0000","last_clean":"2024-09-17T03:37:28.921909+0000","last_became_active":"2024-09-17T03:37:27.545651+0000","last_became_peered":"2024-09-17T03:37:27.545651+0000","last_unstale":"2024-09-17T03:37:28.921909+0000","last_undegraded":"2024-09-17T03:37:28.921909+0000","last_fullsized":"2024-09-17T03:37:28.921909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:55.838205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538534+0000","last_change":"2024-09-17T03:37:27.558313+0000","last_active":"2024-09-17T03:37:28.538534+0000","last_peered":"2024-09-17T03:37:28.538534+0000","last_clean":"2024-09-17T03:37:28.538534+0000","last_became_active":"2024-09-17T03:37:27.557994+0000","last_became_peered":"2024-09-17T03:37:27.557994+0000","last_unstale":"2024-09-17T03:37:28.538534+0000","last_undegraded":"2024-09-17T03:37:28.538534+0000","last_fullsized":"2024-09-17T03:37:28.538534+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:30.370053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971871+0000","last_change":"2024-09-17T03:37:27.549625+0000","last_active":"2024-09-17T03:37:28.971871+0000","last_peered":"2024-09-17T03:37:28.971871+0000","last_clean":"2024-09-17T03:37:28.971871+0000","last_became_active":"2024-09-17T03:37:27.549336+0000","last_became_peered":"2024-09-17T03:37:27.549336+0000","last_unstale":"2024-09-17T03:37:28.971871+0000","last_undegraded":"2024-09-17T03:37:28.971871+0000","last_fullsized":"2024-09-17T03:37:28.971871+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:53.792718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921565+0000","last_change":"2024-09-17T03:37:27.551257+0000","last_active":"2024-09-17T03:37:28.921565+0000","last_peered":"2024-09-17T03:37:28.921565+0000","last_clean":"2024-09-17T03:37:28.921565+0000","last_became_active":"2024-09-17T03:37:27.550886+0000","last_became_peered":"2024-09-17T03:37:27.550886+0000","last_unstale":"2024-09-17T03:37:28.921565+0000","last_undegraded":"2024-09-17T03:37:28.921565+0000","last_fullsized":"2024-09-17T03:37:28.921565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536419+0000","last_change":"2024-09-17T03:37:27.545772+0000","last_active":"2024-09-17T03:37:28.536419+0000","last_peered":"2024-09-17T03:37:28.536419+0000","last_clean":"2024-09-17T03:37:28.536419+0000","last_became_active":"2024-09-17T03:37:27.545156+0000","last_became_peered":"2024-09-17T03:37:27.545156+0000","last_unstale":"2024-09-17T03:37:28.536419+0000","last_undegraded":"2024-09-17T03:37:28.536419+0000","last_fullsized":"2024-09-17T03:37:28.536419+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:53.792718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972117+0000","last_change":"2024-09-17T03:37:27.549769+0000","last_active":"2024-09-17T03:37:28.972117+0000","last_peered":"2024-09-17T03:37:28.972117+0000","last_clean":"2024-09-17T03:37:28.972117+0000","last_became_active":"2024-09-17T03:37:27.549437+0000","last_became_peered":"2024-09-17T03:37:27.549437+0000","last_unstale":"2024-09-17T03:37:28.972117+0000","last_undegraded":"2024-09-17T03:37:28.972117+0000","last_fullsized":"2024-09-17T03:37:28.972117+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:55.838205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535267+0000","last_change":"2024-09-17T03:37:27.534750+0000","last_active":"2024-09-17T03:37:28.535267+0000","last_peered":"2024-09-17T03:37:28.535267+0000","last_clean":"2024-09-17T03:37:28.535267+0000","last_became_active":"2024-09-17T03:37:27.534326+0000","last_became_peered":"2024-09-17T03:37:27.534326+0000","last_unstale":"2024-09-17T03:37:28.535267+0000","last_undegraded":"2024-09-17T03:37:28.535267+0000","last_fullsized":"2024-09-17T03:37:28.535267+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:25.188857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538962+0000","last_change":"2024-09-17T03:37:27.550014+0000","last_active":"2024-09-17T03:37:28.538962+0000","last_peered":"2024-09-17T03:37:28.538962+0000","last_clean":"2024-09-17T03:37:28.538962+0000","last_became_active":"2024-09-17T03:37:27.549694+0000","last_became_peered":"2024-09-17T03:37:27.549694+0000","last_unstale":"2024-09-17T03:37:28.538962+0000","last_undegraded":"2024-09-17T03:37:28.538962+0000","last_fullsized":"2024-09-17T03:37:28.538962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:45.679763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972624+0000","last_change":"2024-09-17T03:37:27.543273+0000","last_active":"2024-09-17T03:37:28.972624+0000","last_peered":"2024-09-17T03:37:28.972624+0000","last_clean":"2024-09-17T03:37:28.972624+0000","last_became_active":"2024-09-17T03:37:27.542939+0000","last_became_peered":"2024-09-17T03:37:27.542939+0000","last_unstale":"2024-09-17T03:37:28.972624+0000","last_undegraded":"2024-09-17T03:37:28.972624+0000","last_fullsized":"2024-09-17T03:37:28.972624+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:47.056365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536597+0000","last_change":"2024-09-17T03:37:27.537150+0000","last_active":"2024-09-17T03:37:28.536597+0000","last_peered":"2024-09-17T03:37:28.536597+0000","last_clean":"2024-09-17T03:37:28.536597+0000","last_became_active":"2024-09-17T03:37:27.536812+0000","last_became_peered":"2024-09-17T03:37:27.536812+0000","last_unstale":"2024-09-17T03:37:28.536597+0000","last_undegraded":"2024-09-17T03:37:28.536597+0000","last_fullsized":"2024-09-17T03:37:28.536597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:27.755987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537577+0000","last_change":"2024-09-17T03:37:27.554147+0000","last_active":"2024-09-17T03:37:28.537577+0000","last_peered":"2024-09-17T03:37:28.537577+0000","last_clean":"2024-09-17T03:37:28.537577+0000","last_became_active":"2024-09-17T03:37:27.553846+0000","last_became_peered":"2024-09-17T03:37:27.553846+0000","last_unstale":"2024-09-17T03:37:28.537577+0000","last_undegraded":"2024-09-17T03:37:28.537577+0000","last_fullsized":"2024-09-17T03:37:28.537577+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537004+0000","last_change":"2024-09-17T03:37:27.543555+0000","last_active":"2024-09-17T03:37:28.537004+0000","last_peered":"2024-09-17T03:37:28.537004+0000","last_clean":"2024-09-17T03:37:28.537004+0000","last_became_active":"2024-09-17T03:37:27.543195+0000","last_became_peered":"2024-09-17T03:37:27.543195+0000","last_unstale":"2024-09-17T03:37:28.537004+0000","last_undegraded":"2024-09-17T03:37:28.537004+0000","last_fullsized":"2024-09-17T03:37:28.537004+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:27.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536509+0000","last_change":"2024-09-17T03:37:27.542230+0000","last_active":"2024-09-17T03:37:28.536509+0000","last_peered":"2024-09-17T03:37:28.536509+0000","last_clean":"2024-09-17T03:37:28.536509+0000","last_became_active":"2024-09-17T03:37:27.541912+0000","last_became_peered":"2024-09-17T03:37:27.541912+0000","last_unstale":"2024-09-17T03:37:28.536509+0000","last_undegraded":"2024-09-17T03:37:28.536509+0000","last_fullsized":"2024-09-17T03:37:28.536509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:00.468303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971820+0000","last_change":"2024-09-17T03:37:27.546632+0000","last_active":"2024-09-17T03:37:28.971820+0000","last_peered":"2024-09-17T03:37:28.971820+0000","last_clean":"2024-09-17T03:37:28.971820+0000","last_became_active":"2024-09-17T03:37:27.544485+0000","last_became_peered":"2024-09-17T03:37:27.544485+0000","last_unstale":"2024-09-17T03:37:28.971820+0000","last_undegraded":"2024-09-17T03:37:28.971820+0000","last_fullsized":"2024-09-17T03:37:28.971820+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:38.995552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535503+0000","last_change":"2024-09-17T03:37:27.538588+0000","last_active":"2024-09-17T03:37:28.535503+0000","last_peered":"2024-09-17T03:37:28.535503+0000","last_clean":"2024-09-17T03:37:28.535503+0000","last_became_active":"2024-09-17T03:37:27.538287+0000","last_became_peered":"2024-09-17T03:37:27.538287+0000","last_unstale":"2024-09-17T03:37:28.535503+0000","last_undegraded":"2024-09-17T03:37:28.535503+0000","last_fullsized":"2024-09-17T03:37:28.535503+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:38.995552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537009+0000","last_change":"2024-09-17T03:37:27.538911+0000","last_active":"2024-09-17T03:37:28.537009+0000","last_peered":"2024-09-17T03:37:28.537009+0000","last_clean":"2024-09-17T03:37:28.537009+0000","last_became_active":"2024-09-17T03:37:27.538020+0000","last_became_peered":"2024-09-17T03:37:27.538020+0000","last_unstale":"2024-09-17T03:37:28.537009+0000","last_undegraded":"2024-09-17T03:37:28.537009+0000","last_fullsized":"2024-09-17T03:37:28.537009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:28.630655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972164+0000","last_change":"2024-09-17T03:37:27.550328+0000","last_active":"2024-09-17T03:37:28.972164+0000","last_peered":"2024-09-17T03:37:28.972164+0000","last_clean":"2024-09-17T03:37:28.972164+0000","last_became_active":"2024-09-17T03:37:27.550060+0000","last_became_peered":"2024-09-17T03:37:27.550060+0000","last_unstale":"2024-09-17T03:37:28.972164+0000","last_undegraded":"2024-09-17T03:37:28.972164+0000","last_fullsized":"2024-09-17T03:37:28.972164+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538664+0000","last_change":"2024-09-17T03:37:27.557330+0000","last_active":"2024-09-17T03:37:28.538664+0000","last_peered":"2024-09-17T03:37:28.538664+0000","last_clean":"2024-09-17T03:37:28.538664+0000","last_became_active":"2024-09-17T03:37:27.548274+0000","last_became_peered":"2024-09-17T03:37:27.548274+0000","last_unstale":"2024-09-17T03:37:28.538664+0000","last_undegraded":"2024-09-17T03:37:28.538664+0000","last_fullsized":"2024-09-17T03:37:28.538664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:16.703349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921606+0000","last_change":"2024-09-17T03:37:27.543944+0000","last_active":"2024-09-17T03:37:28.921606+0000","last_peered":"2024-09-17T03:37:28.921606+0000","last_clean":"2024-09-17T03:37:28.921606+0000","last_became_active":"2024-09-17T03:37:27.543589+0000","last_became_peered":"2024-09-17T03:37:27.543589+0000","last_unstale":"2024-09-17T03:37:28.921606+0000","last_undegraded":"2024-09-17T03:37:28.921606+0000","last_fullsized":"2024-09-17T03:37:28.921606+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:43.099209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971895+0000","last_change":"2024-09-17T03:37:27.552202+0000","last_active":"2024-09-17T03:37:28.971895+0000","last_peered":"2024-09-17T03:37:28.971895+0000","last_clean":"2024-09-17T03:37:28.971895+0000","last_became_active":"2024-09-17T03:37:27.544791+0000","last_became_peered":"2024-09-17T03:37:27.544791+0000","last_unstale":"2024-09-17T03:37:28.971895+0000","last_undegraded":"2024-09-17T03:37:28.971895+0000","last_fullsized":"2024-09-17T03:37:28.971895+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:26.981822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537002+0000","last_change":"2024-09-17T03:37:27.544863+0000","last_active":"2024-09-17T03:37:28.537002+0000","last_peered":"2024-09-17T03:37:28.537002+0000","last_clean":"2024-09-17T03:37:28.537002+0000","last_became_active":"2024-09-17T03:37:27.544558+0000","last_became_peered":"2024-09-17T03:37:27.544558+0000","last_unstale":"2024-09-17T03:37:28.537002+0000","last_undegraded":"2024-09-17T03:37:28.537002+0000","last_fullsized":"2024-09-17T03:37:28.537002+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:31.631639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537254+0000","last_change":"2024-09-17T03:37:27.541536+0000","last_active":"2024-09-17T03:37:28.537254+0000","last_peered":"2024-09-17T03:37:28.537254+0000","last_clean":"2024-09-17T03:37:28.537254+0000","last_became_active":"2024-09-17T03:37:27.541232+0000","last_became_peered":"2024-09-17T03:37:27.541232+0000","last_unstale":"2024-09-17T03:37:28.537254+0000","last_undegraded":"2024-09-17T03:37:28.537254+0000","last_fullsized":"2024-09-17T03:37:28.537254+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:17.894848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535531+0000","last_change":"2024-09-17T03:37:27.548580+0000","last_active":"2024-09-17T03:37:28.535531+0000","last_peered":"2024-09-17T03:37:28.535531+0000","last_clean":"2024-09-17T03:37:28.535531+0000","last_became_active":"2024-09-17T03:37:27.547999+0000","last_became_peered":"2024-09-17T03:37:27.547999+0000","last_unstale":"2024-09-17T03:37:28.535531+0000","last_undegraded":"2024-09-17T03:37:28.535531+0000","last_fullsized":"2024-09-17T03:37:28.535531+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:25.520383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536786+0000","last_change":"2024-09-17T03:37:27.551785+0000","last_active":"2024-09-17T03:37:28.536786+0000","last_peered":"2024-09-17T03:37:28.536786+0000","last_clean":"2024-09-17T03:37:28.536786+0000","last_became_active":"2024-09-17T03:37:27.551351+0000","last_became_peered":"2024-09-17T03:37:27.551351+0000","last_unstale":"2024-09-17T03:37:28.536786+0000","last_undegraded":"2024-09-17T03:37:28.536786+0000","last_fullsized":"2024-09-17T03:37:28.536786+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:22.489576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538734+0000","last_change":"2024-09-17T03:37:27.548165+0000","last_active":"2024-09-17T03:37:28.538734+0000","last_peered":"2024-09-17T03:37:28.538734+0000","last_clean":"2024-09-17T03:37:28.538734+0000","last_became_active":"2024-09-17T03:37:27.547681+0000","last_became_peered":"2024-09-17T03:37:27.547681+0000","last_unstale":"2024-09-17T03:37:28.538734+0000","last_undegraded":"2024-09-17T03:37:28.538734+0000","last_fullsized":"2024-09-17T03:37:28.538734+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:38.918491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537358+0000","last_change":"2024-09-17T03:37:27.547485+0000","last_active":"2024-09-17T03:37:28.537358+0000","last_peered":"2024-09-17T03:37:28.537358+0000","last_clean":"2024-09-17T03:37:28.537358+0000","last_became_active":"2024-09-17T03:37:27.546932+0000","last_became_peered":"2024-09-17T03:37:27.546932+0000","last_unstale":"2024-09-17T03:37:28.537358+0000","last_undegraded":"2024-09-17T03:37:28.537358+0000","last_fullsized":"2024-09-17T03:37:28.537358+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921642+0000","last_change":"2024-09-17T03:37:27.552987+0000","last_active":"2024-09-17T03:37:28.921642+0000","last_peered":"2024-09-17T03:37:28.921642+0000","last_clean":"2024-09-17T03:37:28.921642+0000","last_became_active":"2024-09-17T03:37:27.552509+0000","last_became_peered":"2024-09-17T03:37:27.552509+0000","last_unstale":"2024-09-17T03:37:28.921642+0000","last_undegraded":"2024-09-17T03:37:28.921642+0000","last_fullsized":"2024-09-17T03:37:28.921642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:20.292074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535969+0000","last_change":"2024-09-17T03:37:27.546789+0000","last_active":"2024-09-17T03:37:28.535969+0000","last_peered":"2024-09-17T03:37:28.535969+0000","last_clean":"2024-09-17T03:37:28.535969+0000","last_became_active":"2024-09-17T03:37:27.545462+0000","last_became_peered":"2024-09-17T03:37:27.545462+0000","last_unstale":"2024-09-17T03:37:28.535969+0000","last_undegraded":"2024-09-17T03:37:28.535969+0000","last_fullsized":"2024-09-17T03:37:28.535969+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973019+0000","last_change":"2024-09-17T03:37:27.548434+0000","last_active":"2024-09-17T03:37:28.973019+0000","last_peered":"2024-09-17T03:37:28.973019+0000","last_clean":"2024-09-17T03:37:28.973019+0000","last_became_active":"2024-09-17T03:37:27.548125+0000","last_became_peered":"2024-09-17T03:37:27.548125+0000","last_unstale":"2024-09-17T03:37:28.973019+0000","last_undegraded":"2024-09-17T03:37:28.973019+0000","last_fullsized":"2024-09-17T03:37:28.973019+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:42.573230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537191+0000","last_change":"2024-09-17T03:37:27.554562+0000","last_active":"2024-09-17T03:37:28.537191+0000","last_peered":"2024-09-17T03:37:28.537191+0000","last_clean":"2024-09-17T03:37:28.537191+0000","last_became_active":"2024-09-17T03:37:27.549955+0000","last_became_peered":"2024-09-17T03:37:27.549955+0000","last_unstale":"2024-09-17T03:37:28.537191+0000","last_undegraded":"2024-09-17T03:37:28.537191+0000","last_fullsized":"2024-09-17T03:37:28.537191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:51.664727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921247+0000","last_change":"2024-09-17T03:37:27.533198+0000","last_active":"2024-09-17T03:37:28.921247+0000","last_peered":"2024-09-17T03:37:28.921247+0000","last_clean":"2024-09-17T03:37:28.921247+0000","last_became_active":"2024-09-17T03:37:27.532590+0000","last_became_peered":"2024-09-17T03:37:27.532590+0000","last_unstale":"2024-09-17T03:37:28.921247+0000","last_undegraded":"2024-09-17T03:37:28.921247+0000","last_fullsized":"2024-09-17T03:37:28.921247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:20.412484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972523+0000","last_change":"2024-09-17T03:37:27.557044+0000","last_active":"2024-09-17T03:37:28.972523+0000","last_peered":"2024-09-17T03:37:28.972523+0000","last_clean":"2024-09-17T03:37:28.972523+0000","last_became_active":"2024-09-17T03:37:27.552478+0000","last_became_peered":"2024-09-17T03:37:27.552478+0000","last_unstale":"2024-09-17T03:37:28.972523+0000","last_undegraded":"2024-09-17T03:37:28.972523+0000","last_fullsized":"2024-09-17T03:37:28.972523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:45.217306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973243+0000","last_change":"2024-09-17T03:37:26.531549+0000","last_active":"2024-09-17T03:37:28.973243+0000","last_peered":"2024-09-17T03:37:28.973243+0000","last_clean":"2024-09-17T03:37:28.973243+0000","last_became_active":"2024-09-17T03:37:26.531217+0000","last_became_peered":"2024-09-17T03:37:26.531217+0000","last_unstale":"2024-09-17T03:37:28.973243+0000","last_undegraded":"2024-09-17T03:37:28.973243+0000","last_fullsized":"2024-09-17T03:37:28.973243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:24.181754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972545+0000","last_change":"2024-09-17T03:37:27.543948+0000","last_active":"2024-09-17T03:37:28.972545+0000","last_peered":"2024-09-17T03:37:28.972545+0000","last_clean":"2024-09-17T03:37:28.972545+0000","last_became_active":"2024-09-17T03:37:27.543659+0000","last_became_peered":"2024-09-17T03:37:27.543659+0000","last_unstale":"2024-09-17T03:37:28.972545+0000","last_undegraded":"2024-09-17T03:37:28.972545+0000","last_fullsized":"2024-09-17T03:37:28.972545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:14.055525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537553+0000","last_change":"2024-09-17T03:37:26.536702+0000","last_active":"2024-09-17T03:37:28.537553+0000","last_peered":"2024-09-17T03:37:28.537553+0000","last_clean":"2024-09-17T03:37:28.537553+0000","last_became_active":"2024-09-17T03:37:26.536412+0000","last_became_peered":"2024-09-17T03:37:26.536412+0000","last_unstale":"2024-09-17T03:37:28.537553+0000","last_undegraded":"2024-09-17T03:37:28.537553+0000","last_fullsized":"2024-09-17T03:37:28.537553+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:36.017576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972792+0000","last_change":"2024-09-17T03:37:27.551893+0000","last_active":"2024-09-17T03:37:28.972792+0000","last_peered":"2024-09-17T03:37:28.972792+0000","last_clean":"2024-09-17T03:37:28.972792+0000","last_became_active":"2024-09-17T03:37:27.551602+0000","last_became_peered":"2024-09-17T03:37:27.551602+0000","last_unstale":"2024-09-17T03:37:28.972792+0000","last_undegraded":"2024-09-17T03:37:28.972792+0000","last_fullsized":"2024-09-17T03:37:28.972792+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:57.278615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972464+0000","last_change":"2024-09-17T03:37:26.532271+0000","last_active":"2024-09-17T03:37:28.972464+0000","last_peered":"2024-09-17T03:37:28.972464+0000","last_clean":"2024-09-17T03:37:28.972464+0000","last_became_active":"2024-09-17T03:37:26.531921+0000","last_became_peered":"2024-09-17T03:37:26.531921+0000","last_unstale":"2024-09-17T03:37:28.972464+0000","last_undegraded":"2024-09-17T03:37:28.972464+0000","last_fullsized":"2024-09-17T03:37:28.972464+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:52.144731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972070+0000","last_change":"2024-09-17T03:37:27.553058+0000","last_active":"2024-09-17T03:37:28.972070+0000","last_peered":"2024-09-17T03:37:28.972070+0000","last_clean":"2024-09-17T03:37:28.972070+0000","last_became_active":"2024-09-17T03:37:27.550890+0000","last_became_peered":"2024-09-17T03:37:27.550890+0000","last_unstale":"2024-09-17T03:37:28.972070+0000","last_undegraded":"2024-09-17T03:37:28.972070+0000","last_fullsized":"2024-09-17T03:37:28.972070+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:21.682676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921722+0000","last_change":"2024-09-17T03:37:26.531629+0000","last_active":"2024-09-17T03:37:28.921722+0000","last_peered":"2024-09-17T03:37:28.921722+0000","last_clean":"2024-09-17T03:37:28.921722+0000","last_became_active":"2024-09-17T03:37:26.529987+0000","last_became_peered":"2024-09-17T03:37:26.529987+0000","last_unstale":"2024-09-17T03:37:28.921722+0000","last_undegraded":"2024-09-17T03:37:28.921722+0000","last_fullsized":"2024-09-17T03:37:28.921722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:16.827468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973143+0000","last_change":"2024-09-17T03:37:27.550210+0000","last_active":"2024-09-17T03:37:28.973143+0000","last_peered":"2024-09-17T03:37:28.973143+0000","last_clean":"2024-09-17T03:37:28.973143+0000","last_became_active":"2024-09-17T03:37:27.548300+0000","last_became_peered":"2024-09-17T03:37:27.548300+0000","last_unstale":"2024-09-17T03:37:28.973143+0000","last_undegraded":"2024-09-17T03:37:28.973143+0000","last_fullsized":"2024-09-17T03:37:28.973143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:40.031431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538407+0000","last_change":"2024-09-17T03:37:26.528848+0000","last_active":"2024-09-17T03:37:28.538407+0000","last_peered":"2024-09-17T03:37:28.538407+0000","last_clean":"2024-09-17T03:37:28.538407+0000","last_became_active":"2024-09-17T03:37:26.528533+0000","last_became_peered":"2024-09-17T03:37:26.528533+0000","last_unstale":"2024-09-17T03:37:28.538407+0000","last_undegraded":"2024-09-17T03:37:28.538407+0000","last_fullsized":"2024-09-17T03:37:28.538407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:02.179951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973031+0000","last_change":"2024-09-17T03:37:27.538085+0000","last_active":"2024-09-17T03:37:28.973031+0000","last_peered":"2024-09-17T03:37:28.973031+0000","last_clean":"2024-09-17T03:37:28.973031+0000","last_became_active":"2024-09-17T03:37:27.537802+0000","last_became_peered":"2024-09-17T03:37:27.537802+0000","last_unstale":"2024-09-17T03:37:28.973031+0000","last_undegraded":"2024-09-17T03:37:28.973031+0000","last_fullsized":"2024-09-17T03:37:28.973031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:46.545182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973089+0000","last_change":"2024-09-17T03:37:26.520225+0000","last_active":"2024-09-17T03:37:28.973089+0000","last_peered":"2024-09-17T03:37:28.973089+0000","last_clean":"2024-09-17T03:37:28.973089+0000","last_became_active":"2024-09-17T03:37:26.519923+0000","last_became_peered":"2024-09-17T03:37:26.519923+0000","last_unstale":"2024-09-17T03:37:28.973089+0000","last_undegraded":"2024-09-17T03:37:28.973089+0000","last_fullsized":"2024-09-17T03:37:28.973089+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:27.401642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972651+0000","last_change":"2024-09-17T03:37:27.552395+0000","last_active":"2024-09-17T03:37:28.972651+0000","last_peered":"2024-09-17T03:37:28.972651+0000","last_clean":"2024-09-17T03:37:28.972651+0000","last_became_active":"2024-09-17T03:37:27.551648+0000","last_became_peered":"2024-09-17T03:37:27.551648+0000","last_unstale":"2024-09-17T03:37:28.972651+0000","last_undegraded":"2024-09-17T03:37:28.972651+0000","last_fullsized":"2024-09-17T03:37:28.972651+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:29.942300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972453+0000","last_change":"2024-09-17T03:37:26.522976+0000","last_active":"2024-09-17T03:37:28.972453+0000","last_peered":"2024-09-17T03:37:28.972453+0000","last_clean":"2024-09-17T03:37:28.972453+0000","last_became_active":"2024-09-17T03:37:26.522640+0000","last_became_peered":"2024-09-17T03:37:26.522640+0000","last_unstale":"2024-09-17T03:37:28.972453+0000","last_undegraded":"2024-09-17T03:37:28.972453+0000","last_fullsized":"2024-09-17T03:37:28.972453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:34.420408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972553+0000","last_change":"2024-09-17T03:37:27.541597+0000","last_active":"2024-09-17T03:37:28.972553+0000","last_peered":"2024-09-17T03:37:28.972553+0000","last_clean":"2024-09-17T03:37:28.972553+0000","last_became_active":"2024-09-17T03:37:27.541315+0000","last_became_peered":"2024-09-17T03:37:27.541315+0000","last_unstale":"2024-09-17T03:37:28.972553+0000","last_undegraded":"2024-09-17T03:37:28.972553+0000","last_fullsized":"2024-09-17T03:37:28.972553+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535717+0000","last_change":"2024-09-17T03:37:26.528801+0000","last_active":"2024-09-17T03:37:28.535717+0000","last_peered":"2024-09-17T03:37:28.535717+0000","last_clean":"2024-09-17T03:37:28.535717+0000","last_became_active":"2024-09-17T03:37:26.527544+0000","last_became_peered":"2024-09-17T03:37:26.527544+0000","last_unstale":"2024-09-17T03:37:28.535717+0000","last_undegraded":"2024-09-17T03:37:28.535717+0000","last_fullsized":"2024-09-17T03:37:28.535717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:08.492781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972162+0000","last_change":"2024-09-17T03:37:27.555015+0000","last_active":"2024-09-17T03:37:28.972162+0000","last_peered":"2024-09-17T03:37:28.972162+0000","last_clean":"2024-09-17T03:37:28.972162+0000","last_became_active":"2024-09-17T03:37:27.554722+0000","last_became_peered":"2024-09-17T03:37:27.554722+0000","last_unstale":"2024-09-17T03:37:28.972162+0000","last_undegraded":"2024-09-17T03:37:28.972162+0000","last_fullsized":"2024-09-17T03:37:28.972162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:29.825087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972627+0000","last_change":"2024-09-17T03:37:26.531272+0000","last_active":"2024-09-17T03:37:28.972627+0000","last_peered":"2024-09-17T03:37:28.972627+0000","last_clean":"2024-09-17T03:37:28.972627+0000","last_became_active":"2024-09-17T03:37:26.530970+0000","last_became_peered":"2024-09-17T03:37:26.530970+0000","last_unstale":"2024-09-17T03:37:28.972627+0000","last_undegraded":"2024-09-17T03:37:28.972627+0000","last_fullsized":"2024-09-17T03:37:28.972627+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:02.686244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972225+0000","last_change":"2024-09-17T03:37:27.543452+0000","last_active":"2024-09-17T03:37:28.972225+0000","last_peered":"2024-09-17T03:37:28.972225+0000","last_clean":"2024-09-17T03:37:28.972225+0000","last_became_active":"2024-09-17T03:37:27.543130+0000","last_became_peered":"2024-09-17T03:37:27.543130+0000","last_unstale":"2024-09-17T03:37:28.972225+0000","last_undegraded":"2024-09-17T03:37:28.972225+0000","last_fullsized":"2024-09-17T03:37:28.972225+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972185+0000","last_change":"2024-09-17T03:37:26.526110+0000","last_active":"2024-09-17T03:37:28.972185+0000","last_peered":"2024-09-17T03:37:28.972185+0000","last_clean":"2024-09-17T03:37:28.972185+0000","last_became_active":"2024-09-17T03:37:26.525393+0000","last_became_peered":"2024-09-17T03:37:26.525393+0000","last_unstale":"2024-09-17T03:37:28.972185+0000","last_undegraded":"2024-09-17T03:37:28.972185+0000","last_fullsized":"2024-09-17T03:37:28.972185+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:59.076040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536897+0000","last_change":"2024-09-17T03:37:27.535178+0000","last_active":"2024-09-17T03:37:28.536897+0000","last_peered":"2024-09-17T03:37:28.536897+0000","last_clean":"2024-09-17T03:37:28.536897+0000","last_became_active":"2024-09-17T03:37:27.534768+0000","last_became_peered":"2024-09-17T03:37:27.534768+0000","last_unstale":"2024-09-17T03:37:28.536897+0000","last_undegraded":"2024-09-17T03:37:28.536897+0000","last_fullsized":"2024-09-17T03:37:28.536897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:57.588193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973091+0000","last_change":"2024-09-17T03:37:26.527185+0000","last_active":"2024-09-17T03:37:28.973091+0000","last_peered":"2024-09-17T03:37:28.973091+0000","last_clean":"2024-09-17T03:37:28.973091+0000","last_became_active":"2024-09-17T03:37:26.526936+0000","last_became_peered":"2024-09-17T03:37:26.526936+0000","last_unstale":"2024-09-17T03:37:28.973091+0000","last_undegraded":"2024-09-17T03:37:28.973091+0000","last_fullsized":"2024-09-17T03:37:28.973091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:37.973137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921633+0000","last_change":"2024-09-17T03:37:27.545218+0000","last_active":"2024-09-17T03:37:28.921633+0000","last_peered":"2024-09-17T03:37:28.921633+0000","last_clean":"2024-09-17T03:37:28.921633+0000","last_became_active":"2024-09-17T03:37:27.544912+0000","last_became_peered":"2024-09-17T03:37:27.544912+0000","last_unstale":"2024-09-17T03:37:28.921633+0000","last_undegraded":"2024-09-17T03:37:28.921633+0000","last_fullsized":"2024-09-17T03:37:28.921633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972382+0000","last_change":"2024-09-17T03:37:26.534022+0000","last_active":"2024-09-17T03:37:28.972382+0000","last_peered":"2024-09-17T03:37:28.972382+0000","last_clean":"2024-09-17T03:37:28.972382+0000","last_became_active":"2024-09-17T03:37:26.533717+0000","last_became_peered":"2024-09-17T03:37:26.533717+0000","last_unstale":"2024-09-17T03:37:28.972382+0000","last_undegraded":"2024-09-17T03:37:28.972382+0000","last_fullsized":"2024-09-17T03:37:28.972382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:49.735686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972915+0000","last_change":"2024-09-17T03:37:27.542974+0000","last_active":"2024-09-17T03:37:28.972915+0000","last_peered":"2024-09-17T03:37:28.972915+0000","last_clean":"2024-09-17T03:37:28.972915+0000","last_became_active":"2024-09-17T03:37:27.542632+0000","last_became_peered":"2024-09-17T03:37:27.542632+0000","last_unstale":"2024-09-17T03:37:28.972915+0000","last_undegraded":"2024-09-17T03:37:28.972915+0000","last_fullsized":"2024-09-17T03:37:28.972915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:11.137194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537602+0000","last_change":"2024-09-17T03:37:26.535866+0000","last_active":"2024-09-17T03:37:28.537602+0000","last_peered":"2024-09-17T03:37:28.537602+0000","last_clean":"2024-09-17T03:37:28.537602+0000","last_became_active":"2024-09-17T03:37:26.535582+0000","last_became_peered":"2024-09-17T03:37:26.535582+0000","last_unstale":"2024-09-17T03:37:28.537602+0000","last_undegraded":"2024-09-17T03:37:28.537602+0000","last_fullsized":"2024-09-17T03:37:28.537602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.509896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536716+0000","last_change":"2024-09-17T03:37:27.541751+0000","last_active":"2024-09-17T03:37:28.536716+0000","last_peered":"2024-09-17T03:37:28.536716+0000","last_clean":"2024-09-17T03:37:28.536716+0000","last_became_active":"2024-09-17T03:37:27.541468+0000","last_became_peered":"2024-09-17T03:37:27.541468+0000","last_unstale":"2024-09-17T03:37:28.536716+0000","last_undegraded":"2024-09-17T03:37:28.536716+0000","last_fullsized":"2024-09-17T03:37:28.536716+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:53.887378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971617+0000","last_change":"2024-09-17T03:37:26.527348+0000","last_active":"2024-09-17T03:37:28.971617+0000","last_peered":"2024-09-17T03:37:28.971617+0000","last_clean":"2024-09-17T03:37:28.971617+0000","last_became_active":"2024-09-17T03:37:26.527018+0000","last_became_peered":"2024-09-17T03:37:26.527018+0000","last_unstale":"2024-09-17T03:37:28.971617+0000","last_undegraded":"2024-09-17T03:37:28.971617+0000","last_fullsized":"2024-09-17T03:37:28.971617+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:34.905982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537921+0000","last_change":"2024-09-17T03:37:27.555528+0000","last_active":"2024-09-17T03:37:28.537921+0000","last_peered":"2024-09-17T03:37:28.537921+0000","last_clean":"2024-09-17T03:37:28.537921+0000","last_became_active":"2024-09-17T03:37:27.555178+0000","last_became_peered":"2024-09-17T03:37:27.555178+0000","last_unstale":"2024-09-17T03:37:28.537921+0000","last_undegraded":"2024-09-17T03:37:28.537921+0000","last_fullsized":"2024-09-17T03:37:28.537921+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921173+0000","last_change":"2024-09-17T03:37:26.531987+0000","last_active":"2024-09-17T03:37:28.921173+0000","last_peered":"2024-09-17T03:37:28.921173+0000","last_clean":"2024-09-17T03:37:28.921173+0000","last_became_active":"2024-09-17T03:37:26.531667+0000","last_became_peered":"2024-09-17T03:37:26.531667+0000","last_unstale":"2024-09-17T03:37:28.921173+0000","last_undegraded":"2024-09-17T03:37:28.921173+0000","last_fullsized":"2024-09-17T03:37:28.921173+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:38.767501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.539039+0000","last_change":"2024-09-17T03:37:27.545316+0000","last_active":"2024-09-17T03:37:28.539039+0000","last_peered":"2024-09-17T03:37:28.539039+0000","last_clean":"2024-09-17T03:37:28.539039+0000","last_became_active":"2024-09-17T03:37:27.544131+0000","last_became_peered":"2024-09-17T03:37:27.544131+0000","last_unstale":"2024-09-17T03:37:28.539039+0000","last_undegraded":"2024-09-17T03:37:28.539039+0000","last_fullsized":"2024-09-17T03:37:28.539039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:58.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535515+0000","last_change":"2024-09-17T03:37:26.534154+0000","last_active":"2024-09-17T03:37:28.535515+0000","last_peered":"2024-09-17T03:37:28.535515+0000","last_clean":"2024-09-17T03:37:28.535515+0000","last_became_active":"2024-09-17T03:37:26.533854+0000","last_became_peered":"2024-09-17T03:37:26.533854+0000","last_unstale":"2024-09-17T03:37:28.535515+0000","last_undegraded":"2024-09-17T03:37:28.535515+0000","last_fullsized":"2024-09-17T03:37:28.535515+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:04.512041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971915+0000","last_change":"2024-09-17T03:37:27.549196+0000","last_active":"2024-09-17T03:37:28.971915+0000","last_peered":"2024-09-17T03:37:28.971915+0000","last_clean":"2024-09-17T03:37:28.971915+0000","last_became_active":"2024-09-17T03:37:27.548755+0000","last_became_peered":"2024-09-17T03:37:27.548755+0000","last_unstale":"2024-09-17T03:37:28.971915+0000","last_undegraded":"2024-09-17T03:37:28.971915+0000","last_fullsized":"2024-09-17T03:37:28.971915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:14.345742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538013+0000","last_change":"2024-09-17T03:37:26.536699+0000","last_active":"2024-09-17T03:37:28.538013+0000","last_peered":"2024-09-17T03:37:28.538013+0000","last_clean":"2024-09-17T03:37:28.538013+0000","last_became_active":"2024-09-17T03:37:26.536400+0000","last_became_peered":"2024-09-17T03:37:26.536400+0000","last_unstale":"2024-09-17T03:37:28.538013+0000","last_undegraded":"2024-09-17T03:37:28.538013+0000","last_fullsized":"2024-09-17T03:37:28.538013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:34.905982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535962+0000","last_change":"2024-09-17T03:37:27.545948+0000","last_active":"2024-09-17T03:37:28.535962+0000","last_peered":"2024-09-17T03:37:28.535962+0000","last_clean":"2024-09-17T03:37:28.535962+0000","last_became_active":"2024-09-17T03:37:27.544335+0000","last_became_peered":"2024-09-17T03:37:27.544335+0000","last_unstale":"2024-09-17T03:37:28.535962+0000","last_undegraded":"2024-09-17T03:37:28.535962+0000","last_fullsized":"2024-09-17T03:37:28.535962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:20.292074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537978+0000","last_change":"2024-09-17T03:37:26.532545+0000","last_active":"2024-09-17T03:37:28.537978+0000","last_peered":"2024-09-17T03:37:28.537978+0000","last_clean":"2024-09-17T03:37:28.537978+0000","last_became_active":"2024-09-17T03:37:26.532034+0000","last_became_peered":"2024-09-17T03:37:26.532034+0000","last_unstale":"2024-09-17T03:37:28.537978+0000","last_undegraded":"2024-09-17T03:37:28.537978+0000","last_fullsized":"2024-09-17T03:37:28.537978+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.682503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921360+0000","last_change":"2024-09-17T03:37:27.540180+0000","last_active":"2024-09-17T03:37:28.921360+0000","last_peered":"2024-09-17T03:37:28.921360+0000","last_clean":"2024-09-17T03:37:28.921360+0000","last_became_active":"2024-09-17T03:37:27.536635+0000","last_became_peered":"2024-09-17T03:37:27.536635+0000","last_unstale":"2024-09-17T03:37:28.921360+0000","last_undegraded":"2024-09-17T03:37:28.921360+0000","last_fullsized":"2024-09-17T03:37:28.921360+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:27.280474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972108+0000","last_change":"2024-09-17T03:37:26.530302+0000","last_active":"2024-09-17T03:37:28.972108+0000","last_peered":"2024-09-17T03:37:28.972108+0000","last_clean":"2024-09-17T03:37:28.972108+0000","last_became_active":"2024-09-17T03:37:26.530025+0000","last_became_peered":"2024-09-17T03:37:26.530025+0000","last_unstale":"2024-09-17T03:37:28.972108+0000","last_undegraded":"2024-09-17T03:37:28.972108+0000","last_fullsized":"2024-09-17T03:37:28.972108+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:58.756354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536787+0000","last_change":"2024-09-17T03:37:27.539162+0000","last_active":"2024-09-17T03:37:28.536787+0000","last_peered":"2024-09-17T03:37:28.536787+0000","last_clean":"2024-09-17T03:37:28.536787+0000","last_became_active":"2024-09-17T03:37:27.538843+0000","last_became_peered":"2024-09-17T03:37:27.538843+0000","last_unstale":"2024-09-17T03:37:28.536787+0000","last_undegraded":"2024-09-17T03:37:28.536787+0000","last_fullsized":"2024-09-17T03:37:28.536787+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:20.412484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921850+0000","last_change":"2024-09-17T03:37:26.536689+0000","last_active":"2024-09-17T03:37:28.921850+0000","last_peered":"2024-09-17T03:37:28.921850+0000","last_clean":"2024-09-17T03:37:28.921850+0000","last_became_active":"2024-09-17T03:37:26.536406+0000","last_became_peered":"2024-09-17T03:37:26.536406+0000","last_unstale":"2024-09-17T03:37:28.921850+0000","last_undegraded":"2024-09-17T03:37:28.921850+0000","last_fullsized":"2024-09-17T03:37:28.921850+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:59.807710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921852+0000","last_change":"2024-09-17T03:37:27.546981+0000","last_active":"2024-09-17T03:37:28.921852+0000","last_peered":"2024-09-17T03:37:28.921852+0000","last_clean":"2024-09-17T03:37:28.921852+0000","last_became_active":"2024-09-17T03:37:27.546676+0000","last_became_peered":"2024-09-17T03:37:27.546676+0000","last_unstale":"2024-09-17T03:37:28.921852+0000","last_undegraded":"2024-09-17T03:37:28.921852+0000","last_fullsized":"2024-09-17T03:37:28.921852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:21.682676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.536042+0000","last_change":"2024-09-17T03:37:26.531962+0000","last_active":"2024-09-17T03:37:28.536042+0000","last_peered":"2024-09-17T03:37:28.536042+0000","last_clean":"2024-09-17T03:37:28.536042+0000","last_became_active":"2024-09-17T03:37:26.531665+0000","last_became_peered":"2024-09-17T03:37:26.531665+0000","last_unstale":"2024-09-17T03:37:28.536042+0000","last_undegraded":"2024-09-17T03:37:28.536042+0000","last_fullsized":"2024-09-17T03:37:28.536042+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:20.863280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972031+0000","last_change":"2024-09-17T03:37:27.548909+0000","last_active":"2024-09-17T03:37:28.972031+0000","last_peered":"2024-09-17T03:37:28.972031+0000","last_clean":"2024-09-17T03:37:28.972031+0000","last_became_active":"2024-09-17T03:37:27.543481+0000","last_became_peered":"2024-09-17T03:37:27.543481+0000","last_unstale":"2024-09-17T03:37:28.972031+0000","last_undegraded":"2024-09-17T03:37:28.972031+0000","last_fullsized":"2024-09-17T03:37:28.972031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:06.448770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537219+0000","last_change":"2024-09-17T03:37:26.531193+0000","last_active":"2024-09-17T03:37:28.537219+0000","last_peered":"2024-09-17T03:37:28.537219+0000","last_clean":"2024-09-17T03:37:28.537219+0000","last_became_active":"2024-09-17T03:37:26.529872+0000","last_became_peered":"2024-09-17T03:37:26.529872+0000","last_unstale":"2024-09-17T03:37:28.537219+0000","last_undegraded":"2024-09-17T03:37:28.537219+0000","last_fullsized":"2024-09-17T03:37:28.537219+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:13.560768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.535922+0000","last_change":"2024-09-17T03:37:27.534498+0000","last_active":"2024-09-17T03:37:28.535922+0000","last_peered":"2024-09-17T03:37:28.535922+0000","last_clean":"2024-09-17T03:37:28.535922+0000","last_became_active":"2024-09-17T03:37:27.534156+0000","last_became_peered":"2024-09-17T03:37:27.534156+0000","last_unstale":"2024-09-17T03:37:28.535922+0000","last_undegraded":"2024-09-17T03:37:28.535922+0000","last_fullsized":"2024-09-17T03:37:28.535922+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:40.031431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971932+0000","last_change":"2024-09-17T03:37:26.528782+0000","last_active":"2024-09-17T03:37:28.971932+0000","last_peered":"2024-09-17T03:37:28.971932+0000","last_clean":"2024-09-17T03:37:28.971932+0000","last_became_active":"2024-09-17T03:37:26.528187+0000","last_became_peered":"2024-09-17T03:37:26.528187+0000","last_unstale":"2024-09-17T03:37:28.971932+0000","last_undegraded":"2024-09-17T03:37:28.971932+0000","last_fullsized":"2024-09-17T03:37:28.971932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:57.698060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537927+0000","last_change":"2024-09-17T03:37:27.555855+0000","last_active":"2024-09-17T03:37:28.537927+0000","last_peered":"2024-09-17T03:37:28.537927+0000","last_clean":"2024-09-17T03:37:28.537927+0000","last_became_active":"2024-09-17T03:37:27.555564+0000","last_became_peered":"2024-09-17T03:37:27.555564+0000","last_unstale":"2024-09-17T03:37:28.537927+0000","last_undegraded":"2024-09-17T03:37:28.537927+0000","last_fullsized":"2024-09-17T03:37:28.537927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:13.789016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971883+0000","last_change":"2024-09-17T03:37:26.530376+0000","last_active":"2024-09-17T03:37:28.971883+0000","last_peered":"2024-09-17T03:37:28.971883+0000","last_clean":"2024-09-17T03:37:28.971883+0000","last_became_active":"2024-09-17T03:37:26.526932+0000","last_became_peered":"2024-09-17T03:37:26.526932+0000","last_unstale":"2024-09-17T03:37:28.971883+0000","last_undegraded":"2024-09-17T03:37:28.971883+0000","last_fullsized":"2024-09-17T03:37:28.971883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:56.339214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971888+0000","last_change":"2024-09-17T03:37:27.539745+0000","last_active":"2024-09-17T03:37:28.971888+0000","last_peered":"2024-09-17T03:37:28.971888+0000","last_clean":"2024-09-17T03:37:28.971888+0000","last_became_active":"2024-09-17T03:37:27.539434+0000","last_became_peered":"2024-09-17T03:37:27.539434+0000","last_unstale":"2024-09-17T03:37:28.971888+0000","last_undegraded":"2024-09-17T03:37:28.971888+0000","last_fullsized":"2024-09-17T03:37:28.971888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:49.519749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973003+0000","last_change":"2024-09-17T03:37:26.523031+0000","last_active":"2024-09-17T03:37:28.973003+0000","last_peered":"2024-09-17T03:37:28.973003+0000","last_clean":"2024-09-17T03:37:28.973003+0000","last_became_active":"2024-09-17T03:37:26.522699+0000","last_became_peered":"2024-09-17T03:37:26.522699+0000","last_unstale":"2024-09-17T03:37:28.973003+0000","last_undegraded":"2024-09-17T03:37:28.973003+0000","last_fullsized":"2024-09-17T03:37:28.973003+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:45.288058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972050+0000","last_change":"2024-09-17T03:37:27.552225+0000","last_active":"2024-09-17T03:37:28.972050+0000","last_peered":"2024-09-17T03:37:28.972050+0000","last_clean":"2024-09-17T03:37:28.972050+0000","last_became_active":"2024-09-17T03:37:27.550676+0000","last_became_peered":"2024-09-17T03:37:27.550676+0000","last_unstale":"2024-09-17T03:37:28.972050+0000","last_undegraded":"2024-09-17T03:37:28.972050+0000","last_fullsized":"2024-09-17T03:37:28.972050+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:56.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.973217+0000","last_change":"2024-09-17T03:37:26.525668+0000","last_active":"2024-09-17T03:37:28.973217+0000","last_peered":"2024-09-17T03:37:28.973217+0000","last_clean":"2024-09-17T03:37:28.973217+0000","last_became_active":"2024-09-17T03:37:26.525388+0000","last_became_peered":"2024-09-17T03:37:26.525388+0000","last_unstale":"2024-09-17T03:37:28.973217+0000","last_undegraded":"2024-09-17T03:37:28.973217+0000","last_fullsized":"2024-09-17T03:37:28.973217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:14.255452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538349+0000","last_change":"2024-09-17T03:37:27.546413+0000","last_active":"2024-09-17T03:37:28.538349+0000","last_peered":"2024-09-17T03:37:28.538349+0000","last_clean":"2024-09-17T03:37:28.538349+0000","last_became_active":"2024-09-17T03:37:27.546090+0000","last_became_peered":"2024-09-17T03:37:27.546090+0000","last_unstale":"2024-09-17T03:37:28.538349+0000","last_undegraded":"2024-09-17T03:37:28.538349+0000","last_fullsized":"2024-09-17T03:37:28.538349+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:13.556511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.538419+0000","last_change":"2024-09-17T03:37:26.527912+0000","last_active":"2024-09-17T03:37:28.538419+0000","last_peered":"2024-09-17T03:37:28.538419+0000","last_clean":"2024-09-17T03:37:28.538419+0000","last_became_active":"2024-09-17T03:37:26.527563+0000","last_became_peered":"2024-09-17T03:37:26.527563+0000","last_unstale":"2024-09-17T03:37:28.538419+0000","last_undegraded":"2024-09-17T03:37:28.538419+0000","last_fullsized":"2024-09-17T03:37:28.538419+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:55.494026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972538+0000","last_change":"2024-09-17T03:37:27.551533+0000","last_active":"2024-09-17T03:37:28.972538+0000","last_peered":"2024-09-17T03:37:28.972538+0000","last_clean":"2024-09-17T03:37:28.972538+0000","last_became_active":"2024-09-17T03:37:27.551145+0000","last_became_peered":"2024-09-17T03:37:27.551145+0000","last_unstale":"2024-09-17T03:37:28.972538+0000","last_undegraded":"2024-09-17T03:37:28.972538+0000","last_fullsized":"2024-09-17T03:37:28.972538+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:33.345886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972160+0000","last_change":"2024-09-17T03:37:26.535010+0000","last_active":"2024-09-17T03:37:28.972160+0000","last_peered":"2024-09-17T03:37:28.972160+0000","last_clean":"2024-09-17T03:37:28.972160+0000","last_became_active":"2024-09-17T03:37:26.534652+0000","last_became_peered":"2024-09-17T03:37:26.534652+0000","last_unstale":"2024-09-17T03:37:28.972160+0000","last_undegraded":"2024-09-17T03:37:28.972160+0000","last_fullsized":"2024-09-17T03:37:28.972160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:11.615940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921823+0000","last_change":"2024-09-17T03:37:27.537360+0000","last_active":"2024-09-17T03:37:28.921823+0000","last_peered":"2024-09-17T03:37:28.921823+0000","last_clean":"2024-09-17T03:37:28.921823+0000","last_became_active":"2024-09-17T03:37:27.536792+0000","last_became_peered":"2024-09-17T03:37:27.536792+0000","last_unstale":"2024-09-17T03:37:28.921823+0000","last_undegraded":"2024-09-17T03:37:28.921823+0000","last_fullsized":"2024-09-17T03:37:28.921823+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:56.910152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537357+0000","last_change":"2024-09-17T03:37:26.529448+0000","last_active":"2024-09-17T03:37:28.537357+0000","last_peered":"2024-09-17T03:37:28.537357+0000","last_clean":"2024-09-17T03:37:28.537357+0000","last_became_active":"2024-09-17T03:37:26.529137+0000","last_became_peered":"2024-09-17T03:37:26.529137+0000","last_unstale":"2024-09-17T03:37:28.537357+0000","last_undegraded":"2024-09-17T03:37:28.537357+0000","last_fullsized":"2024-09-17T03:37:28.537357+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:52.570921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972784+0000","last_change":"2024-09-17T03:37:27.551975+0000","last_active":"2024-09-17T03:37:28.972784+0000","last_peered":"2024-09-17T03:37:28.972784+0000","last_clean":"2024-09-17T03:37:28.972784+0000","last_became_active":"2024-09-17T03:37:27.551180+0000","last_became_peered":"2024-09-17T03:37:27.551180+0000","last_unstale":"2024-09-17T03:37:28.972784+0000","last_undegraded":"2024-09-17T03:37:28.972784+0000","last_fullsized":"2024-09-17T03:37:28.972784+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:51.856214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.921248+0000","last_change":"2024-09-17T03:37:26.525209+0000","last_active":"2024-09-17T03:37:28.921248+0000","last_peered":"2024-09-17T03:37:28.921248+0000","last_clean":"2024-09-17T03:37:28.921248+0000","last_became_active":"2024-09-17T03:37:26.524908+0000","last_became_peered":"2024-09-17T03:37:26.524908+0000","last_unstale":"2024-09-17T03:37:28.921248+0000","last_undegraded":"2024-09-17T03:37:28.921248+0000","last_fullsized":"2024-09-17T03:37:28.921248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:04.960327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.537907+0000","last_change":"2024-09-17T03:37:27.551523+0000","last_active":"2024-09-17T03:37:28.537907+0000","last_peered":"2024-09-17T03:37:28.537907+0000","last_clean":"2024-09-17T03:37:28.537907+0000","last_became_active":"2024-09-17T03:37:27.549402+0000","last_became_peered":"2024-09-17T03:37:27.549402+0000","last_unstale":"2024-09-17T03:37:28.537907+0000","last_undegraded":"2024-09-17T03:37:28.537907+0000","last_fullsized":"2024-09-17T03:37:28.537907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:51.877518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971532+0000","last_change":"2024-09-17T03:37:26.521825+0000","last_active":"2024-09-17T03:37:28.971532+0000","last_peered":"2024-09-17T03:37:28.971532+0000","last_clean":"2024-09-17T03:37:28.971532+0000","last_became_active":"2024-09-17T03:37:26.520727+0000","last_became_peered":"2024-09-17T03:37:26.520727+0000","last_unstale":"2024-09-17T03:37:28.971532+0000","last_undegraded":"2024-09-17T03:37:28.971532+0000","last_fullsized":"2024-09-17T03:37:28.971532+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:58.682503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972667+0000","last_change":"2024-09-17T03:37:27.542593+0000","last_active":"2024-09-17T03:37:28.972667+0000","last_peered":"2024-09-17T03:37:28.972667+0000","last_clean":"2024-09-17T03:37:28.972667+0000","last_became_active":"2024-09-17T03:37:27.542312+0000","last_became_peered":"2024-09-17T03:37:27.542312+0000","last_unstale":"2024-09-17T03:37:28.972667+0000","last_undegraded":"2024-09-17T03:37:28.972667+0000","last_fullsized":"2024-09-17T03:37:28.972667+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:26.500482+0000","last_clean_scrub_stamp":"2024-09-17T03:37:26.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:00.543429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.972743+0000","last_change":"2024-09-17T03:37:26.531805+0000","last_active":"2024-09-17T03:37:28.972743+0000","last_peered":"2024-09-17T03:37:28.972743+0000","last_clean":"2024-09-17T03:37:28.972743+0000","last_became_active":"2024-09-17T03:37:26.531514+0000","last_became_peered":"2024-09-17T03:37:26.531514+0000","last_unstale":"2024-09-17T03:37:28.972743+0000","last_undegraded":"2024-09-17T03:37:28.972743+0000","last_fullsized":"2024-09-17T03:37:28.972743+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:25.493379+0000","last_clean_scrub_stamp":"2024-09-17T03:37:25.493379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:12.294261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":169,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-17T03:37:28.971655+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:37:28.971655+0000","last_peered":"2024-09-17T03:37:28.971655+0000","last_clean":"2024-09-17T03:37:28.971655+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:37:28.971655+0000","last_undegraded":"2024-09-17T03:37:28.971655+0000","last_fullsized":"2024-09-17T03:37:28.971655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":618496,"data_stored":268298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1220608,"data_stored":860312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509470,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1208320,"data_stored":858680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509472,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":268824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":630784,"data_stored":269946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:37.400 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:37:37.400 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:37:37.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.665+0000 7fd119200640 1 -- 172.21.15.121:0/1871719504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd114073dd0 msgr2=0x7fd11406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:37.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.665+0000 7fd119200640 1 --2- 172.21.15.121:0/1871719504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd114073dd0 0x7fd11406ddf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd11415d980 tx=0x7fd0fc02a560 comp rx=0 tx=0).stop 2024-09-17T03:37:37.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.666+0000 7fd119200640 1 -- 172.21.15.121:0/1871719504 shutdown_connections 2024-09-17T03:37:37.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.666+0000 7fd119200640 1 --2- 172.21.15.121:0/1871719504 >> v2:172.21.15.176:3300/0 conn(0x7fd11406e330 0x7fd11406ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.666+0000 7fd119200640 1 --2- 172.21.15.121:0/1871719504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd114073dd0 0x7fd11406ddf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.666+0000 7fd119200640 1 -- 172.21.15.121:0/1871719504 >> 172.21.15.121:0/1871719504 conn(0x7fd1140cca40 msgr2=0x7fd1140cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:37.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.666+0000 7fd119200640 1 -- 172.21.15.121:0/1871719504 shutdown_connections 2024-09-17T03:37:37.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.666+0000 7fd119200640 1 -- 172.21.15.121:0/1871719504 wait complete. 2024-09-17T03:37:37.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.668+0000 7fd119200640 1 Processor -- start 2024-09-17T03:37:37.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.668+0000 7fd119200640 1 -- start start 2024-09-17T03:37:37.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.669+0000 7fd119200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd11406e330 0x7fd1140b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:37.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.669+0000 7fd119200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd114073dd0 0x7fd1141f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.669+0000 7fd119200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd114074cb0 0x7fd1141576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.669+0000 7fd119200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd11406f4a0 con 0x7fd114073dd0 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.669+0000 7fd119200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd11406f320 con 0x7fd114074cb0 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.669+0000 7fd119200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd11406f620 con 0x7fd11406e330 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd109400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd114073dd0 0x7fd1141f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd109400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd114073dd0 0x7fd1141f4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53064/0 (socket says 172.21.15.121:53064) 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd109400640 1 -- 172.21.15.121:0/2411715335 learned_addr learned my addr 172.21.15.121:0/2411715335 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd112800640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd114074cb0 0x7fd1141576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd109400640 1 -- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd11406e330 msgr2=0x7fd1140b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd109400640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd11406e330 0x7fd1140b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd109400640 1 -- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd114074cb0 msgr2=0x7fd1141576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd109400640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd114074cb0 0x7fd1141576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd109400640 1 -- 172.21.15.121:0/2411715335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd114156610 con 0x7fd114073dd0 2024-09-17T03:37:37.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd112800640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd114074cb0 0x7fd1141576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:37.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.670+0000 7fd109400640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd114073dd0 0x7fd1141f4940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc000c00 tx=0x7fd0fc003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:37.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.671+0000 7fd10aa00640 1 -- 172.21.15.121:0/2411715335 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc03e030 con 0x7fd114073dd0 2024-09-17T03:37:37.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.671+0000 7fd10aa00640 1 -- 172.21.15.121:0/2411715335 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0fc003e00 con 0x7fd114073dd0 2024-09-17T03:37:37.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.671+0000 7fd119200640 1 -- 172.21.15.121:0/2411715335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1141568f0 con 0x7fd114073dd0 2024-09-17T03:37:37.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.671+0000 7fd10aa00640 1 -- 172.21.15.121:0/2411715335 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc035040 con 0x7fd114073dd0 2024-09-17T03:37:37.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.671+0000 7fd119200640 1 -- 172.21.15.121:0/2411715335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd114156eb0 con 0x7fd114073dd0 2024-09-17T03:37:37.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.672+0000 7fd119200640 1 -- 172.21.15.121:0/2411715335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd114156380 con 0x7fd114073dd0 2024-09-17T03:37:37.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.673+0000 7fd10aa00640 1 -- 172.21.15.121:0/2411715335 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd0fc041030 con 0x7fd114073dd0 2024-09-17T03:37:37.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.674+0000 7fd10aa00640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f0078bc0 0x7fd0f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:37.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.674+0000 7fd10aa00640 1 -- 172.21.15.121:0/2411715335 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fd0fc0bb6d0 con 0x7fd114073dd0 2024-09-17T03:37:37.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.675+0000 7fd111e00640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f0078bc0 0x7fd0f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:37.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.675+0000 7fd111e00640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f0078bc0 0x7fd0f007b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd104006fd0 tx=0x7fd104006bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:37.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.679+0000 7fd10aa00640 1 -- 172.21.15.121:0/2411715335 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd11406e740 con 0x7fd114073dd0 2024-09-17T03:37:37.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.926+0000 7fd119200640 1 -- 172.21.15.121:0/2411715335 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd11406fbc0 con 0x7fd114073dd0 2024-09-17T03:37:37.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.931+0000 7fd10aa00640 1 -- 172.21.15.121:0/2411715335 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fd0fc083970 con 0x7fd114073dd0 2024-09-17T03:37:37.932 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-17T03:37:37.933 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw== 2024-09-17T03:37:37.933 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-17T03:37:37.933 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-17T03:37:37.933 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:37:37.933 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-17T03:37:37.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 -- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f0078bc0 msgr2=0x7fd0f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:37.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f0078bc0 0x7fd0f007b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd104006fd0 tx=0x7fd104006bc0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 -- 172.21.15.121:0/2411715335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd114073dd0 msgr2=0x7fd1141f4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:37.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd114073dd0 0x7fd1141f4940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc000c00 tx=0x7fd0fc003910 comp rx=0 tx=0).stop 2024-09-17T03:37:37.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 -- 172.21.15.121:0/2411715335 shutdown_connections 2024-09-17T03:37:37.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd114074cb0 0x7fd1141576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd0f0078bc0 0x7fd0f007b0d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd114073dd0 0x7fd1141f4940 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 --2- 172.21.15.121:0/2411715335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd11406e330 0x7fd1140b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:37.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 -- 172.21.15.121:0/2411715335 >> 172.21.15.121:0/2411715335 conn(0x7fd1140cca40 msgr2=0x7fd11415a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:37.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 -- 172.21.15.121:0/2411715335 shutdown_connections 2024-09-17T03:37:37.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:37.935+0000 7fd119200640 1 -- 172.21.15.121:0/2411715335 wait complete. 2024-09-17T03:37:37.959 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:38.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.178+0000 7f1abb600640 1 -- 172.21.15.121:0/3020195501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab415a6f0 msgr2=0x7f1ab415e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.178+0000 7f1abb600640 1 --2- 172.21.15.121:0/3020195501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab415a6f0 0x7f1ab415e230 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4073e10 tx=0x7f1aa002a560 comp rx=0 tx=0).stop 2024-09-17T03:37:38.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.178+0000 7f1abb600640 1 -- 172.21.15.121:0/3020195501 shutdown_connections 2024-09-17T03:37:38.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.178+0000 7f1abb600640 1 --2- 172.21.15.121:0/3020195501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab415a6f0 0x7f1ab415e230 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.179+0000 7f1abb600640 1 --2- 172.21.15.121:0/3020195501 >> v2:172.21.15.176:3300/0 conn(0x7f1ab40d01f0 0x7f1ab415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.179+0000 7f1abb600640 1 -- 172.21.15.121:0/3020195501 >> 172.21.15.121:0/3020195501 conn(0x7f1ab4072990 msgr2=0x7f1ab4072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:38.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.179+0000 7f1abb600640 1 -- 172.21.15.121:0/3020195501 shutdown_connections 2024-09-17T03:37:38.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.179+0000 7f1abb600640 1 -- 172.21.15.121:0/3020195501 wait complete. 2024-09-17T03:37:38.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.181+0000 7f1abb600640 1 Processor -- start 2024-09-17T03:37:38.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.181+0000 7f1abb600640 1 -- start start 2024-09-17T03:37:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.182+0000 7f1abb600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ab40d01f0 0x7f1ab41571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.182+0000 7f1abb600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab40d0980 0x7f1ab41526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.182+0000 7f1abb600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab415a6f0 0x7f1ab4152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.182+0000 7f1abb600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab40cd130 con 0x7f1ab415a6f0 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.182+0000 7f1abb600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab40ccfb0 con 0x7f1ab40d01f0 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.182+0000 7f1abb600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab40cd2b0 con 0x7f1ab40d0980 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab9600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab415a6f0 0x7f1ab4152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab9600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab415a6f0 0x7f1ab4152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53074/0 (socket says 172.21.15.121:53074) 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab9600640 1 -- 172.21.15.121:0/1681612203 learned_addr learned my addr 172.21.15.121:0/1681612203 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab8c00640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ab40d01f0 0x7f1ab41571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab3e00640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab40d0980 0x7f1ab41526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab9600640 1 -- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab40d0980 msgr2=0x7f1ab41526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab9600640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab40d0980 0x7f1ab41526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab9600640 1 -- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ab40d01f0 msgr2=0x7f1ab41571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab9600640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ab40d01f0 0x7f1ab41571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab9600640 1 -- 172.21.15.121:0/1681612203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab4153450 con 0x7f1ab415a6f0 2024-09-17T03:37:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab3e00640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab40d0980 0x7f1ab41526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:38.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.183+0000 7f1ab9600640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab415a6f0 0x7f1ab4152c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00ba10 tx=0x7f1aac00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:38.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.184+0000 7f1ab0c00640 1 -- 172.21.15.121:0/1681612203 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac019070 con 0x7f1ab415a6f0 2024-09-17T03:37:38.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.184+0000 7f1ab0c00640 1 -- 172.21.15.121:0/1681612203 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1aac00cc30 con 0x7f1ab415a6f0 2024-09-17T03:37:38.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.184+0000 7f1abb600640 1 -- 172.21.15.121:0/1681612203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab4153730 con 0x7f1ab415a6f0 2024-09-17T03:37:38.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.184+0000 7f1ab0c00640 1 -- 172.21.15.121:0/1681612203 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0146a0 con 0x7f1ab415a6f0 2024-09-17T03:37:38.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.184+0000 7f1abb600640 1 -- 172.21.15.121:0/1681612203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab4154b70 con 0x7f1ab415a6f0 2024-09-17T03:37:38.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.185+0000 7f1abb600640 1 -- 172.21.15.121:0/1681612203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab40cd7c0 con 0x7f1ab415a6f0 2024-09-17T03:37:38.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.186+0000 7f1ab0c00640 1 -- 172.21.15.121:0/1681612203 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1aac01c070 con 0x7f1ab415a6f0 2024-09-17T03:37:38.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.187+0000 7f1ab0c00640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a94078b90 0x7f1a9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.187+0000 7f1ab0c00640 1 -- 172.21.15.121:0/1681612203 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f1aac09aa60 con 0x7f1ab415a6f0 2024-09-17T03:37:38.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.187+0000 7f1ab8c00640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a94078b90 0x7f1a9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.188+0000 7f1ab8c00640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a94078b90 0x7f1a9407b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8005d70 tx=0x7f1aa8005d00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:38.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.192+0000 7f1ab0c00640 1 -- 172.21.15.121:0/1681612203 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1aac00ce20 con 0x7f1ab415a6f0 2024-09-17T03:37:38.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.406+0000 7f1abb600640 1 -- 172.21.15.121:0/1681612203 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ab415e550 con 0x7f1ab415a6f0 2024-09-17T03:37:38.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.407+0000 7f1ab0c00640 1 -- 172.21.15.121:0/1681612203 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5235 (secure 0 0 0) 0x7f1aac062d90 con 0x7f1ab415a6f0 2024-09-17T03:37:38.408 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:38.408 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"btime":"2024-09-17T03:37:30:553841+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4041842554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4041842554},{"type":"v1","addr":"172.21.15.176:6837","nonce":4041842554}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5308,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1921105537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1921105537},{"type":"v1","addr":"172.21.15.176:6836","nonce":1921105537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/1479695563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1479695563},{"type":"v1","addr":"172.21.15.121:6833","nonce":1479695563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:27.000747+0000","modified":"2024-09-17T03:37:30.040560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5388},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5388":{"gid":5388,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3704628086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3704628086},{"type":"v1","addr":"172.21.15.121:6835","nonce":3704628086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5388,"qdb_cluster":[5388]},"id":3}]} 2024-09-17T03:37:38.409 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 28 2024-09-17T03:37:38.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 -- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a94078b90 msgr2=0x7f1a9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a94078b90 0x7f1a9407b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8005d70 tx=0x7f1aa8005d00 comp rx=0 tx=0).stop 2024-09-17T03:37:38.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 -- 172.21.15.121:0/1681612203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab415a6f0 msgr2=0x7f1ab4152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab415a6f0 0x7f1ab4152c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00ba10 tx=0x7f1aac00bed0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 -- 172.21.15.121:0/1681612203 shutdown_connections 2024-09-17T03:37:38.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a94078b90 0x7f1a9407b0a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ab415a6f0 0x7f1ab4152c10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ab40d0980 0x7f1ab41526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 --2- 172.21.15.121:0/1681612203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ab40d01f0 0x7f1ab41571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 -- 172.21.15.121:0/1681612203 >> 172.21.15.121:0/1681612203 conn(0x7f1ab4072990 msgr2=0x7f1ab4070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:38.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 -- 172.21.15.121:0/1681612203 shutdown_connections 2024-09-17T03:37:38.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:38.410+0000 7f1abb600640 1 -- 172.21.15.121:0/1681612203 wait complete. 2024-09-17T03:37:38.835 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:37:27.000747+0000', 'modified': '2024-09-17T03:37:30.040560+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5388}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5388': {'gid': 5388, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6835/3704628086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 3704628086}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 3704628086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5388, 'qdb_cluster': [5388]} 2024-09-17T03:37:38.835 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:37:38.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:37:39.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.058+0000 7f926b600640 1 -- 172.21.15.121:0/2075950910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f926406e500 msgr2=0x7f92640cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.058+0000 7f926b600640 1 --2- 172.21.15.121:0/2075950910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f926406e500 0x7f92640cf290 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9250005fd0 tx=0x7f925002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.058+0000 7f926b600640 1 -- 172.21.15.121:0/2075950910 shutdown_connections 2024-09-17T03:37:39.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.058+0000 7f926b600640 1 --2- 172.21.15.121:0/2075950910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92640cf7d0 0x7f9264072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.058+0000 7f926b600640 1 --2- 172.21.15.121:0/2075950910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f926406e500 0x7f92640cf290 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.058+0000 7f926b600640 1 -- 172.21.15.121:0/2075950910 >> 172.21.15.121:0/2075950910 conn(0x7f92640b1b90 msgr2=0x7f92640b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.058+0000 7f926b600640 1 -- 172.21.15.121:0/2075950910 shutdown_connections 2024-09-17T03:37:39.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.058+0000 7f926b600640 1 -- 172.21.15.121:0/2075950910 wait complete. 2024-09-17T03:37:39.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.060+0000 7f926b600640 1 Processor -- start 2024-09-17T03:37:39.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.061+0000 7f926b600640 1 -- start start 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.062+0000 7f926b600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92640cf7d0 0x7f92641f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.062+0000 7f926b600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f926415fc50 0x7f92641f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.062+0000 7f926b600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f926409fd90 0x7f92640a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.062+0000 7f926b600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f92640732d0 con 0x7f926409fd90 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.062+0000 7f926b600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f92640cfc90 con 0x7f926415fc50 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.062+0000 7f926b600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9264073450 con 0x7f92640cf7d0 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.062+0000 7f9269600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f926409fd90 0x7f92640a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.062+0000 7f9269600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f926409fd90 0x7f92640a01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53088/0 (socket says 172.21.15.121:53088) 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.062+0000 7f9269600640 1 -- 172.21.15.121:0/1932657733 learned_addr learned my addr 172.21.15.121:0/1932657733 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.063+0000 7f9268c00640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92640cf7d0 0x7f92641f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.063+0000 7f9263e00640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f926415fc50 0x7f92641f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.063+0000 7f9269600640 1 -- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92640cf7d0 msgr2=0x7f92641f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.063+0000 7f9269600640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92640cf7d0 0x7f92641f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.063+0000 7f9269600640 1 -- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f926415fc50 msgr2=0x7f92641f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.063+0000 7f9269600640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f926415fc50 0x7f92641f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.063+0000 7f9269600640 1 -- 172.21.15.121:0/1932657733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92640a06e0 con 0x7f926409fd90 2024-09-17T03:37:39.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.063+0000 7f9269600640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f926409fd90 0x7f92640a01a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f925c00e960 tx=0x7f925c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.063+0000 7f9260c00640 1 -- 172.21.15.121:0/1932657733 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c004d20 con 0x7f926409fd90 2024-09-17T03:37:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.063+0000 7f9260c00640 1 -- 172.21.15.121:0/1932657733 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f925c00cb20 con 0x7f926409fd90 2024-09-17T03:37:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.064+0000 7f926b600640 1 -- 172.21.15.121:0/1932657733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926415ec80 con 0x7f926409fd90 2024-09-17T03:37:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.064+0000 7f9260c00640 1 -- 172.21.15.121:0/1932657733 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c005020 con 0x7f926409fd90 2024-09-17T03:37:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.064+0000 7f926b600640 1 -- 172.21.15.121:0/1932657733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92640c77e0 con 0x7f926409fd90 2024-09-17T03:37:39.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.066+0000 7f9260c00640 1 -- 172.21.15.121:0/1932657733 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f925c0051c0 con 0x7f926409fd90 2024-09-17T03:37:39.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.067+0000 7f9260c00640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9244078b90 0x7f924407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.067+0000 7f9260c00640 1 -- 172.21.15.121:0/1932657733 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f925c09b7a0 con 0x7f926409fd90 2024-09-17T03:37:39.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.067+0000 7f9268c00640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9244078b90 0x7f924407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.068+0000 7f9272683740 1 Processor -- start 2024-09-17T03:37:39.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.068+0000 7f9272683740 1 -- start start 2024-09-17T03:37:39.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.068+0000 7f9268c00640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9244078b90 0x7f924407b0a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9258001720 tx=0x7f9258009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.069+0000 7f9272683740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 0x55d4a1a37970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.069+0000 7f9272683740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a163e3b0 0x55d4a1a37eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.069+0000 7f9272683740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a1646590 0x55d4a1a07f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.069+0000 7f9272683740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d4a1991430 con 0x55d4a1646590 2024-09-17T03:37:39.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.069+0000 7f9272683740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d4a19815d0 con 0x55d4a1667270 2024-09-17T03:37:39.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.069+0000 7f9272683740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d4a1970a00 con 0x55d4a163e3b0 2024-09-17T03:37:39.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.069+0000 7f9269600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a1646590 0x55d4a1a07f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.069+0000 7f9269600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a1646590 0x55d4a1a07f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53096/0 (socket says 172.21.15.121:53096) 2024-09-17T03:37:39.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.069+0000 7f9269600640 1 -- 172.21.15.121:0/4181300415 learned_addr learned my addr 172.21.15.121:0/4181300415 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:39.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.069+0000 7f9268c00640 1 --2- 172.21.15.121:0/4181300415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 0x55d4a1a37970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.070+0000 7f9263e00640 1 --2- 172.21.15.121:0/4181300415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a163e3b0 0x55d4a1a37eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.070+0000 7f9269600640 1 -- 172.21.15.121:0/4181300415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a163e3b0 msgr2=0x55d4a1a37eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:39.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.070+0000 7f9269600640 1 --2- 172.21.15.121:0/4181300415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a163e3b0 0x55d4a1a37eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.070+0000 7f9269600640 1 -- 172.21.15.121:0/4181300415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 msgr2=0x55d4a1a37970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:39.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.070+0000 7f9269600640 1 --2- 172.21.15.121:0/4181300415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 0x55d4a1a37970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.070+0000 7f9269600640 1 -- 172.21.15.121:0/4181300415 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a1939520 con 0x55d4a1646590 2024-09-17T03:37:39.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.070+0000 7f9269600640 1 --2- 172.21.15.121:0/4181300415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a1646590 0x55d4a1a07f60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f925c00cfd0 tx=0x7f925c062c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ed510af313cd56 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.070+0000 7f9255200640 1 -- 172.21.15.121:0/4181300415 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c01f040 con 0x55d4a1646590 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.070+0000 7f9255200640 1 -- 172.21.15.121:0/4181300415 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f925c06ccd0 con 0x55d4a1646590 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.070+0000 7f9255200640 1 -- 172.21.15.121:0/4181300415 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c06a310 con 0x55d4a1646590 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.071+0000 7f9272683740 1 -- 172.21.15.121:0/4181300415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a1646590 msgr2=0x55d4a1a07f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.071+0000 7f9272683740 1 --2- 172.21.15.121:0/4181300415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a1646590 0x55d4a1a07f60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f925c00cfd0 tx=0x7f925c062c20 comp rx=0 tx=0).stop 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.071+0000 7f9272683740 1 -- 172.21.15.121:0/4181300415 shutdown_connections 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.071+0000 7f9272683740 1 --2- 172.21.15.121:0/4181300415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a1646590 0x55d4a1a07f60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.071+0000 7f9272683740 1 --2- 172.21.15.121:0/4181300415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a163e3b0 0x55d4a1a37eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.071+0000 7f9272683740 1 --2- 172.21.15.121:0/4181300415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 0x55d4a1a37970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.071+0000 7f9272683740 1 -- 172.21.15.121:0/4181300415 >> 172.21.15.121:0/4181300415 conn(0x55d4a165b3c0 msgr2=0x55d4a1a0d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.071+0000 7f9272683740 1 -- 172.21.15.121:0/4181300415 shutdown_connections 2024-09-17T03:37:39.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.071+0000 7f9272683740 1 -- 172.21.15.121:0/4181300415 wait complete. 2024-09-17T03:37:39.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.072+0000 7f9272683740 1 -- start start 2024-09-17T03:37:39.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.072+0000 7f9272683740 1 Processor -- start 2024-09-17T03:37:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9272683740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a30b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9272683740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1646590 0x55d4a1a4cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9272683740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 0x55d4a1a65680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9272683740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d4a1917330 con 0x55d4a163e3b0 2024-09-17T03:37:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9272683740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d4a1974810 con 0x55d4a1646590 2024-09-17T03:37:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9272683740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d4a16e1620 con 0x55d4a1667270 2024-09-17T03:37:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9272683740 10 client.0 _ll_register_callbacks cb 0x55d4a191c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9268c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a30b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9268c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a30b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53112/0 (socket says 172.21.15.121:53112) 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9268c00640 1 -- 172.21.15.121:0/7484374 learned_addr learned my addr 172.21.15.121:0/7484374 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9263e00640 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1646590 0x55d4a1a4cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.074+0000 7f9269600640 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 0x55d4a1a65680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.075+0000 7f9268c00640 1 -- 172.21.15.121:0/7484374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 msgr2=0x55d4a1a65680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.075+0000 7f9268c00640 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 0x55d4a1a65680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.075+0000 7f9268c00640 1 -- 172.21.15.121:0/7484374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1646590 msgr2=0x55d4a1a4cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.075+0000 7f9268c00640 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1646590 0x55d4a1a4cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.075+0000 7f9268c00640 1 -- 172.21.15.121:0/7484374 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a16d2850 con 0x55d4a163e3b0 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.075+0000 7f9268c00640 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a30b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9258014700 tx=0x7f9258000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38acec0cdf000ae server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.075+0000 7f9249600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.075+0000 7f9249600640 1 -- 172.21.15.121:0/7484374 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258025020 con 0x55d4a163e3b0 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.075+0000 7f9249600640 1 -- 172.21.15.121:0/7484374 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f92580216d0 con 0x55d4a163e3b0 2024-09-17T03:37:39.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.075+0000 7f9272683740 1 -- 172.21.15.121:0/7484374 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f925c06ccd0 con 0x55d4a163e3b0 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9249600640 1 -- 172.21.15.121:0/7484374 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f925802f050 con 0x55d4a163e3b0 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9272683740 10 client.5532 fetch_fsmap learned FSMap version 28 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9272683740 1 -- 172.21.15.121:0/7484374 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55d4a17496b0 con 0x55d4a163e3b0 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9249600640 1 -- 172.21.15.121:0/7484374 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f925c06ccd0 con 0x55d4a163e3b0 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9249600640 1 -- 172.21.15.121:0/7484374 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f9258032020 con 0x55d4a163e3b0 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9272683740 10 client.5532 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9272683740 10 client.5532 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9272683740 20 client.5532 populate_metadata read hostname 'smithi121' 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9272683740 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.121:6834/3704628086,v1:172.21.15.121:6835/3704628086] conn(0x55d4a1625e40 0x55d4a1a620e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9272683740 4 client.5532 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:37:39.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9272683740 1 -- 172.21.15.121:0/7484374 --> [v2:172.21.15.121:6834/3704628086,v1:172.21.15.121:6835/3704628086] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4a1983520 con 0x55d4a1625e40 2024-09-17T03:37:39.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.076+0000 7f9263e00640 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.121:6834/3704628086,v1:172.21.15.121:6835/3704628086] conn(0x55d4a1625e40 0x55d4a1a620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.077+0000 7f9249600640 10 client.5532 ms_handle_connect on v2:172.21.15.121:6834/3704628086 2024-09-17T03:37:39.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.077+0000 7f9263e00640 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.121:6834/3704628086,v1:172.21.15.121:6835/3704628086] conn(0x55d4a1625e40 0x55d4a1a620e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6b2a6445abc37f5 server_cookie=d8a84c84bfd4b00 in_seq=0 out_seq=0 2024-09-17T03:37:39.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9249600640 1 -- 172.21.15.121:0/7484374 <== mds.0 v2:172.21.15.121:6834/3704628086 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4a1983520 con 0x55d4a1625e40 2024-09-17T03:37:39.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9249600640 10 client.5532 handle_command_reply: tid=0 2024-09-17T03:37:39.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 client.5532 shutdown 2024-09-17T03:37:39.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 -- 172.21.15.121:0/7484374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 msgr2=0x55d4a1a30b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a30b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9258014700 tx=0x7f9258000ed0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 -- 172.21.15.121:0/7484374 shutdown_connections 2024-09-17T03:37:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 0x55d4a1a65680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1646590 0x55d4a1a4cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.121:6834/3704628086,v1:172.21.15.121:6835/3704628086] conn(0x55d4a1625e40 0x55d4a1a620e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 --2- 172.21.15.121:0/7484374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a30b60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 -- 172.21.15.121:0/7484374 >> 172.21.15.121:0/7484374 conn(0x55d4a165b3c0 msgr2=0x55d4a1a093f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9249600640 0 client.5532 ms_handle_reset on v2:172.21.15.121:6834/3704628086 2024-09-17T03:37:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 -- 172.21.15.121:0/7484374 shutdown_connections 2024-09-17T03:37:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 1 -- 172.21.15.121:0/7484374 wait complete. 2024-09-17T03:37:39.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.078+0000 7f9272683740 20 client.5532 trim_cache size 0 max 16384 2024-09-17T03:37:39.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.097+0000 7f9272683740 1 Processor -- start 2024-09-17T03:37:39.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.097+0000 7f9272683740 1 -- start start 2024-09-17T03:37:39.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9272683740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a091e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9272683740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1646590 0x55d4a1a09720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9272683740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 0x55d4a1a640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9272683740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f92642016d0 con 0x55d4a163e3b0 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9272683740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f92640c9e90 con 0x55d4a1667270 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9272683740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9264201060 con 0x55d4a1646590 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9268c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9268c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a091e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53126/0 (socket says 172.21.15.121:53126) 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9268c00640 1 -- 172.21.15.121:0/2864239346 learned_addr learned my addr 172.21.15.121:0/2864239346 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9263e00640 1 --2- 172.21.15.121:0/2864239346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1646590 0x55d4a1a09720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9269600640 1 --2- 172.21.15.121:0/2864239346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 0x55d4a1a640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.099+0000 7f9268c00640 1 -- 172.21.15.121:0/2864239346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1646590 msgr2=0x55d4a1a09720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:39.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.100+0000 7f9268c00640 1 --2- 172.21.15.121:0/2864239346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1646590 0x55d4a1a09720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.100+0000 7f9268c00640 1 -- 172.21.15.121:0/2864239346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 msgr2=0x55d4a1a640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.100+0000 7f9268c00640 1 --2- 172.21.15.121:0/2864239346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 0x55d4a1a640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.100+0000 7f9268c00640 1 -- 172.21.15.121:0/2864239346 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a1a0e650 con 0x55d4a163e3b0 2024-09-17T03:37:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.100+0000 7f9269600640 1 --2- 172.21.15.121:0/2864239346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 0x55d4a1a640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.100+0000 7f9268c00640 1 --2- 172.21.15.121:0/2864239346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a091e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9258007d50 tx=0x7f9258007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f181e74248e7aa96 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.100+0000 7f924be00640 1 -- 172.21.15.121:0/2864239346 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258025070 con 0x55d4a163e3b0 2024-09-17T03:37:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.100+0000 7f924be00640 1 -- 172.21.15.121:0/2864239346 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f925801b070 con 0x55d4a163e3b0 2024-09-17T03:37:39.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.100+0000 7f924be00640 1 -- 172.21.15.121:0/2864239346 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258033630 con 0x55d4a163e3b0 2024-09-17T03:37:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.101+0000 7f9272683740 1 -- 172.21.15.121:0/2864239346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 msgr2=0x55d4a1a091e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.101+0000 7f9272683740 1 --2- 172.21.15.121:0/2864239346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a091e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9258007d50 tx=0x7f9258007e30 comp rx=0 tx=0).stop 2024-09-17T03:37:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.101+0000 7f9272683740 1 -- 172.21.15.121:0/2864239346 shutdown_connections 2024-09-17T03:37:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.101+0000 7f9272683740 1 --2- 172.21.15.121:0/2864239346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1667270 0x55d4a1a640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.101+0000 7f9272683740 1 --2- 172.21.15.121:0/2864239346 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1646590 0x55d4a1a09720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.101+0000 7f9272683740 1 --2- 172.21.15.121:0/2864239346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1a091e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.101+0000 7f9272683740 1 -- 172.21.15.121:0/2864239346 >> 172.21.15.121:0/2864239346 conn(0x55d4a165b3c0 msgr2=0x55d4a1a0bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.101+0000 7f9272683740 1 -- 172.21.15.121:0/2864239346 shutdown_connections 2024-09-17T03:37:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.101+0000 7f9272683740 1 -- 172.21.15.121:0/2864239346 wait complete. 2024-09-17T03:37:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.102+0000 7f9272683740 1 -- start start 2024-09-17T03:37:39.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.102+0000 7f9272683740 1 Processor -- start 2024-09-17T03:37:39.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9272683740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1ad1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9272683740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1646590 0x55d4a1a60c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9272683740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 0x55d4a1a611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9272683740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d4a1a34990 con 0x55d4a163e3b0 2024-09-17T03:37:39.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9272683740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d4a1a4d330 con 0x55d4a1646590 2024-09-17T03:37:39.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9272683740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d4a1a2de90 con 0x55d4a1667270 2024-09-17T03:37:39.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9272683740 10 client.0 _ll_register_callbacks cb 0x7f925800fe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:39.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9268c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1ad1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9268c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1ad1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53136/0 (socket says 172.21.15.121:53136) 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9268c00640 1 -- 172.21.15.121:0/3517292367 learned_addr learned my addr 172.21.15.121:0/3517292367 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9263e00640 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1646590 0x55d4a1a60c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9269600640 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 0x55d4a1a611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9268c00640 1 -- 172.21.15.121:0/3517292367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 msgr2=0x55d4a1a611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9268c00640 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 0x55d4a1a611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9268c00640 1 -- 172.21.15.121:0/3517292367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1646590 msgr2=0x55d4a1a60c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9268c00640 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1646590 0x55d4a1a60c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9268c00640 1 -- 172.21.15.121:0/3517292367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a1a52a20 con 0x55d4a163e3b0 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.104+0000 7f9269600640 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 0x55d4a1a611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9268c00640 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1ad1b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9258001050 tx=0x7f9258034a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8bec34d8552e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9249600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:37:39.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9249600640 1 -- 172.21.15.121:0/3517292367 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925803f030 con 0x55d4a163e3b0 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9249600640 1 -- 172.21.15.121:0/3517292367 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f925800f5a0 con 0x55d4a163e3b0 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9272683740 1 -- 172.21.15.121:0/3517292367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f925801b070 con 0x55d4a163e3b0 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9249600640 1 -- 172.21.15.121:0/3517292367 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9258048050 con 0x55d4a163e3b0 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9272683740 10 client.5538 fetch_fsmap learned FSMap version 28 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9272683740 1 -- 172.21.15.121:0/3517292367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55d4a1a52c30 con 0x55d4a163e3b0 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9249600640 1 -- 172.21.15.121:0/3517292367 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f925801b070 con 0x55d4a163e3b0 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9249600640 1 -- 172.21.15.121:0/3517292367 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f925804b020 con 0x55d4a163e3b0 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9272683740 10 client.5538 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9272683740 10 client.5538 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.105+0000 7f9272683740 20 client.5538 populate_metadata read hostname 'smithi121' 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.106+0000 7f9272683740 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.121:6834/3704628086,v1:172.21.15.121:6835/3704628086] conn(0x55d4a1a353d0 0x55d4a1a357e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.106+0000 7f9272683740 4 client.5538 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.106+0000 7f9272683740 1 -- 172.21.15.121:0/3517292367 --> [v2:172.21.15.121:6834/3704628086,v1:172.21.15.121:6835/3704628086] -- command(tid 0: {"prefix": "status"}) -- 0x55d4a197efd0 con 0x55d4a1a353d0 2024-09-17T03:37:39.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.106+0000 7f9263e00640 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.121:6834/3704628086,v1:172.21.15.121:6835/3704628086] conn(0x55d4a1a353d0 0x55d4a1a357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.106+0000 7f9249600640 10 client.5538 ms_handle_connect on v2:172.21.15.121:6834/3704628086 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.106+0000 7f9263e00640 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.121:6834/3704628086,v1:172.21.15.121:6835/3704628086] conn(0x55d4a1a353d0 0x55d4a1a357e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdd1da18c147acb8 server_cookie=faf2f605de240348 in_seq=0 out_seq=0 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.106+0000 7f9249600640 1 -- 172.21.15.121:0/3517292367 <== mds.0 v2:172.21.15.121:6834/3704628086 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55d4a197efd0 con 0x55d4a1a353d0 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9249600640 10 client.5538 handle_command_reply: tid=0 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 client.5538 shutdown 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 -- 172.21.15.121:0/3517292367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 msgr2=0x55d4a1ad1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1ad1b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9258001050 tx=0x7f9258034a90 comp rx=0 tx=0).stop 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 -- 172.21.15.121:0/3517292367 shutdown_connections 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d4a1667270 0x55d4a1a611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d4a1646590 0x55d4a1a60c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.121:6834/3704628086,v1:172.21.15.121:6835/3704628086] conn(0x55d4a1a353d0 0x55d4a1a357e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 --2- 172.21.15.121:0/3517292367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d4a163e3b0 0x55d4a1ad1b90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 -- 172.21.15.121:0/3517292367 >> 172.21.15.121:0/3517292367 conn(0x55d4a165b3c0 msgr2=0x55d4a1a091e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9249600640 0 client.5538 ms_handle_reset on v2:172.21.15.121:6834/3704628086 2024-09-17T03:37:39.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 -- 172.21.15.121:0/3517292367 shutdown_connections 2024-09-17T03:37:39.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 1 -- 172.21.15.121:0/3517292367 wait complete. 2024-09-17T03:37:39.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.107+0000 7f9272683740 20 client.5538 trim_cache size 0 max 16384 2024-09-17T03:37:39.111 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:37:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:37:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:37:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 5388, 2024-09-17T03:37:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:37:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:37:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:37:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 11.589390845, 2024-09-17T03:37:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 28, 2024-09-17T03:37:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 52, 2024-09-17T03:37:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 52, 2024-09-17T03:37:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 16.67984401 2024-09-17T03:37:39.112 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:37:39.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 -- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9244078b90 msgr2=0x7f924407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9244078b90 0x7f924407b0a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9258001720 tx=0x7f9258009040 comp rx=0 tx=0).stop 2024-09-17T03:37:39.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 -- 172.21.15.121:0/1932657733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f926409fd90 msgr2=0x7f92640a01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f926409fd90 0x7f92640a01a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f925c00e960 tx=0x7f925c00ee20 comp rx=0 tx=0).stop 2024-09-17T03:37:39.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 -- 172.21.15.121:0/1932657733 shutdown_connections 2024-09-17T03:37:39.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9244078b90 0x7f924407b0a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f926409fd90 0x7f92640a01a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f926415fc50 0x7f92641f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 --2- 172.21.15.121:0/1932657733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92640cf7d0 0x7f92641f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 -- 172.21.15.121:0/1932657733 >> 172.21.15.121:0/1932657733 conn(0x7f92640b1b90 msgr2=0x7f92640b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 -- 172.21.15.121:0/1932657733 shutdown_connections 2024-09-17T03:37:39.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.108+0000 7f926b600640 1 -- 172.21.15.121:0/1932657733 wait complete. 2024-09-17T03:37:39.132 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:37:39.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.353+0000 7f68ff400640 1 -- 172.21.15.121:0/3745933892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f815e7c0 msgr2=0x7f68f80cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.353+0000 7f68ff400640 1 --2- 172.21.15.121:0/3745933892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f815e7c0 0x7f68f80cde00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f68f0005fd0 tx=0x7f68f002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.353+0000 7f68ff400640 1 -- 172.21.15.121:0/3745933892 shutdown_connections 2024-09-17T03:37:39.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.353+0000 7f68ff400640 1 --2- 172.21.15.121:0/3745933892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f815e7c0 0x7f68f80cde00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.353+0000 7f68ff400640 1 --2- 172.21.15.121:0/3745933892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68f806e500 0x7f68f80af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.353+0000 7f68ff400640 1 -- 172.21.15.121:0/3745933892 >> 172.21.15.121:0/3745933892 conn(0x7f68f80cca40 msgr2=0x7f68f80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.353+0000 7f68ff400640 1 -- 172.21.15.121:0/3745933892 shutdown_connections 2024-09-17T03:37:39.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.353+0000 7f68ff400640 1 -- 172.21.15.121:0/3745933892 wait complete. 2024-09-17T03:37:39.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.356+0000 7f68ff400640 1 Processor -- start 2024-09-17T03:37:39.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.356+0000 7f68ff400640 1 -- start start 2024-09-17T03:37:39.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.357+0000 7f68ff400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f815e7c0 0x7f68f8161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.357+0000 7f68ff400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68f8160810 0x7f68f80b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.357+0000 7f68ff400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68f8160c20 0x7f68f80b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.357+0000 7f68ff400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68f80ce6d0 con 0x7f68f815e7c0 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.357+0000 7f68ff400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f68f80ce550 con 0x7f68f8160810 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.357+0000 7f68ff400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f68f80ce850 con 0x7f68f8160c20 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.357+0000 7f68fca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f815e7c0 0x7f68f8161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.357+0000 7f68fca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f815e7c0 0x7f68f8161320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53152/0 (socket says 172.21.15.121:53152) 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.357+0000 7f68fca00640 1 -- 172.21.15.121:0/159550000 learned_addr learned my addr 172.21.15.121:0/159550000 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68efe00640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68f8160810 0x7f68f80b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68fd400640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68f8160c20 0x7f68f80b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68fca00640 1 -- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68f8160c20 msgr2=0x7f68f80b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68fca00640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68f8160c20 0x7f68f80b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68fca00640 1 -- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68f8160810 msgr2=0x7f68f80b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68fca00640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68f8160810 0x7f68f80b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68fca00640 1 -- 172.21.15.121:0/159550000 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f8161860 con 0x7f68f815e7c0 2024-09-17T03:37:39.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68fca00640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f815e7c0 0x7f68f8161320 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f68e800c3c0 tx=0x7f68e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68f5600640 1 -- 172.21.15.121:0/159550000 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8017070 con 0x7f68f815e7c0 2024-09-17T03:37:39.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68f5600640 1 -- 172.21.15.121:0/159550000 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68e80035f0 con 0x7f68f815e7c0 2024-09-17T03:37:39.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68ff400640 1 -- 172.21.15.121:0/159550000 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f80b3e20 con 0x7f68f815e7c0 2024-09-17T03:37:39.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68f5600640 1 -- 172.21.15.121:0/159550000 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8003a40 con 0x7f68f815e7c0 2024-09-17T03:37:39.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.358+0000 7f68ff400640 1 -- 172.21.15.121:0/159550000 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f80b3340 con 0x7f68f815e7c0 2024-09-17T03:37:39.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.360+0000 7f68ff400640 1 -- 172.21.15.121:0/159550000 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f80ced20 con 0x7f68f815e7c0 2024-09-17T03:37:39.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.361+0000 7f68f5600640 1 -- 172.21.15.121:0/159550000 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f68e801a070 con 0x7f68f815e7c0 2024-09-17T03:37:39.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.362+0000 7f68f5600640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f68d4078b90 0x7f68d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.362+0000 7f68f5600640 1 -- 172.21.15.121:0/159550000 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f68e809a220 con 0x7f68f815e7c0 2024-09-17T03:37:39.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.362+0000 7f68efe00640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f68d4078b90 0x7f68d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.363+0000 7f68efe00640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f68d4078b90 0x7f68d407b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f68e0005fd0 tx=0x7f68e0005850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.367+0000 7f68f5600640 1 -- 172.21.15.121:0/159550000 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f68e80624c0 con 0x7f68f815e7c0 2024-09-17T03:37:39.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.583+0000 7f68ff400640 1 -- 172.21.15.121:0/159550000 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f68f80ca4f0 con 0x7f68f815e7c0 2024-09-17T03:37:39.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.583+0000 7f68f5600640 1 -- 172.21.15.121:0/159550000 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f68e8061dc0 con 0x7f68f815e7c0 2024-09-17T03:37:39.583 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.585+0000 7f68ff400640 1 -- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f68d4078b90 msgr2=0x7f68d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f68d4078b90 0x7f68d407b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f68e0005fd0 tx=0x7f68e0005850 comp rx=0 tx=0).stop 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 -- 172.21.15.121:0/159550000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f815e7c0 msgr2=0x7f68f8161320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f815e7c0 0x7f68f8161320 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f68e800c3c0 tx=0x7f68e800c880 comp rx=0 tx=0).stop 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 -- 172.21.15.121:0/159550000 shutdown_connections 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68f8160c20 0x7f68f80b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68f8160810 0x7f68f80b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f68d4078b90 0x7f68d407b0a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 --2- 172.21.15.121:0/159550000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68f815e7c0 0x7f68f8161320 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 -- 172.21.15.121:0/159550000 >> 172.21.15.121:0/159550000 conn(0x7f68f80cca40 msgr2=0x7f68f80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 -- 172.21.15.121:0/159550000 shutdown_connections 2024-09-17T03:37:39.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39.586+0000 7f68ff400640 1 -- 172.21.15.121:0/159550000 wait complete. 2024-09-17T03:37:39.611 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:37:39.612 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:37:39.612 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:37:39.612 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:37:39.612 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:39.612 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:37:39.612 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:37:39.612 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:37:39.612 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:39.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:39.612 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:37:39.648 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:37:39.648 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:37:39.648 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:37:39.648 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:39.648 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:37:39.648 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42597sec preferred_lft 42597sec 2024-09-17T03:37:39.649 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:39.650 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:37:39.651 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:37:39.651 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:39.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:39.651 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:37:39.742 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:37:39.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:39.745 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:37:39.781 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:37:39.782 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:37:39.782 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:37:39.782 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:37:39.782 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:37:39.782 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:37:39.782 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:37:39.782 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:37:39.782 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:37:39.782 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:37:39.783 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:37:39.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:37:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:39.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:39.978 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:37:40.013 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:37:40.013 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:37:40.014 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:40.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:40.014 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:37:40.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:40.110 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:40.145 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:40.146 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:40.146 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:40.220 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:37:40.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:40.221 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:40.413 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:40.413 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:40.413 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:40.463 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:40.463 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:40.463 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:37:40.463 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:37:40.463 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:40.463 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:37:40.463 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:37:40.463 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:37:40.464 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:37:40.464 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:37:40.464 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:37:40.465 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:37:40.465 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:37:40.467 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:37:40.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:40.468 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:40.524 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:37:40.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:37:40.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:40.622 INFO:teuthology.orchestra.run.smithi121.stdout:client5114 2024-09-17T03:37:40.622 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:40.622 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:40.657 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:37:40.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.918+0000 7fda57c00640 1 -- 172.21.15.121:0/1607702105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda34003aa0 msgr2=0x7fda34003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.918+0000 7fda57c00640 1 --2- 172.21.15.121:0/1607702105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda34003aa0 0x7fda34003f10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fda40009b50 tx=0x7fda34005830 comp rx=0 tx=0).stop 2024-09-17T03:37:40.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.918+0000 7fda55c00640 1 -- 172.21.15.121:0/1607702105 reap_dead start 2024-09-17T03:37:40.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.918+0000 7fda57c00640 1 -- 172.21.15.121:0/1607702105 shutdown_connections 2024-09-17T03:37:40.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.918+0000 7fda57c00640 1 -- 172.21.15.121:0/1607702105 >> 172.21.15.121:0/1607702105 conn(0x7fda500cca40 msgr2=0x7fda500cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:40.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.918+0000 7fda57c00640 1 -- 172.21.15.121:0/1607702105 shutdown_connections 2024-09-17T03:37:40.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.918+0000 7fda57c00640 1 -- 172.21.15.121:0/1607702105 wait complete. 2024-09-17T03:37:40.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.921+0000 7fda57c00640 1 Processor -- start 2024-09-17T03:37:40.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.921+0000 7fda57c00640 1 -- start start 2024-09-17T03:37:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda57c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda500c7a80 0x7fda50159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda57c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda501574a0 0x7fda500c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda57c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda500c9b10 0x7fda501f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda57c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fda5006e680 con 0x7fda500c7a80 2024-09-17T03:37:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda57c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fda5006e500 con 0x7fda501574a0 2024-09-17T03:37:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda57c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fda50070e80 con 0x7fda500c9b10 2024-09-17T03:37:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda55200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda500c7a80 0x7fda50159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda55200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda500c7a80 0x7fda50159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53166/0 (socket says 172.21.15.121:53166) 2024-09-17T03:37:40.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda55200640 1 -- 172.21.15.121:0/1092051720 learned_addr learned my addr 172.21.15.121:0/1092051720 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda55200640 1 -- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda500c9b10 msgr2=0x7fda501f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda55c00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda500c9b10 0x7fda501f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda47e00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda501574a0 0x7fda500c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda55200640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda500c9b10 0x7fda501f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda55200640 1 -- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda501574a0 msgr2=0x7fda500c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda55200640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda501574a0 0x7fda500c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda55200640 1 -- 172.21.15.121:0/1092051720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda500c9f20 con 0x7fda500c7a80 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.923+0000 7fda47e00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda501574a0 0x7fda500c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.924+0000 7fda55200640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda500c7a80 0x7fda50159a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fda40036040 tx=0x7fda40033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.924+0000 7fda4d600640 1 -- 172.21.15.121:0/1092051720 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40038040 con 0x7fda500c7a80 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.924+0000 7fda4d600640 1 -- 172.21.15.121:0/1092051720 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda40004020 con 0x7fda500c7a80 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.924+0000 7fda57c00640 1 -- 172.21.15.121:0/1092051720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5015b920 con 0x7fda500c7a80 2024-09-17T03:37:40.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.924+0000 7fda4d600640 1 -- 172.21.15.121:0/1092051720 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40004470 con 0x7fda500c7a80 2024-09-17T03:37:40.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.924+0000 7fda57c00640 1 -- 172.21.15.121:0/1092051720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5015bee0 con 0x7fda500c7a80 2024-09-17T03:37:40.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.925+0000 7fda57c00640 1 -- 172.21.15.121:0/1092051720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda5006f710 con 0x7fda500c7a80 2024-09-17T03:37:40.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.927+0000 7fda4d600640 1 -- 172.21.15.121:0/1092051720 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda40045020 con 0x7fda500c7a80 2024-09-17T03:37:40.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.928+0000 7fda4d600640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda2c078b90 0x7fda2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.928+0000 7fda4d600640 1 -- 172.21.15.121:0/1092051720 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fda400bb780 con 0x7fda500c7a80 2024-09-17T03:37:40.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.929+0000 7fda47e00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda2c078b90 0x7fda2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.930+0000 7fda47e00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda2c078b90 0x7fda2c07b0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fda38004880 tx=0x7fda38000f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:40.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:40.933+0000 7fda4d600640 1 -- 172.21.15.121:0/1092051720 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fda40083ab0 con 0x7fda500c7a80 2024-09-17T03:37:41.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.150+0000 7fda57c00640 1 -- 172.21.15.121:0/1092051720 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fda500b5f40 con 0x7fda500c7a80 2024-09-17T03:37:41.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.151+0000 7fda4d600640 1 -- 172.21.15.121:0/1092051720 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7fda400833b0 con 0x7fda500c7a80 2024-09-17T03:37:41.151 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:37:41.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.153+0000 7fda57c00640 1 -- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda2c078b90 msgr2=0x7fda2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.153+0000 7fda57c00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda2c078b90 0x7fda2c07b0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fda38004880 tx=0x7fda38000f30 comp rx=0 tx=0).stop 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.153+0000 7fda57c00640 1 -- 172.21.15.121:0/1092051720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda500c7a80 msgr2=0x7fda50159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.153+0000 7fda57c00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda500c7a80 0x7fda50159a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fda40036040 tx=0x7fda40033670 comp rx=0 tx=0).stop 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.154+0000 7fda57c00640 1 -- 172.21.15.121:0/1092051720 shutdown_connections 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.154+0000 7fda57c00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda500c9b10 0x7fda501f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.154+0000 7fda57c00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda501574a0 0x7fda500c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.154+0000 7fda57c00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fda2c078b90 0x7fda2c07b0a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.154+0000 7fda57c00640 1 --2- 172.21.15.121:0/1092051720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda500c7a80 0x7fda50159a40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.154+0000 7fda57c00640 1 -- 172.21.15.121:0/1092051720 >> 172.21.15.121:0/1092051720 conn(0x7fda500cca40 msgr2=0x7fda500afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.154+0000 7fda57c00640 1 -- 172.21.15.121:0/1092051720 shutdown_connections 2024-09-17T03:37:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:41.154+0000 7fda57c00640 1 -- 172.21.15.121:0/1092051720 wait complete. 2024-09-17T03:37:41.177 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:37:41.177 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:37:41.177 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:37:41.177 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:37:41.177 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:37:41.178 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:37:41.178 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:37:41.178 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:37:41.178 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:37:41.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:41.178 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:37:41.219 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:37:41.219 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:37:41.219 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:37:41.219 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:41.219 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:37:41.220 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42593sec preferred_lft 42593sec 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::80c9:d6ff:fe9f:5926/64 scope link 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:41.221 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:41.222 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:37:41.222 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d4cd:10ff:feb7:d68f/64 scope link 2024-09-17T03:37:41.222 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:41.222 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:41.222 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether fe:db:9e:03:5a:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:37:41.222 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::fcdb:9eff:fe03:5a3e/64 scope link 2024-09-17T03:37:41.222 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:41.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:41.223 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:37:41.320 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:37:41.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:41.321 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:37:41.359 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:37:41.359 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:37:41.359 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:37:41.359 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:37:41.359 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:37:41.360 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:37:41.360 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:37:41.360 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:37:41.360 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:37:41.360 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:37:41.360 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:37:41.478 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:37:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:37:41.548 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:37:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:41.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:41.557 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:37:41.592 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:37:41.592 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:37:41.592 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:37:41.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:41.592 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T03:37:41.688 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:41.688 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:37:41.723 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:37:41.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:41.724 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:37:41.798 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:37:41.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:41.799 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:37:41.993 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:37:41.993 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:37:41.993 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:37:42.012 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:37:42.013 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:37:42.013 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:37:42.013 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:37:42.013 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:42.042 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:37:42.043 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:37:42.043 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:37:42.043 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:37:42.043 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:42.043 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:37:42.043 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:37:42.043 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:37:42.044 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:37:42.044 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:37:42.044 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:37:42.044 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:37:42.044 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:37:42.047 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:37:42.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:42.048 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:37:42.103 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:37:42.181 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:37:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:37:42.184 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:42.192 INFO:teuthology.orchestra.run.smithi176.stdout:client5437 2024-09-17T03:37:42.192 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:42.192 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:42.227 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:37:42.228 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:42.333 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:42.411 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:37:42.411 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:42.411 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:42.411 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:42.449 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:42.449 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:42.525 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:37:42.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.787+0000 7f4498e00640 1 -- 172.21.15.121:0/1577928647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44940cf9a0 msgr2=0x7f4494072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:42.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.787+0000 7f4498e00640 1 --2- 172.21.15.121:0/1577928647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44940cf9a0 0x7f4494072d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f448c005fd0 tx=0x7f448c02a940 comp rx=0 tx=0).stop 2024-09-17T03:37:42.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.787+0000 7f4498e00640 1 -- 172.21.15.121:0/1577928647 shutdown_connections 2024-09-17T03:37:42.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.787+0000 7f4498e00640 1 --2- 172.21.15.121:0/1577928647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44940cf9a0 0x7f4494072d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.787+0000 7f4498e00640 1 -- 172.21.15.121:0/1577928647 >> 172.21.15.121:0/1577928647 conn(0x7f44940b1b90 msgr2=0x7f44940b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:42.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.787+0000 7f4498e00640 1 -- 172.21.15.121:0/1577928647 shutdown_connections 2024-09-17T03:37:42.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.787+0000 7f4498e00640 1 -- 172.21.15.121:0/1577928647 wait complete. 2024-09-17T03:37:42.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.789+0000 7f4498e00640 1 Processor -- start 2024-09-17T03:37:42.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.789+0000 7f4498e00640 1 -- start start 2024-09-17T03:37:42.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4498e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44940cf9a0 0x7f4494158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:42.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4498e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f449415fc50 0x7f44941f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:42.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4498e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44941f6600 0x7f44941f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:42.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4498e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4494073450 con 0x7f44941f6600 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4498e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44940732d0 con 0x7f44940cf9a0 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4498e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44940735d0 con 0x7f449415fc50 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4492800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44941f6600 0x7f44941f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4492800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44941f6600 0x7f44941f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57412/0 (socket says 172.21.15.121:57412) 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4492800640 1 -- 172.21.15.121:0/786711947 learned_addr learned my addr 172.21.15.121:0/786711947 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4491e00640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44940cf9a0 0x7f4494158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4489400640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f449415fc50 0x7f44941f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4492800640 1 -- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f449415fc50 msgr2=0x7f44941f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4492800640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f449415fc50 0x7f44941f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4492800640 1 -- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44940cf9a0 msgr2=0x7f4494158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4492800640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44940cf9a0 0x7f4494158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.791+0000 7f4492800640 1 -- 172.21.15.121:0/786711947 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44941f3680 con 0x7f44941f6600 2024-09-17T03:37:42.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.792+0000 7f4492800640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44941f6600 0x7f44941f6a10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f448c02af30 tx=0x7f448c031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:42.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.792+0000 7f448aa00640 1 -- 172.21.15.121:0/786711947 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c03e070 con 0x7f44941f6600 2024-09-17T03:37:42.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.792+0000 7f448aa00640 1 -- 172.21.15.121:0/786711947 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f448c004580 con 0x7f44941f6600 2024-09-17T03:37:42.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.792+0000 7f4498e00640 1 -- 172.21.15.121:0/786711947 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44941f3960 con 0x7f44941f6600 2024-09-17T03:37:42.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.792+0000 7f448aa00640 1 -- 172.21.15.121:0/786711947 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c030430 con 0x7f44941f6600 2024-09-17T03:37:42.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.792+0000 7f4498e00640 1 -- 172.21.15.121:0/786711947 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4494159470 con 0x7f44941f6600 2024-09-17T03:37:42.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.793+0000 7f4498e00640 1 -- 172.21.15.121:0/786711947 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4494072d90 con 0x7f44941f6600 2024-09-17T03:37:42.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.794+0000 7f448aa00640 1 -- 172.21.15.121:0/786711947 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f448c043460 con 0x7f44941f6600 2024-09-17T03:37:42.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.795+0000 7f448aa00640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4470078b90 0x7f447007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:42.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.796+0000 7f448aa00640 1 -- 172.21.15.121:0/786711947 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f448c0bc380 con 0x7f44941f6600 2024-09-17T03:37:42.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.796+0000 7f4491e00640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4470078b90 0x7f447007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:42.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.797+0000 7f4491e00640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4470078b90 0x7f447007b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4484000f60 tx=0x7f4484009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:42.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.800+0000 7f448aa00640 1 -- 172.21.15.121:0/786711947 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f448c04a070 con 0x7f44941f6600 2024-09-17T03:37:42.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.994+0000 7f4498e00640 1 -- 172.21.15.121:0/786711947 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f44940c6c30 con 0x7f44941f6600 2024-09-17T03:37:42.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.994+0000 7f448aa00640 1 -- 172.21.15.121:0/786711947 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) ==== 80+0+0 (secure 0 0 0) 0x7f448c083ec0 con 0x7f44941f6600 2024-09-17T03:37:42.994 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:37:42.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.996+0000 7f4498e00640 1 -- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4470078b90 msgr2=0x7f447007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:42.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.996+0000 7f4498e00640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4470078b90 0x7f447007b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4484000f60 tx=0x7f4484009040 comp rx=0 tx=0).stop 2024-09-17T03:37:42.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.996+0000 7f4498e00640 1 -- 172.21.15.121:0/786711947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44941f6600 msgr2=0x7f44941f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:42.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.996+0000 7f4498e00640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44941f6600 0x7f44941f6a10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f448c02af30 tx=0x7f448c031e20 comp rx=0 tx=0).stop 2024-09-17T03:37:42.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.996+0000 7f4498e00640 1 -- 172.21.15.121:0/786711947 shutdown_connections 2024-09-17T03:37:42.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.996+0000 7f4498e00640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4470078b90 0x7f447007b0a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.996+0000 7f4498e00640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44941f6600 0x7f44941f6a10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.996+0000 7f4498e00640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f449415fc50 0x7f44941f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.996+0000 7f4498e00640 1 --2- 172.21.15.121:0/786711947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44940cf9a0 0x7f4494158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.996+0000 7f4498e00640 1 -- 172.21.15.121:0/786711947 >> 172.21.15.121:0/786711947 conn(0x7f44940b1b90 msgr2=0x7f449406f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:42.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.997+0000 7f4498e00640 1 -- 172.21.15.121:0/786711947 shutdown_connections 2024-09-17T03:37:42.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:42.997+0000 7f4498e00640 1 -- 172.21.15.121:0/786711947 wait complete. 2024-09-17T03:37:43.018 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:37:43.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:43.018 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:43.080 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:37:43.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:43.080 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:37:43.116 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:43.117 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:43.117 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:43.154 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:43.154 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:43.230 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:37:43.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.452+0000 7fe17ea00640 1 -- 172.21.15.121:0/855430924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe178074b60 msgr2=0x7fe17806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:43.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.452+0000 7fe17ea00640 1 --2- 172.21.15.121:0/855430924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe178074b60 0x7fe17806ddf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe164005fd0 tx=0x7fe16402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.452+0000 7fe17ea00640 1 -- 172.21.15.121:0/855430924 shutdown_connections 2024-09-17T03:37:43.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.452+0000 7fe17ea00640 1 --2- 172.21.15.121:0/855430924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe178074b60 0x7fe17806ddf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.452+0000 7fe17ea00640 1 --2- 172.21.15.121:0/855430924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe178156a50 0x7fe178074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.452+0000 7fe17ea00640 1 -- 172.21.15.121:0/855430924 >> 172.21.15.121:0/855430924 conn(0x7fe1780b1b90 msgr2=0x7fe1780b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:43.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.452+0000 7fe17ea00640 1 -- 172.21.15.121:0/855430924 shutdown_connections 2024-09-17T03:37:43.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.452+0000 7fe17ea00640 1 -- 172.21.15.121:0/855430924 wait complete. 2024-09-17T03:37:43.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.454+0000 7fe17ea00640 1 Processor -- start 2024-09-17T03:37:43.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.454+0000 7fe17ea00640 1 -- start start 2024-09-17T03:37:43.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe17ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe17806e330 0x7fe17815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:43.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe17ea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe178074b60 0x7fe17815c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:43.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe17ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe178156a50 0x7fe17809edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:43.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe17ea00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1780ce500 con 0x7fe17806e330 2024-09-17T03:37:43.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe17ea00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1780ce380 con 0x7fe178074b60 2024-09-17T03:37:43.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe17ea00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe1780ce680 con 0x7fe178156a50 2024-09-17T03:37:43.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe177e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe17806e330 0x7fe17815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:43.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe177e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe17806e330 0x7fe17815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57416/0 (socket says 172.21.15.121:57416) 2024-09-17T03:37:43.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe177e00640 1 -- 172.21.15.121:0/930728737 learned_addr learned my addr 172.21.15.121:0/930728737 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:43.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe177400640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe178074b60 0x7fe17815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:43.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe17ca00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe178156a50 0x7fe17809edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:43.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe177e00640 1 -- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe178156a50 msgr2=0x7fe17809edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:43.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe177e00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe178156a50 0x7fe17809edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe177e00640 1 -- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe178074b60 msgr2=0x7fe17815c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:43.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.456+0000 7fe177e00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe178074b60 0x7fe17815c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.457+0000 7fe177e00640 1 -- 172.21.15.121:0/930728737 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1780a0a80 con 0x7fe17806e330 2024-09-17T03:37:43.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.457+0000 7fe177e00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe17806e330 0x7fe17815be40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe16800eb60 tx=0x7fe16800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:43.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.457+0000 7fe16fe00640 1 -- 172.21.15.121:0/930728737 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168010630 con 0x7fe17806e330 2024-09-17T03:37:43.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.457+0000 7fe16fe00640 1 -- 172.21.15.121:0/930728737 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1680108c0 con 0x7fe17806e330 2024-09-17T03:37:43.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.457+0000 7fe16fe00640 1 -- 172.21.15.121:0/930728737 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168010d10 con 0x7fe17806e330 2024-09-17T03:37:43.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.457+0000 7fe17ea00640 1 -- 172.21.15.121:0/930728737 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1781f9df0 con 0x7fe17806e330 2024-09-17T03:37:43.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.457+0000 7fe17ea00640 1 -- 172.21.15.121:0/930728737 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1781f9310 con 0x7fe17806e330 2024-09-17T03:37:43.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.458+0000 7fe17ea00640 1 -- 172.21.15.121:0/930728737 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe17806ddf0 con 0x7fe17806e330 2024-09-17T03:37:43.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.460+0000 7fe16fe00640 1 -- 172.21.15.121:0/930728737 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe168018420 con 0x7fe17806e330 2024-09-17T03:37:43.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.460+0000 7fe16fe00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe158078bc0 0x7fe15807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:43.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.461+0000 7fe16fe00640 1 -- 172.21.15.121:0/930728737 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fe16809bc40 con 0x7fe17806e330 2024-09-17T03:37:43.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.461+0000 7fe177400640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe158078bc0 0x7fe15807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:43.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.462+0000 7fe177400640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe158078bc0 0x7fe15807b0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe164033000 tx=0x7fe164004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:43.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.465+0000 7fe16fe00640 1 -- 172.21.15.121:0/930728737 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe16800ee60 con 0x7fe17806e330 2024-09-17T03:37:43.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.664+0000 7fe17ea00640 1 -- 172.21.15.121:0/930728737 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe178073f10 con 0x7fe17806e330 2024-09-17T03:37:43.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.664+0000 7fe16fe00640 1 -- 172.21.15.121:0/930728737 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) ==== 80+0+0 (secure 0 0 0) 0x7fe168063ef0 con 0x7fe17806e330 2024-09-17T03:37:43.664 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 -- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe158078bc0 msgr2=0x7fe15807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe158078bc0 0x7fe15807b0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe164033000 tx=0x7fe164004730 comp rx=0 tx=0).stop 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 -- 172.21.15.121:0/930728737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe17806e330 msgr2=0x7fe17815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe17806e330 0x7fe17815be40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe16800eb60 tx=0x7fe16800c6a0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 -- 172.21.15.121:0/930728737 shutdown_connections 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe178156a50 0x7fe17809edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe178074b60 0x7fe17815c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe158078bc0 0x7fe15807b0d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 --2- 172.21.15.121:0/930728737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe17806e330 0x7fe17815be40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 -- 172.21.15.121:0/930728737 >> 172.21.15.121:0/930728737 conn(0x7fe1780b1b90 msgr2=0x7fe1780b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 -- 172.21.15.121:0/930728737 shutdown_connections 2024-09-17T03:37:43.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:43.667+0000 7fe17ea00640 1 -- 172.21.15.121:0/930728737 wait complete. 2024-09-17T03:37:43.691 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:37:43.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:43.691 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:37:43.753 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:37:43.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:43.754 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:37:43.790 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:43.790 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:43.790 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:43.826 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:37:43.826 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:43.826 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:43.826 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:43.865 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:43.865 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:44.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.085+0000 7fce69600640 1 -- 172.21.15.121:0/3423819955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce48004800 msgr2=0x7fce48004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.085+0000 7fce69600640 1 --2- 172.21.15.121:0/3423819955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce48004800 0x7fce48004c10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c290 tx=0x7fce48005830 comp rx=0 tx=0).stop 2024-09-17T03:37:44.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.085+0000 7fce63400640 1 -- 172.21.15.121:0/3423819955 reap_dead start 2024-09-17T03:37:44.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.085+0000 7fce69600640 1 -- 172.21.15.121:0/3423819955 shutdown_connections 2024-09-17T03:37:44.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.085+0000 7fce69600640 1 -- 172.21.15.121:0/3423819955 >> 172.21.15.121:0/3423819955 conn(0x7fce640cca40 msgr2=0x7fce640cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:44.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.085+0000 7fce69600640 1 -- 172.21.15.121:0/3423819955 shutdown_connections 2024-09-17T03:37:44.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.085+0000 7fce69600640 1 -- 172.21.15.121:0/3423819955 wait complete. 2024-09-17T03:37:44.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.087+0000 7fce69600640 1 Processor -- start 2024-09-17T03:37:44.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.087+0000 7fce69600640 1 -- start start 2024-09-17T03:37:44.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce69600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce48004800 0x7fce640b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce69600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce640b0dc0 0x7fce64070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce69600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640705d0 0x7fce64153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce69600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce6406ede0 con 0x7fce640b0dc0 2024-09-17T03:37:44.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce69600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fce64074200 con 0x7fce48004800 2024-09-17T03:37:44.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce69600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fce6406ef60 con 0x7fce640705d0 2024-09-17T03:37:44.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce62000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce640b0dc0 0x7fce64070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce62a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce48004800 0x7fce640b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce62000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce640b0dc0 0x7fce64070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57434/0 (socket says 172.21.15.121:57434) 2024-09-17T03:37:44.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce62000640 1 -- 172.21.15.121:0/3631262980 learned_addr learned my addr 172.21.15.121:0/3631262980 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce63400640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640705d0 0x7fce64153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.089+0000 7fce62a00640 1 -- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640705d0 msgr2=0x7fce64153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.090+0000 7fce62a00640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640705d0 0x7fce64153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.090+0000 7fce62a00640 1 -- 172.21.15.121:0/3631262980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce640b0dc0 msgr2=0x7fce64070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.090+0000 7fce62a00640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce640b0dc0 0x7fce64070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.090+0000 7fce62a00640 1 -- 172.21.15.121:0/3631262980 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce640b0bd0 con 0x7fce48004800 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.090+0000 7fce62a00640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce48004800 0x7fce640b0690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fce54005fd0 tx=0x7fce5400e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.090+0000 7fce5aa00640 1 -- 172.21.15.121:0/3631262980 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54003b70 con 0x7fce48004800 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.090+0000 7fce5aa00640 1 -- 172.21.15.121:0/3631262980 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce54015070 con 0x7fce48004800 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.090+0000 7fce69600640 1 -- 172.21.15.121:0/3631262980 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce640709e0 con 0x7fce48004800 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.090+0000 7fce5aa00640 1 -- 172.21.15.121:0/3631262980 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54004290 con 0x7fce48004800 2024-09-17T03:37:44.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.090+0000 7fce69600640 1 -- 172.21.15.121:0/3631262980 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce64152680 con 0x7fce48004800 2024-09-17T03:37:44.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.091+0000 7fce69600640 1 -- 172.21.15.121:0/3631262980 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce64050f60 con 0x7fce48004800 2024-09-17T03:37:44.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.092+0000 7fce5aa00640 1 -- 172.21.15.121:0/3631262980 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce54004430 con 0x7fce48004800 2024-09-17T03:37:44.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.093+0000 7fce5aa00640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce44078b90 0x7fce4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.093+0000 7fce5aa00640 1 -- 172.21.15.121:0/3631262980 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fce5409bb80 con 0x7fce48004800 2024-09-17T03:37:44.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.094+0000 7fce62000640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce44078b90 0x7fce4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.095+0000 7fce62000640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce44078b90 0x7fce4407b0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fce641f6af0 tx=0x7fce50038040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:44.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.099+0000 7fce5aa00640 1 -- 172.21.15.121:0/3631262980 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce64050f60 con 0x7fce48004800 2024-09-17T03:37:44.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.315+0000 7fce69600640 1 -- 172.21.15.121:0/3631262980 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce640cc020 con 0x7fce48004800 2024-09-17T03:37:44.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.316+0000 7fce5aa00640 1 -- 172.21.15.121:0/3631262980 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5235 (secure 0 0 0) 0x7fce640709e0 con 0x7fce48004800 2024-09-17T03:37:44.316 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:44.316 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"btime":"2024-09-17T03:37:30:553841+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4041842554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4041842554},{"type":"v1","addr":"172.21.15.176:6837","nonce":4041842554}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5308,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1921105537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1921105537},{"type":"v1","addr":"172.21.15.176:6836","nonce":1921105537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/1479695563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1479695563},{"type":"v1","addr":"172.21.15.121:6833","nonce":1479695563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:27.000747+0000","modified":"2024-09-17T03:37:30.040560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5388},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5388":{"gid":5388,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3704628086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3704628086},{"type":"v1","addr":"172.21.15.121:6835","nonce":3704628086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5388,"qdb_cluster":[5388]},"id":3}]} 2024-09-17T03:37:44.316 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 28 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.318+0000 7fce69600640 1 -- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce44078b90 msgr2=0x7fce4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.318+0000 7fce69600640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce44078b90 0x7fce4407b0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fce641f6af0 tx=0x7fce50038040 comp rx=0 tx=0).stop 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.318+0000 7fce69600640 1 -- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce48004800 msgr2=0x7fce640b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.318+0000 7fce69600640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce48004800 0x7fce640b0690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fce54005fd0 tx=0x7fce5400e720 comp rx=0 tx=0).stop 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.319+0000 7fce69600640 1 -- 172.21.15.121:0/3631262980 shutdown_connections 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.319+0000 7fce69600640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce640705d0 0x7fce64153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.319+0000 7fce69600640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fce44078b90 0x7fce4407b0a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.319+0000 7fce69600640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce640b0dc0 0x7fce64070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.319+0000 7fce69600640 1 --2- 172.21.15.121:0/3631262980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce48004800 0x7fce640b0690 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.319+0000 7fce69600640 1 -- 172.21.15.121:0/3631262980 >> 172.21.15.121:0/3631262980 conn(0x7fce640cca40 msgr2=0x7fce6409af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.319+0000 7fce69600640 1 -- 172.21.15.121:0/3631262980 shutdown_connections 2024-09-17T03:37:44.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.319+0000 7fce69600640 1 -- 172.21.15.121:0/3631262980 wait complete. 2024-09-17T03:37:44.342 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:44.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.564+0000 7fc3b5000640 1 -- 172.21.15.121:0/1232631308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3b015b9f0 msgr2=0x7fc3b00cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.564+0000 7fc3b5000640 1 --2- 172.21.15.121:0/1232631308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3b015b9f0 0x7fc3b00cf930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0005fd0 tx=0x7fc3a002aa90 comp rx=0 tx=0).stop 2024-09-17T03:37:44.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.564+0000 7fc3b5000640 1 -- 172.21.15.121:0/1232631308 shutdown_connections 2024-09-17T03:37:44.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.564+0000 7fc3b5000640 1 --2- 172.21.15.121:0/1232631308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3b015f5a0 0x7fc3b015f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.564+0000 7fc3b5000640 1 --2- 172.21.15.121:0/1232631308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3b015b9f0 0x7fc3b00cf930 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.564+0000 7fc3b5000640 1 -- 172.21.15.121:0/1232631308 >> 172.21.15.121:0/1232631308 conn(0x7fc3b00cca40 msgr2=0x7fc3b00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:44.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.564+0000 7fc3b5000640 1 -- 172.21.15.121:0/1232631308 shutdown_connections 2024-09-17T03:37:44.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.564+0000 7fc3b5000640 1 -- 172.21.15.121:0/1232631308 wait complete. 2024-09-17T03:37:44.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.566+0000 7fc3b5000640 1 Processor -- start 2024-09-17T03:37:44.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.566+0000 7fc3b5000640 1 -- start start 2024-09-17T03:37:44.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3b5000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3b00cefa0 0x7fc3b009df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3b5000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b015b9f0 0x7fc3b01f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3b5000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3b015f5a0 0x7fc3b009cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3b5000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b006df70 con 0x7fc3b015f5a0 2024-09-17T03:37:44.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3b5000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b006ddf0 con 0x7fc3b015b9f0 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3b5000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b006e0f0 con 0x7fc3b00cefa0 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3ae800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3b015f5a0 0x7fc3b009cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3ade00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3b00cefa0 0x7fc3b009df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3ae800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3b015f5a0 0x7fc3b009cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57452/0 (socket says 172.21.15.121:57452) 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3ae800640 1 -- 172.21.15.121:0/2389305283 learned_addr learned my addr 172.21.15.121:0/2389305283 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3ad400640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b015b9f0 0x7fc3b01f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3ae800640 1 -- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3b00cefa0 msgr2=0x7fc3b009df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3ae800640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3b00cefa0 0x7fc3b009df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3ae800640 1 -- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b015b9f0 msgr2=0x7fc3b01f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3ae800640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b015b9f0 0x7fc3b01f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.568+0000 7fc3ae800640 1 -- 172.21.15.121:0/2389305283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b009bef0 con 0x7fc3b015f5a0 2024-09-17T03:37:44.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.569+0000 7fc3ae800640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3b015f5a0 0x7fc3b009cf90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800d780 tx=0x7fc3a800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:44.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.569+0000 7fc3a6000640 1 -- 172.21.15.121:0/2389305283 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8017070 con 0x7fc3b015f5a0 2024-09-17T03:37:44.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.569+0000 7fc3a6000640 1 -- 172.21.15.121:0/2389305283 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3a8004310 con 0x7fc3b015f5a0 2024-09-17T03:37:44.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.569+0000 7fc3a6000640 1 -- 172.21.15.121:0/2389305283 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8005280 con 0x7fc3b015f5a0 2024-09-17T03:37:44.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.569+0000 7fc3b5000640 1 -- 172.21.15.121:0/2389305283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b009c1d0 con 0x7fc3b015f5a0 2024-09-17T03:37:44.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.569+0000 7fc3b5000640 1 -- 172.21.15.121:0/2389305283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b009c790 con 0x7fc3b015f5a0 2024-09-17T03:37:44.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.570+0000 7fc3b5000640 1 -- 172.21.15.121:0/2389305283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b006e5f0 con 0x7fc3b015f5a0 2024-09-17T03:37:44.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.572+0000 7fc3a6000640 1 -- 172.21.15.121:0/2389305283 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc3a8005420 con 0x7fc3b015f5a0 2024-09-17T03:37:44.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.572+0000 7fc3a6000640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc390078b90 0x7fc39007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.573+0000 7fc3a6000640 1 -- 172.21.15.121:0/2389305283 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fc3a809b110 con 0x7fc3b015f5a0 2024-09-17T03:37:44.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.573+0000 7fc3ade00640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc390078b90 0x7fc39007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.574+0000 7fc3ade00640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc390078b90 0x7fc39007b0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0035000 tx=0x7fc3a0038040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:44.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.577+0000 7fc3a6000640 1 -- 172.21.15.121:0/2389305283 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc3a8020020 con 0x7fc3b015f5a0 2024-09-17T03:37:44.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.796+0000 7fc3b5000640 1 -- 172.21.15.121:0/2389305283 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3b00cb3e0 con 0x7fc3b015f5a0 2024-09-17T03:37:44.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.797+0000 7fc3a6000640 1 -- 172.21.15.121:0/2389305283 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5235 (secure 0 0 0) 0x7fc3a8062d70 con 0x7fc3b015f5a0 2024-09-17T03:37:44.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:44.797 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"btime":"2024-09-17T03:37:30:553841+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4041842554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4041842554},{"type":"v1","addr":"172.21.15.176:6837","nonce":4041842554}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5308,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1921105537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1921105537},{"type":"v1","addr":"172.21.15.176:6836","nonce":1921105537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/1479695563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1479695563},{"type":"v1","addr":"172.21.15.121:6833","nonce":1479695563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:27.000747+0000","modified":"2024-09-17T03:37:30.040560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5388},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5388":{"gid":5388,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3704628086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3704628086},{"type":"v1","addr":"172.21.15.121:6835","nonce":3704628086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5388,"qdb_cluster":[5388]},"id":3}]} 2024-09-17T03:37:44.797 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 28 2024-09-17T03:37:44.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 -- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc390078b90 msgr2=0x7fc39007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc390078b90 0x7fc39007b0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0035000 tx=0x7fc3a0038040 comp rx=0 tx=0).stop 2024-09-17T03:37:44.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 -- 172.21.15.121:0/2389305283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3b015f5a0 msgr2=0x7fc3b009cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3b015f5a0 0x7fc3b009cf90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800d780 tx=0x7fc3a800dc40 comp rx=0 tx=0).stop 2024-09-17T03:37:44.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 -- 172.21.15.121:0/2389305283 shutdown_connections 2024-09-17T03:37:44.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc390078b90 0x7fc39007b0a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3b015f5a0 0x7fc3b009cf90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b015b9f0 0x7fc3b01f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 --2- 172.21.15.121:0/2389305283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3b00cefa0 0x7fc3b009df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 -- 172.21.15.121:0/2389305283 >> 172.21.15.121:0/2389305283 conn(0x7fc3b00cca40 msgr2=0x7fc3b0159560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:44.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 -- 172.21.15.121:0/2389305283 shutdown_connections 2024-09-17T03:37:44.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:44.799+0000 7fc3b5000640 1 -- 172.21.15.121:0/2389305283 wait complete. 2024-09-17T03:37:44.822 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:45.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.043+0000 7ffa63200640 1 -- 172.21.15.121:0/1107381388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa640d2520 msgr2=0x7ffa640cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.043+0000 7ffa63200640 1 --2- 172.21.15.121:0/1107381388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa640d2520 0x7ffa640cf4b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009830 tx=0x7ffa5002a3e0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.043+0000 7ffa63200640 1 -- 172.21.15.121:0/1107381388 shutdown_connections 2024-09-17T03:37:45.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.043+0000 7ffa63200640 1 --2- 172.21.15.121:0/1107381388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa640d2520 0x7ffa640cf4b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.043+0000 7ffa63200640 1 --2- 172.21.15.121:0/1107381388 >> v2:172.21.15.176:3300/0 conn(0x7ffa640ceff0 0x7ffa6415e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.043+0000 7ffa63200640 1 -- 172.21.15.121:0/1107381388 >> 172.21.15.121:0/1107381388 conn(0x7ffa640d4360 msgr2=0x7ffa640d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:45.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.043+0000 7ffa63200640 1 -- 172.21.15.121:0/1107381388 shutdown_connections 2024-09-17T03:37:45.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.043+0000 7ffa63200640 1 -- 172.21.15.121:0/1107381388 wait complete. 2024-09-17T03:37:45.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.045+0000 7ffa63200640 1 Processor -- start 2024-09-17T03:37:45.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.045+0000 7ffa63200640 1 -- start start 2024-09-17T03:37:45.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa63200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa640ceff0 0x7ffa641569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa63200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa640cf9f0 0x7ffa64156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa63200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa640d2520 0x7ffa641f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa63200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641628d0 con 0x7ffa640ceff0 2024-09-17T03:37:45.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa63200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa640b9510 con 0x7ffa640d2520 2024-09-17T03:37:45.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa63200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa64162a50 con 0x7ffa640cf9f0 2024-09-17T03:37:45.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa61e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa640ceff0 0x7ffa641569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa61e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa640ceff0 0x7ffa641569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57468/0 (socket says 172.21.15.121:57468) 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa61e00640 1 -- 172.21.15.121:0/2589236366 learned_addr learned my addr 172.21.15.121:0/2589236366 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa61400640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa640cf9f0 0x7ffa64156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.047+0000 7ffa62800640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa640d2520 0x7ffa641f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa61e00640 1 -- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa640cf9f0 msgr2=0x7ffa64156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa61e00640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa640cf9f0 0x7ffa64156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa61e00640 1 -- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa640d2520 msgr2=0x7ffa641f8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa61e00640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa640d2520 0x7ffa641f8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa61e00640 1 -- 172.21.15.121:0/2589236366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa640cacb0 con 0x7ffa640ceff0 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa62800640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa640d2520 0x7ffa641f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa61e00640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa640ceff0 0x7ffa641569f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400e7c0 tx=0x7ffa5400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa5a000640 1 -- 172.21.15.121:0/2589236366 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400ccc0 con 0x7ffa640ceff0 2024-09-17T03:37:45.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa5a000640 1 -- 172.21.15.121:0/2589236366 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa54010430 con 0x7ffa640ceff0 2024-09-17T03:37:45.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa63200640 1 -- 172.21.15.121:0/2589236366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa64147370 con 0x7ffa640ceff0 2024-09-17T03:37:45.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa5a000640 1 -- 172.21.15.121:0/2589236366 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54010860 con 0x7ffa640ceff0 2024-09-17T03:37:45.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.048+0000 7ffa63200640 1 -- 172.21.15.121:0/2589236366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa64160110 con 0x7ffa640ceff0 2024-09-17T03:37:45.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.050+0000 7ffa63200640 1 -- 172.21.15.121:0/2589236366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa64162f90 con 0x7ffa640ceff0 2024-09-17T03:37:45.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.051+0000 7ffa5a000640 1 -- 172.21.15.121:0/2589236366 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa54010a00 con 0x7ffa640ceff0 2024-09-17T03:37:45.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.052+0000 7ffa5a000640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffa44078b90 0x7ffa4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.052+0000 7ffa5a000640 1 -- 172.21.15.121:0/2589236366 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7ffa5409b840 con 0x7ffa640ceff0 2024-09-17T03:37:45.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.052+0000 7ffa61400640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffa44078b90 0x7ffa4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.053+0000 7ffa61400640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffa44078b90 0x7ffa4407b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffa50034000 tx=0x7ffa50004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:45.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.056+0000 7ffa5a000640 1 -- 172.21.15.121:0/2589236366 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffa540634b0 con 0x7ffa640ceff0 2024-09-17T03:37:45.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.238+0000 7ffa63200640 1 -- 172.21.15.121:0/2589236366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa6415dda0 con 0x7ffa640ceff0 2024-09-17T03:37:45.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.240+0000 7ffa5a000640 1 -- 172.21.15.121:0/2589236366 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+17002 (secure 0 0 0) 0x7ffa54067ee0 con 0x7ffa640ceff0 2024-09-17T03:37:45.240 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:45.240 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":52,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:37:28.529919+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:24.915132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:25.975087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:45.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 -- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffa44078b90 msgr2=0x7ffa4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffa44078b90 0x7ffa4407b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffa50034000 tx=0x7ffa50004730 comp rx=0 tx=0).stop 2024-09-17T03:37:45.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 -- 172.21.15.121:0/2589236366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa640ceff0 msgr2=0x7ffa641569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa640ceff0 0x7ffa641569f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400e7c0 tx=0x7ffa5400ec80 comp rx=0 tx=0).stop 2024-09-17T03:37:45.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 -- 172.21.15.121:0/2589236366 shutdown_connections 2024-09-17T03:37:45.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa640d2520 0x7ffa641f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa640cf9f0 0x7ffa64156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffa44078b90 0x7ffa4407b0a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 --2- 172.21.15.121:0/2589236366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa640ceff0 0x7ffa641569f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 -- 172.21.15.121:0/2589236366 >> 172.21.15.121:0/2589236366 conn(0x7ffa640d4360 msgr2=0x7ffa6406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:45.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 -- 172.21.15.121:0/2589236366 shutdown_connections 2024-09-17T03:37:45.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.242+0000 7ffa63200640 1 -- 172.21.15.121:0/2589236366 wait complete. 2024-09-17T03:37:45.266 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:37:45.266 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:45.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.485+0000 7fde5f600640 1 -- 172.21.15.121:0/2615265395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde58073dd0 msgr2=0x7fde5806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.485+0000 7fde5f600640 1 --2- 172.21.15.121:0/2615265395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde58073dd0 0x7fde5806ddf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fde40009830 tx=0x7fde4002a510 comp rx=0 tx=0).stop 2024-09-17T03:37:45.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.485+0000 7fde5f600640 1 -- 172.21.15.121:0/2615265395 shutdown_connections 2024-09-17T03:37:45.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.485+0000 7fde5f600640 1 --2- 172.21.15.121:0/2615265395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5806e330 0x7fde5806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.485+0000 7fde5f600640 1 --2- 172.21.15.121:0/2615265395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde58073dd0 0x7fde5806ddf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.485+0000 7fde5f600640 1 -- 172.21.15.121:0/2615265395 >> 172.21.15.121:0/2615265395 conn(0x7fde580cca40 msgr2=0x7fde580cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:45.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.485+0000 7fde5f600640 1 -- 172.21.15.121:0/2615265395 shutdown_connections 2024-09-17T03:37:45.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.485+0000 7fde5f600640 1 -- 172.21.15.121:0/2615265395 wait complete. 2024-09-17T03:37:45.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.487+0000 7fde5f600640 1 Processor -- start 2024-09-17T03:37:45.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.488+0000 7fde5f600640 1 -- start start 2024-09-17T03:37:45.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.489+0000 7fde5f600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde5806e330 0x7fde58151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.489+0000 7fde5f600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde58073dd0 0x7fde580c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.489+0000 7fde5f600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde58074cb0 0x7fde581f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.489+0000 7fde5f600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fde5806f4a0 con 0x7fde5806e330 2024-09-17T03:37:45.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.489+0000 7fde5f600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fde5806f320 con 0x7fde58073dd0 2024-09-17T03:37:45.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.489+0000 7fde5f600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde5806f620 con 0x7fde58074cb0 2024-09-17T03:37:45.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.489+0000 7fde5cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde5806e330 0x7fde58151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.489+0000 7fde5cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde5806e330 0x7fde58151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57482/0 (socket says 172.21.15.121:57482) 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.489+0000 7fde5cc00640 1 -- 172.21.15.121:0/3990975147 learned_addr learned my addr 172.21.15.121:0/3990975147 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde4fe00640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde58073dd0 0x7fde580c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde5d600640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde58074cb0 0x7fde581f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde5cc00640 1 -- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde58074cb0 msgr2=0x7fde581f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde5cc00640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde58074cb0 0x7fde581f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde5cc00640 1 -- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde58073dd0 msgr2=0x7fde580c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde5cc00640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde58073dd0 0x7fde580c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde5cc00640 1 -- 172.21.15.121:0/3990975147 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde580ca390 con 0x7fde5806e330 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde4fe00640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde58073dd0 0x7fde580c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde5d600640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde58074cb0 0x7fde581f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde5cc00640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde5806e330 0x7fde58151f00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fde4800c3c0 tx=0x7fde4800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:45.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde55600640 1 -- 172.21.15.121:0/3990975147 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48017070 con 0x7fde5806e330 2024-09-17T03:37:45.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde55600640 1 -- 172.21.15.121:0/3990975147 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde480035f0 con 0x7fde5806e330 2024-09-17T03:37:45.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde55600640 1 -- 172.21.15.121:0/3990975147 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48003a20 con 0x7fde5806e330 2024-09-17T03:37:45.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.490+0000 7fde5f600640 1 -- 172.21.15.121:0/3990975147 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde580cdf50 con 0x7fde5806e330 2024-09-17T03:37:45.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.491+0000 7fde5f600640 1 -- 172.21.15.121:0/3990975147 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde580ce510 con 0x7fde5806e330 2024-09-17T03:37:45.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.492+0000 7fde5f600640 1 -- 172.21.15.121:0/3990975147 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5806ede0 con 0x7fde5806e330 2024-09-17T03:37:45.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.493+0000 7fde55600640 1 -- 172.21.15.121:0/3990975147 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde4801a070 con 0x7fde5806e330 2024-09-17T03:37:45.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.494+0000 7fde55600640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde34078bc0 0x7fde3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.494+0000 7fde55600640 1 -- 172.21.15.121:0/3990975147 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fde4809a170 con 0x7fde5806e330 2024-09-17T03:37:45.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.494+0000 7fde4fe00640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde34078bc0 0x7fde3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.495+0000 7fde4fe00640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde34078bc0 0x7fde3407b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fde40034000 tx=0x7fde40004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.498+0000 7fde55600640 1 -- 172.21.15.121:0/3990975147 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde580ca390 con 0x7fde5806e330 2024-09-17T03:37:45.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.724+0000 7fde5f600640 1 -- 172.21.15.121:0/3990975147 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde5815c160 con 0x7fde5806e330 2024-09-17T03:37:45.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.725+0000 7fde55600640 1 -- 172.21.15.121:0/3990975147 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5235 (secure 0 0 0) 0x7fde48062410 con 0x7fde5806e330 2024-09-17T03:37:45.725 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:45.725 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"btime":"2024-09-17T03:37:30:553841+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4041842554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4041842554},{"type":"v1","addr":"172.21.15.176:6837","nonce":4041842554}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5308,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1921105537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1921105537},{"type":"v1","addr":"172.21.15.176:6836","nonce":1921105537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/1479695563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1479695563},{"type":"v1","addr":"172.21.15.121:6833","nonce":1479695563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:27.000747+0000","modified":"2024-09-17T03:37:30.040560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5388},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5388":{"gid":5388,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3704628086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3704628086},{"type":"v1","addr":"172.21.15.121:6835","nonce":3704628086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5388,"qdb_cluster":[5388]},"id":3}]} 2024-09-17T03:37:45.725 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 28 2024-09-17T03:37:45.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 -- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde34078bc0 msgr2=0x7fde3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde34078bc0 0x7fde3407b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fde40034000 tx=0x7fde40004730 comp rx=0 tx=0).stop 2024-09-17T03:37:45.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 -- 172.21.15.121:0/3990975147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde5806e330 msgr2=0x7fde58151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde5806e330 0x7fde58151f00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fde4800c3c0 tx=0x7fde4800c880 comp rx=0 tx=0).stop 2024-09-17T03:37:45.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 -- 172.21.15.121:0/3990975147 shutdown_connections 2024-09-17T03:37:45.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde58074cb0 0x7fde581f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde58073dd0 0x7fde580c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde34078bc0 0x7fde3407b0d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 --2- 172.21.15.121:0/3990975147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde5806e330 0x7fde58151f00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 -- 172.21.15.121:0/3990975147 >> 172.21.15.121:0/3990975147 conn(0x7fde580cca40 msgr2=0x7fde581586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:45.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 -- 172.21.15.121:0/3990975147 shutdown_connections 2024-09-17T03:37:45.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.727+0000 7fde5f600640 1 -- 172.21.15.121:0/3990975147 wait complete. 2024-09-17T03:37:45.752 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:45.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.973+0000 7ff8ea400640 1 -- 172.21.15.121:0/3477962981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c8004800 msgr2=0x7ff8c8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.973+0000 7ff8ea400640 1 --2- 172.21.15.121:0/3477962981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c8004800 0x7ff8c8004c10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0006fd0 tx=0x7ff8c8005830 comp rx=0 tx=0).stop 2024-09-17T03:37:45.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.973+0000 7ff8ea400640 1 -- 172.21.15.121:0/3477962981 shutdown_connections 2024-09-17T03:37:45.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.973+0000 7ff8ea400640 1 --2- 172.21.15.121:0/3477962981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c8004800 0x7ff8c8004c10 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.973+0000 7ff8ea400640 1 -- 172.21.15.121:0/3477962981 >> 172.21.15.121:0/3477962981 conn(0x7ff8e406f940 msgr2=0x7ff8e40b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:45.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.973+0000 7ff8ea400640 1 -- 172.21.15.121:0/3477962981 shutdown_connections 2024-09-17T03:37:45.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.973+0000 7ff8ea400640 1 -- 172.21.15.121:0/3477962981 wait complete. 2024-09-17T03:37:45.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.975+0000 7ff8ea400640 1 Processor -- start 2024-09-17T03:37:45.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.975+0000 7ff8ea400640 1 -- start start 2024-09-17T03:37:45.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8ea400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c8004800 0x7ff8e40aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8ea400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8e41421f0 0x7ff8e4142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8ea400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8e415b500 0x7ff8e415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8ea400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e406e6f0 con 0x7ff8c8004800 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8ea400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e406e570 con 0x7ff8e41421f0 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8ea400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e406e870 con 0x7ff8e415b500 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8e9000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c8004800 0x7ff8e40aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8e9000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c8004800 0x7ff8e40aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57504/0 (socket says 172.21.15.121:57504) 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8e9000640 1 -- 172.21.15.121:0/1661377881 learned_addr learned my addr 172.21.15.121:0/1661377881 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8e3e00640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8e41421f0 0x7ff8e4142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8e9a00640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8e415b500 0x7ff8e415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8e9000640 1 -- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8e415b500 msgr2=0x7ff8e415b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8e9000640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8e415b500 0x7ff8e415b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8e9000640 1 -- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8e41421f0 msgr2=0x7ff8e4142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:45.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8e9000640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8e41421f0 0x7ff8e4142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:45.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.977+0000 7ff8e9000640 1 -- 172.21.15.121:0/1661377881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e415be50 con 0x7ff8c8004800 2024-09-17T03:37:45.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.978+0000 7ff8e9000640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c8004800 0x7ff8e40aee90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4011d70 tx=0x7ff8d400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:45.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.978+0000 7ff8e0c00640 1 -- 172.21.15.121:0/1661377881 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4011e60 con 0x7ff8c8004800 2024-09-17T03:37:45.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.978+0000 7ff8e0c00640 1 -- 172.21.15.121:0/1661377881 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8d4003d80 con 0x7ff8c8004800 2024-09-17T03:37:45.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.978+0000 7ff8ea400640 1 -- 172.21.15.121:0/1661377881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e41f8b90 con 0x7ff8c8004800 2024-09-17T03:37:45.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.978+0000 7ff8e0c00640 1 -- 172.21.15.121:0/1661377881 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4004d60 con 0x7ff8c8004800 2024-09-17T03:37:45.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.978+0000 7ff8ea400640 1 -- 172.21.15.121:0/1661377881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e41f9150 con 0x7ff8c8004800 2024-09-17T03:37:45.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.979+0000 7ff8ea400640 1 -- 172.21.15.121:0/1661377881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e4140690 con 0x7ff8c8004800 2024-09-17T03:37:45.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.980+0000 7ff8e0c00640 1 -- 172.21.15.121:0/1661377881 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8d4004050 con 0x7ff8c8004800 2024-09-17T03:37:45.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.981+0000 7ff8e0c00640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8c4078bc0 0x7ff8c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:45.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.981+0000 7ff8e0c00640 1 -- 172.21.15.121:0/1661377881 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7ff8d409bfe0 con 0x7ff8c8004800 2024-09-17T03:37:45.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.981+0000 7ff8e3e00640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8c4078bc0 0x7ff8c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:45.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.982+0000 7ff8e3e00640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8c4078bc0 0x7ff8c407b0d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0033000 tx=0x7ff8d0001a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:45.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:45.985+0000 7ff8e0c00640 1 -- 172.21.15.121:0/1661377881 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff8e415be50 con 0x7ff8c8004800 2024-09-17T03:37:46.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.203+0000 7ff8ea400640 1 -- 172.21.15.121:0/1661377881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8e40ccb70 con 0x7ff8c8004800 2024-09-17T03:37:46.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.204+0000 7ff8e0c00640 1 -- 172.21.15.121:0/1661377881 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5235 (secure 0 0 0) 0x7ff8d4064250 con 0x7ff8c8004800 2024-09-17T03:37:46.204 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:46.204 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"btime":"2024-09-17T03:37:30:553841+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4041842554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4041842554},{"type":"v1","addr":"172.21.15.176:6837","nonce":4041842554}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5308,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1921105537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1921105537},{"type":"v1","addr":"172.21.15.176:6836","nonce":1921105537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/1479695563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1479695563},{"type":"v1","addr":"172.21.15.121:6833","nonce":1479695563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:27.000747+0000","modified":"2024-09-17T03:37:30.040560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5388},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5388":{"gid":5388,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3704628086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3704628086},{"type":"v1","addr":"172.21.15.121:6835","nonce":3704628086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5388,"qdb_cluster":[5388]},"id":3}]} 2024-09-17T03:37:46.204 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 28 2024-09-17T03:37:46.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.206+0000 7ff8ea400640 1 -- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8c4078bc0 msgr2=0x7ff8c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.206+0000 7ff8ea400640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8c4078bc0 0x7ff8c407b0d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0033000 tx=0x7ff8d0001a10 comp rx=0 tx=0).stop 2024-09-17T03:37:46.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.206+0000 7ff8ea400640 1 -- 172.21.15.121:0/1661377881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c8004800 msgr2=0x7ff8e40aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.206+0000 7ff8ea400640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c8004800 0x7ff8e40aee90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4011d70 tx=0x7ff8d400f790 comp rx=0 tx=0).stop 2024-09-17T03:37:46.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.206+0000 7ff8ea400640 1 -- 172.21.15.121:0/1661377881 shutdown_connections 2024-09-17T03:37:46.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.206+0000 7ff8ea400640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8e415b500 0x7ff8e415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.206+0000 7ff8ea400640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8e41421f0 0x7ff8e4142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.206+0000 7ff8ea400640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff8c4078bc0 0x7ff8c407b0d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.206+0000 7ff8ea400640 1 --2- 172.21.15.121:0/1661377881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c8004800 0x7ff8e40aee90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.206+0000 7ff8ea400640 1 -- 172.21.15.121:0/1661377881 >> 172.21.15.121:0/1661377881 conn(0x7ff8e406f940 msgr2=0x7ff8e40b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:46.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.207+0000 7ff8ea400640 1 -- 172.21.15.121:0/1661377881 shutdown_connections 2024-09-17T03:37:46.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.207+0000 7ff8ea400640 1 -- 172.21.15.121:0/1661377881 wait complete. 2024-09-17T03:37:46.228 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:46.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.450+0000 7f021e000640 1 -- 172.21.15.121:0/3072944084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0218074cb0 msgr2=0x7f0218073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.450+0000 7f021e000640 1 --2- 172.21.15.121:0/3072944084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0218074cb0 0x7f0218073dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0208009860 tx=0x7f020802a530 comp rx=0 tx=0).stop 2024-09-17T03:37:46.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.450+0000 7f021e000640 1 -- 172.21.15.121:0/3072944084 shutdown_connections 2024-09-17T03:37:46.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.450+0000 7f021e000640 1 --2- 172.21.15.121:0/3072944084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0218074cb0 0x7f0218073dd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.450+0000 7f021e000640 1 -- 172.21.15.121:0/3072944084 >> 172.21.15.121:0/3072944084 conn(0x7f02180cca40 msgr2=0x7f02180cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:46.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.450+0000 7f021e000640 1 -- 172.21.15.121:0/3072944084 shutdown_connections 2024-09-17T03:37:46.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.450+0000 7f021e000640 1 -- 172.21.15.121:0/3072944084 wait complete. 2024-09-17T03:37:46.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.452+0000 7f021e000640 1 Processor -- start 2024-09-17T03:37:46.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.452+0000 7f021e000640 1 -- start start 2024-09-17T03:37:46.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f021e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0218074cb0 0x7f021809e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f021e000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02180cbc10 0x7f021809e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f021e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f021809ebd0 0x7f02181f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f021e000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f021806f670 con 0x7f0218074cb0 2024-09-17T03:37:46.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f021e000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f021806f4f0 con 0x7f021809ebd0 2024-09-17T03:37:46.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f021e000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f021806f7f0 con 0x7f02180cbc10 2024-09-17T03:37:46.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f0217400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0218074cb0 0x7f021809e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f0217400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0218074cb0 0x7f021809e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57506/0 (socket says 172.21.15.121:57506) 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f0217400640 1 -- 172.21.15.121:0/198880571 learned_addr learned my addr 172.21.15.121:0/198880571 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f0216a00640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02180cbc10 0x7f021809e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.454+0000 7f0217e00640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f021809ebd0 0x7f02181f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f0217400640 1 -- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02180cbc10 msgr2=0x7f021809e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f0217400640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02180cbc10 0x7f021809e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f0217400640 1 -- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f021809ebd0 msgr2=0x7f02181f8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f0217400640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f021809ebd0 0x7f02181f8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f0217400640 1 -- 172.21.15.121:0/198880571 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02180ce740 con 0x7f0218074cb0 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f0216a00640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02180cbc10 0x7f021809e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f0217400640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0218074cb0 0x7f021809e150 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0208009980 tx=0x7f0208003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f020f400640 1 -- 172.21.15.121:0/198880571 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208005c90 con 0x7f0218074cb0 2024-09-17T03:37:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f020f400640 1 -- 172.21.15.121:0/198880571 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0208005020 con 0x7f0218074cb0 2024-09-17T03:37:46.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f020f400640 1 -- 172.21.15.121:0/198880571 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208005410 con 0x7f0218074cb0 2024-09-17T03:37:46.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f021e000640 1 -- 172.21.15.121:0/198880571 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02180cea20 con 0x7f0218074cb0 2024-09-17T03:37:46.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.455+0000 7f021e000640 1 -- 172.21.15.121:0/198880571 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02180cefe0 con 0x7f0218074cb0 2024-09-17T03:37:46.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.456+0000 7f021e000640 1 -- 172.21.15.121:0/198880571 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0218072860 con 0x7f0218074cb0 2024-09-17T03:37:46.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.458+0000 7f020f400640 1 -- 172.21.15.121:0/198880571 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f02080317c0 con 0x7f0218074cb0 2024-09-17T03:37:46.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.458+0000 7f020f400640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f01f8078b90 0x7f01f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.459+0000 7f020f400640 1 -- 172.21.15.121:0/198880571 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f02080bbff0 con 0x7f0218074cb0 2024-09-17T03:37:46.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.459+0000 7f0216a00640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f01f8078b90 0x7f01f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.460+0000 7f0216a00640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f01f8078b90 0x7f01f807b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0204007fd0 tx=0x7f0204009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:46.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.463+0000 7f020f400640 1 -- 172.21.15.121:0/198880571 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0218072860 con 0x7f0218074cb0 2024-09-17T03:37:46.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.646+0000 7f021e000640 1 -- 172.21.15.121:0/198880571 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0218073dd0 con 0x7f0218074cb0 2024-09-17T03:37:46.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.647+0000 7f020f400640 1 -- 172.21.15.121:0/198880571 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+17002 (secure 0 0 0) 0x7f020803f030 con 0x7f0218074cb0 2024-09-17T03:37:46.647 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:46.647 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":52,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:37:28.529919+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:24.915132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:25.975087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:46.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 -- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f01f8078b90 msgr2=0x7f01f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f01f8078b90 0x7f01f807b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0204007fd0 tx=0x7f0204009040 comp rx=0 tx=0).stop 2024-09-17T03:37:46.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 -- 172.21.15.121:0/198880571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0218074cb0 msgr2=0x7f021809e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0218074cb0 0x7f021809e150 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0208009980 tx=0x7f0208003c10 comp rx=0 tx=0).stop 2024-09-17T03:37:46.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 -- 172.21.15.121:0/198880571 shutdown_connections 2024-09-17T03:37:46.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f021809ebd0 0x7f02181f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02180cbc10 0x7f021809e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f01f8078b90 0x7f01f807b0a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 --2- 172.21.15.121:0/198880571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0218074cb0 0x7f021809e150 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 -- 172.21.15.121:0/198880571 >> 172.21.15.121:0/198880571 conn(0x7f02180cca40 msgr2=0x7f021815f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:46.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.649+0000 7f021e000640 1 -- 172.21.15.121:0/198880571 shutdown_connections 2024-09-17T03:37:46.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.650+0000 7f021e000640 1 -- 172.21.15.121:0/198880571 wait complete. 2024-09-17T03:37:46.674 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:37:46.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.901+0000 7f32b1800640 1 -- 172.21.15.121:0/570474557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32ac06ec50 msgr2=0x7f32ac06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.901+0000 7f32b1800640 1 --2- 172.21.15.121:0/570474557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32ac06ec50 0x7f32ac06f060 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f32ac06a1b0 tx=0x7f32a402b810 comp rx=0 tx=0).stop 2024-09-17T03:37:46.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.901+0000 7f32b1800640 1 -- 172.21.15.121:0/570474557 shutdown_connections 2024-09-17T03:37:46.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.901+0000 7f32b1800640 1 --2- 172.21.15.121:0/570474557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32ac06ec50 0x7f32ac06f060 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.901+0000 7f32b1800640 1 --2- 172.21.15.121:0/570474557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac06ddf0 0x7f32ac06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.901+0000 7f32b1800640 1 --2- 172.21.15.121:0/570474557 >> v2:172.21.15.176:3300/0 conn(0x7f32ac15ac20 0x7f32ac070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.901+0000 7f32b1800640 1 -- 172.21.15.121:0/570474557 >> 172.21.15.121:0/570474557 conn(0x7f32ac0b1b90 msgr2=0x7f32ac0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:46.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.901+0000 7f32b1800640 1 -- 172.21.15.121:0/570474557 shutdown_connections 2024-09-17T03:37:46.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.901+0000 7f32b1800640 1 -- 172.21.15.121:0/570474557 wait complete. 2024-09-17T03:37:46.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.903+0000 7f32b1800640 1 Processor -- start 2024-09-17T03:37:46.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.903+0000 7f32b1800640 1 -- start start 2024-09-17T03:37:46.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.904+0000 7f32b1800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac06ddf0 0x7f32ac1f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32b1800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac06ec50 0x7f32ac0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32b1800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32ac15ac20 0x7f32ac0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32b1800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac071000 con 0x7f32ac15ac20 2024-09-17T03:37:46.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32b1800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac070e80 con 0x7f32ac06ec50 2024-09-17T03:37:46.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32b1800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f32ac06f5a0 con 0x7f32ac06ddf0 2024-09-17T03:37:46.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32ab400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32ac15ac20 0x7f32ac0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32ab400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32ac15ac20 0x7f32ac0b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57532/0 (socket says 172.21.15.121:57532) 2024-09-17T03:37:46.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32ab400640 1 -- 172.21.15.121:0/4010596100 learned_addr learned my addr 172.21.15.121:0/4010596100 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:46.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32aa000640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac06ec50 0x7f32ac0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32aaa00640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac06ddf0 0x7f32ac1f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32ab400640 1 -- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac06ddf0 msgr2=0x7f32ac1f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32ab400640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac06ddf0 0x7f32ac1f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32ab400640 1 -- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac06ec50 msgr2=0x7f32ac0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32ab400640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac06ec50 0x7f32ac0b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32ab400640 1 -- 172.21.15.121:0/4010596100 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac0b5690 con 0x7f32ac15ac20 2024-09-17T03:37:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.905+0000 7f32aa000640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac06ec50 0x7f32ac0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:46.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.906+0000 7f32ab400640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32ac15ac20 0x7f32ac0b4ac0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f32a402be00 tx=0x7f32a4033630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.906+0000 7f32a2a00640 1 -- 172.21.15.121:0/4010596100 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4041070 con 0x7f32ac15ac20 2024-09-17T03:37:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.906+0000 7f32a2a00640 1 -- 172.21.15.121:0/4010596100 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32a4033b20 con 0x7f32ac15ac20 2024-09-17T03:37:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.906+0000 7f32b1800640 1 -- 172.21.15.121:0/4010596100 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ac0b5970 con 0x7f32ac15ac20 2024-09-17T03:37:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.906+0000 7f32a2a00640 1 -- 172.21.15.121:0/4010596100 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a403c430 con 0x7f32ac15ac20 2024-09-17T03:37:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.906+0000 7f32b1800640 1 -- 172.21.15.121:0/4010596100 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ac1e6b00 con 0x7f32ac15ac20 2024-09-17T03:37:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.907+0000 7f32b1800640 1 -- 172.21.15.121:0/4010596100 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ac0b5400 con 0x7f32ac15ac20 2024-09-17T03:37:46.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.909+0000 7f32a2a00640 1 -- 172.21.15.121:0/4010596100 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32a4044070 con 0x7f32ac15ac20 2024-09-17T03:37:46.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.910+0000 7f32a2a00640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f328c078bc0 0x7f328c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.910+0000 7f32a2a00640 1 -- 172.21.15.121:0/4010596100 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f32a40bbd70 con 0x7f32ac15ac20 2024-09-17T03:37:46.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.910+0000 7f32aaa00640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f328c078bc0 0x7f328c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.911+0000 7f32aaa00640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f328c078bc0 0x7f328c07b0d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f329c009ac0 tx=0x7f329c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:46.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:46.914+0000 7f32a2a00640 1 -- 172.21.15.121:0/4010596100 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f32a40840b0 con 0x7f32ac15ac20 2024-09-17T03:37:47.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.132+0000 7f32b1800640 1 -- 172.21.15.121:0/4010596100 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f32ac1e5350 con 0x7f32ac15ac20 2024-09-17T03:37:47.132 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-17T03:37:47.133+0000 7f1def400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:37:47.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.135+0000 7f32a2a00640 1 -- 172.21.15.121:0/4010596100 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f32a4031880 con 0x7f32ac15ac20 2024-09-17T03:37:47.135 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.137+0000 7f32b1800640 1 -- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f328c078bc0 msgr2=0x7f328c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.137+0000 7f32b1800640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f328c078bc0 0x7f328c07b0d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f329c009ac0 tx=0x7f329c005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.137+0000 7f32b1800640 1 -- 172.21.15.121:0/4010596100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32ac15ac20 msgr2=0x7f32ac0b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.137+0000 7f32b1800640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32ac15ac20 0x7f32ac0b4ac0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f32a402be00 tx=0x7f32a4033630 comp rx=0 tx=0).stop 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.138+0000 7f32b1800640 1 -- 172.21.15.121:0/4010596100 shutdown_connections 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.138+0000 7f32b1800640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f328c078bc0 0x7f328c07b0d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.138+0000 7f32b1800640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32ac15ac20 0x7f32ac0b4ac0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.138+0000 7f32b1800640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac06ec50 0x7f32ac0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.138+0000 7f32b1800640 1 --2- 172.21.15.121:0/4010596100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac06ddf0 0x7f32ac1f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.138+0000 7f32b1800640 1 -- 172.21.15.121:0/4010596100 >> 172.21.15.121:0/4010596100 conn(0x7f32ac0b1b90 msgr2=0x7f32ac15a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:47.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.138+0000 7f32b1800640 1 -- 172.21.15.121:0/4010596100 shutdown_connections 2024-09-17T03:37:47.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.138+0000 7f32b1800640 1 -- 172.21.15.121:0/4010596100 wait complete. 2024-09-17T03:37:47.143 INFO:tasks.ceph.mds.a.smithi121.stderr: -2258> 2024-09-17T03:37:32.491+0000 7fd862a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:37:47.164 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:37:47.261 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:37:47.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.393+0000 7f3138200640 1 -- 172.21.15.121:0/901432069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f313015ca90 msgr2=0x7f31300d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.393+0000 7f3138200640 1 --2- 172.21.15.121:0/901432069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f313015ca90 0x7f31300d0670 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f311c005fd0 tx=0x7f311c02a4b0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.394+0000 7f3138200640 1 -- 172.21.15.121:0/901432069 shutdown_connections 2024-09-17T03:37:47.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.394+0000 7f3138200640 1 --2- 172.21.15.121:0/901432069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31300d0bb0 0x7f31300b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.394+0000 7f3138200640 1 --2- 172.21.15.121:0/901432069 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f313015ca90 0x7f31300d0670 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.394+0000 7f3138200640 1 -- 172.21.15.121:0/901432069 >> 172.21.15.121:0/901432069 conn(0x7f31300b46e0 msgr2=0x7f31300d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:47.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.394+0000 7f3138200640 1 -- 172.21.15.121:0/901432069 shutdown_connections 2024-09-17T03:37:47.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.394+0000 7f3138200640 1 -- 172.21.15.121:0/901432069 wait complete. 2024-09-17T03:37:47.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.396+0000 7f3138200640 1 Processor -- start 2024-09-17T03:37:47.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.396+0000 7f3138200640 1 -- start start 2024-09-17T03:37:47.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.397+0000 7f3138200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31300ccc40 0x7f31301f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.397+0000 7f3138200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31300d0bb0 0x7f313014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.397+0000 7f3138200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f313015ca90 0x7f31301595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.397+0000 7f3138200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f31300b66a0 con 0x7f313015ca90 2024-09-17T03:37:47.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.397+0000 7f3138200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31300b6520 con 0x7f31300ccc40 2024-09-17T03:37:47.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.397+0000 7f3138200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31300b6820 con 0x7f31300d0bb0 2024-09-17T03:37:47.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3136200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f313015ca90 0x7f31301595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3136200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f313015ca90 0x7f31301595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57556/0 (socket says 172.21.15.121:57556) 2024-09-17T03:37:47.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3136200640 1 -- 172.21.15.121:0/1335781825 learned_addr learned my addr 172.21.15.121:0/1335781825 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:47.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3134e00640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31300d0bb0 0x7f313014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3135800640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31300ccc40 0x7f31301f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3136200640 1 -- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31300d0bb0 msgr2=0x7f313014c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3136200640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31300d0bb0 0x7f313014c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3136200640 1 -- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31300ccc40 msgr2=0x7f31301f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3136200640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31300ccc40 0x7f31301f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3136200640 1 -- 172.21.15.121:0/1335781825 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31301580f0 con 0x7f313015ca90 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3135800640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31300ccc40 0x7f31301f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3134e00640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31300d0bb0 0x7f313014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.398+0000 7f3136200640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f313015ca90 0x7f31301595c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f312800c970 tx=0x7f312800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.399+0000 7f312d600640 1 -- 172.21.15.121:0/1335781825 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128004460 con 0x7f313015ca90 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.399+0000 7f312d600640 1 -- 172.21.15.121:0/1335781825 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31280077a0 con 0x7f313015ca90 2024-09-17T03:37:47.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.399+0000 7f312d600640 1 -- 172.21.15.121:0/1335781825 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128007bd0 con 0x7f313015ca90 2024-09-17T03:37:47.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.399+0000 7f3138200640 1 -- 172.21.15.121:0/1335781825 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313006f080 con 0x7f313015ca90 2024-09-17T03:37:47.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.399+0000 7f3138200640 1 -- 172.21.15.121:0/1335781825 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313006f640 con 0x7f313015ca90 2024-09-17T03:37:47.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.400+0000 7f3138200640 1 -- 172.21.15.121:0/1335781825 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31300b6dd0 con 0x7f313015ca90 2024-09-17T03:37:47.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.401+0000 7f312d600640 1 -- 172.21.15.121:0/1335781825 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31280035f0 con 0x7f313015ca90 2024-09-17T03:37:47.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.402+0000 7f312d600640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3110078bc0 0x7f311007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.402+0000 7f312d600640 1 -- 172.21.15.121:0/1335781825 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6187+0+0 (secure 0 0 0) 0x7f312809b670 con 0x7f313015ca90 2024-09-17T03:37:47.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.403+0000 7f3135800640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3110078bc0 0x7f311007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.404+0000 7f3135800640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3110078bc0 0x7f311007b0d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3124007e90 tx=0x7f31240073a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:47.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.407+0000 7f312d600640 1 -- 172.21.15.121:0/1335781825 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3128013030 con 0x7f313015ca90 2024-09-17T03:37:47.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:47.628+0000 7f3138200640 1 -- 172.21.15.121:0/1335781825 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f31300b5e10 con 0x7f313015ca90 2024-09-17T03:37:48.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.144+0000 7f312d600640 1 -- 172.21.15.121:0/1335781825 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) ==== 104+0+0 (secure 0 0 0) 0x7f312800de20 con 0x7f313015ca90 2024-09-17T03:37:48.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.147+0000 7f3138200640 1 -- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3110078bc0 msgr2=0x7f311007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.147+0000 7f3138200640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3110078bc0 0x7f311007b0d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3124007e90 tx=0x7f31240073a0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.147+0000 7f3138200640 1 -- 172.21.15.121:0/1335781825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f313015ca90 msgr2=0x7f31301595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.147+0000 7f3138200640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f313015ca90 0x7f31301595c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f312800c970 tx=0x7f312800ce30 comp rx=0 tx=0).stop 2024-09-17T03:37:48.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.147+0000 7f3138200640 1 -- 172.21.15.121:0/1335781825 shutdown_connections 2024-09-17T03:37:48.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.147+0000 7f3138200640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3110078bc0 0x7f311007b0d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.147+0000 7f3138200640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f313015ca90 0x7f31301595c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.147+0000 7f3138200640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31300d0bb0 0x7f313014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.147+0000 7f3138200640 1 --2- 172.21.15.121:0/1335781825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31300ccc40 0x7f31301f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.147+0000 7f3138200640 1 -- 172.21.15.121:0/1335781825 >> 172.21.15.121:0/1335781825 conn(0x7f31300b46e0 msgr2=0x7f31300cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:48.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.148+0000 7f3138200640 1 -- 172.21.15.121:0/1335781825 shutdown_connections 2024-09-17T03:37:48.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.148+0000 7f3138200640 1 -- 172.21.15.121:0/1335781825 wait complete. 2024-09-17T03:37:48.173 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:37:48.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.399+0000 7fd2bd400640 1 -- 172.21.15.121:0/100094050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2b80ca690 msgr2=0x7fd2b8160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.399+0000 7fd2bd400640 1 --2- 172.21.15.121:0/100094050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2b80ca690 0x7fd2b8160100 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8005fd0 tx=0x7fd2a802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.399+0000 7fd2bd400640 1 -- 172.21.15.121:0/100094050 shutdown_connections 2024-09-17T03:37:48.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.399+0000 7fd2bd400640 1 --2- 172.21.15.121:0/100094050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2b806e2f0 0x7fd2b8160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.399+0000 7fd2bd400640 1 --2- 172.21.15.121:0/100094050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2b80ca690 0x7fd2b8160100 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.399+0000 7fd2bd400640 1 -- 172.21.15.121:0/100094050 >> 172.21.15.121:0/100094050 conn(0x7fd2b80ccac0 msgr2=0x7fd2b80cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:48.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.399+0000 7fd2bd400640 1 -- 172.21.15.121:0/100094050 shutdown_connections 2024-09-17T03:37:48.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.399+0000 7fd2bd400640 1 -- 172.21.15.121:0/100094050 wait complete. 2024-09-17T03:37:48.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.402+0000 7fd2bd400640 1 Processor -- start 2024-09-17T03:37:48.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.402+0000 7fd2bd400640 1 -- start start 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.403+0000 7fd2bd400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2b806e2f0 0x7fd2b8158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.403+0000 7fd2bd400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2b80ca690 0x7fd2b80b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.403+0000 7fd2bd400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2b8160640 0x7fd2b80b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.403+0000 7fd2bd400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b806f7c0 con 0x7fd2b80ca690 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.403+0000 7fd2bd400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b806f640 con 0x7fd2b8160640 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.403+0000 7fd2bd400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b806f940 con 0x7fd2b806e2f0 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.403+0000 7fd2afe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2b80ca690 0x7fd2b80b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2afe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2b80ca690 0x7fd2b80b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57566/0 (socket says 172.21.15.121:57566) 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2afe00640 1 -- 172.21.15.121:0/2313240569 learned_addr learned my addr 172.21.15.121:0/2313240569 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2b6800640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2b806e2f0 0x7fd2b8158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:48.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2b7200640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2b8160640 0x7fd2b80b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:48.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2afe00640 1 -- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2b806e2f0 msgr2=0x7fd2b8158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2afe00640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2b806e2f0 0x7fd2b8158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2afe00640 1 -- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2b8160640 msgr2=0x7fd2b80b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2afe00640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2b8160640 0x7fd2b80b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2afe00640 1 -- 172.21.15.121:0/2313240569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b80b5d00 con 0x7fd2b80ca690 2024-09-17T03:37:48.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2afe00640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2b80ca690 0x7fd2b80b57c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000c3a0 tx=0x7fd2a000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:48.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2aea00640 1 -- 172.21.15.121:0/2313240569 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0017070 con 0x7fd2b80ca690 2024-09-17T03:37:48.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2aea00640 1 -- 172.21.15.121:0/2313240569 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2a00053c0 con 0x7fd2b80ca690 2024-09-17T03:37:48.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.404+0000 7fd2aea00640 1 -- 172.21.15.121:0/2313240569 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0003850 con 0x7fd2b80ca690 2024-09-17T03:37:48.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.405+0000 7fd2bd400640 1 -- 172.21.15.121:0/2313240569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b815d980 con 0x7fd2b80ca690 2024-09-17T03:37:48.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.405+0000 7fd2bd400640 1 -- 172.21.15.121:0/2313240569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b80c57b0 con 0x7fd2b80ca690 2024-09-17T03:37:48.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.406+0000 7fd2bd400640 1 -- 172.21.15.121:0/2313240569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b8160a50 con 0x7fd2b80ca690 2024-09-17T03:37:48.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.407+0000 7fd2aea00640 1 -- 172.21.15.121:0/2313240569 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2a001a070 con 0x7fd2b80ca690 2024-09-17T03:37:48.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.408+0000 7fd2aea00640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd294078b90 0x7fd29407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.409+0000 7fd2aea00640 1 -- 172.21.15.121:0/2313240569 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6187+0+0 (secure 0 0 0) 0x7fd2a009a1a0 con 0x7fd2b80ca690 2024-09-17T03:37:48.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.409+0000 7fd2b6800640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd294078b90 0x7fd29407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:48.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.410+0000 7fd2b6800640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd294078b90 0x7fd29407b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8033000 tx=0x7fd2a8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:48.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.413+0000 7fd2aea00640 1 -- 172.21.15.121:0/2313240569 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2a0061e40 con 0x7fd2b80ca690 2024-09-17T03:37:48.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:48.596+0000 7fd2bd400640 1 -- 172.21.15.121:0/2313240569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd2b80b5f20 con 0x7fd2b80ca690 2024-09-17T03:37:49.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.146+0000 7fd2aea00640 1 -- 172.21.15.121:0/2313240569 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) ==== 181+0+0 (secure 0 0 0) 0x7fd2a0066870 con 0x7fd2b80ca690 2024-09-17T03:37:49.147 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:37:49.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 -- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd294078b90 msgr2=0x7fd29407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd294078b90 0x7fd29407b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8033000 tx=0x7fd2a8004730 comp rx=0 tx=0).stop 2024-09-17T03:37:49.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 -- 172.21.15.121:0/2313240569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2b80ca690 msgr2=0x7fd2b80b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2b80ca690 0x7fd2b80b57c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000c3a0 tx=0x7fd2a000c860 comp rx=0 tx=0).stop 2024-09-17T03:37:49.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 -- 172.21.15.121:0/2313240569 shutdown_connections 2024-09-17T03:37:49.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2b8160640 0x7fd2b80b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd294078b90 0x7fd29407b0a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2b80ca690 0x7fd2b80b57c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 --2- 172.21.15.121:0/2313240569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2b806e2f0 0x7fd2b8158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 -- 172.21.15.121:0/2313240569 >> 172.21.15.121:0/2313240569 conn(0x7fd2b80ccac0 msgr2=0x7fd2b80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:49.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 -- 172.21.15.121:0/2313240569 shutdown_connections 2024-09-17T03:37:49.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.149+0000 7fd2bd400640 1 -- 172.21.15.121:0/2313240569 wait complete. 2024-09-17T03:37:49.173 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:37:49.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.397+0000 7f962cc00640 1 -- 172.21.15.121:0/2620489338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96280cd790 msgr2=0x7f96280cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.397+0000 7f962cc00640 1 --2- 172.21.15.121:0/2620489338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96280cd790 0x7f96280cbd40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9618005fd0 tx=0x7f961802a5c0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.398+0000 7f962cc00640 1 -- 172.21.15.121:0/2620489338 shutdown_connections 2024-09-17T03:37:49.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.398+0000 7f962cc00640 1 --2- 172.21.15.121:0/2620489338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f962806def0 0x7f962806e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.398+0000 7f962cc00640 1 --2- 172.21.15.121:0/2620489338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96280cd790 0x7f96280cbd40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.398+0000 7f962cc00640 1 -- 172.21.15.121:0/2620489338 >> 172.21.15.121:0/2620489338 conn(0x7f96280ccac0 msgr2=0x7f96280cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:49.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.398+0000 7f962cc00640 1 -- 172.21.15.121:0/2620489338 shutdown_connections 2024-09-17T03:37:49.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.398+0000 7f962cc00640 1 -- 172.21.15.121:0/2620489338 wait complete. 2024-09-17T03:37:49.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.400+0000 7f962cc00640 1 Processor -- start 2024-09-17T03:37:49.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.400+0000 7f962cc00640 1 -- start start 2024-09-17T03:37:49.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.401+0000 7f962cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f962806def0 0x7f9628073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.401+0000 7f962cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9628070940 0x7f962815c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.401+0000 7f962cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96280cd790 0x7f962815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.401+0000 7f962cc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f962806f6b0 con 0x7f9628070940 2024-09-17T03:37:49.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f962cc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f962806f530 con 0x7f962806def0 2024-09-17T03:37:49.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f962cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f962806f830 con 0x7f96280cd790 2024-09-17T03:37:49.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f961d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9628070940 0x7f962815c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f961d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9628070940 0x7f962815c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57580/0 (socket says 172.21.15.121:57580) 2024-09-17T03:37:49.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f961d400640 1 -- 172.21.15.121:0/961318813 learned_addr learned my addr 172.21.15.121:0/961318813 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:49.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f9625e00640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f962806def0 0x7f9628073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f9626800640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96280cd790 0x7f962815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f961d400640 1 -- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96280cd790 msgr2=0x7f962815af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f961d400640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96280cd790 0x7f962815af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f961d400640 1 -- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f962806def0 msgr2=0x7f9628073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f961d400640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f962806def0 0x7f9628073ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f961d400640 1 -- 172.21.15.121:0/961318813 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9628072f50 con 0x7f9628070940 2024-09-17T03:37:49.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.402+0000 7f9626800640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96280cd790 0x7f962815af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:49.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.403+0000 7f961d400640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9628070940 0x7f962815c520 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f961000c3a0 tx=0x7f961000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.403+0000 7f961ea00640 1 -- 172.21.15.121:0/961318813 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96100052d0 con 0x7f9628070940 2024-09-17T03:37:49.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.403+0000 7f961ea00640 1 -- 172.21.15.121:0/961318813 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9610007020 con 0x7f9628070940 2024-09-17T03:37:49.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.403+0000 7f961ea00640 1 -- 172.21.15.121:0/961318813 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610007470 con 0x7f9628070940 2024-09-17T03:37:49.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.403+0000 7f962cc00640 1 -- 172.21.15.121:0/961318813 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96280731c0 con 0x7f9628070940 2024-09-17T03:37:49.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.403+0000 7f962cc00640 1 -- 172.21.15.121:0/961318813 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9628073780 con 0x7f9628070940 2024-09-17T03:37:49.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.404+0000 7f962cc00640 1 -- 172.21.15.121:0/961318813 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f962806e300 con 0x7f9628070940 2024-09-17T03:37:49.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.405+0000 7f961ea00640 1 -- 172.21.15.121:0/961318813 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96100067d0 con 0x7f9628070940 2024-09-17T03:37:49.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.406+0000 7f961ea00640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9604078b90 0x7f960407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.406+0000 7f961ea00640 1 -- 172.21.15.121:0/961318813 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5749+0+0 (secure 0 0 0) 0x7f961009a240 con 0x7f9628070940 2024-09-17T03:37:49.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.407+0000 7f9625e00640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9604078b90 0x7f960407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.408+0000 7f9625e00640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9604078b90 0x7f960407b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9618033000 tx=0x7f9618004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.411+0000 7f961ea00640 1 -- 172.21.15.121:0/961318813 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f96280cad00 con 0x7f9628070940 2024-09-17T03:37:49.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:49.597+0000 7f962cc00640 1 -- 172.21.15.121:0/961318813 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f96281f66e0 con 0x7f9628070940 2024-09-17T03:37:50.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.154+0000 7f961ea00640 1 -- 172.21.15.121:0/961318813 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) ==== 169+0+0 (secure 0 0 0) 0x7f9610061f60 con 0x7f9628070940 2024-09-17T03:37:50.154 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-17T03:37:50.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 -- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9604078b90 msgr2=0x7f960407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9604078b90 0x7f960407b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9618033000 tx=0x7f9618004730 comp rx=0 tx=0).stop 2024-09-17T03:37:50.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 -- 172.21.15.121:0/961318813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9628070940 msgr2=0x7f962815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9628070940 0x7f962815c520 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f961000c3a0 tx=0x7f961000c860 comp rx=0 tx=0).stop 2024-09-17T03:37:50.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 -- 172.21.15.121:0/961318813 shutdown_connections 2024-09-17T03:37:50.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96280cd790 0x7f962815af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9604078b90 0x7f960407b0a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9628070940 0x7f962815c520 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 --2- 172.21.15.121:0/961318813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f962806def0 0x7f9628073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 -- 172.21.15.121:0/961318813 >> 172.21.15.121:0/961318813 conn(0x7f96280ccac0 msgr2=0x7f962815a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:50.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 -- 172.21.15.121:0/961318813 shutdown_connections 2024-09-17T03:37:50.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.157+0000 7f962cc00640 1 -- 172.21.15.121:0/961318813 wait complete. 2024-09-17T03:37:50.181 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:37:50.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.403+0000 7fc444c00640 1 -- 172.21.15.121:0/2446345702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc440074b60 msgr2=0x7fc44006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.403+0000 7fc444c00640 1 --2- 172.21.15.121:0/2446345702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc440074b60 0x7fc44006ddf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc4400b2c70 tx=0x7fc42802a560 comp rx=0 tx=0).stop 2024-09-17T03:37:50.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.403+0000 7fc444c00640 1 -- 172.21.15.121:0/2446345702 shutdown_connections 2024-09-17T03:37:50.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.403+0000 7fc444c00640 1 --2- 172.21.15.121:0/2446345702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc44006e330 0x7fc4400cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.403+0000 7fc444c00640 1 --2- 172.21.15.121:0/2446345702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc440074b60 0x7fc44006ddf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.403+0000 7fc444c00640 1 --2- 172.21.15.121:0/2446345702 >> v2:172.21.15.176:3300/0 conn(0x7fc440156a50 0x7fc440074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.403+0000 7fc444c00640 1 -- 172.21.15.121:0/2446345702 >> 172.21.15.121:0/2446345702 conn(0x7fc4400b1b90 msgr2=0x7fc4400b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:50.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.403+0000 7fc444c00640 1 -- 172.21.15.121:0/2446345702 shutdown_connections 2024-09-17T03:37:50.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.403+0000 7fc444c00640 1 -- 172.21.15.121:0/2446345702 wait complete. 2024-09-17T03:37:50.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.405+0000 7fc444c00640 1 Processor -- start 2024-09-17T03:37:50.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.406+0000 7fc444c00640 1 -- start start 2024-09-17T03:37:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.407+0000 7fc444c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44006e330 0x7fc4401f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.407+0000 7fc444c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc440074b60 0x7fc4401f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.407+0000 7fc444c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc440156a50 0x7fc4401f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.407+0000 7fc444c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc4400ce330 con 0x7fc44006e330 2024-09-17T03:37:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.407+0000 7fc444c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc4400ce1b0 con 0x7fc440156a50 2024-09-17T03:37:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.407+0000 7fc444c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc4400ce4b0 con 0x7fc440074b60 2024-09-17T03:37:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.407+0000 7fc43de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44006e330 0x7fc4401f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.407+0000 7fc43de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44006e330 0x7fc4401f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57592/0 (socket says 172.21.15.121:57592) 2024-09-17T03:37:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.408+0000 7fc43de00640 1 -- 172.21.15.121:0/1823072105 learned_addr learned my addr 172.21.15.121:0/1823072105 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.408+0000 7fc435400640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc440074b60 0x7fc4401f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.408+0000 7fc43e800640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc440156a50 0x7fc4401f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.408+0000 7fc43de00640 1 -- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc440074b60 msgr2=0x7fc4401f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.408+0000 7fc43de00640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc440074b60 0x7fc4401f8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.408+0000 7fc43de00640 1 -- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc440156a50 msgr2=0x7fc4401f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.408+0000 7fc43de00640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc440156a50 0x7fc4401f9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.408+0000 7fc43de00640 1 -- 172.21.15.121:0/1823072105 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44009fa50 con 0x7fc44006e330 2024-09-17T03:37:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.408+0000 7fc43de00640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44006e330 0x7fc4401f5180 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e7f0 tx=0x7fc43000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.408+0000 7fc436a00640 1 -- 172.21.15.121:0/1823072105 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43000ccc0 con 0x7fc44006e330 2024-09-17T03:37:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.409+0000 7fc436a00640 1 -- 172.21.15.121:0/1823072105 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc430010430 con 0x7fc44006e330 2024-09-17T03:37:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.409+0000 7fc436a00640 1 -- 172.21.15.121:0/1823072105 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430010860 con 0x7fc44006e330 2024-09-17T03:37:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.409+0000 7fc444c00640 1 -- 172.21.15.121:0/1823072105 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44009fd30 con 0x7fc44006e330 2024-09-17T03:37:50.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.409+0000 7fc444c00640 1 -- 172.21.15.121:0/1823072105 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4400a02f0 con 0x7fc44006e330 2024-09-17T03:37:50.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.410+0000 7fc444c00640 1 -- 172.21.15.121:0/1823072105 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4400a06d0 con 0x7fc44006e330 2024-09-17T03:37:50.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.411+0000 7fc436a00640 1 -- 172.21.15.121:0/1823072105 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc430010a00 con 0x7fc44006e330 2024-09-17T03:37:50.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.412+0000 7fc436a00640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc41c078bc0 0x7fc41c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:50.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.412+0000 7fc436a00640 1 -- 172.21.15.121:0/1823072105 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7fc43009b540 con 0x7fc44006e330 2024-09-17T03:37:50.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.412+0000 7fc435400640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc41c078bc0 0x7fc41c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:50.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.413+0000 7fc435400640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc41c078bc0 0x7fc41c07b0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc428033000 tx=0x7fc428004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:50.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.416+0000 7fc436a00640 1 -- 172.21.15.121:0/1823072105 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc4400a06d0 con 0x7fc44006e330 2024-09-17T03:37:50.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.602+0000 7fc444c00640 1 -- 172.21.15.121:0/1823072105 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fc4400ce9d0 con 0x7fc44006e330 2024-09-17T03:37:50.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.609+0000 7fc436a00640 1 -- 172.21.15.121:0/1823072105 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v36) ==== 71+0+0 (secure 0 0 0) 0x7fc430063af0 con 0x7fc44006e330 2024-09-17T03:37:50.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 -- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc41c078bc0 msgr2=0x7fc41c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc41c078bc0 0x7fc41c07b0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc428033000 tx=0x7fc428004730 comp rx=0 tx=0).stop 2024-09-17T03:37:50.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 -- 172.21.15.121:0/1823072105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44006e330 msgr2=0x7fc4401f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44006e330 0x7fc4401f5180 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e7f0 tx=0x7fc43000ecb0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 -- 172.21.15.121:0/1823072105 shutdown_connections 2024-09-17T03:37:50.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc440156a50 0x7fc4401f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc440074b60 0x7fc4401f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc41c078bc0 0x7fc41c07b0d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 --2- 172.21.15.121:0/1823072105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44006e330 0x7fc4401f5180 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 -- 172.21.15.121:0/1823072105 >> 172.21.15.121:0/1823072105 conn(0x7fc4400b1b90 msgr2=0x7fc44006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:50.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 -- 172.21.15.121:0/1823072105 shutdown_connections 2024-09-17T03:37:50.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.612+0000 7fc444c00640 1 -- 172.21.15.121:0/1823072105 wait complete. 2024-09-17T03:37:50.638 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted' 2024-09-17T03:37:50.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.863+0000 7f4e06e00640 1 -- 172.21.15.121:0/153465228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e0015f790 msgr2=0x7f4e00155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.863+0000 7f4e06e00640 1 --2- 172.21.15.121:0/153465228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e0015f790 0x7f4e00155150 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4dec005fd0 tx=0x7f4dec02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.863+0000 7f4e06e00640 1 -- 172.21.15.121:0/153465228 shutdown_connections 2024-09-17T03:37:50.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.863+0000 7f4e06e00640 1 --2- 172.21.15.121:0/153465228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e0015f790 0x7f4e00155150 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.863+0000 7f4e06e00640 1 -- 172.21.15.121:0/153465228 >> 172.21.15.121:0/153465228 conn(0x7f4e0006f940 msgr2=0x7f4e000b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:50.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.863+0000 7f4e06e00640 1 -- 172.21.15.121:0/153465228 shutdown_connections 2024-09-17T03:37:50.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.863+0000 7f4e06e00640 1 -- 172.21.15.121:0/153465228 wait complete. 2024-09-17T03:37:50.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.866+0000 7f4e06e00640 1 Processor -- start 2024-09-17T03:37:50.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.866+0000 7f4e06e00640 1 -- start start 2024-09-17T03:37:50.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.867+0000 7f4e06e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e000af000 0x7f4e001486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:50.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.867+0000 7f4e06e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e00155690 0x7f4e0015bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:50.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.867+0000 7f4e06e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0015f790 0x7f4e00156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:50.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.867+0000 7f4e06e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0006ddf0 con 0x7f4e000af000 2024-09-17T03:37:50.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.867+0000 7f4e06e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4e000ce920 con 0x7f4e0015f790 2024-09-17T03:37:50.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.867+0000 7f4e06e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4e00156e50 con 0x7f4e00155690 2024-09-17T03:37:50.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.867+0000 7f4e05a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e000af000 0x7f4e001486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:50.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.867+0000 7f4e05a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e000af000 0x7f4e001486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57606/0 (socket says 172.21.15.121:57606) 2024-09-17T03:37:50.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.867+0000 7f4e05a00640 1 -- 172.21.15.121:0/3016815501 learned_addr learned my addr 172.21.15.121:0/3016815501 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:50.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4e06400640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0015f790 0x7f4e00156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:50.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4e05000640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e00155690 0x7f4e0015bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:50.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4e05a00640 1 -- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e00155690 msgr2=0x7f4e0015bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4e05a00640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e00155690 0x7f4e0015bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4e05a00640 1 -- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0015f790 msgr2=0x7f4e00156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4e05a00640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0015f790 0x7f4e00156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4e05a00640 1 -- 172.21.15.121:0/3016815501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e000b0120 con 0x7f4e000af000 2024-09-17T03:37:50.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4e05a00640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e000af000 0x7f4e001486a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4df400b3f0 tx=0x7f4df400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:50.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4dfd600640 1 -- 172.21.15.121:0/3016815501 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4015020 con 0x7f4e000af000 2024-09-17T03:37:50.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4dfd600640 1 -- 172.21.15.121:0/3016815501 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4df4011920 con 0x7f4e000af000 2024-09-17T03:37:50.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.868+0000 7f4dfd600640 1 -- 172.21.15.121:0/3016815501 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4011d70 con 0x7f4e000af000 2024-09-17T03:37:50.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.869+0000 7f4e06e00640 1 -- 172.21.15.121:0/3016815501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e000b0400 con 0x7f4e000af000 2024-09-17T03:37:50.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.869+0000 7f4e06e00640 1 -- 172.21.15.121:0/3016815501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e000b09c0 con 0x7f4e000af000 2024-09-17T03:37:50.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.870+0000 7f4e06e00640 1 -- 172.21.15.121:0/3016815501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e00155150 con 0x7f4e000af000 2024-09-17T03:37:50.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.871+0000 7f4dfd600640 1 -- 172.21.15.121:0/3016815501 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4df4018020 con 0x7f4e000af000 2024-09-17T03:37:50.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.872+0000 7f4dfd600640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4de0078b90 0x7f4de007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:50.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.872+0000 7f4dfd600640 1 -- 172.21.15.121:0/3016815501 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7f4df409a5f0 con 0x7f4e000af000 2024-09-17T03:37:50.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.872+0000 7f4e05000640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4de0078b90 0x7f4de007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:50.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.873+0000 7f4e05000640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4de0078b90 0x7f4de007b0a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4dec033000 tx=0x7f4dec004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:50.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:50.876+0000 7f4dfd600640 1 -- 172.21.15.121:0/3016815501 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4df401f030 con 0x7f4e000af000 2024-09-17T03:37:51.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.127+0000 7f4e06e00640 1 -- 172.21.15.121:0/3016815501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]} v 0) -- 0x7f4e00069450 con 0x7f4e000af000 2024-09-17T03:37:51.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.156+0000 7f4dfd600640 1 -- 172.21.15.121:0/3016815501 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_blocklisted"]}]=0 v150) ==== 153+0+0 (secure 0 0 0) 0x7f4df4062670 con 0x7f4e000af000 2024-09-17T03:37:51.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 -- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4de0078b90 msgr2=0x7f4de007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4de0078b90 0x7f4de007b0a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4dec033000 tx=0x7f4dec004730 comp rx=0 tx=0).stop 2024-09-17T03:37:51.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 -- 172.21.15.121:0/3016815501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e000af000 msgr2=0x7f4e001486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e000af000 0x7f4e001486a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4df400b3f0 tx=0x7f4df400b8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 -- 172.21.15.121:0/3016815501 shutdown_connections 2024-09-17T03:37:51.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0015f790 0x7f4e00156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e00155690 0x7f4e0015bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4de0078b90 0x7f4de007b0a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 --2- 172.21.15.121:0/3016815501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4e000af000 0x7f4e001486a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 -- 172.21.15.121:0/3016815501 >> 172.21.15.121:0/3016815501 conn(0x7f4e0006f940 msgr2=0x7f4e000d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:51.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 -- 172.21.15.121:0/3016815501 shutdown_connections 2024-09-17T03:37:51.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.158+0000 7f4e06e00640 1 -- 172.21.15.121:0/3016815501 wait complete. 2024-09-17T03:37:51.180 INFO:tasks.cephfs_test_runner:Check that mds evicts blocklisted client ... skipped 'Requires FUSE client to use mds_cluster.is_addr_blocklisted()' 2024-09-17T03:37:51.180 INFO:tasks.cephfs_test_runner:Starting test: test_session_evict_non_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) Check that mds evicts without blocklisting client 2024-09-17T03:37:51.180 INFO:tasks.cephfs_test_runner:test_session_evict_non_blocklisted (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-17T03:37:51.180 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:51.202 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:37:51.229 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:37:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.405+0000 7f328c200640 1 -- 172.21.15.121:0/2112592027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3284073dd0 msgr2=0x7f328406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.405+0000 7f328c200640 1 --2- 172.21.15.121:0/2112592027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3284073dd0 0x7f328406ddf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3270005fd0 tx=0x7f327002a670 comp rx=0 tx=0).stop 2024-09-17T03:37:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.405+0000 7f328c200640 1 -- 172.21.15.121:0/2112592027 shutdown_connections 2024-09-17T03:37:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.405+0000 7f328c200640 1 --2- 172.21.15.121:0/2112592027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3284073dd0 0x7f328406ddf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.405+0000 7f328c200640 1 -- 172.21.15.121:0/2112592027 >> 172.21.15.121:0/2112592027 conn(0x7f32840cca40 msgr2=0x7f32840cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:51.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.405+0000 7f328c200640 1 -- 172.21.15.121:0/2112592027 shutdown_connections 2024-09-17T03:37:51.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.405+0000 7f328c200640 1 -- 172.21.15.121:0/2112592027 wait complete. 2024-09-17T03:37:51.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.407+0000 7f328c200640 1 Processor -- start 2024-09-17T03:37:51.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.407+0000 7f328c200640 1 -- start start 2024-09-17T03:37:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.409+0000 7f328c200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f328406e330 0x7f32841e8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.409+0000 7f328c200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3284073dd0 0x7f32841571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.409+0000 7f328c200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3284074cb0 0x7f32840b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.409+0000 7f328c200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f328406f670 con 0x7f328406e330 2024-09-17T03:37:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.409+0000 7f328c200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f328406f4f0 con 0x7f3284073dd0 2024-09-17T03:37:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.409+0000 7f328c200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f328406f7f0 con 0x7f3284074cb0 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.409+0000 7f3289800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f328406e330 0x7f32841e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.409+0000 7f3289800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f328406e330 0x7f32841e8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57616/0 (socket says 172.21.15.121:57616) 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.409+0000 7f3289800640 1 -- 172.21.15.121:0/4211596339 learned_addr learned my addr 172.21.15.121:0/4211596339 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f3288e00640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3284073dd0 0x7f32841571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f3289800640 1 -- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3284074cb0 msgr2=0x7f32840b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f328a200640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3284074cb0 0x7f32840b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f3289800640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3284074cb0 0x7f32840b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f3289800640 1 -- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3284073dd0 msgr2=0x7f32841571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f3289800640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3284073dd0 0x7f32841571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f3289800640 1 -- 172.21.15.121:0/4211596339 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3284157720 con 0x7f328406e330 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f328a200640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3284074cb0 0x7f32840b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f3289800640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f328406e330 0x7f32841e8500 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3278001eb0 tx=0x7f327800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:51.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f3281600640 1 -- 172.21.15.121:0/4211596339 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278017070 con 0x7f328406e330 2024-09-17T03:37:51.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f3281600640 1 -- 172.21.15.121:0/4211596339 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32780053c0 con 0x7f328406e330 2024-09-17T03:37:51.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f328c200640 1 -- 172.21.15.121:0/4211596339 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32840c87e0 con 0x7f328406e330 2024-09-17T03:37:51.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f3281600640 1 -- 172.21.15.121:0/4211596339 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278003830 con 0x7f328406e330 2024-09-17T03:37:51.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.410+0000 7f328c200640 1 -- 172.21.15.121:0/4211596339 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32840b3a30 con 0x7f328406e330 2024-09-17T03:37:51.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.412+0000 7f328c200640 1 -- 172.21.15.121:0/4211596339 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328406acf0 con 0x7f328406e330 2024-09-17T03:37:51.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.413+0000 7f3281600640 1 -- 172.21.15.121:0/4211596339 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f327801a070 con 0x7f328406e330 2024-09-17T03:37:51.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.414+0000 7f3281600640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3264078b90 0x7f326407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.414+0000 7f3281600640 1 -- 172.21.15.121:0/4211596339 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7f327809a080 con 0x7f328406e330 2024-09-17T03:37:51.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.414+0000 7f3288e00640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3264078b90 0x7f326407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.415+0000 7f3288e00640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3264078b90 0x7f326407b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3270033000 tx=0x7f3270004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:51.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.418+0000 7f3281600640 1 -- 172.21.15.121:0/4211596339 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f328406acf0 con 0x7f328406e330 2024-09-17T03:37:51.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.603+0000 7f328c200640 1 -- 172.21.15.121:0/4211596339 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f328406ddf0 con 0x7f328406e330 2024-09-17T03:37:51.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.604+0000 7f3281600640 1 -- 172.21.15.121:0/4211596339 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+13367 (secure 0 0 0) 0x7f328406e740 con 0x7f328406e330 2024-09-17T03:37:51.603 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:51.604 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":55,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:37:50.147952+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6835/3704628086":"2024-09-18T03:37:47.133687+0000","172.21.15.121:6834/3704628086":"2024-09-18T03:37:47.133687+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:51.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 -- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3264078b90 msgr2=0x7f326407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3264078b90 0x7f326407b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3270033000 tx=0x7f3270004730 comp rx=0 tx=0).stop 2024-09-17T03:37:51.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 -- 172.21.15.121:0/4211596339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f328406e330 msgr2=0x7f32841e8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f328406e330 0x7f32841e8500 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3278001eb0 tx=0x7f327800c890 comp rx=0 tx=0).stop 2024-09-17T03:37:51.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 -- 172.21.15.121:0/4211596339 shutdown_connections 2024-09-17T03:37:51.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3284074cb0 0x7f32840b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3284073dd0 0x7f32841571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3264078b90 0x7f326407b0a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 --2- 172.21.15.121:0/4211596339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f328406e330 0x7f32841e8500 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 -- 172.21.15.121:0/4211596339 >> 172.21.15.121:0/4211596339 conn(0x7f32840cca40 msgr2=0x7f32840cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:51.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 -- 172.21.15.121:0/4211596339 shutdown_connections 2024-09-17T03:37:51.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.606+0000 7f328c200640 1 -- 172.21.15.121:0/4211596339 wait complete. 2024-09-17T03:37:51.627 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:35:21.303701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:37:51.627 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:37:51.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.850+0000 7fdcc6400640 1 -- 172.21.15.121:0/106132151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdca4003a00 msgr2=0x7fdca4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.850+0000 7fdcc6400640 1 --2- 172.21.15.121:0/106132151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdca4003a00 0x7fdca4003e70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdcc015a730 tx=0x7fdca4005830 comp rx=0 tx=0).stop 2024-09-17T03:37:51.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.850+0000 7fdcbfe00640 1 -- 172.21.15.121:0/106132151 reap_dead start 2024-09-17T03:37:51.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.850+0000 7fdcc6400640 1 -- 172.21.15.121:0/106132151 shutdown_connections 2024-09-17T03:37:51.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.850+0000 7fdcc6400640 1 -- 172.21.15.121:0/106132151 >> 172.21.15.121:0/106132151 conn(0x7fdcc00cca40 msgr2=0x7fdcc00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:51.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.850+0000 7fdcc6400640 1 -- 172.21.15.121:0/106132151 shutdown_connections 2024-09-17T03:37:51.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.850+0000 7fdcc6400640 1 -- 172.21.15.121:0/106132151 wait complete. 2024-09-17T03:37:51.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.852+0000 7fdcc6400640 1 Processor -- start 2024-09-17T03:37:51.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.853+0000 7fdcc6400640 1 -- start start 2024-09-17T03:37:51.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.854+0000 7fdcc6400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdca4003a00 0x7fdcc00a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.854+0000 7fdcc6400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcc01f3a00 0x7fdcc0158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.854+0000 7fdcc6400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcc00ca5d0 0x7fdcc00ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.854+0000 7fdcc6400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc006df70 con 0x7fdcc00ca5d0 2024-09-17T03:37:51.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.854+0000 7fdcc6400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc006ddf0 con 0x7fdca4003a00 2024-09-17T03:37:51.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.854+0000 7fdcc6400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc006e0f0 con 0x7fdcc01f3a00 2024-09-17T03:37:51.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.854+0000 7fdcbfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcc00ca5d0 0x7fdcc00ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.854+0000 7fdcbfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcc00ca5d0 0x7fdcc00ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39924/0 (socket says 172.21.15.121:39924) 2024-09-17T03:37:51.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.854+0000 7fdcbfe00640 1 -- 172.21.15.121:0/2630764121 learned_addr learned my addr 172.21.15.121:0/2630764121 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:51.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.854+0000 7fdcbf400640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdca4003a00 0x7fdcc00a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcbea00640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcc01f3a00 0x7fdcc0158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcbfe00640 1 -- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcc01f3a00 msgr2=0x7fdcc0158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcbfe00640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcc01f3a00 0x7fdcc0158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcbfe00640 1 -- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdca4003a00 msgr2=0x7fdcc00a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcbfe00640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdca4003a00 0x7fdcc00a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcbfe00640 1 -- 172.21.15.121:0/2630764121 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc00caf20 con 0x7fdcc00ca5d0 2024-09-17T03:37:51.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcbea00640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcc01f3a00 0x7fdcc0158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:51.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcbfe00640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcc00ca5d0 0x7fdcc00ca9e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8005fd0 tx=0x7fdcb8010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:51.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcb7400640 1 -- 172.21.15.121:0/2630764121 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8003970 con 0x7fdcc00ca5d0 2024-09-17T03:37:51.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcb7400640 1 -- 172.21.15.121:0/2630764121 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcb8015070 con 0x7fdcc00ca5d0 2024-09-17T03:37:51.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcc6400640 1 -- 172.21.15.121:0/2630764121 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc00b5930 con 0x7fdcc00ca5d0 2024-09-17T03:37:51.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcb7400640 1 -- 172.21.15.121:0/2630764121 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8004030 con 0x7fdcc00ca5d0 2024-09-17T03:37:51.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.855+0000 7fdcc6400640 1 -- 172.21.15.121:0/2630764121 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc01f40e0 con 0x7fdcc00ca5d0 2024-09-17T03:37:51.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.857+0000 7fdcc6400640 1 -- 172.21.15.121:0/2630764121 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc006ede0 con 0x7fdcc00ca5d0 2024-09-17T03:37:51.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.858+0000 7fdcb7400640 1 -- 172.21.15.121:0/2630764121 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdcb80041d0 con 0x7fdcc00ca5d0 2024-09-17T03:37:51.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.859+0000 7fdcb7400640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdca0078b90 0x7fdca007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.859+0000 7fdcb7400640 1 -- 172.21.15.121:0/2630764121 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7fdcb809b560 con 0x7fdcc00ca5d0 2024-09-17T03:37:51.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.860+0000 7fdcbf400640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdca0078b90 0x7fdca007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.861+0000 7fdcbf400640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdca0078b90 0x7fdca007b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdcc015a730 tx=0x7fdcb0038040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:51.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:51.864+0000 7fdcb7400640 1 -- 172.21.15.121:0/2630764121 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdcc00caf20 con 0x7fdcc00ca5d0 2024-09-17T03:37:52.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.046+0000 7fdcc6400640 1 -- 172.21.15.121:0/2630764121 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdcc00cb1f0 con 0x7fdcc00ca5d0 2024-09-17T03:37:52.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.047+0000 7fdcb7400640 1 -- 172.21.15.121:0/2630764121 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) ==== 93+0+10 (secure 0 0 0) 0x7fdcb80634c0 con 0x7fdcc00ca5d0 2024-09-17T03:37:52.047 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 -- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdca0078b90 msgr2=0x7fdca007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdca0078b90 0x7fdca007b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdcc015a730 tx=0x7fdcb0038040 comp rx=0 tx=0).stop 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 -- 172.21.15.121:0/2630764121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcc00ca5d0 msgr2=0x7fdcc00ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcc00ca5d0 0x7fdcc00ca9e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8005fd0 tx=0x7fdcb8010f40 comp rx=0 tx=0).stop 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 -- 172.21.15.121:0/2630764121 shutdown_connections 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdca0078b90 0x7fdca007b0a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcc00ca5d0 0x7fdcc00ca9e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdcc01f3a00 0x7fdcc0158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 --2- 172.21.15.121:0/2630764121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdca4003a00 0x7fdcc00a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 -- 172.21.15.121:0/2630764121 >> 172.21.15.121:0/2630764121 conn(0x7fdcc00cca40 msgr2=0x7fdcc015aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 -- 172.21.15.121:0/2630764121 shutdown_connections 2024-09-17T03:37:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.050+0000 7fdcc6400640 1 -- 172.21.15.121:0/2630764121 wait complete. 2024-09-17T03:37:52.075 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted' 2024-09-17T03:37:52.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.296+0000 7f4413000640 1 -- 172.21.15.121:0/3189685091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f440c0b39d0 msgr2=0x7f440c06def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.296+0000 7f4413000640 1 --2- 172.21.15.121:0/3189685091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f440c0b39d0 0x7f440c06def0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f440c0750b0 tx=0x7f440402aa30 comp rx=0 tx=0).stop 2024-09-17T03:37:52.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.296+0000 7f4413000640 1 -- 172.21.15.121:0/3189685091 shutdown_connections 2024-09-17T03:37:52.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.296+0000 7f4413000640 1 --2- 172.21.15.121:0/3189685091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f440c0b39d0 0x7f440c06def0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.296+0000 7f4413000640 1 --2- 172.21.15.121:0/3189685091 >> v2:172.21.15.176:3300/0 conn(0x7f440c152530 0x7f440c0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.296+0000 7f4413000640 1 --2- 172.21.15.121:0/3189685091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c073dd0 0x7f440c15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.296+0000 7f4413000640 1 -- 172.21.15.121:0/3189685091 >> 172.21.15.121:0/3189685091 conn(0x7f440c06f940 msgr2=0x7f440c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.296+0000 7f4413000640 1 -- 172.21.15.121:0/3189685091 shutdown_connections 2024-09-17T03:37:52.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.296+0000 7f4413000640 1 -- 172.21.15.121:0/3189685091 wait complete. 2024-09-17T03:37:52.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.299+0000 7f4413000640 1 Processor -- start 2024-09-17T03:37:52.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.299+0000 7f4413000640 1 -- start start 2024-09-17T03:37:52.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4413000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c073dd0 0x7f440c147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4413000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0b39d0 0x7f440c1f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4413000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f440c152530 0x7f440c0b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4413000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f440c0cf3a0 con 0x7f440c152530 2024-09-17T03:37:52.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4413000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f440c0cf220 con 0x7f440c0b39d0 2024-09-17T03:37:52.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4413000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f440c0cf520 con 0x7f440c073dd0 2024-09-17T03:37:52.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4412600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f440c152530 0x7f440c0b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4412600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f440c152530 0x7f440c0b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39940/0 (socket says 172.21.15.121:39940) 2024-09-17T03:37:52.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4412600640 1 -- 172.21.15.121:0/3905166830 learned_addr learned my addr 172.21.15.121:0/3905166830 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:52.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4411c00640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c073dd0 0x7f440c147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4411200640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0b39d0 0x7f440c1f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4412600640 1 -- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c073dd0 msgr2=0x7f440c147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4412600640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c073dd0 0x7f440c147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4412600640 1 -- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0b39d0 msgr2=0x7f440c1f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4412600640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0b39d0 0x7f440c1f6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.301+0000 7f4412600640 1 -- 172.21.15.121:0/3905166830 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c1f7990 con 0x7f440c152530 2024-09-17T03:37:52.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.302+0000 7f4412600640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f440c152530 0x7f440c0b1000 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f440402b020 tx=0x7f4404003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.302+0000 7f4409600640 1 -- 172.21.15.121:0/3905166830 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404033050 con 0x7f440c152530 2024-09-17T03:37:52.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.302+0000 7f4409600640 1 -- 172.21.15.121:0/3905166830 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4404004450 con 0x7f440c152530 2024-09-17T03:37:52.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.302+0000 7f4413000640 1 -- 172.21.15.121:0/3905166830 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440c1f7c70 con 0x7f440c152530 2024-09-17T03:37:52.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.302+0000 7f4409600640 1 -- 172.21.15.121:0/3905166830 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404038450 con 0x7f440c152530 2024-09-17T03:37:52.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.302+0000 7f4413000640 1 -- 172.21.15.121:0/3905166830 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440c145180 con 0x7f440c152530 2024-09-17T03:37:52.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.303+0000 7f4413000640 1 -- 172.21.15.121:0/3905166830 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440c144c90 con 0x7f440c152530 2024-09-17T03:37:52.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.304+0000 7f4409600640 1 -- 172.21.15.121:0/3905166830 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4404036070 con 0x7f440c152530 2024-09-17T03:37:52.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.305+0000 7f4409600640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43ec078bc0 0x7f43ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.305+0000 7f4409600640 1 -- 172.21.15.121:0/3905166830 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7f44040bbe60 con 0x7f440c152530 2024-09-17T03:37:52.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.306+0000 7f4411c00640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43ec078bc0 0x7f43ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.307+0000 7f4411c00640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43ec078bc0 0x7f43ec07b0d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4400005fd0 tx=0x7f440000b260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.310+0000 7f4409600640 1 -- 172.21.15.121:0/3905166830 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4404083e30 con 0x7f440c152530 2024-09-17T03:37:52.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:52.560+0000 7f4413000640 1 -- 172.21.15.121:0/3905166830 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted"]} v 0) -- 0x7f440c0cfab0 con 0x7f440c152530 2024-09-17T03:37:53.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.163+0000 7f4409600640 1 -- 172.21.15.121:0/3905166830 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted"]}]=0 v152) ==== 160+0+0 (secure 0 0 0) 0x7f4404088860 con 0x7f440c152530 2024-09-17T03:37:53.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 -- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43ec078bc0 msgr2=0x7f43ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43ec078bc0 0x7f43ec07b0d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4400005fd0 tx=0x7f440000b260 comp rx=0 tx=0).stop 2024-09-17T03:37:53.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 -- 172.21.15.121:0/3905166830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f440c152530 msgr2=0x7f440c0b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f440c152530 0x7f440c0b1000 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f440402b020 tx=0x7f4404003f90 comp rx=0 tx=0).stop 2024-09-17T03:37:53.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 -- 172.21.15.121:0/3905166830 shutdown_connections 2024-09-17T03:37:53.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43ec078bc0 0x7f43ec07b0d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f440c152530 0x7f440c0b1000 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f440c0b39d0 0x7f440c1f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 --2- 172.21.15.121:0/3905166830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f440c073dd0 0x7f440c147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 -- 172.21.15.121:0/3905166830 >> 172.21.15.121:0/3905166830 conn(0x7f440c06f940 msgr2=0x7f440c14a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:53.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 -- 172.21.15.121:0/3905166830 shutdown_connections 2024-09-17T03:37:53.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.166+0000 7f4413000640 1 -- 172.21.15.121:0/3905166830 wait complete. 2024-09-17T03:37:53.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:37:53.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.410+0000 7f85fb400640 1 -- 172.21.15.121:0/1093043377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f406e500 msgr2=0x7f85f40cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.410+0000 7f85fb400640 1 --2- 172.21.15.121:0/1093043377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f406e500 0x7f85f40cc020 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f85ec005fd0 tx=0x7f85ec02aa90 comp rx=0 tx=0).stop 2024-09-17T03:37:53.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.410+0000 7f85fb400640 1 -- 172.21.15.121:0/1093043377 shutdown_connections 2024-09-17T03:37:53.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.410+0000 7f85fb400640 1 --2- 172.21.15.121:0/1093043377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f406e500 0x7f85f40cc020 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.410+0000 7f85fb400640 1 --2- 172.21.15.121:0/1093043377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f4074cb0 0x7f85f4073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.410+0000 7f85fb400640 1 -- 172.21.15.121:0/1093043377 >> 172.21.15.121:0/1093043377 conn(0x7f85f40cca40 msgr2=0x7f85f40cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:53.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.410+0000 7f85fb400640 1 -- 172.21.15.121:0/1093043377 shutdown_connections 2024-09-17T03:37:53.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.410+0000 7f85fb400640 1 -- 172.21.15.121:0/1093043377 wait complete. 2024-09-17T03:37:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.412+0000 7f85fb400640 1 Processor -- start 2024-09-17T03:37:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.413+0000 7f85fb400640 1 -- start start 2024-09-17T03:37:53.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.414+0000 7f85fb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f4074cb0 0x7f85f41f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.414+0000 7f85fb400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f40cbc10 0x7f85f41f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.414+0000 7f85fb400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f4155480 0x7f85f415ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.414+0000 7f85fb400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f85f406f310 con 0x7f85f4074cb0 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.414+0000 7f85fb400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85f406f190 con 0x7f85f40cbc10 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.414+0000 7f85fb400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85f406f490 con 0x7f85f4155480 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.414+0000 7f85f8a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f4074cb0 0x7f85f41f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.414+0000 7f85f8a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f4074cb0 0x7f85f41f2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39956/0 (socket says 172.21.15.121:39956) 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.414+0000 7f85f8a00640 1 -- 172.21.15.121:0/1684520978 learned_addr learned my addr 172.21.15.121:0/1684520978 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85f9400640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f4155480 0x7f85f415ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85ebe00640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f40cbc10 0x7f85f41f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85f8a00640 1 -- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f4155480 msgr2=0x7f85f415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85f8a00640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f4155480 0x7f85f415ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85f8a00640 1 -- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f40cbc10 msgr2=0x7f85f41f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85f8a00640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f40cbc10 0x7f85f41f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85f8a00640 1 -- 172.21.15.121:0/1684520978 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f41535a0 con 0x7f85f4074cb0 2024-09-17T03:37:53.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85f9400640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f4155480 0x7f85f415ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:53.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85ebe00640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f40cbc10 0x7f85f41f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:53.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85f8a00640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f4074cb0 0x7f85f41f2970 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f85e400d700 tx=0x7f85e400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:53.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.415+0000 7f85f1600640 1 -- 172.21.15.121:0/1684520978 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4017070 con 0x7f85f4074cb0 2024-09-17T03:37:53.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.416+0000 7f85f1600640 1 -- 172.21.15.121:0/1684520978 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85e4004310 con 0x7f85f4074cb0 2024-09-17T03:37:53.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.416+0000 7f85fb400640 1 -- 172.21.15.121:0/1684520978 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f4153880 con 0x7f85f4074cb0 2024-09-17T03:37:53.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.416+0000 7f85f1600640 1 -- 172.21.15.121:0/1684520978 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4009a20 con 0x7f85f4074cb0 2024-09-17T03:37:53.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.416+0000 7f85fb400640 1 -- 172.21.15.121:0/1684520978 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f4153e40 con 0x7f85f4074cb0 2024-09-17T03:37:53.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.417+0000 7f85fb400640 1 -- 172.21.15.121:0/1684520978 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f406f9b0 con 0x7f85f4074cb0 2024-09-17T03:37:53.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.418+0000 7f85f1600640 1 -- 172.21.15.121:0/1684520978 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85e4009bc0 con 0x7f85f4074cb0 2024-09-17T03:37:53.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.419+0000 7f85f1600640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f85d0078bc0 0x7f85d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.419+0000 7f85f1600640 1 -- 172.21.15.121:0/1684520978 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7f85e409ace0 con 0x7f85f4074cb0 2024-09-17T03:37:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.419+0000 7f85ebe00640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f85d0078bc0 0x7f85d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.420+0000 7f85ebe00640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f85d0078bc0 0x7f85d007b0d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f85f409b200 tx=0x7f85dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:53.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.423+0000 7f85f1600640 1 -- 172.21.15.121:0/1684520978 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f85e40631f0 con 0x7f85f4074cb0 2024-09-17T03:37:53.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.607+0000 7f85fb400640 1 -- 172.21.15.121:0/1684520978 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f85f40afaa0 con 0x7f85f4074cb0 2024-09-17T03:37:53.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.608+0000 7f85f1600640 1 -- 172.21.15.121:0/1684520978 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v36) ==== 59+0+2294 (secure 0 0 0) 0x7f85e4062af0 con 0x7f85f4074cb0 2024-09-17T03:37:53.608 INFO:teuthology.orchestra.run.smithi121.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:37:53.608 INFO:teuthology.orchestra.run.smithi121.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:37:53.608 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:37:53.608 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_client 20/20 2024-09-17T03:37:53.608 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:37:53.608 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:37:53.608 INFO:teuthology.orchestra.run.smithi121.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:37:53.608 INFO:teuthology.orchestra.run.smithi121.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:37:53.608 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3249.879374 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3414.976419 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3347.142673 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3524.210167 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 7230.495988 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4229.547603 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4520.738354 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4185.245448 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds 20/20 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_ms 2/2 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_frag true 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:37:53.609 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:37:53.610 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_verify_scatter true 2024-09-17T03:37:53.610 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:37:53.610 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:37:53.610 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:37:53.610 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced client_mount_timeout 600 2024-09-17T03:37:53.610 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_client 20/20 2024-09-17T03:37:53.610 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_ms 1/1 2024-09-17T03:37:53.610 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:37:53.610 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:37:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 -- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f85d0078bc0 msgr2=0x7f85d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f85d0078bc0 0x7f85d007b0d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f85f409b200 tx=0x7f85dc009040 comp rx=0 tx=0).stop 2024-09-17T03:37:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 -- 172.21.15.121:0/1684520978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f4074cb0 msgr2=0x7f85f41f2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f4074cb0 0x7f85f41f2970 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f85e400d700 tx=0x7f85e400dbc0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 -- 172.21.15.121:0/1684520978 shutdown_connections 2024-09-17T03:37:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85f4155480 0x7f85f415ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f40cbc10 0x7f85f41f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f85d0078bc0 0x7f85d007b0d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 --2- 172.21.15.121:0/1684520978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f4074cb0 0x7f85f41f2970 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 -- 172.21.15.121:0/1684520978 >> 172.21.15.121:0/1684520978 conn(0x7f85f40cca40 msgr2=0x7f85f40b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:53.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 -- 172.21.15.121:0/1684520978 shutdown_connections 2024-09-17T03:37:53.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.610+0000 7f85fb400640 1 -- 172.21.15.121:0/1684520978 wait complete. 2024-09-17T03:37:53.631 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:37:53.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.854+0000 7fdd3a200640 1 -- 172.21.15.121:0/1529751160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd34156a50 msgr2=0x7fdd34074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.854+0000 7fdd3a200640 1 --2- 172.21.15.121:0/1529751160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd34156a50 0x7fdd34074620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdd24005fd0 tx=0x7fdd2402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.854+0000 7fdd3a200640 1 -- 172.21.15.121:0/1529751160 shutdown_connections 2024-09-17T03:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.854+0000 7fdd3a200640 1 --2- 172.21.15.121:0/1529751160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd34074b60 0x7fdd3406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.854+0000 7fdd3a200640 1 --2- 172.21.15.121:0/1529751160 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd34156a50 0x7fdd34074620 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.854+0000 7fdd3a200640 1 -- 172.21.15.121:0/1529751160 >> 172.21.15.121:0/1529751160 conn(0x7fdd340b1b90 msgr2=0x7fdd340b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.854+0000 7fdd3a200640 1 -- 172.21.15.121:0/1529751160 shutdown_connections 2024-09-17T03:37:53.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.855+0000 7fdd3a200640 1 -- 172.21.15.121:0/1529751160 wait complete. 2024-09-17T03:37:53.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.857+0000 7fdd3a200640 1 Processor -- start 2024-09-17T03:37:53.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.857+0000 7fdd3a200640 1 -- start start 2024-09-17T03:37:53.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.858+0000 7fdd3a200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd3406e330 0x7fdd341560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.858+0000 7fdd3a200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd34074b60 0x7fdd340b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.858+0000 7fdd3a200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd34156a50 0x7fdd340b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.858+0000 7fdd3a200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd340ce500 con 0x7fdd34156a50 2024-09-17T03:37:53.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.858+0000 7fdd3a200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd340ce380 con 0x7fdd34074b60 2024-09-17T03:37:53.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.858+0000 7fdd3a200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd340ce680 con 0x7fdd3406e330 2024-09-17T03:37:53.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.859+0000 7fdd33e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd34156a50 0x7fdd340b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.859+0000 7fdd33e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd34156a50 0x7fdd340b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39960/0 (socket says 172.21.15.121:39960) 2024-09-17T03:37:53.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.859+0000 7fdd33e00640 1 -- 172.21.15.121:0/3953063367 learned_addr learned my addr 172.21.15.121:0/3953063367 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:53.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.859+0000 7fdd32a00640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd34074b60 0x7fdd340b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.859+0000 7fdd33400640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd3406e330 0x7fdd341560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.859+0000 7fdd33e00640 1 -- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd3406e330 msgr2=0x7fdd341560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.859+0000 7fdd33e00640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd3406e330 0x7fdd341560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.859+0000 7fdd33e00640 1 -- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd34074b60 msgr2=0x7fdd340b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.859+0000 7fdd33e00640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd34074b60 0x7fdd340b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.859+0000 7fdd33e00640 1 -- 172.21.15.121:0/3953063367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd340c8d80 con 0x7fdd34156a50 2024-09-17T03:37:53.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.860+0000 7fdd33e00640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd34156a50 0x7fdd340b5700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c6e0 tx=0x7fdd2c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.860+0000 7fdd2b400640 1 -- 172.21.15.121:0/3953063367 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c003b70 con 0x7fdd34156a50 2024-09-17T03:37:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.860+0000 7fdd3a200640 1 -- 172.21.15.121:0/3953063367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd340c9060 con 0x7fdd34156a50 2024-09-17T03:37:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.860+0000 7fdd2b400640 1 -- 172.21.15.121:0/3953063367 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd2c003d30 con 0x7fdd34156a50 2024-09-17T03:37:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.860+0000 7fdd2b400640 1 -- 172.21.15.121:0/3953063367 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c005330 con 0x7fdd34156a50 2024-09-17T03:37:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.860+0000 7fdd3a200640 1 -- 172.21.15.121:0/3953063367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd34158d20 con 0x7fdd34156a50 2024-09-17T03:37:53.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.861+0000 7fdd3a200640 1 -- 172.21.15.121:0/3953063367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3415aee0 con 0x7fdd34156a50 2024-09-17T03:37:53.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.862+0000 7fdd2b400640 1 -- 172.21.15.121:0/3953063367 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd2c0054d0 con 0x7fdd34156a50 2024-09-17T03:37:53.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.864+0000 7fdd2b400640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdd14078bc0 0x7fdd1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.864+0000 7fdd2b400640 1 -- 172.21.15.121:0/3953063367 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7fdd2c09a730 con 0x7fdd34156a50 2024-09-17T03:37:53.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.864+0000 7fdd33400640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdd14078bc0 0x7fdd1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.865+0000 7fdd33400640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdd14078bc0 0x7fdd1407b0d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdd24033000 tx=0x7fdd24004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:53.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:53.868+0000 7fdd2b400640 1 -- 172.21.15.121:0/3953063367 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd3415aee0 con 0x7fdd34156a50 2024-09-17T03:37:54.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.051+0000 7fdd3a200640 1 -- 172.21.15.121:0/3953063367 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdd340bcb80 con 0x7fdd34156a50 2024-09-17T03:37:54.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.055+0000 7fdd2b400640 1 -- 172.21.15.121:0/3953063367 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v37)=0 v37) ==== 122+0+0 (secure 0 0 0) 0x7fdd3406e740 con 0x7fdd34156a50 2024-09-17T03:37:54.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.057+0000 7fdd3a200640 1 -- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdd14078bc0 msgr2=0x7fdd1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:54.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.057+0000 7fdd3a200640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdd14078bc0 0x7fdd1407b0d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdd24033000 tx=0x7fdd24004730 comp rx=0 tx=0).stop 2024-09-17T03:37:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.057+0000 7fdd3a200640 1 -- 172.21.15.121:0/3953063367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd34156a50 msgr2=0x7fdd340b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.057+0000 7fdd3a200640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd34156a50 0x7fdd340b5700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c6e0 tx=0x7fdd2c00cba0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.058+0000 7fdd3a200640 1 -- 172.21.15.121:0/3953063367 shutdown_connections 2024-09-17T03:37:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.058+0000 7fdd3a200640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdd14078bc0 0x7fdd1407b0d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.058+0000 7fdd3a200640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd34156a50 0x7fdd340b5700 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.058+0000 7fdd3a200640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd34074b60 0x7fdd340b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.058+0000 7fdd3a200640 1 --2- 172.21.15.121:0/3953063367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd3406e330 0x7fdd341560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.058+0000 7fdd3a200640 1 -- 172.21.15.121:0/3953063367 >> 172.21.15.121:0/3953063367 conn(0x7fdd340b1b90 msgr2=0x7fdd340b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.058+0000 7fdd3a200640 1 -- 172.21.15.121:0/3953063367 shutdown_connections 2024-09-17T03:37:54.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.058+0000 7fdd3a200640 1 -- 172.21.15.121:0/3953063367 wait complete. 2024-09-17T03:37:54.083 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:37:54.083 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:54.175 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:54.269 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:37:54.270 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:54.270 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:54.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:37:54.305 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:54.305 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:54.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:54.342 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:37:54.342 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:54.380 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:37:54.380 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:37:54.381 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:54.418 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:54.418 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:37:54.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:54.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.641+0000 7f489d400640 1 -- 172.21.15.121:0/1216583779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f489815dfe0 msgr2=0x7f4898160a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:54.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.641+0000 7f489d400640 1 --2- 172.21.15.121:0/1216583779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f489815dfe0 0x7f4898160a40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4888005fd0 tx=0x7f488802aa10 comp rx=0 tx=0).stop 2024-09-17T03:37:54.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.641+0000 7f489d400640 1 -- 172.21.15.121:0/1216583779 shutdown_connections 2024-09-17T03:37:54.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.641+0000 7f489d400640 1 --2- 172.21.15.121:0/1216583779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48980ccfe0 0x7f489806e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.641+0000 7f489d400640 1 --2- 172.21.15.121:0/1216583779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f489815dfe0 0x7f4898160a40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.641+0000 7f489d400640 1 -- 172.21.15.121:0/1216583779 >> 172.21.15.121:0/1216583779 conn(0x7f489806f940 msgr2=0x7f48980b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:54.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.642+0000 7f489d400640 1 -- 172.21.15.121:0/1216583779 shutdown_connections 2024-09-17T03:37:54.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.642+0000 7f489d400640 1 -- 172.21.15.121:0/1216583779 wait complete. 2024-09-17T03:37:54.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.644+0000 7f489d400640 1 Processor -- start 2024-09-17T03:37:54.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.644+0000 7f489d400640 1 -- start start 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.645+0000 7f489d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f489806e160 0x7f48980c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.645+0000 7f489d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f489815dfe0 0x7f48980c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.645+0000 7f489d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48980ae8c0 0x7f48980c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.645+0000 7f489d400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f48980b4b80 con 0x7f489815dfe0 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.645+0000 7f489d400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f48980b4a00 con 0x7f48980ae8c0 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.645+0000 7f489d400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f48980b4d00 con 0x7f489806e160 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.646+0000 7f488f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f489815dfe0 0x7f48980c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.646+0000 7f488f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f489815dfe0 0x7f48980c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39976/0 (socket says 172.21.15.121:39976) 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.646+0000 7f488f400640 1 -- 172.21.15.121:0/3859748504 learned_addr learned my addr 172.21.15.121:0/3859748504 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.646+0000 7f4897e00640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f489806e160 0x7f48980c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:54.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.646+0000 7f489ca00640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48980ae8c0 0x7f48980c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.646+0000 7f488f400640 1 -- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f489806e160 msgr2=0x7f48980c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.646+0000 7f488f400640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f489806e160 0x7f48980c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.646+0000 7f488f400640 1 -- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48980ae8c0 msgr2=0x7f48980c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.646+0000 7f488f400640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48980ae8c0 0x7f48980c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.646+0000 7f488f400640 1 -- 172.21.15.121:0/3859748504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48981f30f0 con 0x7f489815dfe0 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.647+0000 7f488f400640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f489815dfe0 0x7f48980c70b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f488000c3a0 tx=0x7f488000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.647+0000 7f4894c00640 1 -- 172.21.15.121:0/3859748504 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4880017070 con 0x7f489815dfe0 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.647+0000 7f4894c00640 1 -- 172.21.15.121:0/3859748504 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48800053c0 con 0x7f489815dfe0 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.647+0000 7f4894c00640 1 -- 172.21.15.121:0/3859748504 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4880003850 con 0x7f489815dfe0 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.647+0000 7f489d400640 1 -- 172.21.15.121:0/3859748504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48981f33d0 con 0x7f489815dfe0 2024-09-17T03:37:54.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.647+0000 7f489d400640 1 -- 172.21.15.121:0/3859748504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48981f3990 con 0x7f489815dfe0 2024-09-17T03:37:54.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.648+0000 7f489d400640 1 -- 172.21.15.121:0/3859748504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48980ad660 con 0x7f489815dfe0 2024-09-17T03:37:54.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.649+0000 7f4894c00640 1 -- 172.21.15.121:0/3859748504 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f488001a070 con 0x7f489815dfe0 2024-09-17T03:37:54.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.650+0000 7f4894c00640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4874078b90 0x7f487407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:54.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.650+0000 7f4894c00640 1 -- 172.21.15.121:0/3859748504 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7f4880099f90 con 0x7f489815dfe0 2024-09-17T03:37:54.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.650+0000 7f4897e00640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4874078b90 0x7f487407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:54.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.651+0000 7f4897e00640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4874078b90 0x7f487407b0a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4888035000 tx=0x7f488803b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:54.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.655+0000 7f4894c00640 1 -- 172.21.15.121:0/3859748504 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4880061e50 con 0x7f489815dfe0 2024-09-17T03:37:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.871+0000 7f489d400640 1 -- 172.21.15.121:0/3859748504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48980b51b0 con 0x7f489815dfe0 2024-09-17T03:37:54.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.871+0000 7f4894c00640 1 -- 172.21.15.121:0/3859748504 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3920 (secure 0 0 0) 0x7f4880066880 con 0x7f489815dfe0 2024-09-17T03:37:54.871 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:54.871 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":30,"btime":"2024-09-17T03:37:48:136359+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4041842554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4041842554},{"type":"v1","addr":"172.21.15.176:6837","nonce":4041842554}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5308,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1921105537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1921105537},{"type":"v1","addr":"172.21.15.176:6836","nonce":1921105537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5379,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/1479695563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1479695563},{"type":"v1","addr":"172.21.15.121:6833","nonce":1479695563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/230470634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":230470634},{"type":"v1","addr":"172.21.15.121:6835","nonce":230470634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[]} 2024-09-17T03:37:54.872 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 30 2024-09-17T03:37:54.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 -- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4874078b90 msgr2=0x7f487407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:54.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4874078b90 0x7f487407b0a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4888035000 tx=0x7f488803b040 comp rx=0 tx=0).stop 2024-09-17T03:37:54.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 -- 172.21.15.121:0/3859748504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f489815dfe0 msgr2=0x7f48980c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:54.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f489815dfe0 0x7f48980c70b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f488000c3a0 tx=0x7f488000c860 comp rx=0 tx=0).stop 2024-09-17T03:37:54.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 -- 172.21.15.121:0/3859748504 shutdown_connections 2024-09-17T03:37:54.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48980ae8c0 0x7f48980c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4874078b90 0x7f487407b0a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f489815dfe0 0x7f48980c70b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 --2- 172.21.15.121:0/3859748504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f489806e160 0x7f48980c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:54.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 -- 172.21.15.121:0/3859748504 >> 172.21.15.121:0/3859748504 conn(0x7f489806f940 msgr2=0x7f489815e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:54.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 -- 172.21.15.121:0/3859748504 shutdown_connections 2024-09-17T03:37:54.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:54.874+0000 7f489d400640 1 -- 172.21.15.121:0/3859748504 wait complete. 2024-09-17T03:37:54.896 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:37:54.896 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:37:54.896 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:37:54.896 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:54.896 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:37:54.897 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:37:54.897 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:37:54.897 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:54.897 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:37:54.897 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:37:54.897 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:37:54.897 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:54.898 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:37:54.898 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:37:54.898 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:37:54.898 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:54.930 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:37:54.931 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:37:54.933 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:37:54.933 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:37:54.934 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:37:54.934 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:37:54.935 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:37:54.935 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:37:54.977 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:37:54.977 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:54.978 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:37:54.978 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:54.980 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:37:54.980 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:54.980 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:37:54.981 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:54.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:37:55.172 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:37:55.179 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T03:37:55.179 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:37:55.179 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:37:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.214+0000 7f2f32200640 1 -- 172.21.15.121:0/721454024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f2c0b7aa0 msgr2=0x7f2f2c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.214+0000 7f2f32200640 1 --2- 172.21.15.121:0/721454024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f2c0b7aa0 0x7f2f2c06dc40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009830 tx=0x7f2f1802a5b0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.214+0000 7f2f32200640 1 -- 172.21.15.121:0/721454024 shutdown_connections 2024-09-17T03:37:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.214+0000 7f2f32200640 1 --2- 172.21.15.121:0/721454024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f2c0b7aa0 0x7f2f2c06dc40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.214+0000 7f2f32200640 1 -- 172.21.15.121:0/721454024 >> 172.21.15.121:0/721454024 conn(0x7f2f2c0d0c70 msgr2=0x7f2f2c0d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.214+0000 7f2f32200640 1 -- 172.21.15.121:0/721454024 shutdown_connections 2024-09-17T03:37:55.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.214+0000 7f2f32200640 1 -- 172.21.15.121:0/721454024 wait complete. 2024-09-17T03:37:55.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.216+0000 7f2f32200640 1 Processor -- start 2024-09-17T03:37:55.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.216+0000 7f2f32200640 1 -- start start 2024-09-17T03:37:55.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f32200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c06e180 0x7f2f2c158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:55.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f32200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f2c0b7690 0x7f2f2c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:55.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f32200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c155430 0x7f2f2c1f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:55.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f32200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c1639b0 con 0x7f2f2c0b7690 2024-09-17T03:37:55.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f32200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c163830 con 0x7f2f2c06e180 2024-09-17T03:37:55.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f32200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f2c169e90 con 0x7f2f2c155430 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f2be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f2c0b7690 0x7f2f2c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f2be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f2c0b7690 0x7f2f2c14d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40008/0 (socket says 172.21.15.121:40008) 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f2be00640 1 -- 172.21.15.121:0/1974274931 learned_addr learned my addr 172.21.15.121:0/1974274931 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f30e00640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c06e180 0x7f2f2c158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f31800640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c155430 0x7f2f2c1f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f2be00640 1 -- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c155430 msgr2=0x7f2f2c1f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f2be00640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c155430 0x7f2f2c1f5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f2be00640 1 -- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c06e180 msgr2=0x7f2f2c158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f2be00640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c06e180 0x7f2f2c158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.218+0000 7f2f2be00640 1 -- 172.21.15.121:0/1974274931 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c151620 con 0x7f2f2c0b7690 2024-09-17T03:37:55.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.219+0000 7f2f2be00640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f2c0b7690 0x7f2f2c14d140 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2f18000c00 tx=0x7f2f18032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:55.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.219+0000 7f2f28c00640 1 -- 172.21.15.121:0/1974274931 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18040070 con 0x7f2f2c0b7690 2024-09-17T03:37:55.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.219+0000 7f2f28c00640 1 -- 172.21.15.121:0/1974274931 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f18005310 con 0x7f2f2c0b7690 2024-09-17T03:37:55.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.219+0000 7f2f28c00640 1 -- 172.21.15.121:0/1974274931 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18003800 con 0x7f2f2c0b7690 2024-09-17T03:37:55.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.219+0000 7f2f32200640 1 -- 172.21.15.121:0/1974274931 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2c154950 con 0x7f2f2c0b7690 2024-09-17T03:37:55.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.219+0000 7f2f32200640 1 -- 172.21.15.121:0/1974274931 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f2c154f10 con 0x7f2f2c0b7690 2024-09-17T03:37:55.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.220+0000 7f2f32200640 1 -- 172.21.15.121:0/1974274931 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f2c0b9610 con 0x7f2f2c0b7690 2024-09-17T03:37:55.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.221+0000 7f2f28c00640 1 -- 172.21.15.121:0/1974274931 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f18039040 con 0x7f2f2c0b7690 2024-09-17T03:37:55.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.222+0000 7f2f28c00640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f0c078b90 0x7f2f0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:55.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.222+0000 7f2f28c00640 1 -- 172.21.15.121:0/1974274931 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5335+0+0 (secure 0 0 0) 0x7f2f180bb860 con 0x7f2f2c0b7690 2024-09-17T03:37:55.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.223+0000 7f2f30e00640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f0c078b90 0x7f2f0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:55.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.224+0000 7f2f30e00640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f0c078b90 0x7f2f0c07b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2f200046b0 tx=0x7f2f20007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:55.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.227+0000 7f2f28c00640 1 -- 172.21.15.121:0/1974274931 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f1804b070 con 0x7f2f2c0b7690 2024-09-17T03:37:55.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:55.422+0000 7f2f32200640 1 -- 172.21.15.121:0/1974274931 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2f2c1632a0 con 0x7f2f2c0b7690 2024-09-17T03:37:56.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.184+0000 7f2f28c00640 1 -- 172.21.15.121:0/1974274931 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) ==== 97+0+0 (secure 0 0 0) 0x7f2f18083730 con 0x7f2f2c0b7690 2024-09-17T03:37:56.185 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-17T03:37:56.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.188+0000 7f2f32200640 1 -- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f0c078b90 msgr2=0x7f2f0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.188+0000 7f2f32200640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f0c078b90 0x7f2f0c07b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2f200046b0 tx=0x7f2f20007e90 comp rx=0 tx=0).stop 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.188+0000 7f2f32200640 1 -- 172.21.15.121:0/1974274931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f2c0b7690 msgr2=0x7f2f2c14d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.188+0000 7f2f32200640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f2c0b7690 0x7f2f2c14d140 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2f18000c00 tx=0x7f2f18032d50 comp rx=0 tx=0).stop 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.188+0000 7f2f32200640 1 -- 172.21.15.121:0/1974274931 shutdown_connections 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.188+0000 7f2f32200640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f2c155430 0x7f2f2c1f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.189+0000 7f2f32200640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2f0c078b90 0x7f2f0c07b0a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.189+0000 7f2f32200640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f2c0b7690 0x7f2f2c14d140 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.189+0000 7f2f32200640 1 --2- 172.21.15.121:0/1974274931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f2c06e180 0x7f2f2c158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.189+0000 7f2f32200640 1 -- 172.21.15.121:0/1974274931 >> 172.21.15.121:0/1974274931 conn(0x7f2f2c0d0c70 msgr2=0x7f2f2c0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.189+0000 7f2f32200640 1 -- 172.21.15.121:0/1974274931 shutdown_connections 2024-09-17T03:37:56.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.189+0000 7f2f32200640 1 -- 172.21.15.121:0/1974274931 wait complete. 2024-09-17T03:37:56.213 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:37:56.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.436+0000 7fb586800640 1 -- 172.21.15.121:0/351757034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb568003a00 msgr2=0x7fb568003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.436+0000 7fb586800640 1 --2- 172.21.15.121:0/351757034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb568003a00 0x7fb568003e70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c610 tx=0x7fb568005830 comp rx=0 tx=0).stop 2024-09-17T03:37:56.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.436+0000 7fb585e00640 1 -- 172.21.15.121:0/351757034 reap_dead start 2024-09-17T03:37:56.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.436+0000 7fb586800640 1 -- 172.21.15.121:0/351757034 shutdown_connections 2024-09-17T03:37:56.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.436+0000 7fb586800640 1 -- 172.21.15.121:0/351757034 >> 172.21.15.121:0/351757034 conn(0x7fb58006f940 msgr2=0x7fb5800b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:56.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.436+0000 7fb586800640 1 -- 172.21.15.121:0/351757034 shutdown_connections 2024-09-17T03:37:56.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.436+0000 7fb586800640 1 -- 172.21.15.121:0/351757034 wait complete. 2024-09-17T03:37:56.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.438+0000 7fb586800640 1 Processor -- start 2024-09-17T03:37:56.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.438+0000 7fb586800640 1 -- start start 2024-09-17T03:37:56.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb586800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb568003a00 0x7fb580141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb586800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb580151530 0x7fb58013f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb586800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5801f8c80 0x7fb5801f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb586800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb58006e560 con 0x7fb568003a00 2024-09-17T03:37:56.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb586800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb58006e3e0 con 0x7fb580151530 2024-09-17T03:37:56.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb586800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb58015cf20 con 0x7fb5801f8c80 2024-09-17T03:37:56.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb585400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb568003a00 0x7fb580141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb585400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb568003a00 0x7fb580141e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40034/0 (socket says 172.21.15.121:40034) 2024-09-17T03:37:56.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb585400640 1 -- 172.21.15.121:0/3074047146 learned_addr learned my addr 172.21.15.121:0/3074047146 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:56.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb584a00640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb580151530 0x7fb58013f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb585400640 1 -- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5801f8c80 msgr2=0x7fb5801f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb585400640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5801f8c80 0x7fb5801f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb585400640 1 -- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb580151530 msgr2=0x7fb58013f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb585400640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb580151530 0x7fb58013f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.440+0000 7fb585400640 1 -- 172.21.15.121:0/3074047146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5801f9770 con 0x7fb568003a00 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.441+0000 7fb585400640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb568003a00 0x7fb580141e50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c730 tx=0x7fb574004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.441+0000 7fb57d600640 1 -- 172.21.15.121:0/3074047146 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57402ba00 con 0x7fb568003a00 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.441+0000 7fb57d600640 1 -- 172.21.15.121:0/3074047146 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb57402bba0 con 0x7fb568003a00 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.441+0000 7fb586800640 1 -- 172.21.15.121:0/3074047146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb580141650 con 0x7fb568003a00 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.441+0000 7fb57d600640 1 -- 172.21.15.121:0/3074047146 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5740060c0 con 0x7fb568003a00 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.441+0000 7fb586800640 1 -- 172.21.15.121:0/3074047146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb580142390 con 0x7fb568003a00 2024-09-17T03:37:56.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.442+0000 7fb586800640 1 -- 172.21.15.121:0/3074047146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5800af090 con 0x7fb568003a00 2024-09-17T03:37:56.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.443+0000 7fb57d600640 1 -- 172.21.15.121:0/3074047146 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb574006280 con 0x7fb568003a00 2024-09-17T03:37:56.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.444+0000 7fb57d600640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb560078b90 0x7fb56007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.445+0000 7fb57d600640 1 -- 172.21.15.121:0/3074047146 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7fb5740bb720 con 0x7fb568003a00 2024-09-17T03:37:56.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.445+0000 7fb584a00640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb560078b90 0x7fb56007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.446+0000 7fb584a00640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb560078b90 0x7fb56007b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb56c005eb0 tx=0x7fb56c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:56.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.449+0000 7fb57d600640 1 -- 172.21.15.121:0/3074047146 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb5800af090 con 0x7fb568003a00 2024-09-17T03:37:56.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.700+0000 7fb586800640 1 -- 172.21.15.121:0/3074047146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb5800b3d80 con 0x7fb568003a00 2024-09-17T03:37:56.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.700+0000 7fb57d600640 1 -- 172.21.15.121:0/3074047146 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7fb5800b3d80 con 0x7fb568003a00 2024-09-17T03:37:56.701 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:56.701 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:37:56.701 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-17T03:37:56.701 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.701 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-17T03:37:56.701 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohm64sFGhAAJDdFwMDkudwacQaLfvbAdg==", 2024-09-17T03:37:56.701 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.701 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:56.701 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:37:56.701 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:37:56.702 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.702 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.702 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.702 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.702 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-17T03:37:56.702 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmIGvPNRAAvE+tovzn5WadGa9C/P/A3A==", 2024-09-17T03:37:56.702 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.702 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:56.702 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:37:56.702 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.c", 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmV/btJxAAmhL4jXk0LVdzCPaNi9Hzhg==", 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:37:56.703 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.d", 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmeQccCBAAtTfeUysbtoqrKjwaKRWyvg==", 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.704 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDE+OhmBxJKNRAAGxPaH7R2JtcFVO5kR/Qh2A==", 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDI+OhmRtvFCBAAOG/1XD75Atl6ztUGPw3PKA==", 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-17T03:37:56.706 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL+OhmwzDzIxAA9Z/IIRphtZK1jbS2sIXeJQ==", 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.3", 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDO+Ohm94g0NBAAmxtHPev4OOM0YfOQt7N5Jg==", 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.707 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.4", 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDV+Ohmj7OoCBAA/Hrj9dHVT98lURPWJE3r/g==", 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:56.708 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.5", 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDY+Ohmc29QFxAAGsMy0+9MviYohok8JpL+ZA==", 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.709 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.6", 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDb+OhmDO8tKRAAq6bn/I54WKTdN6XiviHNsQ==", 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.7", 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDe+OhmUuFwNxAAgAeDJiL/TIGDuDAC+dXCyA==", 2024-09-17T03:37:56.710 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw==", 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:56.711 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohmec7LKRAAl5nAqPEncglNL2FbRlD0oA==", 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:37:56.712 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.2", 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohme/hCHxAAdP8DjxaXWMGi/Fw+85zUFA==", 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.713 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.3", 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmivFTNBAA5f47Lq5CE+iXt3i+5fUJGA==", 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.714 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC/+OhmXWj6GBAAh/FBw0ElmHixSBXm8PPeAg==", 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohmsn9CDxAAzjtaZG1qe4XTnBge+t3vlA==", 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.715 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.y", 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmQfYJAxAA6Mc5PiIb5VDamVU5Vhx3aQ==", 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:37:56.716 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.717 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:56.717 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-17T03:37:56.717 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 -- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb560078b90 msgr2=0x7fb56007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb560078b90 0x7fb56007b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb56c005eb0 tx=0x7fb56c005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 -- 172.21.15.121:0/3074047146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb568003a00 msgr2=0x7fb580141e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb568003a00 0x7fb580141e50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c730 tx=0x7fb574004c30 comp rx=0 tx=0).stop 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 -- 172.21.15.121:0/3074047146 shutdown_connections 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5801f8c80 0x7fb5801f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb580151530 0x7fb58013f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb560078b90 0x7fb56007b0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 --2- 172.21.15.121:0/3074047146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb568003a00 0x7fb580141e50 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 -- 172.21.15.121:0/3074047146 >> 172.21.15.121:0/3074047146 conn(0x7fb58006f940 msgr2=0x7fb580073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 -- 172.21.15.121:0/3074047146 shutdown_connections 2024-09-17T03:37:56.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.703+0000 7fb586800640 1 -- 172.21.15.121:0/3074047146 wait complete. 2024-09-17T03:37:56.726 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:37:56.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.945+0000 7f8e1d800640 1 -- 172.21.15.121:0/2226127973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1806e500 msgr2=0x7f8e1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.945+0000 7f8e1d800640 1 --2- 172.21.15.121:0/2226127973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1806e500 0x7f8e1806ede0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8e10005fd0 tx=0x7f8e1002a940 comp rx=0 tx=0).stop 2024-09-17T03:37:56.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.945+0000 7f8e1d800640 1 -- 172.21.15.121:0/2226127973 shutdown_connections 2024-09-17T03:37:56.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.945+0000 7f8e1d800640 1 --2- 172.21.15.121:0/2226127973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1806e500 0x7f8e1806ede0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.945+0000 7f8e1d800640 1 -- 172.21.15.121:0/2226127973 >> 172.21.15.121:0/2226127973 conn(0x7f8e180cca40 msgr2=0x7f8e180cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:56.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.946+0000 7f8e1d800640 1 -- 172.21.15.121:0/2226127973 shutdown_connections 2024-09-17T03:37:56.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.946+0000 7f8e1d800640 1 -- 172.21.15.121:0/2226127973 wait complete. 2024-09-17T03:37:56.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.948+0000 7f8e1d800640 1 Processor -- start 2024-09-17T03:37:56.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.948+0000 7f8e1d800640 1 -- start start 2024-09-17T03:37:56.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.949+0000 7f8e1d800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e18073dd0 0x7f8e180b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.949+0000 7f8e1d800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e18074cb0 0x7f8e181e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.949+0000 7f8e1d800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1815e910 0x7f8e1815ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.949+0000 7f8e1d800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1806f6b0 con 0x7f8e18074cb0 2024-09-17T03:37:56.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.949+0000 7f8e1d800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1806f530 con 0x7f8e1815e910 2024-09-17T03:37:56.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.949+0000 7f8e1d800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1806f830 con 0x7f8e18073dd0 2024-09-17T03:37:56.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.950+0000 7f8e0e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e18074cb0 0x7f8e181e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.950+0000 7f8e0e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e18074cb0 0x7f8e181e75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40038/0 (socket says 172.21.15.121:40038) 2024-09-17T03:37:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.950+0000 7f8e0e000640 1 -- 172.21.15.121:0/4288103886 learned_addr learned my addr 172.21.15.121:0/4288103886 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.950+0000 7f8e17400640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1815e910 0x7f8e1815ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.950+0000 7f8e16a00640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e18073dd0 0x7f8e180b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.950+0000 7f8e0e000640 1 -- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e18073dd0 msgr2=0x7f8e180b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.950+0000 7f8e0e000640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e18073dd0 0x7f8e180b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.950+0000 7f8e0e000640 1 -- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1815e910 msgr2=0x7f8e1815ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.950+0000 7f8e0e000640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1815e910 0x7f8e1815ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.950+0000 7f8e0e000640 1 -- 172.21.15.121:0/4288103886 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1815f260 con 0x7f8e18074cb0 2024-09-17T03:37:56.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.951+0000 7f8e0e000640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e18074cb0 0x7f8e181e75a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000c390 tx=0x7f8e0000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:56.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.951+0000 7f8e0f400640 1 -- 172.21.15.121:0/4288103886 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e00011790 con 0x7f8e18074cb0 2024-09-17T03:37:56.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.951+0000 7f8e0f400640 1 -- 172.21.15.121:0/4288103886 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e00017070 con 0x7f8e18074cb0 2024-09-17T03:37:56.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.951+0000 7f8e0f400640 1 -- 172.21.15.121:0/4288103886 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e00011ce0 con 0x7f8e18074cb0 2024-09-17T03:37:56.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.951+0000 7f8e1d800640 1 -- 172.21.15.121:0/4288103886 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e181f6490 con 0x7f8e18074cb0 2024-09-17T03:37:56.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.951+0000 7f8e1d800640 1 -- 172.21.15.121:0/4288103886 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e181f6c70 con 0x7f8e18074cb0 2024-09-17T03:37:56.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.952+0000 7f8e1d800640 1 -- 172.21.15.121:0/4288103886 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e181f6700 con 0x7f8e18074cb0 2024-09-17T03:37:56.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.953+0000 7f8e0f400640 1 -- 172.21.15.121:0/4288103886 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e0001c460 con 0x7f8e18074cb0 2024-09-17T03:37:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.954+0000 7f8e0f400640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df4078b90 0x7f8df407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.954+0000 7f8e0f400640 1 -- 172.21.15.121:0/4288103886 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7f8e0009a900 con 0x7f8e18074cb0 2024-09-17T03:37:56.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.955+0000 7f8e16a00640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df4078b90 0x7f8df407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.955+0000 7f8e16a00640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df4078b90 0x7f8df407b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8e08000c00 tx=0x7f8e08009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:56.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:56.959+0000 7f8e0f400640 1 -- 172.21.15.121:0/4288103886 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e1815f260 con 0x7f8e18074cb0 2024-09-17T03:37:57.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.143+0000 7f8e1d800640 1 -- 172.21.15.121:0/4288103886 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8e1806ede0 con 0x7f8e18074cb0 2024-09-17T03:37:57.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.143+0000 7f8e0f400640 1 -- 172.21.15.121:0/4288103886 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) ==== 84+0+65 (secure 0 0 0) 0x7f8e00062810 con 0x7f8e18074cb0 2024-09-17T03:37:57.144 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:37:57.144 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-17T03:37:57.144 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:37:57.144 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-17T03:37:57.144 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-17T03:37:57.144 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:37:57.144 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-17T03:37:57.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 -- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df4078b90 msgr2=0x7f8df407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:57.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df4078b90 0x7f8df407b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8e08000c00 tx=0x7f8e08009040 comp rx=0 tx=0).stop 2024-09-17T03:37:57.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 -- 172.21.15.121:0/4288103886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e18074cb0 msgr2=0x7f8e181e75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:57.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e18074cb0 0x7f8e181e75a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000c390 tx=0x7f8e0000c850 comp rx=0 tx=0).stop 2024-09-17T03:37:57.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 -- 172.21.15.121:0/4288103886 shutdown_connections 2024-09-17T03:37:57.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1815e910 0x7f8e1815ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:57.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df4078b90 0x7f8df407b0a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:57.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e18074cb0 0x7f8e181e75a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:57.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 --2- 172.21.15.121:0/4288103886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e18073dd0 0x7f8e180b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:57.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 -- 172.21.15.121:0/4288103886 >> 172.21.15.121:0/4288103886 conn(0x7f8e180cca40 msgr2=0x7f8e1815b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:57.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 -- 172.21.15.121:0/4288103886 shutdown_connections 2024-09-17T03:37:57.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.146+0000 7f8e1d800640 1 -- 172.21.15.121:0/4288103886 wait complete. 2024-09-17T03:37:57.171 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:37:57.171 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:37:57.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.399+0000 7f7a9b200640 1 -- 172.21.15.121:0/1599562364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a7c004800 msgr2=0x7f7a7c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:57.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.399+0000 7f7a9b200640 1 --2- 172.21.15.121:0/1599562364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a7c004800 0x7f7a7c004c10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400c260 tx=0x7f7a7c005830 comp rx=0 tx=0).stop 2024-09-17T03:37:57.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.399+0000 7f7a9a800640 1 -- 172.21.15.121:0/1599562364 reap_dead start 2024-09-17T03:37:57.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.399+0000 7f7a9b200640 1 -- 172.21.15.121:0/1599562364 shutdown_connections 2024-09-17T03:37:57.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.399+0000 7f7a9b200640 1 -- 172.21.15.121:0/1599562364 >> 172.21.15.121:0/1599562364 conn(0x7f7a940d0460 msgr2=0x7f7a9406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:57.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.399+0000 7f7a9b200640 1 -- 172.21.15.121:0/1599562364 shutdown_connections 2024-09-17T03:37:57.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.399+0000 7f7a9b200640 1 -- 172.21.15.121:0/1599562364 wait complete. 2024-09-17T03:37:57.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.402+0000 7f7a9b200640 1 Processor -- start 2024-09-17T03:37:57.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.402+0000 7f7a9b200640 1 -- start start 2024-09-17T03:37:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.403+0000 7f7a9b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c004800 0x7f7a9415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.403+0000 7f7a9b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a941597a0 0x7f7a94159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.403+0000 7f7a9b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a941f84f0 0x7f7a941f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.403+0000 7f7a9b200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940b49b0 con 0x7f7a941597a0 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.403+0000 7f7a9b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940af820 con 0x7f7a941f84f0 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.403+0000 7f7a9b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7a940b4b30 con 0x7f7a7c004800 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.403+0000 7f7a99400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a941597a0 0x7f7a94159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.403+0000 7f7a99400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a941597a0 0x7f7a94159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40048/0 (socket says 172.21.15.121:40048) 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.403+0000 7f7a99400640 1 -- 172.21.15.121:0/1858036775 learned_addr learned my addr 172.21.15.121:0/1858036775 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a9a800640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a941f84f0 0x7f7a941f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a99e00640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c004800 0x7f7a9415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a99400640 1 -- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c004800 msgr2=0x7f7a9415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a99400640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c004800 0x7f7a9415daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:57.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a99400640 1 -- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a941f84f0 msgr2=0x7f7a941f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a99400640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a941f84f0 0x7f7a941f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a99400640 1 -- 172.21.15.121:0/1858036775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a941f8e40 con 0x7f7a941597a0 2024-09-17T03:37:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a99400640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a941597a0 0x7f7a94159bb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7a8402b0d0 tx=0x7f7a84006cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a8e000640 1 -- 172.21.15.121:0/1858036775 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84032030 con 0x7f7a941597a0 2024-09-17T03:37:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a8e000640 1 -- 172.21.15.121:0/1858036775 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a840038e0 con 0x7f7a941597a0 2024-09-17T03:37:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.404+0000 7f7a9b200640 1 -- 172.21.15.121:0/1858036775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9415a3f0 con 0x7f7a941597a0 2024-09-17T03:37:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.405+0000 7f7a8e000640 1 -- 172.21.15.121:0/1858036775 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84003cf0 con 0x7f7a941597a0 2024-09-17T03:37:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.405+0000 7f7a9b200640 1 -- 172.21.15.121:0/1858036775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9415a9b0 con 0x7f7a941597a0 2024-09-17T03:37:57.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.406+0000 7f7a9b200640 1 -- 172.21.15.121:0/1858036775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a94145340 con 0x7f7a941597a0 2024-09-17T03:37:57.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.407+0000 7f7a8e000640 1 -- 172.21.15.121:0/1858036775 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a84035020 con 0x7f7a941597a0 2024-09-17T03:37:57.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.408+0000 7f7a8e000640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a78078bc0 0x7f7a7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:57.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.409+0000 7f7a8e000640 1 -- 172.21.15.121:0/1858036775 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7f7a840bb130 con 0x7f7a941597a0 2024-09-17T03:37:57.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.409+0000 7f7a99e00640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a78078bc0 0x7f7a7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:57.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.410+0000 7f7a99e00640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a78078bc0 0x7f7a7807b0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7a880011a0 tx=0x7f7a88006b10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:57.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.413+0000 7f7a8e000640 1 -- 172.21.15.121:0/1858036775 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7a94145340 con 0x7f7a941597a0 2024-09-17T03:37:57.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:57.596+0000 7f7a9b200640 1 -- 172.21.15.121:0/1858036775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7a9415a180 con 0x7f7a941597a0 2024-09-17T03:37:58.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.189+0000 7f7a8e000640 1 -- 172.21.15.121:0/1858036775 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) ==== 138+0+0 (secure 0 0 0) 0x7f7a84083760 con 0x7f7a941597a0 2024-09-17T03:37:58.189 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-17T03:37:58.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 -- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a78078bc0 msgr2=0x7f7a7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:58.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a78078bc0 0x7f7a7807b0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7a880011a0 tx=0x7f7a88006b10 comp rx=0 tx=0).stop 2024-09-17T03:37:58.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 -- 172.21.15.121:0/1858036775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a941597a0 msgr2=0x7f7a94159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:58.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a941597a0 0x7f7a94159bb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7a8402b0d0 tx=0x7f7a84006cb0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 -- 172.21.15.121:0/1858036775 shutdown_connections 2024-09-17T03:37:58.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a941f84f0 0x7f7a941f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7a78078bc0 0x7f7a7807b0d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a941597a0 0x7f7a94159bb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 --2- 172.21.15.121:0/1858036775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7c004800 0x7f7a9415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 -- 172.21.15.121:0/1858036775 >> 172.21.15.121:0/1858036775 conn(0x7f7a940d0460 msgr2=0x7f7a940b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:58.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 -- 172.21.15.121:0/1858036775 shutdown_connections 2024-09-17T03:37:58.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.192+0000 7f7a9b200640 1 -- 172.21.15.121:0/1858036775 wait complete. 2024-09-17T03:37:58.222 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:37:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.451+0000 7f695f200640 1 -- 172.21.15.121:0/938705302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f693c003c60 msgr2=0x7f693c0040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.451+0000 7f695f200640 1 --2- 172.21.15.121:0/938705302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f693c003c60 0x7f693c0040b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6948001eb0 tx=0x7f693c005830 comp rx=0 tx=0).stop 2024-09-17T03:37:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.451+0000 7f695d200640 1 -- 172.21.15.121:0/938705302 reap_dead start 2024-09-17T03:37:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.452+0000 7f695f200640 1 -- 172.21.15.121:0/938705302 shutdown_connections 2024-09-17T03:37:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.452+0000 7f695f200640 1 -- 172.21.15.121:0/938705302 >> 172.21.15.121:0/938705302 conn(0x7f69580cca40 msgr2=0x7f69580cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.452+0000 7f695f200640 1 -- 172.21.15.121:0/938705302 shutdown_connections 2024-09-17T03:37:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.452+0000 7f695f200640 1 -- 172.21.15.121:0/938705302 wait complete. 2024-09-17T03:37:58.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.454+0000 7f695f200640 1 Processor -- start 2024-09-17T03:37:58.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.454+0000 7f695f200640 1 -- start start 2024-09-17T03:37:58.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.455+0000 7f695f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f693c003c60 0x7f69580af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:58.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.455+0000 7f695f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69580aee10 0x7f69580a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:58.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.455+0000 7f695f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f695815e440 0x7f695815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:58.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f695f200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f695815fd40 con 0x7f693c003c60 2024-09-17T03:37:58.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f695f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f695815fbc0 con 0x7f69580aee10 2024-09-17T03:37:58.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f695f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6958073cc0 con 0x7f695815e440 2024-09-17T03:37:58.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f6957e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f693c003c60 0x7f69580af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f6957e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f693c003c60 0x7f69580af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40062/0 (socket says 172.21.15.121:40062) 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f6957e00640 1 -- 172.21.15.121:0/1353481724 learned_addr learned my addr 172.21.15.121:0/1353481724 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f6957400640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69580aee10 0x7f69580a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f695d200640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f695815e440 0x7f695815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f6957e00640 1 -- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f695815e440 msgr2=0x7f695815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f6957e00640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f695815e440 0x7f695815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f6957e00640 1 -- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69580aee10 msgr2=0x7f69580a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f6957e00640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69580aee10 0x7f69580a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f6957e00640 1 -- 172.21.15.121:0/1353481724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695815ed90 con 0x7f693c003c60 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f695d200640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f695815e440 0x7f695815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:58.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.456+0000 7f6957e00640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f693c003c60 0x7f69580af360 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f694802afe0 tx=0x7f6948001740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:58.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.457+0000 7f694fe00640 1 -- 172.21.15.121:0/1353481724 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948006ba0 con 0x7f693c003c60 2024-09-17T03:37:58.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.457+0000 7f694fe00640 1 -- 172.21.15.121:0/1353481724 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f694803f070 con 0x7f693c003c60 2024-09-17T03:37:58.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.457+0000 7f694fe00640 1 -- 172.21.15.121:0/1353481724 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948003d70 con 0x7f693c003c60 2024-09-17T03:37:58.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.457+0000 7f695f200640 1 -- 172.21.15.121:0/1353481724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6958073f10 con 0x7f693c003c60 2024-09-17T03:37:58.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.457+0000 7f695f200640 1 -- 172.21.15.121:0/1353481724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69580744d0 con 0x7f693c003c60 2024-09-17T03:37:58.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.458+0000 7f695f200640 1 -- 172.21.15.121:0/1353481724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f695815a820 con 0x7f693c003c60 2024-09-17T03:37:58.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.459+0000 7f694fe00640 1 -- 172.21.15.121:0/1353481724 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6948044470 con 0x7f693c003c60 2024-09-17T03:37:58.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.461+0000 7f694fe00640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6938078bc0 0x7f693807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:58.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.461+0000 7f694fe00640 1 -- 172.21.15.121:0/1353481724 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5619+0+0 (secure 0 0 0) 0x7f69480bc560 con 0x7f693c003c60 2024-09-17T03:37:58.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.461+0000 7f6957400640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6938078bc0 0x7f693807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:58.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.462+0000 7f6957400640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6938078bc0 0x7f693807b0d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f69580b5480 tx=0x7f6944006b10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:58.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.466+0000 7f694fe00640 1 -- 172.21.15.121:0/1353481724 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f695815ed90 con 0x7f693c003c60 2024-09-17T03:37:58.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:58.649+0000 7f695f200640 1 -- 172.21.15.121:0/1353481724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f695815a540 con 0x7f693c003c60 2024-09-17T03:37:59.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.198+0000 7f694fe00640 1 -- 172.21.15.121:0/1353481724 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) ==== 170+0+0 (secure 0 0 0) 0x7f6948084950 con 0x7f693c003c60 2024-09-17T03:37:59.198 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.200+0000 7f695f200640 1 -- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6938078bc0 msgr2=0x7f693807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.200+0000 7f695f200640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6938078bc0 0x7f693807b0d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f69580b5480 tx=0x7f6944006b10 comp rx=0 tx=0).stop 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.200+0000 7f695f200640 1 -- 172.21.15.121:0/1353481724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f693c003c60 msgr2=0x7f69580af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.200+0000 7f695f200640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f693c003c60 0x7f69580af360 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f694802afe0 tx=0x7f6948001740 comp rx=0 tx=0).stop 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.201+0000 7f695f200640 1 -- 172.21.15.121:0/1353481724 shutdown_connections 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.201+0000 7f695f200640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f695815e440 0x7f695815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.201+0000 7f695f200640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69580aee10 0x7f69580a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.201+0000 7f695f200640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6938078bc0 0x7f693807b0d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.201+0000 7f695f200640 1 --2- 172.21.15.121:0/1353481724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f693c003c60 0x7f69580af360 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.201+0000 7f695f200640 1 -- 172.21.15.121:0/1353481724 >> 172.21.15.121:0/1353481724 conn(0x7f69580cca40 msgr2=0x7f69580afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.201+0000 7f695f200640 1 -- 172.21.15.121:0/1353481724 shutdown_connections 2024-09-17T03:37:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.201+0000 7f695f200640 1 -- 172.21.15.121:0/1353481724 wait complete. 2024-09-17T03:37:59.239 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:37:59.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.463+0000 7f1b63c00640 1 -- 172.21.15.121:0/351938168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b5c156a50 msgr2=0x7f1b5c074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.463+0000 7f1b63c00640 1 --2- 172.21.15.121:0/351938168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b5c156a50 0x7f1b5c074620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009860 tx=0x7f1b4c02a530 comp rx=0 tx=0).stop 2024-09-17T03:37:59.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.463+0000 7f1b63c00640 1 -- 172.21.15.121:0/351938168 shutdown_connections 2024-09-17T03:37:59.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.463+0000 7f1b63c00640 1 --2- 172.21.15.121:0/351938168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b5c156a50 0x7f1b5c074620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.463+0000 7f1b63c00640 1 -- 172.21.15.121:0/351938168 >> 172.21.15.121:0/351938168 conn(0x7f1b5c0b1b90 msgr2=0x7f1b5c0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.463+0000 7f1b63c00640 1 -- 172.21.15.121:0/351938168 shutdown_connections 2024-09-17T03:37:59.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.463+0000 7f1b63c00640 1 -- 172.21.15.121:0/351938168 wait complete. 2024-09-17T03:37:59.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.465+0000 7f1b63c00640 1 Processor -- start 2024-09-17T03:37:59.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.466+0000 7f1b63c00640 1 -- start start 2024-09-17T03:37:59.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.467+0000 7f1b63c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b5c074b60 0x7f1b5c159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.467+0000 7f1b63c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c156a50 0x7f1b5c1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.467+0000 7f1b63c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b5c1f66f0 0x7f1b5c1f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.467+0000 7f1b63c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c0cf790 con 0x7f1b5c156a50 2024-09-17T03:37:59.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.467+0000 7f1b63c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c0cf610 con 0x7f1b5c074b60 2024-09-17T03:37:59.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.467+0000 7f1b63c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5c0cf910 con 0x7f1b5c1f66f0 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.467+0000 7f1b53e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c156a50 0x7f1b5c1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.467+0000 7f1b53e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c156a50 0x7f1b5c1571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40076/0 (socket says 172.21.15.121:40076) 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.467+0000 7f1b53e00640 1 -- 172.21.15.121:0/624354680 learned_addr learned my addr 172.21.15.121:0/624354680 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b61200640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b5c074b60 0x7f1b5c159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b61c00640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b5c1f66f0 0x7f1b5c1f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b53e00640 1 -- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b5c1f66f0 msgr2=0x7f1b5c1f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b53e00640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b5c1f66f0 0x7f1b5c1f0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b53e00640 1 -- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b5c074b60 msgr2=0x7f1b5c159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b53e00640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b5c074b60 0x7f1b5c159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b53e00640 1 -- 172.21.15.121:0/624354680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c1f32f0 con 0x7f1b5c156a50 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b61200640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b5c074b60 0x7f1b5c159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b53e00640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c156a50 0x7f1b5c1571e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400c500 tx=0x7f1b4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b59600640 1 -- 172.21.15.121:0/624354680 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44016020 con 0x7f1b5c156a50 2024-09-17T03:37:59.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b59600640 1 -- 172.21.15.121:0/624354680 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b44012920 con 0x7f1b5c156a50 2024-09-17T03:37:59.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.468+0000 7f1b63c00640 1 -- 172.21.15.121:0/624354680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5c1f6e60 con 0x7f1b5c156a50 2024-09-17T03:37:59.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.469+0000 7f1b59600640 1 -- 172.21.15.121:0/624354680 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44012d30 con 0x7f1b5c156a50 2024-09-17T03:37:59.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.469+0000 7f1b63c00640 1 -- 172.21.15.121:0/624354680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b5c1f7420 con 0x7f1b5c156a50 2024-09-17T03:37:59.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.470+0000 7f1b63c00640 1 -- 172.21.15.121:0/624354680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5c1f3100 con 0x7f1b5c156a50 2024-09-17T03:37:59.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.471+0000 7f1b59600640 1 -- 172.21.15.121:0/624354680 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b44019020 con 0x7f1b5c156a50 2024-09-17T03:37:59.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.472+0000 7f1b59600640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b38078b90 0x7f1b3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.472+0000 7f1b59600640 1 -- 172.21.15.121:0/624354680 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6001+0+0 (secure 0 0 0) 0x7f1b4409b610 con 0x7f1b5c156a50 2024-09-17T03:37:59.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.472+0000 7f1b61200640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b38078b90 0x7f1b3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.473+0000 7f1b61200640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b38078b90 0x7f1b3807b0a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c034000 tx=0x7f1b4c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.476+0000 7f1b59600640 1 -- 172.21.15.121:0/624354680 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b44020030 con 0x7f1b5c156a50 2024-09-17T03:37:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:37:59.694+0000 7f1b63c00640 1 -- 172.21.15.121:0/624354680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1b5c074620 con 0x7f1b5c156a50 2024-09-17T03:38:00.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.210+0000 7f1b59600640 1 -- 172.21.15.121:0/624354680 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v33) ==== 173+0+0 (secure 0 0 0) 0x7f1b44063890 con 0x7f1b5c156a50 2024-09-17T03:38:00.211 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 9 and data pool 10 2024-09-17T03:38:00.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.217+0000 7f1b63c00640 1 -- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b38078b90 msgr2=0x7f1b3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.217+0000 7f1b63c00640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b38078b90 0x7f1b3807b0a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c034000 tx=0x7f1b4c004730 comp rx=0 tx=0).stop 2024-09-17T03:38:00.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.217+0000 7f1b63c00640 1 -- 172.21.15.121:0/624354680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c156a50 msgr2=0x7f1b5c1571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.217+0000 7f1b63c00640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c156a50 0x7f1b5c1571e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400c500 tx=0x7f1b4400c9c0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.218+0000 7f1b63c00640 1 -- 172.21.15.121:0/624354680 shutdown_connections 2024-09-17T03:38:00.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.218+0000 7f1b63c00640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b5c1f66f0 0x7f1b5c1f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.218+0000 7f1b63c00640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b38078b90 0x7f1b3807b0a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.218+0000 7f1b63c00640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b5c156a50 0x7f1b5c1571e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.218+0000 7f1b63c00640 1 --2- 172.21.15.121:0/624354680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b5c074b60 0x7f1b5c159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.218+0000 7f1b63c00640 1 -- 172.21.15.121:0/624354680 >> 172.21.15.121:0/624354680 conn(0x7f1b5c0b1b90 msgr2=0x7f1b5c156010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:00.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.220+0000 7f1b63c00640 1 -- 172.21.15.121:0/624354680 shutdown_connections 2024-09-17T03:38:00.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.221+0000 7f1b63c00640 1 -- 172.21.15.121:0/624354680 wait complete. 2024-09-17T03:38:00.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:00.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.484+0000 7f4400000640 1 -- 172.21.15.121:0/4073366380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f815b9f0 msgr2=0x7f43f80cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.484+0000 7f4400000640 1 --2- 172.21.15.121:0/4073366380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f815b9f0 0x7f43f80cf930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f43f8072d40 tx=0x7f43ec02a560 comp rx=0 tx=0).stop 2024-09-17T03:38:00.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.484+0000 7f4400000640 1 -- 172.21.15.121:0/4073366380 shutdown_connections 2024-09-17T03:38:00.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.484+0000 7f4400000640 1 --2- 172.21.15.121:0/4073366380 >> v2:172.21.15.176:3300/0 conn(0x7f43f80cefa0 0x7f43f80ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.484+0000 7f4400000640 1 --2- 172.21.15.121:0/4073366380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f815b9f0 0x7f43f80cf930 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.484+0000 7f4400000640 1 -- 172.21.15.121:0/4073366380 >> 172.21.15.121:0/4073366380 conn(0x7f43f80cca40 msgr2=0x7f43f80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:00.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.484+0000 7f4400000640 1 -- 172.21.15.121:0/4073366380 shutdown_connections 2024-09-17T03:38:00.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.484+0000 7f4400000640 1 -- 172.21.15.121:0/4073366380 wait complete. 2024-09-17T03:38:00.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.486+0000 7f4400000640 1 Processor -- start 2024-09-17T03:38:00.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.486+0000 7f4400000640 1 -- start start 2024-09-17T03:38:00.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f4400000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f80ce860 0x7f43f80c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f4400000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f80cefa0 0x7f43f80a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f4400000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f815b9f0 0x7f43f80a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f4400000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43f806ddf0 con 0x7f43f80ce860 2024-09-17T03:38:00.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f4400000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f43f806df70 con 0x7f43f815b9f0 2024-09-17T03:38:00.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f4400000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f43f806e0f0 con 0x7f43f80cefa0 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f43fd600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f80ce860 0x7f43f80c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f43fd600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f80ce860 0x7f43f80c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40096/0 (socket says 172.21.15.121:40096) 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f43fd600640 1 -- 172.21.15.121:0/1527935015 learned_addr learned my addr 172.21.15.121:0/1527935015 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f43fcc00640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f80cefa0 0x7f43f80a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f43fe000640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f815b9f0 0x7f43f80a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.488+0000 7f43fd600640 1 -- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f80cefa0 msgr2=0x7f43f80a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.489+0000 7f43fd600640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f80cefa0 0x7f43f80a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.489+0000 7f43fd600640 1 -- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f815b9f0 msgr2=0x7f43f80a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.489+0000 7f43fd600640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f815b9f0 0x7f43f80a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.489+0000 7f43fd600640 1 -- 172.21.15.121:0/1527935015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f80c6210 con 0x7f43f80ce860 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.489+0000 7f43fd600640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f80ce860 0x7f43f80c5350 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000c00 tx=0x7f43ec003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.489+0000 7f43f5600640 1 -- 172.21.15.121:0/1527935015 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec03e030 con 0x7f43f80ce860 2024-09-17T03:38:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.489+0000 7f43f5600640 1 -- 172.21.15.121:0/1527935015 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43ec003e00 con 0x7f43f80ce860 2024-09-17T03:38:00.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.489+0000 7f43f5600640 1 -- 172.21.15.121:0/1527935015 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec035040 con 0x7f43f80ce860 2024-09-17T03:38:00.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.489+0000 7f4400000640 1 -- 172.21.15.121:0/1527935015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f80c64f0 con 0x7f43f80ce860 2024-09-17T03:38:00.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.489+0000 7f4400000640 1 -- 172.21.15.121:0/1527935015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f80b2e10 con 0x7f43f80ce860 2024-09-17T03:38:00.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.490+0000 7f4400000640 1 -- 172.21.15.121:0/1527935015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f806e600 con 0x7f43f80ce860 2024-09-17T03:38:00.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.491+0000 7f43f5600640 1 -- 172.21.15.121:0/1527935015 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43ec041030 con 0x7f43f80ce860 2024-09-17T03:38:00.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.492+0000 7f43f5600640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43d8078bc0 0x7f43d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.492+0000 7f43f5600640 1 -- 172.21.15.121:0/1527935015 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f43ec0bb6f0 con 0x7f43f80ce860 2024-09-17T03:38:00.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.493+0000 7f43fcc00640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43d8078bc0 0x7f43d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.494+0000 7f43fcc00640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43d8078bc0 0x7f43d807b0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f43e4005fd0 tx=0x7f43e4005850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:00.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.497+0000 7f43f5600640 1 -- 172.21.15.121:0/1527935015 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f43ec083990 con 0x7f43f80ce860 2024-09-17T03:38:00.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.683+0000 7f4400000640 1 -- 172.21.15.121:0/1527935015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43f80a1110 con 0x7f43f80ce860 2024-09-17T03:38:00.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.684+0000 7f43f5600640 1 -- 172.21.15.121:0/1527935015 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+17065 (secure 0 0 0) 0x7f43ec083290 con 0x7f43f80ce860 2024-09-17T03:38:00.684 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:00.684 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":62,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:37:59.696174+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:57.609318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:58.662483+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.686+0000 7f4400000640 1 -- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43d8078bc0 msgr2=0x7f43d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.686+0000 7f4400000640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43d8078bc0 0x7f43d807b0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f43e4005fd0 tx=0x7f43e4005850 comp rx=0 tx=0).stop 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.686+0000 7f4400000640 1 -- 172.21.15.121:0/1527935015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f80ce860 msgr2=0x7f43f80c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.686+0000 7f4400000640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f80ce860 0x7f43f80c5350 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000c00 tx=0x7f43ec003910 comp rx=0 tx=0).stop 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.687+0000 7f4400000640 1 -- 172.21.15.121:0/1527935015 shutdown_connections 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.687+0000 7f4400000640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43f815b9f0 0x7f43f80a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.687+0000 7f4400000640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43f80cefa0 0x7f43f80a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.687+0000 7f4400000640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f43d8078bc0 0x7f43d807b0d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.687+0000 7f4400000640 1 --2- 172.21.15.121:0/1527935015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f80ce860 0x7f43f80c5350 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.687+0000 7f4400000640 1 -- 172.21.15.121:0/1527935015 >> 172.21.15.121:0/1527935015 conn(0x7f43f80cca40 msgr2=0x7f43f80ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.687+0000 7f4400000640 1 -- 172.21.15.121:0/1527935015 shutdown_connections 2024-09-17T03:38:00.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.687+0000 7f4400000640 1 -- 172.21.15.121:0/1527935015 wait complete. 2024-09-17T03:38:00.710 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:00.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.931+0000 7f0f36e00640 1 -- 172.21.15.121:0/1422565530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f300cb0c0 msgr2=0x7f0f300cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.931+0000 7f0f36e00640 1 --2- 172.21.15.121:0/1422565530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f300cb0c0 0x7f0f300cb4d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0f28005fd0 tx=0x7f0f2802aa10 comp rx=0 tx=0).stop 2024-09-17T03:38:00.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.931+0000 7f0f36e00640 1 -- 172.21.15.121:0/1422565530 shutdown_connections 2024-09-17T03:38:00.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.931+0000 7f0f36e00640 1 --2- 172.21.15.121:0/1422565530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f300cb0c0 0x7f0f300cb4d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.931+0000 7f0f36e00640 1 --2- 172.21.15.121:0/1422565530 >> v2:172.21.15.176:3300/0 conn(0x7f0f3006e500 0x7f0f3015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.931+0000 7f0f36e00640 1 -- 172.21.15.121:0/1422565530 >> 172.21.15.121:0/1422565530 conn(0x7f0f30073400 msgr2=0x7f0f30073810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:00.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.931+0000 7f0f36e00640 1 -- 172.21.15.121:0/1422565530 shutdown_connections 2024-09-17T03:38:00.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.931+0000 7f0f36e00640 1 -- 172.21.15.121:0/1422565530 wait complete. 2024-09-17T03:38:00.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.933+0000 7f0f36e00640 1 Processor -- start 2024-09-17T03:38:00.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.934+0000 7f0f36e00640 1 -- start start 2024-09-17T03:38:00.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f36e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f30073f20 0x7f0f301f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f36e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f300cb0c0 0x7f0f300c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f36e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f30155d50 0x7f0f300c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f36e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f300cbc20 con 0x7f0f30155d50 2024-09-17T03:38:00.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f36e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0f300ccbf0 con 0x7f0f30073f20 2024-09-17T03:38:00.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f36e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0f300cbda0 con 0x7f0f300cb0c0 2024-09-17T03:38:00.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f36400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f30155d50 0x7f0f300c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f35000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f300cb0c0 0x7f0f300c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f36400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f30155d50 0x7f0f300c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40102/0 (socket says 172.21.15.121:40102) 2024-09-17T03:38:00.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f36400640 1 -- 172.21.15.121:0/130403153 learned_addr learned my addr 172.21.15.121:0/130403153 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:00.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.935+0000 7f0f35a00640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f30073f20 0x7f0f301f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.936+0000 7f0f36400640 1 -- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f300cb0c0 msgr2=0x7f0f300c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.936+0000 7f0f36400640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f300cb0c0 0x7f0f300c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.936+0000 7f0f36400640 1 -- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f30073f20 msgr2=0x7f0f301f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.936+0000 7f0f36400640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f30073f20 0x7f0f301f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.936+0000 7f0f36400640 1 -- 172.21.15.121:0/130403153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f300c7780 con 0x7f0f30155d50 2024-09-17T03:38:00.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.936+0000 7f0f36400640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f30155d50 0x7f0f300c7f60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009d90 tx=0x7f0f28003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:00.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.936+0000 7f0f2d600640 1 -- 172.21.15.121:0/130403153 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28046070 con 0x7f0f30155d50 2024-09-17T03:38:00.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.936+0000 7f0f2d600640 1 -- 172.21.15.121:0/130403153 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f28004540 con 0x7f0f30155d50 2024-09-17T03:38:00.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.936+0000 7f0f36e00640 1 -- 172.21.15.121:0/130403153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f301f5b00 con 0x7f0f30155d50 2024-09-17T03:38:00.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.937+0000 7f0f2d600640 1 -- 172.21.15.121:0/130403153 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28033070 con 0x7f0f30155d50 2024-09-17T03:38:00.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.937+0000 7f0f36e00640 1 -- 172.21.15.121:0/130403153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f301f60c0 con 0x7f0f30155d50 2024-09-17T03:38:00.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.938+0000 7f0f36e00640 1 -- 172.21.15.121:0/130403153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f300cc2c0 con 0x7f0f30155d50 2024-09-17T03:38:00.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.939+0000 7f0f2d600640 1 -- 172.21.15.121:0/130403153 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f28049070 con 0x7f0f30155d50 2024-09-17T03:38:00.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.940+0000 7f0f2d600640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f10078b90 0x7f0f1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.940+0000 7f0f2d600640 1 -- 172.21.15.121:0/130403153 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f0f280bbfd0 con 0x7f0f30155d50 2024-09-17T03:38:00.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.940+0000 7f0f35a00640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f10078b90 0x7f0f1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.941+0000 7f0f35a00640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f10078b90 0x7f0f1007b0a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0f24007fd0 tx=0x7f0f24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:00.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:00.944+0000 7f0f2d600640 1 -- 172.21.15.121:0/130403153 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f2803e070 con 0x7f0f30155d50 2024-09-17T03:38:01.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.127+0000 7f0f36e00640 1 -- 172.21.15.121:0/130403153 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f300ade20 con 0x7f0f30155d50 2024-09-17T03:38:01.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.129+0000 7f0f2d600640 1 -- 172.21.15.121:0/130403153 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+17065 (secure 0 0 0) 0x7f0f28083b90 con 0x7f0f30155d50 2024-09-17T03:38:01.129 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:01.129 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":62,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:37:59.696174+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:57.609318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:58.662483+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:01.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 -- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f10078b90 msgr2=0x7f0f1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f10078b90 0x7f0f1007b0a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0f24007fd0 tx=0x7f0f24009040 comp rx=0 tx=0).stop 2024-09-17T03:38:01.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 -- 172.21.15.121:0/130403153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f30155d50 msgr2=0x7f0f300c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f30155d50 0x7f0f300c7f60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009d90 tx=0x7f0f28003f20 comp rx=0 tx=0).stop 2024-09-17T03:38:01.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 -- 172.21.15.121:0/130403153 shutdown_connections 2024-09-17T03:38:01.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f10078b90 0x7f0f1007b0a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f30155d50 0x7f0f300c7f60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f300cb0c0 0x7f0f300c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 --2- 172.21.15.121:0/130403153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f30073f20 0x7f0f301f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 -- 172.21.15.121:0/130403153 >> 172.21.15.121:0/130403153 conn(0x7f0f30073400 msgr2=0x7f0f300b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:01.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 -- 172.21.15.121:0/130403153 shutdown_connections 2024-09-17T03:38:01.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.131+0000 7f0f36e00640 1 -- 172.21.15.121:0/130403153 wait complete. 2024-09-17T03:38:01.154 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:38:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.381+0000 7ff9c1800640 1 -- 172.21.15.121:0/763252887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9a0003a00 msgr2=0x7ff9a0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.381+0000 7ff9c1800640 1 --2- 172.21.15.121:0/763252887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9a0003a00 0x7ff9a0003e70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009b50 tx=0x7ff9a0005830 comp rx=0 tx=0).stop 2024-09-17T03:38:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.381+0000 7ff9bb400640 1 -- 172.21.15.121:0/763252887 reap_dead start 2024-09-17T03:38:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.381+0000 7ff9c1800640 1 -- 172.21.15.121:0/763252887 shutdown_connections 2024-09-17T03:38:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.381+0000 7ff9c1800640 1 -- 172.21.15.121:0/763252887 >> 172.21.15.121:0/763252887 conn(0x7ff9bc0b1b90 msgr2=0x7ff9bc0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.381+0000 7ff9c1800640 1 -- 172.21.15.121:0/763252887 shutdown_connections 2024-09-17T03:38:01.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.381+0000 7ff9c1800640 1 -- 172.21.15.121:0/763252887 wait complete. 2024-09-17T03:38:01.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.384+0000 7ff9c1800640 1 Processor -- start 2024-09-17T03:38:01.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.384+0000 7ff9c1800640 1 -- start start 2024-09-17T03:38:01.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.385+0000 7ff9c1800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a0003a00 0x7ff9bc15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.385+0000 7ff9c1800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9bc148920 0x7ff9bc15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.385+0000 7ff9c1800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9bc0c76a0 0x7ff9bc0c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.385+0000 7ff9c1800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc0749b0 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.385+0000 7ff9c1800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc074830 con 0x7ff9a0003a00 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.385+0000 7ff9c1800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9bc0cf440 con 0x7ff9bc148920 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.385+0000 7ff9bb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9bc0c76a0 0x7ff9bc0c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.385+0000 7ff9bb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9bc0c76a0 0x7ff9bc0c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40116/0 (socket says 172.21.15.121:40116) 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9bb400640 1 -- 172.21.15.121:0/3956349858 learned_addr learned my addr 172.21.15.121:0/3956349858 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9baa00640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a0003a00 0x7ff9bc15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9ba000640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9bc148920 0x7ff9bc15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9bb400640 1 -- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9bc148920 msgr2=0x7ff9bc15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9bb400640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9bc148920 0x7ff9bc15baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9bb400640 1 -- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a0003a00 msgr2=0x7ff9bc15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9bb400640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a0003a00 0x7ff9bc15b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9bb400640 1 -- 172.21.15.121:0/3956349858 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9bc1f5500 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9baa00640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a0003a00 0x7ff9bc15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:01.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9ba000640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9bc148920 0x7ff9bc15baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:01.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9bb400640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9bc0c76a0 0x7ff9bc0c7ab0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc072d20 tx=0x7ff9b4010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:01.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9b2a00640 1 -- 172.21.15.121:0/3956349858 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4003970 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.386+0000 7ff9b2a00640 1 -- 172.21.15.121:0/3956349858 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9b4015070 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.387+0000 7ff9c1800640 1 -- 172.21.15.121:0/3956349858 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9bc1f57e0 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.387+0000 7ff9b2a00640 1 -- 172.21.15.121:0/3956349858 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4004030 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.387+0000 7ff9c1800640 1 -- 172.21.15.121:0/3956349858 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9bc148d60 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.388+0000 7ff9c1800640 1 -- 172.21.15.121:0/3956349858 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9bc148fc0 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.389+0000 7ff9b2a00640 1 -- 172.21.15.121:0/3956349858 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9b40041d0 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.390+0000 7ff9b2a00640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff99c078b90 0x7ff99c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.390+0000 7ff9b2a00640 1 -- 172.21.15.121:0/3956349858 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7ff9b409bab0 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.391+0000 7ff9baa00640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff99c078b90 0x7ff99c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.391+0000 7ff9baa00640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff99c078b90 0x7ff99c07b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009b50 tx=0x7ff9ac02d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:01.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.394+0000 7ff9b2a00640 1 -- 172.21.15.121:0/3956349858 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff9b4063cc0 con 0x7ff9bc0c76a0 2024-09-17T03:38:01.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:01.616+0000 7ff9c1800640 1 -- 172.21.15.121:0/3956349858 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff9bc0afc80 con 0x7ff9bc0c76a0 2024-09-17T03:38:02.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.224+0000 7ff9b2a00640 1 -- 172.21.15.121:0/3956349858 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) ==== 118+0+0 (secure 0 0 0) 0x7ff9b40635c0 con 0x7ff9bc0c76a0 2024-09-17T03:38:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 -- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff99c078b90 msgr2=0x7ff99c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff99c078b90 0x7ff99c07b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009b50 tx=0x7ff9ac02d040 comp rx=0 tx=0).stop 2024-09-17T03:38:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 -- 172.21.15.121:0/3956349858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9bc0c76a0 msgr2=0x7ff9bc0c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9bc0c76a0 0x7ff9bc0c7ab0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc072d20 tx=0x7ff9b4010f40 comp rx=0 tx=0).stop 2024-09-17T03:38:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 -- 172.21.15.121:0/3956349858 shutdown_connections 2024-09-17T03:38:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff99c078b90 0x7ff99c07b0a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9bc0c76a0 0x7ff9bc0c7ab0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9bc148920 0x7ff9bc15baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:02.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 --2- 172.21.15.121:0/3956349858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a0003a00 0x7ff9bc15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:02.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 -- 172.21.15.121:0/3956349858 >> 172.21.15.121:0/3956349858 conn(0x7ff9bc0b1b90 msgr2=0x7ff9bc15c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:02.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 -- 172.21.15.121:0/3956349858 shutdown_connections 2024-09-17T03:38:02.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.227+0000 7ff9c1800640 1 -- 172.21.15.121:0/3956349858 wait complete. 2024-09-17T03:38:02.251 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:38:02.251 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:38:02.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.478+0000 7f5d35800640 1 -- 172.21.15.121:0/1107075055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d14004020 msgr2=0x7f5d14004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:02.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.478+0000 7f5d35800640 1 --2- 172.21.15.121:0/1107075055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d14004020 0x7f5d14004800 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c470 tx=0x7f5d14005830 comp rx=0 tx=0).stop 2024-09-17T03:38:02.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.478+0000 7f5d2f400640 1 -- 172.21.15.121:0/1107075055 reap_dead start 2024-09-17T03:38:02.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.478+0000 7f5d35800640 1 -- 172.21.15.121:0/1107075055 shutdown_connections 2024-09-17T03:38:02.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.478+0000 7f5d35800640 1 -- 172.21.15.121:0/1107075055 >> 172.21.15.121:0/1107075055 conn(0x7f5d300b1b90 msgr2=0x7f5d300b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:02.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.478+0000 7f5d35800640 1 -- 172.21.15.121:0/1107075055 shutdown_connections 2024-09-17T03:38:02.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.478+0000 7f5d35800640 1 -- 172.21.15.121:0/1107075055 wait complete. 2024-09-17T03:38:02.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.480+0000 7f5d35800640 1 Processor -- start 2024-09-17T03:38:02.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.481+0000 7f5d35800640 1 -- start start 2024-09-17T03:38:02.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.482+0000 7f5d35800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d14004020 0x7f5d3009cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.482+0000 7f5d35800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d301591a0 0x7f5d301f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.482+0000 7f5d35800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3015cf50 0x7f5d300a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.482+0000 7f5d35800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30070d20 con 0x7f5d14004020 2024-09-17T03:38:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.482+0000 7f5d35800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30070ba0 con 0x7f5d3015cf50 2024-09-17T03:38:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.482+0000 7f5d35800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3006ddf0 con 0x7f5d301591a0 2024-09-17T03:38:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.482+0000 7f5d2ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d14004020 0x7f5d3009cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.482+0000 7f5d2ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d14004020 0x7f5d3009cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41378/0 (socket says 172.21.15.121:41378) 2024-09-17T03:38:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.482+0000 7f5d2ea00640 1 -- 172.21.15.121:0/726111199 learned_addr learned my addr 172.21.15.121:0/726111199 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d2ea00640 1 -- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d301591a0 msgr2=0x7f5d301f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:02.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d2e000640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d301591a0 0x7f5d301f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d2ea00640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d301591a0 0x7f5d301f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d2f400640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3015cf50 0x7f5d300a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d2ea00640 1 -- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3015cf50 msgr2=0x7f5d300a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d2ea00640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3015cf50 0x7f5d300a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d2ea00640 1 -- 172.21.15.121:0/726111199 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3015beb0 con 0x7f5d14004020 2024-09-17T03:38:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d2e000640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d301591a0 0x7f5d301f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d2f400640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3015cf50 0x7f5d300a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d2ea00640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d14004020 0x7f5d3009cd80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d20011a50 tx=0x7f5d20011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d26a00640 1 -- 172.21.15.121:0/726111199 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2001f070 con 0x7f5d14004020 2024-09-17T03:38:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d26a00640 1 -- 172.21.15.121:0/726111199 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d2000fe80 con 0x7f5d14004020 2024-09-17T03:38:02.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d35800640 1 -- 172.21.15.121:0/726111199 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3015c190 con 0x7f5d14004020 2024-09-17T03:38:02.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d26a00640 1 -- 172.21.15.121:0/726111199 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20012690 con 0x7f5d14004020 2024-09-17T03:38:02.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.483+0000 7f5d35800640 1 -- 172.21.15.121:0/726111199 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3015c750 con 0x7f5d14004020 2024-09-17T03:38:02.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.485+0000 7f5d35800640 1 -- 172.21.15.121:0/726111199 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d300cf290 con 0x7f5d14004020 2024-09-17T03:38:02.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.486+0000 7f5d26a00640 1 -- 172.21.15.121:0/726111199 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d20022070 con 0x7f5d14004020 2024-09-17T03:38:02.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.487+0000 7f5d26a00640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5d10078bc0 0x7f5d1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:02.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.487+0000 7f5d26a00640 1 -- 172.21.15.121:0/726111199 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f5d2009b9b0 con 0x7f5d14004020 2024-09-17T03:38:02.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.487+0000 7f5d2e000640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5d10078bc0 0x7f5d1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:02.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.488+0000 7f5d2e000640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5d10078bc0 0x7f5d1007b0d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5d14004780 tx=0x7f5d1c02d070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:02.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.491+0000 7f5d26a00640 1 -- 172.21.15.121:0/726111199 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5d20063570 con 0x7f5d14004020 2024-09-17T03:38:02.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:02.709+0000 7f5d35800640 1 -- 172.21.15.121:0/726111199 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5d3009ddd0 con 0x7f5d14004020 2024-09-17T03:38:03.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.225+0000 7f5d26a00640 1 -- 172.21.15.121:0/726111199 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) ==== 122+0+0 (secure 0 0 0) 0x7f5d20067fa0 con 0x7f5d14004020 2024-09-17T03:38:03.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 -- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5d10078bc0 msgr2=0x7f5d1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:03.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5d10078bc0 0x7f5d1007b0d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5d14004780 tx=0x7f5d1c02d070 comp rx=0 tx=0).stop 2024-09-17T03:38:03.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 -- 172.21.15.121:0/726111199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d14004020 msgr2=0x7f5d3009cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:03.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d14004020 0x7f5d3009cd80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d20011a50 tx=0x7f5d20011f10 comp rx=0 tx=0).stop 2024-09-17T03:38:03.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 -- 172.21.15.121:0/726111199 shutdown_connections 2024-09-17T03:38:03.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d3015cf50 0x7f5d300a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d301591a0 0x7f5d301f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5d10078bc0 0x7f5d1007b0d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 --2- 172.21.15.121:0/726111199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d14004020 0x7f5d3009cd80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 -- 172.21.15.121:0/726111199 >> 172.21.15.121:0/726111199 conn(0x7f5d300b1b90 msgr2=0x7f5d300b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:03.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 -- 172.21.15.121:0/726111199 shutdown_connections 2024-09-17T03:38:03.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.228+0000 7f5d35800640 1 -- 172.21.15.121:0/726111199 wait complete. 2024-09-17T03:38:03.255 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:38:03.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:03.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.478+0000 7f36c3600640 1 -- 172.21.15.121:0/1290948159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36bc074cb0 msgr2=0x7f36bc073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:03.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.478+0000 7f36c3600640 1 --2- 172.21.15.121:0/1290948159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36bc074cb0 0x7f36bc073dd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f36bc15d980 tx=0x7f36ac02a540 comp rx=0 tx=0).stop 2024-09-17T03:38:03.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.478+0000 7f36c3600640 1 -- 172.21.15.121:0/1290948159 shutdown_connections 2024-09-17T03:38:03.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.478+0000 7f36c3600640 1 --2- 172.21.15.121:0/1290948159 >> v2:172.21.15.176:3300/0 conn(0x7f36bc06e500 0x7f36bc0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.478+0000 7f36c3600640 1 --2- 172.21.15.121:0/1290948159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36bc074cb0 0x7f36bc073dd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.478+0000 7f36c3600640 1 -- 172.21.15.121:0/1290948159 >> 172.21.15.121:0/1290948159 conn(0x7f36bc0cca40 msgr2=0x7f36bc0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:03.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.479+0000 7f36c3600640 1 -- 172.21.15.121:0/1290948159 shutdown_connections 2024-09-17T03:38:03.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.479+0000 7f36c3600640 1 -- 172.21.15.121:0/1290948159 wait complete. 2024-09-17T03:38:03.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.481+0000 7f36c3600640 1 Processor -- start 2024-09-17T03:38:03.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.481+0000 7f36c3600640 1 -- start start 2024-09-17T03:38:03.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.482+0000 7f36c3600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36bc074cb0 0x7f36bc0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:03.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.482+0000 7f36c3600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36bc0cbc10 0x7f36bc155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:03.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.482+0000 7f36c3600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36bc1f5460 0x7f36bc0c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:03.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.482+0000 7f36c3600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc06f360 con 0x7f36bc1f5460 2024-09-17T03:38:03.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.482+0000 7f36c3600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc06f1e0 con 0x7f36bc074cb0 2024-09-17T03:38:03.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.482+0000 7f36c3600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc06f4e0 con 0x7f36bc0cbc10 2024-09-17T03:38:03.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c1600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36bc1f5460 0x7f36bc0c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:03.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c1600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36bc1f5460 0x7f36bc0c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41392/0 (socket says 172.21.15.121:41392) 2024-09-17T03:38:03.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c1600640 1 -- 172.21.15.121:0/754763230 learned_addr learned my addr 172.21.15.121:0/754763230 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:03.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c0c00640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36bc074cb0 0x7f36bc0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:03.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36b3e00640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36bc0cbc10 0x7f36bc155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:03.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c1600640 1 -- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36bc0cbc10 msgr2=0x7f36bc155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:03.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c1600640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36bc0cbc10 0x7f36bc155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c1600640 1 -- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36bc074cb0 msgr2=0x7f36bc0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c1600640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36bc074cb0 0x7f36bc0cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c1600640 1 -- 172.21.15.121:0/754763230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc1f5c90 con 0x7f36bc1f5460 2024-09-17T03:38:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c0c00640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36bc074cb0 0x7f36bc0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.483+0000 7f36c1600640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36bc1f5460 0x7f36bc0c8510 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f36b400ea40 tx=0x7f36b400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.484+0000 7f36b9600640 1 -- 172.21.15.121:0/754763230 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b400ce40 con 0x7f36bc1f5460 2024-09-17T03:38:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.484+0000 7f36b9600640 1 -- 172.21.15.121:0/754763230 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36b4004c10 con 0x7f36bc1f5460 2024-09-17T03:38:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.484+0000 7f36b9600640 1 -- 172.21.15.121:0/754763230 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4005020 con 0x7f36bc1f5460 2024-09-17T03:38:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.484+0000 7f36c3600640 1 -- 172.21.15.121:0/754763230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc1f5f70 con 0x7f36bc1f5460 2024-09-17T03:38:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.484+0000 7f36c3600640 1 -- 172.21.15.121:0/754763230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc0c8a50 con 0x7f36bc1f5460 2024-09-17T03:38:03.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.485+0000 7f36c3600640 1 -- 172.21.15.121:0/754763230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36bc1f5a00 con 0x7f36bc1f5460 2024-09-17T03:38:03.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.486+0000 7f36b9600640 1 -- 172.21.15.121:0/754763230 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36b40051c0 con 0x7f36bc1f5460 2024-09-17T03:38:03.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.488+0000 7f36b9600640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:03.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.488+0000 7f36b9600640 1 -- 172.21.15.121:0/754763230 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f36b409bc80 con 0x7f36bc1f5460 2024-09-17T03:38:03.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.488+0000 7f36c0c00640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:03.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.489+0000 7f36c0c00640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3698078b90 0x7f369807b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f36ac034000 tx=0x7f36ac004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:03.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.492+0000 7f36b9600640 1 -- 172.21.15.121:0/754763230 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36b4063fb0 con 0x7f36bc1f5460 2024-09-17T03:38:03.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.709+0000 7f36c3600640 1 -- 172.21.15.121:0/754763230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36bc156260 con 0x7f36bc1f5460 2024-09-17T03:38:03.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.709+0000 7f36b9600640 1 -- 172.21.15.121:0/754763230 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5236 (secure 0 0 0) 0x7f36b40638b0 con 0x7f36bc1f5460 2024-09-17T03:38:03.709 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:03.709 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":37,"btime":"2024-09-17T03:38:03:224733+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1006042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1006042508},{"type":"v1","addr":"172.21.15.176:6836","nonce":1006042508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3672630729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3672630729},{"type":"v1","addr":"172.21.15.176:6837","nonce":3672630729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/4058545170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4058545170},{"type":"v1","addr":"172.21.15.121:6835","nonce":4058545170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:59.696137+0000","modified":"2024-09-17T03:38:02.710560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5712":{"gid":5712,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6833/3893444987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3893444987},{"type":"v1","addr":"172.21.15.121:6833","nonce":3893444987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5712,"qdb_cluster":[5712]},"id":4}]} 2024-09-17T03:38:03.710 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 37 2024-09-17T03:38:03.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 -- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3698078b90 msgr2=0x7f369807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:03.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3698078b90 0x7f369807b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f36ac034000 tx=0x7f36ac004730 comp rx=0 tx=0).stop 2024-09-17T03:38:03.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 -- 172.21.15.121:0/754763230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36bc1f5460 msgr2=0x7f36bc0c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:03.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36bc1f5460 0x7f36bc0c8510 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f36b400ea40 tx=0x7f36b400ef00 comp rx=0 tx=0).stop 2024-09-17T03:38:03.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 -- 172.21.15.121:0/754763230 shutdown_connections 2024-09-17T03:38:03.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36bc1f5460 0x7f36bc0c8510 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36bc0cbc10 0x7f36bc155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 --2- 172.21.15.121:0/754763230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36bc074cb0 0x7f36bc0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 -- 172.21.15.121:0/754763230 >> 172.21.15.121:0/754763230 conn(0x7f36bc0cca40 msgr2=0x7f36bc15a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:03.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 -- 172.21.15.121:0/754763230 shutdown_connections 2024-09-17T03:38:03.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.712+0000 7f36c3600640 1 -- 172.21.15.121:0/754763230 wait complete. 2024-09-17T03:38:03.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:03.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.956+0000 7f5c59600640 1 -- 172.21.15.121:0/3510724653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c5406ddf0 msgr2=0x7f5c5406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:03.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.956+0000 7f5c59600640 1 --2- 172.21.15.121:0/3510724653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c5406ddf0 0x7f5c5406e200 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5c54076360 tx=0x7f5c4c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:38:03.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.956+0000 7f5c59600640 1 -- 172.21.15.121:0/3510724653 shutdown_connections 2024-09-17T03:38:03.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.956+0000 7f5c59600640 1 --2- 172.21.15.121:0/3510724653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c5406ddf0 0x7f5c5406e200 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.956+0000 7f5c59600640 1 --2- 172.21.15.121:0/3510724653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c540cbc10 0x7f5c540cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.956+0000 7f5c59600640 1 --2- 172.21.15.121:0/3510724653 >> v2:172.21.15.176:3300/0 conn(0x7f5c54074cb0 0x7f5c54073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.956+0000 7f5c59600640 1 -- 172.21.15.121:0/3510724653 >> 172.21.15.121:0/3510724653 conn(0x7f5c540cca40 msgr2=0x7f5c540cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:03.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.956+0000 7f5c59600640 1 -- 172.21.15.121:0/3510724653 shutdown_connections 2024-09-17T03:38:03.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.956+0000 7f5c59600640 1 -- 172.21.15.121:0/3510724653 wait complete. 2024-09-17T03:38:03.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.958+0000 7f5c59600640 1 Processor -- start 2024-09-17T03:38:03.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.959+0000 7f5c59600640 1 -- start start 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c59600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5406ddf0 0x7f5c540ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c59600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c54074cb0 0x7f5c540ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c59600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c540cbc10 0x7f5c541f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c59600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5406f170 con 0x7f5c540cbc10 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c59600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5406eff0 con 0x7f5c54074cb0 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c59600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5406f2f0 con 0x7f5c5406ddf0 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c53400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c540cbc10 0x7f5c541f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c53400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c540cbc10 0x7f5c541f8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41418/0 (socket says 172.21.15.121:41418) 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c53400640 1 -- 172.21.15.121:0/2650062237 learned_addr learned my addr 172.21.15.121:0/2650062237 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c52000640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c54074cb0 0x7f5c540ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.960+0000 7f5c52a00640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5406ddf0 0x7f5c540ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:03.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c53400640 1 -- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5406ddf0 msgr2=0x7f5c540ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:03.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c53400640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5406ddf0 0x7f5c540ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c53400640 1 -- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c54074cb0 msgr2=0x7f5c540ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:03.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c53400640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c54074cb0 0x7f5c540ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:03.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c53400640 1 -- 172.21.15.121:0/2650062237 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c54158920 con 0x7f5c540cbc10 2024-09-17T03:38:03.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c52000640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c54074cb0 0x7f5c540ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:03.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c52a00640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5406ddf0 0x7f5c540ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:03.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c53400640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c540cbc10 0x7f5c541f8c30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c02b020 tx=0x7f5c4c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c4aa00640 1 -- 172.21.15.121:0/2650062237 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c033050 con 0x7f5c540cbc10 2024-09-17T03:38:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c4aa00640 1 -- 172.21.15.121:0/2650062237 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c4c004450 con 0x7f5c540cbc10 2024-09-17T03:38:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c4aa00640 1 -- 172.21.15.121:0/2650062237 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c038450 con 0x7f5c540cbc10 2024-09-17T03:38:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.961+0000 7f5c59600640 1 -- 172.21.15.121:0/2650062237 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c540ced10 con 0x7f5c540cbc10 2024-09-17T03:38:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.962+0000 7f5c59600640 1 -- 172.21.15.121:0/2650062237 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c540ca010 con 0x7f5c540cbc10 2024-09-17T03:38:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.963+0000 7f5c59600640 1 -- 172.21.15.121:0/2650062237 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5406acf0 con 0x7f5c540cbc10 2024-09-17T03:38:03.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.964+0000 7f5c4aa00640 1 -- 172.21.15.121:0/2650062237 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c4c036070 con 0x7f5c540cbc10 2024-09-17T03:38:03.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.964+0000 7f5c4aa00640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5c34078bc0 0x7f5c3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:03.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.965+0000 7f5c4aa00640 1 -- 172.21.15.121:0/2650062237 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f5c4c0bc360 con 0x7f5c540cbc10 2024-09-17T03:38:03.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.965+0000 7f5c52a00640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5c34078bc0 0x7f5c3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:03.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.966+0000 7f5c52a00640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5c34078bc0 0x7f5c3407b0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c44005fd0 tx=0x7f5c4400b530 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:03.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:03.969+0000 7f5c4aa00640 1 -- 172.21.15.121:0/2650062237 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5c5406acf0 con 0x7f5c540cbc10 2024-09-17T03:38:04.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.153+0000 7f5c59600640 1 -- 172.21.15.121:0/2650062237 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c54073dd0 con 0x7f5c540cbc10 2024-09-17T03:38:04.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.154+0000 7f5c4aa00640 1 -- 172.21.15.121:0/2650062237 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+17052 (secure 0 0 0) 0x7f5c4c084690 con 0x7f5c540cbc10 2024-09-17T03:38:04.154 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:04.154 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":63,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:38:01.211336+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:57.609318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:58.662483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:04.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 -- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5c34078bc0 msgr2=0x7f5c3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:04.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5c34078bc0 0x7f5c3407b0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c44005fd0 tx=0x7f5c4400b530 comp rx=0 tx=0).stop 2024-09-17T03:38:04.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 -- 172.21.15.121:0/2650062237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c540cbc10 msgr2=0x7f5c541f8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:04.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c540cbc10 0x7f5c541f8c30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c02b020 tx=0x7f5c4c003f10 comp rx=0 tx=0).stop 2024-09-17T03:38:04.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 -- 172.21.15.121:0/2650062237 shutdown_connections 2024-09-17T03:38:04.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5c34078bc0 0x7f5c3407b0d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c540cbc10 0x7f5c541f8c30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c54074cb0 0x7f5c540ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 --2- 172.21.15.121:0/2650062237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c5406ddf0 0x7f5c540ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 -- 172.21.15.121:0/2650062237 >> 172.21.15.121:0/2650062237 conn(0x7f5c540cca40 msgr2=0x7f5c540ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:04.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 -- 172.21.15.121:0/2650062237 shutdown_connections 2024-09-17T03:38:04.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.156+0000 7f5c59600640 1 -- 172.21.15.121:0/2650062237 wait complete. 2024-09-17T03:38:04.183 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:38:04.183 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:38:04.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.406+0000 7fd29cc00640 1 -- 172.21.15.121:0/3543961673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd29815e780 msgr2=0x7fd29806e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:04.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.406+0000 7fd29cc00640 1 --2- 172.21.15.121:0/3543961673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd29815e780 0x7fd29806e220 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd2980d5400 tx=0x7fd28802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.406+0000 7fd29cc00640 1 -- 172.21.15.121:0/3543961673 shutdown_connections 2024-09-17T03:38:04.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.406+0000 7fd29cc00640 1 --2- 172.21.15.121:0/3543961673 >> v2:172.21.15.176:3300/0 conn(0x7fd2980cfcd0 0x7fd2980b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.406+0000 7fd29cc00640 1 --2- 172.21.15.121:0/3543961673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd29815e780 0x7fd29806e220 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.406+0000 7fd29cc00640 1 -- 172.21.15.121:0/3543961673 >> 172.21.15.121:0/3543961673 conn(0x7fd2980d4360 msgr2=0x7fd2980d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:04.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.406+0000 7fd29cc00640 1 -- 172.21.15.121:0/3543961673 shutdown_connections 2024-09-17T03:38:04.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.406+0000 7fd29cc00640 1 -- 172.21.15.121:0/3543961673 wait complete. 2024-09-17T03:38:04.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.408+0000 7fd29cc00640 1 Processor -- start 2024-09-17T03:38:04.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.408+0000 7fd29cc00640 1 -- start start 2024-09-17T03:38:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd29cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2980cfcd0 0x7fd2981f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd29cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2980d34b0 0x7fd298162990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd29cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd29815e780 0x7fd2980b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd29cc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd2980b7ef0 con 0x7fd2980cfcd0 2024-09-17T03:38:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd29cc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2980d3ad0 con 0x7fd2980d34b0 2024-09-17T03:38:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd29cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2980b8070 con 0x7fd29815e780 2024-09-17T03:38:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd297400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2980cfcd0 0x7fd2981f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd297400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2980cfcd0 0x7fd2981f4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41444/0 (socket says 172.21.15.121:41444) 2024-09-17T03:38:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd297400640 1 -- 172.21.15.121:0/58649632 learned_addr learned my addr 172.21.15.121:0/58649632 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd297e00640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd29815e780 0x7fd2980b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.410+0000 7fd296a00640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2980d34b0 0x7fd298162990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.411+0000 7fd297400640 1 -- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd29815e780 msgr2=0x7fd2980b95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.411+0000 7fd297400640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd29815e780 0x7fd2980b95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.411+0000 7fd297400640 1 -- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2980d34b0 msgr2=0x7fd298162990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.411+0000 7fd297400640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2980d34b0 0x7fd298162990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.411+0000 7fd297400640 1 -- 172.21.15.121:0/58649632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2981e9e80 con 0x7fd2980cfcd0 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.411+0000 7fd297400640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2980cfcd0 0x7fd2981f4b10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd288000c00 tx=0x7fd288003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.411+0000 7fd28f400640 1 -- 172.21.15.121:0/58649632 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28803e030 con 0x7fd2980cfcd0 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.411+0000 7fd28f400640 1 -- 172.21.15.121:0/58649632 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd288003e00 con 0x7fd2980cfcd0 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.411+0000 7fd28f400640 1 -- 172.21.15.121:0/58649632 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288035040 con 0x7fd2980cfcd0 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.411+0000 7fd29cc00640 1 -- 172.21.15.121:0/58649632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2981ea380 con 0x7fd2980cfcd0 2024-09-17T03:38:04.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.412+0000 7fd29cc00640 1 -- 172.21.15.121:0/58649632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2981ea940 con 0x7fd2980cfcd0 2024-09-17T03:38:04.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.412+0000 7fd29cc00640 1 -- 172.21.15.121:0/58649632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2980b8540 con 0x7fd2980cfcd0 2024-09-17T03:38:04.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.414+0000 7fd28f400640 1 -- 172.21.15.121:0/58649632 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd288041030 con 0x7fd2980cfcd0 2024-09-17T03:38:04.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.415+0000 7fd28f400640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd278078b90 0x7fd27807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:04.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.415+0000 7fd28f400640 1 -- 172.21.15.121:0/58649632 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fd2880bb6f0 con 0x7fd2980cfcd0 2024-09-17T03:38:04.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.415+0000 7fd296a00640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd278078b90 0x7fd27807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:04.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.416+0000 7fd296a00640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd278078b90 0x7fd27807b0a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd29806e5c0 tx=0x7fd284009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:04.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.419+0000 7fd28f400640 1 -- 172.21.15.121:0/58649632 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2880832b0 con 0x7fd2980cfcd0 2024-09-17T03:38:04.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.598+0000 7fd29cc00640 1 -- 172.21.15.121:0/58649632 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2980cde70 con 0x7fd278078b90 2024-09-17T03:38:04.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.604+0000 7fd28f400640 1 -- 172.21.15.121:0/58649632 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252006 (secure 0 0 0) 0x7fd2980cde70 con 0x7fd278078b90 2024-09-17T03:38:04.606 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:04.608 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:38:04.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 -- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd278078b90 msgr2=0x7fd27807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:04.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd278078b90 0x7fd27807b0a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd29806e5c0 tx=0x7fd284009040 comp rx=0 tx=0).stop 2024-09-17T03:38:04.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 -- 172.21.15.121:0/58649632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2980cfcd0 msgr2=0x7fd2981f4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2980cfcd0 0x7fd2981f4b10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd288000c00 tx=0x7fd288003910 comp rx=0 tx=0).stop 2024-09-17T03:38:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 -- 172.21.15.121:0/58649632 shutdown_connections 2024-09-17T03:38:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd29815e780 0x7fd2980b95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2980d34b0 0x7fd298162990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd278078b90 0x7fd27807b0a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 --2- 172.21.15.121:0/58649632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2980cfcd0 0x7fd2981f4b10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 -- 172.21.15.121:0/58649632 >> 172.21.15.121:0/58649632 conn(0x7fd2980d4360 msgr2=0x7fd2980d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 -- 172.21.15.121:0/58649632 shutdown_connections 2024-09-17T03:38:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.608+0000 7fd29cc00640 1 -- 172.21.15.121:0/58649632 wait complete. 2024-09-17T03:38:04.634 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-17T03:38:03.317110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223148,"kb_used_data":6896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751572,"statfs":{"total":773094113280,"available":772865609728,"internally_reserved":0,"allocated":7061504,"data_stored":3777504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.123334"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.232402+0000","last_change":"2024-09-17T03:38:00.222368+0000","last_active":"2024-09-17T03:38:00.232402+0000","last_peered":"2024-09-17T03:38:00.232402+0000","last_clean":"2024-09-17T03:38:00.232402+0000","last_became_active":"2024-09-17T03:38:00.222033+0000","last_became_peered":"2024-09-17T03:38:00.222033+0000","last_unstale":"2024-09-17T03:38:00.232402+0000","last_undegraded":"2024-09-17T03:38:00.232402+0000","last_fullsized":"2024-09-17T03:38:00.232402+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:11.675564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.223272+0000","last_change":"2024-09-17T03:38:00.212973+0000","last_active":"2024-09-17T03:38:00.223272+0000","last_peered":"2024-09-17T03:38:00.223272+0000","last_clean":"2024-09-17T03:38:00.223272+0000","last_became_active":"2024-09-17T03:38:00.212641+0000","last_became_peered":"2024-09-17T03:38:00.212641+0000","last_unstale":"2024-09-17T03:38:00.223272+0000","last_undegraded":"2024-09-17T03:38:00.223272+0000","last_fullsized":"2024-09-17T03:38:00.223272+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:11.670291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.236911+0000","last_change":"2024-09-17T03:38:00.228461+0000","last_active":"2024-09-17T03:38:00.236911+0000","last_peered":"2024-09-17T03:38:00.236911+0000","last_clean":"2024-09-17T03:38:00.236911+0000","last_became_active":"2024-09-17T03:38:00.228017+0000","last_became_peered":"2024-09-17T03:38:00.228017+0000","last_unstale":"2024-09-17T03:38:00.236911+0000","last_undegraded":"2024-09-17T03:38:00.236911+0000","last_fullsized":"2024-09-17T03:38:00.236911+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:04.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.248229+0000","last_change":"2024-09-17T03:38:00.245821+0000","last_active":"2024-09-17T03:38:00.248229+0000","last_peered":"2024-09-17T03:38:00.248229+0000","last_clean":"2024-09-17T03:38:00.248229+0000","last_became_active":"2024-09-17T03:38:00.240566+0000","last_became_peered":"2024-09-17T03:38:00.240566+0000","last_unstale":"2024-09-17T03:38:00.248229+0000","last_undegraded":"2024-09-17T03:38:00.248229+0000","last_fullsized":"2024-09-17T03:38:00.248229+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:53.116332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237374+0000","last_change":"2024-09-17T03:38:00.232451+0000","last_active":"2024-09-17T03:38:00.237374+0000","last_peered":"2024-09-17T03:38:00.237374+0000","last_clean":"2024-09-17T03:38:00.237374+0000","last_became_active":"2024-09-17T03:38:00.231615+0000","last_became_peered":"2024-09-17T03:38:00.231615+0000","last_unstale":"2024-09-17T03:38:00.237374+0000","last_undegraded":"2024-09-17T03:38:00.237374+0000","last_fullsized":"2024-09-17T03:38:00.237374+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:14.234838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.228828+0000","last_change":"2024-09-17T03:38:00.222687+0000","last_active":"2024-09-17T03:38:00.228828+0000","last_peered":"2024-09-17T03:38:00.228828+0000","last_clean":"2024-09-17T03:38:00.228828+0000","last_became_active":"2024-09-17T03:38:00.222036+0000","last_became_peered":"2024-09-17T03:38:00.222036+0000","last_unstale":"2024-09-17T03:38:00.228828+0000","last_undegraded":"2024-09-17T03:38:00.228828+0000","last_fullsized":"2024-09-17T03:38:00.228828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:46.469094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237651+0000","last_change":"2024-09-17T03:38:00.233920+0000","last_active":"2024-09-17T03:38:00.237651+0000","last_peered":"2024-09-17T03:38:00.237651+0000","last_clean":"2024-09-17T03:38:00.237651+0000","last_became_active":"2024-09-17T03:38:00.233623+0000","last_became_peered":"2024-09-17T03:38:00.233623+0000","last_unstale":"2024-09-17T03:38:00.237651+0000","last_undegraded":"2024-09-17T03:38:00.237651+0000","last_fullsized":"2024-09-17T03:38:00.237651+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:46.655571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.235591+0000","last_change":"2024-09-17T03:38:00.225425+0000","last_active":"2024-09-17T03:38:00.235591+0000","last_peered":"2024-09-17T03:38:00.235591+0000","last_clean":"2024-09-17T03:38:00.235591+0000","last_became_active":"2024-09-17T03:38:00.225128+0000","last_became_peered":"2024-09-17T03:38:00.225128+0000","last_unstale":"2024-09-17T03:38:00.235591+0000","last_undegraded":"2024-09-17T03:38:00.235591+0000","last_fullsized":"2024-09-17T03:38:00.235591+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:25.634474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.248189+0000","last_change":"2024-09-17T03:38:00.240344+0000","last_active":"2024-09-17T03:38:00.248189+0000","last_peered":"2024-09-17T03:38:00.248189+0000","last_clean":"2024-09-17T03:38:00.248189+0000","last_became_active":"2024-09-17T03:38:00.239676+0000","last_became_peered":"2024-09-17T03:38:00.239676+0000","last_unstale":"2024-09-17T03:38:00.248189+0000","last_undegraded":"2024-09-17T03:38:00.248189+0000","last_fullsized":"2024-09-17T03:38:00.248189+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:01.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.241892+0000","last_change":"2024-09-17T03:38:00.236262+0000","last_active":"2024-09-17T03:38:00.241892+0000","last_peered":"2024-09-17T03:38:00.241892+0000","last_clean":"2024-09-17T03:38:00.241892+0000","last_became_active":"2024-09-17T03:38:00.235774+0000","last_became_peered":"2024-09-17T03:38:00.235774+0000","last_unstale":"2024-09-17T03:38:00.241892+0000","last_undegraded":"2024-09-17T03:38:00.241892+0000","last_fullsized":"2024-09-17T03:38:00.241892+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:41.464877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.245580+0000","last_change":"2024-09-17T03:38:00.230368+0000","last_active":"2024-09-17T03:38:00.245580+0000","last_peered":"2024-09-17T03:38:00.245580+0000","last_clean":"2024-09-17T03:38:00.245580+0000","last_became_active":"2024-09-17T03:38:00.230046+0000","last_became_peered":"2024-09-17T03:38:00.230046+0000","last_unstale":"2024-09-17T03:38:00.245580+0000","last_undegraded":"2024-09-17T03:38:00.245580+0000","last_fullsized":"2024-09-17T03:38:00.245580+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:18.985212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.248244+0000","last_change":"2024-09-17T03:38:00.246041+0000","last_active":"2024-09-17T03:38:00.248244+0000","last_peered":"2024-09-17T03:38:00.248244+0000","last_clean":"2024-09-17T03:38:00.248244+0000","last_became_active":"2024-09-17T03:38:00.245235+0000","last_became_peered":"2024-09-17T03:38:00.245235+0000","last_unstale":"2024-09-17T03:38:00.248244+0000","last_undegraded":"2024-09-17T03:38:00.248244+0000","last_fullsized":"2024-09-17T03:38:00.248244+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:55.567120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.229447+0000","last_change":"2024-09-17T03:38:00.223000+0000","last_active":"2024-09-17T03:38:00.229447+0000","last_peered":"2024-09-17T03:38:00.229447+0000","last_clean":"2024-09-17T03:38:00.229447+0000","last_became_active":"2024-09-17T03:38:00.222691+0000","last_became_peered":"2024-09-17T03:38:00.222691+0000","last_unstale":"2024-09-17T03:38:00.229447+0000","last_undegraded":"2024-09-17T03:38:00.229447+0000","last_fullsized":"2024-09-17T03:38:00.229447+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:59.659038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.234118+0000","last_change":"2024-09-17T03:38:00.228464+0000","last_active":"2024-09-17T03:38:00.234118+0000","last_peered":"2024-09-17T03:38:00.234118+0000","last_clean":"2024-09-17T03:38:00.234118+0000","last_became_active":"2024-09-17T03:38:00.226735+0000","last_became_peered":"2024-09-17T03:38:00.226735+0000","last_unstale":"2024-09-17T03:38:00.234118+0000","last_undegraded":"2024-09-17T03:38:00.234118+0000","last_fullsized":"2024-09-17T03:38:00.234118+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:40.088667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.241095+0000","last_change":"2024-09-17T03:38:00.236151+0000","last_active":"2024-09-17T03:38:00.241095+0000","last_peered":"2024-09-17T03:38:00.241095+0000","last_clean":"2024-09-17T03:38:00.241095+0000","last_became_active":"2024-09-17T03:38:00.235856+0000","last_became_peered":"2024-09-17T03:38:00.235856+0000","last_unstale":"2024-09-17T03:38:00.241095+0000","last_undegraded":"2024-09-17T03:38:00.241095+0000","last_fullsized":"2024-09-17T03:38:00.241095+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:00.260519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.233069+0000","last_change":"2024-09-17T03:38:00.223878+0000","last_active":"2024-09-17T03:38:00.233069+0000","last_peered":"2024-09-17T03:38:00.233069+0000","last_clean":"2024-09-17T03:38:00.233069+0000","last_became_active":"2024-09-17T03:38:00.223418+0000","last_became_peered":"2024-09-17T03:38:00.223418+0000","last_unstale":"2024-09-17T03:38:00.233069+0000","last_undegraded":"2024-09-17T03:38:00.233069+0000","last_fullsized":"2024-09-17T03:38:00.233069+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:26.860912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.228375+0000","last_change":"2024-09-17T03:38:00.228806+0000","last_active":"2024-09-17T03:38:01.228375+0000","last_peered":"2024-09-17T03:38:01.228375+0000","last_clean":"2024-09-17T03:38:01.228375+0000","last_became_active":"2024-09-17T03:38:00.228291+0000","last_became_peered":"2024-09-17T03:38:00.228291+0000","last_unstale":"2024-09-17T03:38:01.228375+0000","last_undegraded":"2024-09-17T03:38:01.228375+0000","last_fullsized":"2024-09-17T03:38:01.228375+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:56.132569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.245951+0000","last_change":"2024-09-17T03:38:00.229886+0000","last_active":"2024-09-17T03:38:00.245951+0000","last_peered":"2024-09-17T03:38:00.245951+0000","last_clean":"2024-09-17T03:38:00.245951+0000","last_became_active":"2024-09-17T03:38:00.229585+0000","last_became_peered":"2024-09-17T03:38:00.229585+0000","last_unstale":"2024-09-17T03:38:00.245951+0000","last_undegraded":"2024-09-17T03:38:00.245951+0000","last_fullsized":"2024-09-17T03:38:00.245951+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:12.625389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.245612+0000","last_change":"2024-09-17T03:38:00.230569+0000","last_active":"2024-09-17T03:38:00.245612+0000","last_peered":"2024-09-17T03:38:00.245612+0000","last_clean":"2024-09-17T03:38:00.245612+0000","last_became_active":"2024-09-17T03:38:00.230288+0000","last_became_peered":"2024-09-17T03:38:00.230288+0000","last_unstale":"2024-09-17T03:38:00.245612+0000","last_undegraded":"2024-09-17T03:38:00.245612+0000","last_fullsized":"2024-09-17T03:38:00.245612+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:11.670291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227536+0000","last_change":"2024-09-17T03:38:00.229925+0000","last_active":"2024-09-17T03:38:01.227536+0000","last_peered":"2024-09-17T03:38:01.227536+0000","last_clean":"2024-09-17T03:38:01.227536+0000","last_became_active":"2024-09-17T03:38:00.229488+0000","last_became_peered":"2024-09-17T03:38:00.229488+0000","last_unstale":"2024-09-17T03:38:01.227536+0000","last_undegraded":"2024-09-17T03:38:01.227536+0000","last_fullsized":"2024-09-17T03:38:01.227536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:18.755935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.240375+0000","last_change":"2024-09-17T03:38:00.234052+0000","last_active":"2024-09-17T03:38:00.240375+0000","last_peered":"2024-09-17T03:38:00.240375+0000","last_clean":"2024-09-17T03:38:00.240375+0000","last_became_active":"2024-09-17T03:38:00.233736+0000","last_became_peered":"2024-09-17T03:38:00.233736+0000","last_unstale":"2024-09-17T03:38:00.240375+0000","last_undegraded":"2024-09-17T03:38:00.240375+0000","last_fullsized":"2024-09-17T03:38:00.240375+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:51.062175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.228794+0000","last_change":"2024-09-17T03:38:00.222352+0000","last_active":"2024-09-17T03:38:00.228794+0000","last_peered":"2024-09-17T03:38:00.228794+0000","last_clean":"2024-09-17T03:38:00.228794+0000","last_became_active":"2024-09-17T03:38:00.221667+0000","last_became_peered":"2024-09-17T03:38:00.221667+0000","last_unstale":"2024-09-17T03:38:00.228794+0000","last_undegraded":"2024-09-17T03:38:00.228794+0000","last_fullsized":"2024-09-17T03:38:00.228794+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:01.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.236967+0000","last_change":"2024-09-17T03:38:00.227705+0000","last_active":"2024-09-17T03:38:00.236967+0000","last_peered":"2024-09-17T03:38:00.236967+0000","last_clean":"2024-09-17T03:38:00.236967+0000","last_became_active":"2024-09-17T03:38:00.227353+0000","last_became_peered":"2024-09-17T03:38:00.227353+0000","last_unstale":"2024-09-17T03:38:00.236967+0000","last_undegraded":"2024-09-17T03:38:00.236967+0000","last_fullsized":"2024-09-17T03:38:00.236967+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:00.260519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.235512+0000","last_change":"2024-09-17T03:38:00.220932+0000","last_active":"2024-09-17T03:38:00.235512+0000","last_peered":"2024-09-17T03:38:00.235512+0000","last_clean":"2024-09-17T03:38:00.235512+0000","last_became_active":"2024-09-17T03:38:00.220011+0000","last_became_peered":"2024-09-17T03:38:00.220011+0000","last_unstale":"2024-09-17T03:38:00.235512+0000","last_undegraded":"2024-09-17T03:38:00.235512+0000","last_fullsized":"2024-09-17T03:38:00.235512+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:06.095325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237849+0000","last_change":"2024-09-17T03:38:00.233271+0000","last_active":"2024-09-17T03:38:00.237849+0000","last_peered":"2024-09-17T03:38:00.237849+0000","last_clean":"2024-09-17T03:38:00.237849+0000","last_became_active":"2024-09-17T03:38:00.233012+0000","last_became_peered":"2024-09-17T03:38:00.233012+0000","last_unstale":"2024-09-17T03:38:00.237849+0000","last_undegraded":"2024-09-17T03:38:00.237849+0000","last_fullsized":"2024-09-17T03:38:00.237849+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:00.260519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.241795+0000","last_change":"2024-09-17T03:38:00.235201+0000","last_active":"2024-09-17T03:38:00.241795+0000","last_peered":"2024-09-17T03:38:00.241795+0000","last_clean":"2024-09-17T03:38:00.241795+0000","last_became_active":"2024-09-17T03:38:00.234928+0000","last_became_peered":"2024-09-17T03:38:00.234928+0000","last_unstale":"2024-09-17T03:38:00.241795+0000","last_undegraded":"2024-09-17T03:38:00.241795+0000","last_fullsized":"2024-09-17T03:38:00.241795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:47.712110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.233973+0000","last_change":"2024-09-17T03:38:00.227372+0000","last_active":"2024-09-17T03:38:00.233973+0000","last_peered":"2024-09-17T03:38:00.233973+0000","last_clean":"2024-09-17T03:38:00.233973+0000","last_became_active":"2024-09-17T03:38:00.227079+0000","last_became_peered":"2024-09-17T03:38:00.227079+0000","last_unstale":"2024-09-17T03:38:00.233973+0000","last_undegraded":"2024-09-17T03:38:00.233973+0000","last_fullsized":"2024-09-17T03:38:00.233973+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:00.840555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.230680+0000","last_change":"2024-09-17T03:38:00.223016+0000","last_active":"2024-09-17T03:38:00.230680+0000","last_peered":"2024-09-17T03:38:00.230680+0000","last_clean":"2024-09-17T03:38:00.230680+0000","last_became_active":"2024-09-17T03:38:00.222656+0000","last_became_peered":"2024-09-17T03:38:00.222656+0000","last_unstale":"2024-09-17T03:38:00.230680+0000","last_undegraded":"2024-09-17T03:38:00.230680+0000","last_fullsized":"2024-09-17T03:38:00.230680+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:07.913559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.238775+0000","last_change":"2024-09-17T03:38:00.226869+0000","last_active":"2024-09-17T03:38:00.238775+0000","last_peered":"2024-09-17T03:38:00.238775+0000","last_clean":"2024-09-17T03:38:00.238775+0000","last_became_active":"2024-09-17T03:38:00.226545+0000","last_became_peered":"2024-09-17T03:38:00.226545+0000","last_unstale":"2024-09-17T03:38:00.238775+0000","last_undegraded":"2024-09-17T03:38:00.238775+0000","last_fullsized":"2024-09-17T03:38:00.238775+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:34.327340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.248321+0000","last_change":"2024-09-17T03:38:00.241237+0000","last_active":"2024-09-17T03:38:00.248321+0000","last_peered":"2024-09-17T03:38:00.248321+0000","last_clean":"2024-09-17T03:38:00.248321+0000","last_became_active":"2024-09-17T03:38:00.239848+0000","last_became_peered":"2024-09-17T03:38:00.239848+0000","last_unstale":"2024-09-17T03:38:00.248321+0000","last_undegraded":"2024-09-17T03:38:00.248321+0000","last_fullsized":"2024-09-17T03:38:00.248321+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:46.469094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.236837+0000","last_change":"2024-09-17T03:38:00.220672+0000","last_active":"2024-09-17T03:38:00.236837+0000","last_peered":"2024-09-17T03:38:00.236837+0000","last_clean":"2024-09-17T03:38:00.236837+0000","last_became_active":"2024-09-17T03:38:00.220403+0000","last_became_peered":"2024-09-17T03:38:00.220403+0000","last_unstale":"2024-09-17T03:38:00.236837+0000","last_undegraded":"2024-09-17T03:38:00.236837+0000","last_fullsized":"2024-09-17T03:38:00.236837+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:42.252657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.232473+0000","last_change":"2024-09-17T03:38:00.224820+0000","last_active":"2024-09-17T03:38:00.232473+0000","last_peered":"2024-09-17T03:38:00.232473+0000","last_clean":"2024-09-17T03:38:00.232473+0000","last_became_active":"2024-09-17T03:38:00.224457+0000","last_became_peered":"2024-09-17T03:38:00.224457+0000","last_unstale":"2024-09-17T03:38:00.232473+0000","last_undegraded":"2024-09-17T03:38:00.232473+0000","last_fullsized":"2024-09-17T03:38:00.232473+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:35.977342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.245967+0000","last_change":"2024-09-17T03:38:00.236436+0000","last_active":"2024-09-17T03:38:00.245967+0000","last_peered":"2024-09-17T03:38:00.245967+0000","last_clean":"2024-09-17T03:38:00.245967+0000","last_became_active":"2024-09-17T03:38:00.229713+0000","last_became_peered":"2024-09-17T03:38:00.229713+0000","last_unstale":"2024-09-17T03:38:00.245967+0000","last_undegraded":"2024-09-17T03:38:00.245967+0000","last_fullsized":"2024-09-17T03:38:00.245967+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:47.952606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.239965+0000","last_change":"2024-09-17T03:37:59.218025+0000","last_active":"2024-09-17T03:38:00.239965+0000","last_peered":"2024-09-17T03:38:00.239965+0000","last_clean":"2024-09-17T03:38:00.239965+0000","last_became_active":"2024-09-17T03:37:59.216865+0000","last_became_peered":"2024-09-17T03:37:59.216865+0000","last_unstale":"2024-09-17T03:38:00.239965+0000","last_undegraded":"2024-09-17T03:38:00.239965+0000","last_fullsized":"2024-09-17T03:38:00.239965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:09.111156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237295+0000","last_change":"2024-09-17T03:38:00.232018+0000","last_active":"2024-09-17T03:38:00.237295+0000","last_peered":"2024-09-17T03:38:00.237295+0000","last_clean":"2024-09-17T03:38:00.237295+0000","last_became_active":"2024-09-17T03:38:00.231683+0000","last_became_peered":"2024-09-17T03:38:00.231683+0000","last_unstale":"2024-09-17T03:38:00.237295+0000","last_undegraded":"2024-09-17T03:38:00.237295+0000","last_fullsized":"2024-09-17T03:38:00.237295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:21.983888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.242790+0000","last_change":"2024-09-17T03:37:59.223058+0000","last_active":"2024-09-17T03:38:00.242790+0000","last_peered":"2024-09-17T03:38:00.242790+0000","last_clean":"2024-09-17T03:38:00.242790+0000","last_became_active":"2024-09-17T03:37:59.222526+0000","last_became_peered":"2024-09-17T03:37:59.222526+0000","last_unstale":"2024-09-17T03:38:00.242790+0000","last_undegraded":"2024-09-17T03:38:00.242790+0000","last_fullsized":"2024-09-17T03:38:00.242790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:29.243810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.228155+0000","last_change":"2024-09-17T03:38:00.219316+0000","last_active":"2024-09-17T03:38:00.228155+0000","last_peered":"2024-09-17T03:38:00.228155+0000","last_clean":"2024-09-17T03:38:00.228155+0000","last_became_active":"2024-09-17T03:38:00.219004+0000","last_became_peered":"2024-09-17T03:38:00.219004+0000","last_unstale":"2024-09-17T03:38:00.228155+0000","last_undegraded":"2024-09-17T03:38:00.228155+0000","last_fullsized":"2024-09-17T03:38:00.228155+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:47.952606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237828+0000","last_change":"2024-09-17T03:37:59.220812+0000","last_active":"2024-09-17T03:38:00.237828+0000","last_peered":"2024-09-17T03:38:00.237828+0000","last_clean":"2024-09-17T03:38:00.237828+0000","last_became_active":"2024-09-17T03:37:59.220488+0000","last_became_peered":"2024-09-17T03:37:59.220488+0000","last_unstale":"2024-09-17T03:38:00.237828+0000","last_undegraded":"2024-09-17T03:38:00.237828+0000","last_fullsized":"2024-09-17T03:38:00.237828+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:39.752508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.246004+0000","last_change":"2024-09-17T03:38:00.236810+0000","last_active":"2024-09-17T03:38:00.246004+0000","last_peered":"2024-09-17T03:38:00.246004+0000","last_clean":"2024-09-17T03:38:00.246004+0000","last_became_active":"2024-09-17T03:38:00.232712+0000","last_became_peered":"2024-09-17T03:38:00.232712+0000","last_unstale":"2024-09-17T03:38:00.246004+0000","last_undegraded":"2024-09-17T03:38:00.246004+0000","last_fullsized":"2024-09-17T03:38:00.246004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:08.117563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.247568+0000","last_change":"2024-09-17T03:37:59.224702+0000","last_active":"2024-09-17T03:38:00.247568+0000","last_peered":"2024-09-17T03:38:00.247568+0000","last_clean":"2024-09-17T03:38:00.247568+0000","last_became_active":"2024-09-17T03:37:59.222980+0000","last_became_peered":"2024-09-17T03:37:59.222980+0000","last_unstale":"2024-09-17T03:38:00.247568+0000","last_undegraded":"2024-09-17T03:38:00.247568+0000","last_fullsized":"2024-09-17T03:38:00.247568+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:29.667039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.226108+0000","last_change":"2024-09-17T03:38:00.219079+0000","last_active":"2024-09-17T03:38:01.226108+0000","last_peered":"2024-09-17T03:38:01.226108+0000","last_clean":"2024-09-17T03:38:01.226108+0000","last_became_active":"2024-09-17T03:38:00.218607+0000","last_became_peered":"2024-09-17T03:38:00.218607+0000","last_unstale":"2024-09-17T03:38:01.226108+0000","last_undegraded":"2024-09-17T03:38:01.226108+0000","last_fullsized":"2024-09-17T03:38:01.226108+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:36.115940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227822+0000","last_change":"2024-09-17T03:37:59.222531+0000","last_active":"2024-09-17T03:38:01.227822+0000","last_peered":"2024-09-17T03:38:01.227822+0000","last_clean":"2024-09-17T03:38:01.227822+0000","last_became_active":"2024-09-17T03:37:59.222184+0000","last_became_peered":"2024-09-17T03:37:59.222184+0000","last_unstale":"2024-09-17T03:38:01.227822+0000","last_undegraded":"2024-09-17T03:38:01.227822+0000","last_fullsized":"2024-09-17T03:38:01.227822+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:19.919207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.230726+0000","last_change":"2024-09-17T03:38:00.222000+0000","last_active":"2024-09-17T03:38:00.230726+0000","last_peered":"2024-09-17T03:38:00.230726+0000","last_clean":"2024-09-17T03:38:00.230726+0000","last_became_active":"2024-09-17T03:38:00.219646+0000","last_became_peered":"2024-09-17T03:38:00.219646+0000","last_unstale":"2024-09-17T03:38:00.230726+0000","last_undegraded":"2024-09-17T03:38:00.230726+0000","last_fullsized":"2024-09-17T03:38:00.230726+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:33.457311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.240327+0000","last_change":"2024-09-17T03:37:59.222565+0000","last_active":"2024-09-17T03:38:00.240327+0000","last_peered":"2024-09-17T03:38:00.240327+0000","last_clean":"2024-09-17T03:38:00.240327+0000","last_became_active":"2024-09-17T03:37:59.220288+0000","last_became_peered":"2024-09-17T03:37:59.220288+0000","last_unstale":"2024-09-17T03:38:00.240327+0000","last_undegraded":"2024-09-17T03:38:00.240327+0000","last_fullsized":"2024-09-17T03:38:00.240327+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:17.978225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.231732+0000","last_change":"2024-09-17T03:38:00.229069+0000","last_active":"2024-09-17T03:38:00.231732+0000","last_peered":"2024-09-17T03:38:00.231732+0000","last_clean":"2024-09-17T03:38:00.231732+0000","last_became_active":"2024-09-17T03:38:00.228766+0000","last_became_peered":"2024-09-17T03:38:00.228766+0000","last_unstale":"2024-09-17T03:38:00.231732+0000","last_undegraded":"2024-09-17T03:38:00.231732+0000","last_fullsized":"2024-09-17T03:38:00.231732+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:26.860912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.211024+0000","last_change":"2024-09-17T03:37:59.225707+0000","last_active":"2024-09-17T03:38:00.211024+0000","last_peered":"2024-09-17T03:38:00.211024+0000","last_clean":"2024-09-17T03:38:00.211024+0000","last_became_active":"2024-09-17T03:37:59.224981+0000","last_became_peered":"2024-09-17T03:37:59.224981+0000","last_unstale":"2024-09-17T03:38:00.211024+0000","last_undegraded":"2024-09-17T03:38:00.211024+0000","last_fullsized":"2024-09-17T03:38:00.211024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:37.023804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227663+0000","last_change":"2024-09-17T03:38:00.235652+0000","last_active":"2024-09-17T03:38:01.227663+0000","last_peered":"2024-09-17T03:38:01.227663+0000","last_clean":"2024-09-17T03:38:01.227663+0000","last_became_active":"2024-09-17T03:38:00.234750+0000","last_became_peered":"2024-09-17T03:38:00.234750+0000","last_unstale":"2024-09-17T03:38:01.227663+0000","last_undegraded":"2024-09-17T03:38:01.227663+0000","last_fullsized":"2024-09-17T03:38:01.227663+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:01.619376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.217086+0000","last_change":"2024-09-17T03:37:59.227842+0000","last_active":"2024-09-17T03:38:00.217086+0000","last_peered":"2024-09-17T03:38:00.217086+0000","last_clean":"2024-09-17T03:38:00.217086+0000","last_became_active":"2024-09-17T03:37:59.227543+0000","last_became_peered":"2024-09-17T03:37:59.227543+0000","last_unstale":"2024-09-17T03:38:00.217086+0000","last_undegraded":"2024-09-17T03:38:00.217086+0000","last_fullsized":"2024-09-17T03:38:00.217086+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:29.667039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.230645+0000","last_change":"2024-09-17T03:38:00.220514+0000","last_active":"2024-09-17T03:38:00.230645+0000","last_peered":"2024-09-17T03:38:00.230645+0000","last_clean":"2024-09-17T03:38:00.230645+0000","last_became_active":"2024-09-17T03:38:00.220166+0000","last_became_peered":"2024-09-17T03:38:00.220166+0000","last_unstale":"2024-09-17T03:38:00.230645+0000","last_undegraded":"2024-09-17T03:38:00.230645+0000","last_fullsized":"2024-09-17T03:38:00.230645+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:46.331467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.215834+0000","last_change":"2024-09-17T03:37:59.225758+0000","last_active":"2024-09-17T03:38:00.215834+0000","last_peered":"2024-09-17T03:38:00.215834+0000","last_clean":"2024-09-17T03:38:00.215834+0000","last_became_active":"2024-09-17T03:37:59.225469+0000","last_became_peered":"2024-09-17T03:37:59.225469+0000","last_unstale":"2024-09-17T03:38:00.215834+0000","last_undegraded":"2024-09-17T03:38:00.215834+0000","last_fullsized":"2024-09-17T03:38:00.215834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:41.724280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227419+0000","last_change":"2024-09-17T03:38:00.227573+0000","last_active":"2024-09-17T03:38:01.227419+0000","last_peered":"2024-09-17T03:38:01.227419+0000","last_clean":"2024-09-17T03:38:01.227419+0000","last_became_active":"2024-09-17T03:38:00.226638+0000","last_became_peered":"2024-09-17T03:38:00.226638+0000","last_unstale":"2024-09-17T03:38:01.227419+0000","last_undegraded":"2024-09-17T03:38:01.227419+0000","last_fullsized":"2024-09-17T03:38:01.227419+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:51.494367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.209536+0000","last_change":"2024-09-17T03:37:59.228373+0000","last_active":"2024-09-17T03:38:00.209536+0000","last_peered":"2024-09-17T03:38:00.209536+0000","last_clean":"2024-09-17T03:38:00.209536+0000","last_became_active":"2024-09-17T03:37:59.227824+0000","last_became_peered":"2024-09-17T03:37:59.227824+0000","last_unstale":"2024-09-17T03:38:00.209536+0000","last_undegraded":"2024-09-17T03:38:00.209536+0000","last_fullsized":"2024-09-17T03:38:00.209536+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:05.540291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.227313+0000","last_change":"2024-09-17T03:38:00.221921+0000","last_active":"2024-09-17T03:38:00.227313+0000","last_peered":"2024-09-17T03:38:00.227313+0000","last_clean":"2024-09-17T03:38:00.227313+0000","last_became_active":"2024-09-17T03:38:00.221257+0000","last_became_peered":"2024-09-17T03:38:00.221257+0000","last_unstale":"2024-09-17T03:38:00.227313+0000","last_undegraded":"2024-09-17T03:38:00.227313+0000","last_fullsized":"2024-09-17T03:38:00.227313+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:37.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"62'3","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.248980+0000","last_change":"2024-09-17T03:37:59.224940+0000","last_active":"2024-09-17T03:38:00.248980+0000","last_peered":"2024-09-17T03:38:00.248980+0000","last_clean":"2024-09-17T03:38:00.248980+0000","last_became_active":"2024-09-17T03:37:59.224656+0000","last_became_peered":"2024-09-17T03:37:59.224656+0000","last_unstale":"2024-09-17T03:38:00.248980+0000","last_undegraded":"2024-09-17T03:38:00.248980+0000","last_fullsized":"2024-09-17T03:38:00.248980+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:24.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.242180+0000","last_change":"2024-09-17T03:38:00.224427+0000","last_active":"2024-09-17T03:38:00.242180+0000","last_peered":"2024-09-17T03:38:00.242180+0000","last_clean":"2024-09-17T03:38:00.242180+0000","last_became_active":"2024-09-17T03:38:00.221395+0000","last_became_peered":"2024-09-17T03:38:00.221395+0000","last_unstale":"2024-09-17T03:38:00.242180+0000","last_undegraded":"2024-09-17T03:38:00.242180+0000","last_fullsized":"2024-09-17T03:38:00.242180+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:13.030771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.252134+0000","last_change":"2024-09-17T03:37:59.222176+0000","last_active":"2024-09-17T03:38:00.252134+0000","last_peered":"2024-09-17T03:38:00.252134+0000","last_clean":"2024-09-17T03:38:00.252134+0000","last_became_active":"2024-09-17T03:37:59.221875+0000","last_became_peered":"2024-09-17T03:37:59.221875+0000","last_unstale":"2024-09-17T03:38:00.252134+0000","last_undegraded":"2024-09-17T03:38:00.252134+0000","last_fullsized":"2024-09-17T03:38:00.252134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:10.200073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.247585+0000","last_change":"2024-09-17T03:38:00.243917+0000","last_active":"2024-09-17T03:38:00.247585+0000","last_peered":"2024-09-17T03:38:00.247585+0000","last_clean":"2024-09-17T03:38:00.247585+0000","last_became_active":"2024-09-17T03:38:00.242914+0000","last_became_peered":"2024-09-17T03:38:00.242914+0000","last_unstale":"2024-09-17T03:38:00.247585+0000","last_undegraded":"2024-09-17T03:38:00.247585+0000","last_fullsized":"2024-09-17T03:38:00.247585+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:42.731267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.256081+0000","last_change":"2024-09-17T03:37:59.230180+0000","last_active":"2024-09-17T03:38:00.256081+0000","last_peered":"2024-09-17T03:38:00.256081+0000","last_clean":"2024-09-17T03:38:00.256081+0000","last_became_active":"2024-09-17T03:37:59.229412+0000","last_became_peered":"2024-09-17T03:37:59.229412+0000","last_unstale":"2024-09-17T03:38:00.256081+0000","last_undegraded":"2024-09-17T03:38:00.256081+0000","last_fullsized":"2024-09-17T03:38:00.256081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:50.055188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.231787+0000","last_change":"2024-09-17T03:38:00.225679+0000","last_active":"2024-09-17T03:38:00.231787+0000","last_peered":"2024-09-17T03:38:00.231787+0000","last_clean":"2024-09-17T03:38:00.231787+0000","last_became_active":"2024-09-17T03:38:00.225351+0000","last_became_peered":"2024-09-17T03:38:00.225351+0000","last_unstale":"2024-09-17T03:38:00.231787+0000","last_undegraded":"2024-09-17T03:38:00.231787+0000","last_fullsized":"2024-09-17T03:38:00.231787+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:40.088667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.212183+0000","last_change":"2024-09-17T03:37:59.226284+0000","last_active":"2024-09-17T03:38:00.212183+0000","last_peered":"2024-09-17T03:38:00.212183+0000","last_clean":"2024-09-17T03:38:00.212183+0000","last_became_active":"2024-09-17T03:37:59.225946+0000","last_became_peered":"2024-09-17T03:37:59.225946+0000","last_unstale":"2024-09-17T03:38:00.212183+0000","last_undegraded":"2024-09-17T03:38:00.212183+0000","last_fullsized":"2024-09-17T03:38:00.212183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:05.930614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.231705+0000","last_change":"2024-09-17T03:38:00.223956+0000","last_active":"2024-09-17T03:38:00.231705+0000","last_peered":"2024-09-17T03:38:00.231705+0000","last_clean":"2024-09-17T03:38:00.231705+0000","last_became_active":"2024-09-17T03:38:00.223405+0000","last_became_peered":"2024-09-17T03:38:00.223405+0000","last_unstale":"2024-09-17T03:38:00.231705+0000","last_undegraded":"2024-09-17T03:38:00.231705+0000","last_fullsized":"2024-09-17T03:38:00.231705+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:00.840555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.208434+0000","last_change":"2024-09-17T03:37:59.225995+0000","last_active":"2024-09-17T03:38:00.208434+0000","last_peered":"2024-09-17T03:38:00.208434+0000","last_clean":"2024-09-17T03:38:00.208434+0000","last_became_active":"2024-09-17T03:37:59.225539+0000","last_became_peered":"2024-09-17T03:37:59.225539+0000","last_unstale":"2024-09-17T03:38:00.208434+0000","last_undegraded":"2024-09-17T03:38:00.208434+0000","last_fullsized":"2024-09-17T03:38:00.208434+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:17.533294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.232562+0000","last_change":"2024-09-17T03:38:00.225600+0000","last_active":"2024-09-17T03:38:00.232562+0000","last_peered":"2024-09-17T03:38:00.232562+0000","last_clean":"2024-09-17T03:38:00.232562+0000","last_became_active":"2024-09-17T03:38:00.225189+0000","last_became_peered":"2024-09-17T03:38:00.225189+0000","last_unstale":"2024-09-17T03:38:00.232562+0000","last_undegraded":"2024-09-17T03:38:00.232562+0000","last_fullsized":"2024-09-17T03:38:00.232562+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:53.523523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"62'8","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.249737+0000","last_change":"2024-09-17T03:37:59.229080+0000","last_active":"2024-09-17T03:38:00.249737+0000","last_peered":"2024-09-17T03:38:00.249737+0000","last_clean":"2024-09-17T03:38:00.249737+0000","last_became_active":"2024-09-17T03:37:59.226730+0000","last_became_peered":"2024-09-17T03:37:59.226730+0000","last_unstale":"2024-09-17T03:38:00.249737+0000","last_undegraded":"2024-09-17T03:38:00.249737+0000","last_fullsized":"2024-09-17T03:38:00.249737+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:36.034348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.250721+0000","last_change":"2024-09-17T03:38:00.246265+0000","last_active":"2024-09-17T03:38:00.250721+0000","last_peered":"2024-09-17T03:38:00.250721+0000","last_clean":"2024-09-17T03:38:00.250721+0000","last_became_active":"2024-09-17T03:38:00.245943+0000","last_became_peered":"2024-09-17T03:38:00.245943+0000","last_unstale":"2024-09-17T03:38:00.250721+0000","last_undegraded":"2024-09-17T03:38:00.250721+0000","last_fullsized":"2024-09-17T03:38:00.250721+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:13.617924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.255738+0000","last_change":"2024-09-17T03:37:59.224196+0000","last_active":"2024-09-17T03:38:00.255738+0000","last_peered":"2024-09-17T03:38:00.255738+0000","last_clean":"2024-09-17T03:38:00.255738+0000","last_became_active":"2024-09-17T03:37:59.223898+0000","last_became_peered":"2024-09-17T03:37:59.223898+0000","last_unstale":"2024-09-17T03:38:00.255738+0000","last_undegraded":"2024-09-17T03:38:00.255738+0000","last_fullsized":"2024-09-17T03:38:00.255738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:43.763434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.228237+0000","last_change":"2024-09-17T03:38:00.221221+0000","last_active":"2024-09-17T03:38:00.228237+0000","last_peered":"2024-09-17T03:38:00.228237+0000","last_clean":"2024-09-17T03:38:00.228237+0000","last_became_active":"2024-09-17T03:38:00.220918+0000","last_became_peered":"2024-09-17T03:38:00.220918+0000","last_unstale":"2024-09-17T03:38:00.228237+0000","last_undegraded":"2024-09-17T03:38:00.228237+0000","last_fullsized":"2024-09-17T03:38:00.228237+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:01.320706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.255648+0000","last_change":"2024-09-17T03:37:59.214329+0000","last_active":"2024-09-17T03:38:00.255648+0000","last_peered":"2024-09-17T03:38:00.255648+0000","last_clean":"2024-09-17T03:38:00.255648+0000","last_became_active":"2024-09-17T03:37:59.213877+0000","last_became_peered":"2024-09-17T03:37:59.213877+0000","last_unstale":"2024-09-17T03:38:00.255648+0000","last_undegraded":"2024-09-17T03:38:00.255648+0000","last_fullsized":"2024-09-17T03:38:00.255648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:43.194306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.234820+0000","last_change":"2024-09-17T03:38:00.230752+0000","last_active":"2024-09-17T03:38:00.234820+0000","last_peered":"2024-09-17T03:38:00.234820+0000","last_clean":"2024-09-17T03:38:00.234820+0000","last_became_active":"2024-09-17T03:38:00.230462+0000","last_became_peered":"2024-09-17T03:38:00.230462+0000","last_unstale":"2024-09-17T03:38:00.234820+0000","last_undegraded":"2024-09-17T03:38:00.234820+0000","last_fullsized":"2024-09-17T03:38:00.234820+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:26.860912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.250787+0000","last_change":"2024-09-17T03:37:59.224192+0000","last_active":"2024-09-17T03:38:00.250787+0000","last_peered":"2024-09-17T03:38:00.250787+0000","last_clean":"2024-09-17T03:38:00.250787+0000","last_became_active":"2024-09-17T03:37:59.223827+0000","last_became_peered":"2024-09-17T03:37:59.223827+0000","last_unstale":"2024-09-17T03:38:00.250787+0000","last_undegraded":"2024-09-17T03:38:00.250787+0000","last_fullsized":"2024-09-17T03:38:00.250787+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:50.072135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.247974+0000","last_change":"2024-09-17T03:38:00.241965+0000","last_active":"2024-09-17T03:38:00.247974+0000","last_peered":"2024-09-17T03:38:00.247974+0000","last_clean":"2024-09-17T03:38:00.247974+0000","last_became_active":"2024-09-17T03:38:00.235216+0000","last_became_peered":"2024-09-17T03:38:00.235216+0000","last_unstale":"2024-09-17T03:38:00.247974+0000","last_undegraded":"2024-09-17T03:38:00.247974+0000","last_fullsized":"2024-09-17T03:38:00.247974+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:36.055895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.206329+0000","last_change":"2024-09-17T03:37:59.228513+0000","last_active":"2024-09-17T03:38:00.206329+0000","last_peered":"2024-09-17T03:38:00.206329+0000","last_clean":"2024-09-17T03:38:00.206329+0000","last_became_active":"2024-09-17T03:37:59.228157+0000","last_became_peered":"2024-09-17T03:37:59.228157+0000","last_unstale":"2024-09-17T03:38:00.206329+0000","last_undegraded":"2024-09-17T03:38:00.206329+0000","last_fullsized":"2024-09-17T03:38:00.206329+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:59.833568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.228368+0000","last_change":"2024-09-17T03:38:00.221302+0000","last_active":"2024-09-17T03:38:00.228368+0000","last_peered":"2024-09-17T03:38:00.228368+0000","last_clean":"2024-09-17T03:38:00.228368+0000","last_became_active":"2024-09-17T03:38:00.220972+0000","last_became_peered":"2024-09-17T03:38:00.220972+0000","last_unstale":"2024-09-17T03:38:00.228368+0000","last_undegraded":"2024-09-17T03:38:00.228368+0000","last_fullsized":"2024-09-17T03:38:00.228368+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:08.117563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.243468+0000","last_change":"2024-09-17T03:37:59.229184+0000","last_active":"2024-09-17T03:38:00.243468+0000","last_peered":"2024-09-17T03:38:00.243468+0000","last_clean":"2024-09-17T03:38:00.243468+0000","last_became_active":"2024-09-17T03:37:59.228578+0000","last_became_peered":"2024-09-17T03:37:59.228578+0000","last_unstale":"2024-09-17T03:38:00.243468+0000","last_undegraded":"2024-09-17T03:38:00.243468+0000","last_fullsized":"2024-09-17T03:38:00.243468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:54.599542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.240200+0000","last_change":"2024-09-17T03:38:00.233850+0000","last_active":"2024-09-17T03:38:00.240200+0000","last_peered":"2024-09-17T03:38:00.240200+0000","last_clean":"2024-09-17T03:38:00.240200+0000","last_became_active":"2024-09-17T03:38:00.233534+0000","last_became_peered":"2024-09-17T03:38:00.233534+0000","last_unstale":"2024-09-17T03:38:00.240200+0000","last_undegraded":"2024-09-17T03:38:00.240200+0000","last_fullsized":"2024-09-17T03:38:00.240200+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:41.464877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.211201+0000","last_change":"2024-09-17T03:37:59.224541+0000","last_active":"2024-09-17T03:38:00.211201+0000","last_peered":"2024-09-17T03:38:00.211201+0000","last_clean":"2024-09-17T03:38:00.211201+0000","last_became_active":"2024-09-17T03:37:59.221105+0000","last_became_peered":"2024-09-17T03:37:59.221105+0000","last_unstale":"2024-09-17T03:38:00.211201+0000","last_undegraded":"2024-09-17T03:38:00.211201+0000","last_fullsized":"2024-09-17T03:38:00.211201+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:58.652051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.238722+0000","last_change":"2024-09-17T03:38:00.224092+0000","last_active":"2024-09-17T03:38:00.238722+0000","last_peered":"2024-09-17T03:38:00.238722+0000","last_clean":"2024-09-17T03:38:00.238722+0000","last_became_active":"2024-09-17T03:38:00.223810+0000","last_became_peered":"2024-09-17T03:38:00.223810+0000","last_unstale":"2024-09-17T03:38:00.238722+0000","last_undegraded":"2024-09-17T03:38:00.238722+0000","last_fullsized":"2024-09-17T03:38:00.238722+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:00.166512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.207058+0000","last_change":"2024-09-17T03:37:59.223091+0000","last_active":"2024-09-17T03:38:00.207058+0000","last_peered":"2024-09-17T03:38:00.207058+0000","last_clean":"2024-09-17T03:38:00.207058+0000","last_became_active":"2024-09-17T03:37:59.222793+0000","last_became_peered":"2024-09-17T03:37:59.222793+0000","last_unstale":"2024-09-17T03:38:00.207058+0000","last_undegraded":"2024-09-17T03:38:00.207058+0000","last_fullsized":"2024-09-17T03:38:00.207058+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:29.243810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227538+0000","last_change":"2024-09-17T03:38:00.225975+0000","last_active":"2024-09-17T03:38:01.227538+0000","last_peered":"2024-09-17T03:38:01.227538+0000","last_clean":"2024-09-17T03:38:01.227538+0000","last_became_active":"2024-09-17T03:38:00.225619+0000","last_became_peered":"2024-09-17T03:38:00.225619+0000","last_unstale":"2024-09-17T03:38:01.227538+0000","last_undegraded":"2024-09-17T03:38:01.227538+0000","last_fullsized":"2024-09-17T03:38:01.227538+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:37.825473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.255659+0000","last_change":"2024-09-17T03:37:59.231831+0000","last_active":"2024-09-17T03:38:00.255659+0000","last_peered":"2024-09-17T03:38:00.255659+0000","last_clean":"2024-09-17T03:38:00.255659+0000","last_became_active":"2024-09-17T03:37:59.231070+0000","last_became_peered":"2024-09-17T03:37:59.231070+0000","last_unstale":"2024-09-17T03:38:00.255659+0000","last_undegraded":"2024-09-17T03:38:00.255659+0000","last_fullsized":"2024-09-17T03:38:00.255659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:58.156098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227523+0000","last_change":"2024-09-17T03:38:00.229906+0000","last_active":"2024-09-17T03:38:01.227523+0000","last_peered":"2024-09-17T03:38:01.227523+0000","last_clean":"2024-09-17T03:38:01.227523+0000","last_became_active":"2024-09-17T03:38:00.228075+0000","last_became_peered":"2024-09-17T03:38:00.228075+0000","last_unstale":"2024-09-17T03:38:01.227523+0000","last_undegraded":"2024-09-17T03:38:01.227523+0000","last_fullsized":"2024-09-17T03:38:01.227523+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:57.857766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.217668+0000","last_change":"2024-09-17T03:37:59.222267+0000","last_active":"2024-09-17T03:38:00.217668+0000","last_peered":"2024-09-17T03:38:00.217668+0000","last_clean":"2024-09-17T03:38:00.217668+0000","last_became_active":"2024-09-17T03:37:59.221997+0000","last_became_peered":"2024-09-17T03:37:59.221997+0000","last_unstale":"2024-09-17T03:38:00.217668+0000","last_undegraded":"2024-09-17T03:38:00.217668+0000","last_fullsized":"2024-09-17T03:38:00.217668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:54.599542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237454+0000","last_change":"2024-09-17T03:38:00.233644+0000","last_active":"2024-09-17T03:38:00.237454+0000","last_peered":"2024-09-17T03:38:00.237454+0000","last_clean":"2024-09-17T03:38:00.237454+0000","last_became_active":"2024-09-17T03:38:00.233366+0000","last_became_peered":"2024-09-17T03:38:00.233366+0000","last_unstale":"2024-09-17T03:38:00.237454+0000","last_undegraded":"2024-09-17T03:38:00.237454+0000","last_fullsized":"2024-09-17T03:38:00.237454+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:31.104041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.206057+0000","last_change":"2024-09-17T03:37:59.225808+0000","last_active":"2024-09-17T03:38:00.206057+0000","last_peered":"2024-09-17T03:38:00.206057+0000","last_clean":"2024-09-17T03:38:00.206057+0000","last_became_active":"2024-09-17T03:37:59.224827+0000","last_became_peered":"2024-09-17T03:37:59.224827+0000","last_unstale":"2024-09-17T03:38:00.206057+0000","last_undegraded":"2024-09-17T03:38:00.206057+0000","last_fullsized":"2024-09-17T03:38:00.206057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:59.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.242211+0000","last_change":"2024-09-17T03:38:00.239633+0000","last_active":"2024-09-17T03:38:00.242211+0000","last_peered":"2024-09-17T03:38:00.242211+0000","last_clean":"2024-09-17T03:38:00.242211+0000","last_became_active":"2024-09-17T03:38:00.239339+0000","last_became_peered":"2024-09-17T03:38:00.239339+0000","last_unstale":"2024-09-17T03:38:00.242211+0000","last_undegraded":"2024-09-17T03:38:00.242211+0000","last_fullsized":"2024-09-17T03:38:00.242211+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:10.689168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.206657+0000","last_change":"2024-09-17T03:37:59.228355+0000","last_active":"2024-09-17T03:38:00.206657+0000","last_peered":"2024-09-17T03:38:00.206657+0000","last_clean":"2024-09-17T03:38:00.206657+0000","last_became_active":"2024-09-17T03:37:59.227745+0000","last_became_peered":"2024-09-17T03:37:59.227745+0000","last_unstale":"2024-09-17T03:38:00.206657+0000","last_undegraded":"2024-09-17T03:38:00.206657+0000","last_fullsized":"2024-09-17T03:38:00.206657+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:39.081680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.227835+0000","last_change":"2024-09-17T03:38:00.218376+0000","last_active":"2024-09-17T03:38:00.227835+0000","last_peered":"2024-09-17T03:38:00.227835+0000","last_clean":"2024-09-17T03:38:00.227835+0000","last_became_active":"2024-09-17T03:38:00.218090+0000","last_became_peered":"2024-09-17T03:38:00.218090+0000","last_unstale":"2024-09-17T03:38:00.227835+0000","last_undegraded":"2024-09-17T03:38:00.227835+0000","last_fullsized":"2024-09-17T03:38:00.227835+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.207060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.209138+0000","last_change":"2024-09-17T03:37:59.225322+0000","last_active":"2024-09-17T03:38:00.209138+0000","last_peered":"2024-09-17T03:38:00.209138+0000","last_clean":"2024-09-17T03:38:00.209138+0000","last_became_active":"2024-09-17T03:37:59.225014+0000","last_became_peered":"2024-09-17T03:37:59.225014+0000","last_unstale":"2024-09-17T03:38:00.209138+0000","last_undegraded":"2024-09-17T03:38:00.209138+0000","last_fullsized":"2024-09-17T03:38:00.209138+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:29.271258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.229596+0000","last_change":"2024-09-17T03:38:00.224077+0000","last_active":"2024-09-17T03:38:00.229596+0000","last_peered":"2024-09-17T03:38:00.229596+0000","last_clean":"2024-09-17T03:38:00.229596+0000","last_became_active":"2024-09-17T03:38:00.223711+0000","last_became_peered":"2024-09-17T03:38:00.223711+0000","last_unstale":"2024-09-17T03:38:00.229596+0000","last_undegraded":"2024-09-17T03:38:00.229596+0000","last_fullsized":"2024-09-17T03:38:00.229596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:06.937601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.208160+0000","last_change":"2024-09-17T03:37:59.218409+0000","last_active":"2024-09-17T03:38:00.208160+0000","last_peered":"2024-09-17T03:38:00.208160+0000","last_clean":"2024-09-17T03:38:00.208160+0000","last_became_active":"2024-09-17T03:37:59.217775+0000","last_became_peered":"2024-09-17T03:37:59.217775+0000","last_unstale":"2024-09-17T03:38:00.208160+0000","last_undegraded":"2024-09-17T03:38:00.208160+0000","last_fullsized":"2024-09-17T03:38:00.208160+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:51.310693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.235490+0000","last_change":"2024-09-17T03:38:00.231525+0000","last_active":"2024-09-17T03:38:00.235490+0000","last_peered":"2024-09-17T03:38:00.235490+0000","last_clean":"2024-09-17T03:38:00.235490+0000","last_became_active":"2024-09-17T03:38:00.229191+0000","last_became_peered":"2024-09-17T03:38:00.229191+0000","last_unstale":"2024-09-17T03:38:00.235490+0000","last_undegraded":"2024-09-17T03:38:00.235490+0000","last_fullsized":"2024-09-17T03:38:00.235490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:53.116332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.205503+0000","last_change":"2024-09-17T03:37:59.223643+0000","last_active":"2024-09-17T03:38:00.205503+0000","last_peered":"2024-09-17T03:38:00.205503+0000","last_clean":"2024-09-17T03:38:00.205503+0000","last_became_active":"2024-09-17T03:37:59.223243+0000","last_became_peered":"2024-09-17T03:37:59.223243+0000","last_unstale":"2024-09-17T03:38:00.205503+0000","last_undegraded":"2024-09-17T03:38:00.205503+0000","last_fullsized":"2024-09-17T03:38:00.205503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:05.930614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227794+0000","last_change":"2024-09-17T03:38:00.236019+0000","last_active":"2024-09-17T03:38:01.227794+0000","last_peered":"2024-09-17T03:38:01.227794+0000","last_clean":"2024-09-17T03:38:01.227794+0000","last_became_active":"2024-09-17T03:38:00.235221+0000","last_became_peered":"2024-09-17T03:38:00.235221+0000","last_unstale":"2024-09-17T03:38:01.227794+0000","last_undegraded":"2024-09-17T03:38:01.227794+0000","last_fullsized":"2024-09-17T03:38:01.227794+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:26.517427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.206227+0000","last_change":"2024-09-17T03:37:59.226234+0000","last_active":"2024-09-17T03:38:00.206227+0000","last_peered":"2024-09-17T03:38:00.206227+0000","last_clean":"2024-09-17T03:38:00.206227+0000","last_became_active":"2024-09-17T03:37:59.225924+0000","last_became_peered":"2024-09-17T03:37:59.225924+0000","last_unstale":"2024-09-17T03:38:00.206227+0000","last_undegraded":"2024-09-17T03:38:00.206227+0000","last_fullsized":"2024-09-17T03:38:00.206227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:33.320353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.243290+0000","last_change":"2024-09-17T03:38:00.237982+0000","last_active":"2024-09-17T03:38:00.243290+0000","last_peered":"2024-09-17T03:38:00.243290+0000","last_clean":"2024-09-17T03:38:00.243290+0000","last_became_active":"2024-09-17T03:38:00.237597+0000","last_became_peered":"2024-09-17T03:38:00.237597+0000","last_unstale":"2024-09-17T03:38:00.243290+0000","last_undegraded":"2024-09-17T03:38:00.243290+0000","last_fullsized":"2024-09-17T03:38:00.243290+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:51.062175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.206464+0000","last_change":"2024-09-17T03:37:59.225044+0000","last_active":"2024-09-17T03:38:00.206464+0000","last_peered":"2024-09-17T03:38:00.206464+0000","last_clean":"2024-09-17T03:38:00.206464+0000","last_became_active":"2024-09-17T03:37:59.224600+0000","last_became_peered":"2024-09-17T03:37:59.224600+0000","last_unstale":"2024-09-17T03:38:00.206464+0000","last_undegraded":"2024-09-17T03:38:00.206464+0000","last_fullsized":"2024-09-17T03:38:00.206464+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:11.618402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":187,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.209265+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:38:00.209265+0000","last_peered":"2024-09-17T03:38:00.209265+0000","last_clean":"2024-09-17T03:38:00.209265+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:38:00.209265+0000","last_undegraded":"2024-09-17T03:38:00.209265+0000","last_fullsized":"2024-09-17T03:38:00.209265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":321895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":729088,"data_stored":321895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1323008,"data_stored":912263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":729088,"data_stored":321895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":729088,"data_stored":321895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28324,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343516,"statfs":{"total":96636764160,"available":96607760384,"internally_reserved":0,"allocated":1323008,"data_stored":912263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":329062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":757760,"data_stored":336336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:38:04.639 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:38:04.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.892+0000 7ff29d200640 1 -- 172.21.15.121:0/2750661763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2980af420 msgr2=0x7ff29815e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:04.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.892+0000 7ff29d200640 1 --2- 172.21.15.121:0/2750661763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2980af420 0x7ff29815e7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff290009860 tx=0x7ff29002a5a0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.892+0000 7ff29d200640 1 -- 172.21.15.121:0/2750661763 shutdown_connections 2024-09-17T03:38:04.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.892+0000 7ff29d200640 1 --2- 172.21.15.121:0/2750661763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2980af420 0x7ff29815e7c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.892+0000 7ff29d200640 1 -- 172.21.15.121:0/2750661763 >> 172.21.15.121:0/2750661763 conn(0x7ff2980cca40 msgr2=0x7ff2980cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:04.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.893+0000 7ff29d200640 1 -- 172.21.15.121:0/2750661763 shutdown_connections 2024-09-17T03:38:04.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.893+0000 7ff29d200640 1 -- 172.21.15.121:0/2750661763 wait complete. 2024-09-17T03:38:04.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.895+0000 7ff29d200640 1 Processor -- start 2024-09-17T03:38:04.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.895+0000 7ff29d200640 1 -- start start 2024-09-17T03:38:04.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.896+0000 7ff29d200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2980af420 0x7ff29809eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:04.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.896+0000 7ff29d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2981f8530 0x7ff2980c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:04.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.896+0000 7ff29d200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2980a05d0 0x7ff2980a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:04.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.896+0000 7ff29d200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2980ce8a0 con 0x7ff2980af420 2024-09-17T03:38:04.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.896+0000 7ff29d200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff2980ce720 con 0x7ff2980a05d0 2024-09-17T03:38:04.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.896+0000 7ff29d200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff2980cea20 con 0x7ff2981f8530 2024-09-17T03:38:04.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.897+0000 7ff295e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2980af420 0x7ff29809eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:04.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.897+0000 7ff295e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2980af420 0x7ff29809eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41458/0 (socket says 172.21.15.121:41458) 2024-09-17T03:38:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.897+0000 7ff295e00640 1 -- 172.21.15.121:0/268692962 learned_addr learned my addr 172.21.15.121:0/268692962 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.897+0000 7ff296800640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2980a05d0 0x7ff2980a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.897+0000 7ff28d400640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2981f8530 0x7ff2980c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.897+0000 7ff295e00640 1 -- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2981f8530 msgr2=0x7ff2980c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.897+0000 7ff295e00640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2981f8530 0x7ff2980c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.897+0000 7ff295e00640 1 -- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2980a05d0 msgr2=0x7ff2980a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.897+0000 7ff295e00640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2980a05d0 0x7ff2980a09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.897+0000 7ff295e00640 1 -- 172.21.15.121:0/268692962 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2980c8030 con 0x7ff2980af420 2024-09-17T03:38:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.898+0000 7ff295e00640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2980af420 0x7ff29809eb90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c400 tx=0x7ff28800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.898+0000 7ff28ea00640 1 -- 172.21.15.121:0/268692962 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288017070 con 0x7ff2980af420 2024-09-17T03:38:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.898+0000 7ff28ea00640 1 -- 172.21.15.121:0/268692962 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2880053c0 con 0x7ff2980af420 2024-09-17T03:38:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.898+0000 7ff29d200640 1 -- 172.21.15.121:0/268692962 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2980a0f20 con 0x7ff2980af420 2024-09-17T03:38:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.898+0000 7ff28ea00640 1 -- 172.21.15.121:0/268692962 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288003850 con 0x7ff2980af420 2024-09-17T03:38:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.898+0000 7ff29d200640 1 -- 172.21.15.121:0/268692962 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2981f8fb0 con 0x7ff2980af420 2024-09-17T03:38:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.899+0000 7ff29d200640 1 -- 172.21.15.121:0/268692962 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2980ceeb0 con 0x7ff2980af420 2024-09-17T03:38:04.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.900+0000 7ff28ea00640 1 -- 172.21.15.121:0/268692962 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff28801a070 con 0x7ff2980af420 2024-09-17T03:38:04.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.901+0000 7ff28ea00640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff274078b90 0x7ff27407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:04.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.901+0000 7ff28ea00640 1 -- 172.21.15.121:0/268692962 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7ff28809a330 con 0x7ff2980af420 2024-09-17T03:38:04.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.902+0000 7ff28d400640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff274078b90 0x7ff27407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:04.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.902+0000 7ff28d400640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff274078b90 0x7ff27407b0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff2980bf790 tx=0x7ff280001a30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:04.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:04.906+0000 7ff28ea00640 1 -- 172.21.15.121:0/268692962 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2980a0f20 con 0x7ff2980af420 2024-09-17T03:38:05.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.084+0000 7ff29d200640 1 -- 172.21.15.121:0/268692962 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2980b5f40 con 0x7ff274078b90 2024-09-17T03:38:05.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.089+0000 7ff28ea00640 1 -- 172.21.15.121:0/268692962 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252006 (secure 0 0 0) 0x7ff2980b5f40 con 0x7ff274078b90 2024-09-17T03:38:05.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:05.093 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:38:05.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 -- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff274078b90 msgr2=0x7ff27407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:05.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff274078b90 0x7ff27407b0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff2980bf790 tx=0x7ff280001a30 comp rx=0 tx=0).stop 2024-09-17T03:38:05.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 -- 172.21.15.121:0/268692962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2980af420 msgr2=0x7ff29809eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:05.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2980af420 0x7ff29809eb90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c400 tx=0x7ff28800c8c0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 -- 172.21.15.121:0/268692962 shutdown_connections 2024-09-17T03:38:05.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2980a05d0 0x7ff2980a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2981f8530 0x7ff2980c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff274078b90 0x7ff27407b0a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 --2- 172.21.15.121:0/268692962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2980af420 0x7ff29809eb90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 -- 172.21.15.121:0/268692962 >> 172.21.15.121:0/268692962 conn(0x7ff2980cca40 msgr2=0x7ff2980cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:05.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 -- 172.21.15.121:0/268692962 shutdown_connections 2024-09-17T03:38:05.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.094+0000 7ff29d200640 1 -- 172.21.15.121:0/268692962 wait complete. 2024-09-17T03:38:05.117 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-17T03:38:03.317110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223148,"kb_used_data":6896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751572,"statfs":{"total":773094113280,"available":772865609728,"internally_reserved":0,"allocated":7061504,"data_stored":3777504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.123334"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.232402+0000","last_change":"2024-09-17T03:38:00.222368+0000","last_active":"2024-09-17T03:38:00.232402+0000","last_peered":"2024-09-17T03:38:00.232402+0000","last_clean":"2024-09-17T03:38:00.232402+0000","last_became_active":"2024-09-17T03:38:00.222033+0000","last_became_peered":"2024-09-17T03:38:00.222033+0000","last_unstale":"2024-09-17T03:38:00.232402+0000","last_undegraded":"2024-09-17T03:38:00.232402+0000","last_fullsized":"2024-09-17T03:38:00.232402+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:11.675564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.223272+0000","last_change":"2024-09-17T03:38:00.212973+0000","last_active":"2024-09-17T03:38:00.223272+0000","last_peered":"2024-09-17T03:38:00.223272+0000","last_clean":"2024-09-17T03:38:00.223272+0000","last_became_active":"2024-09-17T03:38:00.212641+0000","last_became_peered":"2024-09-17T03:38:00.212641+0000","last_unstale":"2024-09-17T03:38:00.223272+0000","last_undegraded":"2024-09-17T03:38:00.223272+0000","last_fullsized":"2024-09-17T03:38:00.223272+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:11.670291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.236911+0000","last_change":"2024-09-17T03:38:00.228461+0000","last_active":"2024-09-17T03:38:00.236911+0000","last_peered":"2024-09-17T03:38:00.236911+0000","last_clean":"2024-09-17T03:38:00.236911+0000","last_became_active":"2024-09-17T03:38:00.228017+0000","last_became_peered":"2024-09-17T03:38:00.228017+0000","last_unstale":"2024-09-17T03:38:00.236911+0000","last_undegraded":"2024-09-17T03:38:00.236911+0000","last_fullsized":"2024-09-17T03:38:00.236911+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:04.604156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.248229+0000","last_change":"2024-09-17T03:38:00.245821+0000","last_active":"2024-09-17T03:38:00.248229+0000","last_peered":"2024-09-17T03:38:00.248229+0000","last_clean":"2024-09-17T03:38:00.248229+0000","last_became_active":"2024-09-17T03:38:00.240566+0000","last_became_peered":"2024-09-17T03:38:00.240566+0000","last_unstale":"2024-09-17T03:38:00.248229+0000","last_undegraded":"2024-09-17T03:38:00.248229+0000","last_fullsized":"2024-09-17T03:38:00.248229+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:53.116332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237374+0000","last_change":"2024-09-17T03:38:00.232451+0000","last_active":"2024-09-17T03:38:00.237374+0000","last_peered":"2024-09-17T03:38:00.237374+0000","last_clean":"2024-09-17T03:38:00.237374+0000","last_became_active":"2024-09-17T03:38:00.231615+0000","last_became_peered":"2024-09-17T03:38:00.231615+0000","last_unstale":"2024-09-17T03:38:00.237374+0000","last_undegraded":"2024-09-17T03:38:00.237374+0000","last_fullsized":"2024-09-17T03:38:00.237374+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:14.234838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.228828+0000","last_change":"2024-09-17T03:38:00.222687+0000","last_active":"2024-09-17T03:38:00.228828+0000","last_peered":"2024-09-17T03:38:00.228828+0000","last_clean":"2024-09-17T03:38:00.228828+0000","last_became_active":"2024-09-17T03:38:00.222036+0000","last_became_peered":"2024-09-17T03:38:00.222036+0000","last_unstale":"2024-09-17T03:38:00.228828+0000","last_undegraded":"2024-09-17T03:38:00.228828+0000","last_fullsized":"2024-09-17T03:38:00.228828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:46.469094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237651+0000","last_change":"2024-09-17T03:38:00.233920+0000","last_active":"2024-09-17T03:38:00.237651+0000","last_peered":"2024-09-17T03:38:00.237651+0000","last_clean":"2024-09-17T03:38:00.237651+0000","last_became_active":"2024-09-17T03:38:00.233623+0000","last_became_peered":"2024-09-17T03:38:00.233623+0000","last_unstale":"2024-09-17T03:38:00.237651+0000","last_undegraded":"2024-09-17T03:38:00.237651+0000","last_fullsized":"2024-09-17T03:38:00.237651+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:46.655571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.235591+0000","last_change":"2024-09-17T03:38:00.225425+0000","last_active":"2024-09-17T03:38:00.235591+0000","last_peered":"2024-09-17T03:38:00.235591+0000","last_clean":"2024-09-17T03:38:00.235591+0000","last_became_active":"2024-09-17T03:38:00.225128+0000","last_became_peered":"2024-09-17T03:38:00.225128+0000","last_unstale":"2024-09-17T03:38:00.235591+0000","last_undegraded":"2024-09-17T03:38:00.235591+0000","last_fullsized":"2024-09-17T03:38:00.235591+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:25.634474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.248189+0000","last_change":"2024-09-17T03:38:00.240344+0000","last_active":"2024-09-17T03:38:00.248189+0000","last_peered":"2024-09-17T03:38:00.248189+0000","last_clean":"2024-09-17T03:38:00.248189+0000","last_became_active":"2024-09-17T03:38:00.239676+0000","last_became_peered":"2024-09-17T03:38:00.239676+0000","last_unstale":"2024-09-17T03:38:00.248189+0000","last_undegraded":"2024-09-17T03:38:00.248189+0000","last_fullsized":"2024-09-17T03:38:00.248189+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:01.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.241892+0000","last_change":"2024-09-17T03:38:00.236262+0000","last_active":"2024-09-17T03:38:00.241892+0000","last_peered":"2024-09-17T03:38:00.241892+0000","last_clean":"2024-09-17T03:38:00.241892+0000","last_became_active":"2024-09-17T03:38:00.235774+0000","last_became_peered":"2024-09-17T03:38:00.235774+0000","last_unstale":"2024-09-17T03:38:00.241892+0000","last_undegraded":"2024-09-17T03:38:00.241892+0000","last_fullsized":"2024-09-17T03:38:00.241892+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:41.464877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.245580+0000","last_change":"2024-09-17T03:38:00.230368+0000","last_active":"2024-09-17T03:38:00.245580+0000","last_peered":"2024-09-17T03:38:00.245580+0000","last_clean":"2024-09-17T03:38:00.245580+0000","last_became_active":"2024-09-17T03:38:00.230046+0000","last_became_peered":"2024-09-17T03:38:00.230046+0000","last_unstale":"2024-09-17T03:38:00.245580+0000","last_undegraded":"2024-09-17T03:38:00.245580+0000","last_fullsized":"2024-09-17T03:38:00.245580+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:18.985212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.248244+0000","last_change":"2024-09-17T03:38:00.246041+0000","last_active":"2024-09-17T03:38:00.248244+0000","last_peered":"2024-09-17T03:38:00.248244+0000","last_clean":"2024-09-17T03:38:00.248244+0000","last_became_active":"2024-09-17T03:38:00.245235+0000","last_became_peered":"2024-09-17T03:38:00.245235+0000","last_unstale":"2024-09-17T03:38:00.248244+0000","last_undegraded":"2024-09-17T03:38:00.248244+0000","last_fullsized":"2024-09-17T03:38:00.248244+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:55.567120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.229447+0000","last_change":"2024-09-17T03:38:00.223000+0000","last_active":"2024-09-17T03:38:00.229447+0000","last_peered":"2024-09-17T03:38:00.229447+0000","last_clean":"2024-09-17T03:38:00.229447+0000","last_became_active":"2024-09-17T03:38:00.222691+0000","last_became_peered":"2024-09-17T03:38:00.222691+0000","last_unstale":"2024-09-17T03:38:00.229447+0000","last_undegraded":"2024-09-17T03:38:00.229447+0000","last_fullsized":"2024-09-17T03:38:00.229447+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:59.659038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.234118+0000","last_change":"2024-09-17T03:38:00.228464+0000","last_active":"2024-09-17T03:38:00.234118+0000","last_peered":"2024-09-17T03:38:00.234118+0000","last_clean":"2024-09-17T03:38:00.234118+0000","last_became_active":"2024-09-17T03:38:00.226735+0000","last_became_peered":"2024-09-17T03:38:00.226735+0000","last_unstale":"2024-09-17T03:38:00.234118+0000","last_undegraded":"2024-09-17T03:38:00.234118+0000","last_fullsized":"2024-09-17T03:38:00.234118+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:40.088667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.241095+0000","last_change":"2024-09-17T03:38:00.236151+0000","last_active":"2024-09-17T03:38:00.241095+0000","last_peered":"2024-09-17T03:38:00.241095+0000","last_clean":"2024-09-17T03:38:00.241095+0000","last_became_active":"2024-09-17T03:38:00.235856+0000","last_became_peered":"2024-09-17T03:38:00.235856+0000","last_unstale":"2024-09-17T03:38:00.241095+0000","last_undegraded":"2024-09-17T03:38:00.241095+0000","last_fullsized":"2024-09-17T03:38:00.241095+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:00.260519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.233069+0000","last_change":"2024-09-17T03:38:00.223878+0000","last_active":"2024-09-17T03:38:00.233069+0000","last_peered":"2024-09-17T03:38:00.233069+0000","last_clean":"2024-09-17T03:38:00.233069+0000","last_became_active":"2024-09-17T03:38:00.223418+0000","last_became_peered":"2024-09-17T03:38:00.223418+0000","last_unstale":"2024-09-17T03:38:00.233069+0000","last_undegraded":"2024-09-17T03:38:00.233069+0000","last_fullsized":"2024-09-17T03:38:00.233069+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:26.860912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.228375+0000","last_change":"2024-09-17T03:38:00.228806+0000","last_active":"2024-09-17T03:38:01.228375+0000","last_peered":"2024-09-17T03:38:01.228375+0000","last_clean":"2024-09-17T03:38:01.228375+0000","last_became_active":"2024-09-17T03:38:00.228291+0000","last_became_peered":"2024-09-17T03:38:00.228291+0000","last_unstale":"2024-09-17T03:38:01.228375+0000","last_undegraded":"2024-09-17T03:38:01.228375+0000","last_fullsized":"2024-09-17T03:38:01.228375+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:56.132569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.245951+0000","last_change":"2024-09-17T03:38:00.229886+0000","last_active":"2024-09-17T03:38:00.245951+0000","last_peered":"2024-09-17T03:38:00.245951+0000","last_clean":"2024-09-17T03:38:00.245951+0000","last_became_active":"2024-09-17T03:38:00.229585+0000","last_became_peered":"2024-09-17T03:38:00.229585+0000","last_unstale":"2024-09-17T03:38:00.245951+0000","last_undegraded":"2024-09-17T03:38:00.245951+0000","last_fullsized":"2024-09-17T03:38:00.245951+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:12.625389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.245612+0000","last_change":"2024-09-17T03:38:00.230569+0000","last_active":"2024-09-17T03:38:00.245612+0000","last_peered":"2024-09-17T03:38:00.245612+0000","last_clean":"2024-09-17T03:38:00.245612+0000","last_became_active":"2024-09-17T03:38:00.230288+0000","last_became_peered":"2024-09-17T03:38:00.230288+0000","last_unstale":"2024-09-17T03:38:00.245612+0000","last_undegraded":"2024-09-17T03:38:00.245612+0000","last_fullsized":"2024-09-17T03:38:00.245612+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:11.670291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227536+0000","last_change":"2024-09-17T03:38:00.229925+0000","last_active":"2024-09-17T03:38:01.227536+0000","last_peered":"2024-09-17T03:38:01.227536+0000","last_clean":"2024-09-17T03:38:01.227536+0000","last_became_active":"2024-09-17T03:38:00.229488+0000","last_became_peered":"2024-09-17T03:38:00.229488+0000","last_unstale":"2024-09-17T03:38:01.227536+0000","last_undegraded":"2024-09-17T03:38:01.227536+0000","last_fullsized":"2024-09-17T03:38:01.227536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:18.755935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.240375+0000","last_change":"2024-09-17T03:38:00.234052+0000","last_active":"2024-09-17T03:38:00.240375+0000","last_peered":"2024-09-17T03:38:00.240375+0000","last_clean":"2024-09-17T03:38:00.240375+0000","last_became_active":"2024-09-17T03:38:00.233736+0000","last_became_peered":"2024-09-17T03:38:00.233736+0000","last_unstale":"2024-09-17T03:38:00.240375+0000","last_undegraded":"2024-09-17T03:38:00.240375+0000","last_fullsized":"2024-09-17T03:38:00.240375+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:51.062175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.228794+0000","last_change":"2024-09-17T03:38:00.222352+0000","last_active":"2024-09-17T03:38:00.228794+0000","last_peered":"2024-09-17T03:38:00.228794+0000","last_clean":"2024-09-17T03:38:00.228794+0000","last_became_active":"2024-09-17T03:38:00.221667+0000","last_became_peered":"2024-09-17T03:38:00.221667+0000","last_unstale":"2024-09-17T03:38:00.228794+0000","last_undegraded":"2024-09-17T03:38:00.228794+0000","last_fullsized":"2024-09-17T03:38:00.228794+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:01.098796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.236967+0000","last_change":"2024-09-17T03:38:00.227705+0000","last_active":"2024-09-17T03:38:00.236967+0000","last_peered":"2024-09-17T03:38:00.236967+0000","last_clean":"2024-09-17T03:38:00.236967+0000","last_became_active":"2024-09-17T03:38:00.227353+0000","last_became_peered":"2024-09-17T03:38:00.227353+0000","last_unstale":"2024-09-17T03:38:00.236967+0000","last_undegraded":"2024-09-17T03:38:00.236967+0000","last_fullsized":"2024-09-17T03:38:00.236967+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:00.260519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.235512+0000","last_change":"2024-09-17T03:38:00.220932+0000","last_active":"2024-09-17T03:38:00.235512+0000","last_peered":"2024-09-17T03:38:00.235512+0000","last_clean":"2024-09-17T03:38:00.235512+0000","last_became_active":"2024-09-17T03:38:00.220011+0000","last_became_peered":"2024-09-17T03:38:00.220011+0000","last_unstale":"2024-09-17T03:38:00.235512+0000","last_undegraded":"2024-09-17T03:38:00.235512+0000","last_fullsized":"2024-09-17T03:38:00.235512+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:06.095325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237849+0000","last_change":"2024-09-17T03:38:00.233271+0000","last_active":"2024-09-17T03:38:00.237849+0000","last_peered":"2024-09-17T03:38:00.237849+0000","last_clean":"2024-09-17T03:38:00.237849+0000","last_became_active":"2024-09-17T03:38:00.233012+0000","last_became_peered":"2024-09-17T03:38:00.233012+0000","last_unstale":"2024-09-17T03:38:00.237849+0000","last_undegraded":"2024-09-17T03:38:00.237849+0000","last_fullsized":"2024-09-17T03:38:00.237849+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:00.260519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.241795+0000","last_change":"2024-09-17T03:38:00.235201+0000","last_active":"2024-09-17T03:38:00.241795+0000","last_peered":"2024-09-17T03:38:00.241795+0000","last_clean":"2024-09-17T03:38:00.241795+0000","last_became_active":"2024-09-17T03:38:00.234928+0000","last_became_peered":"2024-09-17T03:38:00.234928+0000","last_unstale":"2024-09-17T03:38:00.241795+0000","last_undegraded":"2024-09-17T03:38:00.241795+0000","last_fullsized":"2024-09-17T03:38:00.241795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:47.712110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.233973+0000","last_change":"2024-09-17T03:38:00.227372+0000","last_active":"2024-09-17T03:38:00.233973+0000","last_peered":"2024-09-17T03:38:00.233973+0000","last_clean":"2024-09-17T03:38:00.233973+0000","last_became_active":"2024-09-17T03:38:00.227079+0000","last_became_peered":"2024-09-17T03:38:00.227079+0000","last_unstale":"2024-09-17T03:38:00.233973+0000","last_undegraded":"2024-09-17T03:38:00.233973+0000","last_fullsized":"2024-09-17T03:38:00.233973+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:00.840555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.230680+0000","last_change":"2024-09-17T03:38:00.223016+0000","last_active":"2024-09-17T03:38:00.230680+0000","last_peered":"2024-09-17T03:38:00.230680+0000","last_clean":"2024-09-17T03:38:00.230680+0000","last_became_active":"2024-09-17T03:38:00.222656+0000","last_became_peered":"2024-09-17T03:38:00.222656+0000","last_unstale":"2024-09-17T03:38:00.230680+0000","last_undegraded":"2024-09-17T03:38:00.230680+0000","last_fullsized":"2024-09-17T03:38:00.230680+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:07.913559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.238775+0000","last_change":"2024-09-17T03:38:00.226869+0000","last_active":"2024-09-17T03:38:00.238775+0000","last_peered":"2024-09-17T03:38:00.238775+0000","last_clean":"2024-09-17T03:38:00.238775+0000","last_became_active":"2024-09-17T03:38:00.226545+0000","last_became_peered":"2024-09-17T03:38:00.226545+0000","last_unstale":"2024-09-17T03:38:00.238775+0000","last_undegraded":"2024-09-17T03:38:00.238775+0000","last_fullsized":"2024-09-17T03:38:00.238775+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:34.327340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.248321+0000","last_change":"2024-09-17T03:38:00.241237+0000","last_active":"2024-09-17T03:38:00.248321+0000","last_peered":"2024-09-17T03:38:00.248321+0000","last_clean":"2024-09-17T03:38:00.248321+0000","last_became_active":"2024-09-17T03:38:00.239848+0000","last_became_peered":"2024-09-17T03:38:00.239848+0000","last_unstale":"2024-09-17T03:38:00.248321+0000","last_undegraded":"2024-09-17T03:38:00.248321+0000","last_fullsized":"2024-09-17T03:38:00.248321+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:46.469094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.236837+0000","last_change":"2024-09-17T03:38:00.220672+0000","last_active":"2024-09-17T03:38:00.236837+0000","last_peered":"2024-09-17T03:38:00.236837+0000","last_clean":"2024-09-17T03:38:00.236837+0000","last_became_active":"2024-09-17T03:38:00.220403+0000","last_became_peered":"2024-09-17T03:38:00.220403+0000","last_unstale":"2024-09-17T03:38:00.236837+0000","last_undegraded":"2024-09-17T03:38:00.236837+0000","last_fullsized":"2024-09-17T03:38:00.236837+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:42.252657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.232473+0000","last_change":"2024-09-17T03:38:00.224820+0000","last_active":"2024-09-17T03:38:00.232473+0000","last_peered":"2024-09-17T03:38:00.232473+0000","last_clean":"2024-09-17T03:38:00.232473+0000","last_became_active":"2024-09-17T03:38:00.224457+0000","last_became_peered":"2024-09-17T03:38:00.224457+0000","last_unstale":"2024-09-17T03:38:00.232473+0000","last_undegraded":"2024-09-17T03:38:00.232473+0000","last_fullsized":"2024-09-17T03:38:00.232473+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:35.977342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.245967+0000","last_change":"2024-09-17T03:38:00.236436+0000","last_active":"2024-09-17T03:38:00.245967+0000","last_peered":"2024-09-17T03:38:00.245967+0000","last_clean":"2024-09-17T03:38:00.245967+0000","last_became_active":"2024-09-17T03:38:00.229713+0000","last_became_peered":"2024-09-17T03:38:00.229713+0000","last_unstale":"2024-09-17T03:38:00.245967+0000","last_undegraded":"2024-09-17T03:38:00.245967+0000","last_fullsized":"2024-09-17T03:38:00.245967+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:47.952606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.239965+0000","last_change":"2024-09-17T03:37:59.218025+0000","last_active":"2024-09-17T03:38:00.239965+0000","last_peered":"2024-09-17T03:38:00.239965+0000","last_clean":"2024-09-17T03:38:00.239965+0000","last_became_active":"2024-09-17T03:37:59.216865+0000","last_became_peered":"2024-09-17T03:37:59.216865+0000","last_unstale":"2024-09-17T03:38:00.239965+0000","last_undegraded":"2024-09-17T03:38:00.239965+0000","last_fullsized":"2024-09-17T03:38:00.239965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:09.111156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237295+0000","last_change":"2024-09-17T03:38:00.232018+0000","last_active":"2024-09-17T03:38:00.237295+0000","last_peered":"2024-09-17T03:38:00.237295+0000","last_clean":"2024-09-17T03:38:00.237295+0000","last_became_active":"2024-09-17T03:38:00.231683+0000","last_became_peered":"2024-09-17T03:38:00.231683+0000","last_unstale":"2024-09-17T03:38:00.237295+0000","last_undegraded":"2024-09-17T03:38:00.237295+0000","last_fullsized":"2024-09-17T03:38:00.237295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:21.983888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.242790+0000","last_change":"2024-09-17T03:37:59.223058+0000","last_active":"2024-09-17T03:38:00.242790+0000","last_peered":"2024-09-17T03:38:00.242790+0000","last_clean":"2024-09-17T03:38:00.242790+0000","last_became_active":"2024-09-17T03:37:59.222526+0000","last_became_peered":"2024-09-17T03:37:59.222526+0000","last_unstale":"2024-09-17T03:38:00.242790+0000","last_undegraded":"2024-09-17T03:38:00.242790+0000","last_fullsized":"2024-09-17T03:38:00.242790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:29.243810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.228155+0000","last_change":"2024-09-17T03:38:00.219316+0000","last_active":"2024-09-17T03:38:00.228155+0000","last_peered":"2024-09-17T03:38:00.228155+0000","last_clean":"2024-09-17T03:38:00.228155+0000","last_became_active":"2024-09-17T03:38:00.219004+0000","last_became_peered":"2024-09-17T03:38:00.219004+0000","last_unstale":"2024-09-17T03:38:00.228155+0000","last_undegraded":"2024-09-17T03:38:00.228155+0000","last_fullsized":"2024-09-17T03:38:00.228155+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:47.952606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237828+0000","last_change":"2024-09-17T03:37:59.220812+0000","last_active":"2024-09-17T03:38:00.237828+0000","last_peered":"2024-09-17T03:38:00.237828+0000","last_clean":"2024-09-17T03:38:00.237828+0000","last_became_active":"2024-09-17T03:37:59.220488+0000","last_became_peered":"2024-09-17T03:37:59.220488+0000","last_unstale":"2024-09-17T03:38:00.237828+0000","last_undegraded":"2024-09-17T03:38:00.237828+0000","last_fullsized":"2024-09-17T03:38:00.237828+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:39.752508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.246004+0000","last_change":"2024-09-17T03:38:00.236810+0000","last_active":"2024-09-17T03:38:00.246004+0000","last_peered":"2024-09-17T03:38:00.246004+0000","last_clean":"2024-09-17T03:38:00.246004+0000","last_became_active":"2024-09-17T03:38:00.232712+0000","last_became_peered":"2024-09-17T03:38:00.232712+0000","last_unstale":"2024-09-17T03:38:00.246004+0000","last_undegraded":"2024-09-17T03:38:00.246004+0000","last_fullsized":"2024-09-17T03:38:00.246004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:08.117563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.247568+0000","last_change":"2024-09-17T03:37:59.224702+0000","last_active":"2024-09-17T03:38:00.247568+0000","last_peered":"2024-09-17T03:38:00.247568+0000","last_clean":"2024-09-17T03:38:00.247568+0000","last_became_active":"2024-09-17T03:37:59.222980+0000","last_became_peered":"2024-09-17T03:37:59.222980+0000","last_unstale":"2024-09-17T03:38:00.247568+0000","last_undegraded":"2024-09-17T03:38:00.247568+0000","last_fullsized":"2024-09-17T03:38:00.247568+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:29.667039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.226108+0000","last_change":"2024-09-17T03:38:00.219079+0000","last_active":"2024-09-17T03:38:01.226108+0000","last_peered":"2024-09-17T03:38:01.226108+0000","last_clean":"2024-09-17T03:38:01.226108+0000","last_became_active":"2024-09-17T03:38:00.218607+0000","last_became_peered":"2024-09-17T03:38:00.218607+0000","last_unstale":"2024-09-17T03:38:01.226108+0000","last_undegraded":"2024-09-17T03:38:01.226108+0000","last_fullsized":"2024-09-17T03:38:01.226108+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:36.115940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227822+0000","last_change":"2024-09-17T03:37:59.222531+0000","last_active":"2024-09-17T03:38:01.227822+0000","last_peered":"2024-09-17T03:38:01.227822+0000","last_clean":"2024-09-17T03:38:01.227822+0000","last_became_active":"2024-09-17T03:37:59.222184+0000","last_became_peered":"2024-09-17T03:37:59.222184+0000","last_unstale":"2024-09-17T03:38:01.227822+0000","last_undegraded":"2024-09-17T03:38:01.227822+0000","last_fullsized":"2024-09-17T03:38:01.227822+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:19.919207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.230726+0000","last_change":"2024-09-17T03:38:00.222000+0000","last_active":"2024-09-17T03:38:00.230726+0000","last_peered":"2024-09-17T03:38:00.230726+0000","last_clean":"2024-09-17T03:38:00.230726+0000","last_became_active":"2024-09-17T03:38:00.219646+0000","last_became_peered":"2024-09-17T03:38:00.219646+0000","last_unstale":"2024-09-17T03:38:00.230726+0000","last_undegraded":"2024-09-17T03:38:00.230726+0000","last_fullsized":"2024-09-17T03:38:00.230726+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:33.457311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.240327+0000","last_change":"2024-09-17T03:37:59.222565+0000","last_active":"2024-09-17T03:38:00.240327+0000","last_peered":"2024-09-17T03:38:00.240327+0000","last_clean":"2024-09-17T03:38:00.240327+0000","last_became_active":"2024-09-17T03:37:59.220288+0000","last_became_peered":"2024-09-17T03:37:59.220288+0000","last_unstale":"2024-09-17T03:38:00.240327+0000","last_undegraded":"2024-09-17T03:38:00.240327+0000","last_fullsized":"2024-09-17T03:38:00.240327+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:17.978225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.231732+0000","last_change":"2024-09-17T03:38:00.229069+0000","last_active":"2024-09-17T03:38:00.231732+0000","last_peered":"2024-09-17T03:38:00.231732+0000","last_clean":"2024-09-17T03:38:00.231732+0000","last_became_active":"2024-09-17T03:38:00.228766+0000","last_became_peered":"2024-09-17T03:38:00.228766+0000","last_unstale":"2024-09-17T03:38:00.231732+0000","last_undegraded":"2024-09-17T03:38:00.231732+0000","last_fullsized":"2024-09-17T03:38:00.231732+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:26.860912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.211024+0000","last_change":"2024-09-17T03:37:59.225707+0000","last_active":"2024-09-17T03:38:00.211024+0000","last_peered":"2024-09-17T03:38:00.211024+0000","last_clean":"2024-09-17T03:38:00.211024+0000","last_became_active":"2024-09-17T03:37:59.224981+0000","last_became_peered":"2024-09-17T03:37:59.224981+0000","last_unstale":"2024-09-17T03:38:00.211024+0000","last_undegraded":"2024-09-17T03:38:00.211024+0000","last_fullsized":"2024-09-17T03:38:00.211024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:37.023804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227663+0000","last_change":"2024-09-17T03:38:00.235652+0000","last_active":"2024-09-17T03:38:01.227663+0000","last_peered":"2024-09-17T03:38:01.227663+0000","last_clean":"2024-09-17T03:38:01.227663+0000","last_became_active":"2024-09-17T03:38:00.234750+0000","last_became_peered":"2024-09-17T03:38:00.234750+0000","last_unstale":"2024-09-17T03:38:01.227663+0000","last_undegraded":"2024-09-17T03:38:01.227663+0000","last_fullsized":"2024-09-17T03:38:01.227663+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:01.619376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.217086+0000","last_change":"2024-09-17T03:37:59.227842+0000","last_active":"2024-09-17T03:38:00.217086+0000","last_peered":"2024-09-17T03:38:00.217086+0000","last_clean":"2024-09-17T03:38:00.217086+0000","last_became_active":"2024-09-17T03:37:59.227543+0000","last_became_peered":"2024-09-17T03:37:59.227543+0000","last_unstale":"2024-09-17T03:38:00.217086+0000","last_undegraded":"2024-09-17T03:38:00.217086+0000","last_fullsized":"2024-09-17T03:38:00.217086+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:29.667039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.230645+0000","last_change":"2024-09-17T03:38:00.220514+0000","last_active":"2024-09-17T03:38:00.230645+0000","last_peered":"2024-09-17T03:38:00.230645+0000","last_clean":"2024-09-17T03:38:00.230645+0000","last_became_active":"2024-09-17T03:38:00.220166+0000","last_became_peered":"2024-09-17T03:38:00.220166+0000","last_unstale":"2024-09-17T03:38:00.230645+0000","last_undegraded":"2024-09-17T03:38:00.230645+0000","last_fullsized":"2024-09-17T03:38:00.230645+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:46.331467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.215834+0000","last_change":"2024-09-17T03:37:59.225758+0000","last_active":"2024-09-17T03:38:00.215834+0000","last_peered":"2024-09-17T03:38:00.215834+0000","last_clean":"2024-09-17T03:38:00.215834+0000","last_became_active":"2024-09-17T03:37:59.225469+0000","last_became_peered":"2024-09-17T03:37:59.225469+0000","last_unstale":"2024-09-17T03:38:00.215834+0000","last_undegraded":"2024-09-17T03:38:00.215834+0000","last_fullsized":"2024-09-17T03:38:00.215834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:41.724280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227419+0000","last_change":"2024-09-17T03:38:00.227573+0000","last_active":"2024-09-17T03:38:01.227419+0000","last_peered":"2024-09-17T03:38:01.227419+0000","last_clean":"2024-09-17T03:38:01.227419+0000","last_became_active":"2024-09-17T03:38:00.226638+0000","last_became_peered":"2024-09-17T03:38:00.226638+0000","last_unstale":"2024-09-17T03:38:01.227419+0000","last_undegraded":"2024-09-17T03:38:01.227419+0000","last_fullsized":"2024-09-17T03:38:01.227419+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:51.494367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.209536+0000","last_change":"2024-09-17T03:37:59.228373+0000","last_active":"2024-09-17T03:38:00.209536+0000","last_peered":"2024-09-17T03:38:00.209536+0000","last_clean":"2024-09-17T03:38:00.209536+0000","last_became_active":"2024-09-17T03:37:59.227824+0000","last_became_peered":"2024-09-17T03:37:59.227824+0000","last_unstale":"2024-09-17T03:38:00.209536+0000","last_undegraded":"2024-09-17T03:38:00.209536+0000","last_fullsized":"2024-09-17T03:38:00.209536+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:05.540291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.227313+0000","last_change":"2024-09-17T03:38:00.221921+0000","last_active":"2024-09-17T03:38:00.227313+0000","last_peered":"2024-09-17T03:38:00.227313+0000","last_clean":"2024-09-17T03:38:00.227313+0000","last_became_active":"2024-09-17T03:38:00.221257+0000","last_became_peered":"2024-09-17T03:38:00.221257+0000","last_unstale":"2024-09-17T03:38:00.227313+0000","last_undegraded":"2024-09-17T03:38:00.227313+0000","last_fullsized":"2024-09-17T03:38:00.227313+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:37.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"62'3","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.248980+0000","last_change":"2024-09-17T03:37:59.224940+0000","last_active":"2024-09-17T03:38:00.248980+0000","last_peered":"2024-09-17T03:38:00.248980+0000","last_clean":"2024-09-17T03:38:00.248980+0000","last_became_active":"2024-09-17T03:37:59.224656+0000","last_became_peered":"2024-09-17T03:37:59.224656+0000","last_unstale":"2024-09-17T03:38:00.248980+0000","last_undegraded":"2024-09-17T03:38:00.248980+0000","last_fullsized":"2024-09-17T03:38:00.248980+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:24.229735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.242180+0000","last_change":"2024-09-17T03:38:00.224427+0000","last_active":"2024-09-17T03:38:00.242180+0000","last_peered":"2024-09-17T03:38:00.242180+0000","last_clean":"2024-09-17T03:38:00.242180+0000","last_became_active":"2024-09-17T03:38:00.221395+0000","last_became_peered":"2024-09-17T03:38:00.221395+0000","last_unstale":"2024-09-17T03:38:00.242180+0000","last_undegraded":"2024-09-17T03:38:00.242180+0000","last_fullsized":"2024-09-17T03:38:00.242180+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:13.030771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.252134+0000","last_change":"2024-09-17T03:37:59.222176+0000","last_active":"2024-09-17T03:38:00.252134+0000","last_peered":"2024-09-17T03:38:00.252134+0000","last_clean":"2024-09-17T03:38:00.252134+0000","last_became_active":"2024-09-17T03:37:59.221875+0000","last_became_peered":"2024-09-17T03:37:59.221875+0000","last_unstale":"2024-09-17T03:38:00.252134+0000","last_undegraded":"2024-09-17T03:38:00.252134+0000","last_fullsized":"2024-09-17T03:38:00.252134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:10.200073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.247585+0000","last_change":"2024-09-17T03:38:00.243917+0000","last_active":"2024-09-17T03:38:00.247585+0000","last_peered":"2024-09-17T03:38:00.247585+0000","last_clean":"2024-09-17T03:38:00.247585+0000","last_became_active":"2024-09-17T03:38:00.242914+0000","last_became_peered":"2024-09-17T03:38:00.242914+0000","last_unstale":"2024-09-17T03:38:00.247585+0000","last_undegraded":"2024-09-17T03:38:00.247585+0000","last_fullsized":"2024-09-17T03:38:00.247585+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:42.731267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.256081+0000","last_change":"2024-09-17T03:37:59.230180+0000","last_active":"2024-09-17T03:38:00.256081+0000","last_peered":"2024-09-17T03:38:00.256081+0000","last_clean":"2024-09-17T03:38:00.256081+0000","last_became_active":"2024-09-17T03:37:59.229412+0000","last_became_peered":"2024-09-17T03:37:59.229412+0000","last_unstale":"2024-09-17T03:38:00.256081+0000","last_undegraded":"2024-09-17T03:38:00.256081+0000","last_fullsized":"2024-09-17T03:38:00.256081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:50.055188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.231787+0000","last_change":"2024-09-17T03:38:00.225679+0000","last_active":"2024-09-17T03:38:00.231787+0000","last_peered":"2024-09-17T03:38:00.231787+0000","last_clean":"2024-09-17T03:38:00.231787+0000","last_became_active":"2024-09-17T03:38:00.225351+0000","last_became_peered":"2024-09-17T03:38:00.225351+0000","last_unstale":"2024-09-17T03:38:00.231787+0000","last_undegraded":"2024-09-17T03:38:00.231787+0000","last_fullsized":"2024-09-17T03:38:00.231787+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:40.088667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.212183+0000","last_change":"2024-09-17T03:37:59.226284+0000","last_active":"2024-09-17T03:38:00.212183+0000","last_peered":"2024-09-17T03:38:00.212183+0000","last_clean":"2024-09-17T03:38:00.212183+0000","last_became_active":"2024-09-17T03:37:59.225946+0000","last_became_peered":"2024-09-17T03:37:59.225946+0000","last_unstale":"2024-09-17T03:38:00.212183+0000","last_undegraded":"2024-09-17T03:38:00.212183+0000","last_fullsized":"2024-09-17T03:38:00.212183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:05.930614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.231705+0000","last_change":"2024-09-17T03:38:00.223956+0000","last_active":"2024-09-17T03:38:00.231705+0000","last_peered":"2024-09-17T03:38:00.231705+0000","last_clean":"2024-09-17T03:38:00.231705+0000","last_became_active":"2024-09-17T03:38:00.223405+0000","last_became_peered":"2024-09-17T03:38:00.223405+0000","last_unstale":"2024-09-17T03:38:00.231705+0000","last_undegraded":"2024-09-17T03:38:00.231705+0000","last_fullsized":"2024-09-17T03:38:00.231705+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:00.840555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.208434+0000","last_change":"2024-09-17T03:37:59.225995+0000","last_active":"2024-09-17T03:38:00.208434+0000","last_peered":"2024-09-17T03:38:00.208434+0000","last_clean":"2024-09-17T03:38:00.208434+0000","last_became_active":"2024-09-17T03:37:59.225539+0000","last_became_peered":"2024-09-17T03:37:59.225539+0000","last_unstale":"2024-09-17T03:38:00.208434+0000","last_undegraded":"2024-09-17T03:38:00.208434+0000","last_fullsized":"2024-09-17T03:38:00.208434+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:17.533294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.232562+0000","last_change":"2024-09-17T03:38:00.225600+0000","last_active":"2024-09-17T03:38:00.232562+0000","last_peered":"2024-09-17T03:38:00.232562+0000","last_clean":"2024-09-17T03:38:00.232562+0000","last_became_active":"2024-09-17T03:38:00.225189+0000","last_became_peered":"2024-09-17T03:38:00.225189+0000","last_unstale":"2024-09-17T03:38:00.232562+0000","last_undegraded":"2024-09-17T03:38:00.232562+0000","last_fullsized":"2024-09-17T03:38:00.232562+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:53.523523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"62'8","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.249737+0000","last_change":"2024-09-17T03:37:59.229080+0000","last_active":"2024-09-17T03:38:00.249737+0000","last_peered":"2024-09-17T03:38:00.249737+0000","last_clean":"2024-09-17T03:38:00.249737+0000","last_became_active":"2024-09-17T03:37:59.226730+0000","last_became_peered":"2024-09-17T03:37:59.226730+0000","last_unstale":"2024-09-17T03:38:00.249737+0000","last_undegraded":"2024-09-17T03:38:00.249737+0000","last_fullsized":"2024-09-17T03:38:00.249737+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:36.034348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.250721+0000","last_change":"2024-09-17T03:38:00.246265+0000","last_active":"2024-09-17T03:38:00.250721+0000","last_peered":"2024-09-17T03:38:00.250721+0000","last_clean":"2024-09-17T03:38:00.250721+0000","last_became_active":"2024-09-17T03:38:00.245943+0000","last_became_peered":"2024-09-17T03:38:00.245943+0000","last_unstale":"2024-09-17T03:38:00.250721+0000","last_undegraded":"2024-09-17T03:38:00.250721+0000","last_fullsized":"2024-09-17T03:38:00.250721+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:13.617924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.255738+0000","last_change":"2024-09-17T03:37:59.224196+0000","last_active":"2024-09-17T03:38:00.255738+0000","last_peered":"2024-09-17T03:38:00.255738+0000","last_clean":"2024-09-17T03:38:00.255738+0000","last_became_active":"2024-09-17T03:37:59.223898+0000","last_became_peered":"2024-09-17T03:37:59.223898+0000","last_unstale":"2024-09-17T03:38:00.255738+0000","last_undegraded":"2024-09-17T03:38:00.255738+0000","last_fullsized":"2024-09-17T03:38:00.255738+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:43.763434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.228237+0000","last_change":"2024-09-17T03:38:00.221221+0000","last_active":"2024-09-17T03:38:00.228237+0000","last_peered":"2024-09-17T03:38:00.228237+0000","last_clean":"2024-09-17T03:38:00.228237+0000","last_became_active":"2024-09-17T03:38:00.220918+0000","last_became_peered":"2024-09-17T03:38:00.220918+0000","last_unstale":"2024-09-17T03:38:00.228237+0000","last_undegraded":"2024-09-17T03:38:00.228237+0000","last_fullsized":"2024-09-17T03:38:00.228237+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:01.320706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.255648+0000","last_change":"2024-09-17T03:37:59.214329+0000","last_active":"2024-09-17T03:38:00.255648+0000","last_peered":"2024-09-17T03:38:00.255648+0000","last_clean":"2024-09-17T03:38:00.255648+0000","last_became_active":"2024-09-17T03:37:59.213877+0000","last_became_peered":"2024-09-17T03:37:59.213877+0000","last_unstale":"2024-09-17T03:38:00.255648+0000","last_undegraded":"2024-09-17T03:38:00.255648+0000","last_fullsized":"2024-09-17T03:38:00.255648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:43.194306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.234820+0000","last_change":"2024-09-17T03:38:00.230752+0000","last_active":"2024-09-17T03:38:00.234820+0000","last_peered":"2024-09-17T03:38:00.234820+0000","last_clean":"2024-09-17T03:38:00.234820+0000","last_became_active":"2024-09-17T03:38:00.230462+0000","last_became_peered":"2024-09-17T03:38:00.230462+0000","last_unstale":"2024-09-17T03:38:00.234820+0000","last_undegraded":"2024-09-17T03:38:00.234820+0000","last_fullsized":"2024-09-17T03:38:00.234820+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:26.860912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.250787+0000","last_change":"2024-09-17T03:37:59.224192+0000","last_active":"2024-09-17T03:38:00.250787+0000","last_peered":"2024-09-17T03:38:00.250787+0000","last_clean":"2024-09-17T03:38:00.250787+0000","last_became_active":"2024-09-17T03:37:59.223827+0000","last_became_peered":"2024-09-17T03:37:59.223827+0000","last_unstale":"2024-09-17T03:38:00.250787+0000","last_undegraded":"2024-09-17T03:38:00.250787+0000","last_fullsized":"2024-09-17T03:38:00.250787+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:50.072135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.247974+0000","last_change":"2024-09-17T03:38:00.241965+0000","last_active":"2024-09-17T03:38:00.247974+0000","last_peered":"2024-09-17T03:38:00.247974+0000","last_clean":"2024-09-17T03:38:00.247974+0000","last_became_active":"2024-09-17T03:38:00.235216+0000","last_became_peered":"2024-09-17T03:38:00.235216+0000","last_unstale":"2024-09-17T03:38:00.247974+0000","last_undegraded":"2024-09-17T03:38:00.247974+0000","last_fullsized":"2024-09-17T03:38:00.247974+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:36.055895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.206329+0000","last_change":"2024-09-17T03:37:59.228513+0000","last_active":"2024-09-17T03:38:00.206329+0000","last_peered":"2024-09-17T03:38:00.206329+0000","last_clean":"2024-09-17T03:38:00.206329+0000","last_became_active":"2024-09-17T03:37:59.228157+0000","last_became_peered":"2024-09-17T03:37:59.228157+0000","last_unstale":"2024-09-17T03:38:00.206329+0000","last_undegraded":"2024-09-17T03:38:00.206329+0000","last_fullsized":"2024-09-17T03:38:00.206329+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:59.833568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.228368+0000","last_change":"2024-09-17T03:38:00.221302+0000","last_active":"2024-09-17T03:38:00.228368+0000","last_peered":"2024-09-17T03:38:00.228368+0000","last_clean":"2024-09-17T03:38:00.228368+0000","last_became_active":"2024-09-17T03:38:00.220972+0000","last_became_peered":"2024-09-17T03:38:00.220972+0000","last_unstale":"2024-09-17T03:38:00.228368+0000","last_undegraded":"2024-09-17T03:38:00.228368+0000","last_fullsized":"2024-09-17T03:38:00.228368+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:08.117563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.243468+0000","last_change":"2024-09-17T03:37:59.229184+0000","last_active":"2024-09-17T03:38:00.243468+0000","last_peered":"2024-09-17T03:38:00.243468+0000","last_clean":"2024-09-17T03:38:00.243468+0000","last_became_active":"2024-09-17T03:37:59.228578+0000","last_became_peered":"2024-09-17T03:37:59.228578+0000","last_unstale":"2024-09-17T03:38:00.243468+0000","last_undegraded":"2024-09-17T03:38:00.243468+0000","last_fullsized":"2024-09-17T03:38:00.243468+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:54.599542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.240200+0000","last_change":"2024-09-17T03:38:00.233850+0000","last_active":"2024-09-17T03:38:00.240200+0000","last_peered":"2024-09-17T03:38:00.240200+0000","last_clean":"2024-09-17T03:38:00.240200+0000","last_became_active":"2024-09-17T03:38:00.233534+0000","last_became_peered":"2024-09-17T03:38:00.233534+0000","last_unstale":"2024-09-17T03:38:00.240200+0000","last_undegraded":"2024-09-17T03:38:00.240200+0000","last_fullsized":"2024-09-17T03:38:00.240200+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:41.464877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.211201+0000","last_change":"2024-09-17T03:37:59.224541+0000","last_active":"2024-09-17T03:38:00.211201+0000","last_peered":"2024-09-17T03:38:00.211201+0000","last_clean":"2024-09-17T03:38:00.211201+0000","last_became_active":"2024-09-17T03:37:59.221105+0000","last_became_peered":"2024-09-17T03:37:59.221105+0000","last_unstale":"2024-09-17T03:38:00.211201+0000","last_undegraded":"2024-09-17T03:38:00.211201+0000","last_fullsized":"2024-09-17T03:38:00.211201+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:58.652051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.238722+0000","last_change":"2024-09-17T03:38:00.224092+0000","last_active":"2024-09-17T03:38:00.238722+0000","last_peered":"2024-09-17T03:38:00.238722+0000","last_clean":"2024-09-17T03:38:00.238722+0000","last_became_active":"2024-09-17T03:38:00.223810+0000","last_became_peered":"2024-09-17T03:38:00.223810+0000","last_unstale":"2024-09-17T03:38:00.238722+0000","last_undegraded":"2024-09-17T03:38:00.238722+0000","last_fullsized":"2024-09-17T03:38:00.238722+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:00.166512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.207058+0000","last_change":"2024-09-17T03:37:59.223091+0000","last_active":"2024-09-17T03:38:00.207058+0000","last_peered":"2024-09-17T03:38:00.207058+0000","last_clean":"2024-09-17T03:38:00.207058+0000","last_became_active":"2024-09-17T03:37:59.222793+0000","last_became_peered":"2024-09-17T03:37:59.222793+0000","last_unstale":"2024-09-17T03:38:00.207058+0000","last_undegraded":"2024-09-17T03:38:00.207058+0000","last_fullsized":"2024-09-17T03:38:00.207058+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:29.243810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227538+0000","last_change":"2024-09-17T03:38:00.225975+0000","last_active":"2024-09-17T03:38:01.227538+0000","last_peered":"2024-09-17T03:38:01.227538+0000","last_clean":"2024-09-17T03:38:01.227538+0000","last_became_active":"2024-09-17T03:38:00.225619+0000","last_became_peered":"2024-09-17T03:38:00.225619+0000","last_unstale":"2024-09-17T03:38:01.227538+0000","last_undegraded":"2024-09-17T03:38:01.227538+0000","last_fullsized":"2024-09-17T03:38:01.227538+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:37.825473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.255659+0000","last_change":"2024-09-17T03:37:59.231831+0000","last_active":"2024-09-17T03:38:00.255659+0000","last_peered":"2024-09-17T03:38:00.255659+0000","last_clean":"2024-09-17T03:38:00.255659+0000","last_became_active":"2024-09-17T03:37:59.231070+0000","last_became_peered":"2024-09-17T03:37:59.231070+0000","last_unstale":"2024-09-17T03:38:00.255659+0000","last_undegraded":"2024-09-17T03:38:00.255659+0000","last_fullsized":"2024-09-17T03:38:00.255659+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:58.156098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227523+0000","last_change":"2024-09-17T03:38:00.229906+0000","last_active":"2024-09-17T03:38:01.227523+0000","last_peered":"2024-09-17T03:38:01.227523+0000","last_clean":"2024-09-17T03:38:01.227523+0000","last_became_active":"2024-09-17T03:38:00.228075+0000","last_became_peered":"2024-09-17T03:38:00.228075+0000","last_unstale":"2024-09-17T03:38:01.227523+0000","last_undegraded":"2024-09-17T03:38:01.227523+0000","last_fullsized":"2024-09-17T03:38:01.227523+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:57.857766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.217668+0000","last_change":"2024-09-17T03:37:59.222267+0000","last_active":"2024-09-17T03:38:00.217668+0000","last_peered":"2024-09-17T03:38:00.217668+0000","last_clean":"2024-09-17T03:38:00.217668+0000","last_became_active":"2024-09-17T03:37:59.221997+0000","last_became_peered":"2024-09-17T03:37:59.221997+0000","last_unstale":"2024-09-17T03:38:00.217668+0000","last_undegraded":"2024-09-17T03:38:00.217668+0000","last_fullsized":"2024-09-17T03:38:00.217668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:54.599542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.237454+0000","last_change":"2024-09-17T03:38:00.233644+0000","last_active":"2024-09-17T03:38:00.237454+0000","last_peered":"2024-09-17T03:38:00.237454+0000","last_clean":"2024-09-17T03:38:00.237454+0000","last_became_active":"2024-09-17T03:38:00.233366+0000","last_became_peered":"2024-09-17T03:38:00.233366+0000","last_unstale":"2024-09-17T03:38:00.237454+0000","last_undegraded":"2024-09-17T03:38:00.237454+0000","last_fullsized":"2024-09-17T03:38:00.237454+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:31.104041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.206057+0000","last_change":"2024-09-17T03:37:59.225808+0000","last_active":"2024-09-17T03:38:00.206057+0000","last_peered":"2024-09-17T03:38:00.206057+0000","last_clean":"2024-09-17T03:38:00.206057+0000","last_became_active":"2024-09-17T03:37:59.224827+0000","last_became_peered":"2024-09-17T03:37:59.224827+0000","last_unstale":"2024-09-17T03:38:00.206057+0000","last_undegraded":"2024-09-17T03:38:00.206057+0000","last_fullsized":"2024-09-17T03:38:00.206057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:59.159525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.242211+0000","last_change":"2024-09-17T03:38:00.239633+0000","last_active":"2024-09-17T03:38:00.242211+0000","last_peered":"2024-09-17T03:38:00.242211+0000","last_clean":"2024-09-17T03:38:00.242211+0000","last_became_active":"2024-09-17T03:38:00.239339+0000","last_became_peered":"2024-09-17T03:38:00.239339+0000","last_unstale":"2024-09-17T03:38:00.242211+0000","last_undegraded":"2024-09-17T03:38:00.242211+0000","last_fullsized":"2024-09-17T03:38:00.242211+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:10.689168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.206657+0000","last_change":"2024-09-17T03:37:59.228355+0000","last_active":"2024-09-17T03:38:00.206657+0000","last_peered":"2024-09-17T03:38:00.206657+0000","last_clean":"2024-09-17T03:38:00.206657+0000","last_became_active":"2024-09-17T03:37:59.227745+0000","last_became_peered":"2024-09-17T03:37:59.227745+0000","last_unstale":"2024-09-17T03:38:00.206657+0000","last_undegraded":"2024-09-17T03:38:00.206657+0000","last_fullsized":"2024-09-17T03:38:00.206657+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:39.081680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.227835+0000","last_change":"2024-09-17T03:38:00.218376+0000","last_active":"2024-09-17T03:38:00.227835+0000","last_peered":"2024-09-17T03:38:00.227835+0000","last_clean":"2024-09-17T03:38:00.227835+0000","last_became_active":"2024-09-17T03:38:00.218090+0000","last_became_peered":"2024-09-17T03:38:00.218090+0000","last_unstale":"2024-09-17T03:38:00.227835+0000","last_undegraded":"2024-09-17T03:38:00.227835+0000","last_fullsized":"2024-09-17T03:38:00.227835+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:11.207060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.209138+0000","last_change":"2024-09-17T03:37:59.225322+0000","last_active":"2024-09-17T03:38:00.209138+0000","last_peered":"2024-09-17T03:38:00.209138+0000","last_clean":"2024-09-17T03:38:00.209138+0000","last_became_active":"2024-09-17T03:37:59.225014+0000","last_became_peered":"2024-09-17T03:37:59.225014+0000","last_unstale":"2024-09-17T03:38:00.209138+0000","last_undegraded":"2024-09-17T03:38:00.209138+0000","last_fullsized":"2024-09-17T03:38:00.209138+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:29.271258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.229596+0000","last_change":"2024-09-17T03:38:00.224077+0000","last_active":"2024-09-17T03:38:00.229596+0000","last_peered":"2024-09-17T03:38:00.229596+0000","last_clean":"2024-09-17T03:38:00.229596+0000","last_became_active":"2024-09-17T03:38:00.223711+0000","last_became_peered":"2024-09-17T03:38:00.223711+0000","last_unstale":"2024-09-17T03:38:00.229596+0000","last_undegraded":"2024-09-17T03:38:00.229596+0000","last_fullsized":"2024-09-17T03:38:00.229596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:06.937601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.208160+0000","last_change":"2024-09-17T03:37:59.218409+0000","last_active":"2024-09-17T03:38:00.208160+0000","last_peered":"2024-09-17T03:38:00.208160+0000","last_clean":"2024-09-17T03:38:00.208160+0000","last_became_active":"2024-09-17T03:37:59.217775+0000","last_became_peered":"2024-09-17T03:37:59.217775+0000","last_unstale":"2024-09-17T03:38:00.208160+0000","last_undegraded":"2024-09-17T03:38:00.208160+0000","last_fullsized":"2024-09-17T03:38:00.208160+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:51.310693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.235490+0000","last_change":"2024-09-17T03:38:00.231525+0000","last_active":"2024-09-17T03:38:00.235490+0000","last_peered":"2024-09-17T03:38:00.235490+0000","last_clean":"2024-09-17T03:38:00.235490+0000","last_became_active":"2024-09-17T03:38:00.229191+0000","last_became_peered":"2024-09-17T03:38:00.229191+0000","last_unstale":"2024-09-17T03:38:00.235490+0000","last_undegraded":"2024-09-17T03:38:00.235490+0000","last_fullsized":"2024-09-17T03:38:00.235490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:53.116332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.205503+0000","last_change":"2024-09-17T03:37:59.223643+0000","last_active":"2024-09-17T03:38:00.205503+0000","last_peered":"2024-09-17T03:38:00.205503+0000","last_clean":"2024-09-17T03:38:00.205503+0000","last_became_active":"2024-09-17T03:37:59.223243+0000","last_became_peered":"2024-09-17T03:37:59.223243+0000","last_unstale":"2024-09-17T03:38:00.205503+0000","last_undegraded":"2024-09-17T03:38:00.205503+0000","last_fullsized":"2024-09-17T03:38:00.205503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:05.930614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T03:38:01.227794+0000","last_change":"2024-09-17T03:38:00.236019+0000","last_active":"2024-09-17T03:38:01.227794+0000","last_peered":"2024-09-17T03:38:01.227794+0000","last_clean":"2024-09-17T03:38:01.227794+0000","last_became_active":"2024-09-17T03:38:00.235221+0000","last_became_peered":"2024-09-17T03:38:00.235221+0000","last_unstale":"2024-09-17T03:38:01.227794+0000","last_undegraded":"2024-09-17T03:38:01.227794+0000","last_fullsized":"2024-09-17T03:38:01.227794+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:26.517427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.206227+0000","last_change":"2024-09-17T03:37:59.226234+0000","last_active":"2024-09-17T03:38:00.206227+0000","last_peered":"2024-09-17T03:38:00.206227+0000","last_clean":"2024-09-17T03:38:00.206227+0000","last_became_active":"2024-09-17T03:37:59.225924+0000","last_became_peered":"2024-09-17T03:37:59.225924+0000","last_unstale":"2024-09-17T03:38:00.206227+0000","last_undegraded":"2024-09-17T03:38:00.206227+0000","last_fullsized":"2024-09-17T03:38:00.206227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:33.320353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.243290+0000","last_change":"2024-09-17T03:38:00.237982+0000","last_active":"2024-09-17T03:38:00.243290+0000","last_peered":"2024-09-17T03:38:00.243290+0000","last_clean":"2024-09-17T03:38:00.243290+0000","last_became_active":"2024-09-17T03:38:00.237597+0000","last_became_peered":"2024-09-17T03:38:00.237597+0000","last_unstale":"2024-09-17T03:38:00.243290+0000","last_undegraded":"2024-09-17T03:38:00.243290+0000","last_fullsized":"2024-09-17T03:38:00.243290+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:59.190533+0000","last_clean_scrub_stamp":"2024-09-17T03:37:59.190533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:51.062175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.206464+0000","last_change":"2024-09-17T03:37:59.225044+0000","last_active":"2024-09-17T03:38:00.206464+0000","last_peered":"2024-09-17T03:38:00.206464+0000","last_clean":"2024-09-17T03:38:00.206464+0000","last_became_active":"2024-09-17T03:37:59.224600+0000","last_became_peered":"2024-09-17T03:37:59.224600+0000","last_unstale":"2024-09-17T03:38:00.206464+0000","last_undegraded":"2024-09-17T03:38:00.206464+0000","last_fullsized":"2024-09-17T03:38:00.206464+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:58.183546+0000","last_clean_scrub_stamp":"2024-09-17T03:37:58.183546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:11.618402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":187,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T03:38:00.209265+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:38:00.209265+0000","last_peered":"2024-09-17T03:38:00.209265+0000","last_clean":"2024-09-17T03:38:00.209265+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:38:00.209265+0000","last_undegraded":"2024-09-17T03:38:00.209265+0000","last_fullsized":"2024-09-17T03:38:00.209265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":321895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":729088,"data_stored":321895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1323008,"data_stored":912263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":729088,"data_stored":321895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":729088,"data_stored":321895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28324,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343516,"statfs":{"total":96636764160,"available":96607760384,"internally_reserved":0,"allocated":1323008,"data_stored":912263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":329062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":757760,"data_stored":336336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:38:05.121 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:38:05.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:38:05.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.385+0000 7f29cda00640 1 -- 172.21.15.121:0/2956981587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29c80cc8d0 msgr2=0x7f29c80ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.385+0000 7f29cda00640 1 --2- 172.21.15.121:0/2956981587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29c80cc8d0 0x7f29c80ccce0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f29c806eb00 tx=0x7f29b402a560 comp rx=0 tx=0).stop 2024-09-17T03:38:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.385+0000 7f29cda00640 1 -- 172.21.15.121:0/2956981587 shutdown_connections 2024-09-17T03:38:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.385+0000 7f29cda00640 1 --2- 172.21.15.121:0/2956981587 >> v2:172.21.15.176:3300/0 conn(0x7f29c80b4990 0x7f29c80b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.385+0000 7f29cda00640 1 --2- 172.21.15.121:0/2956981587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29c80cc8d0 0x7f29c80ccce0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.385+0000 7f29cda00640 1 -- 172.21.15.121:0/2956981587 >> 172.21.15.121:0/2956981587 conn(0x7f29c806f940 msgr2=0x7f29c80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.386+0000 7f29cda00640 1 -- 172.21.15.121:0/2956981587 shutdown_connections 2024-09-17T03:38:05.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.386+0000 7f29cda00640 1 -- 172.21.15.121:0/2956981587 wait complete. 2024-09-17T03:38:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.388+0000 7f29cda00640 1 Processor -- start 2024-09-17T03:38:05.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.388+0000 7f29cda00640 1 -- start start 2024-09-17T03:38:05.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.389+0000 7f29cda00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c80b4990 0x7f29c8141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:05.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.389+0000 7f29cda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c80cc8d0 0x7f29c81f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:05.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.389+0000 7f29cda00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29c815cb20 0x7f29c815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:05.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.389+0000 7f29cda00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f29c806d600 con 0x7f29c815cb20 2024-09-17T03:38:05.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.389+0000 7f29cda00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f29c806d480 con 0x7f29c80b4990 2024-09-17T03:38:05.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.389+0000 7f29cda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f29c806d780 con 0x7f29c80cc8d0 2024-09-17T03:38:05.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29cd000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29c815cb20 0x7f29c815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:05.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29cd000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29c815cb20 0x7f29c815dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41482/0 (socket says 172.21.15.121:41482) 2024-09-17T03:38:05.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29cd000640 1 -- 172.21.15.121:0/3227882052 learned_addr learned my addr 172.21.15.121:0/3227882052 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:05.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29c7400640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c80cc8d0 0x7f29c81f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:05.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29c7e00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c80b4990 0x7f29c8141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:05.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29cd000640 1 -- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c80cc8d0 msgr2=0x7f29c81f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:05.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29cd000640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c80cc8d0 0x7f29c81f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29cd000640 1 -- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c80b4990 msgr2=0x7f29c8141010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:05.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29cd000640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c80b4990 0x7f29c8141010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29cd000640 1 -- 172.21.15.121:0/3227882052 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c81417b0 con 0x7f29c815cb20 2024-09-17T03:38:05.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.390+0000 7f29c7e00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c80b4990 0x7f29c8141010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:05.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.391+0000 7f29cd000640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29c815cb20 0x7f29c815dc90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f29c000caa0 tx=0x7f29c000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:05.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.391+0000 7f29bfe00640 1 -- 172.21.15.121:0/3227882052 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c000adf0 con 0x7f29c815cb20 2024-09-17T03:38:05.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.391+0000 7f29bfe00640 1 -- 172.21.15.121:0/3227882052 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29c000f540 con 0x7f29c815cb20 2024-09-17T03:38:05.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.391+0000 7f29bfe00640 1 -- 172.21.15.121:0/3227882052 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c000f990 con 0x7f29c815cb20 2024-09-17T03:38:05.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.391+0000 7f29cda00640 1 -- 172.21.15.121:0/3227882052 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c8157780 con 0x7f29c815cb20 2024-09-17T03:38:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.391+0000 7f29cda00640 1 -- 172.21.15.121:0/3227882052 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c8157d40 con 0x7f29c815cb20 2024-09-17T03:38:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.392+0000 7f29cda00640 1 -- 172.21.15.121:0/3227882052 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c81574f0 con 0x7f29c815cb20 2024-09-17T03:38:05.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.393+0000 7f29bfe00640 1 -- 172.21.15.121:0/3227882052 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29c000fb30 con 0x7f29c815cb20 2024-09-17T03:38:05.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.394+0000 7f29bfe00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29a8078b90 0x7f29a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:05.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.394+0000 7f29bfe00640 1 -- 172.21.15.121:0/3227882052 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f29c009b890 con 0x7f29c815cb20 2024-09-17T03:38:05.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.395+0000 7f29c7e00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29a8078b90 0x7f29a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:05.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.396+0000 7f29c7e00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29a8078b90 0x7f29a807b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29b8006fd0 tx=0x7f29b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:05.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.399+0000 7f29bfe00640 1 -- 172.21.15.121:0/3227882052 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29c0014030 con 0x7f29c815cb20 2024-09-17T03:38:05.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.651+0000 7f29cda00640 1 -- 172.21.15.121:0/3227882052 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f29c806dca0 con 0x7f29c815cb20 2024-09-17T03:38:05.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.655+0000 7f29bfe00640 1 -- 172.21.15.121:0/3227882052 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f29c000fe20 con 0x7f29c815cb20 2024-09-17T03:38:05.655 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-17T03:38:05.655 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw== 2024-09-17T03:38:05.655 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-17T03:38:05.655 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-17T03:38:05.655 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:38:05.655 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-17T03:38:05.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 -- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29a8078b90 msgr2=0x7f29a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:05.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29a8078b90 0x7f29a807b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29b8006fd0 tx=0x7f29b8008040 comp rx=0 tx=0).stop 2024-09-17T03:38:05.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 -- 172.21.15.121:0/3227882052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29c815cb20 msgr2=0x7f29c815dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:05.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29c815cb20 0x7f29c815dc90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f29c000caa0 tx=0x7f29c000cf60 comp rx=0 tx=0).stop 2024-09-17T03:38:05.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 -- 172.21.15.121:0/3227882052 shutdown_connections 2024-09-17T03:38:05.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29a8078b90 0x7f29a807b0a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29c815cb20 0x7f29c815dc90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29c80cc8d0 0x7f29c81f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 --2- 172.21.15.121:0/3227882052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29c80b4990 0x7f29c8141010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 -- 172.21.15.121:0/3227882052 >> 172.21.15.121:0/3227882052 conn(0x7f29c806f940 msgr2=0x7f29c815f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:05.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 -- 172.21.15.121:0/3227882052 shutdown_connections 2024-09-17T03:38:05.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.657+0000 7f29cda00640 1 -- 172.21.15.121:0/3227882052 wait complete. 2024-09-17T03:38:05.679 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:05.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.899+0000 7f30f7200640 1 -- 172.21.15.121:0/234287673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f80b4a20 msgr2=0x7f30f80b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:05.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.899+0000 7f30f7200640 1 --2- 172.21.15.121:0/234287673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f80b4a20 0x7f30f80b4e30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f30e4005fd0 tx=0x7f30e402a530 comp rx=0 tx=0).stop 2024-09-17T03:38:05.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.899+0000 7f30f7200640 1 -- 172.21.15.121:0/234287673 shutdown_connections 2024-09-17T03:38:05.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.899+0000 7f30f7200640 1 --2- 172.21.15.121:0/234287673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f80cc8d0 0x7f30f80ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.899+0000 7f30f7200640 1 --2- 172.21.15.121:0/234287673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f80b4a20 0x7f30f80b4e30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.899+0000 7f30f7200640 1 -- 172.21.15.121:0/234287673 >> 172.21.15.121:0/234287673 conn(0x7f30f806f940 msgr2=0x7f30f80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:05.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.899+0000 7f30f7200640 1 -- 172.21.15.121:0/234287673 shutdown_connections 2024-09-17T03:38:05.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.899+0000 7f30f7200640 1 -- 172.21.15.121:0/234287673 wait complete. 2024-09-17T03:38:05.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.901+0000 7f30f7200640 1 Processor -- start 2024-09-17T03:38:05.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.901+0000 7f30f7200640 1 -- start start 2024-09-17T03:38:05.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f7200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f80b4a20 0x7f30f81e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:05.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f7200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f80cc8d0 0x7f30f814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f7200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f815cb20 0x7f30f814f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f7200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f30f806d6c0 con 0x7f30f815cb20 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f7200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f30f806d540 con 0x7f30f80b4a20 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f7200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f30f806d840 con 0x7f30f80cc8d0 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f815cb20 0x7f30f814f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f815cb20 0x7f30f814f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41496/0 (socket says 172.21.15.121:41496) 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f6800640 1 -- 172.21.15.121:0/284066867 learned_addr learned my addr 172.21.15.121:0/284066867 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f5400640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f80cc8d0 0x7f30f814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f5e00640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f80b4a20 0x7f30f81e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f6800640 1 -- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f80cc8d0 msgr2=0x7f30f814e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:05.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f6800640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f80cc8d0 0x7f30f814e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f6800640 1 -- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f80b4a20 msgr2=0x7f30f81e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:05.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f6800640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f80b4a20 0x7f30f81e5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:05.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.903+0000 7f30f6800640 1 -- 172.21.15.121:0/284066867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f814ef10 con 0x7f30f815cb20 2024-09-17T03:38:05.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.904+0000 7f30f6800640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f815cb20 0x7f30f814f6c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f30f000d660 tx=0x7f30f000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:05.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.904+0000 7f30ee000640 1 -- 172.21.15.121:0/284066867 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0017070 con 0x7f30f815cb20 2024-09-17T03:38:05.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.904+0000 7f30ee000640 1 -- 172.21.15.121:0/284066867 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30f0005310 con 0x7f30f815cb20 2024-09-17T03:38:05.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.904+0000 7f30ee000640 1 -- 172.21.15.121:0/284066867 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0009820 con 0x7f30f815cb20 2024-09-17T03:38:05.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.904+0000 7f30f7200640 1 -- 172.21.15.121:0/284066867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f81f7420 con 0x7f30f815cb20 2024-09-17T03:38:05.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.904+0000 7f30f7200640 1 -- 172.21.15.121:0/284066867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f81f79e0 con 0x7f30f815cb20 2024-09-17T03:38:05.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.905+0000 7f30f7200640 1 -- 172.21.15.121:0/284066867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f814f0e0 con 0x7f30f815cb20 2024-09-17T03:38:05.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.906+0000 7f30ee000640 1 -- 172.21.15.121:0/284066867 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30f00099c0 con 0x7f30f815cb20 2024-09-17T03:38:05.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.908+0000 7f30ee000640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30d8078bc0 0x7f30d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:05.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.908+0000 7f30ee000640 1 -- 172.21.15.121:0/284066867 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f30f009af00 con 0x7f30f815cb20 2024-09-17T03:38:05.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.908+0000 7f30f5e00640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30d8078bc0 0x7f30d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:05.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.909+0000 7f30f5e00640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30d8078bc0 0x7f30d807b0d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f30e800b450 tx=0x7f30e800d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:05.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:05.913+0000 7f30ee000640 1 -- 172.21.15.121:0/284066867 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30f0062ac0 con 0x7f30f815cb20 2024-09-17T03:38:06.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.130+0000 7f30f7200640 1 -- 172.21.15.121:0/284066867 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30f80b4e30 con 0x7f30f815cb20 2024-09-17T03:38:06.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.131+0000 7f30ee000640 1 -- 172.21.15.121:0/284066867 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5236 (secure 0 0 0) 0x7f30f00674f0 con 0x7f30f815cb20 2024-09-17T03:38:06.131 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:06.131 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":37,"btime":"2024-09-17T03:38:03:224733+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1006042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1006042508},{"type":"v1","addr":"172.21.15.176:6836","nonce":1006042508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3672630729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3672630729},{"type":"v1","addr":"172.21.15.176:6837","nonce":3672630729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/4058545170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4058545170},{"type":"v1","addr":"172.21.15.121:6835","nonce":4058545170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:59.696137+0000","modified":"2024-09-17T03:38:02.710560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5712":{"gid":5712,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6833/3893444987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3893444987},{"type":"v1","addr":"172.21.15.121:6833","nonce":3893444987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5712,"qdb_cluster":[5712]},"id":4}]} 2024-09-17T03:38:06.131 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 37 2024-09-17T03:38:06.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 -- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30d8078bc0 msgr2=0x7f30d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30d8078bc0 0x7f30d807b0d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f30e800b450 tx=0x7f30e800d040 comp rx=0 tx=0).stop 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 -- 172.21.15.121:0/284066867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f815cb20 msgr2=0x7f30f814f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f815cb20 0x7f30f814f6c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f30f000d660 tx=0x7f30f000db20 comp rx=0 tx=0).stop 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 -- 172.21.15.121:0/284066867 shutdown_connections 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f30d8078bc0 0x7f30d807b0d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30f815cb20 0x7f30f814f6c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f80cc8d0 0x7f30f814e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 --2- 172.21.15.121:0/284066867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f80b4a20 0x7f30f81e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 -- 172.21.15.121:0/284066867 >> 172.21.15.121:0/284066867 conn(0x7f30f806f940 msgr2=0x7f30f80cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 -- 172.21.15.121:0/284066867 shutdown_connections 2024-09-17T03:38:06.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.134+0000 7f30f7200640 1 -- 172.21.15.121:0/284066867 wait complete. 2024-09-17T03:38:06.189 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-17T03:38:06.189+0000 7f0c19800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:38:06.558 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:37:59.696137+0000', 'modified': '2024-09-17T03:38:02.710560+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5712}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5712': {'gid': 5712, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6833/3893444987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 3893444987}, {'type': 'v1', 'addr': '172.21.15.121:6833', 'nonce': 3893444987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5712, 'qdb_cluster': [5712]} 2024-09-17T03:38:06.558 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:38:06.558 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:38:06.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.779+0000 7f73c6a00640 1 -- 172.21.15.121:0/1640847098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0156a50 msgr2=0x7f73c0074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.779+0000 7f73c6a00640 1 --2- 172.21.15.121:0/1640847098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0156a50 0x7f73c0074620 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f73c0074160 tx=0x7f73b002a560 comp rx=0 tx=0).stop 2024-09-17T03:38:06.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.779+0000 7f73c6a00640 1 -- 172.21.15.121:0/1640847098 shutdown_connections 2024-09-17T03:38:06.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.779+0000 7f73c6a00640 1 --2- 172.21.15.121:0/1640847098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73c006e330 0x7f73c00cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.779+0000 7f73c6a00640 1 --2- 172.21.15.121:0/1640847098 >> v2:172.21.15.176:3300/0 conn(0x7f73c0074b60 0x7f73c006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.779+0000 7f73c6a00640 1 --2- 172.21.15.121:0/1640847098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0156a50 0x7f73c0074620 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.779+0000 7f73c6a00640 1 -- 172.21.15.121:0/1640847098 >> 172.21.15.121:0/1640847098 conn(0x7f73c00b1b90 msgr2=0x7f73c00b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:06.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.779+0000 7f73c6a00640 1 -- 172.21.15.121:0/1640847098 shutdown_connections 2024-09-17T03:38:06.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.779+0000 7f73c6a00640 1 -- 172.21.15.121:0/1640847098 wait complete. 2024-09-17T03:38:06.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.782+0000 7f73c6a00640 1 Processor -- start 2024-09-17T03:38:06.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.782+0000 7f73c6a00640 1 -- start start 2024-09-17T03:38:06.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.783+0000 7f73c6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73c006e330 0x7f73c00b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.783+0000 7f73c6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0074b60 0x7f73c00a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.783+0000 7f73c6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73c0156a50 0x7f73c00cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.783+0000 7f73c6a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f73c00ce330 con 0x7f73c0074b60 2024-09-17T03:38:06.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.783+0000 7f73c6a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f73c00ce1b0 con 0x7f73c0156a50 2024-09-17T03:38:06.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.783+0000 7f73c6a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f73c00ce4b0 con 0x7f73c006e330 2024-09-17T03:38:06.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.783+0000 7f73bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0074b60 0x7f73c00a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.783+0000 7f73bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0074b60 0x7f73c00a0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41518/0 (socket says 172.21.15.121:41518) 2024-09-17T03:38:06.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.783+0000 7f73bf400640 1 -- 172.21.15.121:0/1911817290 learned_addr learned my addr 172.21.15.121:0/1911817290 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73c4a00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73c0156a50 0x7f73c00cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73bfe00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73c006e330 0x7f73c00b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73bf400640 1 -- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73c006e330 msgr2=0x7f73c00b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73bf400640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73c006e330 0x7f73c00b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73bf400640 1 -- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73c0156a50 msgr2=0x7f73c00cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73bf400640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73c0156a50 0x7f73c00cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73bf400640 1 -- 172.21.15.121:0/1911817290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c0159800 con 0x7f73c0074b60 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73c4a00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73c0156a50 0x7f73c00cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73bfe00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73c006e330 0x7f73c00b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73bf400640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0074b60 0x7f73c00a0030 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00d6a0 tx=0x7f73ac00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:06.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73b7e00640 1 -- 172.21.15.121:0/1911817290 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac017070 con 0x7f73c0074b60 2024-09-17T03:38:06.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73b7e00640 1 -- 172.21.15.121:0/1911817290 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73ac004310 con 0x7f73c0074b60 2024-09-17T03:38:06.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73c6a00640 1 -- 172.21.15.121:0/1911817290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c01571e0 con 0x7f73c0074b60 2024-09-17T03:38:06.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.784+0000 7f73b7e00640 1 -- 172.21.15.121:0/1911817290 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac009a80 con 0x7f73c0074b60 2024-09-17T03:38:06.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.785+0000 7f73c6a00640 1 -- 172.21.15.121:0/1911817290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c01577a0 con 0x7f73c0074b60 2024-09-17T03:38:06.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.788+0000 7f73b7e00640 1 -- 172.21.15.121:0/1911817290 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73ac009c20 con 0x7f73c0074b60 2024-09-17T03:38:06.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.789+0000 7f73b7e00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f73a0078b90 0x7f73a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.789+0000 7f73b7e00640 1 -- 172.21.15.121:0/1911817290 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f73ac09af70 con 0x7f73c0074b60 2024-09-17T03:38:06.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.789+0000 7f73cdc06740 1 Processor -- start 2024-09-17T03:38:06.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.789+0000 7f73cdc06740 1 -- start start 2024-09-17T03:38:06.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.789+0000 7f73bfe00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f73a0078b90 0x7f73a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.790+0000 7f73bfe00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f73a0078b90 0x7f73a007b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f73b0033000 tx=0x7f73b0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:06.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 0x561d56b7b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b7beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d5678a590 0x561d56b4bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73cdc06740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561d56ad5430 con 0x561d567823b0 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73cdc06740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561d56ac55d0 con 0x561d567ab270 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73cdc06740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x561d56ab4a00 con 0x561d5678a590 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b7beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b7beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41526/0 (socket says 172.21.15.121:41526) 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73bf400640 1 -- 172.21.15.121:0/929971868 learned_addr learned my addr 172.21.15.121:0/929971868 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73c4a00640 1 --2- 172.21.15.121:0/929971868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d5678a590 0x561d56b4bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73bfe00640 1 --2- 172.21.15.121:0/929971868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 0x561d56b7b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73bf400640 1 -- 172.21.15.121:0/929971868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d5678a590 msgr2=0x561d56b4bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73bf400640 1 --2- 172.21.15.121:0/929971868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d5678a590 0x561d56b4bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73bf400640 1 -- 172.21.15.121:0/929971868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 msgr2=0x561d56b7b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73bf400640 1 --2- 172.21.15.121:0/929971868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 0x561d56b7b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73bf400640 1 -- 172.21.15.121:0/929971868 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d56a7d520 con 0x561d567823b0 2024-09-17T03:38:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.791+0000 7f73c4a00640 1 --2- 172.21.15.121:0/929971868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d5678a590 0x561d56b4bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:06.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.792+0000 7f73bf400640 1 --2- 172.21.15.121:0/929971868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b7beb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f73ac062aa0 tx=0x7f73ac062280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd400005149a776 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.792+0000 7f73abe00640 1 -- 172.21.15.121:0/929971868 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac020040 con 0x561d567823b0 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.792+0000 7f73abe00640 1 -- 172.21.15.121:0/929971868 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73ac065e50 con 0x561d567823b0 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.792+0000 7f73abe00640 1 -- 172.21.15.121:0/929971868 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac061fd0 con 0x561d567823b0 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.793+0000 7f73cdc06740 1 -- 172.21.15.121:0/929971868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 msgr2=0x561d56b7beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.793+0000 7f73cdc06740 1 --2- 172.21.15.121:0/929971868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b7beb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f73ac062aa0 tx=0x7f73ac062280 comp rx=0 tx=0).stop 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.793+0000 7f73cdc06740 1 -- 172.21.15.121:0/929971868 shutdown_connections 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.793+0000 7f73cdc06740 1 --2- 172.21.15.121:0/929971868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d5678a590 0x561d56b4bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.793+0000 7f73cdc06740 1 --2- 172.21.15.121:0/929971868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b7beb0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.793+0000 7f73cdc06740 1 --2- 172.21.15.121:0/929971868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 0x561d56b7b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.793+0000 7f73cdc06740 1 -- 172.21.15.121:0/929971868 >> 172.21.15.121:0/929971868 conn(0x561d5679f3c0 msgr2=0x561d56b51970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.793+0000 7f73cdc06740 1 -- 172.21.15.121:0/929971868 shutdown_connections 2024-09-17T03:38:06.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.793+0000 7f73cdc06740 1 -- 172.21.15.121:0/929971868 wait complete. 2024-09-17T03:38:06.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.794+0000 7f73cdc06740 1 -- start start 2024-09-17T03:38:06.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.794+0000 7f73cdc06740 1 Processor -- start 2024-09-17T03:38:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.795+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567823b0 0x561d56b90590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.795+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d5678a590 0x561d56b98de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.795+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 0x561d56b71d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.795+0000 7f73cdc06740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561d56a5b330 con 0x561d5678a590 2024-09-17T03:38:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.795+0000 7f73cdc06740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561d56ab8810 con 0x561d567ab270 2024-09-17T03:38:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.795+0000 7f73cdc06740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x561d56825620 con 0x561d567823b0 2024-09-17T03:38:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73cdc06740 10 client.0 _ll_register_callbacks cb 0x561d56a60420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:38:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d5678a590 0x561d56b98de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d5678a590 0x561d56b98de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41530/0 (socket says 172.21.15.121:41530) 2024-09-17T03:38:06.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73bf400640 1 -- 172.21.15.121:0/2697290655 learned_addr learned my addr 172.21.15.121:0/2697290655 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73c4a00640 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 0x561d56b71d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73bfe00640 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567823b0 0x561d56b90590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73bf400640 1 -- 172.21.15.121:0/2697290655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567823b0 msgr2=0x561d56b90590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73bf400640 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567823b0 0x561d56b90590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73bf400640 1 -- 172.21.15.121:0/2697290655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 msgr2=0x561d56b71d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73bf400640 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 0x561d56b71d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73bf400640 1 -- 172.21.15.121:0/2697290655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d56816850 con 0x561d5678a590 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73c4a00640 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 0x561d56b71d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73bf400640 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d5678a590 0x561d56b98de0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f73ac062aa0 tx=0x7f73ac062000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28047b8ddc85cbbf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.796+0000 7f73a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73a8c00640 1 -- 172.21.15.121:0/2697290655 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac020070 con 0x561d5678a590 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73a8c00640 1 -- 172.21.15.121:0/2697290655 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f73ac05e670 con 0x561d5678a590 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73cdc06740 1 -- 172.21.15.121:0/2697290655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73ac065e50 con 0x561d5678a590 2024-09-17T03:38:06.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73a8c00640 1 -- 172.21.15.121:0/2697290655 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f73ac0675f0 con 0x561d5678a590 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73cdc06740 10 client.5832 fetch_fsmap learned FSMap version 37 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73cdc06740 1 -- 172.21.15.121:0/2697290655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x561d5688d6b0 con 0x561d5678a590 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73a8c00640 1 -- 172.21.15.121:0/2697290655 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73ac065e50 con 0x561d5678a590 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73a8c00640 1 -- 172.21.15.121:0/2697290655 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 37) ==== 3502+0+0 (secure 0 0 0) 0x7f73ac0617e0 con 0x561d5678a590 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73cdc06740 10 client.5832 fetch_fsmap finished waiting for FSMap version 37 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73cdc06740 10 client.5832 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73cdc06740 20 client.5832 populate_metadata read hostname 'smithi121' 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x561d56769e40 0x561d56bb30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73cdc06740 4 client.5832 mds_command: new command op to 5712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.797+0000 7f73cdc06740 1 -- 172.21.15.121:0/2697290655 --> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d56ac7520 con 0x561d56769e40 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.798+0000 7f73bfe00640 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x561d56769e40 0x561d56bb30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.798+0000 7f73bfe00640 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x561d56769e40 0x561d56bb30d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b9783c64262ea server_cookie=3b365c1d6eda7910 in_seq=0 out_seq=0 2024-09-17T03:38:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.798+0000 7f73a8c00640 10 client.5832 ms_handle_connect on v2:172.21.15.121:6832/3893444987 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73a8c00640 1 -- 172.21.15.121:0/2697290655 <== mds.0 v2:172.21.15.121:6832/3893444987 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561d56ac7520 con 0x561d56769e40 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73a8c00640 10 client.5832 handle_command_reply: tid=0 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73cdc06740 1 client.5832 shutdown 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73cdc06740 1 -- 172.21.15.121:0/2697290655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d5678a590 msgr2=0x561d56b98de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d5678a590 0x561d56b98de0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f73ac062aa0 tx=0x7f73ac062000 comp rx=0 tx=0).stop 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73cdc06740 1 -- 172.21.15.121:0/2697290655 shutdown_connections 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x561d56769e40 0x561d56bb30d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d567ab270 0x561d56b71d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d5678a590 0x561d56b98de0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2697290655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567823b0 0x561d56b90590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73cdc06740 1 -- 172.21.15.121:0/2697290655 >> 172.21.15.121:0/2697290655 conn(0x561d5679f3c0 msgr2=0x561d56b8cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.799+0000 7f73a8c00640 0 client.5832 ms_handle_reset on v2:172.21.15.121:6832/3893444987 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.800+0000 7f73cdc06740 1 -- 172.21.15.121:0/2697290655 shutdown_connections 2024-09-17T03:38:06.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.800+0000 7f73cdc06740 1 -- 172.21.15.121:0/2697290655 wait complete. 2024-09-17T03:38:06.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.800+0000 7f73cdc06740 20 client.5832 trim_cache size 0 max 16384 2024-09-17T03:38:06.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.819+0000 7f73cdc06740 1 Processor -- start 2024-09-17T03:38:06.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.819+0000 7f73cdc06740 1 -- start start 2024-09-17T03:38:06.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.820+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b4ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.820+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d5678a590 0x561d56b4b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.820+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567ab270 0x561d56b92d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.820+0000 7f73cdc06740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0201730 con 0x561d567823b0 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.820+0000 7f73cdc06740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f73c01f9f70 con 0x561d5678a590 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.820+0000 7f73cdc06740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f73c009f970 con 0x561d567ab270 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.820+0000 7f73bfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b4ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.820+0000 7f73bfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b4ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41538/0 (socket says 172.21.15.121:41538) 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.820+0000 7f73bfe00640 1 -- 172.21.15.121:0/4083592231 learned_addr learned my addr 172.21.15.121:0/4083592231 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.821+0000 7f73bfe00640 1 -- 172.21.15.121:0/4083592231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567ab270 msgr2=0x561d56b92d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.821+0000 7f73bfe00640 1 --2- 172.21.15.121:0/4083592231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567ab270 0x561d56b92d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.821+0000 7f73bfe00640 1 -- 172.21.15.121:0/4083592231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d5678a590 msgr2=0x561d56b4b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.821+0000 7f73bfe00640 1 --2- 172.21.15.121:0/4083592231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d5678a590 0x561d56b4b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.821+0000 7f73bfe00640 1 -- 172.21.15.121:0/4083592231 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d56b468d0 con 0x561d567823b0 2024-09-17T03:38:06.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.821+0000 7f73bfe00640 1 --2- 172.21.15.121:0/4083592231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b4ac60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f73b00099c0 tx=0x7f73b003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef85ff9ace91e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:06.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.821+0000 7f73ab400640 1 -- 172.21.15.121:0/4083592231 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0035050 con 0x561d567823b0 2024-09-17T03:38:06.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.821+0000 7f73ab400640 1 -- 172.21.15.121:0/4083592231 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73b0003e30 con 0x561d567823b0 2024-09-17T03:38:06.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.821+0000 7f73ab400640 1 -- 172.21.15.121:0/4083592231 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b00049e0 con 0x561d567823b0 2024-09-17T03:38:06.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.822+0000 7f73cdc06740 1 -- 172.21.15.121:0/4083592231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 msgr2=0x561d56b4ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.822+0000 7f73cdc06740 1 --2- 172.21.15.121:0/4083592231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b4ac60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f73b00099c0 tx=0x7f73b003b000 comp rx=0 tx=0).stop 2024-09-17T03:38:06.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.822+0000 7f73cdc06740 1 -- 172.21.15.121:0/4083592231 shutdown_connections 2024-09-17T03:38:06.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.822+0000 7f73cdc06740 1 --2- 172.21.15.121:0/4083592231 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567ab270 0x561d56b92d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.822+0000 7f73cdc06740 1 --2- 172.21.15.121:0/4083592231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d5678a590 0x561d56b4b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.822+0000 7f73cdc06740 1 --2- 172.21.15.121:0/4083592231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56b4ac60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.822+0000 7f73cdc06740 1 -- 172.21.15.121:0/4083592231 >> 172.21.15.121:0/4083592231 conn(0x561d5679f3c0 msgr2=0x561d56b4df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:06.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.822+0000 7f73cdc06740 1 -- 172.21.15.121:0/4083592231 shutdown_connections 2024-09-17T03:38:06.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.822+0000 7f73cdc06740 1 -- 172.21.15.121:0/4083592231 wait complete. 2024-09-17T03:38:06.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.823+0000 7f73cdc06740 1 -- start start 2024-09-17T03:38:06.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.823+0000 7f73cdc06740 1 Processor -- start 2024-09-17T03:38:06.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56c0b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d5678a590 0x561d56b517f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73cdc06740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567ab270 0x561d56b51d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73cdc06740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561d56b759f0 con 0x561d567823b0 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73cdc06740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561d56a5b330 con 0x561d5678a590 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73cdc06740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x561d56b8eb70 con 0x561d567ab270 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73cdc06740 10 client.0 _ll_register_callbacks cb 0x7f73ac0628e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73bfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56c0b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73bfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56c0b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41554/0 (socket says 172.21.15.121:41554) 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73bfe00640 1 -- 172.21.15.121:0/2900446583 learned_addr learned my addr 172.21.15.121:0/2900446583 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73bf400640 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d5678a590 0x561d56b517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73c4a00640 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567ab270 0x561d56b51d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73bfe00640 1 -- 172.21.15.121:0/2900446583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567ab270 msgr2=0x561d56b51d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73bfe00640 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567ab270 0x561d56b51d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73bfe00640 1 -- 172.21.15.121:0/2900446583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d5678a590 msgr2=0x561d56b517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.825+0000 7f73bfe00640 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d5678a590 0x561d56b517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.826+0000 7f73bfe00640 1 -- 172.21.15.121:0/2900446583 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d56b52650 con 0x561d567823b0 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.826+0000 7f73bfe00640 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56c0b900 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f73b0052040 tx=0x7f73b0005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ee2598c017a384 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.826+0000 7f73a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.826+0000 7f73a8c00640 1 -- 172.21.15.121:0/2900446583 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0035050 con 0x561d567823b0 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.826+0000 7f73a8c00640 1 -- 172.21.15.121:0/2900446583 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f73b00049a0 con 0x561d567823b0 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.826+0000 7f73cdc06740 1 -- 172.21.15.121:0/2900446583 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b0003e30 con 0x561d567823b0 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.826+0000 7f73a8c00640 1 -- 172.21.15.121:0/2900446583 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f73b0004ba0 con 0x561d567823b0 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.826+0000 7f73cdc06740 10 client.5838 fetch_fsmap learned FSMap version 37 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.826+0000 7f73cdc06740 1 -- 172.21.15.121:0/2900446583 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x561d56b95650 con 0x561d567823b0 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73a8c00640 1 -- 172.21.15.121:0/2900446583 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73b0003e30 con 0x561d567823b0 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73a8c00640 1 -- 172.21.15.121:0/2900446583 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 37) ==== 3502+0+0 (secure 0 0 0) 0x7f73b0004e30 con 0x561d567823b0 2024-09-17T03:38:06.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73cdc06740 10 client.5838 fetch_fsmap finished waiting for FSMap version 37 2024-09-17T03:38:06.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73cdc06740 10 client.5838 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:38:06.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73cdc06740 20 client.5838 populate_metadata read hostname 'smithi121' 2024-09-17T03:38:06.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x561d56c154e0 0x561d56c158f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73cdc06740 4 client.5838 mds_command: new command op to 5712 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:38:06.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73cdc06740 1 -- 172.21.15.121:0/2900446583 --> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] -- command(tid 0: {"prefix": "status"}) -- 0x561d56ac2fd0 con 0x561d56c154e0 2024-09-17T03:38:06.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73bf400640 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x561d56c154e0 0x561d56c158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73bf400640 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x561d56c154e0 0x561d56c158f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfeac2e1bb991f71 server_cookie=2d83d09d9bdb9803 in_seq=0 out_seq=0 2024-09-17T03:38:06.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.827+0000 7f73a8c00640 10 client.5838 ms_handle_connect on v2:172.21.15.121:6832/3893444987 2024-09-17T03:38:06.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73a8c00640 1 -- 172.21.15.121:0/2900446583 <== mds.0 v2:172.21.15.121:6832/3893444987 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x561d56ac2fd0 con 0x561d56c154e0 2024-09-17T03:38:06.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73a8c00640 10 client.5838 handle_command_reply: tid=0 2024-09-17T03:38:06.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 client.5838 shutdown 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 -- 172.21.15.121:0/2900446583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 msgr2=0x561d56c0b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56c0b900 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f73b0052040 tx=0x7f73b0005f00 comp rx=0 tx=0).stop 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 -- 172.21.15.121:0/2900446583 shutdown_connections 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561d567ab270 0x561d56b51d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x561d56c154e0 0x561d56c158f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561d5678a590 0x561d56b517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 --2- 172.21.15.121:0/2900446583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561d567823b0 0x561d56c0b900 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73a8c00640 0 client.5838 ms_handle_reset on v2:172.21.15.121:6832/3893444987 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 -- 172.21.15.121:0/2900446583 >> 172.21.15.121:0/2900446583 conn(0x561d5679f3c0 msgr2=0x561d56b90550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 -- 172.21.15.121:0/2900446583 shutdown_connections 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 1 -- 172.21.15.121:0/2900446583 wait complete. 2024-09-17T03:38:06.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.828+0000 7f73cdc06740 20 client.5838 trim_cache size 0 max 16384 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 5712, 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 6.6150527050000001, 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 37, 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 63, 2024-09-17T03:38:06.832 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 63, 2024-09-17T03:38:06.833 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 11.652089766 2024-09-17T03:38:06.833 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:38:06.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 -- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f73a0078b90 msgr2=0x7f73a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f73a0078b90 0x7f73a007b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f73b0033000 tx=0x7f73b0004730 comp rx=0 tx=0).stop 2024-09-17T03:38:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 -- 172.21.15.121:0/1911817290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0074b60 msgr2=0x7f73c00a0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0074b60 0x7f73c00a0030 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00d6a0 tx=0x7f73ac00db60 comp rx=0 tx=0).stop 2024-09-17T03:38:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 -- 172.21.15.121:0/1911817290 shutdown_connections 2024-09-17T03:38:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73c0156a50 0x7f73c00cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f73a0078b90 0x7f73a007b0a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0074b60 0x7f73c00a0030 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 --2- 172.21.15.121:0/1911817290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73c006e330 0x7f73c00b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 -- 172.21.15.121:0/1911817290 >> 172.21.15.121:0/1911817290 conn(0x7f73c00b1b90 msgr2=0x7f73c015fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 -- 172.21.15.121:0/1911817290 shutdown_connections 2024-09-17T03:38:06.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:06.829+0000 7f73c6a00640 1 -- 172.21.15.121:0/1911817290 wait complete. 2024-09-17T03:38:06.851 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:38:07.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.070+0000 7f9864400640 1 -- 172.21.15.121:0/1236042512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c0cf930 msgr2=0x7f985c0ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.070+0000 7f9864400640 1 --2- 172.21.15.121:0/1236042512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c0cf930 0x7f985c0ce320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9848009830 tx=0x7f984802a530 comp rx=0 tx=0).stop 2024-09-17T03:38:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.070+0000 7f9864400640 1 -- 172.21.15.121:0/1236042512 shutdown_connections 2024-09-17T03:38:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.070+0000 7f9864400640 1 --2- 172.21.15.121:0/1236042512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ce860 0x7f985c15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.070+0000 7f9864400640 1 --2- 172.21.15.121:0/1236042512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c0cf930 0x7f985c0ce320 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.070+0000 7f9864400640 1 -- 172.21.15.121:0/1236042512 >> 172.21.15.121:0/1236042512 conn(0x7f985c0cca40 msgr2=0x7f985c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.071+0000 7f9864400640 1 -- 172.21.15.121:0/1236042512 shutdown_connections 2024-09-17T03:38:07.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.071+0000 7f9864400640 1 -- 172.21.15.121:0/1236042512 wait complete. 2024-09-17T03:38:07.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.073+0000 7f9864400640 1 Processor -- start 2024-09-17T03:38:07.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.073+0000 7f9864400640 1 -- start start 2024-09-17T03:38:07.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.074+0000 7f9864400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ce860 0x7f985c1f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.074+0000 7f9864400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f985c0cf930 0x7f985c0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.074+0000 7f9864400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c15b9f0 0x7f985c0b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.074+0000 7f9864400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f985c06df70 con 0x7f985c0cf930 2024-09-17T03:38:07.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.074+0000 7f9864400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f985c06ddf0 con 0x7f985c15b9f0 2024-09-17T03:38:07.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.074+0000 7f9864400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f985c06e0f0 con 0x7f985c0ce860 2024-09-17T03:38:07.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.074+0000 7f9861000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f985c0cf930 0x7f985c0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.075+0000 7f9861000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f985c0cf930 0x7f985c0b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41560/0 (socket says 172.21.15.121:41560) 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.075+0000 7f9861000640 1 -- 172.21.15.121:0/413258299 learned_addr learned my addr 172.21.15.121:0/413258299 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.075+0000 7f9862400640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c15b9f0 0x7f985c0b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.075+0000 7f9861a00640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ce860 0x7f985c1f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.075+0000 7f9861000640 1 -- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ce860 msgr2=0x7f985c1f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.075+0000 7f9861000640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ce860 0x7f985c1f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.075+0000 7f9861000640 1 -- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c15b9f0 msgr2=0x7f985c0b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.075+0000 7f9861000640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c15b9f0 0x7f985c0b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.075+0000 7f9861000640 1 -- 172.21.15.121:0/413258299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c0b43a0 con 0x7f985c0cf930 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.076+0000 7f9861000640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f985c0cf930 0x7f985c0b3e60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9848000c00 tx=0x7f9848033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.076+0000 7f9859600640 1 -- 172.21.15.121:0/413258299 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848031d60 con 0x7f985c0cf930 2024-09-17T03:38:07.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.076+0000 7f9859600640 1 -- 172.21.15.121:0/413258299 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9848033e10 con 0x7f985c0cf930 2024-09-17T03:38:07.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.076+0000 7f9864400640 1 -- 172.21.15.121:0/413258299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c1f94c0 con 0x7f985c0cf930 2024-09-17T03:38:07.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.076+0000 7f9859600640 1 -- 172.21.15.121:0/413258299 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848033310 con 0x7f985c0cf930 2024-09-17T03:38:07.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.076+0000 7f9864400640 1 -- 172.21.15.121:0/413258299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c1f9a80 con 0x7f985c0cf930 2024-09-17T03:38:07.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.077+0000 7f9864400640 1 -- 172.21.15.121:0/413258299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985c06e610 con 0x7f985c0cf930 2024-09-17T03:38:07.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.078+0000 7f9859600640 1 -- 172.21.15.121:0/413258299 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f98480334b0 con 0x7f985c0cf930 2024-09-17T03:38:07.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.079+0000 7f9859600640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f983c078b90 0x7f983c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.079+0000 7f9859600640 1 -- 172.21.15.121:0/413258299 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f98480bc230 con 0x7f985c0cf930 2024-09-17T03:38:07.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.080+0000 7f9861a00640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f983c078b90 0x7f983c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.080+0000 7f9861a00640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f983c078b90 0x7f983c07b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f985c0ca5c0 tx=0x7f9850009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:07.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.084+0000 7f9859600640 1 -- 172.21.15.121:0/413258299 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f984803f030 con 0x7f985c0cf930 2024-09-17T03:38:07.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.307+0000 7f9864400640 1 -- 172.21.15.121:0/413258299 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f985c06eeb0 con 0x7f985c0cf930 2024-09-17T03:38:07.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.307+0000 7f9859600640 1 -- 172.21.15.121:0/413258299 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) ==== 53+0+73 (secure 0 0 0) 0x7f9848083e80 con 0x7f985c0cf930 2024-09-17T03:38:07.307 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 -- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f983c078b90 msgr2=0x7f983c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f983c078b90 0x7f983c07b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f985c0ca5c0 tx=0x7f9850009040 comp rx=0 tx=0).stop 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 -- 172.21.15.121:0/413258299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f985c0cf930 msgr2=0x7f985c0b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f985c0cf930 0x7f985c0b3e60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9848000c00 tx=0x7f9848033c20 comp rx=0 tx=0).stop 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 -- 172.21.15.121:0/413258299 shutdown_connections 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985c15b9f0 0x7f985c0b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f983c078b90 0x7f983c07b0a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f985c0cf930 0x7f985c0b3e60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 --2- 172.21.15.121:0/413258299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f985c0ce860 0x7f985c1f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 -- 172.21.15.121:0/413258299 >> 172.21.15.121:0/413258299 conn(0x7f985c0cca40 msgr2=0x7f985c151b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:07.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 -- 172.21.15.121:0/413258299 shutdown_connections 2024-09-17T03:38:07.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07.310+0000 7f9864400640 1 -- 172.21.15.121:0/413258299 wait complete. 2024-09-17T03:38:07.333 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:38:07.333 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:38:07.333 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:38:07.333 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:38:07.333 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:07.333 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:38:07.333 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:38:07.333 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:38:07.333 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:07.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:07.334 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:38:07.370 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:38:07.370 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:07.371 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42569sec preferred_lft 42569sec 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:07.372 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:07.373 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:38:07.373 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:38:07.373 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:07.373 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:07.373 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:38:07.373 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:38:07.373 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:07.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:07.373 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:38:07.464 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:38:07.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:07.467 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:38:07.503 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:38:07.503 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:38:07.503 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:38:07.504 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:38:07.504 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:38:07.504 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:38:07.504 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:38:07.504 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:38:07.504 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:38:07.504 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:38:07.504 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:38:07.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:38:07.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:07.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:07.700 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:38:07.735 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:38:07.736 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:38:07.736 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:07.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:07.736 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:38:07.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:07.832 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:07.867 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:07.867 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:07.867 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:07.945 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:38:07.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:07.945 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:08.140 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:08.140 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:08.140 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:38:08.159 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:08.159 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:08.159 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:38:08.160 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:38:08.160 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:08.193 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:08.193 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:08.193 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:38:08.193 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:38:08.193 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:08.193 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:38:08.193 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:38:08.193 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:38:08.194 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:38:08.194 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:38:08.194 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:38:08.195 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:38:08.195 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:38:08.197 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:38:08.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:08.198 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:08.256 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:38:08.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:38:08.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:08.352 INFO:teuthology.orchestra.run.smithi121.stdout:client5321 2024-09-17T03:38:08.352 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:08.352 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:08.392 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:38:08.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.653+0000 7f9b9f200640 1 -- 172.21.15.121:0/696680911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ba01627f0 msgr2=0x7f9ba006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.653+0000 7f9b9f200640 1 --2- 172.21.15.121:0/696680911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ba01627f0 0x7f9ba006d2b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9ba015c800 tx=0x7f9b8802a560 comp rx=0 tx=0).stop 2024-09-17T03:38:08.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.654+0000 7f9b9f200640 1 -- 172.21.15.121:0/696680911 shutdown_connections 2024-09-17T03:38:08.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.654+0000 7f9b9f200640 1 --2- 172.21.15.121:0/696680911 >> v2:172.21.15.176:3300/0 conn(0x7f9ba006d7f0 0x7f9ba0154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.654+0000 7f9b9f200640 1 --2- 172.21.15.121:0/696680911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ba01627f0 0x7f9ba006d2b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.654+0000 7f9b9f200640 1 --2- 172.21.15.121:0/696680911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ba00b9e40 0x7f9ba01622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.654+0000 7f9b9f200640 1 -- 172.21.15.121:0/696680911 >> 172.21.15.121:0/696680911 conn(0x7f9ba00d1930 msgr2=0x7f9ba00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:08.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.654+0000 7f9b9f200640 1 -- 172.21.15.121:0/696680911 shutdown_connections 2024-09-17T03:38:08.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.654+0000 7f9b9f200640 1 -- 172.21.15.121:0/696680911 wait complete. 2024-09-17T03:38:08.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.656+0000 7f9b9f200640 1 Processor -- start 2024-09-17T03:38:08.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.656+0000 7f9b9f200640 1 -- start start 2024-09-17T03:38:08.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.657+0000 7f9b9f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ba006d7f0 0x7f9ba00c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.657+0000 7f9b9f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ba00b9e40 0x7f9ba0151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.657+0000 7f9b9f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ba01627f0 0x7f9ba01610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.657+0000 7f9b9f200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba01555f0 con 0x7f9ba00b9e40 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.657+0000 7f9b9f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba006e7f0 con 0x7f9ba006d7f0 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.657+0000 7f9b9f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba0155770 con 0x7f9ba01627f0 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b95400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ba00b9e40 0x7f9ba0151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b95400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ba00b9e40 0x7f9ba0151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41576/0 (socket says 172.21.15.121:41576) 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b95400640 1 -- 172.21.15.121:0/3628500770 learned_addr learned my addr 172.21.15.121:0/3628500770 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b9de00640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ba006d7f0 0x7f9ba00c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b9e800640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ba01627f0 0x7f9ba01610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b95400640 1 -- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ba01627f0 msgr2=0x7f9ba01610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b95400640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ba01627f0 0x7f9ba01610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b95400640 1 -- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ba006d7f0 msgr2=0x7f9ba00c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b95400640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ba006d7f0 0x7f9ba00c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b95400640 1 -- 172.21.15.121:0/3628500770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba0155f20 con 0x7f9ba00b9e40 2024-09-17T03:38:08.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b9de00640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ba006d7f0 0x7f9ba00c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:08.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b9e800640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ba01627f0 0x7f9ba01610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:08.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.658+0000 7f9b95400640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ba00b9e40 0x7f9ba0151270 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9b88000c00 tx=0x7f9b880039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:08.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.659+0000 7f9b96a00640 1 -- 172.21.15.121:0/3628500770 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8803e030 con 0x7f9ba00b9e40 2024-09-17T03:38:08.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.659+0000 7f9b96a00640 1 -- 172.21.15.121:0/3628500770 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b880047a0 con 0x7f9ba00b9e40 2024-09-17T03:38:08.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.659+0000 7f9b9f200640 1 -- 172.21.15.121:0/3628500770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba0156200 con 0x7f9ba00b9e40 2024-09-17T03:38:08.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.659+0000 7f9b96a00640 1 -- 172.21.15.121:0/3628500770 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88035040 con 0x7f9ba00b9e40 2024-09-17T03:38:08.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.659+0000 7f9b9f200640 1 -- 172.21.15.121:0/3628500770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba0151c40 con 0x7f9ba00b9e40 2024-09-17T03:38:08.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.660+0000 7f9b9f200640 1 -- 172.21.15.121:0/3628500770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba0155200 con 0x7f9ba00b9e40 2024-09-17T03:38:08.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.661+0000 7f9b96a00640 1 -- 172.21.15.121:0/3628500770 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b88041030 con 0x7f9ba00b9e40 2024-09-17T03:38:08.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.662+0000 7f9b96a00640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9b7c078bc0 0x7f9b7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.662+0000 7f9b96a00640 1 -- 172.21.15.121:0/3628500770 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f9b880bb770 con 0x7f9ba00b9e40 2024-09-17T03:38:08.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.662+0000 7f9b9de00640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9b7c078bc0 0x7f9b7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.663+0000 7f9b9de00640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9b7c078bc0 0x7f9b7c07b0d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9b90007eb0 tx=0x7f9b900073c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:08.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.666+0000 7f9b96a00640 1 -- 172.21.15.121:0/3628500770 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9ba0155200 con 0x7f9ba00b9e40 2024-09-17T03:38:08.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.884+0000 7f9b9f200640 1 -- 172.21.15.121:0/3628500770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9ba01563d0 con 0x7f9ba00b9e40 2024-09-17T03:38:08.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.885+0000 7f9b96a00640 1 -- 172.21.15.121:0/3628500770 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) ==== 53+0+73 (secure 0 0 0) 0x7f9ba01563d0 con 0x7f9ba00b9e40 2024-09-17T03:38:08.885 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:38:08.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 -- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9b7c078bc0 msgr2=0x7f9b7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9b7c078bc0 0x7f9b7c07b0d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9b90007eb0 tx=0x7f9b900073c0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 -- 172.21.15.121:0/3628500770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ba00b9e40 msgr2=0x7f9ba0151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ba00b9e40 0x7f9ba0151270 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9b88000c00 tx=0x7f9b880039e0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 -- 172.21.15.121:0/3628500770 shutdown_connections 2024-09-17T03:38:08.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ba01627f0 0x7f9ba01610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9b7c078bc0 0x7f9b7c07b0d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ba00b9e40 0x7f9ba0151270 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 --2- 172.21.15.121:0/3628500770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ba006d7f0 0x7f9ba00c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 -- 172.21.15.121:0/3628500770 >> 172.21.15.121:0/3628500770 conn(0x7f9ba00d1930 msgr2=0x7f9ba00cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:08.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 -- 172.21.15.121:0/3628500770 shutdown_connections 2024-09-17T03:38:08.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:08.887+0000 7f9b9f200640 1 -- 172.21.15.121:0/3628500770 wait complete. 2024-09-17T03:38:08.913 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:38:08.914 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:38:08.914 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:38:08.914 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:38:08.914 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:38:08.914 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:38:08.914 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:38:08.914 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:38:08.914 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:38:08.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:08.914 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:08.956 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42565sec preferred_lft 42565sec 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:38:08.957 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::80c9:d6ff:fe9f:5926/64 scope link 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d4cd:10ff:feb7:d68f/64 scope link 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether fe:db:9e:03:5a:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::fcdb:9eff:fe03:5a3e/64 scope link 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:08.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:08.959 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:38:09.053 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:38:09.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:09.056 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:38:09.094 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:38:09.094 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:38:09.094 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:38:09.095 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:38:09.095 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:38:09.095 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:38:09.095 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:38:09.095 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:38:09.095 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:38:09.095 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:38:09.095 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:38:09.213 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:38:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:38:09.284 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:38:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:09.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:09.293 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:38:09.330 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:38:09.330 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:38:09.331 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:38:09.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:09.331 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T03:38:09.428 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:09.428 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:38:09.463 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:38:09.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:09.463 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:38:09.537 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:38:09.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:09.538 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:38:09.734 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:38:09.734 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:38:09.735 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:38:09.755 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:38:09.755 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:38:09.755 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:38:09.755 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:38:09.755 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:09.785 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:38:09.785 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:38:09.785 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:38:09.785 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:38:09.785 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:09.785 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:38:09.786 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:38:09.786 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:38:09.786 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:38:09.786 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:38:09.786 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:38:09.786 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:38:09.787 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:38:09.789 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:38:09.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:09.790 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:38:09.845 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:38:09.923 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:38:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:38:09.927 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:38:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:09.935 INFO:teuthology.orchestra.run.smithi176.stdout:client5683 2024-09-17T03:38:09.935 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:38:09.935 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:09.971 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_session_blocklist_on_evict False 2024-09-17T03:38:10.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.203+0000 7f7499000640 1 -- 172.21.15.121:0/647241921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f749406ddf0 msgr2=0x7f749406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.203+0000 7f7499000640 1 --2- 172.21.15.121:0/647241921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f749406ddf0 0x7f749406e200 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7480009830 tx=0x7f748002a510 comp rx=0 tx=0).stop 2024-09-17T03:38:10.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.204+0000 7f7499000640 1 -- 172.21.15.121:0/647241921 shutdown_connections 2024-09-17T03:38:10.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.204+0000 7f7499000640 1 --2- 172.21.15.121:0/647241921 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74940cef00 0x7f74940cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.204+0000 7f7499000640 1 --2- 172.21.15.121:0/647241921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f749406ddf0 0x7f749406e200 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.204+0000 7f7499000640 1 -- 172.21.15.121:0/647241921 >> 172.21.15.121:0/647241921 conn(0x7f74940b1b90 msgr2=0x7f74940b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:10.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.204+0000 7f7499000640 1 -- 172.21.15.121:0/647241921 shutdown_connections 2024-09-17T03:38:10.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.204+0000 7f7499000640 1 -- 172.21.15.121:0/647241921 wait complete. 2024-09-17T03:38:10.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.206+0000 7f7499000640 1 Processor -- start 2024-09-17T03:38:10.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.206+0000 7f7499000640 1 -- start start 2024-09-17T03:38:10.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.207+0000 7f7499000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f749406ddf0 0x7f7494159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.207+0000 7f7499000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74940cef00 0x7f74941f9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.207+0000 7f7499000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7494156a50 0x7f7494155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.207+0000 7f7499000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f74940cf850 con 0x7f749406ddf0 2024-09-17T03:38:10.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.207+0000 7f7499000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7494161060 con 0x7f74940cef00 2024-09-17T03:38:10.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.207+0000 7f7499000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f74940cf9d0 con 0x7f7494156a50 2024-09-17T03:38:10.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7491e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f749406ddf0 0x7f7494159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7491e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f749406ddf0 0x7f7494159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41584/0 (socket says 172.21.15.121:41584) 2024-09-17T03:38:10.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7491e00640 1 -- 172.21.15.121:0/1549850361 learned_addr learned my addr 172.21.15.121:0/1549850361 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:10.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7491400640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74940cef00 0x7f74941f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7492800640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7494156a50 0x7f7494155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7491e00640 1 -- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7494156a50 msgr2=0x7f7494155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7491e00640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7494156a50 0x7f7494155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7491e00640 1 -- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74940cef00 msgr2=0x7f74941f9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7491e00640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74940cef00 0x7f74941f9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7491e00640 1 -- 172.21.15.121:0/1549850361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74940c6730 con 0x7f749406ddf0 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.208+0000 7f7491400640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74940cef00 0x7f74941f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.209+0000 7f7491e00640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f749406ddf0 0x7f7494159fd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f748400c3c0 tx=0x7f748400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.209+0000 7f748a000640 1 -- 172.21.15.121:0/1549850361 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484017070 con 0x7f749406ddf0 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.209+0000 7f748a000640 1 -- 172.21.15.121:0/1549850361 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74840035f0 con 0x7f749406ddf0 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.209+0000 7f748a000640 1 -- 172.21.15.121:0/1549850361 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484003a80 con 0x7f749406ddf0 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.209+0000 7f7499000640 1 -- 172.21.15.121:0/1549850361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74941577f0 con 0x7f749406ddf0 2024-09-17T03:38:10.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.209+0000 7f7499000640 1 -- 172.21.15.121:0/1549850361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74941f8e70 con 0x7f749406ddf0 2024-09-17T03:38:10.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.210+0000 7f7499000640 1 -- 172.21.15.121:0/1549850361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f749406e200 con 0x7f749406ddf0 2024-09-17T03:38:10.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.211+0000 7f748a000640 1 -- 172.21.15.121:0/1549850361 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f748401a070 con 0x7f749406ddf0 2024-09-17T03:38:10.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.212+0000 7f748a000640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7474078bc0 0x7f747407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.212+0000 7f748a000640 1 -- 172.21.15.121:0/1549850361 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f748409a0c0 con 0x7f749406ddf0 2024-09-17T03:38:10.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.213+0000 7f7491400640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7474078bc0 0x7f747407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.213+0000 7f7491400640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7474078bc0 0x7f747407b0d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7480034000 tx=0x7f7480004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:10.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.218+0000 7f748a000640 1 -- 172.21.15.121:0/1549850361 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74940c6730 con 0x7f749406ddf0 2024-09-17T03:38:10.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.403+0000 7f7499000640 1 -- 172.21.15.121:0/1549850361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mds_session_blocklist_on_evict}] v 0) -- 0x7f74940b1160 con 0x7f749406ddf0 2024-09-17T03:38:10.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.407+0000 7f748a000640 1 -- 172.21.15.121:0/1549850361 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_session_blocklist_on_evict}]=0 v38)=0 v38) ==== 132+0+0 (secure 0 0 0) 0x7f749406e740 con 0x7f749406ddf0 2024-09-17T03:38:10.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.409+0000 7f7499000640 1 -- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7474078bc0 msgr2=0x7f747407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.409+0000 7f7499000640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7474078bc0 0x7f747407b0d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7480034000 tx=0x7f7480004730 comp rx=0 tx=0).stop 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.409+0000 7f7499000640 1 -- 172.21.15.121:0/1549850361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f749406ddf0 msgr2=0x7f7494159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.409+0000 7f7499000640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f749406ddf0 0x7f7494159fd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f748400c3c0 tx=0x7f748400c880 comp rx=0 tx=0).stop 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.409+0000 7f7499000640 1 -- 172.21.15.121:0/1549850361 shutdown_connections 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.409+0000 7f7499000640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7494156a50 0x7f7494155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.409+0000 7f7499000640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74940cef00 0x7f74941f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.410+0000 7f7499000640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7474078bc0 0x7f747407b0d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.410+0000 7f7499000640 1 --2- 172.21.15.121:0/1549850361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f749406ddf0 0x7f7494159fd0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.410+0000 7f7499000640 1 -- 172.21.15.121:0/1549850361 >> 172.21.15.121:0/1549850361 conn(0x7f74940b1b90 msgr2=0x7f7494072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.410+0000 7f7499000640 1 -- 172.21.15.121:0/1549850361 shutdown_connections 2024-09-17T03:38:10.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.410+0000 7f7499000640 1 -- 172.21.15.121:0/1549850361 wait complete. 2024-09-17T03:38:10.435 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-09-17T03:38:10.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.659+0000 7fd408a00640 1 -- 172.21.15.121:0/1043297354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4040ccf40 msgr2=0x7fd4040b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.659+0000 7fd408a00640 1 --2- 172.21.15.121:0/1043297354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4040ccf40 0x7fd4040b4f10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009be0 tx=0x7fd3fc02a820 comp rx=0 tx=0).stop 2024-09-17T03:38:10.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.659+0000 7fd408a00640 1 -- 172.21.15.121:0/1043297354 shutdown_connections 2024-09-17T03:38:10.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.659+0000 7fd408a00640 1 --2- 172.21.15.121:0/1043297354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4040ccf40 0x7fd4040b4f10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.659+0000 7fd408a00640 1 -- 172.21.15.121:0/1043297354 >> 172.21.15.121:0/1043297354 conn(0x7fd40406f920 msgr2=0x7fd4040b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:10.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.659+0000 7fd408a00640 1 -- 172.21.15.121:0/1043297354 shutdown_connections 2024-09-17T03:38:10.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.659+0000 7fd408a00640 1 -- 172.21.15.121:0/1043297354 wait complete. 2024-09-17T03:38:10.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.661+0000 7fd408a00640 1 Processor -- start 2024-09-17T03:38:10.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.661+0000 7fd408a00640 1 -- start start 2024-09-17T03:38:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd408a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40406e350 0x7fd4040739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd408a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4040b4b00 0x7fd40413d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd408a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd404156230 0x7fd404156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd408a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd40406d8d0 con 0x7fd404156230 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd408a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd40406d750 con 0x7fd4040b4b00 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd408a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd40406da50 con 0x7fd40406e350 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd403200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd404156230 0x7fd404156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd403200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd404156230 0x7fd404156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41596/0 (socket says 172.21.15.121:41596) 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd403200640 1 -- 172.21.15.121:0/1199993075 learned_addr learned my addr 172.21.15.121:0/1199993075 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd402800640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40406e350 0x7fd4040739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.663+0000 7fd401e00640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4040b4b00 0x7fd40413d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.664+0000 7fd403200640 1 -- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40406e350 msgr2=0x7fd4040739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.664+0000 7fd403200640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40406e350 0x7fd4040739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.664+0000 7fd403200640 1 -- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4040b4b00 msgr2=0x7fd40413d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.664+0000 7fd403200640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4040b4b00 0x7fd40413d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.664+0000 7fd403200640 1 -- 172.21.15.121:0/1199993075 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd404156b80 con 0x7fd404156230 2024-09-17T03:38:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.664+0000 7fd403200640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd404156230 0x7fd404156640 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009d00 tx=0x7fd3fc0305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.664+0000 7fd3faa00640 1 -- 172.21.15.121:0/1199993075 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc041030 con 0x7fd404156230 2024-09-17T03:38:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.664+0000 7fd3faa00640 1 -- 172.21.15.121:0/1199993075 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3fc003970 con 0x7fd404156230 2024-09-17T03:38:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.664+0000 7fd408a00640 1 -- 172.21.15.121:0/1199993075 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4041f9070 con 0x7fd404156230 2024-09-17T03:38:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.664+0000 7fd3faa00640 1 -- 172.21.15.121:0/1199993075 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc036040 con 0x7fd404156230 2024-09-17T03:38:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.665+0000 7fd408a00640 1 -- 172.21.15.121:0/1199993075 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4041f9630 con 0x7fd404156230 2024-09-17T03:38:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.665+0000 7fd408a00640 1 -- 172.21.15.121:0/1199993075 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4040b4f10 con 0x7fd404156230 2024-09-17T03:38:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.667+0000 7fd3faa00640 1 -- 172.21.15.121:0/1199993075 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3fc044070 con 0x7fd404156230 2024-09-17T03:38:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.668+0000 7fd3faa00640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e4078b90 0x7fd3e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.668+0000 7fd3faa00640 1 -- 172.21.15.121:0/1199993075 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fd3fc0bbba0 con 0x7fd404156230 2024-09-17T03:38:10.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.668+0000 7fd402800640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e4078b90 0x7fd3e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.669+0000 7fd402800640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e4078b90 0x7fd3e407b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40013c0 tx=0x7fd3f4001720 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:10.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.672+0000 7fd3faa00640 1 -- 172.21.15.121:0/1199993075 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd404156b80 con 0x7fd404156230 2024-09-17T03:38:10.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:10.891+0000 7fd408a00640 1 -- 172.21.15.121:0/1199993075 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7fd404142700 con 0x7fd404156230 2024-09-17T03:38:11.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.411+0000 7fd3faa00640 1 -- 172.21.15.121:0/1199993075 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v38) ==== 105+0+0 (secure 0 0 0) 0x7fd3fc083800 con 0x7fd404156230 2024-09-17T03:38:11.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.414+0000 7fd408a00640 1 -- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e4078b90 msgr2=0x7fd3e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.414+0000 7fd408a00640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e4078b90 0x7fd3e407b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40013c0 tx=0x7fd3f4001720 comp rx=0 tx=0).stop 2024-09-17T03:38:11.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.414+0000 7fd408a00640 1 -- 172.21.15.121:0/1199993075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd404156230 msgr2=0x7fd404156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.414+0000 7fd408a00640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd404156230 0x7fd404156640 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009d00 tx=0x7fd3fc0305d0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.414+0000 7fd408a00640 1 -- 172.21.15.121:0/1199993075 shutdown_connections 2024-09-17T03:38:11.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.414+0000 7fd408a00640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e4078b90 0x7fd3e407b0a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.414+0000 7fd408a00640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd404156230 0x7fd404156640 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.414+0000 7fd408a00640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4040b4b00 0x7fd40413d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.414+0000 7fd408a00640 1 --2- 172.21.15.121:0/1199993075 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40406e350 0x7fd4040739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.414+0000 7fd408a00640 1 -- 172.21.15.121:0/1199993075 >> 172.21.15.121:0/1199993075 conn(0x7fd40406f920 msgr2=0x7fd4040cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:11.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.415+0000 7fd408a00640 1 -- 172.21.15.121:0/1199993075 shutdown_connections 2024-09-17T03:38:11.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.415+0000 7fd408a00640 1 -- 172.21.15.121:0/1199993075 wait complete. 2024-09-17T03:38:11.453 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:11.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.675+0000 7fb29d000640 1 -- 172.21.15.121:0/4257651179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2980b39d0 msgr2=0x7fb29806def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.675+0000 7fb29d000640 1 --2- 172.21.15.121:0/4257651179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2980b39d0 0x7fb29806def0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb290005fd0 tx=0x7fb29002aaa0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.675+0000 7fb29d000640 1 -- 172.21.15.121:0/4257651179 shutdown_connections 2024-09-17T03:38:11.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.675+0000 7fb29d000640 1 --2- 172.21.15.121:0/4257651179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2980b39d0 0x7fb29806def0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.675+0000 7fb29d000640 1 --2- 172.21.15.121:0/4257651179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb298152530 0x7fb2980b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.675+0000 7fb29d000640 1 -- 172.21.15.121:0/4257651179 >> 172.21.15.121:0/4257651179 conn(0x7fb29806f940 msgr2=0x7fb2980b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:11.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.675+0000 7fb29d000640 1 -- 172.21.15.121:0/4257651179 shutdown_connections 2024-09-17T03:38:11.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.675+0000 7fb29d000640 1 -- 172.21.15.121:0/4257651179 wait complete. 2024-09-17T03:38:11.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.677+0000 7fb29d000640 1 Processor -- start 2024-09-17T03:38:11.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.677+0000 7fb29d000640 1 -- start start 2024-09-17T03:38:11.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb29d000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb298073dd0 0x7fb29814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:11.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb29d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2980b39d0 0x7fb29814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:11.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb29d000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb298152530 0x7fb29814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:11.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb29d000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2980cf5b0 con 0x7fb298152530 2024-09-17T03:38:11.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb29d000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2980cf430 con 0x7fb298073dd0 2024-09-17T03:38:11.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb29d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2980cf730 con 0x7fb2980b39d0 2024-09-17T03:38:11.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb297e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb298152530 0x7fb29814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:11.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb297e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb298152530 0x7fb29814e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41606/0 (socket says 172.21.15.121:41606) 2024-09-17T03:38:11.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb297e00640 1 -- 172.21.15.121:0/1889649896 learned_addr learned my addr 172.21.15.121:0/1889649896 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:11.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb28ea00640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2980b39d0 0x7fb29814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb297400640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb298073dd0 0x7fb29814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb297e00640 1 -- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2980b39d0 msgr2=0x7fb29814e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb297e00640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2980b39d0 0x7fb29814e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb297e00640 1 -- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb298073dd0 msgr2=0x7fb29814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.679+0000 7fb297e00640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb298073dd0 0x7fb29814fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.680+0000 7fb297e00640 1 -- 172.21.15.121:0/1889649896 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb298150700 con 0x7fb298152530 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.680+0000 7fb297400640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb298073dd0 0x7fb29814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.680+0000 7fb297e00640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb298152530 0x7fb29814e620 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb290009bf0 tx=0x7fb290003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.680+0000 7fb28fe00640 1 -- 172.21.15.121:0/1889649896 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290044070 con 0x7fb298152530 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.680+0000 7fb28fe00640 1 -- 172.21.15.121:0/1889649896 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb290004250 con 0x7fb298152530 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.680+0000 7fb28fe00640 1 -- 172.21.15.121:0/1889649896 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290004660 con 0x7fb298152530 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.680+0000 7fb29d000640 1 -- 172.21.15.121:0/1889649896 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2981509e0 con 0x7fb298152530 2024-09-17T03:38:11.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.680+0000 7fb29d000640 1 -- 172.21.15.121:0/1889649896 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2981f6780 con 0x7fb298152530 2024-09-17T03:38:11.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.681+0000 7fb29d000640 1 -- 172.21.15.121:0/1889649896 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2980cfbe0 con 0x7fb298152530 2024-09-17T03:38:11.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.683+0000 7fb28fe00640 1 -- 172.21.15.121:0/1889649896 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb290047070 con 0x7fb298152530 2024-09-17T03:38:11.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.683+0000 7fb28fe00640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb274078b90 0x7fb27407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:11.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.684+0000 7fb28fe00640 1 -- 172.21.15.121:0/1889649896 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6304+0+0 (secure 0 0 0) 0x7fb2900bbfb0 con 0x7fb298152530 2024-09-17T03:38:11.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.684+0000 7fb297400640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb274078b90 0x7fb27407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:11.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.685+0000 7fb297400640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb274078b90 0x7fb27407b0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb2980b5540 tx=0x7fb288009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:11.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.688+0000 7fb28fe00640 1 -- 172.21.15.121:0/1889649896 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb290032030 con 0x7fb298152530 2024-09-17T03:38:11.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.906+0000 7fb29d000640 1 -- 172.21.15.121:0/1889649896 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb298150490 con 0x7fb298152530 2024-09-17T03:38:11.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.907+0000 7fb28fe00640 1 -- 172.21.15.121:0/1889649896 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5252 (secure 0 0 0) 0x7fb2900841b0 con 0x7fb298152530 2024-09-17T03:38:11.907 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:11.907 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":39,"btime":"2024-09-17T03:38:11:418652+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1006042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1006042508},{"type":"v1","addr":"172.21.15.176:6836","nonce":1006042508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3672630729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3672630729},{"type":"v1","addr":"172.21.15.176:6837","nonce":3672630729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:59.696137+0000","modified":"2024-09-17T03:38:11.418638+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5712,"mds_1":5234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5234":{"gid":5234,"name":"c","rank":1,"incarnation":39,"state":"up:creating","state_seq":1,"addr":"172.21.15.121:6835/4058545170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4058545170},{"type":"v1","addr":"172.21.15.121:6835","nonce":4058545170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5712":{"gid":5712,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6833/3893444987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3893444987},{"type":"v1","addr":"172.21.15.121:6833","nonce":3893444987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5712,"qdb_cluster":[5712]},"id":4}]} 2024-09-17T03:38:11.907 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 39 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 -- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb274078b90 msgr2=0x7fb27407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb274078b90 0x7fb27407b0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb2980b5540 tx=0x7fb288009040 comp rx=0 tx=0).stop 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 -- 172.21.15.121:0/1889649896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb298152530 msgr2=0x7fb29814e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb298152530 0x7fb29814e620 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb290009bf0 tx=0x7fb290003ce0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 -- 172.21.15.121:0/1889649896 shutdown_connections 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb274078b90 0x7fb27407b0a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb298152530 0x7fb29814e620 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2980b39d0 0x7fb29814e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 --2- 172.21.15.121:0/1889649896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb298073dd0 0x7fb29814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 -- 172.21.15.121:0/1889649896 >> 172.21.15.121:0/1889649896 conn(0x7fb29806f940 msgr2=0x7fb29815e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 -- 172.21.15.121:0/1889649896 shutdown_connections 2024-09-17T03:38:11.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:11.910+0000 7fb29d000640 1 -- 172.21.15.121:0/1889649896 wait complete. 2024-09-17T03:38:12.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:37:59.696137+0000', 'modified': '2024-09-17T03:38:11.418638+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 5712, 'mds_1': 5234}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5234': {'gid': 5234, 'name': 'c', 'rank': 1, 'incarnation': 39, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.121:6835/4058545170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 4058545170}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 4058545170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5712': {'gid': 5712, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6833/3893444987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 3893444987}, {'type': 'v1', 'addr': '172.21.15.121:6833', 'nonce': 3893444987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5712, 'qdb_cluster': [5712]} 2024-09-17T03:38:12.341 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5234:up:creating 2024-09-17T03:38:13.342 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:13.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.573+0000 7f4be8600640 1 -- 172.21.15.121:0/2035206809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be0074cb0 msgr2=0x7f4be0073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.573+0000 7f4be8600640 1 --2- 172.21.15.121:0/2035206809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be0074cb0 0x7f4be0073dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4be015d980 tx=0x7f4bd402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.573+0000 7f4be8600640 1 -- 172.21.15.121:0/2035206809 shutdown_connections 2024-09-17T03:38:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.573+0000 7f4be8600640 1 --2- 172.21.15.121:0/2035206809 >> v2:172.21.15.176:3300/0 conn(0x7f4be006e500 0x7f4be00cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.573+0000 7f4be8600640 1 --2- 172.21.15.121:0/2035206809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be0074cb0 0x7f4be0073dd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.573+0000 7f4be8600640 1 -- 172.21.15.121:0/2035206809 >> 172.21.15.121:0/2035206809 conn(0x7f4be00cca40 msgr2=0x7f4be00cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.573+0000 7f4be8600640 1 -- 172.21.15.121:0/2035206809 shutdown_connections 2024-09-17T03:38:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.573+0000 7f4be8600640 1 -- 172.21.15.121:0/2035206809 wait complete. 2024-09-17T03:38:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.576+0000 7f4be8600640 1 Processor -- start 2024-09-17T03:38:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.576+0000 7f4be8600640 1 -- start start 2024-09-17T03:38:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.577+0000 7f4be8600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0074cb0 0x7f4be006da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.577+0000 7f4be8600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00cbc10 0x7f4be006df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.577+0000 7f4be8600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be014f210 0x7f4be014f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.577+0000 7f4be8600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4be006f360 con 0x7f4be00cbc10 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.577+0000 7f4be8600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4be006f1e0 con 0x7f4be014f210 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.577+0000 7f4be8600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4be006f4e0 con 0x7f4be0074cb0 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.577+0000 7f4be5200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00cbc10 0x7f4be006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be5200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00cbc10 0x7f4be006df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36436/0 (socket says 172.21.15.121:36436) 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be5200640 1 -- 172.21.15.121:0/2821558626 learned_addr learned my addr 172.21.15.121:0/2821558626 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be5c00640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0074cb0 0x7f4be006da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be6600640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be014f210 0x7f4be014f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be5200640 1 -- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0074cb0 msgr2=0x7f4be006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be5200640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0074cb0 0x7f4be006da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be5200640 1 -- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be014f210 msgr2=0x7f4be014f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be5200640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be014f210 0x7f4be014f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be5200640 1 -- 172.21.15.121:0/2821558626 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be0150400 con 0x7f4be00cbc10 2024-09-17T03:38:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be6600640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be014f210 0x7f4be014f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4be5200640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00cbc10 0x7f4be006df70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c390 tx=0x7f4bcc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.578+0000 7f4bdd600640 1 -- 172.21.15.121:0/2821558626 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc011790 con 0x7f4be00cbc10 2024-09-17T03:38:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.579+0000 7f4bdd600640 1 -- 172.21.15.121:0/2821558626 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bcc017070 con 0x7f4be00cbc10 2024-09-17T03:38:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.579+0000 7f4bdd600640 1 -- 172.21.15.121:0/2821558626 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc011ce0 con 0x7f4be00cbc10 2024-09-17T03:38:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.579+0000 7f4be8600640 1 -- 172.21.15.121:0/2821558626 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be01506e0 con 0x7f4be00cbc10 2024-09-17T03:38:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.579+0000 7f4be8600640 1 -- 172.21.15.121:0/2821558626 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be01f4ff0 con 0x7f4be00cbc10 2024-09-17T03:38:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.580+0000 7f4be8600640 1 -- 172.21.15.121:0/2821558626 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be0150170 con 0x7f4be00cbc10 2024-09-17T03:38:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.581+0000 7f4bdd600640 1 -- 172.21.15.121:0/2821558626 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4bcc01c460 con 0x7f4be00cbc10 2024-09-17T03:38:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.582+0000 7f4bdd600640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bc0078b90 0x7f4bc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.582+0000 7f4bdd600640 1 -- 172.21.15.121:0/2821558626 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f4bcc09ad80 con 0x7f4be00cbc10 2024-09-17T03:38:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.582+0000 7f4be5c00640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bc0078b90 0x7f4bc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.583+0000 7f4be5c00640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bc0078b90 0x7f4bc007b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4034000 tx=0x7f4bd4004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.586+0000 7f4bdd600640 1 -- 172.21.15.121:0/2821558626 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4bcc062f80 con 0x7f4be00cbc10 2024-09-17T03:38:13.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.803+0000 7f4be8600640 1 -- 172.21.15.121:0/2821558626 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4be006f990 con 0x7f4be00cbc10 2024-09-17T03:38:13.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.804+0000 7f4bdd600640 1 -- 172.21.15.121:0/2821558626 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5255 (secure 0 0 0) 0x7f4bcc062880 con 0x7f4be00cbc10 2024-09-17T03:38:13.804 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:13.804 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":40,"btime":"2024-09-17T03:38:12:424518+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1006042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1006042508},{"type":"v1","addr":"172.21.15.176:6836","nonce":1006042508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3672630729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3672630729},{"type":"v1","addr":"172.21.15.176:6837","nonce":3672630729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:59.696137+0000","modified":"2024-09-17T03:38:12.424511+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5712,"mds_1":5234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5234":{"gid":5234,"name":"c","rank":1,"incarnation":39,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6835/4058545170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4058545170},{"type":"v1","addr":"172.21.15.121:6835","nonce":4058545170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5712":{"gid":5712,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6833/3893444987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3893444987},{"type":"v1","addr":"172.21.15.121:6833","nonce":3893444987}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5712,"qdb_cluster":[5234,5712]},"id":4}]} 2024-09-17T03:38:13.804 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 40 2024-09-17T03:38:13.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 -- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bc0078b90 msgr2=0x7f4bc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bc0078b90 0x7f4bc007b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4034000 tx=0x7f4bd4004ab0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 -- 172.21.15.121:0/2821558626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00cbc10 msgr2=0x7f4be006df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00cbc10 0x7f4be006df70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c390 tx=0x7f4bcc00c850 comp rx=0 tx=0).stop 2024-09-17T03:38:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 -- 172.21.15.121:0/2821558626 shutdown_connections 2024-09-17T03:38:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4be014f210 0x7f4be014f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4bc0078b90 0x7f4bc007b0a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4be00cbc10 0x7f4be006df70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 --2- 172.21.15.121:0/2821558626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4be0074cb0 0x7f4be006da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 -- 172.21.15.121:0/2821558626 >> 172.21.15.121:0/2821558626 conn(0x7f4be00cca40 msgr2=0x7f4be015bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 -- 172.21.15.121:0/2821558626 shutdown_connections 2024-09-17T03:38:13.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:13.806+0000 7f4be8600640 1 -- 172.21.15.121:0/2821558626 wait complete. 2024-09-17T03:38:14.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:37:59.696137+0000', 'modified': '2024-09-17T03:38:12.424511+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 5712, 'mds_1': 5234}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5234': {'gid': 5234, 'name': 'c', 'rank': 1, 'incarnation': 39, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.121:6835/4058545170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 4058545170}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 4058545170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5712': {'gid': 5712, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6833/3893444987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 3893444987}, {'type': 'v1', 'addr': '172.21.15.121:6833', 'nonce': 3893444987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5712, 'qdb_cluster': [5234, 5712]} 2024-09-17T03:38:14.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-09-17T03:38:14.231 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:38:14.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.455+0000 7f75e7e00640 1 -- 172.21.15.121:0/1217023754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e80cef00 msgr2=0x7f75e80cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.455+0000 7f75e7e00640 1 --2- 172.21.15.121:0/1217023754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e80cef00 0x7f75e80cf310 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f75d4005fd0 tx=0x7f75d402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.455+0000 7f75e7e00640 1 -- 172.21.15.121:0/1217023754 shutdown_connections 2024-09-17T03:38:14.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.455+0000 7f75e7e00640 1 --2- 172.21.15.121:0/1217023754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75e80d2290 0x7f75e80d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.455+0000 7f75e7e00640 1 --2- 172.21.15.121:0/1217023754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e80cef00 0x7f75e80cf310 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.455+0000 7f75e7e00640 1 -- 172.21.15.121:0/1217023754 >> 172.21.15.121:0/1217023754 conn(0x7f75e80d41e0 msgr2=0x7f75e80d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.455+0000 7f75e7e00640 1 -- 172.21.15.121:0/1217023754 shutdown_connections 2024-09-17T03:38:14.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.455+0000 7f75e7e00640 1 -- 172.21.15.121:0/1217023754 wait complete. 2024-09-17T03:38:14.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.457+0000 7f75e7e00640 1 Processor -- start 2024-09-17T03:38:14.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.457+0000 7f75e7e00640 1 -- start start 2024-09-17T03:38:14.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.458+0000 7f75e7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e80cef00 0x7f75e814eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.458+0000 7f75e7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75e80d2290 0x7f75e81f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.458+0000 7f75e7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75e815f6d0 0x7f75e80cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.458+0000 7f75e7e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f75e80d2be0 con 0x7f75e80cef00 2024-09-17T03:38:14.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.458+0000 7f75e7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75e806dd20 con 0x7f75e815f6d0 2024-09-17T03:38:14.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75e80d2d60 con 0x7f75e80d2290 2024-09-17T03:38:14.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e80cef00 0x7f75e814eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e80cef00 0x7f75e814eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36460/0 (socket says 172.21.15.121:36460) 2024-09-17T03:38:14.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e6a00640 1 -- 172.21.15.121:0/9821604 learned_addr learned my addr 172.21.15.121:0/9821604 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:14.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e6000640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75e80d2290 0x7f75e81f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e7400640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75e815f6d0 0x7f75e80cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e6a00640 1 -- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75e80d2290 msgr2=0x7f75e81f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e6a00640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75e80d2290 0x7f75e81f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e6a00640 1 -- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75e815f6d0 msgr2=0x7f75e80cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e6a00640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75e815f6d0 0x7f75e80cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.459+0000 7f75e6a00640 1 -- 172.21.15.121:0/9821604 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e814f690 con 0x7f75e80cef00 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.460+0000 7f75e6a00640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e80cef00 0x7f75e814eb80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c3d0 tx=0x7f75d800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.460+0000 7f75dea00640 1 -- 172.21.15.121:0/9821604 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8017070 con 0x7f75e80cef00 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.460+0000 7f75dea00640 1 -- 172.21.15.121:0/9821604 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75d80053c0 con 0x7f75e80cef00 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.460+0000 7f75dea00640 1 -- 172.21.15.121:0/9821604 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8003850 con 0x7f75e80cef00 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.460+0000 7f75e7e00640 1 -- 172.21.15.121:0/9821604 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e814f970 con 0x7f75e80cef00 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.460+0000 7f75e7e00640 1 -- 172.21.15.121:0/9821604 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e814e320 con 0x7f75e80cef00 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.462+0000 7f75dea00640 1 -- 172.21.15.121:0/9821604 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75d801a070 con 0x7f75e80cef00 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.463+0000 7f75dea00640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75c8078bc0 0x7f75c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.463+0000 7f75dea00640 1 -- 172.21.15.121:0/9821604 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f75d809a240 con 0x7f75e80cef00 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.464+0000 7f75f4609740 1 Processor -- start 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.464+0000 7f75e6000640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75c8078bc0 0x7f75c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.464+0000 7f75f4609740 1 -- start start 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.465+0000 7f75e6000640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75c8078bc0 0x7f75c807b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f75d4033000 tx=0x7f75d4004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.465+0000 7f75f4609740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec102270 0x5592ec4d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.465+0000 7f75f4609740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0d93b0 0x5592ec4d30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.465+0000 7f75f4609740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0e1590 0x5592ec4a3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.465+0000 7f75f4609740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5592ec42c430 con 0x5592ec0d93b0 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.465+0000 7f75f4609740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5592ec41c5d0 con 0x5592ec0e1590 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.465+0000 7f75f4609740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5592ec40ba00 con 0x5592ec102270 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e6000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0d93b0 0x5592ec4d30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e6000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0d93b0 0x5592ec4d30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36470/0 (socket says 172.21.15.121:36470) 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e6000640 1 -- 172.21.15.121:0/2421797685 learned_addr learned my addr 172.21.15.121:0/2421797685 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e7400640 1 --2- 172.21.15.121:0/2421797685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0e1590 0x5592ec4a3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e6a00640 1 --2- 172.21.15.121:0/2421797685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec102270 0x5592ec4d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e6000640 1 -- 172.21.15.121:0/2421797685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec102270 msgr2=0x5592ec4d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e6000640 1 --2- 172.21.15.121:0/2421797685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec102270 0x5592ec4d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e6000640 1 -- 172.21.15.121:0/2421797685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0e1590 msgr2=0x5592ec4a3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e6000640 1 --2- 172.21.15.121:0/2421797685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0e1590 0x5592ec4a3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e6000640 1 -- 172.21.15.121:0/2421797685 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592ec3d4520 con 0x5592ec0d93b0 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.466+0000 7f75e6000640 1 --2- 172.21.15.121:0/2421797685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0d93b0 0x5592ec4d30a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f75d40099f0 tx=0x7f75d403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb2b9fe8adab49c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.467+0000 7f75d3000640 1 -- 172.21.15.121:0/2421797685 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d4035040 con 0x5592ec0d93b0 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.467+0000 7f75d3000640 1 -- 172.21.15.121:0/2421797685 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75d404d070 con 0x5592ec0d93b0 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.467+0000 7f75d3000640 1 -- 172.21.15.121:0/2421797685 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d4004bd0 con 0x5592ec0d93b0 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.467+0000 7f75f4609740 1 -- 172.21.15.121:0/2421797685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0d93b0 msgr2=0x5592ec4d30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.467+0000 7f75f4609740 1 --2- 172.21.15.121:0/2421797685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0d93b0 0x5592ec4d30a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f75d40099f0 tx=0x7f75d403d000 comp rx=0 tx=0).stop 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.467+0000 7f75f4609740 1 -- 172.21.15.121:0/2421797685 shutdown_connections 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.467+0000 7f75f4609740 1 --2- 172.21.15.121:0/2421797685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0e1590 0x5592ec4a3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.467+0000 7f75f4609740 1 --2- 172.21.15.121:0/2421797685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0d93b0 0x5592ec4d30a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.467+0000 7f75f4609740 1 --2- 172.21.15.121:0/2421797685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec102270 0x5592ec4d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.467+0000 7f75f4609740 1 -- 172.21.15.121:0/2421797685 >> 172.21.15.121:0/2421797685 conn(0x5592ec0f63c0 msgr2=0x5592ec4a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.468+0000 7f75f4609740 1 -- 172.21.15.121:0/2421797685 shutdown_connections 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.468+0000 7f75f4609740 1 -- 172.21.15.121:0/2421797685 wait complete. 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.469+0000 7f75f4609740 1 -- start start 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.469+0000 7f75f4609740 1 Processor -- start 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.470+0000 7f75f4609740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0d93b0 0x5592ec4d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.470+0000 7f75f4609740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4bcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.470+0000 7f75f4609740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec102270 0x5592ec4e7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.470+0000 7f75f4609740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5592ec3b2330 con 0x5592ec0e1590 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.470+0000 7f75f4609740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5592ec40f810 con 0x5592ec0d93b0 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.470+0000 7f75f4609740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5592ec17c620 con 0x5592ec102270 2024-09-17T03:38:14.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.470+0000 7f75f4609740 10 client.0 _ll_register_callbacks cb 0x5592ec3b7420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e6000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4bcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e6000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4bcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36474/0 (socket says 172.21.15.121:36474) 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e6000640 1 -- 172.21.15.121:0/1667249038 learned_addr learned my addr 172.21.15.121:0/1667249038 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e6a00640 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0d93b0 0x5592ec4d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e7400640 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec102270 0x5592ec4e7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e6000640 1 -- 172.21.15.121:0/1667249038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec102270 msgr2=0x5592ec4e7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e6000640 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec102270 0x5592ec4e7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e6000640 1 -- 172.21.15.121:0/1667249038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0d93b0 msgr2=0x5592ec4d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e6000640 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0d93b0 0x5592ec4d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e6000640 1 -- 172.21.15.121:0/1667249038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592ec16d850 con 0x5592ec0e1590 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75e6000640 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4bcf50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f75d4000c00 tx=0x7f75d4004ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f724093ee13bedf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.471+0000 7f75c7400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:38:14.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75c7400640 1 -- 172.21.15.121:0/1667249038 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d40035f0 con 0x5592ec0e1590 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75c7400640 1 -- 172.21.15.121:0/1667249038 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f75d405ccf0 con 0x5592ec0e1590 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75f4609740 1 -- 172.21.15.121:0/1667249038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75d404d070 con 0x5592ec0e1590 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75c7400640 1 -- 172.21.15.121:0/1667249038 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f75d4003790 con 0x5592ec0e1590 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75f4609740 10 client.5886 fetch_fsmap learned FSMap version 40 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75f4609740 1 -- 172.21.15.121:0/1667249038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5592ec1e46b0 con 0x5592ec0e1590 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75c7400640 1 -- 172.21.15.121:0/1667249038 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75d404d070 con 0x5592ec0e1590 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75c7400640 1 -- 172.21.15.121:0/1667249038 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 40) ==== 3522+0+0 (secure 0 0 0) 0x7f75d4003930 con 0x5592ec0e1590 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75f4609740 10 client.5886 fetch_fsmap finished waiting for FSMap version 40 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75f4609740 10 client.5886 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75f4609740 20 client.5886 populate_metadata read hostname 'smithi121' 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75f4609740 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.121:6834/4058545170,v1:172.21.15.121:6835/4058545170] conn(0x5592ec0c0e40 0x5592ec4cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75f4609740 4 client.5886 mds_command: new command op to 5234 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:38:14.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.472+0000 7f75f4609740 1 -- 172.21.15.121:0/1667249038 --> [v2:172.21.15.121:6834/4058545170,v1:172.21.15.121:6835/4058545170] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592ec41e520 con 0x5592ec0c0e40 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.473+0000 7f75e6a00640 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.121:6834/4058545170,v1:172.21.15.121:6835/4058545170] conn(0x5592ec0c0e40 0x5592ec4cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.473+0000 7f75e6a00640 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.121:6834/4058545170,v1:172.21.15.121:6835/4058545170] conn(0x5592ec0c0e40 0x5592ec4cc500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b1b11844fc9f1667 server_cookie=c1c082fd84b3bf3 in_seq=0 out_seq=0 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.473+0000 7f75c7400640 10 client.5886 ms_handle_connect on v2:172.21.15.121:6834/4058545170 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.474+0000 7f75c7400640 1 -- 172.21.15.121:0/1667249038 <== mds.1 v2:172.21.15.121:6834/4058545170 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592ec41e520 con 0x5592ec0c0e40 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.474+0000 7f75c7400640 10 client.5886 handle_command_reply: tid=0 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.474+0000 7f75f4609740 1 client.5886 shutdown 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.474+0000 7f75f4609740 1 -- 172.21.15.121:0/1667249038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 msgr2=0x5592ec4bcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.474+0000 7f75f4609740 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4bcf50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f75d4000c00 tx=0x7f75d4004ae0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.475+0000 7f75f4609740 1 -- 172.21.15.121:0/1667249038 shutdown_connections 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.475+0000 7f75f4609740 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.121:6834/4058545170,v1:172.21.15.121:6835/4058545170] conn(0x5592ec0c0e40 0x5592ec4cc500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.475+0000 7f75f4609740 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec102270 0x5592ec4e7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.475+0000 7f75f4609740 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4bcf50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.475+0000 7f75c7400640 0 client.5886 ms_handle_reset on v2:172.21.15.121:6834/4058545170 2024-09-17T03:38:14.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.475+0000 7f75f4609740 1 --2- 172.21.15.121:0/1667249038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0d93b0 0x5592ec4d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.475+0000 7f75f4609740 1 -- 172.21.15.121:0/1667249038 >> 172.21.15.121:0/1667249038 conn(0x5592ec0f63c0 msgr2=0x5592ec4a1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.475+0000 7f75f4609740 1 -- 172.21.15.121:0/1667249038 shutdown_connections 2024-09-17T03:38:14.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.475+0000 7f75f4609740 1 -- 172.21.15.121:0/1667249038 wait complete. 2024-09-17T03:38:14.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.475+0000 7f75f4609740 20 client.5886 trim_cache size 0 max 16384 2024-09-17T03:38:14.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.494+0000 7f75f4609740 1 Processor -- start 2024-09-17T03:38:14.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.494+0000 7f75f4609740 1 -- start start 2024-09-17T03:38:14.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75f4609740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0d93b0 0x5592ec4ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75f4609740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec0e1590 0x5592ec4ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75f4609740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec102270 0x5592ec4fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75f4609740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f75e8202550 con 0x5592ec102270 2024-09-17T03:38:14.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75f4609740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75e814de60 con 0x5592ec0d93b0 2024-09-17T03:38:14.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75f4609740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75e81f8ab0 con 0x5592ec0e1590 2024-09-17T03:38:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75e7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec102270 0x5592ec4fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75e7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec102270 0x5592ec4fbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36490/0 (socket says 172.21.15.121:36490) 2024-09-17T03:38:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75e7400640 1 -- 172.21.15.121:0/56132115 learned_addr learned my addr 172.21.15.121:0/56132115 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75e6a00640 1 --2- 172.21.15.121:0/56132115 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0d93b0 0x5592ec4ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.495+0000 7f75e6000640 1 --2- 172.21.15.121:0/56132115 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec0e1590 0x5592ec4ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.496+0000 7f75e7400640 1 -- 172.21.15.121:0/56132115 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec0e1590 msgr2=0x5592ec4ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.496+0000 7f75e7400640 1 --2- 172.21.15.121:0/56132115 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec0e1590 0x5592ec4ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.496+0000 7f75e7400640 1 -- 172.21.15.121:0/56132115 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0d93b0 msgr2=0x5592ec4ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.496+0000 7f75e7400640 1 --2- 172.21.15.121:0/56132115 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0d93b0 0x5592ec4ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.496+0000 7f75e7400640 1 -- 172.21.15.121:0/56132115 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592ec4ee720 con 0x5592ec102270 2024-09-17T03:38:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.496+0000 7f75e7400640 1 --2- 172.21.15.121:0/56132115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec102270 0x5592ec4fbd40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f75e00123f0 tx=0x7f75e00128b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970bb90ba91707f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.496+0000 7f75d2600640 1 -- 172.21.15.121:0/56132115 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0003970 con 0x5592ec102270 2024-09-17T03:38:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.496+0000 7f75d2600640 1 -- 172.21.15.121:0/56132115 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75e0003b10 con 0x5592ec102270 2024-09-17T03:38:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.496+0000 7f75d2600640 1 -- 172.21.15.121:0/56132115 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0004020 con 0x5592ec102270 2024-09-17T03:38:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.497+0000 7f75f4609740 1 -- 172.21.15.121:0/56132115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec102270 msgr2=0x5592ec4fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.497+0000 7f75f4609740 1 --2- 172.21.15.121:0/56132115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec102270 0x5592ec4fbd40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f75e00123f0 tx=0x7f75e00128b0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.497+0000 7f75f4609740 1 -- 172.21.15.121:0/56132115 shutdown_connections 2024-09-17T03:38:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.497+0000 7f75f4609740 1 --2- 172.21.15.121:0/56132115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec102270 0x5592ec4fbd40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.497+0000 7f75f4609740 1 --2- 172.21.15.121:0/56132115 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec0e1590 0x5592ec4ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.497+0000 7f75f4609740 1 --2- 172.21.15.121:0/56132115 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec0d93b0 0x5592ec4ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.497+0000 7f75f4609740 1 -- 172.21.15.121:0/56132115 >> 172.21.15.121:0/56132115 conn(0x5592ec0f63c0 msgr2=0x5592ec4e8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.497+0000 7f75f4609740 1 -- 172.21.15.121:0/56132115 shutdown_connections 2024-09-17T03:38:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.497+0000 7f75f4609740 1 -- 172.21.15.121:0/56132115 wait complete. 2024-09-17T03:38:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.498+0000 7f75f4609740 1 -- start start 2024-09-17T03:38:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.498+0000 7f75f4609740 1 Processor -- start 2024-09-17T03:38:14.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75f4609740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec0d93b0 0x5592ec56a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75f4609740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4feb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75f4609740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec102270 0x5592ec4ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75f4609740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5592ec4cd580 con 0x5592ec0e1590 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75f4609740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5592ec4cf6c0 con 0x5592ec102270 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75f4609740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5592ec5004a0 con 0x5592ec0d93b0 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75f4609740 10 client.0 _ll_register_callbacks cb 0x7f75d40056c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75e6000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4feb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75e6000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4feb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36494/0 (socket says 172.21.15.121:36494) 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75e6000640 1 -- 172.21.15.121:0/2853690129 learned_addr learned my addr 172.21.15.121:0/2853690129 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75e7400640 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec102270 0x5592ec4ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75e6a00640 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec0d93b0 0x5592ec56a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75e6000640 1 -- 172.21.15.121:0/2853690129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec0d93b0 msgr2=0x5592ec56a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75e6000640 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec0d93b0 0x5592ec56a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75e6000640 1 -- 172.21.15.121:0/2853690129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec102270 msgr2=0x5592ec4ff0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75e6000640 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec102270 0x5592ec4ff0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.500+0000 7f75e6000640 1 -- 172.21.15.121:0/2853690129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592ec4a9840 con 0x5592ec0e1590 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.501+0000 7f75e6000640 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4feb70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f75d40054e0 tx=0x7f75d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638b2c1f7dd08df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.501+0000 7f75c7400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.501+0000 7f75c7400640 1 -- 172.21.15.121:0/2853690129 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d4040070 con 0x5592ec0e1590 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.501+0000 7f75c7400640 1 -- 172.21.15.121:0/2853690129 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f75d405d930 con 0x5592ec0e1590 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.501+0000 7f75f4609740 1 -- 172.21.15.121:0/2853690129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75e0003b10 con 0x5592ec0e1590 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.501+0000 7f75c7400640 1 -- 172.21.15.121:0/2853690129 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f75d40035f0 con 0x5592ec0e1590 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.501+0000 7f75f4609740 10 client.5892 fetch_fsmap learned FSMap version 40 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.501+0000 7f75f4609740 1 -- 172.21.15.121:0/2853690129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5592ec4ee330 con 0x5592ec0e1590 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.501+0000 7f75c7400640 1 -- 172.21.15.121:0/2853690129 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75e0003b10 con 0x5592ec0e1590 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.502+0000 7f75c7400640 1 -- 172.21.15.121:0/2853690129 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 40) ==== 3522+0+0 (secure 0 0 0) 0x7f75d405db30 con 0x5592ec0e1590 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.502+0000 7f75f4609740 10 client.5892 fetch_fsmap finished waiting for FSMap version 40 2024-09-17T03:38:14.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.502+0000 7f75f4609740 10 client.5892 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:38:14.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.502+0000 7f75f4609740 20 client.5892 populate_metadata read hostname 'smithi121' 2024-09-17T03:38:14.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.502+0000 7f75f4609740 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.121:6834/4058545170,v1:172.21.15.121:6835/4058545170] conn(0x5592ec56d8c0 0x5592ec4ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.502+0000 7f75f4609740 4 client.5892 mds_command: new command op to 5234 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:38:14.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.502+0000 7f75f4609740 1 -- 172.21.15.121:0/2853690129 --> [v2:172.21.15.121:6834/4058545170,v1:172.21.15.121:6835/4058545170] -- command(tid 0: {"prefix": "status"}) -- 0x5592ec4a7120 con 0x5592ec56d8c0 2024-09-17T03:38:14.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.502+0000 7f75e6a00640 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.121:6834/4058545170,v1:172.21.15.121:6835/4058545170] conn(0x5592ec56d8c0 0x5592ec4ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.502+0000 7f75c7400640 10 client.5892 ms_handle_connect on v2:172.21.15.121:6834/4058545170 2024-09-17T03:38:14.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.502+0000 7f75e6a00640 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.121:6834/4058545170,v1:172.21.15.121:6835/4058545170] conn(0x5592ec56d8c0 0x5592ec4ca8a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bafcece47a58348b server_cookie=ad156da97f522e3a in_seq=0 out_seq=0 2024-09-17T03:38:14.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75c7400640 1 -- 172.21.15.121:0/2853690129 <== mds.1 v2:172.21.15.121:6834/4058545170 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5592ec4a7120 con 0x5592ec56d8c0 2024-09-17T03:38:14.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75c7400640 10 client.5892 handle_command_reply: tid=0 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 client.5892 shutdown 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 -- 172.21.15.121:0/2853690129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 msgr2=0x5592ec4feb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4feb70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f75d40054e0 tx=0x7f75d40046c0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 -- 172.21.15.121:0/2853690129 shutdown_connections 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.121:6834/4058545170,v1:172.21.15.121:6835/4058545170] conn(0x5592ec56d8c0 0x5592ec4ca8a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5592ec102270 0x5592ec4ff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5592ec0e1590 0x5592ec4feb70 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75c7400640 0 client.5892 ms_handle_reset on v2:172.21.15.121:6834/4058545170 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 --2- 172.21.15.121:0/2853690129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5592ec0d93b0 0x5592ec56a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 -- 172.21.15.121:0/2853690129 >> 172.21.15.121:0/2853690129 conn(0x5592ec0f63c0 msgr2=0x5592ec4ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 -- 172.21.15.121:0/2853690129 shutdown_connections 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 1 -- 172.21.15.121:0/2853690129 wait complete. 2024-09-17T03:38:14.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.503+0000 7f75f4609740 20 client.5892 trim_cache size 0 max 16384 2024-09-17T03:38:14.507 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:38:14.507 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:38:14.507 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 1, 2024-09-17T03:38:14.507 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 5234, 2024-09-17T03:38:14.507 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:38:14.507 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:38:14.507 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:38:14.507 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 3.0782333519999998, 2024-09-17T03:38:14.507 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 40, 2024-09-17T03:38:14.507 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 65, 2024-09-17T03:38:14.508 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 65, 2024-09-17T03:38:14.508 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 19.318913978000001 2024-09-17T03:38:14.508 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:38:14.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 -- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75c8078bc0 msgr2=0x7f75c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75c8078bc0 0x7f75c807b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f75d4033000 tx=0x7f75d4004730 comp rx=0 tx=0).stop 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 -- 172.21.15.121:0/9821604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e80cef00 msgr2=0x7f75e814eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e80cef00 0x7f75e814eb80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c3d0 tx=0x7f75d800c890 comp rx=0 tx=0).stop 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 -- 172.21.15.121:0/9821604 shutdown_connections 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75e815f6d0 0x7f75e80cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75e80d2290 0x7f75e81f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75c8078bc0 0x7f75c807b0d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 --2- 172.21.15.121:0/9821604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e80cef00 0x7f75e814eb80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 -- 172.21.15.121:0/9821604 >> 172.21.15.121:0/9821604 conn(0x7f75e80d41e0 msgr2=0x7f75e815d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 -- 172.21.15.121:0/9821604 shutdown_connections 2024-09-17T03:38:14.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.504+0000 7f75e7e00640 1 -- 172.21.15.121:0/9821604 wait complete. 2024-09-17T03:38:14.525 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:38:14.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.746+0000 7f2caac00640 1 -- 172.21.15.121:0/1820512931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40ccc40 msgr2=0x7f2ca415ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.746+0000 7f2caac00640 1 --2- 172.21.15.121:0/1820512931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40ccc40 0x7f2ca415ca90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40cd050 tx=0x7f2c9402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.746+0000 7f2caac00640 1 -- 172.21.15.121:0/1820512931 shutdown_connections 2024-09-17T03:38:14.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.746+0000 7f2caac00640 1 --2- 172.21.15.121:0/1820512931 >> v2:172.21.15.176:3300/0 conn(0x7f2ca40d0d80 0x7f2ca40b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.746+0000 7f2caac00640 1 --2- 172.21.15.121:0/1820512931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40ccc40 0x7f2ca415ca90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.746+0000 7f2caac00640 1 -- 172.21.15.121:0/1820512931 >> 172.21.15.121:0/1820512931 conn(0x7f2ca40b46e0 msgr2=0x7f2ca40d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.746+0000 7f2caac00640 1 -- 172.21.15.121:0/1820512931 shutdown_connections 2024-09-17T03:38:14.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.747+0000 7f2caac00640 1 -- 172.21.15.121:0/1820512931 wait complete. 2024-09-17T03:38:14.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.749+0000 7f2caac00640 1 Processor -- start 2024-09-17T03:38:14.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.749+0000 7f2caac00640 1 -- start start 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.750+0000 7f2caac00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40ccc40 0x7f2ca41f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.750+0000 7f2caac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca40cd440 0x7f2ca415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.750+0000 7f2caac00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca415e200 0x7f2ca415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.750+0000 7f2caac00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca40b6650 con 0x7f2ca40ccc40 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.750+0000 7f2caac00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca40b64d0 con 0x7f2ca415e200 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.750+0000 7f2caac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca40b67d0 con 0x7f2ca40cd440 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40ccc40 0x7f2ca41f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40ccc40 0x7f2ca41f90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36518/0 (socket says 172.21.15.121:36518) 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca3e00640 1 -- 172.21.15.121:0/1120263478 learned_addr learned my addr 172.21.15.121:0/1120263478 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca8c00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca415e200 0x7f2ca415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca3400640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca40cd440 0x7f2ca415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca3e00640 1 -- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca40cd440 msgr2=0x7f2ca415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca40cd440 0x7f2ca415dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca3e00640 1 -- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca415e200 msgr2=0x7f2ca415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca415e200 0x7f2ca415b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca3e00640 1 -- 172.21.15.121:0/1120263478 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca415e8f0 con 0x7f2ca40ccc40 2024-09-17T03:38:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca8c00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca415e200 0x7f2ca415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.751+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40ccc40 0x7f2ca41f90a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2c9402aa90 tx=0x7f2c94033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.752+0000 7f2c9be00640 1 -- 172.21.15.121:0/1120263478 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94005c90 con 0x7f2ca40ccc40 2024-09-17T03:38:14.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.752+0000 7f2c9be00640 1 -- 172.21.15.121:0/1120263478 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c94031e50 con 0x7f2ca40ccc40 2024-09-17T03:38:14.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.752+0000 7f2c9be00640 1 -- 172.21.15.121:0/1120263478 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94005240 con 0x7f2ca40ccc40 2024-09-17T03:38:14.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.752+0000 7f2caac00640 1 -- 172.21.15.121:0/1120263478 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca40cc630 con 0x7f2ca40ccc40 2024-09-17T03:38:14.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.752+0000 7f2caac00640 1 -- 172.21.15.121:0/1120263478 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca41f5600 con 0x7f2ca40ccc40 2024-09-17T03:38:14.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.754+0000 7f2c9be00640 1 -- 172.21.15.121:0/1120263478 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c940053e0 con 0x7f2ca40ccc40 2024-09-17T03:38:14.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.755+0000 7f2c9be00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c84078b90 0x7f2c8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.755+0000 7f2c9be00640 1 -- 172.21.15.121:0/1120263478 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f2c940bc120 con 0x7f2ca40ccc40 2024-09-17T03:38:14.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.756+0000 7f2ca3400640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c84078b90 0x7f2c8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.756+0000 7f2cb1c78740 1 Processor -- start 2024-09-17T03:38:14.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.756+0000 7f2cb1c78740 1 -- start start 2024-09-17T03:38:14.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.756+0000 7f2ca3400640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c84078b90 0x7f2c8407b0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40c8270 tx=0x7f2c90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.757+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 0x562badf3d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.757+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb443b0 0x562badf3deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.757+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf0df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.757+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562bade97430 con 0x562badb4c590 2024-09-17T03:38:14.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.757+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562bade875d0 con 0x562badb443b0 2024-09-17T03:38:14.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.757+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562bade76a00 con 0x562badb6d270 2024-09-17T03:38:14.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.757+0000 7f2ca8c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf0df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca8c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf0df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36526/0 (socket says 172.21.15.121:36526) 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca8c00640 1 -- 172.21.15.121:0/587999713 learned_addr learned my addr 172.21.15.121:0/587999713 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca3400640 1 --2- 172.21.15.121:0/587999713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb443b0 0x562badf3deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/587999713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 0x562badf3d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca8c00640 1 -- 172.21.15.121:0/587999713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 msgr2=0x562badf3d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca8c00640 1 --2- 172.21.15.121:0/587999713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 0x562badf3d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca8c00640 1 -- 172.21.15.121:0/587999713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb443b0 msgr2=0x562badf3deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca8c00640 1 --2- 172.21.15.121:0/587999713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb443b0 0x562badf3deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca8c00640 1 -- 172.21.15.121:0/587999713 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bade3f520 con 0x562badb4c590 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/587999713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 0x562badf3d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2ca8c00640 1 --2- 172.21.15.121:0/587999713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf0df60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009f40 tx=0x7f2c9c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdc4dc1917a396b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2c8fe00640 1 -- 172.21.15.121:0/587999713 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c015070 con 0x562badb4c590 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2c8fe00640 1 -- 172.21.15.121:0/587999713 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c9c004e10 con 0x562badb4c590 2024-09-17T03:38:14.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.758+0000 7f2c8fe00640 1 -- 172.21.15.121:0/587999713 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c003bd0 con 0x562badb4c590 2024-09-17T03:38:14.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.759+0000 7f2cb1c78740 1 -- 172.21.15.121:0/587999713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 msgr2=0x562badf0df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.759+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/587999713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf0df60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009f40 tx=0x7f2c9c00f7f0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.759+0000 7f2cb1c78740 1 -- 172.21.15.121:0/587999713 shutdown_connections 2024-09-17T03:38:14.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.759+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/587999713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf0df60 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.759+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/587999713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb443b0 0x562badf3deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.759+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/587999713 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 0x562badf3d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.759+0000 7f2cb1c78740 1 -- 172.21.15.121:0/587999713 >> 172.21.15.121:0/587999713 conn(0x562badb613c0 msgr2=0x562badf13970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.759+0000 7f2cb1c78740 1 -- 172.21.15.121:0/587999713 shutdown_connections 2024-09-17T03:38:14.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.759+0000 7f2cb1c78740 1 -- 172.21.15.121:0/587999713 wait complete. 2024-09-17T03:38:14.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.760+0000 7f2cb1c78740 1 -- start start 2024-09-17T03:38:14.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.761+0000 7f2cb1c78740 1 Processor -- start 2024-09-17T03:38:14.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.762+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 0x562badf33610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.762+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf53630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.762+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb6d270 0x562badf53b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.762+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562bade1d330 con 0x562badb4c590 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.762+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562bade7a810 con 0x562badb6d270 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.762+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562badbe7620 con 0x562badb443b0 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.762+0000 7f2cb1c78740 10 client.0 _ll_register_callbacks cb 0x562bade22420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.762+0000 7f2ca3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf53630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.762+0000 7f2ca3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf53630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36542/0 (socket says 172.21.15.121:36542) 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.762+0000 7f2ca3400640 1 -- 172.21.15.121:0/2701260057 learned_addr learned my addr 172.21.15.121:0/2701260057 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2ca8c00640 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb6d270 0x562badf53b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 0x562badf33610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2ca3400640 1 -- 172.21.15.121:0/2701260057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 msgr2=0x562badf33610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2ca3400640 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 0x562badf33610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2ca3400640 1 -- 172.21.15.121:0/2701260057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb6d270 msgr2=0x562badf53b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2ca3400640 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb6d270 0x562badf53b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2ca3400640 1 -- 172.21.15.121:0/2701260057 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562badbd8850 con 0x562badb4c590 2024-09-17T03:38:14.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 0x562badf33610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:14.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2ca3400640 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf53630 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40d1410 tx=0x7f2c90004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2eb154aa403dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2c8cc00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:38:14.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2c8cc00640 1 -- 172.21.15.121:0/2701260057 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000ed70 con 0x562badb4c590 2024-09-17T03:38:14.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2cb1c78740 1 -- 172.21.15.121:0/2701260057 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c9c004e10 con 0x562badb4c590 2024-09-17T03:38:14.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.763+0000 7f2c8cc00640 1 -- 172.21.15.121:0/2701260057 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f2c9001e040 con 0x562badb4c590 2024-09-17T03:38:14.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2c8cc00640 1 -- 172.21.15.121:0/2701260057 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2c9002d050 con 0x562badb4c590 2024-09-17T03:38:14.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2cb1c78740 10 client.5907 fetch_fsmap learned FSMap version 40 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2cb1c78740 1 -- 172.21.15.121:0/2701260057 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x562badc4f6b0 con 0x562badb4c590 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2c8cc00640 1 -- 172.21.15.121:0/2701260057 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c9c004e10 con 0x562badb4c590 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2c8cc00640 1 -- 172.21.15.121:0/2701260057 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 40) ==== 3522+0+0 (secure 0 0 0) 0x7f2c90030020 con 0x562badb4c590 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2cb1c78740 10 client.5907 fetch_fsmap finished waiting for FSMap version 40 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2cb1c78740 10 client.5907 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2cb1c78740 20 client.5907 populate_metadata read hostname 'smithi121' 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x562badb2be40 0x562badf39780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2cb1c78740 4 client.5907 mds_command: new command op to 5712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2cb1c78740 1 -- 172.21.15.121:0/2701260057 --> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bade89520 con 0x562badb2be40 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.764+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x562badb2be40 0x562badf39780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.765+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x562badb2be40 0x562badf39780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dc8206824704eea server_cookie=66eac14860c5689f in_seq=0 out_seq=0 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.765+0000 7f2c8cc00640 10 client.5907 ms_handle_connect on v2:172.21.15.121:6832/3893444987 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.765+0000 7f2c8cc00640 1 -- 172.21.15.121:0/2701260057 <== mds.0 v2:172.21.15.121:6832/3893444987 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562bade89520 con 0x562badb2be40 2024-09-17T03:38:14.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2c8cc00640 10 client.5907 handle_command_reply: tid=0 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 client.5907 shutdown 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 -- 172.21.15.121:0/2701260057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 msgr2=0x562badf53630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf53630 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40d1410 tx=0x7f2c90004620 comp rx=0 tx=0).stop 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 -- 172.21.15.121:0/2701260057 shutdown_connections 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x562badb2be40 0x562badf39780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb6d270 0x562badf53b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf53630 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/2701260057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 0x562badf33610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2c8cc00640 0 client.5907 ms_handle_reset on v2:172.21.15.121:6832/3893444987 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 -- 172.21.15.121:0/2701260057 >> 172.21.15.121:0/2701260057 conn(0x562badb613c0 msgr2=0x562badf5b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 -- 172.21.15.121:0/2701260057 shutdown_connections 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 1 -- 172.21.15.121:0/2701260057 wait complete. 2024-09-17T03:38:14.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.766+0000 7f2cb1c78740 20 client.5907 trim_cache size 0 max 16384 2024-09-17T03:38:14.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.785+0000 7f2cb1c78740 1 Processor -- start 2024-09-17T03:38:14.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.785+0000 7f2cb1c78740 1 -- start start 2024-09-17T03:38:14.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.786+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb443b0 0x562badf0f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.786+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb4c590 0x562badf7bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.786+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 0x562badf7c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.786+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca4202870 con 0x562badb443b0 2024-09-17T03:38:14.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.786+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca4200af0 con 0x562badb4c590 2024-09-17T03:38:14.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.786+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca4201130 con 0x562badb6d270 2024-09-17T03:38:14.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb443b0 0x562badf0f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb443b0 0x562badf0f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36554/0 (socket says 172.21.15.121:36554) 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca3e00640 1 -- 172.21.15.121:0/3082160569 learned_addr learned my addr 172.21.15.121:0/3082160569 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca3400640 1 --2- 172.21.15.121:0/3082160569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb4c590 0x562badf7bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca8c00640 1 --2- 172.21.15.121:0/3082160569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 0x562badf7c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca3e00640 1 -- 172.21.15.121:0/3082160569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 msgr2=0x562badf7c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/3082160569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 0x562badf7c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca3e00640 1 -- 172.21.15.121:0/3082160569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb4c590 msgr2=0x562badf7bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/3082160569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb4c590 0x562badf7bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca3e00640 1 -- 172.21.15.121:0/3082160569 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562badf14650 con 0x562badb443b0 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/3082160569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb443b0 0x562badf0f0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2c94000c00 tx=0x7f2c9402a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307cac4fd0377429 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.787+0000 7f2c8f400640 1 -- 172.21.15.121:0/3082160569 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94048040 con 0x562badb443b0 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2c8f400640 1 -- 172.21.15.121:0/3082160569 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c94031770 con 0x562badb443b0 2024-09-17T03:38:14.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2c8f400640 1 -- 172.21.15.121:0/3082160569 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94084290 con 0x562badb443b0 2024-09-17T03:38:14.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2cb1c78740 1 -- 172.21.15.121:0/3082160569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb443b0 msgr2=0x562badf0f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/3082160569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb443b0 0x562badf0f0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2c94000c00 tx=0x7f2c9402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2cb1c78740 1 -- 172.21.15.121:0/3082160569 shutdown_connections 2024-09-17T03:38:14.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/3082160569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb6d270 0x562badf7c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/3082160569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb4c590 0x562badf7bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/3082160569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb443b0 0x562badf0f0a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2cb1c78740 1 -- 172.21.15.121:0/3082160569 >> 172.21.15.121:0/3082160569 conn(0x562badb613c0 msgr2=0x562badf113d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2cb1c78740 1 -- 172.21.15.121:0/3082160569 shutdown_connections 2024-09-17T03:38:14.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.788+0000 7f2cb1c78740 1 -- 172.21.15.121:0/3082160569 wait complete. 2024-09-17T03:38:14.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.789+0000 7f2cb1c78740 1 -- start start 2024-09-17T03:38:14.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.790+0000 7f2cb1c78740 1 Processor -- start 2024-09-17T03:38:14.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 0x562badf7c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf113d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2cb1c78740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb6d270 0x562badf11910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562badf6b6f0 con 0x562badb4c590 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562badf34470 con 0x562badb6d270 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2cb1c78740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562badf6bd10 con 0x562badb443b0 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2cb1c78740 10 client.0 _ll_register_callbacks cb 0x7f2c90015790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2ca3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2ca3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf113d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36570/0 (socket says 172.21.15.121:36570) 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2ca3400640 1 -- 172.21.15.121:0/1040269852 learned_addr learned my addr 172.21.15.121:0/1040269852 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 0x562badf7c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.791+0000 7f2ca8c00640 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb6d270 0x562badf11910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2ca3400640 1 -- 172.21.15.121:0/1040269852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 msgr2=0x562badf7c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2ca3400640 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 0x562badf7c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2ca3400640 1 -- 172.21.15.121:0/1040269852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb6d270 msgr2=0x562badf11910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2ca3400640 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb6d270 0x562badf11910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2ca3400640 1 -- 172.21.15.121:0/1040269852 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562badf7c7a0 con 0x562badb4c590 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2ca3400640 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf113d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x562badf6c7b0 tx=0x7f2c90005460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8346596872186242 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2c8cc00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2c8cc00640 1 -- 172.21.15.121:0/1040269852 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90035070 con 0x562badb4c590 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2c8cc00640 1 -- 172.21.15.121:0/1040269852 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f2c90026040 con 0x562badb4c590 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2cb1c78740 1 -- 172.21.15.121:0/1040269852 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c94031770 con 0x562badb4c590 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.792+0000 7f2c8cc00640 1 -- 172.21.15.121:0/1040269852 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2c90041050 con 0x562badb4c590 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2cb1c78740 10 client.5913 fetch_fsmap learned FSMap version 40 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2cb1c78740 1 -- 172.21.15.121:0/1040269852 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x562badf7afd0 con 0x562badb4c590 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2c8cc00640 1 -- 172.21.15.121:0/1040269852 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c94031770 con 0x562badb4c590 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2c8cc00640 1 -- 172.21.15.121:0/1040269852 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 40) ==== 3522+0+0 (secure 0 0 0) 0x7f2c90030030 con 0x562badb4c590 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2cb1c78740 10 client.5913 fetch_fsmap finished waiting for FSMap version 40 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2cb1c78740 10 client.5913 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2cb1c78740 20 client.5913 populate_metadata read hostname 'smithi121' 2024-09-17T03:38:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x562badfd92a0 0x562badfdbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2cb1c78740 4 client.5913 mds_command: new command op to 5712 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2cb1c78740 1 -- 172.21.15.121:0/1040269852 --> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] -- command(tid 0: {"prefix": "status"}) -- 0x562badf11f30 con 0x562badfd92a0 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.793+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x562badfd92a0 0x562badfdbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2c8cc00640 10 client.5913 ms_handle_connect on v2:172.21.15.121:6832/3893444987 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2ca3e00640 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x562badfd92a0 0x562badfdbc90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca777ae3aa8ac0d server_cookie=a0e125b43762b43e in_seq=0 out_seq=0 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2c8cc00640 1 -- 172.21.15.121:0/1040269852 <== mds.0 v2:172.21.15.121:6832/3893444987 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562badf11f30 con 0x562badfd92a0 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2c8cc00640 10 client.5913 handle_command_reply: tid=0 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 client.5913 shutdown 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 -- 172.21.15.121:0/1040269852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 msgr2=0x562badf113d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf113d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x562badf6c7b0 tx=0x7f2c90005460 comp rx=0 tx=0).stop 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 -- 172.21.15.121:0/1040269852 shutdown_connections 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.121:6832/3893444987,v1:172.21.15.121:6833/3893444987] conn(0x562badfd92a0 0x562badfdbc90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562badb6d270 0x562badf11910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562badb4c590 0x562badf113d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 --2- 172.21.15.121:0/1040269852 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562badb443b0 0x562badf7c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2c8cc00640 0 client.5913 ms_handle_reset on v2:172.21.15.121:6832/3893444987 2024-09-17T03:38:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 -- 172.21.15.121:0/1040269852 >> 172.21.15.121:0/1040269852 conn(0x562badb613c0 msgr2=0x562badf3ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 -- 172.21.15.121:0/1040269852 shutdown_connections 2024-09-17T03:38:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.794+0000 7f2cb1c78740 1 -- 172.21.15.121:0/1040269852 wait complete. 2024-09-17T03:38:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2cb1c78740 20 client.5913 trim_cache size 0 max 16384 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 5712, 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 14.581292596000001, 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 40, 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 65, 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 65, 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 19.618332179999999 2024-09-17T03:38:14.799 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:38:14.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 -- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c84078b90 msgr2=0x7f2c8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c84078b90 0x7f2c8407b0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40c8270 tx=0x7f2c90009040 comp rx=0 tx=0).stop 2024-09-17T03:38:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 -- 172.21.15.121:0/1120263478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40ccc40 msgr2=0x7f2ca41f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40ccc40 0x7f2ca41f90a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2c9402aa90 tx=0x7f2c94033c20 comp rx=0 tx=0).stop 2024-09-17T03:38:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 -- 172.21.15.121:0/1120263478 shutdown_connections 2024-09-17T03:38:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca415e200 0x7f2ca415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca40cd440 0x7f2ca415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c84078b90 0x7f2c8407b0a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 --2- 172.21.15.121:0/1120263478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca40ccc40 0x7f2ca41f90a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 -- 172.21.15.121:0/1120263478 >> 172.21.15.121:0/1120263478 conn(0x7f2ca40b46e0 msgr2=0x7f2ca40b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 -- 172.21.15.121:0/1120263478 shutdown_connections 2024-09-17T03:38:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:14.795+0000 7f2caac00640 1 -- 172.21.15.121:0/1120263478 wait complete. 2024-09-17T03:38:14.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:38:14.825 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:38:14.919 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-09-17T03:38:14.919 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.920 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-09-17T03:38:14.921 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-09-17T03:38:14.922 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.121,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on skipped message = False 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = f24b1682-8755-41b1-8124-cbd8f88939a2 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:38:14.923 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.924 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 20 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 20 2024-09-17T03:38:14.925 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 10 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:38:14.926 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:38:14.927 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:38:14.928 INFO:teuthology.orchestra.run.smithi121.stdout: mon down mkfs grace = 300 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = "" 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout: client reconnect stale = True 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-09-17T03:38:14.929 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-09-17T03:38:14.930 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-09-17T03:38:14.931 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-17T03:38:14.931 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-17T03:38:14.932 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:38:14.933 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.121,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = f24b1682-8755-41b1-8124-cbd8f88939a2 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.935 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.936 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 20 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 20 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:38:14.937 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 10 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-17T03:38:14.938 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-17T03:38:14.939 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.940 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:38:14.941 INFO:teuthology.orchestra.run.smithi176.stdout: mon down mkfs grace = 300 2024-09-17T03:38:14.941 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:38:14.941 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-17T03:38:14.941 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-17T03:38:14.941 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-17T03:38:14.941 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-17T03:38:14.941 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:38:14.941 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:38:14.941 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-09-17T03:38:14.942 INFO:teuthology.orchestra.run.smithi176.stdout: client reconnect stale = True 2024-09-17T03:38:14.942 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-17T03:38:14.942 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-09-17T03:38:14.942 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-09-17T03:38:14.942 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-17T03:38:14.942 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-17T03:38:14.942 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-17T03:38:14.942 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-17T03:38:14.958 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:14.958 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:14.994 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:14.994 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:15.070 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:38:15.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.333+0000 7fea25800640 1 -- 172.21.15.121:0/984048633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea2006d620 msgr2=0x7fea200d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.333+0000 7fea25800640 1 --2- 172.21.15.121:0/984048633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea2006d620 0x7fea200d0630 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009830 tx=0x7fea0c02a480 comp rx=0 tx=0).stop 2024-09-17T03:38:15.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.333+0000 7fea25800640 1 -- 172.21.15.121:0/984048633 shutdown_connections 2024-09-17T03:38:15.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.333+0000 7fea25800640 1 --2- 172.21.15.121:0/984048633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea2006d620 0x7fea200d0630 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.333+0000 7fea25800640 1 --2- 172.21.15.121:0/984048633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea200cca80 0x7fea200707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.333+0000 7fea25800640 1 -- 172.21.15.121:0/984048633 >> 172.21.15.121:0/984048633 conn(0x7fea200b3580 msgr2=0x7fea200b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:15.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.333+0000 7fea25800640 1 -- 172.21.15.121:0/984048633 shutdown_connections 2024-09-17T03:38:15.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.333+0000 7fea25800640 1 -- 172.21.15.121:0/984048633 wait complete. 2024-09-17T03:38:15.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.335+0000 7fea25800640 1 Processor -- start 2024-09-17T03:38:15.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.336+0000 7fea25800640 1 -- start start 2024-09-17T03:38:15.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea25800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2006d620 0x7fea200c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:15.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea25800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea2006da30 0x7fea2015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:15.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea25800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea200cca80 0x7fea200c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:15.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea25800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fea200d0b70 con 0x7fea200cca80 2024-09-17T03:38:15.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea25800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea200d0cf0 con 0x7fea2006d620 2024-09-17T03:38:15.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea25800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea200d0e70 con 0x7fea2006da30 2024-09-17T03:38:15.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea1f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea200cca80 0x7fea200c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:15.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea1f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea200cca80 0x7fea200c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36588/0 (socket says 172.21.15.121:36588) 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea1f400640 1 -- 172.21.15.121:0/1798504222 learned_addr learned my addr 172.21.15.121:0/1798504222 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea1ea00640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2006d620 0x7fea200c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.337+0000 7fea1e000640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea2006da30 0x7fea2015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.338+0000 7fea1f400640 1 -- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea2006da30 msgr2=0x7fea2015b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.338+0000 7fea1f400640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea2006da30 0x7fea2015b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.338+0000 7fea1f400640 1 -- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2006d620 msgr2=0x7fea200c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.338+0000 7fea1f400640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2006d620 0x7fea200c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.338+0000 7fea1f400640 1 -- 172.21.15.121:0/1798504222 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea200c4020 con 0x7fea200cca80 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.338+0000 7fea1f400640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea200cca80 0x7fea200c5e90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fea1800c6f0 tx=0x7fea1800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.338+0000 7fea16a00640 1 -- 172.21.15.121:0/1798504222 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18017070 con 0x7fea200cca80 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.338+0000 7fea16a00640 1 -- 172.21.15.121:0/1798504222 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea18003c90 con 0x7fea200cca80 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.338+0000 7fea25800640 1 -- 172.21.15.121:0/1798504222 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea200c3d40 con 0x7fea200cca80 2024-09-17T03:38:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.338+0000 7fea16a00640 1 -- 172.21.15.121:0/1798504222 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18003e60 con 0x7fea200cca80 2024-09-17T03:38:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.339+0000 7fea25800640 1 -- 172.21.15.121:0/1798504222 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea201f6570 con 0x7fea200cca80 2024-09-17T03:38:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.340+0000 7fea25800640 1 -- 172.21.15.121:0/1798504222 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea200cc070 con 0x7fea200cca80 2024-09-17T03:38:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.341+0000 7fea16a00640 1 -- 172.21.15.121:0/1798504222 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea1801a070 con 0x7fea200cca80 2024-09-17T03:38:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.342+0000 7fea16a00640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fea00078bc0 0x7fea0007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.342+0000 7fea16a00640 1 -- 172.21.15.121:0/1798504222 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7fea1809a430 con 0x7fea200cca80 2024-09-17T03:38:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.342+0000 7fea1ea00640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fea00078bc0 0x7fea0007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.343+0000 7fea1ea00640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fea00078bc0 0x7fea0007b0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fea1000bb50 tx=0x7fea1000b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.346+0000 7fea16a00640 1 -- 172.21.15.121:0/1798504222 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea18062060 con 0x7fea200cca80 2024-09-17T03:38:15.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.543+0000 7fea25800640 1 -- 172.21.15.121:0/1798504222 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea200cc410 con 0x7fea200cca80 2024-09-17T03:38:15.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.543+0000 7fea16a00640 1 -- 172.21.15.121:0/1798504222 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) ==== 80+0+0 (secure 0 0 0) 0x7fea18066a90 con 0x7fea200cca80 2024-09-17T03:38:15.543 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:38:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 -- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fea00078bc0 msgr2=0x7fea0007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fea00078bc0 0x7fea0007b0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fea1000bb50 tx=0x7fea1000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 -- 172.21.15.121:0/1798504222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea200cca80 msgr2=0x7fea200c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea200cca80 0x7fea200c5e90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fea1800c6f0 tx=0x7fea1800cbb0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 -- 172.21.15.121:0/1798504222 shutdown_connections 2024-09-17T03:38:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fea00078bc0 0x7fea0007b0d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea200cca80 0x7fea200c5e90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea2006da30 0x7fea2015b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 --2- 172.21.15.121:0/1798504222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2006d620 0x7fea200c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 -- 172.21.15.121:0/1798504222 >> 172.21.15.121:0/1798504222 conn(0x7fea200b3580 msgr2=0x7fea20160e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:15.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 -- 172.21.15.121:0/1798504222 shutdown_connections 2024-09-17T03:38:15.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:15.546+0000 7fea25800640 1 -- 172.21.15.121:0/1798504222 wait complete. 2024-09-17T03:38:15.572 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:38:15.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:15.572 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:15.635 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:38:15.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:15.635 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:38:15.671 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:15.671 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:15.747 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:38:15.748 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:38:16.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.010+0000 7fe2f6a00640 1 -- 172.21.15.121:0/3871098509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f00b51c0 msgr2=0x7fe2f0160180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.010+0000 7fe2f6a00640 1 --2- 172.21.15.121:0/3871098509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f00b51c0 0x7fe2f0160180 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0146350 tx=0x7fe2dc02a560 comp rx=0 tx=0).stop 2024-09-17T03:38:16.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.011+0000 7fe2f6a00640 1 -- 172.21.15.121:0/3871098509 shutdown_connections 2024-09-17T03:38:16.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.011+0000 7fe2f6a00640 1 --2- 172.21.15.121:0/3871098509 >> v2:172.21.15.176:3300/0 conn(0x7fe2f01606c0 0x7fe2f015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.011+0000 7fe2f6a00640 1 --2- 172.21.15.121:0/3871098509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f00b51c0 0x7fe2f0160180 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.011+0000 7fe2f6a00640 1 --2- 172.21.15.121:0/3871098509 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2f0070810 0x7fe2f00b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.011+0000 7fe2f6a00640 1 -- 172.21.15.121:0/3871098509 >> 172.21.15.121:0/3871098509 conn(0x7fe2f00b2440 msgr2=0x7fe2f00d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:16.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.011+0000 7fe2f6a00640 1 -- 172.21.15.121:0/3871098509 shutdown_connections 2024-09-17T03:38:16.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.011+0000 7fe2f6a00640 1 -- 172.21.15.121:0/3871098509 wait complete. 2024-09-17T03:38:16.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.013+0000 7fe2f6a00640 1 Processor -- start 2024-09-17T03:38:16.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.013+0000 7fe2f6a00640 1 -- start start 2024-09-17T03:38:16.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.014+0000 7fe2f6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0070810 0x7fe2f0144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.014+0000 7fe2f6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2f00b51c0 0x7fe2f00cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.014+0000 7fe2f6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2f01606c0 0x7fe2f015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.014+0000 7fe2f6a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f00b30b0 con 0x7fe2f0070810 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.014+0000 7fe2f6a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f006f000 con 0x7fe2f01606c0 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.014+0000 7fe2f6a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f015d0d0 con 0x7fe2f00b51c0 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f5600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0070810 0x7fe2f0144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f5600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0070810 0x7fe2f0144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36606/0 (socket says 172.21.15.121:36606) 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f5600640 1 -- 172.21.15.121:0/2422703854 learned_addr learned my addr 172.21.15.121:0/2422703854 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f6000640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2f01606c0 0x7fe2f015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f4c00640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2f00b51c0 0x7fe2f00cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f5600640 1 -- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2f00b51c0 msgr2=0x7fe2f00cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f5600640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2f00b51c0 0x7fe2f00cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f5600640 1 -- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2f01606c0 msgr2=0x7fe2f015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f5600640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2f01606c0 0x7fe2f015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f5600640 1 -- 172.21.15.121:0/2422703854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f0074390 con 0x7fe2f0070810 2024-09-17T03:38:16.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.015+0000 7fe2f5600640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0070810 0x7fe2f0144760 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400d660 tx=0x7fe2e400db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:16.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.016+0000 7fe2ed600640 1 -- 172.21.15.121:0/2422703854 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4017070 con 0x7fe2f0070810 2024-09-17T03:38:16.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.016+0000 7fe2ed600640 1 -- 172.21.15.121:0/2422703854 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2e4005310 con 0x7fe2f0070810 2024-09-17T03:38:16.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.016+0000 7fe2f6a00640 1 -- 172.21.15.121:0/2422703854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f0074670 con 0x7fe2f0070810 2024-09-17T03:38:16.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.016+0000 7fe2ed600640 1 -- 172.21.15.121:0/2422703854 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4009820 con 0x7fe2f0070810 2024-09-17T03:38:16.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.016+0000 7fe2f6a00640 1 -- 172.21.15.121:0/2422703854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f0074c30 con 0x7fe2f0070810 2024-09-17T03:38:16.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.017+0000 7fe2f6a00640 1 -- 172.21.15.121:0/2422703854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f0160180 con 0x7fe2f0070810 2024-09-17T03:38:16.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.018+0000 7fe2ed600640 1 -- 172.21.15.121:0/2422703854 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe2e40099c0 con 0x7fe2f0070810 2024-09-17T03:38:16.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.019+0000 7fe2ed600640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe2d0078b90 0x7fe2d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.019+0000 7fe2ed600640 1 -- 172.21.15.121:0/2422703854 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7fe2e409afe0 con 0x7fe2f0070810 2024-09-17T03:38:16.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.019+0000 7fe2f4c00640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe2d0078b90 0x7fe2d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.020+0000 7fe2f4c00640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe2d0078b90 0x7fe2d007b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc033000 tx=0x7fe2dc004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:16.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.023+0000 7fe2ed600640 1 -- 172.21.15.121:0/2422703854 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe2e40632b0 con 0x7fe2f0070810 2024-09-17T03:38:16.190 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-17T03:38:16.190+0000 7f0c19800640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-17T03:38:16.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.246+0000 7fe2f6a00640 1 -- 172.21.15.121:0/2422703854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe2f00b1a60 con 0x7fe2f0070810 2024-09-17T03:38:16.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.246+0000 7fe2ed600640 1 -- 172.21.15.121:0/2422703854 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) ==== 53+0+73 (secure 0 0 0) 0x7fe2e4062bb0 con 0x7fe2f0070810 2024-09-17T03:38:16.246 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:38:16.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 -- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe2d0078b90 msgr2=0x7fe2d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe2d0078b90 0x7fe2d007b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc033000 tx=0x7fe2dc004730 comp rx=0 tx=0).stop 2024-09-17T03:38:16.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 -- 172.21.15.121:0/2422703854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0070810 msgr2=0x7fe2f0144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0070810 0x7fe2f0144760 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400d660 tx=0x7fe2e400db20 comp rx=0 tx=0).stop 2024-09-17T03:38:16.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 -- 172.21.15.121:0/2422703854 shutdown_connections 2024-09-17T03:38:16.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2f01606c0 0x7fe2f015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2f00b51c0 0x7fe2f00cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe2d0078b90 0x7fe2d007b0a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 --2- 172.21.15.121:0/2422703854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0070810 0x7fe2f0144760 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 -- 172.21.15.121:0/2422703854 >> 172.21.15.121:0/2422703854 conn(0x7fe2f00b2440 msgr2=0x7fe2f00b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:16.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 -- 172.21.15.121:0/2422703854 shutdown_connections 2024-09-17T03:38:16.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16.249+0000 7fe2f6a00640 1 -- 172.21.15.121:0/2422703854 wait complete. 2024-09-17T03:38:16.271 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:38:16.271 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:38:16.271 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:38:16.271 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:38:16.271 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:16.271 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:38:16.271 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:38:16.271 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:38:16.272 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:16.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:16.272 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:38:16.308 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:38:16.308 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:38:16.308 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:38:16.308 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:16.308 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:38:16.308 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:16.308 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:16.308 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:16.308 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:38:16.308 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42560sec preferred_lft 42560sec 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:38:16.309 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:16.310 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:38:16.310 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:16.310 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:16.310 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:38:16.310 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:38:16.310 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:16.310 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:16.310 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:38:16.310 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:38:16.310 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:16.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:16.311 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:38:16.402 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:38:16.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:16.406 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:38:16.442 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:38:16.442 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:38:16.442 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:38:16.442 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:38:16.442 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:38:16.443 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:38:16.443 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:38:16.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:38:16.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:38:16.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:38:16.443 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:38:16.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:38:16.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:16.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:16.639 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:38:16.674 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:38:16.675 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:38:16.675 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:16.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:16.675 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:38:16.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:16.771 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:16.806 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:16.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:16.807 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:16.882 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:38:16.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:16.883 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:17.078 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:17.078 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:17.078 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:38:17.098 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:17.098 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:17.098 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:38:17.098 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:38:17.098 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:38:17.131 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:38:17.131 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:17.131 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:38:17.131 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:38:17.131 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:38:17.132 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:38:17.132 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:38:17.132 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:38:17.132 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:38:17.132 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:38:17.135 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:38:17.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:17.135 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:17.191 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:38:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:38:17.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:17.280 INFO:teuthology.orchestra.run.smithi121.stdout:client5749 2024-09-17T03:38:17.280 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:17.280 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:17.316 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:38:17.316 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:17.356 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:38:17.356 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:17.436 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:38:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.659+0000 7f2180200640 1 -- 172.21.15.121:0/1683395976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217806d800 msgr2=0x7f21780d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.659+0000 7f2180200640 1 --2- 172.21.15.121:0/1683395976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217806d800 0x7f21780d05b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f21780c3a00 tx=0x7f216402a410 comp rx=0 tx=0).stop 2024-09-17T03:38:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.659+0000 7f2180200640 1 -- 172.21.15.121:0/1683395976 shutdown_connections 2024-09-17T03:38:17.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.659+0000 7f2180200640 1 --2- 172.21.15.121:0/1683395976 >> v2:172.21.15.176:3300/0 conn(0x7f21780d0af0 0x7f217815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:17.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.659+0000 7f2180200640 1 --2- 172.21.15.121:0/1683395976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217806d800 0x7f21780d05b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:17.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.659+0000 7f2180200640 1 -- 172.21.15.121:0/1683395976 >> 172.21.15.121:0/1683395976 conn(0x7f21780b3580 msgr2=0x7f21780b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:17.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.659+0000 7f2180200640 1 -- 172.21.15.121:0/1683395976 shutdown_connections 2024-09-17T03:38:17.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.659+0000 7f2180200640 1 -- 172.21.15.121:0/1683395976 wait complete. 2024-09-17T03:38:17.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.661+0000 7f2180200640 1 Processor -- start 2024-09-17T03:38:17.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.662+0000 7f2180200640 1 -- start start 2024-09-17T03:38:17.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f2180200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f217806d800 0x7f21780c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f2180200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21780d0af0 0x7f217809caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f2180200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217815a3e0 0x7f217809cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f2180200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f217815d4e0 con 0x7f21780d0af0 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f2180200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f217815d360 con 0x7f217806d800 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f2180200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f217815d660 con 0x7f217815a3e0 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f217ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21780d0af0 0x7f217809caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f217ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21780d0af0 0x7f217809caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36614/0 (socket says 172.21.15.121:36614) 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f217ce00640 1 -- 172.21.15.121:0/2681837520 learned_addr learned my addr 172.21.15.121:0/2681837520 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f217e200640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217815a3e0 0x7f217809cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.663+0000 7f217d800640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f217806d800 0x7f21780c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:17.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.664+0000 7f217ce00640 1 -- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217815a3e0 msgr2=0x7f217809cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.664+0000 7f217ce00640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217815a3e0 0x7f217809cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.664+0000 7f217ce00640 1 -- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f217806d800 msgr2=0x7f21780c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.664+0000 7f217ce00640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f217806d800 0x7f21780c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.664+0000 7f217ce00640 1 -- 172.21.15.121:0/2681837520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21780c60a0 con 0x7f21780d0af0 2024-09-17T03:38:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.664+0000 7f217ce00640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21780d0af0 0x7f217809caa0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2164031770 tx=0x7f2164033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.664+0000 7f2175600640 1 -- 172.21.15.121:0/2681837520 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164031d60 con 0x7f21780d0af0 2024-09-17T03:38:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.664+0000 7f2175600640 1 -- 172.21.15.121:0/2681837520 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2164033e40 con 0x7f21780d0af0 2024-09-17T03:38:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.664+0000 7f2175600640 1 -- 172.21.15.121:0/2681837520 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164005260 con 0x7f21780d0af0 2024-09-17T03:38:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.664+0000 7f2180200640 1 -- 172.21.15.121:0/2681837520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217815c280 con 0x7f21780d0af0 2024-09-17T03:38:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.665+0000 7f2180200640 1 -- 172.21.15.121:0/2681837520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217809ae50 con 0x7f21780d0af0 2024-09-17T03:38:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.666+0000 7f2180200640 1 -- 172.21.15.121:0/2681837520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217815dba0 con 0x7f21780d0af0 2024-09-17T03:38:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.667+0000 7f2175600640 1 -- 172.21.15.121:0/2681837520 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2164005400 con 0x7f21780d0af0 2024-09-17T03:38:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.668+0000 7f2175600640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2158078bf0 0x7f215807b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.668+0000 7f2175600640 1 -- 172.21.15.121:0/2681837520 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f21640bc170 con 0x7f21780d0af0 2024-09-17T03:38:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.668+0000 7f217d800640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2158078bf0 0x7f215807b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.669+0000 7f217d800640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2158078bf0 0x7f215807b100 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f216c000f60 tx=0x7f216c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:17.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.672+0000 7f2175600640 1 -- 172.21.15.121:0/2681837520 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f21780c60a0 con 0x7f21780d0af0 2024-09-17T03:38:17.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.863+0000 7f2180200640 1 -- 172.21.15.121:0/2681837520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f21780c6ed0 con 0x7f21780d0af0 2024-09-17T03:38:17.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.863+0000 7f2175600640 1 -- 172.21.15.121:0/2681837520 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) ==== 80+0+0 (secure 0 0 0) 0x7f216403f030 con 0x7f21780d0af0 2024-09-17T03:38:17.863 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:38:17.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 -- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2158078bf0 msgr2=0x7f215807b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:17.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2158078bf0 0x7f215807b100 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f216c000f60 tx=0x7f216c009040 comp rx=0 tx=0).stop 2024-09-17T03:38:17.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 -- 172.21.15.121:0/2681837520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21780d0af0 msgr2=0x7f217809caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:17.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21780d0af0 0x7f217809caa0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2164031770 tx=0x7f2164033c20 comp rx=0 tx=0).stop 2024-09-17T03:38:17.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 -- 172.21.15.121:0/2681837520 shutdown_connections 2024-09-17T03:38:17.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f217815a3e0 0x7f217809cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:17.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2158078bf0 0x7f215807b100 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:17.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21780d0af0 0x7f217809caa0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:17.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 --2- 172.21.15.121:0/2681837520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f217806d800 0x7f21780c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:17.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 -- 172.21.15.121:0/2681837520 >> 172.21.15.121:0/2681837520 conn(0x7f21780b3580 msgr2=0x7f21780cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:17.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 -- 172.21.15.121:0/2681837520 shutdown_connections 2024-09-17T03:38:17.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:17.866+0000 7f2180200640 1 -- 172.21.15.121:0/2681837520 wait complete. 2024-09-17T03:38:17.888 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:38:17.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:17.888 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:38:17.957 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:38:17.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:17.958 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:38:17.995 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:38:17.995 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:18.071 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:38:18.071 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:38:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.293+0000 7f6f73a00640 1 -- 172.21.15.121:0/2429596307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6c0d0af0 msgr2=0x7f6f6c15cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.293+0000 7f6f73a00640 1 --2- 172.21.15.121:0/2429596307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6c0d0af0 0x7f6f6c15cc10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6f64005fd0 tx=0x7f6f6402a780 comp rx=0 tx=0).stop 2024-09-17T03:38:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.293+0000 7f6f73a00640 1 -- 172.21.15.121:0/2429596307 shutdown_connections 2024-09-17T03:38:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.293+0000 7f6f73a00640 1 --2- 172.21.15.121:0/2429596307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6c0d0af0 0x7f6f6c15cc10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:18.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.293+0000 7f6f73a00640 1 --2- 172.21.15.121:0/2429596307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f6c06d800 0x7f6f6c0d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:18.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.293+0000 7f6f73a00640 1 -- 172.21.15.121:0/2429596307 >> 172.21.15.121:0/2429596307 conn(0x7f6f6c0b3580 msgr2=0x7f6f6c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:18.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.293+0000 7f6f73a00640 1 -- 172.21.15.121:0/2429596307 shutdown_connections 2024-09-17T03:38:18.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.293+0000 7f6f73a00640 1 -- 172.21.15.121:0/2429596307 wait complete. 2024-09-17T03:38:18.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.295+0000 7f6f73a00640 1 Processor -- start 2024-09-17T03:38:18.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.295+0000 7f6f73a00640 1 -- start start 2024-09-17T03:38:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f73a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6c06d800 0x7f6f6c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f73a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f6c0d0af0 0x7f6f6c0742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f73a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f6c15a3e0 0x7f6f6c074830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f73a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c15d4e0 con 0x7f6f6c06d800 2024-09-17T03:38:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f73a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c15d360 con 0x7f6f6c15a3e0 2024-09-17T03:38:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f73a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6c15d660 con 0x7f6f6c0d0af0 2024-09-17T03:38:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f71000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6c06d800 0x7f6f6c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f71000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6c06d800 0x7f6f6c0c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36630/0 (socket says 172.21.15.121:36630) 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f71000640 1 -- 172.21.15.121:0/1714861563 learned_addr learned my addr 172.21.15.121:0/1714861563 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f71a00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f6c15a3e0 0x7f6f6c074830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.297+0000 7f6f6be00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f6c0d0af0 0x7f6f6c0742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f71000640 1 -- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f6c0d0af0 msgr2=0x7f6f6c0742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f71000640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f6c0d0af0 0x7f6f6c0742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f71000640 1 -- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f6c15a3e0 msgr2=0x7f6f6c074830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f71000640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f6c15a3e0 0x7f6f6c074830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f71000640 1 -- 172.21.15.121:0/1714861563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c0cf780 con 0x7f6f6c06d800 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f6be00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f6c0d0af0 0x7f6f6c0742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f71000640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6c06d800 0x7f6f6c0c9bb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00c730 tx=0x7f6f5c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f68c00640 1 -- 172.21.15.121:0/1714861563 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c016020 con 0x7f6f6c06d800 2024-09-17T03:38:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f68c00640 1 -- 172.21.15.121:0/1714861563 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f5c00a950 con 0x7f6f6c06d800 2024-09-17T03:38:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f68c00640 1 -- 172.21.15.121:0/1714861563 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00ada0 con 0x7f6f6c06d800 2024-09-17T03:38:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f73a00640 1 -- 172.21.15.121:0/1714861563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6c0cf4a0 con 0x7f6f6c06d800 2024-09-17T03:38:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.298+0000 7f6f73a00640 1 -- 172.21.15.121:0/1714861563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6c09db20 con 0x7f6f6c06d800 2024-09-17T03:38:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.299+0000 7f6f73a00640 1 -- 172.21.15.121:0/1714861563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6c15db80 con 0x7f6f6c06d800 2024-09-17T03:38:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.301+0000 7f6f68c00640 1 -- 172.21.15.121:0/1714861563 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f5c019020 con 0x7f6f6c06d800 2024-09-17T03:38:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.301+0000 7f6f68c00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f4c078bf0 0x7f6f4c07b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.302+0000 7f6f68c00640 1 -- 172.21.15.121:0/1714861563 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f6f5c09adf0 con 0x7f6f6c06d800 2024-09-17T03:38:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.302+0000 7f6f6be00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f4c078bf0 0x7f6f4c07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.303+0000 7f6f6be00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f4c078bf0 0x7f6f4c07b100 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c156770 tx=0x7f6f58005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.306+0000 7f6f68c00640 1 -- 172.21.15.121:0/1714861563 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6f5c020020 con 0x7f6f6c06d800 2024-09-17T03:38:18.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.528+0000 7f6f73a00640 1 -- 172.21.15.121:0/1714861563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6f6c0cc3d0 con 0x7f6f6c06d800 2024-09-17T03:38:18.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.529+0000 7f6f68c00640 1 -- 172.21.15.121:0/1714861563 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) ==== 53+0+73 (secure 0 0 0) 0x7f6f6c0d0f00 con 0x7f6f6c06d800 2024-09-17T03:38:18.529 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:38:18.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.531+0000 7f6f73a00640 1 -- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f4c078bf0 msgr2=0x7f6f4c07b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.531+0000 7f6f73a00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f4c078bf0 0x7f6f4c07b100 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c156770 tx=0x7f6f58005f90 comp rx=0 tx=0).stop 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.531+0000 7f6f73a00640 1 -- 172.21.15.121:0/1714861563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6c06d800 msgr2=0x7f6f6c0c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.531+0000 7f6f73a00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6c06d800 0x7f6f6c0c9bb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00c730 tx=0x7f6f5c00cbf0 comp rx=0 tx=0).stop 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.531+0000 7f6f73a00640 1 -- 172.21.15.121:0/1714861563 shutdown_connections 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.531+0000 7f6f73a00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f6c15a3e0 0x7f6f6c074830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.531+0000 7f6f73a00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f6c0d0af0 0x7f6f6c0742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.531+0000 7f6f73a00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f4c078bf0 0x7f6f4c07b100 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.531+0000 7f6f73a00640 1 --2- 172.21.15.121:0/1714861563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f6c06d800 0x7f6f6c0c9bb0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.531+0000 7f6f73a00640 1 -- 172.21.15.121:0/1714861563 >> 172.21.15.121:0/1714861563 conn(0x7f6f6c0b3580 msgr2=0x7f6f6c06dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.532+0000 7f6f73a00640 1 -- 172.21.15.121:0/1714861563 shutdown_connections 2024-09-17T03:38:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:18.532+0000 7f6f73a00640 1 -- 172.21.15.121:0/1714861563 wait complete. 2024-09-17T03:38:18.554 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:38:18.554 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:38:18.554 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:38:18.554 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:38:18.554 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:38:18.554 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:38:18.554 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:38:18.554 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:38:18.554 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:38:18.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:18.555 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:38:18.593 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:38:18.594 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:38:18.594 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:38:18.594 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:18.594 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:38:18.595 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42555sec preferred_lft 42555sec 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::80c9:d6ff:fe9f:5926/64 scope link 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d4cd:10ff:feb7:d68f/64 scope link 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:18.596 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether fe:db:9e:03:5a:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:38:18.597 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::fcdb:9eff:fe03:5a3e/64 scope link 2024-09-17T03:38:18.597 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:18.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:18.597 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:38:18.688 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:38:18.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:18.692 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:38:18.729 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:38:18.729 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:38:18.729 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:38:18.729 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:38:18.729 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:38:18.730 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:38:18.730 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:38:18.730 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:38:18.730 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:38:18.730 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:38:18.730 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:38:18.846 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:38:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:38:18.916 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:38:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:18.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:18.925 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:38:18.960 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:38:18.960 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:38:18.960 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:38:18.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:18.960 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T03:38:19.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:19.057 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:38:19.092 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:38:19.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:19.093 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:38:19.166 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:38:19.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:19.166 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:38:19.361 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:38:19.361 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:38:19.361 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:38:19.381 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:38:19.381 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:38:19.381 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:38:19.381 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:38:19.381 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:19.410 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:38:19.411 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:38:19.411 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:38:19.411 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:38:19.411 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:19.411 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:38:19.411 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:38:19.411 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:38:19.412 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:38:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:38:19.412 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:38:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:38:19.413 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:38:19.415 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:38:19.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:19.416 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:38:19.473 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:38:19.551 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:38:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:38:19.555 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:19.562 INFO:teuthology.orchestra.run.smithi176.stdout:client5396 2024-09-17T03:38:19.562 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:38:19.563 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:19.598 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir {d0,d1} && touch {d0,d1}/file') 2024-09-17T03:38:19.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:38:19.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:19.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:19.710 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d0) 2024-09-17T03:38:19.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:19.750 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2024-09-17T03:38:19.826 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:38:20.104 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"9","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":1},"nref":5}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:38:20.105 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 5, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "9" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:38:20.105 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-09-17T03:38:21.319 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:38:21.324 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:38:22.108 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:38:22.355 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:38:22.356 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:38:22.356 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-09-17T03:38:24.357 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:38:24.607 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:38:24.608 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:38:24.608 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d0', 0), ('/d1', 1)] 2024-09-17T03:38:26.609 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:38:26.855 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"14","version":"14","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d0","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-17T03:38:26.856 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d0", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000001", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:38:26.856 INFO:tasks.cephfs.cephfs_test_case:[('/d0', 0), ('/d1', 1)] =?= [('/d0', 0), ('/d1', 1)] 2024-09-17T03:38:26.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:26.856 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d0/f0) 2024-09-17T03:38:26.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:26.895 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d1/f0) 2024-09-17T03:38:26.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:26.974 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d0/f1) 2024-09-17T03:38:27.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:27.022 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d1/f1) 2024-09-17T03:38:27.066 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T03:38:27.312 INFO:teuthology.orchestra.run.smithi121.stdout:[{"id":5749,"entity":{"name":{"type":"client","num":5749},"addr":{"type":"v1","addr":"172.21.15.121:0","nonce":2433664616}},"state":"open","num_leases":3,"num_caps":5,"request_load_avg":8,"uptime":7.6068995959999999,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":14.788463316908382,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":13,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000003","length":500}],"inst":"client.5749 v1:172.21.15.121:0/2433664616","completed_requests":[{"tid":13,"created_ino":"0x100000001f8"}],"prealloc_inos":[{"start":"0x10000000003","length":500},{"start":"0x100000001f9","length":999}],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi121","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}},{"id":5396,"entity":{"name":{"type":"client","num":5396},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":54068762}},"state":"open","num_leases":1,"num_caps":4,"request_load_avg":6,"uptime":7.8908958480000004,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":7.9440560131282076,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":8,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5396 v1:192.168.0.1:0/54068762","completed_requests":[],"prealloc_inos":[{"start":"0x100000005e1","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi176","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}}] 2024-09-17T03:38:27.313 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "0", "hostname": "smithi121", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000001f8", "tid": 13 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000003" } ], "entity": { "addr": { "addr": "172.21.15.121:0", "nonce": 2433664616, "type": "v1" }, "name": { "num": 5749, "type": "client" } }, "id": 5749, "inst": "client.5749 v1:172.21.15.121:0/2433664616", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 13, "num_caps": 5, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 3, "prealloc_inos": [ { "length": 500, "start": "0x10000000003" }, { "length": 999, "start": "0x100000001f9" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 14.788463316908382 }, "state": "open", "uptime": 7.606899596 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "1", "hostname": "smithi176", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 54068762, "type": "v1" }, "name": { "num": 5396, "type": "client" } }, "id": 5396, "inst": "client.5396 v1:192.168.0.1:0/54068762", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 8, "num_caps": 4, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x100000005e1" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 7.944056013128208 }, "state": "open", "uptime": 7.890895848 } ] 2024-09-17T03:38:27.313 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-17T03:38:27.557 INFO:teuthology.orchestra.run.smithi121.stdout:[{"id":5396,"entity":{"name":{"type":"client","num":5396},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":54068762}},"state":"open","num_leases":1,"num_caps":2,"request_load_avg":0,"uptime":0.47699370400000002,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":3.9956217655143029,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":8,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5396 v1:192.168.0.1:0/54068762","completed_requests":[{"tid":8,"created_ino":"0x200000003e9"}],"prealloc_inos":[{"start":"0x200000003ea","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi176","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}},{"id":5749,"entity":{"name":{"type":"client","num":5749},"addr":{"type":"v1","addr":"172.21.15.121:0","nonce":2433664616}},"state":"open","num_leases":1,"num_caps":4,"request_load_avg":4,"uptime":10.420862456,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":9.9074917884316243,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":13,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5749 v1:172.21.15.121:0/2433664616","completed_requests":[{"tid":14,"created_ino":"0x20000000000"}],"prealloc_inos":[{"start":"0x20000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi121","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}}] 2024-09-17T03:38:27.557 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "1", "hostname": "smithi176", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x200000003e9", "tid": 8 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 54068762, "type": "v1" }, "name": { "num": 5396, "type": "client" } }, "id": 5396, "inst": "client.5396 v1:192.168.0.1:0/54068762", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 8, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x200000003ea" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 3.995621765514303 }, "state": "open", "uptime": 0.476993704 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "0", "hostname": "smithi121", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x20000000000", "tid": 14 } ], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.121:0", "nonce": 2433664616, "type": "v1" }, "name": { "num": 5749, "type": "client" } }, "id": 5749, "inst": "client.5749 v1:172.21.15.121:0/2433664616", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 13, "num_caps": 4, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x20000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 4, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 9.907491788431624 }, "state": "open", "uptime": 10.420862456 } ] 2024-09-17T03:38:27.558 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:27.558 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:27.593 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:38:27.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:38:27.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:27.723 INFO:teuthology.orchestra.run.smithi121.stdout:client5749 2024-09-17T03:38:27.723 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session evict 5749 2024-09-17T03:38:28.022 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-17T03:38:28.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:28.023 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d0/f00) 2024-09-17T03:38:28.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:28.107 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch d1/f00) 2024-09-17T03:38:28.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:28.144 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d0/f10) 2024-09-17T03:38:28.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:28.186 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch d1/f10) 2024-09-17T03:38:38.266 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T03:38:38.518 INFO:teuthology.orchestra.run.smithi121.stdout:[{"id":5749,"entity":{"name":{"type":"client","num":5749},"addr":{"type":"v1","addr":"172.21.15.121:0","nonce":2433664616}},"state":"open","num_leases":1,"num_caps":2,"request_load_avg":0,"uptime":10.399862733000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":3.905080054334884,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":0,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5749 v1:172.21.15.121:0/2433664616","completed_requests":[],"prealloc_inos":[{"start":"0x10000000004","length":499},{"start":"0x100000001f9","length":501}],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi121","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}},{"id":5396,"entity":{"name":{"type":"client","num":5396},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":54068762}},"state":"open","num_leases":2,"num_caps":5,"request_load_avg":6,"uptime":19.099747904000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":10.670310531558185,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":0,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x100000005e2","length":500}],"inst":"client.5396 v1:192.168.0.1:0/54068762","completed_requests":[],"prealloc_inos":[{"start":"0x100000005e2","length":999}],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi176","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}}] 2024-09-17T03:38:38.518 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "0", "hostname": "smithi121", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.121:0", "nonce": 2433664616, "type": "v1" }, "name": { "num": 5749, "type": "client" } }, "id": 5749, "inst": "client.5749 v1:172.21.15.121:0/2433664616", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 0, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 499, "start": "0x10000000004" }, { "length": 501, "start": "0x100000001f9" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 3.905080054334884 }, "state": "open", "uptime": 10.399862733 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "1", "hostname": "smithi176", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x100000005e2" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 54068762, "type": "v1" }, "name": { "num": 5396, "type": "client" } }, "id": 5396, "inst": "client.5396 v1:192.168.0.1:0/54068762", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 0, "num_caps": 5, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 2, "prealloc_inos": [ { "length": 999, "start": "0x100000005e2" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 10.670310531558185 }, "state": "open", "uptime": 19.099747904 } ] 2024-09-17T03:38:38.519 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-17T03:38:38.760 INFO:teuthology.orchestra.run.smithi121.stdout:[{"id":5396,"entity":{"name":{"type":"client","num":5396},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":54068762}},"state":"open","num_leases":2,"num_caps":3,"request_load_avg":1,"uptime":11.680845826000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":6.8217618478529678,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":0,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x200000003eb","length":500}],"inst":"client.5396 v1:192.168.0.1:0/54068762","completed_requests":[],"prealloc_inos":[{"start":"0x200000003eb","length":999}],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi176","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}},{"id":5749,"entity":{"name":{"type":"client","num":5749},"addr":{"type":"v1","addr":"172.21.15.121:0","nonce":2433664616}},"state":"open","num_leases":2,"num_caps":5,"request_load_avg":4,"uptime":21.624714577999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":12.58174015197001,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":0,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x20000000002","length":500}],"inst":"client.5749 v1:172.21.15.121:0/2433664616","completed_requests":[],"prealloc_inos":[{"start":"0x20000000002","length":999}],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi121","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}}] 2024-09-17T03:38:38.761 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "1", "hostname": "smithi176", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x200000003eb" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 54068762, "type": "v1" }, "name": { "num": 5396, "type": "client" } }, "id": 5396, "inst": "client.5396 v1:192.168.0.1:0/54068762", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 0, "num_caps": 3, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 2, "prealloc_inos": [ { "length": 999, "start": "0x200000003eb" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 1, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 6.821761847852968 }, "state": "open", "uptime": 11.680845826 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "0", "hostname": "smithi121", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x20000000002" } ], "entity": { "addr": { "addr": "172.21.15.121:0", "nonce": 2433664616, "type": "v1" }, "name": { "num": 5749, "type": "client" } }, "id": 5749, "inst": "client.5749 v1:172.21.15.121:0/2433664616", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 0, "num_caps": 5, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 2, "prealloc_inos": [ { "length": 999, "start": "0x20000000002" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 4, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 12.58174015197001 }, "state": "open", "uptime": 21.624714578 } ] 2024-09-17T03:38:38.761 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:38:38.761 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:38.761 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:38.796 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:38.796 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:38.872 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:38:39.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.132+0000 7f4cd5600640 1 -- 172.21.15.121:0/444111253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd00b3ca0 msgr2=0x7f4cd00b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:39.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.132+0000 7f4cd5600640 1 --2- 172.21.15.121:0/444111253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd00b3ca0 0x7f4cd00b40b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8005fd0 tx=0x7f4cc802aa90 comp rx=0 tx=0).stop 2024-09-17T03:38:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.132+0000 7f4cd5600640 1 -- 172.21.15.121:0/444111253 shutdown_connections 2024-09-17T03:38:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.132+0000 7f4cd5600640 1 --2- 172.21.15.121:0/444111253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd00b3ca0 0x7f4cd00b40b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.132+0000 7f4cd5600640 1 --2- 172.21.15.121:0/444111253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd0070290 0x7f4cd00cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.132+0000 7f4cd5600640 1 -- 172.21.15.121:0/444111253 >> 172.21.15.121:0/444111253 conn(0x7f4cd00cee80 msgr2=0x7f4cd00cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.132+0000 7f4cd5600640 1 -- 172.21.15.121:0/444111253 shutdown_connections 2024-09-17T03:38:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.132+0000 7f4cd5600640 1 -- 172.21.15.121:0/444111253 wait complete. 2024-09-17T03:38:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.134+0000 7f4cd5600640 1 Processor -- start 2024-09-17T03:38:39.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.134+0000 7f4cd5600640 1 -- start start 2024-09-17T03:38:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cd5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd0070290 0x7f4cd0157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cd5600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd00b3ca0 0x7f4cd01f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cd5600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd01623f0 0x7f4cd01f9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cd5600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd015f370 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cd5600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd00ccfc0 con 0x7f4cd0070290 2024-09-17T03:38:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cd5600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd015f4f0 con 0x7f4cd01623f0 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cc7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd00b3ca0 0x7f4cd01f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cc7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd00b3ca0 0x7f4cd01f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48160/0 (socket says 172.21.15.121:48160) 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cc7400640 1 -- 172.21.15.121:0/3415864230 learned_addr learned my addr 172.21.15.121:0/3415864230 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cd4c00640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd01623f0 0x7f4cd01f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4ccfe00640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd0070290 0x7f4cd0157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cc7400640 1 -- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd01623f0 msgr2=0x7f4cd01f9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.136+0000 7f4cc7400640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd01623f0 0x7f4cd01f9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.137+0000 7f4cc7400640 1 -- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd0070290 msgr2=0x7f4cd0157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.137+0000 7f4cc7400640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd0070290 0x7f4cd0157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.137+0000 7f4cc7400640 1 -- 172.21.15.121:0/3415864230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd01584c0 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.137+0000 7f4ccfe00640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd0070290 0x7f4cd0157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.137+0000 7f4cc7400640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd00b3ca0 0x7f4cd01f8ee0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e7c0 tx=0x7f4cb800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.137+0000 7f4cccc00640 1 -- 172.21.15.121:0/3415864230 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800ccc0 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.137+0000 7f4cccc00640 1 -- 172.21.15.121:0/3415864230 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cb800ee70 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.137+0000 7f4cccc00640 1 -- 172.21.15.121:0/3415864230 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8010690 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.137+0000 7f4cd5600640 1 -- 172.21.15.121:0/3415864230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd01f9b40 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.137+0000 7f4cd5600640 1 -- 172.21.15.121:0/3415864230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd0159ee0 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.138+0000 7f4cd5600640 1 -- 172.21.15.121:0/3415864230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd01f9960 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.139+0000 7f4cccc00640 1 -- 172.21.15.121:0/3415864230 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4cb8010830 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.140+0000 7f4cccc00640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4cac078bc0 0x7f4cac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.141+0000 7f4cccc00640 1 -- 172.21.15.121:0/3415864230 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f4cb809b890 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.141+0000 7f4ccfe00640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4cac078bc0 0x7f4cac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:39.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.142+0000 7f4ccfe00640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4cac078bc0 0x7f4cac07b0d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0007fd0 tx=0x7f4cc0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:39.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.145+0000 7f4cccc00640 1 -- 172.21.15.121:0/3415864230 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cd01f9960 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.345+0000 7f4cd5600640 1 -- 172.21.15.121:0/3415864230 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4cd006add0 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.346+0000 7f4cccc00640 1 -- 172.21.15.121:0/3415864230 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) ==== 80+0+0 (secure 0 0 0) 0x7f4cd006add0 con 0x7f4cd00b3ca0 2024-09-17T03:38:39.347 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:38:39.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.348+0000 7f4cd5600640 1 -- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4cac078bc0 msgr2=0x7f4cac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:39.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.348+0000 7f4cd5600640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4cac078bc0 0x7f4cac07b0d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0007fd0 tx=0x7f4cc0009040 comp rx=0 tx=0).stop 2024-09-17T03:38:39.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.348+0000 7f4cd5600640 1 -- 172.21.15.121:0/3415864230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd00b3ca0 msgr2=0x7f4cd01f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:39.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.348+0000 7f4cd5600640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd00b3ca0 0x7f4cd01f8ee0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e7c0 tx=0x7f4cb800ec80 comp rx=0 tx=0).stop 2024-09-17T03:38:39.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.348+0000 7f4cd5600640 1 -- 172.21.15.121:0/3415864230 shutdown_connections 2024-09-17T03:38:39.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.348+0000 7f4cd5600640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd01623f0 0x7f4cd01f9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.348+0000 7f4cd5600640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4cac078bc0 0x7f4cac07b0d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.348+0000 7f4cd5600640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd00b3ca0 0x7f4cd01f8ee0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.348+0000 7f4cd5600640 1 --2- 172.21.15.121:0/3415864230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd0070290 0x7f4cd0157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.349+0000 7f4cd5600640 1 -- 172.21.15.121:0/3415864230 >> 172.21.15.121:0/3415864230 conn(0x7f4cd00cee80 msgr2=0x7f4cd00cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:39.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.349+0000 7f4cd5600640 1 -- 172.21.15.121:0/3415864230 shutdown_connections 2024-09-17T03:38:39.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.349+0000 7f4cd5600640 1 -- 172.21.15.121:0/3415864230 wait complete. 2024-09-17T03:38:39.374 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:38:39.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:39.374 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T03:38:39.510 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:38:39.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:39.510 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:38:39.548 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:38:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.810+0000 7f2c18a00640 1 -- 172.21.15.121:0/1907381173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c140d0af0 msgr2=0x7f2c1415cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.810+0000 7f2c18a00640 1 --2- 172.21.15.121:0/1907381173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c140d0af0 0x7f2c1415cc10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c005fd0 tx=0x7f2c0c02a780 comp rx=0 tx=0).stop 2024-09-17T03:38:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.810+0000 7f2c18a00640 1 -- 172.21.15.121:0/1907381173 shutdown_connections 2024-09-17T03:38:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.810+0000 7f2c18a00640 1 --2- 172.21.15.121:0/1907381173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c140d0af0 0x7f2c1415cc10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.810+0000 7f2c18a00640 1 --2- 172.21.15.121:0/1907381173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c1406d800 0x7f2c140d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.811+0000 7f2c18a00640 1 -- 172.21.15.121:0/1907381173 >> 172.21.15.121:0/1907381173 conn(0x7f2c140b3580 msgr2=0x7f2c140b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.811+0000 7f2c18a00640 1 -- 172.21.15.121:0/1907381173 shutdown_connections 2024-09-17T03:38:39.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.811+0000 7f2c18a00640 1 -- 172.21.15.121:0/1907381173 wait complete. 2024-09-17T03:38:39.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.813+0000 7f2c18a00640 1 Processor -- start 2024-09-17T03:38:39.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.813+0000 7f2c18a00640 1 -- start start 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.814+0000 7f2c18a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c1406d800 0x7f2c1409a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.814+0000 7f2c18a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140d0af0 0x7f2c141f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.814+0000 7f2c18a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c1415a3e0 0x7f2c140b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.814+0000 7f2c18a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1415d4e0 con 0x7f2c140d0af0 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.814+0000 7f2c18a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1415d360 con 0x7f2c1406d800 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.814+0000 7f2c18a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1415d660 con 0x7f2c1415a3e0 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c09400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140d0af0 0x7f2c141f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c12800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c1415a3e0 0x7f2c140b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c11e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c1406d800 0x7f2c1409a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c09400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140d0af0 0x7f2c141f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48174/0 (socket says 172.21.15.121:48174) 2024-09-17T03:38:39.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c09400640 1 -- 172.21.15.121:0/466760282 learned_addr learned my addr 172.21.15.121:0/466760282 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:39.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c09400640 1 -- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c1415a3e0 msgr2=0x7f2c140b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:39.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c09400640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c1415a3e0 0x7f2c140b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c09400640 1 -- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c1406d800 msgr2=0x7f2c1409a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:39.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c09400640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c1406d800 0x7f2c1409a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c09400640 1 -- 172.21.15.121:0/466760282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c141f9de0 con 0x7f2c140d0af0 2024-09-17T03:38:39.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c11e00640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c1406d800 0x7f2c1409a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:38:39.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.815+0000 7f2c09400640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140d0af0 0x7f2c141f5180 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00e790 tx=0x7f2bfc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:39.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.816+0000 7f2c0aa00640 1 -- 172.21.15.121:0/466760282 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00eea0 con 0x7f2c140d0af0 2024-09-17T03:38:39.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.816+0000 7f2c0aa00640 1 -- 172.21.15.121:0/466760282 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bfc00cdb0 con 0x7f2c140d0af0 2024-09-17T03:38:39.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.816+0000 7f2c0aa00640 1 -- 172.21.15.121:0/466760282 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc010690 con 0x7f2c140d0af0 2024-09-17T03:38:39.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.816+0000 7f2c18a00640 1 -- 172.21.15.121:0/466760282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c141f9540 con 0x7f2c140d0af0 2024-09-17T03:38:39.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.816+0000 7f2c18a00640 1 -- 172.21.15.121:0/466760282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c141f9b00 con 0x7f2c140d0af0 2024-09-17T03:38:39.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.817+0000 7f2c18a00640 1 -- 172.21.15.121:0/466760282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c141f92b0 con 0x7f2c140d0af0 2024-09-17T03:38:39.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.818+0000 7f2c0aa00640 1 -- 172.21.15.121:0/466760282 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2bfc010830 con 0x7f2c140d0af0 2024-09-17T03:38:39.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.819+0000 7f2c0aa00640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bf0078bc0 0x7f2bf007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:39.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.819+0000 7f2c0aa00640 1 -- 172.21.15.121:0/466760282 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f2bfc09b8e0 con 0x7f2c140d0af0 2024-09-17T03:38:39.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.820+0000 7f2c11e00640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bf0078bc0 0x7f2bf007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:39.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.820+0000 7f2c11e00640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bf0078bc0 0x7f2bf007b0d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2c04001b10 tx=0x7f2c04007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:39.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:39.824+0000 7f2c0aa00640 1 -- 172.21.15.121:0/466760282 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2bfc063480 con 0x7f2c140d0af0 2024-09-17T03:38:40.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.045+0000 7f2c18a00640 1 -- 172.21.15.121:0/466760282 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2c1409ce20 con 0x7f2c140d0af0 2024-09-17T03:38:40.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.045+0000 7f2c0aa00640 1 -- 172.21.15.121:0/466760282 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7f2bfc067eb0 con 0x7f2c140d0af0 2024-09-17T03:38:40.046 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:38:40.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 -- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bf0078bc0 msgr2=0x7f2bf007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:40.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bf0078bc0 0x7f2bf007b0d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2c04001b10 tx=0x7f2c04007e90 comp rx=0 tx=0).stop 2024-09-17T03:38:40.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 -- 172.21.15.121:0/466760282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140d0af0 msgr2=0x7f2c141f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:40.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140d0af0 0x7f2c141f5180 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00e790 tx=0x7f2bfc00ec50 comp rx=0 tx=0).stop 2024-09-17T03:38:40.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 -- 172.21.15.121:0/466760282 shutdown_connections 2024-09-17T03:38:40.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c1415a3e0 0x7f2c140b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:40.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bf0078bc0 0x7f2bf007b0d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:40.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c140d0af0 0x7f2c141f5180 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:40.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 --2- 172.21.15.121:0/466760282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c1406d800 0x7f2c1409a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:40.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 -- 172.21.15.121:0/466760282 >> 172.21.15.121:0/466760282 conn(0x7f2c140b3580 msgr2=0x7f2c1415a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:40.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 -- 172.21.15.121:0/466760282 shutdown_connections 2024-09-17T03:38:40.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40.048+0000 7f2c18a00640 1 -- 172.21.15.121:0/466760282 wait complete. 2024-09-17T03:38:40.075 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:38:40.075 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:38:40.075 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:38:40.075 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:38:40.075 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:40.075 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:38:40.075 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:38:40.075 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:38:40.075 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:40.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:40.075 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:38:40.111 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:38:40.111 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:38:40.111 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:38:40.111 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:40.111 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:38:40.111 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:40.111 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42536sec preferred_lft 42536sec 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:38:40.112 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:38:40.113 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:38:40.114 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:40.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:40.114 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:38:40.205 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:38:40.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:40.208 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:38:40.246 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:38:40.247 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:38:40.247 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:38:40.247 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:38:40.247 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:38:40.247 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:38:40.247 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:38:40.247 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:38:40.247 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:38:40.247 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:38:40.248 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:38:40.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:38:40.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:40.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:40.443 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:38:40.479 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:38:40.479 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:38:40.479 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:40.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:40.479 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:38:40.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:40.575 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:40.611 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:40.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:40.611 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:40.687 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:38:40.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:40.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:40.883 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:40.883 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:40.883 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:38:40.903 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:40.903 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:40.904 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:38:40.904 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:38:40.904 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:40.935 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:40.935 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:40.935 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:38:40.935 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:38:40.935 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:40.935 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:38:40.935 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:38:40.935 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:38:40.936 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:38:40.936 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:38:40.937 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:38:40.937 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:38:40.937 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:38:40.939 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:38:40.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:40.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:40.996 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:38:41.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:38:41.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:41.088 INFO:teuthology.orchestra.run.smithi121.stdout:client5958 2024-09-17T03:38:41.088 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:41.089 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:41.124 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:38:41.124 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:38:41.256 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:38:41.359 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:38:41.360 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:38:41.360 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:41.360 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:41.395 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:41.396 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:41.471 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:38:41.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.732+0000 7f5364400640 1 -- 172.21.15.121:0/507121799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f535c0ce9e0 msgr2=0x7f535c0d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:41.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.732+0000 7f5364400640 1 --2- 172.21.15.121:0/507121799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f535c0ce9e0 0x7f535c0d0c40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f535c072960 tx=0x7f534802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:38:41.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.732+0000 7f5364400640 1 -- 172.21.15.121:0/507121799 shutdown_connections 2024-09-17T03:38:41.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.732+0000 7f5364400640 1 --2- 172.21.15.121:0/507121799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535c06cde0 0x7f535c06d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:41.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.732+0000 7f5364400640 1 --2- 172.21.15.121:0/507121799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f535c0ce9e0 0x7f535c0d0c40 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:41.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.732+0000 7f5364400640 1 --2- 172.21.15.121:0/507121799 >> v2:172.21.15.176:3300/0 conn(0x7f535c0cc270 0x7f535c0d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:41.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.732+0000 7f5364400640 1 -- 172.21.15.121:0/507121799 >> 172.21.15.121:0/507121799 conn(0x7f535c0b3580 msgr2=0x7f535c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:41.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.732+0000 7f5364400640 1 -- 172.21.15.121:0/507121799 shutdown_connections 2024-09-17T03:38:41.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.732+0000 7f5364400640 1 -- 172.21.15.121:0/507121799 wait complete. 2024-09-17T03:38:41.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.735+0000 7f5364400640 1 Processor -- start 2024-09-17T03:38:41.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.735+0000 7f5364400640 1 -- start start 2024-09-17T03:38:41.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5364400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535c06cde0 0x7f535c0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:41.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5364400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535c0cc270 0x7f535c0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:41.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5364400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f535c0ce9e0 0x7f535c0b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:41.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5364400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f535c0afad0 con 0x7f535c0ce9e0 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5364400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f535c0af950 con 0x7f535c06cde0 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5364400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f535c06d730 con 0x7f535c0cc270 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5362400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f535c0ce9e0 0x7f535c0b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5362400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f535c0ce9e0 0x7f535c0b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48184/0 (socket says 172.21.15.121:48184) 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5362400640 1 -- 172.21.15.121:0/914780876 learned_addr learned my addr 172.21.15.121:0/914780876 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5361000640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535c0cc270 0x7f535c0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.736+0000 7f5361a00640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535c06cde0 0x7f535c0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5362400640 1 -- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535c0cc270 msgr2=0x7f535c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5362400640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535c0cc270 0x7f535c0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5362400640 1 -- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535c06cde0 msgr2=0x7f535c0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5362400640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535c06cde0 0x7f535c0cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5362400640 1 -- 172.21.15.121:0/914780876 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c159aa0 con 0x7f535c0ce9e0 2024-09-17T03:38:41.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5362400640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f535c0ce9e0 0x7f535c0b26d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f535400e9d0 tx=0x7f535400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:41.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5359600640 1 -- 172.21.15.121:0/914780876 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535400cd80 con 0x7f535c0ce9e0 2024-09-17T03:38:41.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5359600640 1 -- 172.21.15.121:0/914780876 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5354004b20 con 0x7f535c0ce9e0 2024-09-17T03:38:41.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5359600640 1 -- 172.21.15.121:0/914780876 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354005020 con 0x7f535c0ce9e0 2024-09-17T03:38:41.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5364400640 1 -- 172.21.15.121:0/914780876 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535c1f6910 con 0x7f535c0ce9e0 2024-09-17T03:38:41.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.737+0000 7f5364400640 1 -- 172.21.15.121:0/914780876 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535c1f6ed0 con 0x7f535c0ce9e0 2024-09-17T03:38:41.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.738+0000 7f5364400640 1 -- 172.21.15.121:0/914780876 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535c06dbb0 con 0x7f535c0ce9e0 2024-09-17T03:38:41.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.740+0000 7f5359600640 1 -- 172.21.15.121:0/914780876 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f53540051c0 con 0x7f535c0ce9e0 2024-09-17T03:38:41.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.741+0000 7f5359600640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f533c078bc0 0x7f533c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:41.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.741+0000 7f5359600640 1 -- 172.21.15.121:0/914780876 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f535409bad0 con 0x7f535c0ce9e0 2024-09-17T03:38:41.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.741+0000 7f5361a00640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f533c078bc0 0x7f533c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:41.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.742+0000 7f5361a00640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f533c078bc0 0x7f533c07b0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5350009b30 tx=0x7f5350005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:41.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.745+0000 7f5359600640 1 -- 172.21.15.121:0/914780876 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5354063c40 con 0x7f535c0ce9e0 2024-09-17T03:38:41.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.943+0000 7f5364400640 1 -- 172.21.15.121:0/914780876 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f535c0d0ba0 con 0x7f535c0ce9e0 2024-09-17T03:38:41.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.943+0000 7f5359600640 1 -- 172.21.15.121:0/914780876 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) ==== 80+0+0 (secure 0 0 0) 0x7f5354063540 con 0x7f535c0ce9e0 2024-09-17T03:38:41.944 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:38:41.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 -- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f533c078bc0 msgr2=0x7f533c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:41.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f533c078bc0 0x7f533c07b0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5350009b30 tx=0x7f5350005f90 comp rx=0 tx=0).stop 2024-09-17T03:38:41.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 -- 172.21.15.121:0/914780876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f535c0ce9e0 msgr2=0x7f535c0b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:41.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f535c0ce9e0 0x7f535c0b26d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f535400e9d0 tx=0x7f535400ee90 comp rx=0 tx=0).stop 2024-09-17T03:38:41.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 -- 172.21.15.121:0/914780876 shutdown_connections 2024-09-17T03:38:41.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f533c078bc0 0x7f533c07b0d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:41.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f535c0ce9e0 0x7f535c0b26d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535c0cc270 0x7f535c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 --2- 172.21.15.121:0/914780876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535c06cde0 0x7f535c0cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 -- 172.21.15.121:0/914780876 >> 172.21.15.121:0/914780876 conn(0x7f535c0b3580 msgr2=0x7f535c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 -- 172.21.15.121:0/914780876 shutdown_connections 2024-09-17T03:38:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:41.946+0000 7f5364400640 1 -- 172.21.15.121:0/914780876 wait complete. 2024-09-17T03:38:41.972 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:38:41.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:41.973 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:42.034 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:38:42.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:42.035 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:38:42.071 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:38:42.071 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:38:42.071 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:42.111 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:38:42.111 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:42.191 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:38:42.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.412+0000 7f5929400640 1 -- 172.21.15.121:0/2270389142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59240d0af0 msgr2=0x7f592415cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:42.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.412+0000 7f5929400640 1 --2- 172.21.15.121:0/2270389142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59240d0af0 0x7f592415cc10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5924072680 tx=0x7f591c02a9a0 comp rx=0 tx=0).stop 2024-09-17T03:38:42.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.412+0000 7f5929400640 1 -- 172.21.15.121:0/2270389142 shutdown_connections 2024-09-17T03:38:42.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.412+0000 7f5929400640 1 --2- 172.21.15.121:0/2270389142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59240d0af0 0x7f592415cc10 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:42.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.412+0000 7f5929400640 1 --2- 172.21.15.121:0/2270389142 >> v2:172.21.15.176:3300/0 conn(0x7f592406d800 0x7f59240d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:42.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.412+0000 7f5929400640 1 -- 172.21.15.121:0/2270389142 >> 172.21.15.121:0/2270389142 conn(0x7f59240b3580 msgr2=0x7f59240b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:42.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.412+0000 7f5929400640 1 -- 172.21.15.121:0/2270389142 shutdown_connections 2024-09-17T03:38:42.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.412+0000 7f5929400640 1 -- 172.21.15.121:0/2270389142 wait complete. 2024-09-17T03:38:42.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.414+0000 7f5929400640 1 Processor -- start 2024-09-17T03:38:42.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.415+0000 7f5929400640 1 -- start start 2024-09-17T03:38:42.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5929400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f592406d800 0x7f59241548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:42.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5929400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59240d0af0 0x7f5924159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:42.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5929400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f592415a3e0 0x7f5924159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:42.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5929400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f592415d4e0 con 0x7f592415a3e0 2024-09-17T03:38:42.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5929400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f592415d360 con 0x7f592406d800 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5929400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f592415d660 con 0x7f59240d0af0 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5923200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f592415a3e0 0x7f5924159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5923200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f592415a3e0 0x7f5924159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48360/0 (socket says 172.21.15.121:48360) 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5923200640 1 -- 172.21.15.121:0/3897543692 learned_addr learned my addr 172.21.15.121:0/3897543692 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5922800640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f592406d800 0x7f59241548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.416+0000 7f5919e00640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59240d0af0 0x7f5924159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.417+0000 7f5923200640 1 -- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59240d0af0 msgr2=0x7f5924159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.417+0000 7f5923200640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59240d0af0 0x7f5924159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.417+0000 7f5923200640 1 -- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f592406d800 msgr2=0x7f59241548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.417+0000 7f5923200640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f592406d800 0x7f59241548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.417+0000 7f5923200640 1 -- 172.21.15.121:0/3897543692 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59240c9cd0 con 0x7f592415a3e0 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.417+0000 7f5923200640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f592415a3e0 0x7f5924159750 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f591c009d60 tx=0x7f591c003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.417+0000 7f591b400640 1 -- 172.21.15.121:0/3897543692 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c033050 con 0x7f592415a3e0 2024-09-17T03:38:42.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.417+0000 7f591b400640 1 -- 172.21.15.121:0/3897543692 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f591c004450 con 0x7f592415a3e0 2024-09-17T03:38:42.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.417+0000 7f5929400640 1 -- 172.21.15.121:0/3897543692 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59240c9fb0 con 0x7f592415a3e0 2024-09-17T03:38:42.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.417+0000 7f591b400640 1 -- 172.21.15.121:0/3897543692 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c004860 con 0x7f592415a3e0 2024-09-17T03:38:42.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.418+0000 7f5929400640 1 -- 172.21.15.121:0/3897543692 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59240ca570 con 0x7f592415a3e0 2024-09-17T03:38:42.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.419+0000 7f5929400640 1 -- 172.21.15.121:0/3897543692 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5924155190 con 0x7f592415a3e0 2024-09-17T03:38:42.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.420+0000 7f591b400640 1 -- 172.21.15.121:0/3897543692 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f591c036070 con 0x7f592415a3e0 2024-09-17T03:38:42.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.421+0000 7f591b400640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5900078bf0 0x7f590007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:42.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.421+0000 7f591b400640 1 -- 172.21.15.121:0/3897543692 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f591c0bbfa0 con 0x7f592415a3e0 2024-09-17T03:38:42.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.421+0000 7f5922800640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5900078bf0 0x7f590007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:42.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.422+0000 7f5922800640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5900078bf0 0x7f590007b100 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5914001720 tx=0x7f5914009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:42.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.425+0000 7f591b400640 1 -- 172.21.15.121:0/3897543692 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f591c083b50 con 0x7f592415a3e0 2024-09-17T03:38:42.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.620+0000 7f5929400640 1 -- 172.21.15.121:0/3897543692 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5924154ed0 con 0x7f592415a3e0 2024-09-17T03:38:42.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.620+0000 7f591b400640 1 -- 172.21.15.121:0/3897543692 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) ==== 80+0+0 (secure 0 0 0) 0x7f591c088580 con 0x7f592415a3e0 2024-09-17T03:38:42.621 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:38:42.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.622+0000 7f5929400640 1 -- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5900078bf0 msgr2=0x7f590007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:42.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.622+0000 7f5929400640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5900078bf0 0x7f590007b100 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5914001720 tx=0x7f5914009040 comp rx=0 tx=0).stop 2024-09-17T03:38:42.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.622+0000 7f5929400640 1 -- 172.21.15.121:0/3897543692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f592415a3e0 msgr2=0x7f5924159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:42.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.622+0000 7f5929400640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f592415a3e0 0x7f5924159750 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f591c009d60 tx=0x7f591c003ef0 comp rx=0 tx=0).stop 2024-09-17T03:38:42.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.622+0000 7f5929400640 1 -- 172.21.15.121:0/3897543692 shutdown_connections 2024-09-17T03:38:42.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.622+0000 7f5929400640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5900078bf0 0x7f590007b100 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:42.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.622+0000 7f5929400640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f592415a3e0 0x7f5924159750 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:42.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.622+0000 7f5929400640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59240d0af0 0x7f5924159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:42.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.622+0000 7f5929400640 1 --2- 172.21.15.121:0/3897543692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f592406d800 0x7f59241548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:42.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.623+0000 7f5929400640 1 -- 172.21.15.121:0/3897543692 >> 172.21.15.121:0/3897543692 conn(0x7f59240b3580 msgr2=0x7f592415aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:42.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.623+0000 7f5929400640 1 -- 172.21.15.121:0/3897543692 shutdown_connections 2024-09-17T03:38:42.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:42.623+0000 7f5929400640 1 -- 172.21.15.121:0/3897543692 wait complete. 2024-09-17T03:38:42.645 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:38:42.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:42.645 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:38:42.756 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:38:42.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:42.757 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:38:42.822 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:38:42.822 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:42.822 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:42.858 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:38:42.858 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:38:42.858 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:38:42.858 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:42.894 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:38:42.894 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:43.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.118+0000 7fd702000640 1 -- 172.21.15.121:0/208973582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6fc15a3e0 msgr2=0x7fd6fc06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:43.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.118+0000 7fd702000640 1 --2- 172.21.15.121:0/208973582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6fc15a3e0 0x7fd6fc06d800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009830 tx=0x7fd6ec02a3f0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.118+0000 7fd702000640 1 -- 172.21.15.121:0/208973582 shutdown_connections 2024-09-17T03:38:43.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.118+0000 7fd702000640 1 --2- 172.21.15.121:0/208973582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6fc0d0cc0 0x7fd6fc15cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.118+0000 7fd702000640 1 --2- 172.21.15.121:0/208973582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6fc15a3e0 0x7fd6fc06d800 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.118+0000 7fd702000640 1 -- 172.21.15.121:0/208973582 >> 172.21.15.121:0/208973582 conn(0x7fd6fc0b3580 msgr2=0x7fd6fc0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:43.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.118+0000 7fd702000640 1 -- 172.21.15.121:0/208973582 shutdown_connections 2024-09-17T03:38:43.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.118+0000 7fd702000640 1 -- 172.21.15.121:0/208973582 wait complete. 2024-09-17T03:38:43.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.120+0000 7fd702000640 1 Processor -- start 2024-09-17T03:38:43.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.121+0000 7fd702000640 1 -- start start 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.122+0000 7fd702000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6fc06ddc0 0x7fd6fc0c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.122+0000 7fd702000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6fc15a3e0 0x7fd6fc15f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.122+0000 7fd702000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc15f5c0 0x7fd6fc099590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.122+0000 7fd702000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc15d4e0 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.122+0000 7fd702000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc15d360 con 0x7fd6fc06ddc0 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.122+0000 7fd702000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd6fc15d660 con 0x7fd6fc15a3e0 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.122+0000 7fd6fbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc15f5c0 0x7fd6fc099590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.122+0000 7fd6fbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc15f5c0 0x7fd6fc099590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48372/0 (socket says 172.21.15.121:48372) 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.122+0000 7fd6fbe00640 1 -- 172.21.15.121:0/2579787085 learned_addr learned my addr 172.21.15.121:0/2579787085 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.122+0000 7fd6f2a00640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6fc15a3e0 0x7fd6fc15f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:43.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.123+0000 7fd6fb400640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6fc06ddc0 0x7fd6fc0c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:43.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.123+0000 7fd6fbe00640 1 -- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6fc15a3e0 msgr2=0x7fd6fc15f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:43.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.123+0000 7fd6fbe00640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6fc15a3e0 0x7fd6fc15f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.123+0000 7fd6fbe00640 1 -- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6fc06ddc0 msgr2=0x7fd6fc0c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:43.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.123+0000 7fd6fbe00640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6fc06ddc0 0x7fd6fc0c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.123+0000 7fd6fbe00640 1 -- 172.21.15.121:0/2579787085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6fc1f59d0 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.123+0000 7fd6fbe00640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc15f5c0 0x7fd6fc099590 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400ea70 tx=0x7fd6f400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:43.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.123+0000 7fd6f3e00640 1 -- 172.21.15.121:0/2579787085 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400ce40 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.123+0000 7fd6f3e00640 1 -- 172.21.15.121:0/2579787085 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6f4004c10 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.124+0000 7fd702000640 1 -- 172.21.15.121:0/2579787085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6fc1f5cb0 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.124+0000 7fd6f3e00640 1 -- 172.21.15.121:0/2579787085 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4005020 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.124+0000 7fd702000640 1 -- 172.21.15.121:0/2579787085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6fc1f6270 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.125+0000 7fd702000640 1 -- 172.21.15.121:0/2579787085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6fc1f9ac0 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.126+0000 7fd6f3e00640 1 -- 172.21.15.121:0/2579787085 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd6f40051c0 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.127+0000 7fd6f3e00640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd6d8078b90 0x7fd6d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:43.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.127+0000 7fd6f3e00640 1 -- 172.21.15.121:0/2579787085 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7fd6f409bd60 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.127+0000 7fd6fb400640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd6d8078b90 0x7fd6d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:43.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.128+0000 7fd6fb400640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd6d8078b90 0x7fd6d807b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec034000 tx=0x7fd6ec004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:43.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.131+0000 7fd6f3e00640 1 -- 172.21.15.121:0/2579787085 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd6f4063880 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.350+0000 7fd702000640 1 -- 172.21.15.121:0/2579787085 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6fc15cf70 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.351+0000 7fd6f3e00640 1 -- 172.21.15.121:0/2579787085 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5256 (secure 0 0 0) 0x7fd6fc15cf70 con 0x7fd6fc15f5c0 2024-09-17T03:38:43.352 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:43.352 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":41,"btime":"2024-09-17T03:38:25:452654+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1006042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1006042508},{"type":"v1","addr":"172.21.15.176:6836","nonce":1006042508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3672630729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3672630729},{"type":"v1","addr":"172.21.15.176:6837","nonce":3672630729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:59.696137+0000","modified":"2024-09-17T03:38:25.180701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5712,"mds_1":5234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5234":{"gid":5234,"name":"c","rank":1,"incarnation":39,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6835/4058545170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4058545170},{"type":"v1","addr":"172.21.15.121:6835","nonce":4058545170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5712":{"gid":5712,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6833/3893444987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3893444987},{"type":"v1","addr":"172.21.15.121:6833","nonce":3893444987}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5712,"qdb_cluster":[5712,5234]},"id":4}]} 2024-09-17T03:38:43.352 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 41 2024-09-17T03:38:43.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 -- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd6d8078b90 msgr2=0x7fd6d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:43.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd6d8078b90 0x7fd6d807b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec034000 tx=0x7fd6ec004730 comp rx=0 tx=0).stop 2024-09-17T03:38:43.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 -- 172.21.15.121:0/2579787085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc15f5c0 msgr2=0x7fd6fc099590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:43.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc15f5c0 0x7fd6fc099590 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400ea70 tx=0x7fd6f400ef30 comp rx=0 tx=0).stop 2024-09-17T03:38:43.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 -- 172.21.15.121:0/2579787085 shutdown_connections 2024-09-17T03:38:43.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd6d8078b90 0x7fd6d807b0a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc15f5c0 0x7fd6fc099590 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6fc15a3e0 0x7fd6fc15f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 --2- 172.21.15.121:0/2579787085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6fc06ddc0 0x7fd6fc0c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 -- 172.21.15.121:0/2579787085 >> 172.21.15.121:0/2579787085 conn(0x7fd6fc0b3580 msgr2=0x7fd6fc068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:43.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 -- 172.21.15.121:0/2579787085 shutdown_connections 2024-09-17T03:38:43.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.353+0000 7fd702000640 1 -- 172.21.15.121:0/2579787085 wait complete. 2024-09-17T03:38:43.375 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:43.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.594+0000 7fd751600640 1 -- 172.21.15.121:0/2765812243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c15a3e0 msgr2=0x7fd74c06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:43.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.594+0000 7fd751600640 1 --2- 172.21.15.121:0/2765812243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c15a3e0 0x7fd74c06d800 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009830 tx=0x7fd73c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.595+0000 7fd751600640 1 -- 172.21.15.121:0/2765812243 shutdown_connections 2024-09-17T03:38:43.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.595+0000 7fd751600640 1 --2- 172.21.15.121:0/2765812243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c15a3e0 0x7fd74c06d800 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.595+0000 7fd751600640 1 -- 172.21.15.121:0/2765812243 >> 172.21.15.121:0/2765812243 conn(0x7fd74c0b3580 msgr2=0x7fd74c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:43.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.595+0000 7fd751600640 1 -- 172.21.15.121:0/2765812243 shutdown_connections 2024-09-17T03:38:43.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.595+0000 7fd751600640 1 -- 172.21.15.121:0/2765812243 wait complete. 2024-09-17T03:38:43.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.597+0000 7fd751600640 1 Processor -- start 2024-09-17T03:38:43.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.597+0000 7fd751600640 1 -- start start 2024-09-17T03:38:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.598+0000 7fd751600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74c06ddc0 0x7fd74c0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.598+0000 7fd751600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74c15a3e0 0x7fd74c0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.598+0000 7fd751600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c15bd20 0x7fd74c0b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.598+0000 7fd751600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c15d6b0 con 0x7fd74c15bd20 2024-09-17T03:38:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.598+0000 7fd751600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c15d530 con 0x7fd74c06ddc0 2024-09-17T03:38:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.598+0000 7fd751600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd74c15d830 con 0x7fd74c15a3e0 2024-09-17T03:38:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c15bd20 0x7fd74c0b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c15bd20 0x7fd74c0b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48386/0 (socket says 172.21.15.121:48386) 2024-09-17T03:38:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74b400640 1 -- 172.21.15.121:0/3107257046 learned_addr learned my addr 172.21.15.121:0/3107257046 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:43.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74aa00640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74c06ddc0 0x7fd74c0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:43.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74a000640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74c15a3e0 0x7fd74c0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:43.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74b400640 1 -- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74c15a3e0 msgr2=0x7fd74c0b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:43.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74b400640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74c15a3e0 0x7fd74c0b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74b400640 1 -- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74c06ddc0 msgr2=0x7fd74c0c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:43.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74b400640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74c06ddc0 0x7fd74c0c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74b400640 1 -- 172.21.15.121:0/3107257046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c1f5b50 con 0x7fd74c15bd20 2024-09-17T03:38:43.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.599+0000 7fd74b400640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c15bd20 0x7fd74c0b1990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd74400cb10 tx=0x7fd74400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:43.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.600+0000 7fd742a00640 1 -- 172.21.15.121:0/3107257046 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744016020 con 0x7fd74c15bd20 2024-09-17T03:38:43.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.600+0000 7fd742a00640 1 -- 172.21.15.121:0/3107257046 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd74400ad00 con 0x7fd74c15bd20 2024-09-17T03:38:43.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.600+0000 7fd751600640 1 -- 172.21.15.121:0/3107257046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c1f5e30 con 0x7fd74c15bd20 2024-09-17T03:38:43.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.600+0000 7fd742a00640 1 -- 172.21.15.121:0/3107257046 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744012680 con 0x7fd74c15bd20 2024-09-17T03:38:43.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.600+0000 7fd751600640 1 -- 172.21.15.121:0/3107257046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c1f63f0 con 0x7fd74c15bd20 2024-09-17T03:38:43.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.601+0000 7fd751600640 1 -- 172.21.15.121:0/3107257046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74c1566e0 con 0x7fd74c15bd20 2024-09-17T03:38:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.602+0000 7fd742a00640 1 -- 172.21.15.121:0/3107257046 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd744019020 con 0x7fd74c15bd20 2024-09-17T03:38:43.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.603+0000 7fd742a00640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd72c078b90 0x7fd72c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:43.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.604+0000 7fd742a00640 1 -- 172.21.15.121:0/3107257046 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7fd74409b2a0 con 0x7fd74c15bd20 2024-09-17T03:38:43.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.604+0000 7fd74aa00640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd72c078b90 0x7fd72c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:43.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.604+0000 7fd74aa00640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd72c078b90 0x7fd72c07b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd73c034000 tx=0x7fd73c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:43.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.608+0000 7fd742a00640 1 -- 172.21.15.121:0/3107257046 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd74c1566e0 con 0x7fd74c15bd20 2024-09-17T03:38:43.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.826+0000 7fd751600640 1 -- 172.21.15.121:0/3107257046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd74c0b2330 con 0x7fd74c15bd20 2024-09-17T03:38:43.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.826+0000 7fd742a00640 1 -- 172.21.15.121:0/3107257046 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5256 (secure 0 0 0) 0x7fd744020030 con 0x7fd74c15bd20 2024-09-17T03:38:43.827 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:43.827 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":41,"btime":"2024-09-17T03:38:25:452654+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1006042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1006042508},{"type":"v1","addr":"172.21.15.176:6836","nonce":1006042508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3672630729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3672630729},{"type":"v1","addr":"172.21.15.176:6837","nonce":3672630729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:59.696137+0000","modified":"2024-09-17T03:38:25.180701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5712,"mds_1":5234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5234":{"gid":5234,"name":"c","rank":1,"incarnation":39,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6835/4058545170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4058545170},{"type":"v1","addr":"172.21.15.121:6835","nonce":4058545170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5712":{"gid":5712,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6833/3893444987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3893444987},{"type":"v1","addr":"172.21.15.121:6833","nonce":3893444987}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5712,"qdb_cluster":[5712,5234]},"id":4}]} 2024-09-17T03:38:43.828 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 41 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 -- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd72c078b90 msgr2=0x7fd72c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd72c078b90 0x7fd72c07b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd73c034000 tx=0x7fd73c004730 comp rx=0 tx=0).stop 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 -- 172.21.15.121:0/3107257046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c15bd20 msgr2=0x7fd74c0b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c15bd20 0x7fd74c0b1990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd74400cb10 tx=0x7fd74400a060 comp rx=0 tx=0).stop 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 -- 172.21.15.121:0/3107257046 shutdown_connections 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd72c078b90 0x7fd72c07b0a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c15bd20 0x7fd74c0b1990 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74c15a3e0 0x7fd74c0b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 --2- 172.21.15.121:0/3107257046 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74c06ddc0 0x7fd74c0c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 -- 172.21.15.121:0/3107257046 >> 172.21.15.121:0/3107257046 conn(0x7fd74c0b3580 msgr2=0x7fd74c159380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 -- 172.21.15.121:0/3107257046 shutdown_connections 2024-09-17T03:38:43.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:43.829+0000 7fd751600640 1 -- 172.21.15.121:0/3107257046 wait complete. 2024-09-17T03:38:43.853 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:44.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.071+0000 7f7d37600640 1 -- 172.21.15.121:0/1422857588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d300d0e10 msgr2=0x7f7d300ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:44.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.071+0000 7f7d37600640 1 --2- 172.21.15.121:0/1422857588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d300d0e10 0x7f7d300ca7e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7d18005fd0 tx=0x7f7d1802a660 comp rx=0 tx=0).stop 2024-09-17T03:38:44.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.071+0000 7f7d37600640 1 -- 172.21.15.121:0/1422857588 shutdown_connections 2024-09-17T03:38:44.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.071+0000 7f7d37600640 1 --2- 172.21.15.121:0/1422857588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300ce9e0 0x7f7d300cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.071+0000 7f7d37600640 1 --2- 172.21.15.121:0/1422857588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d300d0e10 0x7f7d300ca7e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.071+0000 7f7d37600640 1 -- 172.21.15.121:0/1422857588 >> 172.21.15.121:0/1422857588 conn(0x7f7d300b3580 msgr2=0x7f7d300b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:44.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.071+0000 7f7d37600640 1 -- 172.21.15.121:0/1422857588 shutdown_connections 2024-09-17T03:38:44.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.071+0000 7f7d37600640 1 -- 172.21.15.121:0/1422857588 wait complete. 2024-09-17T03:38:44.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.073+0000 7f7d37600640 1 Processor -- start 2024-09-17T03:38:44.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.073+0000 7f7d37600640 1 -- start start 2024-09-17T03:38:44.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d37600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d300cc270 0x7f7d3015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:44.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d37600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300ce9e0 0x7f7d301f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:44.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d37600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300ae430 0x7f7d300ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:44.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d37600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7d300cb3e0 con 0x7f7d300cc270 2024-09-17T03:38:44.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d37600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d300cb260 con 0x7f7d300ae430 2024-09-17T03:38:44.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d37600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d300cb560 con 0x7f7d300ce9e0 2024-09-17T03:38:44.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d34c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d300cc270 0x7f7d3015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d34c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d300cc270 0x7f7d3015e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48416/0 (socket says 172.21.15.121:48416) 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d34c00640 1 -- 172.21.15.121:0/1899037005 learned_addr learned my addr 172.21.15.121:0/1899037005 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d27e00640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300ce9e0 0x7f7d301f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.075+0000 7f7d35600640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300ae430 0x7f7d300ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d34c00640 1 -- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300ce9e0 msgr2=0x7f7d301f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d34c00640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300ce9e0 0x7f7d301f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d34c00640 1 -- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300ae430 msgr2=0x7f7d300ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d34c00640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300ae430 0x7f7d300ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d34c00640 1 -- 172.21.15.121:0/1899037005 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d300b0f60 con 0x7f7d300cc270 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d35600640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300ae430 0x7f7d300ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d34c00640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d300cc270 0x7f7d3015e2c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000c3d0 tx=0x7f7d2000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d2d600640 1 -- 172.21.15.121:0/1899037005 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20017070 con 0x7f7d300cc270 2024-09-17T03:38:44.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d2d600640 1 -- 172.21.15.121:0/1899037005 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d200053c0 con 0x7f7d300cc270 2024-09-17T03:38:44.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d37600640 1 -- 172.21.15.121:0/1899037005 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d300b1240 con 0x7f7d300cc270 2024-09-17T03:38:44.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d2d600640 1 -- 172.21.15.121:0/1899037005 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20003850 con 0x7f7d300cc270 2024-09-17T03:38:44.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.076+0000 7f7d37600640 1 -- 172.21.15.121:0/1899037005 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d300b1800 con 0x7f7d300cc270 2024-09-17T03:38:44.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.077+0000 7f7d37600640 1 -- 172.21.15.121:0/1899037005 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d300ca7e0 con 0x7f7d300cc270 2024-09-17T03:38:44.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.079+0000 7f7d2d600640 1 -- 172.21.15.121:0/1899037005 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d2001a070 con 0x7f7d300cc270 2024-09-17T03:38:44.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.080+0000 7f7d2d600640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7d0c078b90 0x7f7d0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:44.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.080+0000 7f7d2d600640 1 -- 172.21.15.121:0/1899037005 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7f7d2009a290 con 0x7f7d300cc270 2024-09-17T03:38:44.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.080+0000 7f7d27e00640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7d0c078b90 0x7f7d0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:44.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.081+0000 7f7d27e00640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7d0c078b90 0x7f7d0c07b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d18033000 tx=0x7f7d18004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:44.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.084+0000 7f7d2d600640 1 -- 172.21.15.121:0/1899037005 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d20061e40 con 0x7f7d300cc270 2024-09-17T03:38:44.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.270+0000 7f7d37600640 1 -- 172.21.15.121:0/1899037005 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d301e8590 con 0x7f7d300cc270 2024-09-17T03:38:44.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.271+0000 7f7d2d600640 1 -- 172.21.15.121:0/1899037005 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+17387 (secure 0 0 0) 0x7f7d20066870 con 0x7f7d300cc270 2024-09-17T03:38:44.272 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:44.272 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":65,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:38:12.412071+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:57.609318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:58.662483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1","mappings":[{"from":2,"to":7}]},{"pgid":"10.7","mappings":[{"from":4,"to":1}]},{"pgid":"10.c","mappings":[{"from":2,"to":5}]},{"pgid":"10.1c","mappings":[{"from":2,"to":7}]},{"pgid":"10.1d","mappings":[{"from":2,"to":7}]},{"pgid":"10.2c","mappings":[{"from":2,"to":1}]},{"pgid":"10.3b","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:44.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 -- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7d0c078b90 msgr2=0x7f7d0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7d0c078b90 0x7f7d0c07b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d18033000 tx=0x7f7d18004730 comp rx=0 tx=0).stop 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 -- 172.21.15.121:0/1899037005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d300cc270 msgr2=0x7f7d3015e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d300cc270 0x7f7d3015e2c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000c3d0 tx=0x7f7d2000c890 comp rx=0 tx=0).stop 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 -- 172.21.15.121:0/1899037005 shutdown_connections 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d300ae430 0x7f7d300ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d300ce9e0 0x7f7d301f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7d0c078b90 0x7f7d0c07b0a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 --2- 172.21.15.121:0/1899037005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d300cc270 0x7f7d3015e2c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 -- 172.21.15.121:0/1899037005 >> 172.21.15.121:0/1899037005 conn(0x7f7d300b3580 msgr2=0x7f7d300cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 -- 172.21.15.121:0/1899037005 shutdown_connections 2024-09-17T03:38:44.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.273+0000 7f7d37600640 1 -- 172.21.15.121:0/1899037005 wait complete. 2024-09-17T03:38:44.296 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:38:44.297 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:44.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.518+0000 7fe68dc00640 1 -- 172.21.15.121:0/19926339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6880cca80 msgr2=0x7fe6880707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.518+0000 7fe68dc00640 1 --2- 172.21.15.121:0/19926339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6880cca80 0x7fe6880707c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe678005fd0 tx=0x7fe67802a4b0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.518+0000 7fe68dc00640 1 -- 172.21.15.121:0/19926339 shutdown_connections 2024-09-17T03:38:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.518+0000 7fe68dc00640 1 --2- 172.21.15.121:0/19926339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe68806d620 0x7fe6880d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.518+0000 7fe68dc00640 1 --2- 172.21.15.121:0/19926339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6880cca80 0x7fe6880707c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.518+0000 7fe68dc00640 1 -- 172.21.15.121:0/19926339 >> 172.21.15.121:0/19926339 conn(0x7fe6880b3580 msgr2=0x7fe6880b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.518+0000 7fe68dc00640 1 -- 172.21.15.121:0/19926339 shutdown_connections 2024-09-17T03:38:44.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.518+0000 7fe68dc00640 1 -- 172.21.15.121:0/19926339 wait complete. 2024-09-17T03:38:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.521+0000 7fe68dc00640 1 Processor -- start 2024-09-17T03:38:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.521+0000 7fe68dc00640 1 -- start start 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.522+0000 7fe68dc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe68806d620 0x7fe6880c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.522+0000 7fe68dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe68806da30 0x7fe6880b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.522+0000 7fe68dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880cca80 0x7fe6880c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.522+0000 7fe68dc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe6880d0b70 con 0x7fe68806d620 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.522+0000 7fe68dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6880d0cf0 con 0x7fe6880cca80 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.522+0000 7fe68dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6880d0e70 con 0x7fe68806da30 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.522+0000 7fe686a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe68806d620 0x7fe6880c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.523+0000 7fe686a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe68806d620 0x7fe6880c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48444/0 (socket says 172.21.15.121:48444) 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.523+0000 7fe686a00640 1 -- 172.21.15.121:0/476285999 learned_addr learned my addr 172.21.15.121:0/476285999 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.523+0000 7fe686000640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe68806da30 0x7fe6880b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.523+0000 7fe687400640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880cca80 0x7fe6880c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:44.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.523+0000 7fe686a00640 1 -- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe68806da30 msgr2=0x7fe6880b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:44.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.523+0000 7fe686a00640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe68806da30 0x7fe6880b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.523+0000 7fe686a00640 1 -- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880cca80 msgr2=0x7fe6880c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:44.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.523+0000 7fe686a00640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880cca80 0x7fe6880c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.523+0000 7fe686a00640 1 -- 172.21.15.121:0/476285999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68815c4d0 con 0x7fe68806d620 2024-09-17T03:38:44.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.523+0000 7fe686a00640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe68806d620 0x7fe6880c45c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe678034040 tx=0x7fe6780038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:44.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.524+0000 7fe67ea00640 1 -- 172.21.15.121:0/476285999 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67803e030 con 0x7fe68806d620 2024-09-17T03:38:44.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.524+0000 7fe67ea00640 1 -- 172.21.15.121:0/476285999 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe678003d90 con 0x7fe68806d620 2024-09-17T03:38:44.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.524+0000 7fe68dc00640 1 -- 172.21.15.121:0/476285999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68815c7b0 con 0x7fe68806d620 2024-09-17T03:38:44.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.524+0000 7fe67ea00640 1 -- 172.21.15.121:0/476285999 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe678035040 con 0x7fe68806d620 2024-09-17T03:38:44.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.524+0000 7fe68dc00640 1 -- 172.21.15.121:0/476285999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe68815cd70 con 0x7fe68806d620 2024-09-17T03:38:44.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.525+0000 7fe68dc00640 1 -- 172.21.15.121:0/476285999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6880cc0c0 con 0x7fe68806d620 2024-09-17T03:38:44.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.526+0000 7fe67ea00640 1 -- 172.21.15.121:0/476285999 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe678041030 con 0x7fe68806d620 2024-09-17T03:38:44.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.528+0000 7fe67ea00640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe668078b90 0x7fe66807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:44.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.528+0000 7fe67ea00640 1 -- 172.21.15.121:0/476285999 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7fe6780bbab0 con 0x7fe68806d620 2024-09-17T03:38:44.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.528+0000 7fe686000640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe668078b90 0x7fe66807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:44.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.529+0000 7fe686000640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe668078b90 0x7fe66807b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe6880c4f10 tx=0x7fe67400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:44.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.532+0000 7fe67ea00640 1 -- 172.21.15.121:0/476285999 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe678083660 con 0x7fe68806d620 2024-09-17T03:38:44.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.767+0000 7fe68dc00640 1 -- 172.21.15.121:0/476285999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe688074000 con 0x7fe68806d620 2024-09-17T03:38:44.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.768+0000 7fe67ea00640 1 -- 172.21.15.121:0/476285999 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5256 (secure 0 0 0) 0x7fe678088090 con 0x7fe68806d620 2024-09-17T03:38:44.769 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:44.769 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":41,"btime":"2024-09-17T03:38:25:452654+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1006042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1006042508},{"type":"v1","addr":"172.21.15.176:6836","nonce":1006042508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3672630729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3672630729},{"type":"v1","addr":"172.21.15.176:6837","nonce":3672630729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:59.696137+0000","modified":"2024-09-17T03:38:25.180701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5712,"mds_1":5234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5234":{"gid":5234,"name":"c","rank":1,"incarnation":39,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6835/4058545170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4058545170},{"type":"v1","addr":"172.21.15.121:6835","nonce":4058545170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5712":{"gid":5712,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6833/3893444987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3893444987},{"type":"v1","addr":"172.21.15.121:6833","nonce":3893444987}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5712,"qdb_cluster":[5712,5234]},"id":4}]} 2024-09-17T03:38:44.769 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 41 2024-09-17T03:38:44.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.770+0000 7fe68dc00640 1 -- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe668078b90 msgr2=0x7fe66807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:44.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.770+0000 7fe68dc00640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe668078b90 0x7fe66807b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe6880c4f10 tx=0x7fe67400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.770+0000 7fe68dc00640 1 -- 172.21.15.121:0/476285999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe68806d620 msgr2=0x7fe6880c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:44.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.770+0000 7fe68dc00640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe68806d620 0x7fe6880c45c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe678034040 tx=0x7fe6780038a0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.770+0000 7fe68dc00640 1 -- 172.21.15.121:0/476285999 shutdown_connections 2024-09-17T03:38:44.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.770+0000 7fe68dc00640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880cca80 0x7fe6880c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.770+0000 7fe68dc00640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe68806da30 0x7fe6880b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.770+0000 7fe68dc00640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe668078b90 0x7fe66807b0a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.770+0000 7fe68dc00640 1 --2- 172.21.15.121:0/476285999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe68806d620 0x7fe6880c45c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:44.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.770+0000 7fe68dc00640 1 -- 172.21.15.121:0/476285999 >> 172.21.15.121:0/476285999 conn(0x7fe6880b3580 msgr2=0x7fe688072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:44.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.771+0000 7fe68dc00640 1 -- 172.21.15.121:0/476285999 shutdown_connections 2024-09-17T03:38:44.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:44.771+0000 7fe68dc00640 1 -- 172.21.15.121:0/476285999 wait complete. 2024-09-17T03:38:44.794 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:45.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.012+0000 7feae0600640 1 -- 172.21.15.121:0/975316507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80d0c40 msgr2=0x7fead806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.012+0000 7feae0600640 1 --2- 172.21.15.121:0/975316507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80d0c40 0x7fead806d4f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fead8072960 tx=0x7fead002aac0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.012+0000 7feae0600640 1 -- 172.21.15.121:0/975316507 shutdown_connections 2024-09-17T03:38:45.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.012+0000 7feae0600640 1 --2- 172.21.15.121:0/975316507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80d0c40 0x7fead806d4f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.012+0000 7feae0600640 1 --2- 172.21.15.121:0/975316507 >> v2:172.21.15.176:3300/0 conn(0x7fead80cc270 0x7fead80d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.012+0000 7feae0600640 1 -- 172.21.15.121:0/975316507 >> 172.21.15.121:0/975316507 conn(0x7fead80b3580 msgr2=0x7fead80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:45.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.012+0000 7feae0600640 1 -- 172.21.15.121:0/975316507 shutdown_connections 2024-09-17T03:38:45.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.012+0000 7feae0600640 1 -- 172.21.15.121:0/975316507 wait complete. 2024-09-17T03:38:45.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.014+0000 7feae0600640 1 Processor -- start 2024-09-17T03:38:45.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.015+0000 7feae0600640 1 -- start start 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feae0600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fead80cc270 0x7fead81f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feae0600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead80ce9e0 0x7fead80c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feae0600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80d0c40 0x7fead81f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feae0600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fead80705e0 con 0x7fead80d0c40 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feae0600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fead8070460 con 0x7fead80ce9e0 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feae0600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fead80af950 con 0x7fead80cc270 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feade600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80d0c40 0x7fead81f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feade600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80d0c40 0x7fead81f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48464/0 (socket says 172.21.15.121:48464) 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feade600640 1 -- 172.21.15.121:0/2153193242 learned_addr learned my addr 172.21.15.121:0/2153193242 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feaddc00640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fead80cc270 0x7fead81f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.016+0000 7feadd200640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead80ce9e0 0x7fead80c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.017+0000 7feade600640 1 -- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fead80cc270 msgr2=0x7fead81f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.017+0000 7feade600640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fead80cc270 0x7fead81f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.017+0000 7feade600640 1 -- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead80ce9e0 msgr2=0x7fead80c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.017+0000 7feade600640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead80ce9e0 0x7fead80c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.017+0000 7feade600640 1 -- 172.21.15.121:0/2153193242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead80c5150 con 0x7fead80d0c40 2024-09-17T03:38:45.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.017+0000 7feade600640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80d0c40 0x7fead81f3590 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fead0009d60 tx=0x7fead0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:45.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.017+0000 7fead5600640 1 -- 172.21.15.121:0/2153193242 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead0044070 con 0x7fead80d0c40 2024-09-17T03:38:45.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.017+0000 7fead5600640 1 -- 172.21.15.121:0/2153193242 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fead0004250 con 0x7fead80d0c40 2024-09-17T03:38:45.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.017+0000 7fead5600640 1 -- 172.21.15.121:0/2153193242 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead0004680 con 0x7fead80d0c40 2024-09-17T03:38:45.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.018+0000 7feae0600640 1 -- 172.21.15.121:0/2153193242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead809a2f0 con 0x7fead80d0c40 2024-09-17T03:38:45.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.018+0000 7feae0600640 1 -- 172.21.15.121:0/2153193242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead80ca4c0 con 0x7fead80d0c40 2024-09-17T03:38:45.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.019+0000 7feae0600640 1 -- 172.21.15.121:0/2153193242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead806dbc0 con 0x7fead80d0c40 2024-09-17T03:38:45.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.020+0000 7fead5600640 1 -- 172.21.15.121:0/2153193242 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fead0036400 con 0x7fead80d0c40 2024-09-17T03:38:45.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.021+0000 7fead5600640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feab8078b90 0x7feab807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.021+0000 7fead5600640 1 -- 172.21.15.121:0/2153193242 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7fead00bb6b0 con 0x7fead80d0c40 2024-09-17T03:38:45.022 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.021+0000 7feaddc00640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feab8078b90 0x7feab807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.022 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.022+0000 7feaddc00640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feab8078b90 0x7feab807b0a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feacc004630 tx=0x7feacc00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:45.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.025+0000 7fead5600640 1 -- 172.21.15.121:0/2153193242 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fead0032030 con 0x7fead80d0c40 2024-09-17T03:38:45.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.243+0000 7feae0600640 1 -- 172.21.15.121:0/2153193242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fead80c6a60 con 0x7fead80d0c40 2024-09-17T03:38:45.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.244+0000 7fead5600640 1 -- 172.21.15.121:0/2153193242 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5256 (secure 0 0 0) 0x7fead80d1050 con 0x7fead80d0c40 2024-09-17T03:38:45.245 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:45.245 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":41,"btime":"2024-09-17T03:38:25:452654+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1006042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1006042508},{"type":"v1","addr":"172.21.15.176:6836","nonce":1006042508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3672630729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3672630729},{"type":"v1","addr":"172.21.15.176:6837","nonce":3672630729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:59.696137+0000","modified":"2024-09-17T03:38:25.180701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5712,"mds_1":5234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5234":{"gid":5234,"name":"c","rank":1,"incarnation":39,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6835/4058545170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4058545170},{"type":"v1","addr":"172.21.15.121:6835","nonce":4058545170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5712":{"gid":5712,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6833/3893444987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3893444987},{"type":"v1","addr":"172.21.15.121:6833","nonce":3893444987}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5712,"qdb_cluster":[5712,5234]},"id":4}]} 2024-09-17T03:38:45.245 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 41 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.246+0000 7feae0600640 1 -- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feab8078b90 msgr2=0x7feab807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.246+0000 7feae0600640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feab8078b90 0x7feab807b0a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feacc004630 tx=0x7feacc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.246+0000 7feae0600640 1 -- 172.21.15.121:0/2153193242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80d0c40 msgr2=0x7fead81f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.246+0000 7feae0600640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80d0c40 0x7fead81f3590 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fead0009d60 tx=0x7fead0003f10 comp rx=0 tx=0).stop 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.247+0000 7feae0600640 1 -- 172.21.15.121:0/2153193242 shutdown_connections 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.247+0000 7feae0600640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feab8078b90 0x7feab807b0a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.247+0000 7feae0600640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fead80d0c40 0x7fead81f3590 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.247+0000 7feae0600640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead80ce9e0 0x7fead80c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.247+0000 7feae0600640 1 --2- 172.21.15.121:0/2153193242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fead80cc270 0x7fead81f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.247+0000 7feae0600640 1 -- 172.21.15.121:0/2153193242 >> 172.21.15.121:0/2153193242 conn(0x7fead80b3580 msgr2=0x7fead80b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:45.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.247+0000 7feae0600640 1 -- 172.21.15.121:0/2153193242 shutdown_connections 2024-09-17T03:38:45.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.247+0000 7feae0600640 1 -- 172.21.15.121:0/2153193242 wait complete. 2024-09-17T03:38:45.273 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:45.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.491+0000 7fa02d200640 1 -- 172.21.15.121:0/2630106344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa02806e600 msgr2=0x7fa0280b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.491+0000 7fa02d200640 1 --2- 172.21.15.121:0/2630106344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa02806e600 0x7fa0280b3d70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa010009830 tx=0x7fa01002a480 comp rx=0 tx=0).stop 2024-09-17T03:38:45.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.491+0000 7fa02d200640 1 -- 172.21.15.121:0/2630106344 shutdown_connections 2024-09-17T03:38:45.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.491+0000 7fa02d200640 1 --2- 172.21.15.121:0/2630106344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0280b42b0 0x7fa028073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.491+0000 7fa02d200640 1 --2- 172.21.15.121:0/2630106344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa02806e600 0x7fa0280b3d70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.491+0000 7fa02d200640 1 -- 172.21.15.121:0/2630106344 >> 172.21.15.121:0/2630106344 conn(0x7fa0280b2440 msgr2=0x7fa0280d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:45.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.491+0000 7fa02d200640 1 -- 172.21.15.121:0/2630106344 shutdown_connections 2024-09-17T03:38:45.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.491+0000 7fa02d200640 1 -- 172.21.15.121:0/2630106344 wait complete. 2024-09-17T03:38:45.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.493+0000 7fa02d200640 1 Processor -- start 2024-09-17T03:38:45.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.493+0000 7fa02d200640 1 -- start start 2024-09-17T03:38:45.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa02d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0280b42b0 0x7fa02813b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa02d200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028159170 0x7fa0280b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa02d200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0281f6060 0x7fa0280b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa02d200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa028073c70 con 0x7fa028159170 2024-09-17T03:38:45.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa02d200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa028073af0 con 0x7fa0281f6060 2024-09-17T03:38:45.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa02d200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa028073df0 con 0x7fa0280b42b0 2024-09-17T03:38:45.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa01ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028159170 0x7fa0280b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa01ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028159170 0x7fa0280b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48490/0 (socket says 172.21.15.121:48490) 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa01ea00640 1 -- 172.21.15.121:0/2429321686 learned_addr learned my addr 172.21.15.121:0/2429321686 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa027400640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0280b42b0 0x7fa02813b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa027e00640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0281f6060 0x7fa0280b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa01ea00640 1 -- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0280b42b0 msgr2=0x7fa02813b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa01ea00640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0280b42b0 0x7fa02813b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa01ea00640 1 -- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0281f6060 msgr2=0x7fa0280b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.495+0000 7fa01ea00640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0281f6060 0x7fa0280b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.496+0000 7fa01ea00640 1 -- 172.21.15.121:0/2429321686 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0280708d0 con 0x7fa028159170 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.496+0000 7fa027e00640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0281f6060 0x7fa0280b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.496+0000 7fa01ea00640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028159170 0x7fa0280b0da0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa010000c00 tx=0x7fa010033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.496+0000 7fa01fe00640 1 -- 172.21.15.121:0/2429321686 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa010031d60 con 0x7fa028159170 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.496+0000 7fa01fe00640 1 -- 172.21.15.121:0/2429321686 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa010033e10 con 0x7fa028159170 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.496+0000 7fa02d200640 1 -- 172.21.15.121:0/2429321686 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0281f6740 con 0x7fa028159170 2024-09-17T03:38:45.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.496+0000 7fa01fe00640 1 -- 172.21.15.121:0/2429321686 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0100332b0 con 0x7fa028159170 2024-09-17T03:38:45.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.496+0000 7fa02d200640 1 -- 172.21.15.121:0/2429321686 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0281f6d00 con 0x7fa028159170 2024-09-17T03:38:45.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.497+0000 7fa02d200640 1 -- 172.21.15.121:0/2429321686 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0281f64a0 con 0x7fa028159170 2024-09-17T03:38:45.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.498+0000 7fa01fe00640 1 -- 172.21.15.121:0/2429321686 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa010033450 con 0x7fa028159170 2024-09-17T03:38:45.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.500+0000 7fa01fe00640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa004078bc0 0x7fa00407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.500+0000 7fa01fe00640 1 -- 172.21.15.121:0/2429321686 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7fa0100bc2e0 con 0x7fa028159170 2024-09-17T03:38:45.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.500+0000 7fa027400640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa004078bc0 0x7fa00407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.501+0000 7fa027400640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa004078bc0 0x7fa00407b0d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa018007fd0 tx=0x7fa018001370 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:45.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.505+0000 7fa01fe00640 1 -- 172.21.15.121:0/2429321686 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0281f64a0 con 0x7fa028159170 2024-09-17T03:38:45.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.689+0000 7fa02d200640 1 -- 172.21.15.121:0/2429321686 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa028074380 con 0x7fa028159170 2024-09-17T03:38:45.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.690+0000 7fa01fe00640 1 -- 172.21.15.121:0/2429321686 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+17387 (secure 0 0 0) 0x7fa01003f030 con 0x7fa028159170 2024-09-17T03:38:45.691 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:45.692 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":65,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:38:12.412071+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:57.609318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:58.662483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1","mappings":[{"from":2,"to":7}]},{"pgid":"10.7","mappings":[{"from":4,"to":1}]},{"pgid":"10.c","mappings":[{"from":2,"to":5}]},{"pgid":"10.1c","mappings":[{"from":2,"to":7}]},{"pgid":"10.1d","mappings":[{"from":2,"to":7}]},{"pgid":"10.2c","mappings":[{"from":2,"to":1}]},{"pgid":"10.3b","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:45.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 -- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa004078bc0 msgr2=0x7fa00407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa004078bc0 0x7fa00407b0d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa018007fd0 tx=0x7fa018001370 comp rx=0 tx=0).stop 2024-09-17T03:38:45.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 -- 172.21.15.121:0/2429321686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028159170 msgr2=0x7fa0280b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028159170 0x7fa0280b0da0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa010000c00 tx=0x7fa010033c20 comp rx=0 tx=0).stop 2024-09-17T03:38:45.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 -- 172.21.15.121:0/2429321686 shutdown_connections 2024-09-17T03:38:45.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0281f6060 0x7fa0280b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa004078bc0 0x7fa00407b0d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028159170 0x7fa0280b0da0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 --2- 172.21.15.121:0/2429321686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0280b42b0 0x7fa02813b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 -- 172.21.15.121:0/2429321686 >> 172.21.15.121:0/2429321686 conn(0x7fa0280b2440 msgr2=0x7fa02809cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:45.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 -- 172.21.15.121:0/2429321686 shutdown_connections 2024-09-17T03:38:45.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.693+0000 7fa02d200640 1 -- 172.21.15.121:0/2429321686 wait complete. 2024-09-17T03:38:45.717 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:38:45.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.940+0000 7faa9ae00640 1 -- 172.21.15.121:0/2320170535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa7c004800 msgr2=0x7faa7c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.940+0000 7faa9ae00640 1 --2- 172.21.15.121:0/2320170535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa7c004800 0x7faa7c004c10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7faa80006f40 tx=0x7faa7c005830 comp rx=0 tx=0).stop 2024-09-17T03:38:45.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.940+0000 7faa9a400640 1 -- 172.21.15.121:0/2320170535 reap_dead start 2024-09-17T03:38:45.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.940+0000 7faa9ae00640 1 -- 172.21.15.121:0/2320170535 shutdown_connections 2024-09-17T03:38:45.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.940+0000 7faa9ae00640 1 -- 172.21.15.121:0/2320170535 >> 172.21.15.121:0/2320170535 conn(0x7faa940d14b0 msgr2=0x7faa940b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:45.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.940+0000 7faa9ae00640 1 -- 172.21.15.121:0/2320170535 shutdown_connections 2024-09-17T03:38:45.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.940+0000 7faa9ae00640 1 -- 172.21.15.121:0/2320170535 wait complete. 2024-09-17T03:38:45.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.942+0000 7faa9ae00640 1 Processor -- start 2024-09-17T03:38:45.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.942+0000 7faa9ae00640 1 -- start start 2024-09-17T03:38:45.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa9ae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c004800 0x7faa940c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa9ae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa94157610 0x7faa940ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa9ae00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa94157a20 0x7faa940ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa9ae00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa9415b8e0 con 0x7faa94157a20 2024-09-17T03:38:45.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa9ae00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faa94161660 con 0x7faa7c004800 2024-09-17T03:38:45.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa9ae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faa9415ba60 con 0x7faa94157610 2024-09-17T03:38:45.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa9a400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa94157a20 0x7faa940ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa9a400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa94157a20 0x7faa940ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48520/0 (socket says 172.21.15.121:48520) 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa9a400640 1 -- 172.21.15.121:0/1414682707 learned_addr learned my addr 172.21.15.121:0/1414682707 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa99a00640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c004800 0x7faa940c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.944+0000 7faa99000640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa94157610 0x7faa940ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa9a400640 1 -- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa94157610 msgr2=0x7faa940ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa9a400640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa94157610 0x7faa940ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa9a400640 1 -- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c004800 msgr2=0x7faa940c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa9a400640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c004800 0x7faa940c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa9a400640 1 -- 172.21.15.121:0/1414682707 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa940c85d0 con 0x7faa94157a20 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa9a400640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa94157a20 0x7faa940ca790 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faa940d0e50 tx=0x7faa8c011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa91600640 1 -- 172.21.15.121:0/1414682707 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c004b20 con 0x7faa94157a20 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa91600640 1 -- 172.21.15.121:0/1414682707 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa8c004cc0 con 0x7faa94157a20 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa91600640 1 -- 172.21.15.121:0/1414682707 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c003bd0 con 0x7faa94157a20 2024-09-17T03:38:45.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa9ae00640 1 -- 172.21.15.121:0/1414682707 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa940b8a20 con 0x7faa94157a20 2024-09-17T03:38:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.945+0000 7faa9ae00640 1 -- 172.21.15.121:0/1414682707 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa940b8fe0 con 0x7faa94157a20 2024-09-17T03:38:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.947+0000 7faa9ae00640 1 -- 172.21.15.121:0/1414682707 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa940d3310 con 0x7faa94157a20 2024-09-17T03:38:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.948+0000 7faa91600640 1 -- 172.21.15.121:0/1414682707 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faa8c004030 con 0x7faa94157a20 2024-09-17T03:38:45.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.949+0000 7faa91600640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa74078b90 0x7faa7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:45.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.949+0000 7faa91600640 1 -- 172.21.15.121:0/1414682707 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6304+0+0 (secure 0 0 0) 0x7faa8c09ba90 con 0x7faa94157a20 2024-09-17T03:38:45.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.949+0000 7faa99a00640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa74078b90 0x7faa7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:45.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.950+0000 7faa99a00640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa74078b90 0x7faa7407b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faa88000c00 tx=0x7faa88006b10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:45.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:45.953+0000 7faa91600640 1 -- 172.21.15.121:0/1414682707 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faa8c01f060 con 0x7faa94157a20 2024-09-17T03:38:46.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.172+0000 7faa9ae00640 1 -- 172.21.15.121:0/1414682707 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faa9415b130 con 0x7faa94157a20 2024-09-17T03:38:46.174 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-17T03:38:46.173+0000 7f1def400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:38:46.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.175+0000 7faa91600640 1 -- 172.21.15.121:0/1414682707 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) ==== 161+0+0 (secure 0 0 0) 0x7faa8c063c80 con 0x7faa94157a20 2024-09-17T03:38:46.176 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:38:46.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.178+0000 7faa9ae00640 1 -- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa74078b90 msgr2=0x7faa7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.178+0000 7faa9ae00640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa74078b90 0x7faa7407b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faa88000c00 tx=0x7faa88006b10 comp rx=0 tx=0).stop 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.179+0000 7faa9ae00640 1 -- 172.21.15.121:0/1414682707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa94157a20 msgr2=0x7faa940ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.179+0000 7faa9ae00640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa94157a20 0x7faa940ca790 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faa940d0e50 tx=0x7faa8c011ef0 comp rx=0 tx=0).stop 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.179+0000 7faa9ae00640 1 -- 172.21.15.121:0/1414682707 shutdown_connections 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.179+0000 7faa9ae00640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa74078b90 0x7faa7407b0a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.179+0000 7faa9ae00640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa94157a20 0x7faa940ca790 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.179+0000 7faa9ae00640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa94157610 0x7faa940ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.179+0000 7faa9ae00640 1 --2- 172.21.15.121:0/1414682707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa7c004800 0x7faa940c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.179+0000 7faa9ae00640 1 -- 172.21.15.121:0/1414682707 >> 172.21.15.121:0/1414682707 conn(0x7faa940d14b0 msgr2=0x7faa940cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.179+0000 7faa9ae00640 1 -- 172.21.15.121:0/1414682707 shutdown_connections 2024-09-17T03:38:46.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.179+0000 7faa9ae00640 1 -- 172.21.15.121:0/1414682707 wait complete. 2024-09-17T03:38:46.206 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:38:46.319 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:38:46.319 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:38:46.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.437+0000 7fcdeca00640 1 -- 172.21.15.121:0/1930415596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde80b5250 msgr2=0x7fcde80cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:46.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.437+0000 7fcdeca00640 1 --2- 172.21.15.121:0/1930415596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde80b5250 0x7fcde80cd180 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009850 tx=0x7fcdd802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:38:46.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.437+0000 7fcdeca00640 1 -- 172.21.15.121:0/1930415596 shutdown_connections 2024-09-17T03:38:46.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.437+0000 7fcdeca00640 1 --2- 172.21.15.121:0/1930415596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde815ca70 0x7fcde815ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:46.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.437+0000 7fcdeca00640 1 --2- 172.21.15.121:0/1930415596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde80b5250 0x7fcde80cd180 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:46.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.437+0000 7fcdeca00640 1 -- 172.21.15.121:0/1930415596 >> 172.21.15.121:0/1930415596 conn(0x7fcde80d07f0 msgr2=0x7fcde80b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:46.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.437+0000 7fcdeca00640 1 -- 172.21.15.121:0/1930415596 shutdown_connections 2024-09-17T03:38:46.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.437+0000 7fcdeca00640 1 -- 172.21.15.121:0/1930415596 wait complete. 2024-09-17T03:38:46.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.439+0000 7fcdeca00640 1 Processor -- start 2024-09-17T03:38:46.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.440+0000 7fcdeca00640 1 -- start start 2024-09-17T03:38:46.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.441+0000 7fcdeca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde80b5250 0x7fcde814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:46.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.441+0000 7fcdeca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde815ca70 0x7fcde815b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:46.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.441+0000 7fcdeca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde815d3c0 0x7fcde815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.441+0000 7fcdeca00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8160770 con 0x7fcde815ca70 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.441+0000 7fcdeca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcde806e780 con 0x7fcde815d3c0 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.441+0000 7fcdeca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcde81608f0 con 0x7fcde80b5250 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.441+0000 7fcddea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde815ca70 0x7fcde815b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.441+0000 7fcddea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde815ca70 0x7fcde815b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48568/0 (socket says 172.21.15.121:48568) 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.441+0000 7fcddea00640 1 -- 172.21.15.121:0/1459311391 learned_addr learned my addr 172.21.15.121:0/1459311391 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcde7400640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde80b5250 0x7fcde814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcde7e00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde815d3c0 0x7fcde815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcddea00640 1 -- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde80b5250 msgr2=0x7fcde814ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcddea00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde80b5250 0x7fcde814ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcddea00640 1 -- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde815d3c0 msgr2=0x7fcde815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcddea00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde815d3c0 0x7fcde815b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:46.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcddea00640 1 -- 172.21.15.121:0/1459311391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde8073980 con 0x7fcde815ca70 2024-09-17T03:38:46.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcde7400640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde80b5250 0x7fcde814ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:46.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcde7e00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde815d3c0 0x7fcde815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:46.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcddea00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde815ca70 0x7fcde815b4b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000e9f0 tx=0x7fcdd000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:46.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcddfe00640 1 -- 172.21.15.121:0/1459311391 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd000cd80 con 0x7fcde815ca70 2024-09-17T03:38:46.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcddfe00640 1 -- 172.21.15.121:0/1459311391 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdd0011560 con 0x7fcde815ca70 2024-09-17T03:38:46.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcddfe00640 1 -- 172.21.15.121:0/1459311391 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0011970 con 0x7fcde815ca70 2024-09-17T03:38:46.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.442+0000 7fcdeca00640 1 -- 172.21.15.121:0/1459311391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde81502a0 con 0x7fcde815ca70 2024-09-17T03:38:46.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.443+0000 7fcdeca00640 1 -- 172.21.15.121:0/1459311391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde8155df0 con 0x7fcde815ca70 2024-09-17T03:38:46.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.444+0000 7fcdeca00640 1 -- 172.21.15.121:0/1459311391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde8160e10 con 0x7fcde815ca70 2024-09-17T03:38:46.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.445+0000 7fcddfe00640 1 -- 172.21.15.121:0/1459311391 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcdd0011b10 con 0x7fcde815ca70 2024-09-17T03:38:46.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.446+0000 7fcddfe00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcdc4078b90 0x7fcdc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:46.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.446+0000 7fcddfe00640 1 -- 172.21.15.121:0/1459311391 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6476+0+0 (secure 0 0 0) 0x7fcdd009bd30 con 0x7fcde815ca70 2024-09-17T03:38:46.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.446+0000 7fcde7400640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcdc4078b90 0x7fcdc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:46.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.447+0000 7fcde7400640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcdc4078b90 0x7fcdc407b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8034000 tx=0x7fcdd8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:46.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.450+0000 7fcddfe00640 1 -- 172.21.15.121:0/1459311391 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcdd0016030 con 0x7fcde815ca70 2024-09-17T03:38:46.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:46.669+0000 7fcdeca00640 1 -- 172.21.15.121:0/1459311391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcde8073710 con 0x7fcde815ca70 2024-09-17T03:38:47.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.178+0000 7fcddfe00640 1 -- 172.21.15.121:0/1459311391 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7fcdd0063e60 con 0x7fcde815ca70 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.180+0000 7fcdeca00640 1 -- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcdc4078b90 msgr2=0x7fcdc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.180+0000 7fcdeca00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcdc4078b90 0x7fcdc407b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8034000 tx=0x7fcdd8004730 comp rx=0 tx=0).stop 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.180+0000 7fcdeca00640 1 -- 172.21.15.121:0/1459311391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde815ca70 msgr2=0x7fcde815b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.180+0000 7fcdeca00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde815ca70 0x7fcde815b4b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000e9f0 tx=0x7fcdd000eeb0 comp rx=0 tx=0).stop 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.181+0000 7fcdeca00640 1 -- 172.21.15.121:0/1459311391 shutdown_connections 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.181+0000 7fcdeca00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde815d3c0 0x7fcde815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.181+0000 7fcdeca00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcdc4078b90 0x7fcdc407b0a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.181+0000 7fcdeca00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde815ca70 0x7fcde815b4b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.181+0000 7fcdeca00640 1 --2- 172.21.15.121:0/1459311391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde80b5250 0x7fcde814ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.181+0000 7fcdeca00640 1 -- 172.21.15.121:0/1459311391 >> 172.21.15.121:0/1459311391 conn(0x7fcde80d07f0 msgr2=0x7fcde80b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.181+0000 7fcdeca00640 1 -- 172.21.15.121:0/1459311391 shutdown_connections 2024-09-17T03:38:47.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.181+0000 7fcdeca00640 1 -- 172.21.15.121:0/1459311391 wait complete. 2024-09-17T03:38:47.207 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:38:47.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.437+0000 7f75d2800640 1 -- 172.21.15.121:0/784332213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75cc0af310 msgr2=0x7f75cc06fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:47.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.437+0000 7f75d2800640 1 --2- 172.21.15.121:0/784332213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75cc0af310 0x7f75cc06fd00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f75c4005fd0 tx=0x7f75c402a820 comp rx=0 tx=0).stop 2024-09-17T03:38:47.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.437+0000 7f75d2800640 1 -- 172.21.15.121:0/784332213 shutdown_connections 2024-09-17T03:38:47.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.437+0000 7f75d2800640 1 --2- 172.21.15.121:0/784332213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75cc0af310 0x7f75cc06fd00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:47.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.437+0000 7f75d2800640 1 -- 172.21.15.121:0/784332213 >> 172.21.15.121:0/784332213 conn(0x7f75cc0b3620 msgr2=0x7f75cc0b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:47.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.437+0000 7f75d2800640 1 -- 172.21.15.121:0/784332213 shutdown_connections 2024-09-17T03:38:47.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.437+0000 7f75d2800640 1 -- 172.21.15.121:0/784332213 wait complete. 2024-09-17T03:38:47.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.439+0000 7f75d2800640 1 Processor -- start 2024-09-17T03:38:47.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.439+0000 7f75d2800640 1 -- start start 2024-09-17T03:38:47.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75d2800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75cc0af310 0x7f75cc1f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:47.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75d2800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75cc15c690 0x7f75cc159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:47.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75d2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75cc148540 0x7f75cc1e3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:47.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75d2800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc0703c0 con 0x7f75cc0af310 2024-09-17T03:38:47.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75d2800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc070240 con 0x7f75cc148540 2024-09-17T03:38:47.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75d2800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75cc070540 con 0x7f75cc15c690 2024-09-17T03:38:47.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75cb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75cc0af310 0x7f75cc1f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:47.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75cb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75cc0af310 0x7f75cc1f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48584/0 (socket says 172.21.15.121:48584) 2024-09-17T03:38:47.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75cb400640 1 -- 172.21.15.121:0/3626969410 learned_addr learned my addr 172.21.15.121:0/3626969410 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:47.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75cb400640 1 -- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75cc15c690 msgr2=0x7f75cc159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:47.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75cb400640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75cc15c690 0x7f75cc159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:47.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75cb400640 1 -- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75cc148540 msgr2=0x7f75cc1e3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:47.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75cb400640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75cc148540 0x7f75cc1e3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:47.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.441+0000 7f75cb400640 1 -- 172.21.15.121:0/3626969410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc0aeb60 con 0x7f75cc0af310 2024-09-17T03:38:47.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.442+0000 7f75cb400640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75cc0af310 0x7f75cc1f5f00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00c3a0 tx=0x7f75bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:47.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.442+0000 7f75c3e00640 1 -- 172.21.15.121:0/3626969410 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc017070 con 0x7f75cc0af310 2024-09-17T03:38:47.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.442+0000 7f75c3e00640 1 -- 172.21.15.121:0/3626969410 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75bc0053c0 con 0x7f75cc0af310 2024-09-17T03:38:47.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.442+0000 7f75c3e00640 1 -- 172.21.15.121:0/3626969410 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc003850 con 0x7f75cc0af310 2024-09-17T03:38:47.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.442+0000 7f75d2800640 1 -- 172.21.15.121:0/3626969410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75cc0aefd0 con 0x7f75cc0af310 2024-09-17T03:38:47.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.442+0000 7f75d2800640 1 -- 172.21.15.121:0/3626969410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75cc0cba10 con 0x7f75cc0af310 2024-09-17T03:38:47.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.443+0000 7f75d2800640 1 -- 172.21.15.121:0/3626969410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75cc0d0680 con 0x7f75cc0af310 2024-09-17T03:38:47.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.445+0000 7f75c3e00640 1 -- 172.21.15.121:0/3626969410 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75bc01a070 con 0x7f75cc0af310 2024-09-17T03:38:47.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.445+0000 7f75c3e00640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75a8078b90 0x7f75a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:47.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.446+0000 7f75c3e00640 1 -- 172.21.15.121:0/3626969410 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6476+0+0 (secure 0 0 0) 0x7f75bc09a4e0 con 0x7f75cc0af310 2024-09-17T03:38:47.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.446+0000 7f75c2a00640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75a8078b90 0x7f75a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:47.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.447+0000 7f75c2a00640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75a8078b90 0x7f75a807b0a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f75b4007fd0 tx=0x7f75b4007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:47.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.450+0000 7f75c3e00640 1 -- 172.21.15.121:0/3626969410 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75bc062580 con 0x7f75cc0af310 2024-09-17T03:38:47.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:47.636+0000 7f75d2800640 1 -- 172.21.15.121:0/3626969410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f75cc15be50 con 0x7f75cc0af310 2024-09-17T03:38:48.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.533+0000 7f75c3e00640 1 -- 172.21.15.121:0/3626969410 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) ==== 181+0+0 (secure 0 0 0) 0x7f75bc061e80 con 0x7f75cc0af310 2024-09-17T03:38:48.534 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:38:48.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 -- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75a8078b90 msgr2=0x7f75a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:48.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75a8078b90 0x7f75a807b0a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f75b4007fd0 tx=0x7f75b4007900 comp rx=0 tx=0).stop 2024-09-17T03:38:48.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 -- 172.21.15.121:0/3626969410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75cc0af310 msgr2=0x7f75cc1f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:48.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75cc0af310 0x7f75cc1f5f00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00c3a0 tx=0x7f75bc00c860 comp rx=0 tx=0).stop 2024-09-17T03:38:48.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 -- 172.21.15.121:0/3626969410 shutdown_connections 2024-09-17T03:38:48.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75cc148540 0x7f75cc1e3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:48.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75cc15c690 0x7f75cc159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:48.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75a8078b90 0x7f75a807b0a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:48.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 --2- 172.21.15.121:0/3626969410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75cc0af310 0x7f75cc1f5f00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:48.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 -- 172.21.15.121:0/3626969410 >> 172.21.15.121:0/3626969410 conn(0x7f75cc0b3620 msgr2=0x7f75cc0ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:48.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 -- 172.21.15.121:0/3626969410 shutdown_connections 2024-09-17T03:38:48.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.536+0000 7f75d2800640 1 -- 172.21.15.121:0/3626969410 wait complete. 2024-09-17T03:38:48.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:38:48.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.786+0000 7f0c15600640 1 -- 172.21.15.121:0/1469857052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bf4004d40 msgr2=0x7f0bf4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:48.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.786+0000 7f0c15600640 1 --2- 172.21.15.121:0/1469857052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bf4004d40 0x7f0bf4005150 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009ed0 tx=0x7f0bf4005830 comp rx=0 tx=0).stop 2024-09-17T03:38:48.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.786+0000 7f0c0f400640 1 -- 172.21.15.121:0/1469857052 reap_dead start 2024-09-17T03:38:48.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.786+0000 7f0c15600640 1 -- 172.21.15.121:0/1469857052 shutdown_connections 2024-09-17T03:38:48.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.786+0000 7f0c15600640 1 -- 172.21.15.121:0/1469857052 >> 172.21.15.121:0/1469857052 conn(0x7f0c100d0c20 msgr2=0x7f0c100cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:48.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.786+0000 7f0c15600640 1 -- 172.21.15.121:0/1469857052 shutdown_connections 2024-09-17T03:38:48.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.786+0000 7f0c15600640 1 -- 172.21.15.121:0/1469857052 wait complete. 2024-09-17T03:38:48.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.788+0000 7f0c15600640 1 Processor -- start 2024-09-17T03:38:48.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.788+0000 7f0c15600640 1 -- start start 2024-09-17T03:38:48.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c15600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bf4004d40 0x7f0c10156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:48.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c15600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c1015e490 0x7f0c100b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:48.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c15600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c100b1850 0x7f0c101f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:48.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c15600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0c10160460 con 0x7f0c100b1850 2024-09-17T03:38:48.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c15600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0c10160d00 con 0x7f0bf4004d40 2024-09-17T03:38:48.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c15600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0c101605e0 con 0x7f0c1015e490 2024-09-17T03:38:48.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c0f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c100b1850 0x7f0c101f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:48.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c0f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c100b1850 0x7f0c101f8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48598/0 (socket says 172.21.15.121:48598) 2024-09-17T03:38:48.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c0f400640 1 -- 172.21.15.121:0/1291703655 learned_addr learned my addr 172.21.15.121:0/1291703655 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:48.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c0ea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bf4004d40 0x7f0c10156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:48.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c06000640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c1015e490 0x7f0c100b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:48.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c0f400640 1 -- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c1015e490 msgr2=0x7f0c100b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:48.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.790+0000 7f0c0f400640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c1015e490 0x7f0c100b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:48.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.791+0000 7f0c0f400640 1 -- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bf4004d40 msgr2=0x7f0c10156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:48.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.791+0000 7f0c0f400640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bf4004d40 0x7f0c10156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:48.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.791+0000 7f0c0f400640 1 -- 172.21.15.121:0/1291703655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c100b1c60 con 0x7f0c100b1850 2024-09-17T03:38:48.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.791+0000 7f0c0f400640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c100b1850 0x7f0c101f8740 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0c0802af20 tx=0x7f0c08033dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:48.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.791+0000 7f0c07400640 1 -- 172.21.15.121:0/1291703655 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08042070 con 0x7f0c100b1850 2024-09-17T03:38:48.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.791+0000 7f0c07400640 1 -- 172.21.15.121:0/1291703655 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c08003c60 con 0x7f0c100b1850 2024-09-17T03:38:48.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.791+0000 7f0c07400640 1 -- 172.21.15.121:0/1291703655 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08038040 con 0x7f0c100b1850 2024-09-17T03:38:48.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.791+0000 7f0c15600640 1 -- 172.21.15.121:0/1291703655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c101f5260 con 0x7f0c100b1850 2024-09-17T03:38:48.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.791+0000 7f0c15600640 1 -- 172.21.15.121:0/1291703655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c101f5820 con 0x7f0c100b1850 2024-09-17T03:38:48.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.792+0000 7f0c15600640 1 -- 172.21.15.121:0/1291703655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c1006f770 con 0x7f0c100b1850 2024-09-17T03:38:48.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.794+0000 7f0c07400640 1 -- 172.21.15.121:0/1291703655 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c08004290 con 0x7f0c100b1850 2024-09-17T03:38:48.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.795+0000 7f0c07400640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0bec078bc0 0x7f0bec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:48.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.795+0000 7f0c07400640 1 -- 172.21.15.121:0/1291703655 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6038+0+0 (secure 0 0 0) 0x7f0c080bb430 con 0x7f0c100b1850 2024-09-17T03:38:48.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.796+0000 7f0c0ea00640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0bec078bc0 0x7f0bec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:48.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.796+0000 7f0c0ea00640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0bec078bc0 0x7f0bec07b0d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0c00001260 tx=0x7f0c00001110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:48.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.800+0000 7f0c07400640 1 -- 172.21.15.121:0/1291703655 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c100b1c60 con 0x7f0c100b1850 2024-09-17T03:38:48.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:48.982+0000 7f0c15600640 1 -- 172.21.15.121:0/1291703655 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0c1015c500 con 0x7f0c100b1850 2024-09-17T03:38:49.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.540+0000 7f0c07400640 1 -- 172.21.15.121:0/1291703655 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) ==== 169+0+0 (secure 0 0 0) 0x7f0c08083030 con 0x7f0c100b1850 2024-09-17T03:38:49.541 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-17T03:38:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 -- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0bec078bc0 msgr2=0x7f0bec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0bec078bc0 0x7f0bec07b0d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0c00001260 tx=0x7f0c00001110 comp rx=0 tx=0).stop 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 -- 172.21.15.121:0/1291703655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c100b1850 msgr2=0x7f0c101f8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c100b1850 0x7f0c101f8740 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0c0802af20 tx=0x7f0c08033dc0 comp rx=0 tx=0).stop 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 -- 172.21.15.121:0/1291703655 shutdown_connections 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0bec078bc0 0x7f0bec07b0d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c100b1850 0x7f0c101f8740 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c1015e490 0x7f0c100b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 --2- 172.21.15.121:0/1291703655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0bf4004d40 0x7f0c10156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 -- 172.21.15.121:0/1291703655 >> 172.21.15.121:0/1291703655 conn(0x7f0c100d0c20 msgr2=0x7f0c100b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 -- 172.21.15.121:0/1291703655 shutdown_connections 2024-09-17T03:38:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.543+0000 7f0c15600640 1 -- 172.21.15.121:0/1291703655 wait complete. 2024-09-17T03:38:49.571 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:38:49.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.796+0000 7f5665400640 1 -- 172.21.15.121:0/2506955232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56600cfe50 msgr2=0x7f566015a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:49.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.796+0000 7f5665400640 1 --2- 172.21.15.121:0/2506955232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56600cfe50 0x7f566015a070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5650009830 tx=0x7f565002a490 comp rx=0 tx=0).stop 2024-09-17T03:38:49.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.796+0000 7f5665400640 1 -- 172.21.15.121:0/2506955232 shutdown_connections 2024-09-17T03:38:49.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.796+0000 7f5665400640 1 --2- 172.21.15.121:0/2506955232 >> v2:172.21.15.176:3300/0 conn(0x7f56600d1950 0x7f56600ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.796+0000 7f5665400640 1 --2- 172.21.15.121:0/2506955232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56600cfe50 0x7f566015a070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.796+0000 7f5665400640 1 -- 172.21.15.121:0/2506955232 >> 172.21.15.121:0/2506955232 conn(0x7f56600cf120 msgr2=0x7f56600cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.796+0000 7f5665400640 1 -- 172.21.15.121:0/2506955232 shutdown_connections 2024-09-17T03:38:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.796+0000 7f5665400640 1 -- 172.21.15.121:0/2506955232 wait complete. 2024-09-17T03:38:49.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.798+0000 7f5665400640 1 Processor -- start 2024-09-17T03:38:49.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.798+0000 7f5665400640 1 -- start start 2024-09-17T03:38:49.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f5665400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56600cfe50 0x7f566014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:49.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f5665400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56600d1950 0x7f566015f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:49.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f5665400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56600d1d60 0x7f566015f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:49.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f5665400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f56600cd3b0 con 0x7f56600cfe50 2024-09-17T03:38:49.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f5665400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f56600cd230 con 0x7f56600d1950 2024-09-17T03:38:49.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f5665400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f56600b25d0 con 0x7f56600d1d60 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f565fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56600cfe50 0x7f566014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f565fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56600cfe50 0x7f566014b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48610/0 (socket says 172.21.15.121:48610) 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f565fe00640 1 -- 172.21.15.121:0/2727846134 learned_addr learned my addr 172.21.15.121:0/2727846134 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f565f400640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56600d1950 0x7f566015f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.800+0000 7f5664a00640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56600d1d60 0x7f566015f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.801+0000 7f565fe00640 1 -- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56600d1d60 msgr2=0x7f566015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.801+0000 7f565fe00640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56600d1d60 0x7f566015f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.801+0000 7f565fe00640 1 -- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56600d1950 msgr2=0x7f566015f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.801+0000 7f565fe00640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56600d1950 0x7f566015f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.801+0000 7f565fe00640 1 -- 172.21.15.121:0/2727846134 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56601f9050 con 0x7f56600cfe50 2024-09-17T03:38:49.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.801+0000 7f565fe00640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56600cfe50 0x7f566014b720 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5650009950 tx=0x7f5650003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:49.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.801+0000 7f5657e00640 1 -- 172.21.15.121:0/2727846134 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650005c90 con 0x7f56600cfe50 2024-09-17T03:38:49.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.801+0000 7f5657e00640 1 -- 172.21.15.121:0/2727846134 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5650005020 con 0x7f56600cfe50 2024-09-17T03:38:49.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.801+0000 7f5657e00640 1 -- 172.21.15.121:0/2727846134 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650005450 con 0x7f56600cfe50 2024-09-17T03:38:49.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.801+0000 7f5665400640 1 -- 172.21.15.121:0/2727846134 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56601f9330 con 0x7f56600cfe50 2024-09-17T03:38:49.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.802+0000 7f5665400640 1 -- 172.21.15.121:0/2727846134 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56601f98f0 con 0x7f56600cfe50 2024-09-17T03:38:49.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.802+0000 7f5665400640 1 -- 172.21.15.121:0/2727846134 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f566015a070 con 0x7f56600cfe50 2024-09-17T03:38:49.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.804+0000 7f5657e00640 1 -- 172.21.15.121:0/2727846134 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f56500317c0 con 0x7f56600cfe50 2024-09-17T03:38:49.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.805+0000 7f5657e00640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5640078b90 0x7f564007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:49.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.805+0000 7f5657e00640 1 -- 172.21.15.121:0/2727846134 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5421+0+0 (secure 0 0 0) 0x7f56500bbc00 con 0x7f56600cfe50 2024-09-17T03:38:49.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.806+0000 7f565f400640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5640078b90 0x7f564007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:49.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.806+0000 7f565f400640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5640078b90 0x7f564007b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f56600c8790 tx=0x7f564c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:49.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.810+0000 7f5657e00640 1 -- 172.21.15.121:0/2727846134 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f565003f030 con 0x7f56600cfe50 2024-09-17T03:38:49.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.993+0000 7f5665400640 1 -- 172.21.15.121:0/2727846134 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f56600b43b0 con 0x7f56600cfe50 2024-09-17T03:38:49.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:49.998+0000 7f5657e00640 1 -- 172.21.15.121:0/2727846134 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v39) ==== 71+0+0 (secure 0 0 0) 0x7f5650083b10 con 0x7f56600cfe50 2024-09-17T03:38:50.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 -- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5640078b90 msgr2=0x7f564007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5640078b90 0x7f564007b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f56600c8790 tx=0x7f564c005f90 comp rx=0 tx=0).stop 2024-09-17T03:38:50.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 -- 172.21.15.121:0/2727846134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56600cfe50 msgr2=0x7f566014b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56600cfe50 0x7f566014b720 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5650009950 tx=0x7f5650003c10 comp rx=0 tx=0).stop 2024-09-17T03:38:50.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 -- 172.21.15.121:0/2727846134 shutdown_connections 2024-09-17T03:38:50.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56600d1d60 0x7f566015f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56600d1950 0x7f566015f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5640078b90 0x7f564007b0a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 --2- 172.21.15.121:0/2727846134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56600cfe50 0x7f566014b720 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 -- 172.21.15.121:0/2727846134 >> 172.21.15.121:0/2727846134 conn(0x7f56600cf120 msgr2=0x7f56601565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:50.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 -- 172.21.15.121:0/2727846134 shutdown_connections 2024-09-17T03:38:50.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.001+0000 7f5665400640 1 -- 172.21.15.121:0/2727846134 wait complete. 2024-09-17T03:38:50.024 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted' 2024-09-17T03:38:50.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.244+0000 7f6e4ba00640 1 -- 172.21.15.121:0/3179997126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4415a3e0 msgr2=0x7f6e4406d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.244+0000 7f6e4ba00640 1 --2- 172.21.15.121:0/3179997126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4415a3e0 0x7f6e4406d800 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6e44072680 tx=0x7f6e3402a440 comp rx=0 tx=0).stop 2024-09-17T03:38:50.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.245+0000 7f6e4ba00640 1 -- 172.21.15.121:0/3179997126 shutdown_connections 2024-09-17T03:38:50.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.245+0000 7f6e4ba00640 1 --2- 172.21.15.121:0/3179997126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e440d0af0 0x7f6e4406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.245+0000 7f6e4ba00640 1 --2- 172.21.15.121:0/3179997126 >> v2:172.21.15.176:3300/0 conn(0x7f6e4406ddc0 0x7f6e440d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.245+0000 7f6e4ba00640 1 --2- 172.21.15.121:0/3179997126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4415a3e0 0x7f6e4406d800 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.245+0000 7f6e4ba00640 1 -- 172.21.15.121:0/3179997126 >> 172.21.15.121:0/3179997126 conn(0x7f6e440b3580 msgr2=0x7f6e440b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:50.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.245+0000 7f6e4ba00640 1 -- 172.21.15.121:0/3179997126 shutdown_connections 2024-09-17T03:38:50.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.245+0000 7f6e4ba00640 1 -- 172.21.15.121:0/3179997126 wait complete. 2024-09-17T03:38:50.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.247+0000 7f6e4ba00640 1 Processor -- start 2024-09-17T03:38:50.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.247+0000 7f6e4ba00640 1 -- start start 2024-09-17T03:38:50.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e4ba00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e4406ddc0 0x7f6e441f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:50.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e4ba00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e440d0af0 0x7f6e4415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:50.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e4ba00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4415a3e0 0x7f6e4415f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:50.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e4ba00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4406f510 con 0x7f6e4415a3e0 2024-09-17T03:38:50.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e4ba00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4406f390 con 0x7f6e440d0af0 2024-09-17T03:38:50.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e4ba00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e4406f690 con 0x7f6e4406ddc0 2024-09-17T03:38:50.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e49a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4415a3e0 0x7f6e4415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:50.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e49a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4415a3e0 0x7f6e4415f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48622/0 (socket says 172.21.15.121:48622) 2024-09-17T03:38:50.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e49a00640 1 -- 172.21.15.121:0/841889107 learned_addr learned my addr 172.21.15.121:0/841889107 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e49000640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e4406ddc0 0x7f6e441f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e3be00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e440d0af0 0x7f6e4415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e49a00640 1 -- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e4406ddc0 msgr2=0x7f6e441f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e49a00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e4406ddc0 0x7f6e441f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e49a00640 1 -- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e440d0af0 msgr2=0x7f6e4415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e49a00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e440d0af0 0x7f6e4415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e49a00640 1 -- 172.21.15.121:0/841889107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4415db70 con 0x7f6e4415a3e0 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e49000640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e4406ddc0 0x7f6e441f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.249+0000 7f6e3be00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e440d0af0 0x7f6e4415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.250+0000 7f6e49a00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4415a3e0 0x7f6e4415f640 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00e9c0 tx=0x7f6e3c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.250+0000 7f6e41600640 1 -- 172.21.15.121:0/841889107 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c004d20 con 0x7f6e4415a3e0 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.250+0000 7f6e41600640 1 -- 172.21.15.121:0/841889107 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e3c00cac0 con 0x7f6e4415a3e0 2024-09-17T03:38:50.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.250+0000 7f6e4ba00640 1 -- 172.21.15.121:0/841889107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e44074110 con 0x7f6e4415a3e0 2024-09-17T03:38:50.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.250+0000 7f6e41600640 1 -- 172.21.15.121:0/841889107 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c005020 con 0x7f6e4415a3e0 2024-09-17T03:38:50.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.250+0000 7f6e4ba00640 1 -- 172.21.15.121:0/841889107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e440746d0 con 0x7f6e4415a3e0 2024-09-17T03:38:50.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.251+0000 7f6e4ba00640 1 -- 172.21.15.121:0/841889107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4406fb80 con 0x7f6e4415a3e0 2024-09-17T03:38:50.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.252+0000 7f6e41600640 1 -- 172.21.15.121:0/841889107 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e3c0051c0 con 0x7f6e4415a3e0 2024-09-17T03:38:50.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.253+0000 7f6e41600640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e20078b90 0x7f6e2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:50.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.253+0000 7f6e41600640 1 -- 172.21.15.121:0/841889107 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5421+0+0 (secure 0 0 0) 0x7f6e3c09b540 con 0x7f6e4415a3e0 2024-09-17T03:38:50.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.254+0000 7f6e49000640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e20078b90 0x7f6e2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:50.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.254+0000 7f6e49000640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e20078b90 0x7f6e2007b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6e34033000 tx=0x7f6e34004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:50.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.258+0000 7f6e41600640 1 -- 172.21.15.121:0/841889107 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e3c016030 con 0x7f6e4415a3e0 2024-09-17T03:38:50.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.508+0000 7f6e4ba00640 1 -- 172.21.15.121:0/841889107 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted"]} v 0) -- 0x7f6e4415d900 con 0x7f6e4415a3e0 2024-09-17T03:38:50.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.542+0000 7f6e41600640 1 -- 172.21.15.121:0/841889107 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_evict_non_blocklisted"]}]=0 v197) ==== 157+0+0 (secure 0 0 0) 0x7f6e3c063aa0 con 0x7f6e4415a3e0 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 -- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e20078b90 msgr2=0x7f6e2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e20078b90 0x7f6e2007b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6e34033000 tx=0x7f6e34004730 comp rx=0 tx=0).stop 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 -- 172.21.15.121:0/841889107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4415a3e0 msgr2=0x7f6e4415f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4415a3e0 0x7f6e4415f640 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00e9c0 tx=0x7f6e3c00ee80 comp rx=0 tx=0).stop 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 -- 172.21.15.121:0/841889107 shutdown_connections 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e20078b90 0x7f6e2007b0a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4415a3e0 0x7f6e4415f640 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e440d0af0 0x7f6e4415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 --2- 172.21.15.121:0/841889107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e4406ddc0 0x7f6e441f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 -- 172.21.15.121:0/841889107 >> 172.21.15.121:0/841889107 conn(0x7f6e440b3580 msgr2=0x7f6e44068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 -- 172.21.15.121:0/841889107 shutdown_connections 2024-09-17T03:38:50.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.545+0000 7f6e4ba00640 1 -- 172.21.15.121:0/841889107 wait complete. 2024-09-17T03:38:50.568 INFO:tasks.cephfs_test_runner:Check that mds evicts without blocklisting client ... ok 2024-09-17T03:38:50.568 INFO:tasks.cephfs_test_runner:Starting test: test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-17T03:38:50.569 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:50.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.790+0000 7f6335600640 1 -- 172.21.15.121:0/1784058657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6314003b30 msgr2=0x7f6314003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.790+0000 7f6335600640 1 --2- 172.21.15.121:0/1784058657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6314003b30 0x7f6314003fa0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6320009b50 tx=0x7f6314005830 comp rx=0 tx=0).stop 2024-09-17T03:38:50.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.790+0000 7f6335600640 1 -- 172.21.15.121:0/1784058657 shutdown_connections 2024-09-17T03:38:50.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.790+0000 7f6335600640 1 --2- 172.21.15.121:0/1784058657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6314003b30 0x7f6314003fa0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.790+0000 7f6335600640 1 -- 172.21.15.121:0/1784058657 >> 172.21.15.121:0/1784058657 conn(0x7f63300b3580 msgr2=0x7f63300b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:50.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.790+0000 7f6335600640 1 -- 172.21.15.121:0/1784058657 shutdown_connections 2024-09-17T03:38:50.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.790+0000 7f6335600640 1 -- 172.21.15.121:0/1784058657 wait complete. 2024-09-17T03:38:50.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.793+0000 7f6335600640 1 Processor -- start 2024-09-17T03:38:50.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.793+0000 7f6335600640 1 -- start start 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.794+0000 7f6335600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6314003b30 0x7f63301593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.794+0000 7f6335600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63300c5c10 0x7f6330155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.794+0000 7f6335600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63301541a0 0x7f6330155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.794+0000 7f6335600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f633006db90 con 0x7f63300c5c10 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.794+0000 7f6335600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f633006da10 con 0x7f6314003b30 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.794+0000 7f6335600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6330161190 con 0x7f63301541a0 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.794+0000 7f632e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63300c5c10 0x7f6330155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.794+0000 7f632e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63300c5c10 0x7f6330155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48642/0 (socket says 172.21.15.121:48642) 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.794+0000 7f632e000640 1 -- 172.21.15.121:0/3777098958 learned_addr learned my addr 172.21.15.121:0/3777098958 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f632ea00640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6314003b30 0x7f63301593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f632f400640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63301541a0 0x7f6330155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f632e000640 1 -- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63301541a0 msgr2=0x7f6330155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f632e000640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63301541a0 0x7f6330155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f632e000640 1 -- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6314003b30 msgr2=0x7f63301593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f632e000640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6314003b30 0x7f63301593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f632e000640 1 -- 172.21.15.121:0/3777098958 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63301fa180 con 0x7f63300c5c10 2024-09-17T03:38:50.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f632e000640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63300c5c10 0x7f6330155790 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f631c00e5c0 tx=0x7f631c00ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:50.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f6326a00640 1 -- 172.21.15.121:0/3777098958 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c015020 con 0x7f63300c5c10 2024-09-17T03:38:50.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f6326a00640 1 -- 172.21.15.121:0/3777098958 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f631c0109a0 con 0x7f63300c5c10 2024-09-17T03:38:50.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.795+0000 7f6335600640 1 -- 172.21.15.121:0/3777098958 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63301f93c0 con 0x7f63300c5c10 2024-09-17T03:38:50.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.796+0000 7f6326a00640 1 -- 172.21.15.121:0/3777098958 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c010df0 con 0x7f63300c5c10 2024-09-17T03:38:50.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.796+0000 7f6335600640 1 -- 172.21.15.121:0/3777098958 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63301f9980 con 0x7f63300c5c10 2024-09-17T03:38:50.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.797+0000 7f6335600640 1 -- 172.21.15.121:0/3777098958 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63300d08c0 con 0x7f63300c5c10 2024-09-17T03:38:50.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.798+0000 7f6326a00640 1 -- 172.21.15.121:0/3777098958 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f631c018020 con 0x7f63300c5c10 2024-09-17T03:38:50.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.799+0000 7f6326a00640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6310078bc0 0x7f631007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:50.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.799+0000 7f6326a00640 1 -- 172.21.15.121:0/3777098958 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5421+0+0 (secure 0 0 0) 0x7f631c09aec0 con 0x7f63300c5c10 2024-09-17T03:38:50.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.800+0000 7f632ea00640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6310078bc0 0x7f631007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:50.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.800+0000 7f632ea00640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6310078bc0 0x7f631007b0d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6320035000 tx=0x7f63200046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:50.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.803+0000 7f6326a00640 1 -- 172.21.15.121:0/3777098958 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f631c01f020 con 0x7f63300c5c10 2024-09-17T03:38:50.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.989+0000 7f6335600640 1 -- 172.21.15.121:0/3777098958 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63300c3630 con 0x7f63300c5c10 2024-09-17T03:38:50.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.990+0000 7f6326a00640 1 -- 172.21.15.121:0/3777098958 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+13500 (secure 0 0 0) 0x7f631c062e50 con 0x7f63300c5c10 2024-09-17T03:38:50.991 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:50.992 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":68,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:38:49.535417+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6833/3893444987":"2024-09-18T03:38:46.175020+0000","172.21.15.121:6832/3893444987":"2024-09-18T03:38:46.175020+0000","172.21.15.121:6835/4058545170":"2024-09-18T03:38:46.175002+0000","172.21.15.121:6834/4058545170":"2024-09-18T03:38:46.175002+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:50.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 -- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6310078bc0 msgr2=0x7f631007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6310078bc0 0x7f631007b0d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6320035000 tx=0x7f63200046c0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 -- 172.21.15.121:0/3777098958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63300c5c10 msgr2=0x7f6330155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:50.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63300c5c10 0x7f6330155790 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f631c00e5c0 tx=0x7f631c00ea80 comp rx=0 tx=0).stop 2024-09-17T03:38:50.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 -- 172.21.15.121:0/3777098958 shutdown_connections 2024-09-17T03:38:50.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63301541a0 0x7f6330155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6310078bc0 0x7f631007b0d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63300c5c10 0x7f6330155790 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 --2- 172.21.15.121:0/3777098958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6314003b30 0x7f63301593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:50.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 -- 172.21.15.121:0/3777098958 >> 172.21.15.121:0/3777098958 conn(0x7f63300b3580 msgr2=0x7f633015bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:50.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 -- 172.21.15.121:0/3777098958 shutdown_connections 2024-09-17T03:38:50.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:50.993+0000 7f6335600640 1 -- 172.21.15.121:0/3777098958 wait complete. 2024-09-17T03:38:51.017 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:35:21.303701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:38:51.017 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:38:51.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.252+0000 7fc23fe00640 1 -- 172.21.15.121:0/1972650480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc220003ae0 msgr2=0x7fc220003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:51.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.252+0000 7fc23fe00640 1 --2- 172.21.15.121:0/1972650480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc220003ae0 0x7fc220003f50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009d20 tx=0x7fc220005830 comp rx=0 tx=0).stop 2024-09-17T03:38:51.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.252+0000 7fc23de00640 1 -- 172.21.15.121:0/1972650480 reap_dead start 2024-09-17T03:38:51.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.252+0000 7fc23fe00640 1 -- 172.21.15.121:0/1972650480 shutdown_connections 2024-09-17T03:38:51.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.252+0000 7fc23fe00640 1 -- 172.21.15.121:0/1972650480 >> 172.21.15.121:0/1972650480 conn(0x7fc2380b3580 msgr2=0x7fc2380b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:51.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.252+0000 7fc23fe00640 1 -- 172.21.15.121:0/1972650480 shutdown_connections 2024-09-17T03:38:51.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.252+0000 7fc23fe00640 1 -- 172.21.15.121:0/1972650480 wait complete. 2024-09-17T03:38:51.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.254+0000 7fc23fe00640 1 Processor -- start 2024-09-17T03:38:51.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.254+0000 7fc23fe00640 1 -- start start 2024-09-17T03:38:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc220003ae0 0x7fc238158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc23815d400 0x7fc23815d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc23815dd50 0x7fc23809bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23fe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc2380705e0 con 0x7fc220003ae0 2024-09-17T03:38:51.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc238070460 con 0x7fc23815d400 2024-09-17T03:38:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc2380af950 con 0x7fc23815dd50 2024-09-17T03:38:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc220003ae0 0x7fc238158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc220003ae0 0x7fc238158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48662/0 (socket says 172.21.15.121:48662) 2024-09-17T03:38:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23d400640 1 -- 172.21.15.121:0/15840496 learned_addr learned my addr 172.21.15.121:0/15840496 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23d400640 1 -- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc23815dd50 msgr2=0x7fc23809bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23d400640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc23815dd50 0x7fc23809bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23d400640 1 -- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc23815d400 msgr2=0x7fc23815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23d400640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc23815d400 0x7fc23815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.256+0000 7fc23d400640 1 -- 172.21.15.121:0/15840496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23809e100 con 0x7fc220003ae0 2024-09-17T03:38:51.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.257+0000 7fc23d400640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc220003ae0 0x7fc238158130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc22c02b6b0 tx=0x7fc22c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:51.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.257+0000 7fc235600640 1 -- 172.21.15.121:0/15840496 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c042020 con 0x7fc220003ae0 2024-09-17T03:38:51.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.257+0000 7fc235600640 1 -- 172.21.15.121:0/15840496 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc22c02ba80 con 0x7fc220003ae0 2024-09-17T03:38:51.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.257+0000 7fc23fe00640 1 -- 172.21.15.121:0/15840496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23809b1a0 con 0x7fc220003ae0 2024-09-17T03:38:51.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.257+0000 7fc235600640 1 -- 172.21.15.121:0/15840496 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c003d00 con 0x7fc220003ae0 2024-09-17T03:38:51.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.257+0000 7fc23fe00640 1 -- 172.21.15.121:0/15840496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc23809b760 con 0x7fc220003ae0 2024-09-17T03:38:51.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.258+0000 7fc23fe00640 1 -- 172.21.15.121:0/15840496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2380af500 con 0x7fc220003ae0 2024-09-17T03:38:51.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.259+0000 7fc235600640 1 -- 172.21.15.121:0/15840496 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc22c045020 con 0x7fc220003ae0 2024-09-17T03:38:51.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.260+0000 7fc235600640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc218078bc0 0x7fc21807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:51.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.260+0000 7fc235600640 1 -- 172.21.15.121:0/15840496 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5421+0+0 (secure 0 0 0) 0x7fc22c0bc1c0 con 0x7fc220003ae0 2024-09-17T03:38:51.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.261+0000 7fc23ca00640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc218078bc0 0x7fc21807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:51.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.261+0000 7fc23ca00640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc218078bc0 0x7fc21807b0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc2380c0a40 tx=0x7fc224001170 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:51.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.265+0000 7fc235600640 1 -- 172.21.15.121:0/15840496 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc22c04c030 con 0x7fc220003ae0 2024-09-17T03:38:51.425 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:38:51.430 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:38:51.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.451+0000 7fc23fe00640 1 -- 172.21.15.121:0/15840496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc23806d990 con 0x7fc220003ae0 2024-09-17T03:38:51.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.451+0000 7fc235600640 1 -- 172.21.15.121:0/15840496 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7fc22c084710 con 0x7fc220003ae0 2024-09-17T03:38:51.452 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-17T03:38:51.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 -- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc218078bc0 msgr2=0x7fc21807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:51.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc218078bc0 0x7fc21807b0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc2380c0a40 tx=0x7fc224001170 comp rx=0 tx=0).stop 2024-09-17T03:38:51.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 -- 172.21.15.121:0/15840496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc220003ae0 msgr2=0x7fc238158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:51.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc220003ae0 0x7fc238158130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc22c02b6b0 tx=0x7fc22c003820 comp rx=0 tx=0).stop 2024-09-17T03:38:51.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 -- 172.21.15.121:0/15840496 shutdown_connections 2024-09-17T03:38:51.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc23815dd50 0x7fc23809bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:51.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc23815d400 0x7fc23815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:51.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc218078bc0 0x7fc21807b0d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:51.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 --2- 172.21.15.121:0/15840496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc220003ae0 0x7fc238158130 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:51.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 -- 172.21.15.121:0/15840496 >> 172.21.15.121:0/15840496 conn(0x7fc2380b3580 msgr2=0x7fc2380affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:51.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 -- 172.21.15.121:0/15840496 shutdown_connections 2024-09-17T03:38:51.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.454+0000 7fc23fe00640 1 -- 172.21.15.121:0/15840496 wait complete. 2024-09-17T03:38:51.480 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-09-17T03:38:51.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.779+0000 7f2c72e00640 1 -- 172.21.15.121:0/3762828373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c6c15e7a0 msgr2=0x7f2c6c0d3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:51.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.779+0000 7f2c72e00640 1 --2- 172.21.15.121:0/3762828373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c6c15e7a0 0x7f2c6c0d3000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009830 tx=0x7f2c6002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:38:51.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.779+0000 7f2c72e00640 1 -- 172.21.15.121:0/3762828373 shutdown_connections 2024-09-17T03:38:51.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.779+0000 7f2c72e00640 1 --2- 172.21.15.121:0/3762828373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c6c15e7a0 0x7f2c6c0d3000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:51.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.779+0000 7f2c72e00640 1 -- 172.21.15.121:0/3762828373 >> 172.21.15.121:0/3762828373 conn(0x7f2c6c0d4b30 msgr2=0x7f2c6c0b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:51.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.779+0000 7f2c72e00640 1 -- 172.21.15.121:0/3762828373 shutdown_connections 2024-09-17T03:38:51.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.779+0000 7f2c72e00640 1 -- 172.21.15.121:0/3762828373 wait complete. 2024-09-17T03:38:51.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.781+0000 7f2c72e00640 1 Processor -- start 2024-09-17T03:38:51.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.781+0000 7f2c72e00640 1 -- start start 2024-09-17T03:38:51.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c72e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c6c0d3540 0x7f2c6c1609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:51.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c72e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c6c15e7a0 0x7f2c6c1f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:51.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c72e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c6c162b30 0x7f2c6c1fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:51.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c72e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c0d0590 con 0x7f2c6c0d3540 2024-09-17T03:38:51.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c72e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c0d0410 con 0x7f2c6c15e7a0 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c72e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c0d0710 con 0x7f2c6c162b30 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c71a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c6c0d3540 0x7f2c6c1609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c71a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c6c0d3540 0x7f2c6c1609d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48672/0 (socket says 172.21.15.121:48672) 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c71a00640 1 -- 172.21.15.121:0/263832076 learned_addr learned my addr 172.21.15.121:0/263832076 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c71000640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c6c15e7a0 0x7f2c6c1f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.783+0000 7f2c72400640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c6c162b30 0x7f2c6c1fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c71a00640 1 -- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c6c162b30 msgr2=0x7f2c6c1fa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c71a00640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c6c162b30 0x7f2c6c1fa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c71a00640 1 -- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c6c15e7a0 msgr2=0x7f2c6c1f9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c71a00640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c6c15e7a0 0x7f2c6c1f9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c71a00640 1 -- 172.21.15.121:0/263832076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c1f63b0 con 0x7f2c6c0d3540 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c71000640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c6c15e7a0 0x7f2c6c1f9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:51.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c71a00640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c6c0d3540 0x7f2c6c1609d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009950 tx=0x7f2c60033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:51.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c69600640 1 -- 172.21.15.121:0/263832076 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60031b50 con 0x7f2c6c0d3540 2024-09-17T03:38:51.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c69600640 1 -- 172.21.15.121:0/263832076 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c60031de0 con 0x7f2c6c0d3540 2024-09-17T03:38:51.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c69600640 1 -- 172.21.15.121:0/263832076 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60005280 con 0x7f2c6c0d3540 2024-09-17T03:38:51.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c72e00640 1 -- 172.21.15.121:0/263832076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c1f6690 con 0x7f2c6c0d3540 2024-09-17T03:38:51.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.784+0000 7f2c72e00640 1 -- 172.21.15.121:0/263832076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c155630 con 0x7f2c6c0d3540 2024-09-17T03:38:51.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.785+0000 7f2c72e00640 1 -- 172.21.15.121:0/263832076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c155890 con 0x7f2c6c0d3540 2024-09-17T03:38:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.787+0000 7f2c69600640 1 -- 172.21.15.121:0/263832076 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c60005420 con 0x7f2c6c0d3540 2024-09-17T03:38:51.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.788+0000 7f2c69600640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c4c078bc0 0x7f2c4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:51.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.788+0000 7f2c69600640 1 -- 172.21.15.121:0/263832076 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5421+0+0 (secure 0 0 0) 0x7f2c600bbc50 con 0x7f2c6c0d3540 2024-09-17T03:38:51.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.789+0000 7f2c71000640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c4c078bc0 0x7f2c4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:51.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.789+0000 7f2c71000640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c4c078bc0 0x7f2c4c07b0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0b3160 tx=0x7f2c58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:51.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:51.793+0000 7f2c69600640 1 -- 172.21.15.121:0/263832076 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c600c1020 con 0x7f2c6c0d3540 2024-09-17T03:38:52.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.044+0000 7f2c72e00640 1 -- 172.21.15.121:0/263832076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) -- 0x7f2c6c0d3000 con 0x7f2c6c0d3540 2024-09-17T03:38:52.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.552+0000 7f2c69600640 1 -- 172.21.15.121:0/263832076 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v199) ==== 145+0+0 (secure 0 0 0) 0x7f2c6003f030 con 0x7f2c6c0d3540 2024-09-17T03:38:52.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 -- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c4c078bc0 msgr2=0x7f2c4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:52.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c4c078bc0 0x7f2c4c07b0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0b3160 tx=0x7f2c58009040 comp rx=0 tx=0).stop 2024-09-17T03:38:52.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 -- 172.21.15.121:0/263832076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c6c0d3540 msgr2=0x7f2c6c1609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:52.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c6c0d3540 0x7f2c6c1609d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009950 tx=0x7f2c60033ba0 comp rx=0 tx=0).stop 2024-09-17T03:38:52.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 -- 172.21.15.121:0/263832076 shutdown_connections 2024-09-17T03:38:52.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c6c162b30 0x7f2c6c1fa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:52.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c6c15e7a0 0x7f2c6c1f9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:52.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c4c078bc0 0x7f2c4c07b0d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:52.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 --2- 172.21.15.121:0/263832076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c6c0d3540 0x7f2c6c1609d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:52.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 -- 172.21.15.121:0/263832076 >> 172.21.15.121:0/263832076 conn(0x7f2c6c0d4b30 msgr2=0x7f2c6c06cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:52.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 -- 172.21.15.121:0/263832076 shutdown_connections 2024-09-17T03:38:52.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.555+0000 7f2c72e00640 1 -- 172.21.15.121:0/263832076 wait complete. 2024-09-17T03:38:52.580 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:38:52.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.801+0000 7f8e1d800640 1 -- 172.21.15.121:0/1720827604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1806d800 msgr2=0x7f8e180d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:52.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.801+0000 7f8e1d800640 1 --2- 172.21.15.121:0/1720827604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1806d800 0x7f8e180d05b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009830 tx=0x7f8e0402a420 comp rx=0 tx=0).stop 2024-09-17T03:38:52.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.801+0000 7f8e1d800640 1 -- 172.21.15.121:0/1720827604 shutdown_connections 2024-09-17T03:38:52.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.801+0000 7f8e1d800640 1 --2- 172.21.15.121:0/1720827604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1806d800 0x7f8e180d05b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:52.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.801+0000 7f8e1d800640 1 -- 172.21.15.121:0/1720827604 >> 172.21.15.121:0/1720827604 conn(0x7f8e180b3580 msgr2=0x7f8e180b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:52.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.801+0000 7f8e1d800640 1 -- 172.21.15.121:0/1720827604 shutdown_connections 2024-09-17T03:38:52.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.801+0000 7f8e1d800640 1 -- 172.21.15.121:0/1720827604 wait complete. 2024-09-17T03:38:52.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.803+0000 7f8e1d800640 1 Processor -- start 2024-09-17T03:38:52.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.803+0000 7f8e1d800640 1 -- start start 2024-09-17T03:38:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e1d800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e1806d800 0x7f8e1809d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e1d800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e180d0af0 0x7f8e181f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e1d800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1815a3e0 0x7f8e181f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e1d800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1815d6b0 con 0x7f8e1806d800 2024-09-17T03:38:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e1d800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1815d530 con 0x7f8e1815a3e0 2024-09-17T03:38:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e1d800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1815d830 con 0x7f8e180d0af0 2024-09-17T03:38:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e1806d800 0x7f8e1809d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e1806d800 0x7f8e1809d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52100/0 (socket says 172.21.15.121:52100) 2024-09-17T03:38:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16a00640 1 -- 172.21.15.121:0/1254243276 learned_addr learned my addr 172.21.15.121:0/1254243276 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16000640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e180d0af0 0x7f8e181f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e17400640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1815a3e0 0x7f8e181f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16a00640 1 -- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e180d0af0 msgr2=0x7f8e181f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16a00640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e180d0af0 0x7f8e181f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16a00640 1 -- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1815a3e0 msgr2=0x7f8e181f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16a00640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1815a3e0 0x7f8e181f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:52.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16a00640 1 -- 172.21.15.121:0/1254243276 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e180b26a0 con 0x7f8e1806d800 2024-09-17T03:38:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16000640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e180d0af0 0x7f8e181f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e16a00640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e1806d800 0x7f8e1809d620 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c700 tx=0x7f8e0800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e0ea00640 1 -- 172.21.15.121:0/1254243276 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08016020 con 0x7f8e1806d800 2024-09-17T03:38:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e0ea00640 1 -- 172.21.15.121:0/1254243276 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e0800a930 con 0x7f8e1806d800 2024-09-17T03:38:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e0ea00640 1 -- 172.21.15.121:0/1254243276 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800ad80 con 0x7f8e1806d800 2024-09-17T03:38:52.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e1d800640 1 -- 172.21.15.121:0/1254243276 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e180b2980 con 0x7f8e1806d800 2024-09-17T03:38:52.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.806+0000 7f8e1d800640 1 -- 172.21.15.121:0/1254243276 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e180743d0 con 0x7f8e1806d800 2024-09-17T03:38:52.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.807+0000 7f8e1d800640 1 -- 172.21.15.121:0/1254243276 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e18074630 con 0x7f8e1806d800 2024-09-17T03:38:52.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.808+0000 7f8e0ea00640 1 -- 172.21.15.121:0/1254243276 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e08019020 con 0x7f8e1806d800 2024-09-17T03:38:52.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.810+0000 7f8e0ea00640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df8078b90 0x7f8df807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:52.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.810+0000 7f8e0ea00640 1 -- 172.21.15.121:0/1254243276 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5421+0+0 (secure 0 0 0) 0x7f8e0809ae80 con 0x7f8e1806d800 2024-09-17T03:38:52.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.810+0000 7f8e16000640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df8078b90 0x7f8df807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:52.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.811+0000 7f8e16000640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df8078b90 0x7f8df807b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8e04034000 tx=0x7f8e04004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:52.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.815+0000 7f8e0ea00640 1 -- 172.21.15.121:0/1254243276 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e08020020 con 0x7f8e1806d800 2024-09-17T03:38:52.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.997+0000 7f8e1d800640 1 -- 172.21.15.121:0/1254243276 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8e180d05b0 con 0x7f8e1806d800 2024-09-17T03:38:52.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:52.998+0000 7f8e0ea00640 1 -- 172.21.15.121:0/1254243276 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v39) ==== 59+0+2294 (secure 0 0 0) 0x7f8e180d0f00 con 0x7f8e1806d800 2024-09-17T03:38:52.999 INFO:teuthology.orchestra.run.smithi121.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:38:52.999 INFO:teuthology.orchestra.run.smithi121.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:38:52.999 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:38:52.999 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_client 20/20 2024-09-17T03:38:52.999 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:38:52.999 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:38:52.999 INFO:teuthology.orchestra.run.smithi121.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:38:52.999 INFO:teuthology.orchestra.run.smithi121.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:38:52.999 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3249.879374 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3414.976419 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3347.142673 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3524.210167 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 7230.495988 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4229.547603 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4520.738354 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4185.245448 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds 20/20 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_ms 2/2 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_frag true 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:38:53.000 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:38:53.001 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_verify_scatter true 2024-09-17T03:38:53.001 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:38:53.001 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:38:53.001 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:38:53.001 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced client_mount_timeout 600 2024-09-17T03:38:53.001 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_client 20/20 2024-09-17T03:38:53.001 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_ms 1/1 2024-09-17T03:38:53.001 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:38:53.001 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:38:53.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 -- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df8078b90 msgr2=0x7f8df807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:53.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df8078b90 0x7f8df807b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8e04034000 tx=0x7f8e04004730 comp rx=0 tx=0).stop 2024-09-17T03:38:53.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 -- 172.21.15.121:0/1254243276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e1806d800 msgr2=0x7f8e1809d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:53.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e1806d800 0x7f8e1809d620 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c700 tx=0x7f8e0800cbc0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 -- 172.21.15.121:0/1254243276 shutdown_connections 2024-09-17T03:38:53.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1815a3e0 0x7f8e181f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e180d0af0 0x7f8e181f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8df8078b90 0x7f8df807b0a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 --2- 172.21.15.121:0/1254243276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e1806d800 0x7f8e1809d620 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 -- 172.21.15.121:0/1254243276 >> 172.21.15.121:0/1254243276 conn(0x7f8e180b3580 msgr2=0x7f8e1815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:53.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 -- 172.21.15.121:0/1254243276 shutdown_connections 2024-09-17T03:38:53.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.001+0000 7f8e1d800640 1 -- 172.21.15.121:0/1254243276 wait complete. 2024-09-17T03:38:53.024 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:38:53.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.249+0000 7ff623600640 1 -- 172.21.15.121:0/467235927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff600004800 msgr2=0x7ff600004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:53.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.249+0000 7ff623600640 1 --2- 172.21.15.121:0/467235927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff600004800 0x7ff600004c10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff60400c2e0 tx=0x7ff600005830 comp rx=0 tx=0).stop 2024-09-17T03:38:53.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.249+0000 7ff623600640 1 -- 172.21.15.121:0/467235927 shutdown_connections 2024-09-17T03:38:53.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.249+0000 7ff623600640 1 --2- 172.21.15.121:0/467235927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff600004800 0x7ff600004c10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.249+0000 7ff623600640 1 -- 172.21.15.121:0/467235927 >> 172.21.15.121:0/467235927 conn(0x7ff61c0b3580 msgr2=0x7ff61c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:53.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.249+0000 7ff623600640 1 -- 172.21.15.121:0/467235927 shutdown_connections 2024-09-17T03:38:53.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.249+0000 7ff623600640 1 -- 172.21.15.121:0/467235927 wait complete. 2024-09-17T03:38:53.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.252+0000 7ff623600640 1 Processor -- start 2024-09-17T03:38:53.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.252+0000 7ff623600640 1 -- start start 2024-09-17T03:38:53.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.253+0000 7ff623600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff600004800 0x7ff61c0c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:53.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.253+0000 7ff623600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0c6290 0x7ff61c0c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.253+0000 7ff623600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c15dea0 0x7ff61c15e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.253+0000 7ff623600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c06db90 con 0x7ff600004800 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.253+0000 7ff623600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c06da10 con 0x7ff61c15dea0 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.253+0000 7ff623600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c161190 con 0x7ff61c0c6290 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.253+0000 7ff620c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff600004800 0x7ff61c0c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff620c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff600004800 0x7ff61c0c9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52116/0 (socket says 172.21.15.121:52116) 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff620c00640 1 -- 172.21.15.121:0/1397409242 learned_addr learned my addr 172.21.15.121:0/1397409242 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff613e00640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0c6290 0x7ff61c0c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff621600640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c15dea0 0x7ff61c15e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff620c00640 1 -- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0c6290 msgr2=0x7ff61c0c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff620c00640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0c6290 0x7ff61c0c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff620c00640 1 -- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c15dea0 msgr2=0x7ff61c15e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:53.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff620c00640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c15dea0 0x7ff61c15e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff620c00640 1 -- 172.21.15.121:0/1397409242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c15e7f0 con 0x7ff600004800 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff621600640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c15dea0 0x7ff61c15e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff620c00640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff600004800 0x7ff61c0c9670 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff60c011ae0 tx=0x7ff60c009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff619600640 1 -- 172.21.15.121:0/1397409242 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c01e070 con 0x7ff600004800 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff619600640 1 -- 172.21.15.121:0/1397409242 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff60c00fc70 con 0x7ff600004800 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.254+0000 7ff619600640 1 -- 172.21.15.121:0/1397409242 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c019410 con 0x7ff600004800 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.255+0000 7ff623600640 1 -- 172.21.15.121:0/1397409242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c0b1630 con 0x7ff600004800 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.255+0000 7ff623600640 1 -- 172.21.15.121:0/1397409242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c0b1bf0 con 0x7ff600004800 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.256+0000 7ff623600640 1 -- 172.21.15.121:0/1397409242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c0d08c0 con 0x7ff600004800 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.257+0000 7ff619600640 1 -- 172.21.15.121:0/1397409242 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff60c021070 con 0x7ff600004800 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.258+0000 7ff619600640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff5f8078b90 0x7ff5f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:53.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.258+0000 7ff619600640 1 -- 172.21.15.121:0/1397409242 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5421+0+0 (secure 0 0 0) 0x7ff60c09b4e0 con 0x7ff600004800 2024-09-17T03:38:53.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.258+0000 7ff613e00640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff5f8078b90 0x7ff5f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:53.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.259+0000 7ff613e00640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff5f8078b90 0x7ff5f807b0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff604033000 tx=0x7ff61c160670 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:53.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.262+0000 7ff619600640 1 -- 172.21.15.121:0/1397409242 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff61c15e7f0 con 0x7ff600004800 2024-09-17T03:38:53.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.448+0000 7ff623600640 1 -- 172.21.15.121:0/1397409242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff61c0d0d80 con 0x7ff600004800 2024-09-17T03:38:53.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.452+0000 7ff619600640 1 -- 172.21.15.121:0/1397409242 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7ff60c0633e0 con 0x7ff600004800 2024-09-17T03:38:53.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 -- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff5f8078b90 msgr2=0x7ff5f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:53.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff5f8078b90 0x7ff5f807b0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff604033000 tx=0x7ff61c160670 comp rx=0 tx=0).stop 2024-09-17T03:38:53.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 -- 172.21.15.121:0/1397409242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff600004800 msgr2=0x7ff61c0c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:53.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff600004800 0x7ff61c0c9670 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff60c011ae0 tx=0x7ff60c009eb0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 -- 172.21.15.121:0/1397409242 shutdown_connections 2024-09-17T03:38:53.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c15dea0 0x7ff61c15e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0c6290 0x7ff61c0c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff5f8078b90 0x7ff5f807b0a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 --2- 172.21.15.121:0/1397409242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff600004800 0x7ff61c0c9670 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:53.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 -- 172.21.15.121:0/1397409242 >> 172.21.15.121:0/1397409242 conn(0x7ff61c0b3580 msgr2=0x7ff61c15b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:53.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 -- 172.21.15.121:0/1397409242 shutdown_connections 2024-09-17T03:38:53.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:53.455+0000 7ff623600640 1 -- 172.21.15.121:0/1397409242 wait complete. 2024-09-17T03:38:53.480 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:38:53.480 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:38:53.567 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:38:53.659 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:38:53.660 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:53.660 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:53.695 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:38:53.695 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:38:53.695 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:53.732 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:38:53.732 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:38:53.732 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:53.770 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:38:53.770 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:38:53.770 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:53.807 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:38:53.807 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:38:53.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:54.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.028+0000 7f0932000640 1 -- 172.21.15.121:0/3270670416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f092c15a3e0 msgr2=0x7f092c06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:54.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.028+0000 7f0932000640 1 --2- 172.21.15.121:0/3270670416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f092c15a3e0 0x7f092c06d800 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f091c009830 tx=0x7f091c02a3f0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.028+0000 7f0932000640 1 -- 172.21.15.121:0/3270670416 shutdown_connections 2024-09-17T03:38:54.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.028+0000 7f0932000640 1 --2- 172.21.15.121:0/3270670416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f092c0d0cc0 0x7f092c15cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.028+0000 7f0932000640 1 --2- 172.21.15.121:0/3270670416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f092c15a3e0 0x7f092c06d800 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.028+0000 7f0932000640 1 -- 172.21.15.121:0/3270670416 >> 172.21.15.121:0/3270670416 conn(0x7f092c0b3580 msgr2=0x7f092c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:54.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.028+0000 7f0932000640 1 -- 172.21.15.121:0/3270670416 shutdown_connections 2024-09-17T03:38:54.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.028+0000 7f0932000640 1 -- 172.21.15.121:0/3270670416 wait complete. 2024-09-17T03:38:54.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.031+0000 7f0932000640 1 Processor -- start 2024-09-17T03:38:54.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.031+0000 7f0932000640 1 -- start start 2024-09-17T03:38:54.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.032+0000 7f0932000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f092c06ddc0 0x7f092c098de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.032+0000 7f0932000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f092c15a3e0 0x7f092c1f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.032+0000 7f0932000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f092c099890 0x7f092c1f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.032+0000 7f0932000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f092c15d4e0 con 0x7f092c099890 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.032+0000 7f0932000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f092c15d360 con 0x7f092c15a3e0 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.032+0000 7f0932000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f092c15d660 con 0x7f092c06ddc0 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.032+0000 7f092be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f092c099890 0x7f092c1f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.032+0000 7f092be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f092c099890 0x7f092c1f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52130/0 (socket says 172.21.15.121:52130) 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.032+0000 7f092be00640 1 -- 172.21.15.121:0/399874567 learned_addr learned my addr 172.21.15.121:0/399874567 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f092b400640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f092c06ddc0 0x7f092c098de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f0923e00640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f092c15a3e0 0x7f092c1f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f092be00640 1 -- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f092c06ddc0 msgr2=0x7f092c098de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f092be00640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f092c06ddc0 0x7f092c098de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f092be00640 1 -- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f092c15a3e0 msgr2=0x7f092c1f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:54.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f092be00640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f092c15a3e0 0x7f092c1f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f092be00640 1 -- 172.21.15.121:0/399874567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092c072fb0 con 0x7f092c099890 2024-09-17T03:38:54.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f0923e00640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f092c15a3e0 0x7f092c1f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:54.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f092be00640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f092c099890 0x7f092c1f6d80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f092400ea70 tx=0x7f092400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:54.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f0923400640 1 -- 172.21.15.121:0/399874567 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092400cde0 con 0x7f092c099890 2024-09-17T03:38:54.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f0923400640 1 -- 172.21.15.121:0/399874567 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0924004c10 con 0x7f092c099890 2024-09-17T03:38:54.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f0932000640 1 -- 172.21.15.121:0/399874567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092c1f7410 con 0x7f092c099890 2024-09-17T03:38:54.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.033+0000 7f0923400640 1 -- 172.21.15.121:0/399874567 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0924005020 con 0x7f092c099890 2024-09-17T03:38:54.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.034+0000 7f0932000640 1 -- 172.21.15.121:0/399874567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f092c1590d0 con 0x7f092c099890 2024-09-17T03:38:54.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.035+0000 7f0932000640 1 -- 172.21.15.121:0/399874567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f092c159330 con 0x7f092c099890 2024-09-17T03:38:54.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.036+0000 7f0923400640 1 -- 172.21.15.121:0/399874567 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09240051c0 con 0x7f092c099890 2024-09-17T03:38:54.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.037+0000 7f0923400640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0908078bc0 0x7f090807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:54.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.038+0000 7f0923400640 1 -- 172.21.15.121:0/399874567 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5421+0+0 (secure 0 0 0) 0x7f092409b9c0 con 0x7f092c099890 2024-09-17T03:38:54.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.038+0000 7f092b400640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0908078bc0 0x7f090807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:54.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.039+0000 7f092b400640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0908078bc0 0x7f090807b0d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f091c034000 tx=0x7f091c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:54.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.042+0000 7f0923400640 1 -- 172.21.15.121:0/399874567 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f092409de20 con 0x7f092c099890 2024-09-17T03:38:54.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.259+0000 7f0932000640 1 -- 172.21.15.121:0/399874567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f092c1563d0 con 0x7f092c099890 2024-09-17T03:38:54.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.260+0000 7f0923400640 1 -- 172.21.15.121:0/399874567 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+3923 (secure 0 0 0) 0x7f0924063f20 con 0x7f092c099890 2024-09-17T03:38:54.261 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:54.261 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":43,"btime":"2024-09-17T03:38:47:177525+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1006042508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1006042508},{"type":"v1","addr":"172.21.15.176:6836","nonce":1006042508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5231,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3672630729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3672630729},{"type":"v1","addr":"172.21.15.176:6837","nonce":3672630729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1052414199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1052414199},{"type":"v1","addr":"172.21.15.121:6835","nonce":1052414199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6024,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/3029565240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3029565240},{"type":"v1","addr":"172.21.15.121:6834","nonce":3029565240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[]} 2024-09-17T03:38:54.261 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 43 2024-09-17T03:38:54.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.262+0000 7f0932000640 1 -- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0908078bc0 msgr2=0x7f090807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:54.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.262+0000 7f0932000640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0908078bc0 0x7f090807b0d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f091c034000 tx=0x7f091c004730 comp rx=0 tx=0).stop 2024-09-17T03:38:54.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.262+0000 7f0932000640 1 -- 172.21.15.121:0/399874567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f092c099890 msgr2=0x7f092c1f6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:54.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.262+0000 7f0932000640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f092c099890 0x7f092c1f6d80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f092400ea70 tx=0x7f092400ef30 comp rx=0 tx=0).stop 2024-09-17T03:38:54.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.263+0000 7f0932000640 1 -- 172.21.15.121:0/399874567 shutdown_connections 2024-09-17T03:38:54.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.263+0000 7f0932000640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0908078bc0 0x7f090807b0d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.263+0000 7f0932000640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f092c099890 0x7f092c1f6d80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.263+0000 7f0932000640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f092c15a3e0 0x7f092c1f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.263+0000 7f0932000640 1 --2- 172.21.15.121:0/399874567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f092c06ddc0 0x7f092c098de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.263+0000 7f0932000640 1 -- 172.21.15.121:0/399874567 >> 172.21.15.121:0/399874567 conn(0x7f092c0b3580 msgr2=0x7f092c0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:54.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.263+0000 7f0932000640 1 -- 172.21.15.121:0/399874567 shutdown_connections 2024-09-17T03:38:54.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.263+0000 7f0932000640 1 -- 172.21.15.121:0/399874567 wait complete. 2024-09-17T03:38:54.290 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:38:54.290 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:38:54.290 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:38:54.290 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:38:54.290 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:38:54.290 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:38:54.291 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:38:54.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:38:54.291 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:38:54.291 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:38:54.291 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:38:54.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:38:54.291 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:38:54.292 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:38:54.292 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:38:54.292 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:38:54.316 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:38:54.316 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:38:54.317 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:38:54.317 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:38:54.318 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:38:54.319 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:38:54.320 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:38:54.321 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:38:54.361 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:38:54.361 DEBUG:teuthology.parallel:result is None 2024-09-17T03:38:54.362 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:38:54.363 DEBUG:teuthology.parallel:result is None 2024-09-17T03:38:54.364 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:38:54.364 DEBUG:teuthology.parallel:result is None 2024-09-17T03:38:54.367 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:38:54.367 DEBUG:teuthology.parallel:result is None 2024-09-17T03:38:54.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:38:54.559 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T03:38:54.559 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:38:54.560 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:38:54.560 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:38:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.599+0000 7ff169000640 1 -- 172.21.15.121:0/1083014934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1640adf80 msgr2=0x7ff1640ae390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.599+0000 7ff169000640 1 --2- 172.21.15.121:0/1083014934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1640adf80 0x7ff1640ae390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff15c005fd0 tx=0x7ff15c02aa80 comp rx=0 tx=0).stop 2024-09-17T03:38:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.600+0000 7ff169000640 1 -- 172.21.15.121:0/1083014934 shutdown_connections 2024-09-17T03:38:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.600+0000 7ff169000640 1 --2- 172.21.15.121:0/1083014934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1640adf80 0x7ff1640ae390 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.600+0000 7ff169000640 1 --2- 172.21.15.121:0/1083014934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff164162190 0x7ff1641625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.600+0000 7ff169000640 1 -- 172.21.15.121:0/1083014934 >> 172.21.15.121:0/1083014934 conn(0x7ff164074540 msgr2=0x7ff16406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.600+0000 7ff169000640 1 -- 172.21.15.121:0/1083014934 shutdown_connections 2024-09-17T03:38:54.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.600+0000 7ff169000640 1 -- 172.21.15.121:0/1083014934 wait complete. 2024-09-17T03:38:54.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.601+0000 7ff169000640 1 Processor -- start 2024-09-17T03:38:54.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.601+0000 7ff169000640 1 -- start start 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.603+0000 7ff169000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1640adf80 0x7ff1641f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.603+0000 7ff169000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1640d0010 0x7ff1641f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff169000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff164162190 0x7ff1641f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff169000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff1640aec60 con 0x7ff164162190 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff169000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1640aeae0 con 0x7ff1640adf80 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff169000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1640aede0 con 0x7ff1640d0010 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff163e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff164162190 0x7ff1641f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff163400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1640adf80 0x7ff1641f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff163400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1640adf80 0x7ff1641f54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:42934/0 (socket says 172.21.15.121:42934) 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff163400640 1 -- 172.21.15.121:0/3416752625 learned_addr learned my addr 172.21.15.121:0/3416752625 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff163e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff164162190 0x7ff1641f8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52170/0 (socket says 172.21.15.121:52170) 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff162a00640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1640d0010 0x7ff1641f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:54.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff163400640 1 -- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1640d0010 msgr2=0x7ff1641f8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff163400640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1640d0010 0x7ff1641f8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff163400640 1 -- 172.21.15.121:0/3416752625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff164162190 msgr2=0x7ff1641f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff163400640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff164162190 0x7ff1641f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.604+0000 7ff163400640 1 -- 172.21.15.121:0/3416752625 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1641f6480 con 0x7ff1640adf80 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.605+0000 7ff163400640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1640adf80 0x7ff1641f54b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff15400c3c0 tx=0x7ff15400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.605+0000 7ff15b400640 1 -- 172.21.15.121:0/3416752625 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154017070 con 0x7ff1640adf80 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.605+0000 7ff15b400640 1 -- 172.21.15.121:0/3416752625 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1540035f0 con 0x7ff1640adf80 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.605+0000 7ff169000640 1 -- 172.21.15.121:0/3416752625 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1641f5be0 con 0x7ff1640adf80 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.605+0000 7ff15b400640 1 -- 172.21.15.121:0/3416752625 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154003a80 con 0x7ff1640adf80 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.605+0000 7ff169000640 1 -- 172.21.15.121:0/3416752625 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1641f61a0 con 0x7ff1640adf80 2024-09-17T03:38:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.606+0000 7ff169000640 1 -- 172.21.15.121:0/3416752625 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1640ae390 con 0x7ff1640adf80 2024-09-17T03:38:54.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.607+0000 7ff15b400640 1 -- 172.21.15.121:0/3416752625 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff15401a070 con 0x7ff1640adf80 2024-09-17T03:38:54.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.608+0000 7ff15b400640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff144078b90 0x7ff14407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:54.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.609+0000 7ff15b400640 1 -- 172.21.15.121:0/3416752625 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5421+0+0 (secure 0 0 0) 0x7ff15409a110 con 0x7ff1640adf80 2024-09-17T03:38:54.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.609+0000 7ff162a00640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff144078b90 0x7ff14407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:54.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.609+0000 7ff162a00640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff144078b90 0x7ff14407b0a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff16414b060 tx=0x7ff150005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:54.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.612+0000 7ff15b400640 1 -- 172.21.15.121:0/3416752625 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff154062000 con 0x7ff1640adf80 2024-09-17T03:38:54.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:54.805+0000 7ff169000640 1 -- 172.21.15.121:0/3416752625 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff1640b1800 con 0x7ff1640adf80 2024-09-17T03:38:55.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.577+0000 7ff15b400640 1 -- 172.21.15.121:0/3416752625 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v70) ==== 97+0+0 (secure 0 0 0) 0x7ff154066a30 con 0x7ff1640adf80 2024-09-17T03:38:55.577 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-17T03:38:55.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 -- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff144078b90 msgr2=0x7ff14407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:55.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff144078b90 0x7ff14407b0a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff16414b060 tx=0x7ff150005f90 comp rx=0 tx=0).stop 2024-09-17T03:38:55.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 -- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1640adf80 msgr2=0x7ff1641f54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:55.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1640adf80 0x7ff1641f54b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff15400c3c0 tx=0x7ff15400c880 comp rx=0 tx=0).stop 2024-09-17T03:38:55.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 -- 172.21.15.121:0/3416752625 shutdown_connections 2024-09-17T03:38:55.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff144078b90 0x7ff14407b0a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:55.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff164162190 0x7ff1641f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:55.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1640d0010 0x7ff1641f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:55.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 --2- 172.21.15.121:0/3416752625 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1640adf80 0x7ff1641f54b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:55.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 -- 172.21.15.121:0/3416752625 >> 172.21.15.121:0/3416752625 conn(0x7ff164074540 msgr2=0x7ff164155350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:55.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 -- 172.21.15.121:0/3416752625 shutdown_connections 2024-09-17T03:38:55.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.581+0000 7ff169000640 1 -- 172.21.15.121:0/3416752625 wait complete. 2024-09-17T03:38:55.607 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:38:55.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.833+0000 7f2887e00640 1 -- 172.21.15.121:0/2782650132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f288815e7a0 msgr2=0x7f28880d3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:55.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.833+0000 7f2887e00640 1 --2- 172.21.15.121:0/2782650132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f288815e7a0 0x7f28880d3000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2878009830 tx=0x7f287802a410 comp rx=0 tx=0).stop 2024-09-17T03:38:55.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.833+0000 7f2887e00640 1 -- 172.21.15.121:0/2782650132 shutdown_connections 2024-09-17T03:38:55.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.833+0000 7f2887e00640 1 --2- 172.21.15.121:0/2782650132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2888162b30 0x7f28880cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:55.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.833+0000 7f2887e00640 1 --2- 172.21.15.121:0/2782650132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f288815e7a0 0x7f28880d3000 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:55.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.833+0000 7f2887e00640 1 -- 172.21.15.121:0/2782650132 >> 172.21.15.121:0/2782650132 conn(0x7f28880d4b30 msgr2=0x7f28880b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:55.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.833+0000 7f2887e00640 1 -- 172.21.15.121:0/2782650132 shutdown_connections 2024-09-17T03:38:55.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.833+0000 7f2887e00640 1 -- 172.21.15.121:0/2782650132 wait complete. 2024-09-17T03:38:55.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.835+0000 7f2887e00640 1 Processor -- start 2024-09-17T03:38:55.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.836+0000 7f2887e00640 1 -- start start 2024-09-17T03:38:55.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.837+0000 7f2887e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28880d3540 0x7f2888160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:55.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.837+0000 7f2887e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f288815e7a0 0x7f2888161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:55.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.837+0000 7f2887e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2888162b30 0x7f28880cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:55.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.837+0000 7f2887e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f28880d0440 con 0x7f2888162b30 2024-09-17T03:38:55.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.837+0000 7f2887e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f28880d02c0 con 0x7f28880d3540 2024-09-17T03:38:55.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.837+0000 7f2887e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f28880d05c0 con 0x7f288815e7a0 2024-09-17T03:38:55.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.837+0000 7f2887400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2888162b30 0x7f28880cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:55.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.837+0000 7f2887400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2888162b30 0x7f28880cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52178/0 (socket says 172.21.15.121:52178) 2024-09-17T03:38:55.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.837+0000 7f2887400640 1 -- 172.21.15.121:0/2698687910 learned_addr learned my addr 172.21.15.121:0/2698687910 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:55.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.838+0000 7f287e000640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f288815e7a0 0x7f2888161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:55.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.838+0000 7f2886a00640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28880d3540 0x7f2888160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:55.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.838+0000 7f2887400640 1 -- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f288815e7a0 msgr2=0x7f2888161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:55.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.838+0000 7f2887400640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f288815e7a0 0x7f2888161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:55.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.838+0000 7f2887400640 1 -- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28880d3540 msgr2=0x7f2888160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:55.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.838+0000 7f2887400640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28880d3540 0x7f2888160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:55.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.838+0000 7f2887400640 1 -- 172.21.15.121:0/2698687910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28881f96f0 con 0x7f2888162b30 2024-09-17T03:38:55.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.838+0000 7f2887400640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2888162b30 0x7f28880cd6a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f288000ea40 tx=0x7f288000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:55.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.839+0000 7f287f400640 1 -- 172.21.15.121:0/2698687910 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288000ce40 con 0x7f2888162b30 2024-09-17T03:38:55.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.839+0000 7f287f400640 1 -- 172.21.15.121:0/2698687910 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2880004c10 con 0x7f2888162b30 2024-09-17T03:38:55.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.839+0000 7f2887e00640 1 -- 172.21.15.121:0/2698687910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28881f99d0 con 0x7f2888162b30 2024-09-17T03:38:55.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.839+0000 7f287f400640 1 -- 172.21.15.121:0/2698687910 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880005020 con 0x7f2888162b30 2024-09-17T03:38:55.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.839+0000 7f2887e00640 1 -- 172.21.15.121:0/2698687910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28881f9f90 con 0x7f2888162b30 2024-09-17T03:38:55.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.840+0000 7f2887e00640 1 -- 172.21.15.121:0/2698687910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28880cfb00 con 0x7f2888162b30 2024-09-17T03:38:55.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.841+0000 7f287f400640 1 -- 172.21.15.121:0/2698687910 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28800051c0 con 0x7f2888162b30 2024-09-17T03:38:55.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.842+0000 7f287f400640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2864078bc0 0x7f286407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:55.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.842+0000 7f287f400640 1 -- 172.21.15.121:0/2698687910 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5249+0+0 (secure 0 0 0) 0x7f288009b8a0 con 0x7f2888162b30 2024-09-17T03:38:55.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.843+0000 7f2886a00640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2864078bc0 0x7f286407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:55.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.843+0000 7f2886a00640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2864078bc0 0x7f286407b0d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2878034000 tx=0x7f2878004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:55.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:55.847+0000 7f287f400640 1 -- 172.21.15.121:0/2698687910 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f28880cfb00 con 0x7f2888162b30 2024-09-17T03:38:56.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.097+0000 7f2887e00640 1 -- 172.21.15.121:0/2698687910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f28880b31d0 con 0x7f2888162b30 2024-09-17T03:38:56.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.097+0000 7f287f400640 1 -- 172.21.15.121:0/2698687910 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f2880063840 con 0x7f2888162b30 2024-09-17T03:38:56.097 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:56.097 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohm64sFGhAAJDdFwMDkudwacQaLfvbAdg==", 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.098 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmIGvPNRAAvE+tovzn5WadGa9C/P/A3A==", 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.c", 2024-09-17T03:38:56.099 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmV/btJxAAmhL4jXk0LVdzCPaNi9Hzhg==", 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.d", 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmeQccCBAAtTfeUysbtoqrKjwaKRWyvg==", 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:38:56.100 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDE+OhmBxJKNRAAGxPaH7R2JtcFVO5kR/Qh2A==", 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.101 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDI+OhmRtvFCBAAOG/1XD75Atl6ztUGPw3PKA==", 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-17T03:38:56.102 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL+OhmwzDzIxAA9Z/IIRphtZK1jbS2sIXeJQ==", 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.3", 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDO+Ohm94g0NBAAmxtHPev4OOM0YfOQt7N5Jg==", 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.103 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.4", 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDV+Ohmj7OoCBAA/Hrj9dHVT98lURPWJE3r/g==", 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.5", 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDY+Ohmc29QFxAAGsMy0+9MviYohok8JpL+ZA==", 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.105 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.6", 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDb+OhmDO8tKRAAq6bn/I54WKTdN6XiviHNsQ==", 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.7", 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDe+OhmUuFwNxAAgAeDJiL/TIGDuDAC+dXCyA==", 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:56.106 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw==", 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohmec7LKRAAl5nAqPEncglNL2FbRlD0oA==", 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.108 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.2", 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohme/hCHxAAdP8DjxaXWMGi/Fw+85zUFA==", 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.3", 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmivFTNBAA5f47Lq5CE+iXt3i+5fUJGA==", 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:38:56.109 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:38:56.110 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:38:56.110 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:38:56.110 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.110 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-17T03:38:56.110 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC/+OhmXWj6GBAAh/FBw0ElmHixSBXm8PPeAg==", 2024-09-17T03:38:56.110 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.110 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:38:56.110 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohmsn9CDxAAzjtaZG1qe4XTnBge+t3vlA==", 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.y", 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmQfYJAxAA6Mc5PiIb5VDamVU5Vhx3aQ==", 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-17T03:38:56.112 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:38:56.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 -- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2864078bc0 msgr2=0x7f286407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:56.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2864078bc0 0x7f286407b0d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2878034000 tx=0x7f2878004730 comp rx=0 tx=0).stop 2024-09-17T03:38:56.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 -- 172.21.15.121:0/2698687910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2888162b30 msgr2=0x7f28880cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:56.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2888162b30 0x7f28880cd6a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f288000ea40 tx=0x7f288000ef00 comp rx=0 tx=0).stop 2024-09-17T03:38:56.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 -- 172.21.15.121:0/2698687910 shutdown_connections 2024-09-17T03:38:56.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2864078bc0 0x7f286407b0d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2888162b30 0x7f28880cd6a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f288815e7a0 0x7f2888161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 --2- 172.21.15.121:0/2698687910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28880d3540 0x7f2888160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 -- 172.21.15.121:0/2698687910 >> 172.21.15.121:0/2698687910 conn(0x7f28880d4b30 msgr2=0x7f28880b99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:56.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 -- 172.21.15.121:0/2698687910 shutdown_connections 2024-09-17T03:38:56.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.100+0000 7f2887e00640 1 -- 172.21.15.121:0/2698687910 wait complete. 2024-09-17T03:38:56.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:38:56.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.348+0000 7f5eec000640 1 -- 172.21.15.121:0/3547124279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ee406da30 msgr2=0x7f5ee40d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:56.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.348+0000 7f5eec000640 1 --2- 172.21.15.121:0/3547124279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ee406da30 0x7f5ee40d0b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5edc005fd0 tx=0x7f5edc02aa10 comp rx=0 tx=0).stop 2024-09-17T03:38:56.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.348+0000 7f5eec000640 1 -- 172.21.15.121:0/3547124279 shutdown_connections 2024-09-17T03:38:56.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.348+0000 7f5eec000640 1 --2- 172.21.15.121:0/3547124279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ee406da30 0x7f5ee40d0b70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.348+0000 7f5eec000640 1 --2- 172.21.15.121:0/3547124279 >> v2:172.21.15.176:3300/0 conn(0x7f5ee406d620 0x7f5ee40d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.348+0000 7f5eec000640 1 -- 172.21.15.121:0/3547124279 >> 172.21.15.121:0/3547124279 conn(0x7f5ee40b3580 msgr2=0x7f5ee40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:56.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.348+0000 7f5eec000640 1 -- 172.21.15.121:0/3547124279 shutdown_connections 2024-09-17T03:38:56.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.348+0000 7f5eec000640 1 -- 172.21.15.121:0/3547124279 wait complete. 2024-09-17T03:38:56.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.350+0000 7f5eec000640 1 Processor -- start 2024-09-17T03:38:56.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.350+0000 7f5eec000640 1 -- start start 2024-09-17T03:38:56.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5eec000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ee406d620 0x7f5ee40ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:56.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5eec000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee406da30 0x7f5ee40b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:56.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5eec000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ee40cca80 0x7f5ee40b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:56.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5eec000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee40cb970 con 0x7f5ee406da30 2024-09-17T03:38:56.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5eec000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee40cb7f0 con 0x7f5ee40cca80 2024-09-17T03:38:56.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5eec000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee40cbaf0 con 0x7f5ee406d620 2024-09-17T03:38:56.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5ee8c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee406da30 0x7f5ee40b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:56.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5ee8c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee406da30 0x7f5ee40b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52184/0 (socket says 172.21.15.121:52184) 2024-09-17T03:38:56.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5ee8c00640 1 -- 172.21.15.121:0/833140741 learned_addr learned my addr 172.21.15.121:0/833140741 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:56.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5eea000640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ee40cca80 0x7f5ee40b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:56.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5ee9600640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ee406d620 0x7f5ee40ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:56.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5ee8c00640 1 -- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ee406d620 msgr2=0x7f5ee40ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:56.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5ee8c00640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ee406d620 0x7f5ee40ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5ee8c00640 1 -- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ee40cca80 msgr2=0x7f5ee40b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:56.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5ee8c00640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ee40cca80 0x7f5ee40b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.352+0000 7f5ee8c00640 1 -- 172.21.15.121:0/833140741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee41e8850 con 0x7f5ee406da30 2024-09-17T03:38:56.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.353+0000 7f5ee8c00640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee406da30 0x7f5ee40b02f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000e710 tx=0x7f5ed000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:56.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.353+0000 7f5ee1600640 1 -- 172.21.15.121:0/833140741 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0004230 con 0x7f5ee406da30 2024-09-17T03:38:56.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.353+0000 7f5ee1600640 1 -- 172.21.15.121:0/833140741 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ed00043f0 con 0x7f5ee406da30 2024-09-17T03:38:56.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.353+0000 7f5eec000640 1 -- 172.21.15.121:0/833140741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee41e8b30 con 0x7f5ee406da30 2024-09-17T03:38:56.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.353+0000 7f5ee1600640 1 -- 172.21.15.121:0/833140741 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000cb10 con 0x7f5ee406da30 2024-09-17T03:38:56.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.353+0000 7f5eec000640 1 -- 172.21.15.121:0/833140741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee40caee0 con 0x7f5ee406da30 2024-09-17T03:38:56.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.354+0000 7f5eec000640 1 -- 172.21.15.121:0/833140741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee40cb540 con 0x7f5ee406da30 2024-09-17T03:38:56.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.355+0000 7f5ee1600640 1 -- 172.21.15.121:0/833140741 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ed00035f0 con 0x7f5ee406da30 2024-09-17T03:38:56.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.356+0000 7f5ee1600640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ec4078bc0 0x7f5ec407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:56.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.356+0000 7f5ee1600640 1 -- 172.21.15.121:0/833140741 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5249+0+0 (secure 0 0 0) 0x7f5ed009b630 con 0x7f5ee406da30 2024-09-17T03:38:56.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.357+0000 7f5ee9600640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ec4078bc0 0x7f5ec407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:56.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.358+0000 7f5ee9600640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ec4078bc0 0x7f5ec407b0d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8000f60 tx=0x7f5ed8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:56.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.361+0000 7f5ee1600640 1 -- 172.21.15.121:0/833140741 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5ee40cb540 con 0x7f5ee406da30 2024-09-17T03:38:56.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.549+0000 7f5eec000640 1 -- 172.21.15.121:0/833140741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5ee40cbf70 con 0x7f5ee406da30 2024-09-17T03:38:56.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.549+0000 7f5ee1600640 1 -- 172.21.15.121:0/833140741 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7f5ed0063540 con 0x7f5ee406da30 2024-09-17T03:38:56.549 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:38:56.549 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-17T03:38:56.549 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:38:56.550 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-17T03:38:56.550 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-17T03:38:56.550 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:38:56.550 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-17T03:38:56.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 -- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ec4078bc0 msgr2=0x7f5ec407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:56.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ec4078bc0 0x7f5ec407b0d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8000f60 tx=0x7f5ed8009040 comp rx=0 tx=0).stop 2024-09-17T03:38:56.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 -- 172.21.15.121:0/833140741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee406da30 msgr2=0x7f5ee40b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:56.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee406da30 0x7f5ee40b02f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000e710 tx=0x7f5ed000ebd0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 -- 172.21.15.121:0/833140741 shutdown_connections 2024-09-17T03:38:56.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ee40cca80 0x7f5ee40b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ec4078bc0 0x7f5ec407b0d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee406da30 0x7f5ee40b02f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 --2- 172.21.15.121:0/833140741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ee406d620 0x7f5ee40ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 -- 172.21.15.121:0/833140741 >> 172.21.15.121:0/833140741 conn(0x7f5ee40b3580 msgr2=0x7f5ee4160900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:56.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 -- 172.21.15.121:0/833140741 shutdown_connections 2024-09-17T03:38:56.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.552+0000 7f5eec000640 1 -- 172.21.15.121:0/833140741 wait complete. 2024-09-17T03:38:56.575 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:38:56.575 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:38:56.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.799+0000 7fbf13800640 1 -- 172.21.15.121:0/3851340867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf0c0d05f0 msgr2=0x7fbf0c0d0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:56.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.800+0000 7fbf13800640 1 --2- 172.21.15.121:0/3851340867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf0c0d05f0 0x7fbf0c0d0a00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbf04005fd0 tx=0x7fbf0402aa00 comp rx=0 tx=0).stop 2024-09-17T03:38:56.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.800+0000 7fbf13800640 1 -- 172.21.15.121:0/3851340867 shutdown_connections 2024-09-17T03:38:56.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.800+0000 7fbf13800640 1 --2- 172.21.15.121:0/3851340867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf0c0d05f0 0x7fbf0c0d0a00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.800+0000 7fbf13800640 1 --2- 172.21.15.121:0/3851340867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c06d750 0x7fbf0c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.800+0000 7fbf13800640 1 -- 172.21.15.121:0/3851340867 >> 172.21.15.121:0/3851340867 conn(0x7fbf0c0b3620 msgr2=0x7fbf0c0b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:56.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.800+0000 7fbf13800640 1 -- 172.21.15.121:0/3851340867 shutdown_connections 2024-09-17T03:38:56.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.800+0000 7fbf13800640 1 -- 172.21.15.121:0/3851340867 wait complete. 2024-09-17T03:38:56.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.802+0000 7fbf13800640 1 Processor -- start 2024-09-17T03:38:56.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.802+0000 7fbf13800640 1 -- start start 2024-09-17T03:38:56.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.803+0000 7fbf13800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf0c06d750 0x7fbf0c1f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:56.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.803+0000 7fbf13800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf0c0d05f0 0x7fbf0c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:56.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.803+0000 7fbf13800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c15c830 0x7fbf0c1f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf13800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c15d420 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf13800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c15d2a0 con 0x7fbf0c06d750 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf13800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0c15d5a0 con 0x7fbf0c15c830 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf0be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf0c0d05f0 0x7fbf0c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf0be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf0c0d05f0 0x7fbf0c0b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52204/0 (socket says 172.21.15.121:52204) 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf0be00640 1 -- 172.21.15.121:0/769558882 learned_addr learned my addr 172.21.15.121:0/769558882 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf11800640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c15c830 0x7fbf0c1f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf10e00640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf0c06d750 0x7fbf0c1f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf0be00640 1 -- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c15c830 msgr2=0x7fbf0c1f3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf0be00640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c15c830 0x7fbf0c1f3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf0be00640 1 -- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf0c06d750 msgr2=0x7fbf0c1f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf0be00640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf0c06d750 0x7fbf0c1f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf0be00640 1 -- 172.21.15.121:0/769558882 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0c1f3550 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.804+0000 7fbf11800640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c15c830 0x7fbf0c1f3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.805+0000 7fbf0be00640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf0c0d05f0 0x7fbf0c0b2030 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbef800d700 tx=0x7fbef800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.805+0000 7fbf08c00640 1 -- 172.21.15.121:0/769558882 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8017070 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.805+0000 7fbf08c00640 1 -- 172.21.15.121:0/769558882 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbef8005310 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.805+0000 7fbf08c00640 1 -- 172.21.15.121:0/769558882 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8009820 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.805+0000 7fbf13800640 1 -- 172.21.15.121:0/769558882 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0c1f70c0 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.805+0000 7fbf13800640 1 -- 172.21.15.121:0/769558882 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0c1f7680 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.806+0000 7fbf13800640 1 -- 172.21.15.121:0/769558882 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf0c1f3360 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.807+0000 7fbf08c00640 1 -- 172.21.15.121:0/769558882 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbef80099c0 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.808+0000 7fbf08c00640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbeec078b90 0x7fbeec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.808+0000 7fbf08c00640 1 -- 172.21.15.121:0/769558882 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5249+0+0 (secure 0 0 0) 0x7fbef809acd0 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.809+0000 7fbf10e00640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbeec078b90 0x7fbeec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:56.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.809+0000 7fbf10e00640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbeec078b90 0x7fbeec07b0a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbf00006fd0 tx=0x7fbf00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:56.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.812+0000 7fbf08c00640 1 -- 172.21.15.121:0/769558882 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbef80632c0 con 0x7fbf0c0d05f0 2024-09-17T03:38:56.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:56.994+0000 7fbf13800640 1 -- 172.21.15.121:0/769558882 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbf0c1f6e50 con 0x7fbf0c0d05f0 2024-09-17T03:38:57.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.583+0000 7fbf08c00640 1 -- 172.21.15.121:0/769558882 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7fbef8062bc0 con 0x7fbf0c0d05f0 2024-09-17T03:38:57.583 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-17T03:38:57.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 -- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbeec078b90 msgr2=0x7fbeec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:57.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbeec078b90 0x7fbeec07b0a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbf00006fd0 tx=0x7fbf00008040 comp rx=0 tx=0).stop 2024-09-17T03:38:57.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 -- 172.21.15.121:0/769558882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf0c0d05f0 msgr2=0x7fbf0c0b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:57.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf0c0d05f0 0x7fbf0c0b2030 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbef800d700 tx=0x7fbef800dbc0 comp rx=0 tx=0).stop 2024-09-17T03:38:57.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 -- 172.21.15.121:0/769558882 shutdown_connections 2024-09-17T03:38:57.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf0c15c830 0x7fbf0c1f3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:57.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbeec078b90 0x7fbeec07b0a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:57.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf0c0d05f0 0x7fbf0c0b2030 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:57.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 --2- 172.21.15.121:0/769558882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf0c06d750 0x7fbf0c1f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:57.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 -- 172.21.15.121:0/769558882 >> 172.21.15.121:0/769558882 conn(0x7fbf0c0b3620 msgr2=0x7fbf0c0b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:57.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 -- 172.21.15.121:0/769558882 shutdown_connections 2024-09-17T03:38:57.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.586+0000 7fbf13800640 1 -- 172.21.15.121:0/769558882 wait complete. 2024-09-17T03:38:57.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:38:57.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.847+0000 7fdf3e600640 1 -- 172.21.15.121:0/2020604414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf1c003ae0 msgr2=0x7fdf1c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:57.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.847+0000 7fdf3e600640 1 --2- 172.21.15.121:0/2020604414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf1c003ae0 0x7fdf1c003f50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800c780 tx=0x7fdf1c005830 comp rx=0 tx=0).stop 2024-09-17T03:38:57.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.847+0000 7fdf37e00640 1 -- 172.21.15.121:0/2020604414 reap_dead start 2024-09-17T03:38:57.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.847+0000 7fdf3e600640 1 -- 172.21.15.121:0/2020604414 shutdown_connections 2024-09-17T03:38:57.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.847+0000 7fdf3e600640 1 -- 172.21.15.121:0/2020604414 >> 172.21.15.121:0/2020604414 conn(0x7fdf380b3580 msgr2=0x7fdf380b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:57.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.847+0000 7fdf3e600640 1 -- 172.21.15.121:0/2020604414 shutdown_connections 2024-09-17T03:38:57.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.847+0000 7fdf3e600640 1 -- 172.21.15.121:0/2020604414 wait complete. 2024-09-17T03:38:57.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.849+0000 7fdf3e600640 1 Processor -- start 2024-09-17T03:38:57.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.849+0000 7fdf3e600640 1 -- start start 2024-09-17T03:38:57.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf3e600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1c003ae0 0x7fdf380c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:57.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf3e600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf380998f0 0x7fdf3815e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:57.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf3e600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3815ebf0 0x7fdf380c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:57.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf3e600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3815cfa0 con 0x7fdf380998f0 2024-09-17T03:38:57.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf3e600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3815ce20 con 0x7fdf1c003ae0 2024-09-17T03:38:57.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf3e600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3815d120 con 0x7fdf3815ebf0 2024-09-17T03:38:57.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf2ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf380998f0 0x7fdf3815e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:57.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf2ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf380998f0 0x7fdf3815e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52222/0 (socket says 172.21.15.121:52222) 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf2ea00640 1 -- 172.21.15.121:0/2694726630 learned_addr learned my addr 172.21.15.121:0/2694726630 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf37400640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1c003ae0 0x7fdf380c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.851+0000 7fdf37e00640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3815ebf0 0x7fdf380c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf2ea00640 1 -- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3815ebf0 msgr2=0x7fdf380c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf2ea00640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3815ebf0 0x7fdf380c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf2ea00640 1 -- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1c003ae0 msgr2=0x7fdf380c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf2ea00640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1c003ae0 0x7fdf380c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf2ea00640 1 -- 172.21.15.121:0/2694726630 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3815f000 con 0x7fdf380998f0 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf2ea00640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf380998f0 0x7fdf3815e6b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdf20011ae0 tx=0x7fdf20011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf2fe00640 1 -- 172.21.15.121:0/2694726630 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2001e070 con 0x7fdf380998f0 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf2fe00640 1 -- 172.21.15.121:0/2694726630 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf2000fe70 con 0x7fdf380998f0 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf3e600640 1 -- 172.21.15.121:0/2694726630 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf380c6e40 con 0x7fdf380998f0 2024-09-17T03:38:57.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf2fe00640 1 -- 172.21.15.121:0/2694726630 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf20019690 con 0x7fdf380998f0 2024-09-17T03:38:57.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.852+0000 7fdf3e600640 1 -- 172.21.15.121:0/2694726630 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf381f71e0 con 0x7fdf380998f0 2024-09-17T03:38:57.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.853+0000 7fdf3e600640 1 -- 172.21.15.121:0/2694726630 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf380696f0 con 0x7fdf380998f0 2024-09-17T03:38:57.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.855+0000 7fdf2fe00640 1 -- 172.21.15.121:0/2694726630 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf20021070 con 0x7fdf380998f0 2024-09-17T03:38:57.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.856+0000 7fdf2fe00640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf14078b90 0x7fdf1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:57.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.856+0000 7fdf2fe00640 1 -- 172.21.15.121:0/2694726630 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5619+0+0 (secure 0 0 0) 0x7fdf2009b840 con 0x7fdf380998f0 2024-09-17T03:38:57.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.856+0000 7fdf37400640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf14078b90 0x7fdf1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:57.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.857+0000 7fdf37400640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf14078b90 0x7fdf1407b0a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdf28033000 tx=0x7fdf2802d070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:57.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:57.861+0000 7fdf2fe00640 1 -- 172.21.15.121:0/2694726630 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf380696f0 con 0x7fdf380998f0 2024-09-17T03:38:58.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.045+0000 7fdf3e600640 1 -- 172.21.15.121:0/2694726630 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdf380d05b0 con 0x7fdf380998f0 2024-09-17T03:38:58.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.593+0000 7fdf2fe00640 1 -- 172.21.15.121:0/2694726630 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v74) ==== 170+0+0 (secure 0 0 0) 0x7fdf3815f000 con 0x7fdf380998f0 2024-09-17T03:38:58.594 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-17T03:38:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.596+0000 7fdf3e600640 1 -- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf14078b90 msgr2=0x7fdf1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:58.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.596+0000 7fdf3e600640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf14078b90 0x7fdf1407b0a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdf28033000 tx=0x7fdf2802d070 comp rx=0 tx=0).stop 2024-09-17T03:38:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.596+0000 7fdf3e600640 1 -- 172.21.15.121:0/2694726630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf380998f0 msgr2=0x7fdf3815e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.596+0000 7fdf3e600640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf380998f0 0x7fdf3815e6b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdf20011ae0 tx=0x7fdf20011ee0 comp rx=0 tx=0).stop 2024-09-17T03:38:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.596+0000 7fdf3e600640 1 -- 172.21.15.121:0/2694726630 shutdown_connections 2024-09-17T03:38:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.596+0000 7fdf3e600640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3815ebf0 0x7fdf380c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:58.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.596+0000 7fdf3e600640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf14078b90 0x7fdf1407b0a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:58.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.596+0000 7fdf3e600640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf380998f0 0x7fdf3815e6b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:58.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.596+0000 7fdf3e600640 1 --2- 172.21.15.121:0/2694726630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1c003ae0 0x7fdf380c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:58.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.596+0000 7fdf3e600640 1 -- 172.21.15.121:0/2694726630 >> 172.21.15.121:0/2694726630 conn(0x7fdf380b3580 msgr2=0x7fdf380b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:58.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.597+0000 7fdf3e600640 1 -- 172.21.15.121:0/2694726630 shutdown_connections 2024-09-17T03:38:58.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.598+0000 7fdf3e600640 1 -- 172.21.15.121:0/2694726630 wait complete. 2024-09-17T03:38:58.637 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:38:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.862+0000 7fa050000640 1 -- 172.21.15.121:0/3789425938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa030004d40 msgr2=0x7fa0300051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.862+0000 7fa050000640 1 --2- 172.21.15.121:0/3789425938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa030004d40 0x7fa0300051b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa040009ed0 tx=0x7fa030005830 comp rx=0 tx=0).stop 2024-09-17T03:38:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.862+0000 7fa04e000640 1 -- 172.21.15.121:0/3789425938 reap_dead start 2024-09-17T03:38:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.862+0000 7fa050000640 1 -- 172.21.15.121:0/3789425938 shutdown_connections 2024-09-17T03:38:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.862+0000 7fa050000640 1 -- 172.21.15.121:0/3789425938 >> 172.21.15.121:0/3789425938 conn(0x7fa0480b3580 msgr2=0x7fa0480b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.862+0000 7fa050000640 1 -- 172.21.15.121:0/3789425938 shutdown_connections 2024-09-17T03:38:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.862+0000 7fa050000640 1 -- 172.21.15.121:0/3789425938 wait complete. 2024-09-17T03:38:58.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.864+0000 7fa050000640 1 Processor -- start 2024-09-17T03:38:58.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.864+0000 7fa050000640 1 -- start start 2024-09-17T03:38:58.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa050000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa030004d40 0x7fa048155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:58.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa050000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0480ce1e0 0x7fa0481594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:58.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa050000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0480b1450 0x7fa0480b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:58.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa050000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa04806db90 con 0x7fa0480b1450 2024-09-17T03:38:58.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa050000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa04806da10 con 0x7fa0480ce1e0 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa050000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0481611d0 con 0x7fa030004d40 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0480b1450 0x7fa0480b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0480b1450 0x7fa0480b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52240/0 (socket says 172.21.15.121:52240) 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04e000640 1 -- 172.21.15.121:0/3232064827 learned_addr learned my addr 172.21.15.121:0/3232064827 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04d600640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa030004d40 0x7fa048155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04cc00640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0480ce1e0 0x7fa0481594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04e000640 1 -- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa030004d40 msgr2=0x7fa048155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04e000640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa030004d40 0x7fa048155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04e000640 1 -- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0480ce1e0 msgr2=0x7fa0481594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04e000640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0480ce1e0 0x7fa0481594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04e000640 1 -- 172.21.15.121:0/3232064827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0480b1da0 con 0x7fa0480b1450 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04cc00640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0480ce1e0 0x7fa0481594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.866+0000 7fa04d600640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa030004d40 0x7fa048155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:58.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.867+0000 7fa04e000640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0480b1450 0x7fa0480b1860 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa040009ed0 tx=0x7fa040033dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:58.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.867+0000 7fa045600640 1 -- 172.21.15.121:0/3232064827 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040043070 con 0x7fa0480b1450 2024-09-17T03:38:58.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.867+0000 7fa045600640 1 -- 172.21.15.121:0/3232064827 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa040003b70 con 0x7fa0480b1450 2024-09-17T03:38:58.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.867+0000 7fa045600640 1 -- 172.21.15.121:0/3232064827 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040038040 con 0x7fa0480b1450 2024-09-17T03:38:58.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.867+0000 7fa050000640 1 -- 172.21.15.121:0/3232064827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0481f8d80 con 0x7fa0480b1450 2024-09-17T03:38:58.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.867+0000 7fa050000640 1 -- 172.21.15.121:0/3232064827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0481f9340 con 0x7fa0480b1450 2024-09-17T03:38:58.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.868+0000 7fa050000640 1 -- 172.21.15.121:0/3232064827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0481f8af0 con 0x7fa0480b1450 2024-09-17T03:38:58.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.869+0000 7fa045600640 1 -- 172.21.15.121:0/3232064827 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa040004030 con 0x7fa0480b1450 2024-09-17T03:38:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.871+0000 7fa045600640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa028078bc0 0x7fa02807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.871+0000 7fa045600640 1 -- 172.21.15.121:0/3232064827 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6001+0+0 (secure 0 0 0) 0x7fa0400bb120 con 0x7fa0480b1450 2024-09-17T03:38:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.871+0000 7fa04d600640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa028078bc0 0x7fa02807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.872+0000 7fa04d600640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa028078bc0 0x7fa02807b0d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009c50 tx=0x7fa03c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:58.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:58.876+0000 7fa045600640 1 -- 172.21.15.121:0/3232064827 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0480b1da0 con 0x7fa0480b1450 2024-09-17T03:38:59.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.094+0000 7fa050000640 1 -- 172.21.15.121:0/3232064827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa04815cc10 con 0x7fa0480b1450 2024-09-17T03:38:59.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.610+0000 7fa045600640 1 -- 172.21.15.121:0/3232064827 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v46) ==== 174+0+0 (secure 0 0 0) 0x7fa040082d50 con 0x7fa0480b1450 2024-09-17T03:38:59.610 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 11 and data pool 12 2024-09-17T03:38:59.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.615+0000 7fa050000640 1 -- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa028078bc0 msgr2=0x7fa02807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:59.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.615+0000 7fa050000640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa028078bc0 0x7fa02807b0d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009c50 tx=0x7fa03c005f90 comp rx=0 tx=0).stop 2024-09-17T03:38:59.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.615+0000 7fa050000640 1 -- 172.21.15.121:0/3232064827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0480b1450 msgr2=0x7fa0480b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:59.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.615+0000 7fa050000640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0480b1450 0x7fa0480b1860 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa040009ed0 tx=0x7fa040033dc0 comp rx=0 tx=0).stop 2024-09-17T03:38:59.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.616+0000 7fa050000640 1 -- 172.21.15.121:0/3232064827 shutdown_connections 2024-09-17T03:38:59.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.616+0000 7fa050000640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa028078bc0 0x7fa02807b0d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:59.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.616+0000 7fa050000640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0480b1450 0x7fa0480b1860 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:59.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.616+0000 7fa050000640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0480ce1e0 0x7fa0481594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:59.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.616+0000 7fa050000640 1 --2- 172.21.15.121:0/3232064827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa030004d40 0x7fa048155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:59.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.616+0000 7fa050000640 1 -- 172.21.15.121:0/3232064827 >> 172.21.15.121:0/3232064827 conn(0x7fa0480b3580 msgr2=0x7fa04815a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:59.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.617+0000 7fa050000640 1 -- 172.21.15.121:0/3232064827 shutdown_connections 2024-09-17T03:38:59.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.618+0000 7fa050000640 1 -- 172.21.15.121:0/3232064827 wait complete. 2024-09-17T03:38:59.657 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:59.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.878+0000 7fc017600640 1 -- 172.21.15.121:0/2557220754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0100d0cc0 msgr2=0x7fc01015cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:59.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.878+0000 7fc017600640 1 --2- 172.21.15.121:0/2557220754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0100d0cc0 0x7fc01015cc10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc0100cdc20 tx=0x7fc00802a9a0 comp rx=0 tx=0).stop 2024-09-17T03:38:59.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.878+0000 7fc017600640 1 -- 172.21.15.121:0/2557220754 shutdown_connections 2024-09-17T03:38:59.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.878+0000 7fc017600640 1 --2- 172.21.15.121:0/2557220754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0100d0cc0 0x7fc01015cc10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:59.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.878+0000 7fc017600640 1 --2- 172.21.15.121:0/2557220754 >> v2:172.21.15.176:3300/0 conn(0x7fc01015a3e0 0x7fc01006d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:59.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.878+0000 7fc017600640 1 -- 172.21.15.121:0/2557220754 >> 172.21.15.121:0/2557220754 conn(0x7fc0100b3580 msgr2=0x7fc0100b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:59.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.878+0000 7fc017600640 1 -- 172.21.15.121:0/2557220754 shutdown_connections 2024-09-17T03:38:59.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.878+0000 7fc017600640 1 -- 172.21.15.121:0/2557220754 wait complete. 2024-09-17T03:38:59.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.881+0000 7fc017600640 1 Processor -- start 2024-09-17T03:38:59.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.881+0000 7fc017600640 1 -- start start 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.882+0000 7fc017600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01006ddc0 0x7fc0100b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.882+0000 7fc017600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01015a3e0 0x7fc010155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.882+0000 7fc017600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0100cf980 0x7fc0100745b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.882+0000 7fc017600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc01015d4e0 con 0x7fc0100cf980 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.882+0000 7fc017600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc01015d360 con 0x7fc01006ddc0 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.882+0000 7fc017600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc01015d660 con 0x7fc01015a3e0 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc015600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0100cf980 0x7fc0100745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc015600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0100cf980 0x7fc0100745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52260/0 (socket says 172.21.15.121:52260) 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc015600640 1 -- 172.21.15.121:0/3040656405 learned_addr learned my addr 172.21.15.121:0/3040656405 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc014c00640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01006ddc0 0x7fc0100b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:59.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc00fe00640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01015a3e0 0x7fc010155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:59.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc015600640 1 -- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01015a3e0 msgr2=0x7fc010155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:59.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc015600640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01015a3e0 0x7fc010155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:59.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc015600640 1 -- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01006ddc0 msgr2=0x7fc0100b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:59.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc015600640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01006ddc0 0x7fc0100b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:59.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc015600640 1 -- 172.21.15.121:0/3040656405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0100c7220 con 0x7fc0100cf980 2024-09-17T03:38:59.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.883+0000 7fc015600640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0100cf980 0x7fc0100745b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc00802af90 tx=0x7fc008003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:59.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.884+0000 7fc00cc00640 1 -- 172.21.15.121:0/3040656405 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008033050 con 0x7fc0100cf980 2024-09-17T03:38:59.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.884+0000 7fc00cc00640 1 -- 172.21.15.121:0/3040656405 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc008004450 con 0x7fc0100cf980 2024-09-17T03:38:59.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.884+0000 7fc00cc00640 1 -- 172.21.15.121:0/3040656405 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008038450 con 0x7fc0100cf980 2024-09-17T03:38:59.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.884+0000 7fc017600640 1 -- 172.21.15.121:0/3040656405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0100cf440 con 0x7fc0100cf980 2024-09-17T03:38:59.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.884+0000 7fc017600640 1 -- 172.21.15.121:0/3040656405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc01015ee90 con 0x7fc0100cf980 2024-09-17T03:38:59.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.885+0000 7fc017600640 1 -- 172.21.15.121:0/3040656405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01015db10 con 0x7fc0100cf980 2024-09-17T03:38:59.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.886+0000 7fc00cc00640 1 -- 172.21.15.121:0/3040656405 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc008036070 con 0x7fc0100cf980 2024-09-17T03:38:59.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.887+0000 7fc00cc00640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbff0078b90 0x7fbff007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:59.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.887+0000 7fc00cc00640 1 -- 172.21.15.121:0/3040656405 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fc0080bc060 con 0x7fc0100cf980 2024-09-17T03:38:59.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.887+0000 7fc014c00640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbff0078b90 0x7fbff007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:59.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.888+0000 7fc014c00640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbff0078b90 0x7fbff007b0a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc004009b30 tx=0x7fc004005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:59.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:38:59.892+0000 7fc00cc00640 1 -- 172.21.15.121:0/3040656405 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0080098b0 con 0x7fc0100cf980 2024-09-17T03:39:00.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.077+0000 7fc017600640 1 -- 172.21.15.121:0/3040656405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc01015fe50 con 0x7fc0100cf980 2024-09-17T03:39:00.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.079+0000 7fc00cc00640 1 -- 172.21.15.121:0/3040656405 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17018 (secure 0 0 0) 0x7fc008084270 con 0x7fc0100cf980 2024-09-17T03:39:00.079 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:00.079 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":75,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:38:59.096016+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:38:57.006752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-17T03:38:58.058455+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:00.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 -- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbff0078b90 msgr2=0x7fbff007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:00.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbff0078b90 0x7fbff007b0a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc004009b30 tx=0x7fc004005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:00.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 -- 172.21.15.121:0/3040656405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0100cf980 msgr2=0x7fc0100745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:00.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0100cf980 0x7fc0100745b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc00802af90 tx=0x7fc008003f70 comp rx=0 tx=0).stop 2024-09-17T03:39:00.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 -- 172.21.15.121:0/3040656405 shutdown_connections 2024-09-17T03:39:00.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbff0078b90 0x7fbff007b0a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0100cf980 0x7fc0100745b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01015a3e0 0x7fc010155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 --2- 172.21.15.121:0/3040656405 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01006ddc0 0x7fc0100b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 -- 172.21.15.121:0/3040656405 >> 172.21.15.121:0/3040656405 conn(0x7fc0100b3580 msgr2=0x7fc01015bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:00.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 -- 172.21.15.121:0/3040656405 shutdown_connections 2024-09-17T03:39:00.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.081+0000 7fc017600640 1 -- 172.21.15.121:0/3040656405 wait complete. 2024-09-17T03:39:00.108 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:00.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.330+0000 7fc8c1400640 1 -- 172.21.15.121:0/2612472726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0b51c0 msgr2=0x7fc8bc160180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:00.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.330+0000 7fc8c1400640 1 --2- 172.21.15.121:0/2612472726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0b51c0 0x7fc8bc160180 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4005fd0 tx=0x7fc8a402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.330+0000 7fc8c1400640 1 -- 172.21.15.121:0/2612472726 shutdown_connections 2024-09-17T03:39:00.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.330+0000 7fc8c1400640 1 --2- 172.21.15.121:0/2612472726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0b51c0 0x7fc8bc160180 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.330+0000 7fc8c1400640 1 --2- 172.21.15.121:0/2612472726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc070810 0x7fc8bc0b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.330+0000 7fc8c1400640 1 -- 172.21.15.121:0/2612472726 >> 172.21.15.121:0/2612472726 conn(0x7fc8bc0b2440 msgr2=0x7fc8bc0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:00.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.330+0000 7fc8c1400640 1 -- 172.21.15.121:0/2612472726 shutdown_connections 2024-09-17T03:39:00.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.331+0000 7fc8c1400640 1 -- 172.21.15.121:0/2612472726 wait complete. 2024-09-17T03:39:00.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.333+0000 7fc8c1400640 1 Processor -- start 2024-09-17T03:39:00.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.333+0000 7fc8c1400640 1 -- start start 2024-09-17T03:39:00.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.334+0000 7fc8c1400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc070810 0x7fc8bc09baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:00.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.334+0000 7fc8c1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0b51c0 0x7fc8bc1f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:00.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.334+0000 7fc8c1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8bc1606c0 0x7fc8bc13bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:00.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.334+0000 7fc8c1400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc0b30b0 con 0x7fc8bc1606c0 2024-09-17T03:39:00.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.334+0000 7fc8c1400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc06f000 con 0x7fc8bc0b51c0 2024-09-17T03:39:00.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.334+0000 7fc8c1400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8bc15d2a0 con 0x7fc8bc070810 2024-09-17T03:39:00.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8c0a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8bc1606c0 0x7fc8bc13bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:00.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8c0a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8bc1606c0 0x7fc8bc13bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52266/0 (socket says 172.21.15.121:52266) 2024-09-17T03:39:00.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8c0a00640 1 -- 172.21.15.121:0/1787877789 learned_addr learned my addr 172.21.15.121:0/1787877789 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:00.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8b3400640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0b51c0 0x7fc8bc1f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:00.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8bbe00640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc070810 0x7fc8bc09baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:00.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8c0a00640 1 -- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc070810 msgr2=0x7fc8bc09baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:00.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8c0a00640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc070810 0x7fc8bc09baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8c0a00640 1 -- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0b51c0 msgr2=0x7fc8bc1f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:00.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8c0a00640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0b51c0 0x7fc8bc1f5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8c0a00640 1 -- 172.21.15.121:0/1787877789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc1f62f0 con 0x7fc8bc1606c0 2024-09-17T03:39:00.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8b3400640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0b51c0 0x7fc8bc1f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:00.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.335+0000 7fc8c0a00640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8bc1606c0 0x7fc8bc13bb90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400c3f0 tx=0x7fc8b400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:00.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.336+0000 7fc8b8c00640 1 -- 172.21.15.121:0/1787877789 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4017070 con 0x7fc8bc1606c0 2024-09-17T03:39:00.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.336+0000 7fc8b8c00640 1 -- 172.21.15.121:0/1787877789 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8b4006d90 con 0x7fc8bc1606c0 2024-09-17T03:39:00.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.336+0000 7fc8c1400640 1 -- 172.21.15.121:0/1787877789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc13c0d0 con 0x7fc8bc1606c0 2024-09-17T03:39:00.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.336+0000 7fc8b8c00640 1 -- 172.21.15.121:0/1787877789 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4007290 con 0x7fc8bc1606c0 2024-09-17T03:39:00.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.336+0000 7fc8c1400640 1 -- 172.21.15.121:0/1787877789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc0ccd20 con 0x7fc8bc1606c0 2024-09-17T03:39:00.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.337+0000 7fc8c1400640 1 -- 172.21.15.121:0/1787877789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8bc0b1260 con 0x7fc8bc1606c0 2024-09-17T03:39:00.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.338+0000 7fc8b8c00640 1 -- 172.21.15.121:0/1787877789 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc8b401a070 con 0x7fc8bc1606c0 2024-09-17T03:39:00.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.339+0000 7fc8b8c00640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc898078b90 0x7fc89807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:00.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.339+0000 7fc8b8c00640 1 -- 172.21.15.121:0/1787877789 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fc8b409a110 con 0x7fc8bc1606c0 2024-09-17T03:39:00.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.340+0000 7fc8bbe00640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc898078b90 0x7fc89807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:00.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.340+0000 7fc8bbe00640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc898078b90 0x7fc89807b0a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009ac0 tx=0x7fc8ac005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:00.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.344+0000 7fc8b8c00640 1 -- 172.21.15.121:0/1787877789 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc8bc13c0d0 con 0x7fc8bc1606c0 2024-09-17T03:39:00.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.527+0000 7fc8c1400640 1 -- 172.21.15.121:0/1787877789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8bc0adc10 con 0x7fc8bc1606c0 2024-09-17T03:39:00.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.529+0000 7fc8b8c00640 1 -- 172.21.15.121:0/1787877789 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17018 (secure 0 0 0) 0x7fc8bc1f62f0 con 0x7fc8bc1606c0 2024-09-17T03:39:00.529 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:00.529 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":75,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:38:59.096016+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:38:57.006752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-17T03:38:58.058455+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:00.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 -- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc898078b90 msgr2=0x7fc89807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:00.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc898078b90 0x7fc89807b0a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009ac0 tx=0x7fc8ac005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:00.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 -- 172.21.15.121:0/1787877789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8bc1606c0 msgr2=0x7fc8bc13bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:00.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8bc1606c0 0x7fc8bc13bb90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400c3f0 tx=0x7fc8b400c8b0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 -- 172.21.15.121:0/1787877789 shutdown_connections 2024-09-17T03:39:00.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc898078b90 0x7fc89807b0a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8bc1606c0 0x7fc8bc13bb90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8bc0b51c0 0x7fc8bc1f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 --2- 172.21.15.121:0/1787877789 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8bc070810 0x7fc8bc09baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 -- 172.21.15.121:0/1787877789 >> 172.21.15.121:0/1787877789 conn(0x7fc8bc0b2440 msgr2=0x7fc8bc0acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:00.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 -- 172.21.15.121:0/1787877789 shutdown_connections 2024-09-17T03:39:00.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.531+0000 7fc8c1400640 1 -- 172.21.15.121:0/1787877789 wait complete. 2024-09-17T03:39:00.554 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:39:00.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.781+0000 7ff4f2000640 1 -- 172.21.15.121:0/525365236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4d0003a30 msgr2=0x7ff4d0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:00.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.781+0000 7ff4f2000640 1 --2- 172.21.15.121:0/525365236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4d0003a30 0x7ff4d0003ea0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c260 tx=0x7ff4d0005830 comp rx=0 tx=0).stop 2024-09-17T03:39:00.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.781+0000 7ff4f1600640 1 -- 172.21.15.121:0/525365236 reap_dead start 2024-09-17T03:39:00.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.781+0000 7ff4f2000640 1 -- 172.21.15.121:0/525365236 shutdown_connections 2024-09-17T03:39:00.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.781+0000 7ff4f2000640 1 -- 172.21.15.121:0/525365236 >> 172.21.15.121:0/525365236 conn(0x7ff4ec0d07f0 msgr2=0x7ff4ec0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:00.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.781+0000 7ff4f2000640 1 -- 172.21.15.121:0/525365236 shutdown_connections 2024-09-17T03:39:00.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.781+0000 7ff4f2000640 1 -- 172.21.15.121:0/525365236 wait complete. 2024-09-17T03:39:00.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.783+0000 7ff4f2000640 1 Processor -- start 2024-09-17T03:39:00.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.783+0000 7ff4f2000640 1 -- start start 2024-09-17T03:39:00.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4f2000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4d0003a30 0x7ff4ec0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:00.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4f2000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ec1f4f30 0x7ff4ec14d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:00.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4f2000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4ec14aa00 0x7ff4ec160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:00.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4f2000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec06daa0 con 0x7ff4ec14aa00 2024-09-17T03:39:00.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4f2000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec06d920 con 0x7ff4d0003a30 2024-09-17T03:39:00.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4f2000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec06dc20 con 0x7ff4ec1f4f30 2024-09-17T03:39:00.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4f1600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4ec14aa00 0x7ff4ec160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:00.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4f1600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4ec14aa00 0x7ff4ec160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52270/0 (socket says 172.21.15.121:52270) 2024-09-17T03:39:00.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4f1600640 1 -- 172.21.15.121:0/3569642565 learned_addr learned my addr 172.21.15.121:0/3569642565 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4e3e00640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ec1f4f30 0x7ff4ec14d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.785+0000 7ff4f0c00640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4d0003a30 0x7ff4ec0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4f1600640 1 -- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ec1f4f30 msgr2=0x7ff4ec14d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4f1600640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ec1f4f30 0x7ff4ec14d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4f1600640 1 -- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4d0003a30 msgr2=0x7ff4ec0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4f1600640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4d0003a30 0x7ff4ec0ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4f1600640 1 -- 172.21.15.121:0/3569642565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec1f5980 con 0x7ff4ec14aa00 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4f1600640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4ec14aa00 0x7ff4ec160340 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec1610d0 tx=0x7ff4e4011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4e9600640 1 -- 172.21.15.121:0/3569642565 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4003e40 con 0x7ff4ec14aa00 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4e9600640 1 -- 172.21.15.121:0/3569642565 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4e4004b20 con 0x7ff4ec14aa00 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4f2000640 1 -- 172.21.15.121:0/3569642565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec1f5c60 con 0x7ff4ec14aa00 2024-09-17T03:39:00.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4e9600640 1 -- 172.21.15.121:0/3569642565 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400f950 con 0x7ff4ec14aa00 2024-09-17T03:39:00.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.786+0000 7ff4f2000640 1 -- 172.21.15.121:0/3569642565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec14cef0 con 0x7ff4ec14aa00 2024-09-17T03:39:00.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.787+0000 7ff4f2000640 1 -- 172.21.15.121:0/3569642565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4ec06e1b0 con 0x7ff4ec14aa00 2024-09-17T03:39:00.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.789+0000 7ff4e9600640 1 -- 172.21.15.121:0/3569642565 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4e400faf0 con 0x7ff4ec14aa00 2024-09-17T03:39:00.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.790+0000 7ff4e9600640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff4c8078bc0 0x7ff4c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:00.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.790+0000 7ff4e9600640 1 -- 172.21.15.121:0/3569642565 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7ff4e409b190 con 0x7ff4ec14aa00 2024-09-17T03:39:00.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.790+0000 7ff4f0c00640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff4c8078bc0 0x7ff4c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:00.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.791+0000 7ff4f0c00640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff4c8078bc0 0x7ff4c807b0d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc033000 tx=0x7ff4dc02d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:00.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:00.794+0000 7ff4e9600640 1 -- 172.21.15.121:0/3569642565 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff4e4062de0 con 0x7ff4ec14aa00 2024-09-17T03:39:01.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.014+0000 7ff4f2000640 1 -- 172.21.15.121:0/3569642565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff4ec1586a0 con 0x7ff4ec14aa00 2024-09-17T03:39:01.578 INFO:tasks.ceph.mds.c.smithi121.stderr:2024-09-17T03:39:01.578+0000 7efe2c400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:39:01.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.619+0000 7ff4e9600640 1 -- 172.21.15.121:0/3569642565 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) ==== 118+0+0 (secure 0 0 0) 0x7ff4e4067810 con 0x7ff4ec14aa00 2024-09-17T03:39:01.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.622+0000 7ff4f2000640 1 -- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff4c8078bc0 msgr2=0x7ff4c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:01.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.622+0000 7ff4f2000640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff4c8078bc0 0x7ff4c807b0d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc033000 tx=0x7ff4dc02d000 comp rx=0 tx=0).stop 2024-09-17T03:39:01.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.622+0000 7ff4f2000640 1 -- 172.21.15.121:0/3569642565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4ec14aa00 msgr2=0x7ff4ec160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:01.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.622+0000 7ff4f2000640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4ec14aa00 0x7ff4ec160340 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec1610d0 tx=0x7ff4e4011e80 comp rx=0 tx=0).stop 2024-09-17T03:39:01.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.622+0000 7ff4f2000640 1 -- 172.21.15.121:0/3569642565 shutdown_connections 2024-09-17T03:39:01.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.622+0000 7ff4f2000640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff4c8078bc0 0x7ff4c807b0d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:01.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.622+0000 7ff4f2000640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4ec14aa00 0x7ff4ec160340 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:01.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.622+0000 7ff4f2000640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4ec1f4f30 0x7ff4ec14d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:01.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.622+0000 7ff4f2000640 1 --2- 172.21.15.121:0/3569642565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4d0003a30 0x7ff4ec0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:01.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.622+0000 7ff4f2000640 1 -- 172.21.15.121:0/3569642565 >> 172.21.15.121:0/3569642565 conn(0x7ff4ec0d07f0 msgr2=0x7ff4ec15ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:01.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.623+0000 7ff4f2000640 1 -- 172.21.15.121:0/3569642565 shutdown_connections 2024-09-17T03:39:01.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.623+0000 7ff4f2000640 1 -- 172.21.15.121:0/3569642565 wait complete. 2024-09-17T03:39:01.647 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:39:01.647 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:39:01.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.873+0000 7fbf7a400640 1 -- 172.21.15.121:0/1987716464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf58003c10 msgr2=0x7fbf58004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.873+0000 7fbf7a400640 1 --2- 172.21.15.121:0/1987716464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf58003c10 0x7fbf58004060 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbf6400c2e0 tx=0x7fbf58005830 comp rx=0 tx=0).stop 2024-09-17T03:39:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.873+0000 7fbf79a00640 1 -- 172.21.15.121:0/1987716464 reap_dead start 2024-09-17T03:39:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.873+0000 7fbf7a400640 1 -- 172.21.15.121:0/1987716464 shutdown_connections 2024-09-17T03:39:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.873+0000 7fbf7a400640 1 -- 172.21.15.121:0/1987716464 >> 172.21.15.121:0/1987716464 conn(0x7fbf740d07f0 msgr2=0x7fbf740b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.874+0000 7fbf7a400640 1 -- 172.21.15.121:0/1987716464 shutdown_connections 2024-09-17T03:39:01.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.874+0000 7fbf7a400640 1 -- 172.21.15.121:0/1987716464 wait complete. 2024-09-17T03:39:01.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.876+0000 7fbf7a400640 1 Processor -- start 2024-09-17T03:39:01.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.876+0000 7fbf7a400640 1 -- start start 2024-09-17T03:39:01.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.877+0000 7fbf7a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf58003c10 0x7fbf741f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:01.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.877+0000 7fbf7a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf74157f50 0x7fbf741f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:01.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.877+0000 7fbf7a400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf74146790 0x7fbf74146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:01.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.877+0000 7fbf7a400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbf740b3230 con 0x7fbf74146790 2024-09-17T03:39:01.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.877+0000 7fbf7a400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbf740b30b0 con 0x7fbf74157f50 2024-09-17T03:39:01.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.877+0000 7fbf7a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf74073840 con 0x7fbf58003c10 2024-09-17T03:39:01.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.878+0000 7fbf79a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf74146790 0x7fbf74146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:01.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.878+0000 7fbf79a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf74146790 0x7fbf74146ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37992/0 (socket says 172.21.15.121:37992) 2024-09-17T03:39:01.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.878+0000 7fbf79a00640 1 -- 172.21.15.121:0/1362831048 learned_addr learned my addr 172.21.15.121:0/1362831048 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:01.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.878+0000 7fbf79a00640 1 -- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf58003c10 msgr2=0x7fbf741f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:01.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.878+0000 7fbf79a00640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf58003c10 0x7fbf741f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:01.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.878+0000 7fbf79a00640 1 -- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf74157f50 msgr2=0x7fbf741f8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:01.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.878+0000 7fbf79a00640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf74157f50 0x7fbf741f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:01.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.878+0000 7fbf79a00640 1 -- 172.21.15.121:0/1362831048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf741586f0 con 0x7fbf74146790 2024-09-17T03:39:01.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.878+0000 7fbf79a00640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf74146790 0x7fbf74146ba0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c005fd0 tx=0x7fbf6c010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:01.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.878+0000 7fbf71600640 1 -- 172.21.15.121:0/1362831048 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c003970 con 0x7fbf74146790 2024-09-17T03:39:01.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.879+0000 7fbf71600640 1 -- 172.21.15.121:0/1362831048 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf6c015070 con 0x7fbf74146790 2024-09-17T03:39:01.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.879+0000 7fbf7a400640 1 -- 172.21.15.121:0/1362831048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf741589d0 con 0x7fbf74146790 2024-09-17T03:39:01.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.879+0000 7fbf7a400640 1 -- 172.21.15.121:0/1362831048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf74157680 con 0x7fbf74146790 2024-09-17T03:39:01.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.879+0000 7fbf71600640 1 -- 172.21.15.121:0/1362831048 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c021060 con 0x7fbf74146790 2024-09-17T03:39:01.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.880+0000 7fbf7a400640 1 -- 172.21.15.121:0/1362831048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf4c005290 con 0x7fbf74146790 2024-09-17T03:39:01.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.881+0000 7fbf71600640 1 -- 172.21.15.121:0/1362831048 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf6c004030 con 0x7fbf74146790 2024-09-17T03:39:01.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.882+0000 7fbf71600640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbf50078b90 0x7fbf5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:01.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.882+0000 7fbf71600640 1 -- 172.21.15.121:0/1362831048 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fbf6c09bbe0 con 0x7fbf74146790 2024-09-17T03:39:01.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.882+0000 7fbf79000640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbf50078b90 0x7fbf5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:01.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.883+0000 7fbf79000640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbf50078b90 0x7fbf5007b0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbf7406ff30 tx=0x7fbf640019c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:01.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:01.886+0000 7fbf71600640 1 -- 172.21.15.121:0/1362831048 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf6c063e90 con 0x7fbf74146790 2024-09-17T03:39:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.106+0000 7fbf7a400640 1 -- 172.21.15.121:0/1362831048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbf4c005580 con 0x7fbf74146790 2024-09-17T03:39:02.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.622+0000 7fbf71600640 1 -- 172.21.15.121:0/1362831048 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) ==== 122+0+0 (secure 0 0 0) 0x7fbf6c003e40 con 0x7fbf74146790 2024-09-17T03:39:02.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.624+0000 7fbf7a400640 1 -- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbf50078b90 msgr2=0x7fbf5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:02.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.624+0000 7fbf7a400640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbf50078b90 0x7fbf5007b0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbf7406ff30 tx=0x7fbf640019c0 comp rx=0 tx=0).stop 2024-09-17T03:39:02.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.624+0000 7fbf7a400640 1 -- 172.21.15.121:0/1362831048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf74146790 msgr2=0x7fbf74146ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:02.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.624+0000 7fbf7a400640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf74146790 0x7fbf74146ba0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c005fd0 tx=0x7fbf6c010f40 comp rx=0 tx=0).stop 2024-09-17T03:39:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.624+0000 7fbf7a400640 1 -- 172.21.15.121:0/1362831048 shutdown_connections 2024-09-17T03:39:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.624+0000 7fbf7a400640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbf50078b90 0x7fbf5007b0a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.624+0000 7fbf7a400640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf74146790 0x7fbf74146ba0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.624+0000 7fbf7a400640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf74157f50 0x7fbf741f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.624+0000 7fbf7a400640 1 --2- 172.21.15.121:0/1362831048 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf58003c10 0x7fbf741f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.624+0000 7fbf7a400640 1 -- 172.21.15.121:0/1362831048 >> 172.21.15.121:0/1362831048 conn(0x7fbf740d07f0 msgr2=0x7fbf74072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.625+0000 7fbf7a400640 1 -- 172.21.15.121:0/1362831048 shutdown_connections 2024-09-17T03:39:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.625+0000 7fbf7a400640 1 -- 172.21.15.121:0/1362831048 wait complete. 2024-09-17T03:39:02.648 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:39:02.649 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:02.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.869+0000 7f52a6e00640 1 -- 172.21.15.121:0/32356076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52a015b040 msgr2=0x7f52a00cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:02.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.869+0000 7f52a6e00640 1 --2- 172.21.15.121:0/32356076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52a015b040 0x7f52a00cf980 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5290009830 tx=0x7f529002a520 comp rx=0 tx=0).stop 2024-09-17T03:39:02.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.869+0000 7f52a6e00640 1 -- 172.21.15.121:0/32356076 shutdown_connections 2024-09-17T03:39:02.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.869+0000 7f52a6e00640 1 --2- 172.21.15.121:0/32356076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52a00ad040 0x7f52a006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:02.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.869+0000 7f52a6e00640 1 --2- 172.21.15.121:0/32356076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52a015b040 0x7f52a00cf980 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:02.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.869+0000 7f52a6e00640 1 -- 172.21.15.121:0/32356076 >> 172.21.15.121:0/32356076 conn(0x7f52a00b3580 msgr2=0x7f52a00b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:02.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.869+0000 7f52a6e00640 1 -- 172.21.15.121:0/32356076 shutdown_connections 2024-09-17T03:39:02.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.869+0000 7f52a6e00640 1 -- 172.21.15.121:0/32356076 wait complete. 2024-09-17T03:39:02.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.871+0000 7f52a6e00640 1 Processor -- start 2024-09-17T03:39:02.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.871+0000 7f52a6e00640 1 -- start start 2024-09-17T03:39:02.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f52a6e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52a00ad040 0x7f52a015bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:02.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f52a6e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52a00ad450 0x7f52a00c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:02.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f52a6e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52a015b040 0x7f52a01e8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f52a6e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0070c60 con 0x7f52a00ad040 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f52a6e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f52a006dc00 con 0x7f52a015b040 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f52a6e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f52a015c850 con 0x7f52a00ad450 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f529fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52a00ad040 0x7f52a015bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f529fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52a00ad040 0x7f52a015bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37998/0 (socket says 172.21.15.121:37998) 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f529fe00640 1 -- 172.21.15.121:0/2487824838 learned_addr learned my addr 172.21.15.121:0/2487824838 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f529f400640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52a00ad450 0x7f52a00c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f52a4e00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52a015b040 0x7f52a01e8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.873+0000 7f529fe00640 1 -- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52a00ad450 msgr2=0x7f52a00c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.874+0000 7f529fe00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52a00ad450 0x7f52a00c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.874+0000 7f529fe00640 1 -- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52a015b040 msgr2=0x7f52a01e8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.874+0000 7f529fe00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52a015b040 0x7f52a01e8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.874+0000 7f529fe00640 1 -- 172.21.15.121:0/2487824838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a00c9bb0 con 0x7f52a00ad040 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.874+0000 7f529fe00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52a00ad040 0x7f52a015bfc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f529002ab10 tx=0x7f5290033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:02.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.874+0000 7f5297e00640 1 -- 172.21.15.121:0/2487824838 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290005c90 con 0x7f52a00ad040 2024-09-17T03:39:02.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.874+0000 7f5297e00640 1 -- 172.21.15.121:0/2487824838 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5290031e50 con 0x7f52a00ad040 2024-09-17T03:39:02.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.874+0000 7f52a6e00640 1 -- 172.21.15.121:0/2487824838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a01f9ea0 con 0x7f52a00ad040 2024-09-17T03:39:02.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.874+0000 7f5297e00640 1 -- 172.21.15.121:0/2487824838 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290005260 con 0x7f52a00ad040 2024-09-17T03:39:02.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.874+0000 7f52a6e00640 1 -- 172.21.15.121:0/2487824838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a01f98e0 con 0x7f52a00ad040 2024-09-17T03:39:02.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.875+0000 7f52a6e00640 1 -- 172.21.15.121:0/2487824838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52a006d620 con 0x7f52a00ad040 2024-09-17T03:39:02.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.877+0000 7f5297e00640 1 -- 172.21.15.121:0/2487824838 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5290005400 con 0x7f52a00ad040 2024-09-17T03:39:02.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.878+0000 7f5297e00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5280078b90 0x7f528007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:02.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.878+0000 7f5297e00640 1 -- 172.21.15.121:0/2487824838 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f52900bbe50 con 0x7f52a00ad040 2024-09-17T03:39:02.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.878+0000 7f529f400640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5280078b90 0x7f528007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:02.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.879+0000 7f529f400640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5280078b90 0x7f528007b0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f52a015f650 tx=0x7f528c010040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:02.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:02.882+0000 7f5297e00640 1 -- 172.21.15.121:0/2487824838 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f529003f030 con 0x7f52a00ad040 2024-09-17T03:39:03.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.099+0000 7f52a6e00640 1 -- 172.21.15.121:0/2487824838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52a0159530 con 0x7f52a00ad040 2024-09-17T03:39:03.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.099+0000 7f5297e00640 1 -- 172.21.15.121:0/2487824838 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5234 (secure 0 0 0) 0x7f5290083b40 con 0x7f52a00ad040 2024-09-17T03:39:03.099 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:03.099 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":50,"btime":"2024-09-17T03:39:02:620623+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5513,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3345012856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3345012856},{"type":"v1","addr":"172.21.15.176:6837","nonce":3345012856}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5519,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1489171016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1489171016},{"type":"v1","addr":"172.21.15.121:6835","nonce":1489171016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2870460783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2870460783},{"type":"v1","addr":"172.21.15.176:6836","nonce":2870460783}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:38:59.095974+0000","modified":"2024-09-17T03:39:02.108102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6132":{"gid":6132,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6834/762401029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":762401029},{"type":"v1","addr":"172.21.15.121:6834","nonce":762401029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6132,"qdb_cluster":[6132]},"id":5}]} 2024-09-17T03:39:03.100 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 50 2024-09-17T03:39:03.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 -- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5280078b90 msgr2=0x7f528007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5280078b90 0x7f528007b0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f52a015f650 tx=0x7f528c010040 comp rx=0 tx=0).stop 2024-09-17T03:39:03.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 -- 172.21.15.121:0/2487824838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52a00ad040 msgr2=0x7f52a015bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52a00ad040 0x7f52a015bfc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f529002ab10 tx=0x7f5290033c20 comp rx=0 tx=0).stop 2024-09-17T03:39:03.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 -- 172.21.15.121:0/2487824838 shutdown_connections 2024-09-17T03:39:03.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52a015b040 0x7f52a01e8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52a00ad450 0x7f52a00c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5280078b90 0x7f528007b0a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 --2- 172.21.15.121:0/2487824838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52a00ad040 0x7f52a015bfc0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 -- 172.21.15.121:0/2487824838 >> 172.21.15.121:0/2487824838 conn(0x7f52a00b3580 msgr2=0x7f52a00ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:03.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 -- 172.21.15.121:0/2487824838 shutdown_connections 2024-09-17T03:39:03.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.102+0000 7f52a6e00640 1 -- 172.21.15.121:0/2487824838 wait complete. 2024-09-17T03:39:03.124 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:03.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.344+0000 7f96d3e00640 1 -- 172.21.15.121:0/2935541210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96d41606c0 msgr2=0x7f96d415cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.344+0000 7f96d3e00640 1 --2- 172.21.15.121:0/2935541210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96d41606c0 0x7f96d415cb90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f96d406e9b0 tx=0x7f96cc02aa10 comp rx=0 tx=0).stop 2024-09-17T03:39:03.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.344+0000 7f96d3e00640 1 -- 172.21.15.121:0/2935541210 shutdown_connections 2024-09-17T03:39:03.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.344+0000 7f96d3e00640 1 --2- 172.21.15.121:0/2935541210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96d41606c0 0x7f96d415cb90 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.344+0000 7f96d3e00640 1 --2- 172.21.15.121:0/2935541210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96d40b51c0 0x7f96d4160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.344+0000 7f96d3e00640 1 --2- 172.21.15.121:0/2935541210 >> v2:172.21.15.176:3300/0 conn(0x7f96d4070810 0x7f96d40b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.344+0000 7f96d3e00640 1 -- 172.21.15.121:0/2935541210 >> 172.21.15.121:0/2935541210 conn(0x7f96d40b2440 msgr2=0x7f96d40d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:03.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.344+0000 7f96d3e00640 1 -- 172.21.15.121:0/2935541210 shutdown_connections 2024-09-17T03:39:03.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.344+0000 7f96d3e00640 1 -- 172.21.15.121:0/2935541210 wait complete. 2024-09-17T03:39:03.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.346+0000 7f96d3e00640 1 Processor -- start 2024-09-17T03:39:03.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.346+0000 7f96d3e00640 1 -- start start 2024-09-17T03:39:03.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96d3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d4070810 0x7f96d41f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:03.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96d3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96d40b51c0 0x7f96d4144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:03.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96d3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96d41606c0 0x7f96d41f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:03.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96d3e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f96d40b30b0 con 0x7f96d40b51c0 2024-09-17T03:39:03.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96d3e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f96d406f000 con 0x7f96d4070810 2024-09-17T03:39:03.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96d3e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f96d415d0d0 con 0x7f96d41606c0 2024-09-17T03:39:03.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96ca000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96d40b51c0 0x7f96d4144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:03.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96ca000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96d40b51c0 0x7f96d4144640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38014/0 (socket says 172.21.15.121:38014) 2024-09-17T03:39:03.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96ca000640 1 -- 172.21.15.121:0/3193714386 learned_addr learned my addr 172.21.15.121:0/3193714386 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96d3400640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96d41606c0 0x7f96d41f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.348+0000 7f96d2a00640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d4070810 0x7f96d41f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96ca000640 1 -- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96d41606c0 msgr2=0x7f96d41f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96ca000640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96d41606c0 0x7f96d41f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96ca000640 1 -- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d4070810 msgr2=0x7f96d41f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96ca000640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d4070810 0x7f96d41f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96ca000640 1 -- 172.21.15.121:0/3193714386 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d40cf110 con 0x7f96d40b51c0 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96d2a00640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d4070810 0x7f96d41f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96ca000640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96d40b51c0 0x7f96d4144640 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f96bc00d700 tx=0x7f96bc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96cb400640 1 -- 172.21.15.121:0/3193714386 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc017070 con 0x7f96d40b51c0 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96cb400640 1 -- 172.21.15.121:0/3193714386 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96bc005310 con 0x7f96d40b51c0 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96d3e00640 1 -- 172.21.15.121:0/3193714386 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d40ce350 con 0x7f96d40b51c0 2024-09-17T03:39:03.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96cb400640 1 -- 172.21.15.121:0/3193714386 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc009820 con 0x7f96d40b51c0 2024-09-17T03:39:03.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.349+0000 7f96d3e00640 1 -- 172.21.15.121:0/3193714386 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d40ce910 con 0x7f96d40b51c0 2024-09-17T03:39:03.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.350+0000 7f96d3e00640 1 -- 172.21.15.121:0/3193714386 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d4160180 con 0x7f96d40b51c0 2024-09-17T03:39:03.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.351+0000 7f96cb400640 1 -- 172.21.15.121:0/3193714386 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96bc0099c0 con 0x7f96d40b51c0 2024-09-17T03:39:03.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.352+0000 7f96cb400640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f96b0078b90 0x7f96b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:03.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.352+0000 7f96cb400640 1 -- 172.21.15.121:0/3193714386 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f96bc09afd0 con 0x7f96d40b51c0 2024-09-17T03:39:03.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.353+0000 7f96d2a00640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f96b0078b90 0x7f96b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:03.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.354+0000 7f96d2a00640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f96b0078b90 0x7f96b007b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f96c400bb40 tx=0x7f96c4005e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:03.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.357+0000 7f96cb400640 1 -- 172.21.15.121:0/3193714386 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f96bc062b90 con 0x7f96d40b51c0 2024-09-17T03:39:03.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.541+0000 7f96d3e00640 1 -- 172.21.15.121:0/3193714386 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96d409d570 con 0x7f96d40b51c0 2024-09-17T03:39:03.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.542+0000 7f96cb400640 1 -- 172.21.15.121:0/3193714386 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17005 (secure 0 0 0) 0x7f96bc0675c0 con 0x7f96d40b51c0 2024-09-17T03:39:03.542 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:03.542 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":76,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:00.607362+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:38:57.006752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-17T03:38:58.058455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.544+0000 7f96d3e00640 1 -- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f96b0078b90 msgr2=0x7f96b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.544+0000 7f96d3e00640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f96b0078b90 0x7f96b007b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f96c400bb40 tx=0x7f96c4005e70 comp rx=0 tx=0).stop 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.544+0000 7f96d3e00640 1 -- 172.21.15.121:0/3193714386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96d40b51c0 msgr2=0x7f96d4144640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.544+0000 7f96d3e00640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96d40b51c0 0x7f96d4144640 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f96bc00d700 tx=0x7f96bc00dbc0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.544+0000 7f96d3e00640 1 -- 172.21.15.121:0/3193714386 shutdown_connections 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.545+0000 7f96d3e00640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96d41606c0 0x7f96d41f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.545+0000 7f96d3e00640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f96b0078b90 0x7f96b007b0a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.545+0000 7f96d3e00640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96d40b51c0 0x7f96d4144640 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.545+0000 7f96d3e00640 1 --2- 172.21.15.121:0/3193714386 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96d4070810 0x7f96d41f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.545+0000 7f96d3e00640 1 -- 172.21.15.121:0/3193714386 >> 172.21.15.121:0/3193714386 conn(0x7f96d40b2440 msgr2=0x7f96d415bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:03.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.545+0000 7f96d3e00640 1 -- 172.21.15.121:0/3193714386 shutdown_connections 2024-09-17T03:39:03.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.545+0000 7f96d3e00640 1 -- 172.21.15.121:0/3193714386 wait complete. 2024-09-17T03:39:03.567 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:39:03.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:39:03.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.788+0000 7f90eee00640 1 -- 172.21.15.121:0/49410170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e806d7c0 msgr2=0x7f90e80b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.788+0000 7f90eee00640 1 --2- 172.21.15.121:0/49410170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e806d7c0 0x7f90e80b7970 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f90e808d800 tx=0x7f90dc02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.788+0000 7f90eee00640 1 -- 172.21.15.121:0/49410170 shutdown_connections 2024-09-17T03:39:03.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.788+0000 7f90eee00640 1 --2- 172.21.15.121:0/49410170 >> v2:172.21.15.176:3300/0 conn(0x7f90e80b7eb0 0x7f90e80d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.788+0000 7f90eee00640 1 --2- 172.21.15.121:0/49410170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e806d7c0 0x7f90e80b7970 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.788+0000 7f90eee00640 1 -- 172.21.15.121:0/49410170 >> 172.21.15.121:0/49410170 conn(0x7f90e80d1750 msgr2=0x7f90e80b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:03.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.788+0000 7f90eee00640 1 -- 172.21.15.121:0/49410170 shutdown_connections 2024-09-17T03:39:03.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.788+0000 7f90eee00640 1 -- 172.21.15.121:0/49410170 wait complete. 2024-09-17T03:39:03.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.790+0000 7f90eee00640 1 Processor -- start 2024-09-17T03:39:03.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.790+0000 7f90eee00640 1 -- start start 2024-09-17T03:39:03.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90eee00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e806d7c0 0x7f90e81f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:03.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90eee00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90e80b7eb0 0x7f90e80cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:03.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90eee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e80d3510 0x7f90e80cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:03.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90eee00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f90e815eac0 con 0x7f90e806d7c0 2024-09-17T03:39:03.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90eee00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f90e806e4d0 con 0x7f90e80b7eb0 2024-09-17T03:39:03.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90eee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f90e815ec40 con 0x7f90e80d3510 2024-09-17T03:39:03.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90eda00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e806d7c0 0x7f90e81f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:03.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90eda00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e806d7c0 0x7f90e81f5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38038/0 (socket says 172.21.15.121:38038) 2024-09-17T03:39:03.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90eda00640 1 -- 172.21.15.121:0/3435312804 learned_addr learned my addr 172.21.15.121:0/3435312804 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:03.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90ed000640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90e80b7eb0 0x7f90e80cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.792+0000 7f90ee400640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e80d3510 0x7f90e80cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90eda00640 1 -- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e80d3510 msgr2=0x7f90e80cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90eda00640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e80d3510 0x7f90e80cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90eda00640 1 -- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90e80b7eb0 msgr2=0x7f90e80cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90eda00640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90e80b7eb0 0x7f90e80cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90eda00640 1 -- 172.21.15.121:0/3435312804 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e81619c0 con 0x7f90e806d7c0 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90ee400640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e80d3510 0x7f90e80cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90eda00640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e806d7c0 0x7f90e81f5470 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f90dc034040 tx=0x7f90dc003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90e5600640 1 -- 172.21.15.121:0/3435312804 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc03e030 con 0x7f90e806d7c0 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90e5600640 1 -- 172.21.15.121:0/3435312804 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90dc003e00 con 0x7f90e806d7c0 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90eee00640 1 -- 172.21.15.121:0/3435312804 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e81580d0 con 0x7f90e806d7c0 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90e5600640 1 -- 172.21.15.121:0/3435312804 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc035040 con 0x7f90e806d7c0 2024-09-17T03:39:03.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.793+0000 7f90eee00640 1 -- 172.21.15.121:0/3435312804 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e8161220 con 0x7f90e806d7c0 2024-09-17T03:39:03.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.794+0000 7f90eee00640 1 -- 172.21.15.121:0/3435312804 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e80cfd60 con 0x7f90e806d7c0 2024-09-17T03:39:03.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.796+0000 7f90e5600640 1 -- 172.21.15.121:0/3435312804 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90dc041030 con 0x7f90e806d7c0 2024-09-17T03:39:03.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.797+0000 7f90e5600640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90c8078b90 0x7f90c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:03.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.797+0000 7f90e5600640 1 -- 172.21.15.121:0/3435312804 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f90dc0bb7b0 con 0x7f90e806d7c0 2024-09-17T03:39:03.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.798+0000 7f90ed000640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90c8078b90 0x7f90c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:03.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.798+0000 7f90ed000640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90c8078b90 0x7f90c807b0a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f90d4005fd0 tx=0x7f90d4005850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:03.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.802+0000 7f90e5600640 1 -- 172.21.15.121:0/3435312804 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f90dc083a50 con 0x7f90e806d7c0 2024-09-17T03:39:03.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.979+0000 7f90eee00640 1 -- 172.21.15.121:0/3435312804 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90e80d0080 con 0x7f90c8078b90 2024-09-17T03:39:03.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.985+0000 7f90e5600640 1 -- 172.21.15.121:0/3435312804 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252055 (secure 0 0 0) 0x7f90e80d0080 con 0x7f90c8078b90 2024-09-17T03:39:03.988 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:03.989 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.989+0000 7f90eee00640 1 -- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90c8078b90 msgr2=0x7f90c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.989+0000 7f90eee00640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90c8078b90 0x7f90c807b0a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f90d4005fd0 tx=0x7f90d4005850 comp rx=0 tx=0).stop 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.989+0000 7f90eee00640 1 -- 172.21.15.121:0/3435312804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e806d7c0 msgr2=0x7f90e81f5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.989+0000 7f90eee00640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e806d7c0 0x7f90e81f5470 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f90dc034040 tx=0x7f90dc003910 comp rx=0 tx=0).stop 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.989+0000 7f90eee00640 1 -- 172.21.15.121:0/3435312804 shutdown_connections 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.989+0000 7f90eee00640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e80d3510 0x7f90e80cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.989+0000 7f90eee00640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90e80b7eb0 0x7f90e80cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.989+0000 7f90eee00640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90c8078b90 0x7f90c807b0a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.989+0000 7f90eee00640 1 --2- 172.21.15.121:0/3435312804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e806d7c0 0x7f90e81f5470 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.989+0000 7f90eee00640 1 -- 172.21.15.121:0/3435312804 >> 172.21.15.121:0/3435312804 conn(0x7f90e80d1750 msgr2=0x7f90e80d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:03.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.990+0000 7f90eee00640 1 -- 172.21.15.121:0/3435312804 shutdown_connections 2024-09-17T03:39:03.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:03.990+0000 7f90eee00640 1 -- 172.21.15.121:0/3435312804 wait complete. 2024-09-17T03:39:04.014 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-17T03:39:03.332809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253716,"kb_used_data":8340,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721004,"statfs":{"total":773094113280,"available":772834308096,"internally_reserved":0,"allocated":8540160,"data_stored":4479048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.742829"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.627043+0000","last_change":"2024-09-17T03:38:59.622728+0000","last_active":"2024-09-17T03:38:59.627043+0000","last_peered":"2024-09-17T03:38:59.627043+0000","last_clean":"2024-09-17T03:38:59.627043+0000","last_became_active":"2024-09-17T03:38:59.622444+0000","last_became_peered":"2024-09-17T03:38:59.622444+0000","last_unstale":"2024-09-17T03:38:59.627043+0000","last_undegraded":"2024-09-17T03:38:59.627043+0000","last_fullsized":"2024-09-17T03:38:59.627043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:26.316277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.636852+0000","last_change":"2024-09-17T03:38:59.626835+0000","last_active":"2024-09-17T03:38:59.636852+0000","last_peered":"2024-09-17T03:38:59.636852+0000","last_clean":"2024-09-17T03:38:59.636852+0000","last_became_active":"2024-09-17T03:38:59.625346+0000","last_became_peered":"2024-09-17T03:38:59.625346+0000","last_unstale":"2024-09-17T03:38:59.636852+0000","last_undegraded":"2024-09-17T03:38:59.636852+0000","last_fullsized":"2024-09-17T03:38:59.636852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:31.729920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640122+0000","last_change":"2024-09-17T03:38:59.632722+0000","last_active":"2024-09-17T03:38:59.640122+0000","last_peered":"2024-09-17T03:38:59.640122+0000","last_clean":"2024-09-17T03:38:59.640122+0000","last_became_active":"2024-09-17T03:38:59.632264+0000","last_became_peered":"2024-09-17T03:38:59.632264+0000","last_unstale":"2024-09-17T03:38:59.640122+0000","last_undegraded":"2024-09-17T03:38:59.640122+0000","last_fullsized":"2024-09-17T03:38:59.640122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:54.295364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628375+0000","last_change":"2024-09-17T03:38:59.621580+0000","last_active":"2024-09-17T03:38:59.628375+0000","last_peered":"2024-09-17T03:38:59.628375+0000","last_clean":"2024-09-17T03:38:59.628375+0000","last_became_active":"2024-09-17T03:38:59.621282+0000","last_became_peered":"2024-09-17T03:38:59.621282+0000","last_unstale":"2024-09-17T03:38:59.628375+0000","last_undegraded":"2024-09-17T03:38:59.628375+0000","last_fullsized":"2024-09-17T03:38:59.628375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:17.489683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.630154+0000","last_change":"2024-09-17T03:38:59.623113+0000","last_active":"2024-09-17T03:38:59.630154+0000","last_peered":"2024-09-17T03:38:59.630154+0000","last_clean":"2024-09-17T03:38:59.630154+0000","last_became_active":"2024-09-17T03:38:59.622830+0000","last_became_peered":"2024-09-17T03:38:59.622830+0000","last_unstale":"2024-09-17T03:38:59.630154+0000","last_undegraded":"2024-09-17T03:38:59.630154+0000","last_fullsized":"2024-09-17T03:38:59.630154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:05.284840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.638176+0000","last_change":"2024-09-17T03:38:59.630626+0000","last_active":"2024-09-17T03:38:59.638176+0000","last_peered":"2024-09-17T03:38:59.638176+0000","last_clean":"2024-09-17T03:38:59.638176+0000","last_became_active":"2024-09-17T03:38:59.630257+0000","last_became_peered":"2024-09-17T03:38:59.630257+0000","last_unstale":"2024-09-17T03:38:59.638176+0000","last_undegraded":"2024-09-17T03:38:59.638176+0000","last_fullsized":"2024-09-17T03:38:59.638176+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:35.449904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.620718+0000","last_change":"2024-09-17T03:38:59.614311+0000","last_active":"2024-09-17T03:38:59.620718+0000","last_peered":"2024-09-17T03:38:59.620718+0000","last_clean":"2024-09-17T03:38:59.620718+0000","last_became_active":"2024-09-17T03:38:59.614035+0000","last_became_peered":"2024-09-17T03:38:59.614035+0000","last_unstale":"2024-09-17T03:38:59.620718+0000","last_undegraded":"2024-09-17T03:38:59.620718+0000","last_fullsized":"2024-09-17T03:38:59.620718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:57.352693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.618471+0000","last_change":"2024-09-17T03:38:59.618155+0000","last_active":"2024-09-17T03:39:00.618471+0000","last_peered":"2024-09-17T03:39:00.618471+0000","last_clean":"2024-09-17T03:39:00.618471+0000","last_became_active":"2024-09-17T03:38:59.617827+0000","last_became_peered":"2024-09-17T03:38:59.617827+0000","last_unstale":"2024-09-17T03:39:00.618471+0000","last_undegraded":"2024-09-17T03:39:00.618471+0000","last_fullsized":"2024-09-17T03:39:00.618471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:44.607598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.627905+0000","last_change":"2024-09-17T03:38:59.621773+0000","last_active":"2024-09-17T03:38:59.627905+0000","last_peered":"2024-09-17T03:38:59.627905+0000","last_clean":"2024-09-17T03:38:59.627905+0000","last_became_active":"2024-09-17T03:38:59.621447+0000","last_became_peered":"2024-09-17T03:38:59.621447+0000","last_unstale":"2024-09-17T03:38:59.627905+0000","last_undegraded":"2024-09-17T03:38:59.627905+0000","last_fullsized":"2024-09-17T03:38:59.627905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:59.672117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.621287+0000","last_change":"2024-09-17T03:38:59.618293+0000","last_active":"2024-09-17T03:38:59.621287+0000","last_peered":"2024-09-17T03:38:59.621287+0000","last_clean":"2024-09-17T03:38:59.621287+0000","last_became_active":"2024-09-17T03:38:59.617952+0000","last_became_peered":"2024-09-17T03:38:59.617952+0000","last_unstale":"2024-09-17T03:38:59.621287+0000","last_undegraded":"2024-09-17T03:38:59.621287+0000","last_fullsized":"2024-09-17T03:38:59.621287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:18.629243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.639985+0000","last_change":"2024-09-17T03:38:59.629280+0000","last_active":"2024-09-17T03:38:59.639985+0000","last_peered":"2024-09-17T03:38:59.639985+0000","last_clean":"2024-09-17T03:38:59.639985+0000","last_became_active":"2024-09-17T03:38:59.625503+0000","last_became_peered":"2024-09-17T03:38:59.625503+0000","last_unstale":"2024-09-17T03:38:59.639985+0000","last_undegraded":"2024-09-17T03:38:59.639985+0000","last_fullsized":"2024-09-17T03:38:59.639985+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:33.842673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.625217+0000","last_change":"2024-09-17T03:38:59.622389+0000","last_active":"2024-09-17T03:38:59.625217+0000","last_peered":"2024-09-17T03:38:59.625217+0000","last_clean":"2024-09-17T03:38:59.625217+0000","last_became_active":"2024-09-17T03:38:59.619048+0000","last_became_peered":"2024-09-17T03:38:59.619048+0000","last_unstale":"2024-09-17T03:38:59.625217+0000","last_undegraded":"2024-09-17T03:38:59.625217+0000","last_fullsized":"2024-09-17T03:38:59.625217+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:04.488288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629773+0000","last_change":"2024-09-17T03:38:59.623167+0000","last_active":"2024-09-17T03:38:59.629773+0000","last_peered":"2024-09-17T03:38:59.629773+0000","last_clean":"2024-09-17T03:38:59.629773+0000","last_became_active":"2024-09-17T03:38:59.622785+0000","last_became_peered":"2024-09-17T03:38:59.622785+0000","last_unstale":"2024-09-17T03:38:59.629773+0000","last_undegraded":"2024-09-17T03:38:59.629773+0000","last_fullsized":"2024-09-17T03:38:59.629773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:05.489334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620318+0000","last_change":"2024-09-17T03:38:59.622111+0000","last_active":"2024-09-17T03:39:00.620318+0000","last_peered":"2024-09-17T03:39:00.620318+0000","last_clean":"2024-09-17T03:39:00.620318+0000","last_became_active":"2024-09-17T03:38:59.620569+0000","last_became_peered":"2024-09-17T03:38:59.620569+0000","last_unstale":"2024-09-17T03:39:00.620318+0000","last_undegraded":"2024-09-17T03:39:00.620318+0000","last_fullsized":"2024-09-17T03:39:00.620318+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:11.128337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.638118+0000","last_change":"2024-09-17T03:38:59.633561+0000","last_active":"2024-09-17T03:38:59.638118+0000","last_peered":"2024-09-17T03:38:59.638118+0000","last_clean":"2024-09-17T03:38:59.638118+0000","last_became_active":"2024-09-17T03:38:59.633290+0000","last_became_peered":"2024-09-17T03:38:59.633290+0000","last_unstale":"2024-09-17T03:38:59.638118+0000","last_undegraded":"2024-09-17T03:38:59.638118+0000","last_fullsized":"2024-09-17T03:38:59.638118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:06.149485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.622334+0000","last_change":"2024-09-17T03:38:59.618110+0000","last_active":"2024-09-17T03:38:59.622334+0000","last_peered":"2024-09-17T03:38:59.622334+0000","last_clean":"2024-09-17T03:38:59.622334+0000","last_became_active":"2024-09-17T03:38:59.617391+0000","last_became_peered":"2024-09-17T03:38:59.617391+0000","last_unstale":"2024-09-17T03:38:59.622334+0000","last_undegraded":"2024-09-17T03:38:59.622334+0000","last_fullsized":"2024-09-17T03:38:59.622334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:11.847989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.621011+0000","last_change":"2024-09-17T03:38:59.621735+0000","last_active":"2024-09-17T03:39:00.621011+0000","last_peered":"2024-09-17T03:39:00.621011+0000","last_clean":"2024-09-17T03:39:00.621011+0000","last_became_active":"2024-09-17T03:38:59.621423+0000","last_became_peered":"2024-09-17T03:38:59.621423+0000","last_unstale":"2024-09-17T03:39:00.621011+0000","last_undegraded":"2024-09-17T03:39:00.621011+0000","last_fullsized":"2024-09-17T03:39:00.621011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:58.920352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629630+0000","last_change":"2024-09-17T03:38:59.623797+0000","last_active":"2024-09-17T03:38:59.629630+0000","last_peered":"2024-09-17T03:38:59.629630+0000","last_clean":"2024-09-17T03:38:59.629630+0000","last_became_active":"2024-09-17T03:38:59.621369+0000","last_became_peered":"2024-09-17T03:38:59.621369+0000","last_unstale":"2024-09-17T03:38:59.629630+0000","last_undegraded":"2024-09-17T03:38:59.629630+0000","last_fullsized":"2024-09-17T03:38:59.629630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:25.028483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620793+0000","last_change":"2024-09-17T03:38:59.610983+0000","last_active":"2024-09-17T03:39:00.620793+0000","last_peered":"2024-09-17T03:39:00.620793+0000","last_clean":"2024-09-17T03:39:00.620793+0000","last_became_active":"2024-09-17T03:38:59.610665+0000","last_became_peered":"2024-09-17T03:38:59.610665+0000","last_unstale":"2024-09-17T03:39:00.620793+0000","last_undegraded":"2024-09-17T03:39:00.620793+0000","last_fullsized":"2024-09-17T03:39:00.620793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:34.511117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629089+0000","last_change":"2024-09-17T03:38:59.623770+0000","last_active":"2024-09-17T03:38:59.629089+0000","last_peered":"2024-09-17T03:38:59.629089+0000","last_clean":"2024-09-17T03:38:59.629089+0000","last_became_active":"2024-09-17T03:38:59.623422+0000","last_became_peered":"2024-09-17T03:38:59.623422+0000","last_unstale":"2024-09-17T03:38:59.629089+0000","last_undegraded":"2024-09-17T03:38:59.629089+0000","last_fullsized":"2024-09-17T03:38:59.629089+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:30.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.621304+0000","last_change":"2024-09-17T03:38:59.614677+0000","last_active":"2024-09-17T03:38:59.621304+0000","last_peered":"2024-09-17T03:38:59.621304+0000","last_clean":"2024-09-17T03:38:59.621304+0000","last_became_active":"2024-09-17T03:38:59.613498+0000","last_became_peered":"2024-09-17T03:38:59.613498+0000","last_unstale":"2024-09-17T03:38:59.621304+0000","last_undegraded":"2024-09-17T03:38:59.621304+0000","last_fullsized":"2024-09-17T03:38:59.621304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:08.782456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640142+0000","last_change":"2024-09-17T03:38:59.632508+0000","last_active":"2024-09-17T03:38:59.640142+0000","last_peered":"2024-09-17T03:38:59.640142+0000","last_clean":"2024-09-17T03:38:59.640142+0000","last_became_active":"2024-09-17T03:38:59.627322+0000","last_became_peered":"2024-09-17T03:38:59.627322+0000","last_unstale":"2024-09-17T03:38:59.640142+0000","last_undegraded":"2024-09-17T03:38:59.640142+0000","last_fullsized":"2024-09-17T03:38:59.640142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:16.544763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.636030+0000","last_change":"2024-09-17T03:38:59.627863+0000","last_active":"2024-09-17T03:38:59.636030+0000","last_peered":"2024-09-17T03:38:59.636030+0000","last_clean":"2024-09-17T03:38:59.636030+0000","last_became_active":"2024-09-17T03:38:59.627461+0000","last_became_peered":"2024-09-17T03:38:59.627461+0000","last_unstale":"2024-09-17T03:38:59.636030+0000","last_undegraded":"2024-09-17T03:38:59.636030+0000","last_fullsized":"2024-09-17T03:38:59.636030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:11.049338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629242+0000","last_change":"2024-09-17T03:38:59.623308+0000","last_active":"2024-09-17T03:38:59.629242+0000","last_peered":"2024-09-17T03:38:59.629242+0000","last_clean":"2024-09-17T03:38:59.629242+0000","last_became_active":"2024-09-17T03:38:59.622499+0000","last_became_peered":"2024-09-17T03:38:59.622499+0000","last_unstale":"2024-09-17T03:38:59.629242+0000","last_undegraded":"2024-09-17T03:38:59.629242+0000","last_fullsized":"2024-09-17T03:38:59.629242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:12.424780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.635436+0000","last_change":"2024-09-17T03:38:59.628263+0000","last_active":"2024-09-17T03:38:59.635436+0000","last_peered":"2024-09-17T03:38:59.635436+0000","last_clean":"2024-09-17T03:38:59.635436+0000","last_became_active":"2024-09-17T03:38:59.627860+0000","last_became_peered":"2024-09-17T03:38:59.627860+0000","last_unstale":"2024-09-17T03:38:59.635436+0000","last_undegraded":"2024-09-17T03:38:59.635436+0000","last_fullsized":"2024-09-17T03:38:59.635436+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:10.083178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629381+0000","last_change":"2024-09-17T03:38:59.624910+0000","last_active":"2024-09-17T03:38:59.629381+0000","last_peered":"2024-09-17T03:38:59.629381+0000","last_clean":"2024-09-17T03:38:59.629381+0000","last_became_active":"2024-09-17T03:38:59.624566+0000","last_became_peered":"2024-09-17T03:38:59.624566+0000","last_unstale":"2024-09-17T03:38:59.629381+0000","last_undegraded":"2024-09-17T03:38:59.629381+0000","last_fullsized":"2024-09-17T03:38:59.629381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:43.772833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.639817+0000","last_change":"2024-09-17T03:38:59.634017+0000","last_active":"2024-09-17T03:38:59.639817+0000","last_peered":"2024-09-17T03:38:59.639817+0000","last_clean":"2024-09-17T03:38:59.639817+0000","last_became_active":"2024-09-17T03:38:59.633694+0000","last_became_peered":"2024-09-17T03:38:59.633694+0000","last_unstale":"2024-09-17T03:38:59.639817+0000","last_undegraded":"2024-09-17T03:38:59.639817+0000","last_fullsized":"2024-09-17T03:38:59.639817+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:12.424780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.635645+0000","last_change":"2024-09-17T03:38:59.628738+0000","last_active":"2024-09-17T03:38:59.635645+0000","last_peered":"2024-09-17T03:38:59.635645+0000","last_clean":"2024-09-17T03:38:59.635645+0000","last_became_active":"2024-09-17T03:38:59.628448+0000","last_became_peered":"2024-09-17T03:38:59.628448+0000","last_unstale":"2024-09-17T03:38:59.635645+0000","last_undegraded":"2024-09-17T03:38:59.635645+0000","last_fullsized":"2024-09-17T03:38:59.635645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:29.786378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628883+0000","last_change":"2024-09-17T03:38:59.625715+0000","last_active":"2024-09-17T03:38:59.628883+0000","last_peered":"2024-09-17T03:38:59.628883+0000","last_clean":"2024-09-17T03:38:59.628883+0000","last_became_active":"2024-09-17T03:38:59.625408+0000","last_became_peered":"2024-09-17T03:38:59.625408+0000","last_unstale":"2024-09-17T03:38:59.628883+0000","last_undegraded":"2024-09-17T03:38:59.628883+0000","last_fullsized":"2024-09-17T03:38:59.628883+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:47.106119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.641053+0000","last_change":"2024-09-17T03:38:59.631837+0000","last_active":"2024-09-17T03:38:59.641053+0000","last_peered":"2024-09-17T03:38:59.641053+0000","last_clean":"2024-09-17T03:38:59.641053+0000","last_became_active":"2024-09-17T03:38:59.631449+0000","last_became_peered":"2024-09-17T03:38:59.631449+0000","last_unstale":"2024-09-17T03:38:59.641053+0000","last_undegraded":"2024-09-17T03:38:59.641053+0000","last_fullsized":"2024-09-17T03:38:59.641053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:34.087229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.636832+0000","last_change":"2024-09-17T03:38:59.625470+0000","last_active":"2024-09-17T03:38:59.636832+0000","last_peered":"2024-09-17T03:38:59.636832+0000","last_clean":"2024-09-17T03:38:59.636832+0000","last_became_active":"2024-09-17T03:38:59.625114+0000","last_became_peered":"2024-09-17T03:38:59.625114+0000","last_unstale":"2024-09-17T03:38:59.636832+0000","last_undegraded":"2024-09-17T03:38:59.636832+0000","last_fullsized":"2024-09-17T03:38:59.636832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:40.034423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.630640+0000","last_change":"2024-09-17T03:38:59.627401+0000","last_active":"2024-09-17T03:38:59.630640+0000","last_peered":"2024-09-17T03:38:59.630640+0000","last_clean":"2024-09-17T03:38:59.630640+0000","last_became_active":"2024-09-17T03:38:59.627088+0000","last_became_peered":"2024-09-17T03:38:59.627088+0000","last_unstale":"2024-09-17T03:38:59.630640+0000","last_undegraded":"2024-09-17T03:38:59.630640+0000","last_fullsized":"2024-09-17T03:38:59.630640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:46.005300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.626515+0000","last_change":"2024-09-17T03:38:59.614683+0000","last_active":"2024-09-17T03:38:59.626515+0000","last_peered":"2024-09-17T03:38:59.626515+0000","last_clean":"2024-09-17T03:38:59.626515+0000","last_became_active":"2024-09-17T03:38:59.614368+0000","last_became_peered":"2024-09-17T03:38:59.614368+0000","last_unstale":"2024-09-17T03:38:59.626515+0000","last_undegraded":"2024-09-17T03:38:59.626515+0000","last_fullsized":"2024-09-17T03:38:59.626515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:54.961129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"75'4","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.643591+0000","last_change":"2024-09-17T03:38:58.616647+0000","last_active":"2024-09-17T03:38:59.643591+0000","last_peered":"2024-09-17T03:38:59.643591+0000","last_clean":"2024-09-17T03:38:59.643591+0000","last_became_active":"2024-09-17T03:38:58.616168+0000","last_became_peered":"2024-09-17T03:38:58.616168+0000","last_unstale":"2024-09-17T03:38:59.643591+0000","last_undegraded":"2024-09-17T03:38:59.643591+0000","last_fullsized":"2024-09-17T03:38:59.643591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:44.856274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629143+0000","last_change":"2024-09-17T03:38:59.614832+0000","last_active":"2024-09-17T03:38:59.629143+0000","last_peered":"2024-09-17T03:38:59.629143+0000","last_clean":"2024-09-17T03:38:59.629143+0000","last_became_active":"2024-09-17T03:38:59.614452+0000","last_became_peered":"2024-09-17T03:38:59.614452+0000","last_unstale":"2024-09-17T03:38:59.629143+0000","last_undegraded":"2024-09-17T03:38:59.629143+0000","last_fullsized":"2024-09-17T03:38:59.629143+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:13.011933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640156+0000","last_change":"2024-09-17T03:38:58.615216+0000","last_active":"2024-09-17T03:38:59.640156+0000","last_peered":"2024-09-17T03:38:59.640156+0000","last_clean":"2024-09-17T03:38:59.640156+0000","last_became_active":"2024-09-17T03:38:58.614870+0000","last_became_peered":"2024-09-17T03:38:58.614870+0000","last_unstale":"2024-09-17T03:38:59.640156+0000","last_undegraded":"2024-09-17T03:38:59.640156+0000","last_fullsized":"2024-09-17T03:38:59.640156+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:01.203269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628724+0000","last_change":"2024-09-17T03:38:59.626346+0000","last_active":"2024-09-17T03:38:59.628724+0000","last_peered":"2024-09-17T03:38:59.628724+0000","last_clean":"2024-09-17T03:38:59.628724+0000","last_became_active":"2024-09-17T03:38:59.626007+0000","last_became_peered":"2024-09-17T03:38:59.626007+0000","last_unstale":"2024-09-17T03:38:59.628724+0000","last_undegraded":"2024-09-17T03:38:59.628724+0000","last_fullsized":"2024-09-17T03:38:59.628724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:56.900909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.645092+0000","last_change":"2024-09-17T03:38:58.623559+0000","last_active":"2024-09-17T03:38:59.645092+0000","last_peered":"2024-09-17T03:38:59.645092+0000","last_clean":"2024-09-17T03:38:59.645092+0000","last_became_active":"2024-09-17T03:38:58.623145+0000","last_became_peered":"2024-09-17T03:38:58.623145+0000","last_unstale":"2024-09-17T03:38:59.645092+0000","last_undegraded":"2024-09-17T03:38:59.645092+0000","last_fullsized":"2024-09-17T03:38:59.645092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:45.132756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.630134+0000","last_change":"2024-09-17T03:38:59.626344+0000","last_active":"2024-09-17T03:38:59.630134+0000","last_peered":"2024-09-17T03:38:59.630134+0000","last_clean":"2024-09-17T03:38:59.630134+0000","last_became_active":"2024-09-17T03:38:59.625377+0000","last_became_peered":"2024-09-17T03:38:59.625377+0000","last_unstale":"2024-09-17T03:38:59.630134+0000","last_undegraded":"2024-09-17T03:38:59.630134+0000","last_fullsized":"2024-09-17T03:38:59.630134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:31.355226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.642473+0000","last_change":"2024-09-17T03:38:58.610832+0000","last_active":"2024-09-17T03:38:59.642473+0000","last_peered":"2024-09-17T03:38:59.642473+0000","last_clean":"2024-09-17T03:38:59.642473+0000","last_became_active":"2024-09-17T03:38:58.610502+0000","last_became_peered":"2024-09-17T03:38:58.610502+0000","last_unstale":"2024-09-17T03:38:59.642473+0000","last_undegraded":"2024-09-17T03:38:59.642473+0000","last_fullsized":"2024-09-17T03:38:59.642473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:15.537933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629060+0000","last_change":"2024-09-17T03:38:59.620754+0000","last_active":"2024-09-17T03:38:59.629060+0000","last_peered":"2024-09-17T03:38:59.629060+0000","last_clean":"2024-09-17T03:38:59.629060+0000","last_became_active":"2024-09-17T03:38:59.619890+0000","last_became_peered":"2024-09-17T03:38:59.619890+0000","last_unstale":"2024-09-17T03:38:59.629060+0000","last_undegraded":"2024-09-17T03:38:59.629060+0000","last_fullsized":"2024-09-17T03:38:59.629060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:21.377897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.642208+0000","last_change":"2024-09-17T03:38:58.614344+0000","last_active":"2024-09-17T03:38:59.642208+0000","last_peered":"2024-09-17T03:38:59.642208+0000","last_clean":"2024-09-17T03:38:59.642208+0000","last_became_active":"2024-09-17T03:38:58.613857+0000","last_became_peered":"2024-09-17T03:38:58.613857+0000","last_unstale":"2024-09-17T03:38:59.642208+0000","last_undegraded":"2024-09-17T03:38:59.642208+0000","last_fullsized":"2024-09-17T03:38:59.642208+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:53.288535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.636967+0000","last_change":"2024-09-17T03:38:59.625038+0000","last_active":"2024-09-17T03:38:59.636967+0000","last_peered":"2024-09-17T03:38:59.636967+0000","last_clean":"2024-09-17T03:38:59.636967+0000","last_became_active":"2024-09-17T03:38:59.624683+0000","last_became_peered":"2024-09-17T03:38:59.624683+0000","last_unstale":"2024-09-17T03:38:59.636967+0000","last_undegraded":"2024-09-17T03:38:59.636967+0000","last_fullsized":"2024-09-17T03:38:59.636967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:17.840111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.637626+0000","last_change":"2024-09-17T03:38:58.618369+0000","last_active":"2024-09-17T03:38:59.637626+0000","last_peered":"2024-09-17T03:38:59.637626+0000","last_clean":"2024-09-17T03:38:59.637626+0000","last_became_active":"2024-09-17T03:38:58.618049+0000","last_became_peered":"2024-09-17T03:38:58.618049+0000","last_unstale":"2024-09-17T03:38:59.637626+0000","last_undegraded":"2024-09-17T03:38:59.637626+0000","last_fullsized":"2024-09-17T03:38:59.637626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:12.759055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.625861+0000","last_change":"2024-09-17T03:38:59.622677+0000","last_active":"2024-09-17T03:38:59.625861+0000","last_peered":"2024-09-17T03:38:59.625861+0000","last_clean":"2024-09-17T03:38:59.625861+0000","last_became_active":"2024-09-17T03:38:59.622329+0000","last_became_peered":"2024-09-17T03:38:59.622329+0000","last_unstale":"2024-09-17T03:38:59.625861+0000","last_undegraded":"2024-09-17T03:38:59.625861+0000","last_fullsized":"2024-09-17T03:38:59.625861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:00.902867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.618356+0000","last_change":"2024-09-17T03:38:58.615960+0000","last_active":"2024-09-17T03:39:00.618356+0000","last_peered":"2024-09-17T03:39:00.618356+0000","last_clean":"2024-09-17T03:39:00.618356+0000","last_became_active":"2024-09-17T03:38:58.615663+0000","last_became_peered":"2024-09-17T03:38:58.615663+0000","last_unstale":"2024-09-17T03:39:00.618356+0000","last_undegraded":"2024-09-17T03:39:00.618356+0000","last_fullsized":"2024-09-17T03:39:00.618356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:59.318973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.633287+0000","last_change":"2024-09-17T03:38:59.626632+0000","last_active":"2024-09-17T03:38:59.633287+0000","last_peered":"2024-09-17T03:38:59.633287+0000","last_clean":"2024-09-17T03:38:59.633287+0000","last_became_active":"2024-09-17T03:38:59.625947+0000","last_became_peered":"2024-09-17T03:38:59.625947+0000","last_unstale":"2024-09-17T03:38:59.633287+0000","last_undegraded":"2024-09-17T03:38:59.633287+0000","last_fullsized":"2024-09-17T03:38:59.633287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:06.262397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.610470+0000","last_change":"2024-09-17T03:38:58.620173+0000","last_active":"2024-09-17T03:38:59.610470+0000","last_peered":"2024-09-17T03:38:59.610470+0000","last_clean":"2024-09-17T03:38:59.610470+0000","last_became_active":"2024-09-17T03:38:58.619844+0000","last_became_peered":"2024-09-17T03:38:58.619844+0000","last_unstale":"2024-09-17T03:38:59.610470+0000","last_undegraded":"2024-09-17T03:38:59.610470+0000","last_fullsized":"2024-09-17T03:38:59.610470+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:16.482854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629167+0000","last_change":"2024-09-17T03:38:59.620416+0000","last_active":"2024-09-17T03:38:59.629167+0000","last_peered":"2024-09-17T03:38:59.629167+0000","last_clean":"2024-09-17T03:38:59.629167+0000","last_became_active":"2024-09-17T03:38:59.620041+0000","last_became_peered":"2024-09-17T03:38:59.620041+0000","last_unstale":"2024-09-17T03:38:59.629167+0000","last_undegraded":"2024-09-17T03:38:59.629167+0000","last_fullsized":"2024-09-17T03:38:59.629167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:46.005300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.607744+0000","last_change":"2024-09-17T03:38:58.622597+0000","last_active":"2024-09-17T03:38:59.607744+0000","last_peered":"2024-09-17T03:38:59.607744+0000","last_clean":"2024-09-17T03:38:59.607744+0000","last_became_active":"2024-09-17T03:38:58.622138+0000","last_became_peered":"2024-09-17T03:38:58.622138+0000","last_unstale":"2024-09-17T03:38:59.607744+0000","last_undegraded":"2024-09-17T03:38:59.607744+0000","last_fullsized":"2024-09-17T03:38:59.607744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:01.115479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.624593+0000","last_change":"2024-09-17T03:38:59.620811+0000","last_active":"2024-09-17T03:38:59.624593+0000","last_peered":"2024-09-17T03:38:59.624593+0000","last_clean":"2024-09-17T03:38:59.624593+0000","last_became_active":"2024-09-17T03:38:59.620457+0000","last_became_peered":"2024-09-17T03:38:59.620457+0000","last_unstale":"2024-09-17T03:38:59.624593+0000","last_undegraded":"2024-09-17T03:38:59.624593+0000","last_fullsized":"2024-09-17T03:38:59.624593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:21.429128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.605114+0000","last_change":"2024-09-17T03:38:58.624028+0000","last_active":"2024-09-17T03:38:59.605114+0000","last_peered":"2024-09-17T03:38:59.605114+0000","last_clean":"2024-09-17T03:38:59.605114+0000","last_became_active":"2024-09-17T03:38:58.623676+0000","last_became_peered":"2024-09-17T03:38:58.623676+0000","last_unstale":"2024-09-17T03:38:59.605114+0000","last_undegraded":"2024-09-17T03:38:59.605114+0000","last_fullsized":"2024-09-17T03:38:59.605114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:13.650461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620809+0000","last_change":"2024-09-17T03:38:59.626400+0000","last_active":"2024-09-17T03:39:00.620809+0000","last_peered":"2024-09-17T03:39:00.620809+0000","last_clean":"2024-09-17T03:39:00.620809+0000","last_became_active":"2024-09-17T03:38:59.620150+0000","last_became_peered":"2024-09-17T03:38:59.620150+0000","last_unstale":"2024-09-17T03:39:00.620809+0000","last_undegraded":"2024-09-17T03:39:00.620809+0000","last_fullsized":"2024-09-17T03:39:00.620809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:26.279085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"75'3","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640838+0000","last_change":"2024-09-17T03:38:58.624672+0000","last_active":"2024-09-17T03:38:59.640838+0000","last_peered":"2024-09-17T03:38:59.640838+0000","last_clean":"2024-09-17T03:38:59.640838+0000","last_became_active":"2024-09-17T03:38:58.624337+0000","last_became_peered":"2024-09-17T03:38:58.624337+0000","last_unstale":"2024-09-17T03:38:59.640838+0000","last_undegraded":"2024-09-17T03:38:59.640838+0000","last_fullsized":"2024-09-17T03:38:59.640838+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:39.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628853+0000","last_change":"2024-09-17T03:38:59.621179+0000","last_active":"2024-09-17T03:38:59.628853+0000","last_peered":"2024-09-17T03:38:59.628853+0000","last_clean":"2024-09-17T03:38:59.628853+0000","last_became_active":"2024-09-17T03:38:59.620871+0000","last_became_peered":"2024-09-17T03:38:59.620871+0000","last_unstale":"2024-09-17T03:38:59.628853+0000","last_undegraded":"2024-09-17T03:38:59.628853+0000","last_fullsized":"2024-09-17T03:38:59.628853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:13.628847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"75'6","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.647102+0000","last_change":"2024-09-17T03:38:58.624381+0000","last_active":"2024-09-17T03:38:59.647102+0000","last_peered":"2024-09-17T03:38:59.647102+0000","last_clean":"2024-09-17T03:38:59.647102+0000","last_became_active":"2024-09-17T03:38:58.624066+0000","last_became_peered":"2024-09-17T03:38:58.624066+0000","last_unstale":"2024-09-17T03:38:59.647102+0000","last_undegraded":"2024-09-17T03:38:59.647102+0000","last_fullsized":"2024-09-17T03:38:59.647102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:54.940938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628345+0000","last_change":"2024-09-17T03:38:59.621472+0000","last_active":"2024-09-17T03:38:59.628345+0000","last_peered":"2024-09-17T03:38:59.628345+0000","last_clean":"2024-09-17T03:38:59.628345+0000","last_became_active":"2024-09-17T03:38:59.621173+0000","last_became_peered":"2024-09-17T03:38:59.621173+0000","last_unstale":"2024-09-17T03:38:59.628345+0000","last_undegraded":"2024-09-17T03:38:59.628345+0000","last_fullsized":"2024-09-17T03:38:59.628345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:19.536206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.644951+0000","last_change":"2024-09-17T03:38:58.621818+0000","last_active":"2024-09-17T03:38:59.644951+0000","last_peered":"2024-09-17T03:38:59.644951+0000","last_clean":"2024-09-17T03:38:59.644951+0000","last_became_active":"2024-09-17T03:38:58.619691+0000","last_became_peered":"2024-09-17T03:38:58.619691+0000","last_unstale":"2024-09-17T03:38:59.644951+0000","last_undegraded":"2024-09-17T03:38:59.644951+0000","last_fullsized":"2024-09-17T03:38:59.644951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:16.294537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.644979+0000","last_change":"2024-09-17T03:38:59.641164+0000","last_active":"2024-09-17T03:38:59.644979+0000","last_peered":"2024-09-17T03:38:59.644979+0000","last_clean":"2024-09-17T03:38:59.644979+0000","last_became_active":"2024-09-17T03:38:59.639067+0000","last_became_peered":"2024-09-17T03:38:59.639067+0000","last_unstale":"2024-09-17T03:38:59.644979+0000","last_undegraded":"2024-09-17T03:38:59.644979+0000","last_fullsized":"2024-09-17T03:38:59.644979+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:15.912773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.606184+0000","last_change":"2024-09-17T03:38:58.620658+0000","last_active":"2024-09-17T03:38:59.606184+0000","last_peered":"2024-09-17T03:38:59.606184+0000","last_clean":"2024-09-17T03:38:59.606184+0000","last_became_active":"2024-09-17T03:38:58.620332+0000","last_became_peered":"2024-09-17T03:38:58.620332+0000","last_unstale":"2024-09-17T03:38:59.606184+0000","last_undegraded":"2024-09-17T03:38:59.606184+0000","last_fullsized":"2024-09-17T03:38:59.606184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:48.124704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628928+0000","last_change":"2024-09-17T03:38:59.625995+0000","last_active":"2024-09-17T03:38:59.628928+0000","last_peered":"2024-09-17T03:38:59.628928+0000","last_clean":"2024-09-17T03:38:59.628928+0000","last_became_active":"2024-09-17T03:38:59.625476+0000","last_became_peered":"2024-09-17T03:38:59.625476+0000","last_unstale":"2024-09-17T03:38:59.628928+0000","last_undegraded":"2024-09-17T03:38:59.628928+0000","last_fullsized":"2024-09-17T03:38:59.628928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:51.912010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.601476+0000","last_change":"2024-09-17T03:38:58.612692+0000","last_active":"2024-09-17T03:38:59.601476+0000","last_peered":"2024-09-17T03:38:59.601476+0000","last_clean":"2024-09-17T03:38:59.601476+0000","last_became_active":"2024-09-17T03:38:58.612399+0000","last_became_peered":"2024-09-17T03:38:58.612399+0000","last_unstale":"2024-09-17T03:38:59.601476+0000","last_undegraded":"2024-09-17T03:38:59.601476+0000","last_fullsized":"2024-09-17T03:38:59.601476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:46.339786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.641109+0000","last_change":"2024-09-17T03:38:59.635915+0000","last_active":"2024-09-17T03:38:59.641109+0000","last_peered":"2024-09-17T03:38:59.641109+0000","last_clean":"2024-09-17T03:38:59.641109+0000","last_became_active":"2024-09-17T03:38:59.631731+0000","last_became_peered":"2024-09-17T03:38:59.631731+0000","last_unstale":"2024-09-17T03:38:59.641109+0000","last_undegraded":"2024-09-17T03:38:59.641109+0000","last_fullsized":"2024-09-17T03:38:59.641109+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:05.773787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"75'8","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.643930+0000","last_change":"2024-09-17T03:38:58.623796+0000","last_active":"2024-09-17T03:38:59.643930+0000","last_peered":"2024-09-17T03:38:59.643930+0000","last_clean":"2024-09-17T03:38:59.643930+0000","last_became_active":"2024-09-17T03:38:58.623428+0000","last_became_peered":"2024-09-17T03:38:58.623428+0000","last_unstale":"2024-09-17T03:38:59.643930+0000","last_undegraded":"2024-09-17T03:38:59.643930+0000","last_fullsized":"2024-09-17T03:38:59.643930+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:40.639837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.635656+0000","last_change":"2024-09-17T03:38:59.626258+0000","last_active":"2024-09-17T03:38:59.635656+0000","last_peered":"2024-09-17T03:38:59.635656+0000","last_clean":"2024-09-17T03:38:59.635656+0000","last_became_active":"2024-09-17T03:38:59.624225+0000","last_became_peered":"2024-09-17T03:38:59.624225+0000","last_unstale":"2024-09-17T03:38:59.635656+0000","last_undegraded":"2024-09-17T03:38:59.635656+0000","last_fullsized":"2024-09-17T03:38:59.635656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:54.225889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.643118+0000","last_change":"2024-09-17T03:38:58.618371+0000","last_active":"2024-09-17T03:38:59.643118+0000","last_peered":"2024-09-17T03:38:59.643118+0000","last_clean":"2024-09-17T03:38:59.643118+0000","last_became_active":"2024-09-17T03:38:58.618097+0000","last_became_peered":"2024-09-17T03:38:58.618097+0000","last_unstale":"2024-09-17T03:38:59.643118+0000","last_undegraded":"2024-09-17T03:38:59.643118+0000","last_fullsized":"2024-09-17T03:38:59.643118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:31.172157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640066+0000","last_change":"2024-09-17T03:38:59.631731+0000","last_active":"2024-09-17T03:38:59.640066+0000","last_peered":"2024-09-17T03:38:59.640066+0000","last_clean":"2024-09-17T03:38:59.640066+0000","last_became_active":"2024-09-17T03:38:59.631421+0000","last_became_peered":"2024-09-17T03:38:59.631421+0000","last_unstale":"2024-09-17T03:38:59.640066+0000","last_undegraded":"2024-09-17T03:38:59.640066+0000","last_fullsized":"2024-09-17T03:38:59.640066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:49.131534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.643051+0000","last_change":"2024-09-17T03:38:58.620262+0000","last_active":"2024-09-17T03:38:59.643051+0000","last_peered":"2024-09-17T03:38:59.643051+0000","last_clean":"2024-09-17T03:38:59.643051+0000","last_became_active":"2024-09-17T03:38:58.619928+0000","last_became_peered":"2024-09-17T03:38:58.619928+0000","last_unstale":"2024-09-17T03:38:59.643051+0000","last_undegraded":"2024-09-17T03:38:59.643051+0000","last_fullsized":"2024-09-17T03:38:59.643051+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:05.142655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620595+0000","last_change":"2024-09-17T03:38:59.627911+0000","last_active":"2024-09-17T03:39:00.620595+0000","last_peered":"2024-09-17T03:39:00.620595+0000","last_clean":"2024-09-17T03:39:00.620595+0000","last_became_active":"2024-09-17T03:38:59.627535+0000","last_became_peered":"2024-09-17T03:38:59.627535+0000","last_unstale":"2024-09-17T03:39:00.620595+0000","last_undegraded":"2024-09-17T03:39:00.620595+0000","last_fullsized":"2024-09-17T03:39:00.620595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:54.665460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.641770+0000","last_change":"2024-09-17T03:38:58.610413+0000","last_active":"2024-09-17T03:38:59.641770+0000","last_peered":"2024-09-17T03:38:59.641770+0000","last_clean":"2024-09-17T03:38:59.641770+0000","last_became_active":"2024-09-17T03:38:58.610096+0000","last_became_peered":"2024-09-17T03:38:58.610096+0000","last_unstale":"2024-09-17T03:38:59.641770+0000","last_undegraded":"2024-09-17T03:38:59.641770+0000","last_fullsized":"2024-09-17T03:38:59.641770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:59.485976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.622589+0000","last_change":"2024-09-17T03:38:59.610358+0000","last_active":"2024-09-17T03:38:59.622589+0000","last_peered":"2024-09-17T03:38:59.622589+0000","last_clean":"2024-09-17T03:38:59.622589+0000","last_became_active":"2024-09-17T03:38:59.609943+0000","last_became_peered":"2024-09-17T03:38:59.609943+0000","last_unstale":"2024-09-17T03:38:59.622589+0000","last_undegraded":"2024-09-17T03:38:59.622589+0000","last_fullsized":"2024-09-17T03:38:59.622589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:52.510341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.603093+0000","last_change":"2024-09-17T03:38:58.611065+0000","last_active":"2024-09-17T03:38:59.603093+0000","last_peered":"2024-09-17T03:38:59.603093+0000","last_clean":"2024-09-17T03:38:59.603093+0000","last_became_active":"2024-09-17T03:38:58.610766+0000","last_became_peered":"2024-09-17T03:38:58.610766+0000","last_unstale":"2024-09-17T03:38:59.603093+0000","last_undegraded":"2024-09-17T03:38:59.603093+0000","last_fullsized":"2024-09-17T03:38:59.603093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:06.504742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.635320+0000","last_change":"2024-09-17T03:38:59.624866+0000","last_active":"2024-09-17T03:38:59.635320+0000","last_peered":"2024-09-17T03:38:59.635320+0000","last_clean":"2024-09-17T03:38:59.635320+0000","last_became_active":"2024-09-17T03:38:59.621691+0000","last_became_peered":"2024-09-17T03:38:59.621691+0000","last_unstale":"2024-09-17T03:38:59.635320+0000","last_undegraded":"2024-09-17T03:38:59.635320+0000","last_fullsized":"2024-09-17T03:38:59.635320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:45.163607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640842+0000","last_change":"2024-09-17T03:38:58.619380+0000","last_active":"2024-09-17T03:38:59.640842+0000","last_peered":"2024-09-17T03:38:59.640842+0000","last_clean":"2024-09-17T03:38:59.640842+0000","last_became_active":"2024-09-17T03:38:58.619016+0000","last_became_peered":"2024-09-17T03:38:58.619016+0000","last_unstale":"2024-09-17T03:38:59.640842+0000","last_undegraded":"2024-09-17T03:38:59.640842+0000","last_fullsized":"2024-09-17T03:38:59.640842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:30.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.631638+0000","last_change":"2024-09-17T03:38:59.622349+0000","last_active":"2024-09-17T03:38:59.631638+0000","last_peered":"2024-09-17T03:38:59.631638+0000","last_clean":"2024-09-17T03:38:59.631638+0000","last_became_active":"2024-09-17T03:38:59.621613+0000","last_became_peered":"2024-09-17T03:38:59.621613+0000","last_unstale":"2024-09-17T03:38:59.631638+0000","last_undegraded":"2024-09-17T03:38:59.631638+0000","last_fullsized":"2024-09-17T03:38:59.631638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:23.543136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620002+0000","last_change":"2024-09-17T03:38:58.610030+0000","last_active":"2024-09-17T03:39:00.620002+0000","last_peered":"2024-09-17T03:39:00.620002+0000","last_clean":"2024-09-17T03:39:00.620002+0000","last_became_active":"2024-09-17T03:38:58.609601+0000","last_became_peered":"2024-09-17T03:38:58.609601+0000","last_unstale":"2024-09-17T03:39:00.620002+0000","last_undegraded":"2024-09-17T03:39:00.620002+0000","last_fullsized":"2024-09-17T03:39:00.620002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:12.964590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.633320+0000","last_change":"2024-09-17T03:38:59.626921+0000","last_active":"2024-09-17T03:38:59.633320+0000","last_peered":"2024-09-17T03:38:59.633320+0000","last_clean":"2024-09-17T03:38:59.633320+0000","last_became_active":"2024-09-17T03:38:59.626360+0000","last_became_peered":"2024-09-17T03:38:59.626360+0000","last_unstale":"2024-09-17T03:38:59.633320+0000","last_undegraded":"2024-09-17T03:38:59.633320+0000","last_fullsized":"2024-09-17T03:38:59.633320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:58.097943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.610938+0000","last_change":"2024-09-17T03:38:58.620060+0000","last_active":"2024-09-17T03:38:59.610938+0000","last_peered":"2024-09-17T03:38:59.610938+0000","last_clean":"2024-09-17T03:38:59.610938+0000","last_became_active":"2024-09-17T03:38:58.619601+0000","last_became_peered":"2024-09-17T03:38:58.619601+0000","last_unstale":"2024-09-17T03:38:59.610938+0000","last_undegraded":"2024-09-17T03:38:59.610938+0000","last_fullsized":"2024-09-17T03:38:59.610938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:42.766003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.639747+0000","last_change":"2024-09-17T03:38:59.633324+0000","last_active":"2024-09-17T03:38:59.639747+0000","last_peered":"2024-09-17T03:38:59.639747+0000","last_clean":"2024-09-17T03:38:59.639747+0000","last_became_active":"2024-09-17T03:38:59.633025+0000","last_became_peered":"2024-09-17T03:38:59.633025+0000","last_unstale":"2024-09-17T03:38:59.639747+0000","last_undegraded":"2024-09-17T03:38:59.639747+0000","last_fullsized":"2024-09-17T03:38:59.639747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:05.489334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.644171+0000","last_change":"2024-09-17T03:38:58.621296+0000","last_active":"2024-09-17T03:38:59.644171+0000","last_peered":"2024-09-17T03:38:59.644171+0000","last_clean":"2024-09-17T03:38:59.644171+0000","last_became_active":"2024-09-17T03:38:58.617586+0000","last_became_peered":"2024-09-17T03:38:58.617586+0000","last_unstale":"2024-09-17T03:38:59.644171+0000","last_undegraded":"2024-09-17T03:38:59.644171+0000","last_fullsized":"2024-09-17T03:38:59.644171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:42.214425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640952+0000","last_change":"2024-09-17T03:38:59.633778+0000","last_active":"2024-09-17T03:38:59.640952+0000","last_peered":"2024-09-17T03:38:59.640952+0000","last_clean":"2024-09-17T03:38:59.640952+0000","last_became_active":"2024-09-17T03:38:59.633390+0000","last_became_peered":"2024-09-17T03:38:59.633390+0000","last_unstale":"2024-09-17T03:38:59.640952+0000","last_undegraded":"2024-09-17T03:38:59.640952+0000","last_fullsized":"2024-09-17T03:38:59.640952+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:44.631255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.616163+0000","last_change":"2024-09-17T03:38:58.623604+0000","last_active":"2024-09-17T03:38:59.616163+0000","last_peered":"2024-09-17T03:38:59.616163+0000","last_clean":"2024-09-17T03:38:59.616163+0000","last_became_active":"2024-09-17T03:38:58.623299+0000","last_became_peered":"2024-09-17T03:38:58.623299+0000","last_unstale":"2024-09-17T03:38:59.616163+0000","last_undegraded":"2024-09-17T03:38:59.616163+0000","last_fullsized":"2024-09-17T03:38:59.616163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:00.760554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629680+0000","last_change":"2024-09-17T03:38:59.627493+0000","last_active":"2024-09-17T03:38:59.629680+0000","last_peered":"2024-09-17T03:38:59.629680+0000","last_clean":"2024-09-17T03:38:59.629680+0000","last_became_active":"2024-09-17T03:38:59.625545+0000","last_became_peered":"2024-09-17T03:38:59.625545+0000","last_unstale":"2024-09-17T03:38:59.629680+0000","last_undegraded":"2024-09-17T03:38:59.629680+0000","last_fullsized":"2024-09-17T03:38:59.629680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:10.990480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.603099+0000","last_change":"2024-09-17T03:38:58.623877+0000","last_active":"2024-09-17T03:38:59.603099+0000","last_peered":"2024-09-17T03:38:59.603099+0000","last_clean":"2024-09-17T03:38:59.603099+0000","last_became_active":"2024-09-17T03:38:58.623599+0000","last_became_peered":"2024-09-17T03:38:58.623599+0000","last_unstale":"2024-09-17T03:38:59.603099+0000","last_undegraded":"2024-09-17T03:38:59.603099+0000","last_fullsized":"2024-09-17T03:38:59.603099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:28.355846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620868+0000","last_change":"2024-09-17T03:38:59.622372+0000","last_active":"2024-09-17T03:39:00.620868+0000","last_peered":"2024-09-17T03:39:00.620868+0000","last_clean":"2024-09-17T03:39:00.620868+0000","last_became_active":"2024-09-17T03:38:59.622042+0000","last_became_peered":"2024-09-17T03:38:59.622042+0000","last_unstale":"2024-09-17T03:39:00.620868+0000","last_undegraded":"2024-09-17T03:39:00.620868+0000","last_fullsized":"2024-09-17T03:39:00.620868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:34.803509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.604735+0000","last_change":"2024-09-17T03:38:58.614203+0000","last_active":"2024-09-17T03:38:59.604735+0000","last_peered":"2024-09-17T03:38:59.604735+0000","last_clean":"2024-09-17T03:38:59.604735+0000","last_became_active":"2024-09-17T03:38:58.613919+0000","last_became_peered":"2024-09-17T03:38:58.613919+0000","last_unstale":"2024-09-17T03:38:59.604735+0000","last_undegraded":"2024-09-17T03:38:59.604735+0000","last_fullsized":"2024-09-17T03:38:59.604735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:53.855762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.622697+0000","last_change":"2024-09-17T03:38:59.612983+0000","last_active":"2024-09-17T03:38:59.622697+0000","last_peered":"2024-09-17T03:38:59.622697+0000","last_clean":"2024-09-17T03:38:59.622697+0000","last_became_active":"2024-09-17T03:38:59.612500+0000","last_became_peered":"2024-09-17T03:38:59.612500+0000","last_unstale":"2024-09-17T03:38:59.622697+0000","last_undegraded":"2024-09-17T03:38:59.622697+0000","last_fullsized":"2024-09-17T03:38:59.622697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:27.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.604369+0000","last_change":"2024-09-17T03:38:58.613480+0000","last_active":"2024-09-17T03:38:59.604369+0000","last_peered":"2024-09-17T03:38:59.604369+0000","last_clean":"2024-09-17T03:38:59.604369+0000","last_became_active":"2024-09-17T03:38:58.613170+0000","last_became_peered":"2024-09-17T03:38:58.613170+0000","last_unstale":"2024-09-17T03:38:59.604369+0000","last_undegraded":"2024-09-17T03:38:59.604369+0000","last_fullsized":"2024-09-17T03:38:59.604369+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:40.579197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.639786+0000","last_change":"2024-09-17T03:38:59.632053+0000","last_active":"2024-09-17T03:38:59.639786+0000","last_peered":"2024-09-17T03:38:59.639786+0000","last_clean":"2024-09-17T03:38:59.639786+0000","last_became_active":"2024-09-17T03:38:59.631699+0000","last_became_peered":"2024-09-17T03:38:59.631699+0000","last_unstale":"2024-09-17T03:38:59.639786+0000","last_undegraded":"2024-09-17T03:38:59.639786+0000","last_fullsized":"2024-09-17T03:38:59.639786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:09.189955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.617898+0000","last_change":"2024-09-17T03:38:58.621698+0000","last_active":"2024-09-17T03:38:59.617898+0000","last_peered":"2024-09-17T03:38:59.617898+0000","last_clean":"2024-09-17T03:38:59.617898+0000","last_became_active":"2024-09-17T03:38:58.621128+0000","last_became_peered":"2024-09-17T03:38:58.621128+0000","last_unstale":"2024-09-17T03:38:59.617898+0000","last_undegraded":"2024-09-17T03:38:59.617898+0000","last_fullsized":"2024-09-17T03:38:59.617898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:02.991335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.627939+0000","last_change":"2024-09-17T03:38:59.621336+0000","last_active":"2024-09-17T03:38:59.627939+0000","last_peered":"2024-09-17T03:38:59.627939+0000","last_clean":"2024-09-17T03:38:59.627939+0000","last_became_active":"2024-09-17T03:38:59.621006+0000","last_became_peered":"2024-09-17T03:38:59.621006+0000","last_unstale":"2024-09-17T03:38:59.627939+0000","last_undegraded":"2024-09-17T03:38:59.627939+0000","last_fullsized":"2024-09-17T03:38:59.627939+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:09.189955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.607162+0000","last_change":"2024-09-17T03:38:58.618294+0000","last_active":"2024-09-17T03:38:59.607162+0000","last_peered":"2024-09-17T03:38:59.607162+0000","last_clean":"2024-09-17T03:38:59.607162+0000","last_became_active":"2024-09-17T03:38:58.618008+0000","last_became_peered":"2024-09-17T03:38:58.618008+0000","last_unstale":"2024-09-17T03:38:59.607162+0000","last_undegraded":"2024-09-17T03:38:59.607162+0000","last_fullsized":"2024-09-17T03:38:59.607162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:36.547395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.637546+0000","last_change":"2024-09-17T03:38:59.630566+0000","last_active":"2024-09-17T03:38:59.637546+0000","last_peered":"2024-09-17T03:38:59.637546+0000","last_clean":"2024-09-17T03:38:59.637546+0000","last_became_active":"2024-09-17T03:38:59.627186+0000","last_became_peered":"2024-09-17T03:38:59.627186+0000","last_unstale":"2024-09-17T03:38:59.637546+0000","last_undegraded":"2024-09-17T03:38:59.637546+0000","last_fullsized":"2024-09-17T03:38:59.637546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:54.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.610704+0000","last_change":"2024-09-17T03:38:58.617479+0000","last_active":"2024-09-17T03:38:59.610704+0000","last_peered":"2024-09-17T03:38:59.610704+0000","last_clean":"2024-09-17T03:38:59.610704+0000","last_became_active":"2024-09-17T03:38:58.617119+0000","last_became_peered":"2024-09-17T03:38:58.617119+0000","last_unstale":"2024-09-17T03:38:59.610704+0000","last_undegraded":"2024-09-17T03:38:59.610704+0000","last_fullsized":"2024-09-17T03:38:59.610704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:58.665288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.632550+0000","last_change":"2024-09-17T03:38:59.619450+0000","last_active":"2024-09-17T03:38:59.632550+0000","last_peered":"2024-09-17T03:38:59.632550+0000","last_clean":"2024-09-17T03:38:59.632550+0000","last_became_active":"2024-09-17T03:38:59.618195+0000","last_became_peered":"2024-09-17T03:38:59.618195+0000","last_unstale":"2024-09-17T03:38:59.632550+0000","last_undegraded":"2024-09-17T03:38:59.632550+0000","last_fullsized":"2024-09-17T03:38:59.632550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:25.262341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.617586+0000","last_change":"2024-09-17T03:38:58.618630+0000","last_active":"2024-09-17T03:38:59.617586+0000","last_peered":"2024-09-17T03:38:59.617586+0000","last_clean":"2024-09-17T03:38:59.617586+0000","last_became_active":"2024-09-17T03:38:58.618286+0000","last_became_peered":"2024-09-17T03:38:58.618286+0000","last_unstale":"2024-09-17T03:38:59.617586+0000","last_undegraded":"2024-09-17T03:38:59.617586+0000","last_fullsized":"2024-09-17T03:38:59.617586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:18.982913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":211,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.602317+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:38:59.602317+0000","last_peered":"2024-09-17T03:38:59.602317+0000","last_clean":"2024-09-17T03:38:59.602317+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:38:59.602317+0000","last_undegraded":"2024-09-17T03:38:59.602317+0000","last_fullsized":"2024-09-17T03:38:59.602317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":411502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":411522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1507328,"data_stored":1001308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":929792,"data_stored":412566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":909312,"data_stored":410850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1519616,"data_stored":1002864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":913408,"data_stored":410872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":925696,"data_stored":417564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:39:04.018 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:39:04.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.276+0000 7f28eca00640 1 -- 172.21.15.121:0/3697771129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28e80d3540 msgr2=0x7f28e8162420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:04.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.276+0000 7f28eca00640 1 --2- 172.21.15.121:0/3697771129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28e80d3540 0x7f28e8162420 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f28e808c900 tx=0x7f28d002aac0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.276+0000 7f28eca00640 1 -- 172.21.15.121:0/3697771129 shutdown_connections 2024-09-17T03:39:04.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.276+0000 7f28eca00640 1 --2- 172.21.15.121:0/3697771129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28e80d3540 0x7f28e8162420 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.276+0000 7f28eca00640 1 --2- 172.21.15.121:0/3697771129 >> v2:172.21.15.176:3300/0 conn(0x7f28e815e7a0 0x7f28e80d3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.276+0000 7f28eca00640 1 -- 172.21.15.121:0/3697771129 >> 172.21.15.121:0/3697771129 conn(0x7f28e80d4b30 msgr2=0x7f28e80b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:04.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.276+0000 7f28eca00640 1 -- 172.21.15.121:0/3697771129 shutdown_connections 2024-09-17T03:39:04.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.276+0000 7f28eca00640 1 -- 172.21.15.121:0/3697771129 wait complete. 2024-09-17T03:39:04.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.278+0000 7f28eca00640 1 Processor -- start 2024-09-17T03:39:04.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.278+0000 7f28eca00640 1 -- start start 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28eca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28e80d3540 0x7f28e80cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28eca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e815e7a0 0x7f28e80b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28eca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e8162960 0x7f28e8160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28eca00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f28e806d4f0 con 0x7f28e80d3540 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28eca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80d0af0 con 0x7f28e815e7a0 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28eca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f28e806d670 con 0x7f28e8162960 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28e6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28e80d3540 0x7f28e80cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28e6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28e80d3540 0x7f28e80cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38058/0 (socket says 172.21.15.121:38058) 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28e6800640 1 -- 172.21.15.121:0/663820461 learned_addr learned my addr 172.21.15.121:0/663820461 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28e7200640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e8162960 0x7f28e8160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28dde00640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e815e7a0 0x7f28e80b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:04.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28e6800640 1 -- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e8162960 msgr2=0x7f28e8160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:04.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28e6800640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e8162960 0x7f28e8160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28e6800640 1 -- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e815e7a0 msgr2=0x7f28e80b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:04.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.280+0000 7f28e6800640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e815e7a0 0x7f28e80b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.281+0000 7f28e6800640 1 -- 172.21.15.121:0/663820461 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e80b2ba0 con 0x7f28e80d3540 2024-09-17T03:39:04.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.281+0000 7f28e6800640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28e80d3540 0x7f28e80cb4b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f28d800e790 tx=0x7f28d800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:04.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.281+0000 7f28df400640 1 -- 172.21.15.121:0/663820461 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d800eea0 con 0x7f28e80d3540 2024-09-17T03:39:04.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.281+0000 7f28df400640 1 -- 172.21.15.121:0/663820461 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28d800cdb0 con 0x7f28e80d3540 2024-09-17T03:39:04.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.281+0000 7f28df400640 1 -- 172.21.15.121:0/663820461 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d8010690 con 0x7f28e80d3540 2024-09-17T03:39:04.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.281+0000 7f28eca00640 1 -- 172.21.15.121:0/663820461 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e80ce540 con 0x7f28e80d3540 2024-09-17T03:39:04.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.281+0000 7f28eca00640 1 -- 172.21.15.121:0/663820461 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e80c97f0 con 0x7f28e80d3540 2024-09-17T03:39:04.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.282+0000 7f28eca00640 1 -- 172.21.15.121:0/663820461 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e806db70 con 0x7f28e80d3540 2024-09-17T03:39:04.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.284+0000 7f28df400640 1 -- 172.21.15.121:0/663820461 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28d8010830 con 0x7f28e80d3540 2024-09-17T03:39:04.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.285+0000 7f28df400640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f28c4078b90 0x7f28c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:04.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.285+0000 7f28df400640 1 -- 172.21.15.121:0/663820461 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f28d809c070 con 0x7f28e80d3540 2024-09-17T03:39:04.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.285+0000 7f28dde00640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f28c4078b90 0x7f28c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:04.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.286+0000 7f28dde00640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f28c4078b90 0x7f28c407b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f28d0035000 tx=0x7f28d0004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:04.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.288+0000 7f28df400640 1 -- 172.21.15.121:0/663820461 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f28d8064490 con 0x7f28e80d3540 2024-09-17T03:39:04.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.468+0000 7f28eca00640 1 -- 172.21.15.121:0/663820461 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28e80b31d0 con 0x7f28c4078b90 2024-09-17T03:39:04.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.473+0000 7f28df400640 1 -- 172.21.15.121:0/663820461 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252055 (secure 0 0 0) 0x7f28d00838b0 con 0x7f28c4078b90 2024-09-17T03:39:04.476 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:04.477 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:39:04.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 -- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f28c4078b90 msgr2=0x7f28c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:04.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f28c4078b90 0x7f28c407b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f28d0035000 tx=0x7f28d0004ab0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 -- 172.21.15.121:0/663820461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28e80d3540 msgr2=0x7f28e80cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:04.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28e80d3540 0x7f28e80cb4b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f28d800e790 tx=0x7f28d800ec50 comp rx=0 tx=0).stop 2024-09-17T03:39:04.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 -- 172.21.15.121:0/663820461 shutdown_connections 2024-09-17T03:39:04.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e8162960 0x7f28e8160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e815e7a0 0x7f28e80b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f28c4078b90 0x7f28c407b0a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 --2- 172.21.15.121:0/663820461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f28e80d3540 0x7f28e80cb4b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 -- 172.21.15.121:0/663820461 >> 172.21.15.121:0/663820461 conn(0x7f28e80d4b30 msgr2=0x7f28e80b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:04.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 -- 172.21.15.121:0/663820461 shutdown_connections 2024-09-17T03:39:04.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.477+0000 7f28eca00640 1 -- 172.21.15.121:0/663820461 wait complete. 2024-09-17T03:39:04.502 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-17T03:39:03.332809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253716,"kb_used_data":8340,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721004,"statfs":{"total":773094113280,"available":772834308096,"internally_reserved":0,"allocated":8540160,"data_stored":4479048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.742829"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.627043+0000","last_change":"2024-09-17T03:38:59.622728+0000","last_active":"2024-09-17T03:38:59.627043+0000","last_peered":"2024-09-17T03:38:59.627043+0000","last_clean":"2024-09-17T03:38:59.627043+0000","last_became_active":"2024-09-17T03:38:59.622444+0000","last_became_peered":"2024-09-17T03:38:59.622444+0000","last_unstale":"2024-09-17T03:38:59.627043+0000","last_undegraded":"2024-09-17T03:38:59.627043+0000","last_fullsized":"2024-09-17T03:38:59.627043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:26.316277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.636852+0000","last_change":"2024-09-17T03:38:59.626835+0000","last_active":"2024-09-17T03:38:59.636852+0000","last_peered":"2024-09-17T03:38:59.636852+0000","last_clean":"2024-09-17T03:38:59.636852+0000","last_became_active":"2024-09-17T03:38:59.625346+0000","last_became_peered":"2024-09-17T03:38:59.625346+0000","last_unstale":"2024-09-17T03:38:59.636852+0000","last_undegraded":"2024-09-17T03:38:59.636852+0000","last_fullsized":"2024-09-17T03:38:59.636852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:31.729920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640122+0000","last_change":"2024-09-17T03:38:59.632722+0000","last_active":"2024-09-17T03:38:59.640122+0000","last_peered":"2024-09-17T03:38:59.640122+0000","last_clean":"2024-09-17T03:38:59.640122+0000","last_became_active":"2024-09-17T03:38:59.632264+0000","last_became_peered":"2024-09-17T03:38:59.632264+0000","last_unstale":"2024-09-17T03:38:59.640122+0000","last_undegraded":"2024-09-17T03:38:59.640122+0000","last_fullsized":"2024-09-17T03:38:59.640122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:54.295364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628375+0000","last_change":"2024-09-17T03:38:59.621580+0000","last_active":"2024-09-17T03:38:59.628375+0000","last_peered":"2024-09-17T03:38:59.628375+0000","last_clean":"2024-09-17T03:38:59.628375+0000","last_became_active":"2024-09-17T03:38:59.621282+0000","last_became_peered":"2024-09-17T03:38:59.621282+0000","last_unstale":"2024-09-17T03:38:59.628375+0000","last_undegraded":"2024-09-17T03:38:59.628375+0000","last_fullsized":"2024-09-17T03:38:59.628375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:17.489683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.630154+0000","last_change":"2024-09-17T03:38:59.623113+0000","last_active":"2024-09-17T03:38:59.630154+0000","last_peered":"2024-09-17T03:38:59.630154+0000","last_clean":"2024-09-17T03:38:59.630154+0000","last_became_active":"2024-09-17T03:38:59.622830+0000","last_became_peered":"2024-09-17T03:38:59.622830+0000","last_unstale":"2024-09-17T03:38:59.630154+0000","last_undegraded":"2024-09-17T03:38:59.630154+0000","last_fullsized":"2024-09-17T03:38:59.630154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:05.284840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.638176+0000","last_change":"2024-09-17T03:38:59.630626+0000","last_active":"2024-09-17T03:38:59.638176+0000","last_peered":"2024-09-17T03:38:59.638176+0000","last_clean":"2024-09-17T03:38:59.638176+0000","last_became_active":"2024-09-17T03:38:59.630257+0000","last_became_peered":"2024-09-17T03:38:59.630257+0000","last_unstale":"2024-09-17T03:38:59.638176+0000","last_undegraded":"2024-09-17T03:38:59.638176+0000","last_fullsized":"2024-09-17T03:38:59.638176+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:35.449904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.620718+0000","last_change":"2024-09-17T03:38:59.614311+0000","last_active":"2024-09-17T03:38:59.620718+0000","last_peered":"2024-09-17T03:38:59.620718+0000","last_clean":"2024-09-17T03:38:59.620718+0000","last_became_active":"2024-09-17T03:38:59.614035+0000","last_became_peered":"2024-09-17T03:38:59.614035+0000","last_unstale":"2024-09-17T03:38:59.620718+0000","last_undegraded":"2024-09-17T03:38:59.620718+0000","last_fullsized":"2024-09-17T03:38:59.620718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:57.352693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.618471+0000","last_change":"2024-09-17T03:38:59.618155+0000","last_active":"2024-09-17T03:39:00.618471+0000","last_peered":"2024-09-17T03:39:00.618471+0000","last_clean":"2024-09-17T03:39:00.618471+0000","last_became_active":"2024-09-17T03:38:59.617827+0000","last_became_peered":"2024-09-17T03:38:59.617827+0000","last_unstale":"2024-09-17T03:39:00.618471+0000","last_undegraded":"2024-09-17T03:39:00.618471+0000","last_fullsized":"2024-09-17T03:39:00.618471+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:44.607598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.627905+0000","last_change":"2024-09-17T03:38:59.621773+0000","last_active":"2024-09-17T03:38:59.627905+0000","last_peered":"2024-09-17T03:38:59.627905+0000","last_clean":"2024-09-17T03:38:59.627905+0000","last_became_active":"2024-09-17T03:38:59.621447+0000","last_became_peered":"2024-09-17T03:38:59.621447+0000","last_unstale":"2024-09-17T03:38:59.627905+0000","last_undegraded":"2024-09-17T03:38:59.627905+0000","last_fullsized":"2024-09-17T03:38:59.627905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:59.672117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.621287+0000","last_change":"2024-09-17T03:38:59.618293+0000","last_active":"2024-09-17T03:38:59.621287+0000","last_peered":"2024-09-17T03:38:59.621287+0000","last_clean":"2024-09-17T03:38:59.621287+0000","last_became_active":"2024-09-17T03:38:59.617952+0000","last_became_peered":"2024-09-17T03:38:59.617952+0000","last_unstale":"2024-09-17T03:38:59.621287+0000","last_undegraded":"2024-09-17T03:38:59.621287+0000","last_fullsized":"2024-09-17T03:38:59.621287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:18.629243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.639985+0000","last_change":"2024-09-17T03:38:59.629280+0000","last_active":"2024-09-17T03:38:59.639985+0000","last_peered":"2024-09-17T03:38:59.639985+0000","last_clean":"2024-09-17T03:38:59.639985+0000","last_became_active":"2024-09-17T03:38:59.625503+0000","last_became_peered":"2024-09-17T03:38:59.625503+0000","last_unstale":"2024-09-17T03:38:59.639985+0000","last_undegraded":"2024-09-17T03:38:59.639985+0000","last_fullsized":"2024-09-17T03:38:59.639985+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:33.842673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.625217+0000","last_change":"2024-09-17T03:38:59.622389+0000","last_active":"2024-09-17T03:38:59.625217+0000","last_peered":"2024-09-17T03:38:59.625217+0000","last_clean":"2024-09-17T03:38:59.625217+0000","last_became_active":"2024-09-17T03:38:59.619048+0000","last_became_peered":"2024-09-17T03:38:59.619048+0000","last_unstale":"2024-09-17T03:38:59.625217+0000","last_undegraded":"2024-09-17T03:38:59.625217+0000","last_fullsized":"2024-09-17T03:38:59.625217+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:04.488288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629773+0000","last_change":"2024-09-17T03:38:59.623167+0000","last_active":"2024-09-17T03:38:59.629773+0000","last_peered":"2024-09-17T03:38:59.629773+0000","last_clean":"2024-09-17T03:38:59.629773+0000","last_became_active":"2024-09-17T03:38:59.622785+0000","last_became_peered":"2024-09-17T03:38:59.622785+0000","last_unstale":"2024-09-17T03:38:59.629773+0000","last_undegraded":"2024-09-17T03:38:59.629773+0000","last_fullsized":"2024-09-17T03:38:59.629773+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:05.489334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620318+0000","last_change":"2024-09-17T03:38:59.622111+0000","last_active":"2024-09-17T03:39:00.620318+0000","last_peered":"2024-09-17T03:39:00.620318+0000","last_clean":"2024-09-17T03:39:00.620318+0000","last_became_active":"2024-09-17T03:38:59.620569+0000","last_became_peered":"2024-09-17T03:38:59.620569+0000","last_unstale":"2024-09-17T03:39:00.620318+0000","last_undegraded":"2024-09-17T03:39:00.620318+0000","last_fullsized":"2024-09-17T03:39:00.620318+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:11.128337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.638118+0000","last_change":"2024-09-17T03:38:59.633561+0000","last_active":"2024-09-17T03:38:59.638118+0000","last_peered":"2024-09-17T03:38:59.638118+0000","last_clean":"2024-09-17T03:38:59.638118+0000","last_became_active":"2024-09-17T03:38:59.633290+0000","last_became_peered":"2024-09-17T03:38:59.633290+0000","last_unstale":"2024-09-17T03:38:59.638118+0000","last_undegraded":"2024-09-17T03:38:59.638118+0000","last_fullsized":"2024-09-17T03:38:59.638118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:06.149485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.622334+0000","last_change":"2024-09-17T03:38:59.618110+0000","last_active":"2024-09-17T03:38:59.622334+0000","last_peered":"2024-09-17T03:38:59.622334+0000","last_clean":"2024-09-17T03:38:59.622334+0000","last_became_active":"2024-09-17T03:38:59.617391+0000","last_became_peered":"2024-09-17T03:38:59.617391+0000","last_unstale":"2024-09-17T03:38:59.622334+0000","last_undegraded":"2024-09-17T03:38:59.622334+0000","last_fullsized":"2024-09-17T03:38:59.622334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:11.847989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.621011+0000","last_change":"2024-09-17T03:38:59.621735+0000","last_active":"2024-09-17T03:39:00.621011+0000","last_peered":"2024-09-17T03:39:00.621011+0000","last_clean":"2024-09-17T03:39:00.621011+0000","last_became_active":"2024-09-17T03:38:59.621423+0000","last_became_peered":"2024-09-17T03:38:59.621423+0000","last_unstale":"2024-09-17T03:39:00.621011+0000","last_undegraded":"2024-09-17T03:39:00.621011+0000","last_fullsized":"2024-09-17T03:39:00.621011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:58.920352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629630+0000","last_change":"2024-09-17T03:38:59.623797+0000","last_active":"2024-09-17T03:38:59.629630+0000","last_peered":"2024-09-17T03:38:59.629630+0000","last_clean":"2024-09-17T03:38:59.629630+0000","last_became_active":"2024-09-17T03:38:59.621369+0000","last_became_peered":"2024-09-17T03:38:59.621369+0000","last_unstale":"2024-09-17T03:38:59.629630+0000","last_undegraded":"2024-09-17T03:38:59.629630+0000","last_fullsized":"2024-09-17T03:38:59.629630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:25.028483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620793+0000","last_change":"2024-09-17T03:38:59.610983+0000","last_active":"2024-09-17T03:39:00.620793+0000","last_peered":"2024-09-17T03:39:00.620793+0000","last_clean":"2024-09-17T03:39:00.620793+0000","last_became_active":"2024-09-17T03:38:59.610665+0000","last_became_peered":"2024-09-17T03:38:59.610665+0000","last_unstale":"2024-09-17T03:39:00.620793+0000","last_undegraded":"2024-09-17T03:39:00.620793+0000","last_fullsized":"2024-09-17T03:39:00.620793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:34.511117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629089+0000","last_change":"2024-09-17T03:38:59.623770+0000","last_active":"2024-09-17T03:38:59.629089+0000","last_peered":"2024-09-17T03:38:59.629089+0000","last_clean":"2024-09-17T03:38:59.629089+0000","last_became_active":"2024-09-17T03:38:59.623422+0000","last_became_peered":"2024-09-17T03:38:59.623422+0000","last_unstale":"2024-09-17T03:38:59.629089+0000","last_undegraded":"2024-09-17T03:38:59.629089+0000","last_fullsized":"2024-09-17T03:38:59.629089+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:30.498051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.621304+0000","last_change":"2024-09-17T03:38:59.614677+0000","last_active":"2024-09-17T03:38:59.621304+0000","last_peered":"2024-09-17T03:38:59.621304+0000","last_clean":"2024-09-17T03:38:59.621304+0000","last_became_active":"2024-09-17T03:38:59.613498+0000","last_became_peered":"2024-09-17T03:38:59.613498+0000","last_unstale":"2024-09-17T03:38:59.621304+0000","last_undegraded":"2024-09-17T03:38:59.621304+0000","last_fullsized":"2024-09-17T03:38:59.621304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:08.782456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640142+0000","last_change":"2024-09-17T03:38:59.632508+0000","last_active":"2024-09-17T03:38:59.640142+0000","last_peered":"2024-09-17T03:38:59.640142+0000","last_clean":"2024-09-17T03:38:59.640142+0000","last_became_active":"2024-09-17T03:38:59.627322+0000","last_became_peered":"2024-09-17T03:38:59.627322+0000","last_unstale":"2024-09-17T03:38:59.640142+0000","last_undegraded":"2024-09-17T03:38:59.640142+0000","last_fullsized":"2024-09-17T03:38:59.640142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:16.544763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.636030+0000","last_change":"2024-09-17T03:38:59.627863+0000","last_active":"2024-09-17T03:38:59.636030+0000","last_peered":"2024-09-17T03:38:59.636030+0000","last_clean":"2024-09-17T03:38:59.636030+0000","last_became_active":"2024-09-17T03:38:59.627461+0000","last_became_peered":"2024-09-17T03:38:59.627461+0000","last_unstale":"2024-09-17T03:38:59.636030+0000","last_undegraded":"2024-09-17T03:38:59.636030+0000","last_fullsized":"2024-09-17T03:38:59.636030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:11.049338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629242+0000","last_change":"2024-09-17T03:38:59.623308+0000","last_active":"2024-09-17T03:38:59.629242+0000","last_peered":"2024-09-17T03:38:59.629242+0000","last_clean":"2024-09-17T03:38:59.629242+0000","last_became_active":"2024-09-17T03:38:59.622499+0000","last_became_peered":"2024-09-17T03:38:59.622499+0000","last_unstale":"2024-09-17T03:38:59.629242+0000","last_undegraded":"2024-09-17T03:38:59.629242+0000","last_fullsized":"2024-09-17T03:38:59.629242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:12.424780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.635436+0000","last_change":"2024-09-17T03:38:59.628263+0000","last_active":"2024-09-17T03:38:59.635436+0000","last_peered":"2024-09-17T03:38:59.635436+0000","last_clean":"2024-09-17T03:38:59.635436+0000","last_became_active":"2024-09-17T03:38:59.627860+0000","last_became_peered":"2024-09-17T03:38:59.627860+0000","last_unstale":"2024-09-17T03:38:59.635436+0000","last_undegraded":"2024-09-17T03:38:59.635436+0000","last_fullsized":"2024-09-17T03:38:59.635436+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:10.083178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629381+0000","last_change":"2024-09-17T03:38:59.624910+0000","last_active":"2024-09-17T03:38:59.629381+0000","last_peered":"2024-09-17T03:38:59.629381+0000","last_clean":"2024-09-17T03:38:59.629381+0000","last_became_active":"2024-09-17T03:38:59.624566+0000","last_became_peered":"2024-09-17T03:38:59.624566+0000","last_unstale":"2024-09-17T03:38:59.629381+0000","last_undegraded":"2024-09-17T03:38:59.629381+0000","last_fullsized":"2024-09-17T03:38:59.629381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:43.772833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.639817+0000","last_change":"2024-09-17T03:38:59.634017+0000","last_active":"2024-09-17T03:38:59.639817+0000","last_peered":"2024-09-17T03:38:59.639817+0000","last_clean":"2024-09-17T03:38:59.639817+0000","last_became_active":"2024-09-17T03:38:59.633694+0000","last_became_peered":"2024-09-17T03:38:59.633694+0000","last_unstale":"2024-09-17T03:38:59.639817+0000","last_undegraded":"2024-09-17T03:38:59.639817+0000","last_fullsized":"2024-09-17T03:38:59.639817+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:12.424780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.635645+0000","last_change":"2024-09-17T03:38:59.628738+0000","last_active":"2024-09-17T03:38:59.635645+0000","last_peered":"2024-09-17T03:38:59.635645+0000","last_clean":"2024-09-17T03:38:59.635645+0000","last_became_active":"2024-09-17T03:38:59.628448+0000","last_became_peered":"2024-09-17T03:38:59.628448+0000","last_unstale":"2024-09-17T03:38:59.635645+0000","last_undegraded":"2024-09-17T03:38:59.635645+0000","last_fullsized":"2024-09-17T03:38:59.635645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:29.786378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628883+0000","last_change":"2024-09-17T03:38:59.625715+0000","last_active":"2024-09-17T03:38:59.628883+0000","last_peered":"2024-09-17T03:38:59.628883+0000","last_clean":"2024-09-17T03:38:59.628883+0000","last_became_active":"2024-09-17T03:38:59.625408+0000","last_became_peered":"2024-09-17T03:38:59.625408+0000","last_unstale":"2024-09-17T03:38:59.628883+0000","last_undegraded":"2024-09-17T03:38:59.628883+0000","last_fullsized":"2024-09-17T03:38:59.628883+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:47.106119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.641053+0000","last_change":"2024-09-17T03:38:59.631837+0000","last_active":"2024-09-17T03:38:59.641053+0000","last_peered":"2024-09-17T03:38:59.641053+0000","last_clean":"2024-09-17T03:38:59.641053+0000","last_became_active":"2024-09-17T03:38:59.631449+0000","last_became_peered":"2024-09-17T03:38:59.631449+0000","last_unstale":"2024-09-17T03:38:59.641053+0000","last_undegraded":"2024-09-17T03:38:59.641053+0000","last_fullsized":"2024-09-17T03:38:59.641053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:34.087229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.636832+0000","last_change":"2024-09-17T03:38:59.625470+0000","last_active":"2024-09-17T03:38:59.636832+0000","last_peered":"2024-09-17T03:38:59.636832+0000","last_clean":"2024-09-17T03:38:59.636832+0000","last_became_active":"2024-09-17T03:38:59.625114+0000","last_became_peered":"2024-09-17T03:38:59.625114+0000","last_unstale":"2024-09-17T03:38:59.636832+0000","last_undegraded":"2024-09-17T03:38:59.636832+0000","last_fullsized":"2024-09-17T03:38:59.636832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:40.034423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.630640+0000","last_change":"2024-09-17T03:38:59.627401+0000","last_active":"2024-09-17T03:38:59.630640+0000","last_peered":"2024-09-17T03:38:59.630640+0000","last_clean":"2024-09-17T03:38:59.630640+0000","last_became_active":"2024-09-17T03:38:59.627088+0000","last_became_peered":"2024-09-17T03:38:59.627088+0000","last_unstale":"2024-09-17T03:38:59.630640+0000","last_undegraded":"2024-09-17T03:38:59.630640+0000","last_fullsized":"2024-09-17T03:38:59.630640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:46.005300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.626515+0000","last_change":"2024-09-17T03:38:59.614683+0000","last_active":"2024-09-17T03:38:59.626515+0000","last_peered":"2024-09-17T03:38:59.626515+0000","last_clean":"2024-09-17T03:38:59.626515+0000","last_became_active":"2024-09-17T03:38:59.614368+0000","last_became_peered":"2024-09-17T03:38:59.614368+0000","last_unstale":"2024-09-17T03:38:59.626515+0000","last_undegraded":"2024-09-17T03:38:59.626515+0000","last_fullsized":"2024-09-17T03:38:59.626515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:54.961129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"75'4","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.643591+0000","last_change":"2024-09-17T03:38:58.616647+0000","last_active":"2024-09-17T03:38:59.643591+0000","last_peered":"2024-09-17T03:38:59.643591+0000","last_clean":"2024-09-17T03:38:59.643591+0000","last_became_active":"2024-09-17T03:38:58.616168+0000","last_became_peered":"2024-09-17T03:38:58.616168+0000","last_unstale":"2024-09-17T03:38:59.643591+0000","last_undegraded":"2024-09-17T03:38:59.643591+0000","last_fullsized":"2024-09-17T03:38:59.643591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:44.856274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629143+0000","last_change":"2024-09-17T03:38:59.614832+0000","last_active":"2024-09-17T03:38:59.629143+0000","last_peered":"2024-09-17T03:38:59.629143+0000","last_clean":"2024-09-17T03:38:59.629143+0000","last_became_active":"2024-09-17T03:38:59.614452+0000","last_became_peered":"2024-09-17T03:38:59.614452+0000","last_unstale":"2024-09-17T03:38:59.629143+0000","last_undegraded":"2024-09-17T03:38:59.629143+0000","last_fullsized":"2024-09-17T03:38:59.629143+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:13.011933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640156+0000","last_change":"2024-09-17T03:38:58.615216+0000","last_active":"2024-09-17T03:38:59.640156+0000","last_peered":"2024-09-17T03:38:59.640156+0000","last_clean":"2024-09-17T03:38:59.640156+0000","last_became_active":"2024-09-17T03:38:58.614870+0000","last_became_peered":"2024-09-17T03:38:58.614870+0000","last_unstale":"2024-09-17T03:38:59.640156+0000","last_undegraded":"2024-09-17T03:38:59.640156+0000","last_fullsized":"2024-09-17T03:38:59.640156+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:01.203269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628724+0000","last_change":"2024-09-17T03:38:59.626346+0000","last_active":"2024-09-17T03:38:59.628724+0000","last_peered":"2024-09-17T03:38:59.628724+0000","last_clean":"2024-09-17T03:38:59.628724+0000","last_became_active":"2024-09-17T03:38:59.626007+0000","last_became_peered":"2024-09-17T03:38:59.626007+0000","last_unstale":"2024-09-17T03:38:59.628724+0000","last_undegraded":"2024-09-17T03:38:59.628724+0000","last_fullsized":"2024-09-17T03:38:59.628724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:56.900909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.645092+0000","last_change":"2024-09-17T03:38:58.623559+0000","last_active":"2024-09-17T03:38:59.645092+0000","last_peered":"2024-09-17T03:38:59.645092+0000","last_clean":"2024-09-17T03:38:59.645092+0000","last_became_active":"2024-09-17T03:38:58.623145+0000","last_became_peered":"2024-09-17T03:38:58.623145+0000","last_unstale":"2024-09-17T03:38:59.645092+0000","last_undegraded":"2024-09-17T03:38:59.645092+0000","last_fullsized":"2024-09-17T03:38:59.645092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:45.132756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.630134+0000","last_change":"2024-09-17T03:38:59.626344+0000","last_active":"2024-09-17T03:38:59.630134+0000","last_peered":"2024-09-17T03:38:59.630134+0000","last_clean":"2024-09-17T03:38:59.630134+0000","last_became_active":"2024-09-17T03:38:59.625377+0000","last_became_peered":"2024-09-17T03:38:59.625377+0000","last_unstale":"2024-09-17T03:38:59.630134+0000","last_undegraded":"2024-09-17T03:38:59.630134+0000","last_fullsized":"2024-09-17T03:38:59.630134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:31.355226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.642473+0000","last_change":"2024-09-17T03:38:58.610832+0000","last_active":"2024-09-17T03:38:59.642473+0000","last_peered":"2024-09-17T03:38:59.642473+0000","last_clean":"2024-09-17T03:38:59.642473+0000","last_became_active":"2024-09-17T03:38:58.610502+0000","last_became_peered":"2024-09-17T03:38:58.610502+0000","last_unstale":"2024-09-17T03:38:59.642473+0000","last_undegraded":"2024-09-17T03:38:59.642473+0000","last_fullsized":"2024-09-17T03:38:59.642473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:15.537933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629060+0000","last_change":"2024-09-17T03:38:59.620754+0000","last_active":"2024-09-17T03:38:59.629060+0000","last_peered":"2024-09-17T03:38:59.629060+0000","last_clean":"2024-09-17T03:38:59.629060+0000","last_became_active":"2024-09-17T03:38:59.619890+0000","last_became_peered":"2024-09-17T03:38:59.619890+0000","last_unstale":"2024-09-17T03:38:59.629060+0000","last_undegraded":"2024-09-17T03:38:59.629060+0000","last_fullsized":"2024-09-17T03:38:59.629060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:21.377897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.642208+0000","last_change":"2024-09-17T03:38:58.614344+0000","last_active":"2024-09-17T03:38:59.642208+0000","last_peered":"2024-09-17T03:38:59.642208+0000","last_clean":"2024-09-17T03:38:59.642208+0000","last_became_active":"2024-09-17T03:38:58.613857+0000","last_became_peered":"2024-09-17T03:38:58.613857+0000","last_unstale":"2024-09-17T03:38:59.642208+0000","last_undegraded":"2024-09-17T03:38:59.642208+0000","last_fullsized":"2024-09-17T03:38:59.642208+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:53.288535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.636967+0000","last_change":"2024-09-17T03:38:59.625038+0000","last_active":"2024-09-17T03:38:59.636967+0000","last_peered":"2024-09-17T03:38:59.636967+0000","last_clean":"2024-09-17T03:38:59.636967+0000","last_became_active":"2024-09-17T03:38:59.624683+0000","last_became_peered":"2024-09-17T03:38:59.624683+0000","last_unstale":"2024-09-17T03:38:59.636967+0000","last_undegraded":"2024-09-17T03:38:59.636967+0000","last_fullsized":"2024-09-17T03:38:59.636967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:17.840111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.637626+0000","last_change":"2024-09-17T03:38:58.618369+0000","last_active":"2024-09-17T03:38:59.637626+0000","last_peered":"2024-09-17T03:38:59.637626+0000","last_clean":"2024-09-17T03:38:59.637626+0000","last_became_active":"2024-09-17T03:38:58.618049+0000","last_became_peered":"2024-09-17T03:38:58.618049+0000","last_unstale":"2024-09-17T03:38:59.637626+0000","last_undegraded":"2024-09-17T03:38:59.637626+0000","last_fullsized":"2024-09-17T03:38:59.637626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:12.759055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.625861+0000","last_change":"2024-09-17T03:38:59.622677+0000","last_active":"2024-09-17T03:38:59.625861+0000","last_peered":"2024-09-17T03:38:59.625861+0000","last_clean":"2024-09-17T03:38:59.625861+0000","last_became_active":"2024-09-17T03:38:59.622329+0000","last_became_peered":"2024-09-17T03:38:59.622329+0000","last_unstale":"2024-09-17T03:38:59.625861+0000","last_undegraded":"2024-09-17T03:38:59.625861+0000","last_fullsized":"2024-09-17T03:38:59.625861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:00.902867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.618356+0000","last_change":"2024-09-17T03:38:58.615960+0000","last_active":"2024-09-17T03:39:00.618356+0000","last_peered":"2024-09-17T03:39:00.618356+0000","last_clean":"2024-09-17T03:39:00.618356+0000","last_became_active":"2024-09-17T03:38:58.615663+0000","last_became_peered":"2024-09-17T03:38:58.615663+0000","last_unstale":"2024-09-17T03:39:00.618356+0000","last_undegraded":"2024-09-17T03:39:00.618356+0000","last_fullsized":"2024-09-17T03:39:00.618356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:59.318973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.633287+0000","last_change":"2024-09-17T03:38:59.626632+0000","last_active":"2024-09-17T03:38:59.633287+0000","last_peered":"2024-09-17T03:38:59.633287+0000","last_clean":"2024-09-17T03:38:59.633287+0000","last_became_active":"2024-09-17T03:38:59.625947+0000","last_became_peered":"2024-09-17T03:38:59.625947+0000","last_unstale":"2024-09-17T03:38:59.633287+0000","last_undegraded":"2024-09-17T03:38:59.633287+0000","last_fullsized":"2024-09-17T03:38:59.633287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:06.262397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.610470+0000","last_change":"2024-09-17T03:38:58.620173+0000","last_active":"2024-09-17T03:38:59.610470+0000","last_peered":"2024-09-17T03:38:59.610470+0000","last_clean":"2024-09-17T03:38:59.610470+0000","last_became_active":"2024-09-17T03:38:58.619844+0000","last_became_peered":"2024-09-17T03:38:58.619844+0000","last_unstale":"2024-09-17T03:38:59.610470+0000","last_undegraded":"2024-09-17T03:38:59.610470+0000","last_fullsized":"2024-09-17T03:38:59.610470+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:16.482854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629167+0000","last_change":"2024-09-17T03:38:59.620416+0000","last_active":"2024-09-17T03:38:59.629167+0000","last_peered":"2024-09-17T03:38:59.629167+0000","last_clean":"2024-09-17T03:38:59.629167+0000","last_became_active":"2024-09-17T03:38:59.620041+0000","last_became_peered":"2024-09-17T03:38:59.620041+0000","last_unstale":"2024-09-17T03:38:59.629167+0000","last_undegraded":"2024-09-17T03:38:59.629167+0000","last_fullsized":"2024-09-17T03:38:59.629167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:46.005300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.607744+0000","last_change":"2024-09-17T03:38:58.622597+0000","last_active":"2024-09-17T03:38:59.607744+0000","last_peered":"2024-09-17T03:38:59.607744+0000","last_clean":"2024-09-17T03:38:59.607744+0000","last_became_active":"2024-09-17T03:38:58.622138+0000","last_became_peered":"2024-09-17T03:38:58.622138+0000","last_unstale":"2024-09-17T03:38:59.607744+0000","last_undegraded":"2024-09-17T03:38:59.607744+0000","last_fullsized":"2024-09-17T03:38:59.607744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:01.115479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.624593+0000","last_change":"2024-09-17T03:38:59.620811+0000","last_active":"2024-09-17T03:38:59.624593+0000","last_peered":"2024-09-17T03:38:59.624593+0000","last_clean":"2024-09-17T03:38:59.624593+0000","last_became_active":"2024-09-17T03:38:59.620457+0000","last_became_peered":"2024-09-17T03:38:59.620457+0000","last_unstale":"2024-09-17T03:38:59.624593+0000","last_undegraded":"2024-09-17T03:38:59.624593+0000","last_fullsized":"2024-09-17T03:38:59.624593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:21.429128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.605114+0000","last_change":"2024-09-17T03:38:58.624028+0000","last_active":"2024-09-17T03:38:59.605114+0000","last_peered":"2024-09-17T03:38:59.605114+0000","last_clean":"2024-09-17T03:38:59.605114+0000","last_became_active":"2024-09-17T03:38:58.623676+0000","last_became_peered":"2024-09-17T03:38:58.623676+0000","last_unstale":"2024-09-17T03:38:59.605114+0000","last_undegraded":"2024-09-17T03:38:59.605114+0000","last_fullsized":"2024-09-17T03:38:59.605114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:13.650461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620809+0000","last_change":"2024-09-17T03:38:59.626400+0000","last_active":"2024-09-17T03:39:00.620809+0000","last_peered":"2024-09-17T03:39:00.620809+0000","last_clean":"2024-09-17T03:39:00.620809+0000","last_became_active":"2024-09-17T03:38:59.620150+0000","last_became_peered":"2024-09-17T03:38:59.620150+0000","last_unstale":"2024-09-17T03:39:00.620809+0000","last_undegraded":"2024-09-17T03:39:00.620809+0000","last_fullsized":"2024-09-17T03:39:00.620809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:26.279085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"75'3","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640838+0000","last_change":"2024-09-17T03:38:58.624672+0000","last_active":"2024-09-17T03:38:59.640838+0000","last_peered":"2024-09-17T03:38:59.640838+0000","last_clean":"2024-09-17T03:38:59.640838+0000","last_became_active":"2024-09-17T03:38:58.624337+0000","last_became_peered":"2024-09-17T03:38:58.624337+0000","last_unstale":"2024-09-17T03:38:59.640838+0000","last_undegraded":"2024-09-17T03:38:59.640838+0000","last_fullsized":"2024-09-17T03:38:59.640838+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:39.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628853+0000","last_change":"2024-09-17T03:38:59.621179+0000","last_active":"2024-09-17T03:38:59.628853+0000","last_peered":"2024-09-17T03:38:59.628853+0000","last_clean":"2024-09-17T03:38:59.628853+0000","last_became_active":"2024-09-17T03:38:59.620871+0000","last_became_peered":"2024-09-17T03:38:59.620871+0000","last_unstale":"2024-09-17T03:38:59.628853+0000","last_undegraded":"2024-09-17T03:38:59.628853+0000","last_fullsized":"2024-09-17T03:38:59.628853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:13.628847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"75'6","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.647102+0000","last_change":"2024-09-17T03:38:58.624381+0000","last_active":"2024-09-17T03:38:59.647102+0000","last_peered":"2024-09-17T03:38:59.647102+0000","last_clean":"2024-09-17T03:38:59.647102+0000","last_became_active":"2024-09-17T03:38:58.624066+0000","last_became_peered":"2024-09-17T03:38:58.624066+0000","last_unstale":"2024-09-17T03:38:59.647102+0000","last_undegraded":"2024-09-17T03:38:59.647102+0000","last_fullsized":"2024-09-17T03:38:59.647102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:54.940938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628345+0000","last_change":"2024-09-17T03:38:59.621472+0000","last_active":"2024-09-17T03:38:59.628345+0000","last_peered":"2024-09-17T03:38:59.628345+0000","last_clean":"2024-09-17T03:38:59.628345+0000","last_became_active":"2024-09-17T03:38:59.621173+0000","last_became_peered":"2024-09-17T03:38:59.621173+0000","last_unstale":"2024-09-17T03:38:59.628345+0000","last_undegraded":"2024-09-17T03:38:59.628345+0000","last_fullsized":"2024-09-17T03:38:59.628345+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:19.536206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.644951+0000","last_change":"2024-09-17T03:38:58.621818+0000","last_active":"2024-09-17T03:38:59.644951+0000","last_peered":"2024-09-17T03:38:59.644951+0000","last_clean":"2024-09-17T03:38:59.644951+0000","last_became_active":"2024-09-17T03:38:58.619691+0000","last_became_peered":"2024-09-17T03:38:58.619691+0000","last_unstale":"2024-09-17T03:38:59.644951+0000","last_undegraded":"2024-09-17T03:38:59.644951+0000","last_fullsized":"2024-09-17T03:38:59.644951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:16.294537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.644979+0000","last_change":"2024-09-17T03:38:59.641164+0000","last_active":"2024-09-17T03:38:59.644979+0000","last_peered":"2024-09-17T03:38:59.644979+0000","last_clean":"2024-09-17T03:38:59.644979+0000","last_became_active":"2024-09-17T03:38:59.639067+0000","last_became_peered":"2024-09-17T03:38:59.639067+0000","last_unstale":"2024-09-17T03:38:59.644979+0000","last_undegraded":"2024-09-17T03:38:59.644979+0000","last_fullsized":"2024-09-17T03:38:59.644979+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:15.912773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.606184+0000","last_change":"2024-09-17T03:38:58.620658+0000","last_active":"2024-09-17T03:38:59.606184+0000","last_peered":"2024-09-17T03:38:59.606184+0000","last_clean":"2024-09-17T03:38:59.606184+0000","last_became_active":"2024-09-17T03:38:58.620332+0000","last_became_peered":"2024-09-17T03:38:58.620332+0000","last_unstale":"2024-09-17T03:38:59.606184+0000","last_undegraded":"2024-09-17T03:38:59.606184+0000","last_fullsized":"2024-09-17T03:38:59.606184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:48.124704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.628928+0000","last_change":"2024-09-17T03:38:59.625995+0000","last_active":"2024-09-17T03:38:59.628928+0000","last_peered":"2024-09-17T03:38:59.628928+0000","last_clean":"2024-09-17T03:38:59.628928+0000","last_became_active":"2024-09-17T03:38:59.625476+0000","last_became_peered":"2024-09-17T03:38:59.625476+0000","last_unstale":"2024-09-17T03:38:59.628928+0000","last_undegraded":"2024-09-17T03:38:59.628928+0000","last_fullsized":"2024-09-17T03:38:59.628928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:51.912010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.601476+0000","last_change":"2024-09-17T03:38:58.612692+0000","last_active":"2024-09-17T03:38:59.601476+0000","last_peered":"2024-09-17T03:38:59.601476+0000","last_clean":"2024-09-17T03:38:59.601476+0000","last_became_active":"2024-09-17T03:38:58.612399+0000","last_became_peered":"2024-09-17T03:38:58.612399+0000","last_unstale":"2024-09-17T03:38:59.601476+0000","last_undegraded":"2024-09-17T03:38:59.601476+0000","last_fullsized":"2024-09-17T03:38:59.601476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:46.339786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.641109+0000","last_change":"2024-09-17T03:38:59.635915+0000","last_active":"2024-09-17T03:38:59.641109+0000","last_peered":"2024-09-17T03:38:59.641109+0000","last_clean":"2024-09-17T03:38:59.641109+0000","last_became_active":"2024-09-17T03:38:59.631731+0000","last_became_peered":"2024-09-17T03:38:59.631731+0000","last_unstale":"2024-09-17T03:38:59.641109+0000","last_undegraded":"2024-09-17T03:38:59.641109+0000","last_fullsized":"2024-09-17T03:38:59.641109+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:05.773787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"75'8","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.643930+0000","last_change":"2024-09-17T03:38:58.623796+0000","last_active":"2024-09-17T03:38:59.643930+0000","last_peered":"2024-09-17T03:38:59.643930+0000","last_clean":"2024-09-17T03:38:59.643930+0000","last_became_active":"2024-09-17T03:38:58.623428+0000","last_became_peered":"2024-09-17T03:38:58.623428+0000","last_unstale":"2024-09-17T03:38:59.643930+0000","last_undegraded":"2024-09-17T03:38:59.643930+0000","last_fullsized":"2024-09-17T03:38:59.643930+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:40.639837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.635656+0000","last_change":"2024-09-17T03:38:59.626258+0000","last_active":"2024-09-17T03:38:59.635656+0000","last_peered":"2024-09-17T03:38:59.635656+0000","last_clean":"2024-09-17T03:38:59.635656+0000","last_became_active":"2024-09-17T03:38:59.624225+0000","last_became_peered":"2024-09-17T03:38:59.624225+0000","last_unstale":"2024-09-17T03:38:59.635656+0000","last_undegraded":"2024-09-17T03:38:59.635656+0000","last_fullsized":"2024-09-17T03:38:59.635656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:54.225889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.643118+0000","last_change":"2024-09-17T03:38:58.618371+0000","last_active":"2024-09-17T03:38:59.643118+0000","last_peered":"2024-09-17T03:38:59.643118+0000","last_clean":"2024-09-17T03:38:59.643118+0000","last_became_active":"2024-09-17T03:38:58.618097+0000","last_became_peered":"2024-09-17T03:38:58.618097+0000","last_unstale":"2024-09-17T03:38:59.643118+0000","last_undegraded":"2024-09-17T03:38:59.643118+0000","last_fullsized":"2024-09-17T03:38:59.643118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:31.172157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640066+0000","last_change":"2024-09-17T03:38:59.631731+0000","last_active":"2024-09-17T03:38:59.640066+0000","last_peered":"2024-09-17T03:38:59.640066+0000","last_clean":"2024-09-17T03:38:59.640066+0000","last_became_active":"2024-09-17T03:38:59.631421+0000","last_became_peered":"2024-09-17T03:38:59.631421+0000","last_unstale":"2024-09-17T03:38:59.640066+0000","last_undegraded":"2024-09-17T03:38:59.640066+0000","last_fullsized":"2024-09-17T03:38:59.640066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:49.131534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.643051+0000","last_change":"2024-09-17T03:38:58.620262+0000","last_active":"2024-09-17T03:38:59.643051+0000","last_peered":"2024-09-17T03:38:59.643051+0000","last_clean":"2024-09-17T03:38:59.643051+0000","last_became_active":"2024-09-17T03:38:58.619928+0000","last_became_peered":"2024-09-17T03:38:58.619928+0000","last_unstale":"2024-09-17T03:38:59.643051+0000","last_undegraded":"2024-09-17T03:38:59.643051+0000","last_fullsized":"2024-09-17T03:38:59.643051+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:05.142655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620595+0000","last_change":"2024-09-17T03:38:59.627911+0000","last_active":"2024-09-17T03:39:00.620595+0000","last_peered":"2024-09-17T03:39:00.620595+0000","last_clean":"2024-09-17T03:39:00.620595+0000","last_became_active":"2024-09-17T03:38:59.627535+0000","last_became_peered":"2024-09-17T03:38:59.627535+0000","last_unstale":"2024-09-17T03:39:00.620595+0000","last_undegraded":"2024-09-17T03:39:00.620595+0000","last_fullsized":"2024-09-17T03:39:00.620595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:54.665460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"75'1","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.641770+0000","last_change":"2024-09-17T03:38:58.610413+0000","last_active":"2024-09-17T03:38:59.641770+0000","last_peered":"2024-09-17T03:38:59.641770+0000","last_clean":"2024-09-17T03:38:59.641770+0000","last_became_active":"2024-09-17T03:38:58.610096+0000","last_became_peered":"2024-09-17T03:38:58.610096+0000","last_unstale":"2024-09-17T03:38:59.641770+0000","last_undegraded":"2024-09-17T03:38:59.641770+0000","last_fullsized":"2024-09-17T03:38:59.641770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:59.485976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.622589+0000","last_change":"2024-09-17T03:38:59.610358+0000","last_active":"2024-09-17T03:38:59.622589+0000","last_peered":"2024-09-17T03:38:59.622589+0000","last_clean":"2024-09-17T03:38:59.622589+0000","last_became_active":"2024-09-17T03:38:59.609943+0000","last_became_peered":"2024-09-17T03:38:59.609943+0000","last_unstale":"2024-09-17T03:38:59.622589+0000","last_undegraded":"2024-09-17T03:38:59.622589+0000","last_fullsized":"2024-09-17T03:38:59.622589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:52.510341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.603093+0000","last_change":"2024-09-17T03:38:58.611065+0000","last_active":"2024-09-17T03:38:59.603093+0000","last_peered":"2024-09-17T03:38:59.603093+0000","last_clean":"2024-09-17T03:38:59.603093+0000","last_became_active":"2024-09-17T03:38:58.610766+0000","last_became_peered":"2024-09-17T03:38:58.610766+0000","last_unstale":"2024-09-17T03:38:59.603093+0000","last_undegraded":"2024-09-17T03:38:59.603093+0000","last_fullsized":"2024-09-17T03:38:59.603093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:06.504742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.635320+0000","last_change":"2024-09-17T03:38:59.624866+0000","last_active":"2024-09-17T03:38:59.635320+0000","last_peered":"2024-09-17T03:38:59.635320+0000","last_clean":"2024-09-17T03:38:59.635320+0000","last_became_active":"2024-09-17T03:38:59.621691+0000","last_became_peered":"2024-09-17T03:38:59.621691+0000","last_unstale":"2024-09-17T03:38:59.635320+0000","last_undegraded":"2024-09-17T03:38:59.635320+0000","last_fullsized":"2024-09-17T03:38:59.635320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:45.163607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640842+0000","last_change":"2024-09-17T03:38:58.619380+0000","last_active":"2024-09-17T03:38:59.640842+0000","last_peered":"2024-09-17T03:38:59.640842+0000","last_clean":"2024-09-17T03:38:59.640842+0000","last_became_active":"2024-09-17T03:38:58.619016+0000","last_became_peered":"2024-09-17T03:38:58.619016+0000","last_unstale":"2024-09-17T03:38:59.640842+0000","last_undegraded":"2024-09-17T03:38:59.640842+0000","last_fullsized":"2024-09-17T03:38:59.640842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:30.348396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.631638+0000","last_change":"2024-09-17T03:38:59.622349+0000","last_active":"2024-09-17T03:38:59.631638+0000","last_peered":"2024-09-17T03:38:59.631638+0000","last_clean":"2024-09-17T03:38:59.631638+0000","last_became_active":"2024-09-17T03:38:59.621613+0000","last_became_peered":"2024-09-17T03:38:59.621613+0000","last_unstale":"2024-09-17T03:38:59.631638+0000","last_undegraded":"2024-09-17T03:38:59.631638+0000","last_fullsized":"2024-09-17T03:38:59.631638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:23.543136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620002+0000","last_change":"2024-09-17T03:38:58.610030+0000","last_active":"2024-09-17T03:39:00.620002+0000","last_peered":"2024-09-17T03:39:00.620002+0000","last_clean":"2024-09-17T03:39:00.620002+0000","last_became_active":"2024-09-17T03:38:58.609601+0000","last_became_peered":"2024-09-17T03:38:58.609601+0000","last_unstale":"2024-09-17T03:39:00.620002+0000","last_undegraded":"2024-09-17T03:39:00.620002+0000","last_fullsized":"2024-09-17T03:39:00.620002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:12.964590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.633320+0000","last_change":"2024-09-17T03:38:59.626921+0000","last_active":"2024-09-17T03:38:59.633320+0000","last_peered":"2024-09-17T03:38:59.633320+0000","last_clean":"2024-09-17T03:38:59.633320+0000","last_became_active":"2024-09-17T03:38:59.626360+0000","last_became_peered":"2024-09-17T03:38:59.626360+0000","last_unstale":"2024-09-17T03:38:59.633320+0000","last_undegraded":"2024-09-17T03:38:59.633320+0000","last_fullsized":"2024-09-17T03:38:59.633320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:58.097943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.610938+0000","last_change":"2024-09-17T03:38:58.620060+0000","last_active":"2024-09-17T03:38:59.610938+0000","last_peered":"2024-09-17T03:38:59.610938+0000","last_clean":"2024-09-17T03:38:59.610938+0000","last_became_active":"2024-09-17T03:38:58.619601+0000","last_became_peered":"2024-09-17T03:38:58.619601+0000","last_unstale":"2024-09-17T03:38:59.610938+0000","last_undegraded":"2024-09-17T03:38:59.610938+0000","last_fullsized":"2024-09-17T03:38:59.610938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:42.766003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.639747+0000","last_change":"2024-09-17T03:38:59.633324+0000","last_active":"2024-09-17T03:38:59.639747+0000","last_peered":"2024-09-17T03:38:59.639747+0000","last_clean":"2024-09-17T03:38:59.639747+0000","last_became_active":"2024-09-17T03:38:59.633025+0000","last_became_peered":"2024-09-17T03:38:59.633025+0000","last_unstale":"2024-09-17T03:38:59.639747+0000","last_undegraded":"2024-09-17T03:38:59.639747+0000","last_fullsized":"2024-09-17T03:38:59.639747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:05.489334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"75'2","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.644171+0000","last_change":"2024-09-17T03:38:58.621296+0000","last_active":"2024-09-17T03:38:59.644171+0000","last_peered":"2024-09-17T03:38:59.644171+0000","last_clean":"2024-09-17T03:38:59.644171+0000","last_became_active":"2024-09-17T03:38:58.617586+0000","last_became_peered":"2024-09-17T03:38:58.617586+0000","last_unstale":"2024-09-17T03:38:59.644171+0000","last_undegraded":"2024-09-17T03:38:59.644171+0000","last_fullsized":"2024-09-17T03:38:59.644171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:42.214425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.640952+0000","last_change":"2024-09-17T03:38:59.633778+0000","last_active":"2024-09-17T03:38:59.640952+0000","last_peered":"2024-09-17T03:38:59.640952+0000","last_clean":"2024-09-17T03:38:59.640952+0000","last_became_active":"2024-09-17T03:38:59.633390+0000","last_became_peered":"2024-09-17T03:38:59.633390+0000","last_unstale":"2024-09-17T03:38:59.640952+0000","last_undegraded":"2024-09-17T03:38:59.640952+0000","last_fullsized":"2024-09-17T03:38:59.640952+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:44.631255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.616163+0000","last_change":"2024-09-17T03:38:58.623604+0000","last_active":"2024-09-17T03:38:59.616163+0000","last_peered":"2024-09-17T03:38:59.616163+0000","last_clean":"2024-09-17T03:38:59.616163+0000","last_became_active":"2024-09-17T03:38:58.623299+0000","last_became_peered":"2024-09-17T03:38:58.623299+0000","last_unstale":"2024-09-17T03:38:59.616163+0000","last_undegraded":"2024-09-17T03:38:59.616163+0000","last_fullsized":"2024-09-17T03:38:59.616163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:00.760554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.629680+0000","last_change":"2024-09-17T03:38:59.627493+0000","last_active":"2024-09-17T03:38:59.629680+0000","last_peered":"2024-09-17T03:38:59.629680+0000","last_clean":"2024-09-17T03:38:59.629680+0000","last_became_active":"2024-09-17T03:38:59.625545+0000","last_became_peered":"2024-09-17T03:38:59.625545+0000","last_unstale":"2024-09-17T03:38:59.629680+0000","last_undegraded":"2024-09-17T03:38:59.629680+0000","last_fullsized":"2024-09-17T03:38:59.629680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:10.990480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.603099+0000","last_change":"2024-09-17T03:38:58.623877+0000","last_active":"2024-09-17T03:38:59.603099+0000","last_peered":"2024-09-17T03:38:59.603099+0000","last_clean":"2024-09-17T03:38:59.603099+0000","last_became_active":"2024-09-17T03:38:58.623599+0000","last_became_peered":"2024-09-17T03:38:58.623599+0000","last_unstale":"2024-09-17T03:38:59.603099+0000","last_undegraded":"2024-09-17T03:38:59.603099+0000","last_fullsized":"2024-09-17T03:38:59.603099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:28.355846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T03:39:00.620868+0000","last_change":"2024-09-17T03:38:59.622372+0000","last_active":"2024-09-17T03:39:00.620868+0000","last_peered":"2024-09-17T03:39:00.620868+0000","last_clean":"2024-09-17T03:39:00.620868+0000","last_became_active":"2024-09-17T03:38:59.622042+0000","last_became_peered":"2024-09-17T03:38:59.622042+0000","last_unstale":"2024-09-17T03:39:00.620868+0000","last_undegraded":"2024-09-17T03:39:00.620868+0000","last_fullsized":"2024-09-17T03:39:00.620868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:34.803509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.604735+0000","last_change":"2024-09-17T03:38:58.614203+0000","last_active":"2024-09-17T03:38:59.604735+0000","last_peered":"2024-09-17T03:38:59.604735+0000","last_clean":"2024-09-17T03:38:59.604735+0000","last_became_active":"2024-09-17T03:38:58.613919+0000","last_became_peered":"2024-09-17T03:38:58.613919+0000","last_unstale":"2024-09-17T03:38:59.604735+0000","last_undegraded":"2024-09-17T03:38:59.604735+0000","last_fullsized":"2024-09-17T03:38:59.604735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:53.855762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.622697+0000","last_change":"2024-09-17T03:38:59.612983+0000","last_active":"2024-09-17T03:38:59.622697+0000","last_peered":"2024-09-17T03:38:59.622697+0000","last_clean":"2024-09-17T03:38:59.622697+0000","last_became_active":"2024-09-17T03:38:59.612500+0000","last_became_peered":"2024-09-17T03:38:59.612500+0000","last_unstale":"2024-09-17T03:38:59.622697+0000","last_undegraded":"2024-09-17T03:38:59.622697+0000","last_fullsized":"2024-09-17T03:38:59.622697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:27.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.604369+0000","last_change":"2024-09-17T03:38:58.613480+0000","last_active":"2024-09-17T03:38:59.604369+0000","last_peered":"2024-09-17T03:38:59.604369+0000","last_clean":"2024-09-17T03:38:59.604369+0000","last_became_active":"2024-09-17T03:38:58.613170+0000","last_became_peered":"2024-09-17T03:38:58.613170+0000","last_unstale":"2024-09-17T03:38:59.604369+0000","last_undegraded":"2024-09-17T03:38:59.604369+0000","last_fullsized":"2024-09-17T03:38:59.604369+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:40.579197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.639786+0000","last_change":"2024-09-17T03:38:59.632053+0000","last_active":"2024-09-17T03:38:59.639786+0000","last_peered":"2024-09-17T03:38:59.639786+0000","last_clean":"2024-09-17T03:38:59.639786+0000","last_became_active":"2024-09-17T03:38:59.631699+0000","last_became_peered":"2024-09-17T03:38:59.631699+0000","last_unstale":"2024-09-17T03:38:59.639786+0000","last_undegraded":"2024-09-17T03:38:59.639786+0000","last_fullsized":"2024-09-17T03:38:59.639786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:09.189955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.617898+0000","last_change":"2024-09-17T03:38:58.621698+0000","last_active":"2024-09-17T03:38:59.617898+0000","last_peered":"2024-09-17T03:38:59.617898+0000","last_clean":"2024-09-17T03:38:59.617898+0000","last_became_active":"2024-09-17T03:38:58.621128+0000","last_became_peered":"2024-09-17T03:38:58.621128+0000","last_unstale":"2024-09-17T03:38:59.617898+0000","last_undegraded":"2024-09-17T03:38:59.617898+0000","last_fullsized":"2024-09-17T03:38:59.617898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:02.991335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.627939+0000","last_change":"2024-09-17T03:38:59.621336+0000","last_active":"2024-09-17T03:38:59.627939+0000","last_peered":"2024-09-17T03:38:59.627939+0000","last_clean":"2024-09-17T03:38:59.627939+0000","last_became_active":"2024-09-17T03:38:59.621006+0000","last_became_peered":"2024-09-17T03:38:59.621006+0000","last_unstale":"2024-09-17T03:38:59.627939+0000","last_undegraded":"2024-09-17T03:38:59.627939+0000","last_fullsized":"2024-09-17T03:38:59.627939+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:09.189955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.607162+0000","last_change":"2024-09-17T03:38:58.618294+0000","last_active":"2024-09-17T03:38:59.607162+0000","last_peered":"2024-09-17T03:38:59.607162+0000","last_clean":"2024-09-17T03:38:59.607162+0000","last_became_active":"2024-09-17T03:38:58.618008+0000","last_became_peered":"2024-09-17T03:38:58.618008+0000","last_unstale":"2024-09-17T03:38:59.607162+0000","last_undegraded":"2024-09-17T03:38:59.607162+0000","last_fullsized":"2024-09-17T03:38:59.607162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:36.547395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.637546+0000","last_change":"2024-09-17T03:38:59.630566+0000","last_active":"2024-09-17T03:38:59.637546+0000","last_peered":"2024-09-17T03:38:59.637546+0000","last_clean":"2024-09-17T03:38:59.637546+0000","last_became_active":"2024-09-17T03:38:59.627186+0000","last_became_peered":"2024-09-17T03:38:59.627186+0000","last_unstale":"2024-09-17T03:38:59.637546+0000","last_undegraded":"2024-09-17T03:38:59.637546+0000","last_fullsized":"2024-09-17T03:38:59.637546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:54.862592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.610704+0000","last_change":"2024-09-17T03:38:58.617479+0000","last_active":"2024-09-17T03:38:59.610704+0000","last_peered":"2024-09-17T03:38:59.610704+0000","last_clean":"2024-09-17T03:38:59.610704+0000","last_became_active":"2024-09-17T03:38:58.617119+0000","last_became_peered":"2024-09-17T03:38:58.617119+0000","last_unstale":"2024-09-17T03:38:59.610704+0000","last_undegraded":"2024-09-17T03:38:59.610704+0000","last_fullsized":"2024-09-17T03:38:59.610704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:58.665288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.632550+0000","last_change":"2024-09-17T03:38:59.619450+0000","last_active":"2024-09-17T03:38:59.632550+0000","last_peered":"2024-09-17T03:38:59.632550+0000","last_clean":"2024-09-17T03:38:59.632550+0000","last_became_active":"2024-09-17T03:38:59.618195+0000","last_became_peered":"2024-09-17T03:38:59.618195+0000","last_unstale":"2024-09-17T03:38:59.632550+0000","last_undegraded":"2024-09-17T03:38:59.632550+0000","last_fullsized":"2024-09-17T03:38:59.632550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:58.584542+0000","last_clean_scrub_stamp":"2024-09-17T03:38:58.584542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:25.262341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.617586+0000","last_change":"2024-09-17T03:38:58.618630+0000","last_active":"2024-09-17T03:38:59.617586+0000","last_peered":"2024-09-17T03:38:59.617586+0000","last_clean":"2024-09-17T03:38:59.617586+0000","last_became_active":"2024-09-17T03:38:58.618286+0000","last_became_peered":"2024-09-17T03:38:58.618286+0000","last_unstale":"2024-09-17T03:38:59.617586+0000","last_undegraded":"2024-09-17T03:38:59.617586+0000","last_fullsized":"2024-09-17T03:38:59.617586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:57.577713+0000","last_clean_scrub_stamp":"2024-09-17T03:38:57.577713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:18.982913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":211,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T03:38:59.602317+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:38:59.602317+0000","last_peered":"2024-09-17T03:38:59.602317+0000","last_clean":"2024-09-17T03:38:59.602317+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:38:59.602317+0000","last_undegraded":"2024-09-17T03:38:59.602317+0000","last_fullsized":"2024-09-17T03:38:59.602317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":411502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":917504,"data_stored":411522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1507328,"data_stored":1001308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":929792,"data_stored":412566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":909312,"data_stored":410850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1519616,"data_stored":1002864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":913408,"data_stored":410872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":925696,"data_stored":417564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:39:04.506 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:39:04.506 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:39:04.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.773+0000 7f6372e00640 1 -- 172.21.15.121:0/4024873863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6350003b30 msgr2=0x7f6350003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:04.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.773+0000 7f6372e00640 1 --2- 172.21.15.121:0/4024873863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6350003b30 0x7f6350003fa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f635c009d20 tx=0x7f6350005830 comp rx=0 tx=0).stop 2024-09-17T03:39:04.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.773+0000 7f6372e00640 1 -- 172.21.15.121:0/4024873863 shutdown_connections 2024-09-17T03:39:04.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.773+0000 7f6372e00640 1 --2- 172.21.15.121:0/4024873863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6350003b30 0x7f6350003fa0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.773+0000 7f6372e00640 1 -- 172.21.15.121:0/4024873863 >> 172.21.15.121:0/4024873863 conn(0x7f636c0b3580 msgr2=0x7f636c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:04.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.773+0000 7f6372e00640 1 -- 172.21.15.121:0/4024873863 shutdown_connections 2024-09-17T03:39:04.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.773+0000 7f6372e00640 1 -- 172.21.15.121:0/4024873863 wait complete. 2024-09-17T03:39:04.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.775+0000 7f6372e00640 1 Processor -- start 2024-09-17T03:39:04.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.775+0000 7f6372e00640 1 -- start start 2024-09-17T03:39:04.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f6372e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6350003b30 0x7f636c1f9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:04.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f6372e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f636c092cd0 0x7f636c08fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:04.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f6372e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f636c08bfe0 0x7f636c08c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:04.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f6372e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f636c06db90 con 0x7f6350003b30 2024-09-17T03:39:04.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f6372e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f636c06da10 con 0x7f636c092cd0 2024-09-17T03:39:04.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f6372e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f636c161190 con 0x7f636c08bfe0 2024-09-17T03:39:04.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f636be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6350003b30 0x7f636c1f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:04.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f636be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6350003b30 0x7f636c1f9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38076/0 (socket says 172.21.15.121:38076) 2024-09-17T03:39:04.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f636be00640 1 -- 172.21.15.121:0/1674322271 learned_addr learned my addr 172.21.15.121:0/1674322271 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:04.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f6363400640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f636c092cd0 0x7f636c08fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:04.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.777+0000 7f6370e00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f636c08bfe0 0x7f636c08c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:04.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f636be00640 1 -- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f636c08bfe0 msgr2=0x7f636c08c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:04.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f636be00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f636c08bfe0 0x7f636c08c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f636be00640 1 -- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f636c092cd0 msgr2=0x7f636c08fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:04.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f636be00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f636c092cd0 0x7f636c08fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:04.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f636be00640 1 -- 172.21.15.121:0/1674322271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c0c3f80 con 0x7f6350003b30 2024-09-17T03:39:04.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f636be00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6350003b30 0x7f636c1f9730 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f635c009e40 tx=0x7f635c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:04.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f6368c00640 1 -- 172.21.15.121:0/1674322271 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c040020 con 0x7f6350003b30 2024-09-17T03:39:04.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f6368c00640 1 -- 172.21.15.121:0/1674322271 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f635c02ba20 con 0x7f6350003b30 2024-09-17T03:39:04.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f6372e00640 1 -- 172.21.15.121:0/1674322271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636c0c4260 con 0x7f6350003b30 2024-09-17T03:39:04.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f6368c00640 1 -- 172.21.15.121:0/1674322271 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c005030 con 0x7f6350003b30 2024-09-17T03:39:04.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.778+0000 7f6372e00640 1 -- 172.21.15.121:0/1674322271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f636c1f8f30 con 0x7f6350003b30 2024-09-17T03:39:04.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.779+0000 7f6372e00640 1 -- 172.21.15.121:0/1674322271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f636c0d08c0 con 0x7f6350003b30 2024-09-17T03:39:04.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.780+0000 7f6368c00640 1 -- 172.21.15.121:0/1674322271 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f635c043020 con 0x7f6350003b30 2024-09-17T03:39:04.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.781+0000 7f6368c00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6348078b90 0x7f634807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:04.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.781+0000 7f6368c00640 1 -- 172.21.15.121:0/1674322271 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f635c0bba00 con 0x7f6350003b30 2024-09-17T03:39:04.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.782+0000 7f6363400640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6348078b90 0x7f634807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:04.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.783+0000 7f6363400640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6348078b90 0x7f634807b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f636c093950 tx=0x7f6354006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:04.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:04.786+0000 7f6368c00640 1 -- 172.21.15.121:0/1674322271 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f635c04a070 con 0x7f6350003b30 2024-09-17T03:39:05.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.035+0000 7f6372e00640 1 -- 172.21.15.121:0/1674322271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f636c074f50 con 0x7f6350003b30 2024-09-17T03:39:05.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.038+0000 7f6368c00640 1 -- 172.21.15.121:0/1674322271 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f635c083650 con 0x7f6350003b30 2024-09-17T03:39:05.038 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-17T03:39:05.039 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw== 2024-09-17T03:39:05.039 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-17T03:39:05.039 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-17T03:39:05.039 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:39:05.039 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-17T03:39:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 -- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6348078b90 msgr2=0x7f634807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6348078b90 0x7f634807b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f636c093950 tx=0x7f6354006040 comp rx=0 tx=0).stop 2024-09-17T03:39:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 -- 172.21.15.121:0/1674322271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6350003b30 msgr2=0x7f636c1f9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6350003b30 0x7f636c1f9730 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f635c009e40 tx=0x7f635c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 -- 172.21.15.121:0/1674322271 shutdown_connections 2024-09-17T03:39:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f636c08bfe0 0x7f636c08c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f636c092cd0 0x7f636c08fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6348078b90 0x7f634807b0a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 --2- 172.21.15.121:0/1674322271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6350003b30 0x7f636c1f9730 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 -- 172.21.15.121:0/1674322271 >> 172.21.15.121:0/1674322271 conn(0x7f636c0b3580 msgr2=0x7f636c1e8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 -- 172.21.15.121:0/1674322271 shutdown_connections 2024-09-17T03:39:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.041+0000 7f6372e00640 1 -- 172.21.15.121:0/1674322271 wait complete. 2024-09-17T03:39:05.068 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:05.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.289+0000 7f80c9a00640 1 -- 172.21.15.121:0/2907126570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80c406ddc0 msgr2=0x7f80c40d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:05.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.289+0000 7f80c9a00640 1 --2- 172.21.15.121:0/2907126570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80c406ddc0 0x7f80c40d05b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f80b0005fd0 tx=0x7f80b002a4b0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.289+0000 7f80c9a00640 1 -- 172.21.15.121:0/2907126570 shutdown_connections 2024-09-17T03:39:05.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.289+0000 7f80c9a00640 1 --2- 172.21.15.121:0/2907126570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80c406ddc0 0x7f80c40d05b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.289+0000 7f80c9a00640 1 --2- 172.21.15.121:0/2907126570 >> v2:172.21.15.176:3300/0 conn(0x7f80c415a3e0 0x7f80c406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.289+0000 7f80c9a00640 1 -- 172.21.15.121:0/2907126570 >> 172.21.15.121:0/2907126570 conn(0x7f80c40b3580 msgr2=0x7f80c40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:05.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.289+0000 7f80c9a00640 1 -- 172.21.15.121:0/2907126570 shutdown_connections 2024-09-17T03:39:05.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.289+0000 7f80c9a00640 1 -- 172.21.15.121:0/2907126570 wait complete. 2024-09-17T03:39:05.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.291+0000 7f80c9a00640 1 Processor -- start 2024-09-17T03:39:05.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.292+0000 7f80c9a00640 1 -- start start 2024-09-17T03:39:05.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c9a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80c406ddc0 0x7f80c4158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:05.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c9a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c40d0af0 0x7f80c409a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:05.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c9a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c415a3e0 0x7f80c41f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:05.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c9a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f80c406f560 con 0x7f80c40d0af0 2024-09-17T03:39:05.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c9a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4161190 con 0x7f80c415a3e0 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c9a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80c406f6e0 con 0x7f80c406ddc0 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c2000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c40d0af0 0x7f80c409a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c2000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c40d0af0 0x7f80c409a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38078/0 (socket says 172.21.15.121:38078) 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c2000640 1 -- 172.21.15.121:0/65581143 learned_addr learned my addr 172.21.15.121:0/65581143 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c2a00640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80c406ddc0 0x7f80c4158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.293+0000 7f80c3400640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c415a3e0 0x7f80c41f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.294+0000 7f80c2000640 1 -- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80c406ddc0 msgr2=0x7f80c4158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.294+0000 7f80c2000640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80c406ddc0 0x7f80c4158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.294+0000 7f80c2000640 1 -- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c415a3e0 msgr2=0x7f80c41f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.294+0000 7f80c2000640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c415a3e0 0x7f80c41f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.294+0000 7f80c2000640 1 -- 172.21.15.121:0/65581143 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c41f5a30 con 0x7f80c40d0af0 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.294+0000 7f80c2000640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c40d0af0 0x7f80c409a2a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f80b0034040 tx=0x7f80b00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:05.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.294+0000 7f80baa00640 1 -- 172.21.15.121:0/65581143 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b003e030 con 0x7f80c40d0af0 2024-09-17T03:39:05.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.294+0000 7f80baa00640 1 -- 172.21.15.121:0/65581143 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80b0003d90 con 0x7f80c40d0af0 2024-09-17T03:39:05.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.294+0000 7f80c9a00640 1 -- 172.21.15.121:0/65581143 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c41f9800 con 0x7f80c40d0af0 2024-09-17T03:39:05.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.294+0000 7f80baa00640 1 -- 172.21.15.121:0/65581143 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0035040 con 0x7f80c40d0af0 2024-09-17T03:39:05.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.295+0000 7f80c9a00640 1 -- 172.21.15.121:0/65581143 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c41f9dc0 con 0x7f80c40d0af0 2024-09-17T03:39:05.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.296+0000 7f80c9a00640 1 -- 172.21.15.121:0/65581143 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c41f9570 con 0x7f80c40d0af0 2024-09-17T03:39:05.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.297+0000 7f80baa00640 1 -- 172.21.15.121:0/65581143 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80b0041030 con 0x7f80c40d0af0 2024-09-17T03:39:05.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.298+0000 7f80baa00640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80a4078b90 0x7f80a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:05.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.298+0000 7f80baa00640 1 -- 172.21.15.121:0/65581143 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f80b00bb540 con 0x7f80c40d0af0 2024-09-17T03:39:05.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.298+0000 7f80c2a00640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80a4078b90 0x7f80a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:05.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.299+0000 7f80c2a00640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80a4078b90 0x7f80a407b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f80b40095f0 tx=0x7f80b4005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:05.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.302+0000 7f80baa00640 1 -- 172.21.15.121:0/65581143 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80c41f5a30 con 0x7f80c40d0af0 2024-09-17T03:39:05.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.520+0000 7f80c9a00640 1 -- 172.21.15.121:0/65581143 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80c406fb90 con 0x7f80c40d0af0 2024-09-17T03:39:05.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.521+0000 7f80baa00640 1 -- 172.21.15.121:0/65581143 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5234 (secure 0 0 0) 0x7f80b0083230 con 0x7f80c40d0af0 2024-09-17T03:39:05.521 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:05.521 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":50,"btime":"2024-09-17T03:39:02:620623+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5513,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3345012856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3345012856},{"type":"v1","addr":"172.21.15.176:6837","nonce":3345012856}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5519,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1489171016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1489171016},{"type":"v1","addr":"172.21.15.121:6835","nonce":1489171016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2870460783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2870460783},{"type":"v1","addr":"172.21.15.176:6836","nonce":2870460783}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:38:59.095974+0000","modified":"2024-09-17T03:39:02.108102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6132":{"gid":6132,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6834/762401029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":762401029},{"type":"v1","addr":"172.21.15.121:6834","nonce":762401029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6132,"qdb_cluster":[6132]},"id":5}]} 2024-09-17T03:39:05.522 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 50 2024-09-17T03:39:05.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 -- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80a4078b90 msgr2=0x7f80a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:05.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80a4078b90 0x7f80a407b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f80b40095f0 tx=0x7f80b4005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 -- 172.21.15.121:0/65581143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c40d0af0 msgr2=0x7f80c409a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c40d0af0 0x7f80c409a2a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f80b0034040 tx=0x7f80b00038a0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 -- 172.21.15.121:0/65581143 shutdown_connections 2024-09-17T03:39:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80c415a3e0 0x7f80c41f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80a4078b90 0x7f80a407b0a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c40d0af0 0x7f80c409a2a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 --2- 172.21.15.121:0/65581143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80c406ddc0 0x7f80c4158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 -- 172.21.15.121:0/65581143 >> 172.21.15.121:0/65581143 conn(0x7f80c40b3580 msgr2=0x7f80c40ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 -- 172.21.15.121:0/65581143 shutdown_connections 2024-09-17T03:39:05.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:05.524+0000 7f80c9a00640 1 -- 172.21.15.121:0/65581143 wait complete. 2024-09-17T03:39:05.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:38:59.095974+0000', 'modified': '2024-09-17T03:39:02.108102+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6132}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6132': {'gid': 6132, 'name': 'c', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6834/762401029', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 762401029}, {'type': 'v1', 'addr': '172.21.15.121:6834', 'nonce': 762401029}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6132, 'qdb_cluster': [6132]} 2024-09-17T03:39:05.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:39:05.960 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:39:06.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.185+0000 7fb568e00640 1 -- 172.21.15.121:0/1336525323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415ca70 msgr2=0x7fb56415ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.185+0000 7fb568e00640 1 --2- 172.21.15.121:0/1336525323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415ca70 0x7fb56415ce80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009900 tx=0x7fb54c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.185+0000 7fb568e00640 1 -- 172.21.15.121:0/1336525323 shutdown_connections 2024-09-17T03:39:06.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.185+0000 7fb568e00640 1 --2- 172.21.15.121:0/1336525323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415ca70 0x7fb56415ce80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.185+0000 7fb568e00640 1 --2- 172.21.15.121:0/1336525323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5640b5250 0x7fb5640cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.185+0000 7fb568e00640 1 -- 172.21.15.121:0/1336525323 >> 172.21.15.121:0/1336525323 conn(0x7fb5640d07f0 msgr2=0x7fb5640b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:06.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.185+0000 7fb568e00640 1 -- 172.21.15.121:0/1336525323 shutdown_connections 2024-09-17T03:39:06.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.185+0000 7fb568e00640 1 -- 172.21.15.121:0/1336525323 wait complete. 2024-09-17T03:39:06.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.187+0000 7fb568e00640 1 Processor -- start 2024-09-17T03:39:06.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.188+0000 7fb568e00640 1 -- start start 2024-09-17T03:39:06.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb568e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5640b5250 0x7fb56413e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb568e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56415ca70 0x7fb564156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb568e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415d3c0 0x7fb5641566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb568e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb564160770 con 0x7fb56415d3c0 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb568e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb56406e780 con 0x7fb56415ca70 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb568e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5641608f0 con 0x7fb5640b5250 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb563e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415d3c0 0x7fb5641566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb563400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5640b5250 0x7fb56413e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb563400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5640b5250 0x7fb56413e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:33816/0 (socket says 172.21.15.121:33816) 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb563400640 1 -- 172.21.15.121:0/38651704 learned_addr learned my addr 172.21.15.121:0/38651704 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.189+0000 7fb55aa00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56415ca70 0x7fb564156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.190+0000 7fb563e00640 1 -- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5640b5250 msgr2=0x7fb56413e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.190+0000 7fb563e00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5640b5250 0x7fb56413e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.190+0000 7fb563e00640 1 -- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56415ca70 msgr2=0x7fb564156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.190+0000 7fb563e00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56415ca70 0x7fb564156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.190+0000 7fb563e00640 1 -- 172.21.15.121:0/38651704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56413eed0 con 0x7fb56415d3c0 2024-09-17T03:39:06.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.190+0000 7fb563e00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415d3c0 0x7fb5641566c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00be30 tx=0x7fb55c00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:06.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.190+0000 7fb55be00640 1 -- 172.21.15.121:0/38651704 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c019070 con 0x7fb56415d3c0 2024-09-17T03:39:06.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.190+0000 7fb55be00640 1 -- 172.21.15.121:0/38651704 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb55c014440 con 0x7fb56415d3c0 2024-09-17T03:39:06.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.190+0000 7fb568e00640 1 -- 172.21.15.121:0/38651704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb564151620 con 0x7fb56415d3c0 2024-09-17T03:39:06.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.191+0000 7fb55be00640 1 -- 172.21.15.121:0/38651704 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c014890 con 0x7fb56415d3c0 2024-09-17T03:39:06.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.191+0000 7fb568e00640 1 -- 172.21.15.121:0/38651704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb564151be0 con 0x7fb56415d3c0 2024-09-17T03:39:06.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.193+0000 7fb55be00640 1 -- 172.21.15.121:0/38651704 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb55c01c070 con 0x7fb56415d3c0 2024-09-17T03:39:06.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.194+0000 7fb55be00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078b90 0x7fb54007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.194+0000 7fb55be00640 1 -- 172.21.15.121:0/38651704 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fb55c09ac40 con 0x7fb56415d3c0 2024-09-17T03:39:06.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.194+0000 7fb571122740 1 Processor -- start 2024-09-17T03:39:06.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.194+0000 7fb563400640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078b90 0x7fb54007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.194+0000 7fb571122740 1 -- start start 2024-09-17T03:39:06.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.195+0000 7fb563400640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078b90 0x7fb54007b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb55400abe0 tx=0x7fb55400a2d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:06.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb571122740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4d6270 0x55bb6d8a6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb571122740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d8a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb571122740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d877150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb571122740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bb6d800430 con 0x55bb6d4b5590 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb571122740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bb6d7f05d0 con 0x55bb6d4d6270 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb571122740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55bb6d7dfa00 con 0x55bb6d4ad3b0 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb563e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d877150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb563e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d877150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38108/0 (socket says 172.21.15.121:38108) 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb563e00640 1 -- 172.21.15.121:0/1968097922 learned_addr learned my addr 172.21.15.121:0/1968097922 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb563400640 1 --2- 172.21.15.121:0/1968097922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4d6270 0x55bb6d8a6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.196+0000 7fb55aa00640 1 --2- 172.21.15.121:0/1968097922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d8a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.197+0000 7fb563e00640 1 -- 172.21.15.121:0/1968097922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 msgr2=0x55bb6d8a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.197+0000 7fb563e00640 1 --2- 172.21.15.121:0/1968097922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d8a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.197+0000 7fb563e00640 1 -- 172.21.15.121:0/1968097922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4d6270 msgr2=0x55bb6d8a6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:06.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.197+0000 7fb563e00640 1 --2- 172.21.15.121:0/1968097922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4d6270 0x55bb6d8a6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.197+0000 7fb563e00640 1 -- 172.21.15.121:0/1968097922 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb6d7a8520 con 0x55bb6d4b5590 2024-09-17T03:39:06.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.197+0000 7fb55aa00640 1 --2- 172.21.15.121:0/1968097922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d8a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:06.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.197+0000 7fb563e00640 1 --2- 172.21.15.121:0/1968097922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d877150 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb55c098eb0 tx=0x7fb55c062000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6896fad0fdff26f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:06.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.197+0000 7fb553e00640 1 -- 172.21.15.121:0/1968097922 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0672c0 con 0x55bb6d4b5590 2024-09-17T03:39:06.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.197+0000 7fb553e00640 1 -- 172.21.15.121:0/1968097922 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb55c06c170 con 0x55bb6d4b5590 2024-09-17T03:39:06.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.197+0000 7fb553e00640 1 -- 172.21.15.121:0/1968097922 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c06bf40 con 0x55bb6d4b5590 2024-09-17T03:39:06.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.198+0000 7fb571122740 1 -- 172.21.15.121:0/1968097922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 msgr2=0x55bb6d877150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.198+0000 7fb571122740 1 --2- 172.21.15.121:0/1968097922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d877150 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb55c098eb0 tx=0x7fb55c062000 comp rx=0 tx=0).stop 2024-09-17T03:39:06.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.198+0000 7fb571122740 1 -- 172.21.15.121:0/1968097922 shutdown_connections 2024-09-17T03:39:06.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.198+0000 7fb571122740 1 --2- 172.21.15.121:0/1968097922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d877150 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.198+0000 7fb571122740 1 --2- 172.21.15.121:0/1968097922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d8a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.198+0000 7fb571122740 1 --2- 172.21.15.121:0/1968097922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4d6270 0x55bb6d8a6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.198+0000 7fb571122740 1 -- 172.21.15.121:0/1968097922 >> 172.21.15.121:0/1968097922 conn(0x55bb6d4ca3c0 msgr2=0x55bb6d87cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:06.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.198+0000 7fb571122740 1 -- 172.21.15.121:0/1968097922 shutdown_connections 2024-09-17T03:39:06.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.198+0000 7fb571122740 1 -- 172.21.15.121:0/1968097922 wait complete. 2024-09-17T03:39:06.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.199+0000 7fb571122740 1 -- start start 2024-09-17T03:39:06.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.200+0000 7fb571122740 1 Processor -- start 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb571122740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d8d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb571122740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4b5590 0x55bb6d8a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb571122740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8bb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb571122740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bb6d786330 con 0x55bb6d4d6270 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb571122740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bb6d7e3810 con 0x55bb6d4b5590 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb571122740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55bb6d550620 con 0x55bb6d4ad3b0 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb571122740 10 client.0 _ll_register_callbacks cb 0x55bb6d78b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb563e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8bb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb563e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8bb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38110/0 (socket says 172.21.15.121:38110) 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb563e00640 1 -- 172.21.15.121:0/2426883181 learned_addr learned my addr 172.21.15.121:0/2426883181 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb55aa00640 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4b5590 0x55bb6d8a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.201+0000 7fb563400640 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d8d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb563e00640 1 -- 172.21.15.121:0/2426883181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 msgr2=0x55bb6d8d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb563e00640 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d8d15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb563e00640 1 -- 172.21.15.121:0/2426883181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4b5590 msgr2=0x55bb6d8a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb563e00640 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4b5590 0x55bb6d8a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb563e00640 1 -- 172.21.15.121:0/2426883181 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb6d541850 con 0x55bb6d4d6270 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb55aa00640 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4b5590 0x55bb6d8a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb563400640 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d8d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb563e00640 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8bb770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb55c062170 tx=0x7fb55c06bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e167b0ebb7855feb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb550c00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb550c00640 1 -- 172.21.15.121:0/2426883181 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0672c0 con 0x55bb6d4d6270 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb550c00640 1 -- 172.21.15.121:0/2426883181 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fb55c063b10 con 0x55bb6d4d6270 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb571122740 1 -- 172.21.15.121:0/2426883181 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb55c06c170 con 0x55bb6d4d6270 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb550c00640 1 -- 172.21.15.121:0/2426883181 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb55c072050 con 0x55bb6d4d6270 2024-09-17T03:39:06.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb571122740 10 client.6234 fetch_fsmap learned FSMap version 50 2024-09-17T03:39:06.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.202+0000 7fb571122740 1 -- 172.21.15.121:0/2426883181 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55bb6d5b86b0 con 0x55bb6d4d6270 2024-09-17T03:39:06.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.203+0000 7fb550c00640 1 -- 172.21.15.121:0/2426883181 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb55c06c170 con 0x55bb6d4d6270 2024-09-17T03:39:06.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.203+0000 7fb550c00640 1 -- 172.21.15.121:0/2426883181 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 3502+0+0 (secure 0 0 0) 0x7fb55c075020 con 0x55bb6d4d6270 2024-09-17T03:39:06.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.203+0000 7fb571122740 10 client.6234 fetch_fsmap finished waiting for FSMap version 50 2024-09-17T03:39:06.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.203+0000 7fb571122740 10 client.6234 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:39:06.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.203+0000 7fb571122740 20 client.6234 populate_metadata read hostname 'smithi121' 2024-09-17T03:39:06.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.203+0000 7fb571122740 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.121:6832/762401029,v1:172.21.15.121:6834/762401029] conn(0x55bb6d494e40 0x55bb6d8d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.203+0000 7fb571122740 4 client.6234 mds_command: new command op to 6132 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:39:06.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.203+0000 7fb571122740 1 -- 172.21.15.121:0/2426883181 --> [v2:172.21.15.121:6832/762401029,v1:172.21.15.121:6834/762401029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb6d7f2520 con 0x55bb6d494e40 2024-09-17T03:39:06.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.203+0000 7fb563400640 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.121:6832/762401029,v1:172.21.15.121:6834/762401029] conn(0x55bb6d494e40 0x55bb6d8d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.204+0000 7fb563400640 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.121:6832/762401029,v1:172.21.15.121:6834/762401029] conn(0x55bb6d494e40 0x55bb6d8d4170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e69d379d1cedfb4 server_cookie=aea62d06851617b7 in_seq=0 out_seq=0 2024-09-17T03:39:06.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.204+0000 7fb550c00640 10 client.6234 ms_handle_connect on v2:172.21.15.121:6832/762401029 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.204+0000 7fb550c00640 1 -- 172.21.15.121:0/2426883181 <== mds.0 v2:172.21.15.121:6832/762401029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb6d7f2520 con 0x55bb6d494e40 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.204+0000 7fb550c00640 10 client.6234 handle_command_reply: tid=0 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 client.6234 shutdown 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 -- 172.21.15.121:0/2426883181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 msgr2=0x55bb6d8bb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8bb770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb55c062170 tx=0x7fb55c06bf90 comp rx=0 tx=0).stop 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 -- 172.21.15.121:0/2426883181 shutdown_connections 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.121:6832/762401029,v1:172.21.15.121:6834/762401029] conn(0x55bb6d494e40 0x55bb6d8d4170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8bb770 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4b5590 0x55bb6d8a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 --2- 172.21.15.121:0/2426883181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d8d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 -- 172.21.15.121:0/2426883181 >> 172.21.15.121:0/2426883181 conn(0x55bb6d4ca3c0 msgr2=0x55bb6d878300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb550c00640 0 client.6234 ms_handle_reset on v2:172.21.15.121:6832/762401029 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 -- 172.21.15.121:0/2426883181 shutdown_connections 2024-09-17T03:39:06.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 1 -- 172.21.15.121:0/2426883181 wait complete. 2024-09-17T03:39:06.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.205+0000 7fb571122740 20 client.6234 trim_cache size 0 max 16384 2024-09-17T03:39:06.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.224+0000 7fb571122740 1 Processor -- start 2024-09-17T03:39:06.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.224+0000 7fb571122740 1 -- start start 2024-09-17T03:39:06.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.225+0000 7fb571122740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4ad3b0 0x55bb6d89d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.225+0000 7fb571122740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4b5590 0x55bb6d8a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.225+0000 7fb571122740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8d8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.225+0000 7fb571122740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb564141b40 con 0x55bb6d4d6270 2024-09-17T03:39:06.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.225+0000 7fb571122740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb5641f98c0 con 0x55bb6d4ad3b0 2024-09-17T03:39:06.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.225+0000 7fb571122740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5641414f0 con 0x55bb6d4b5590 2024-09-17T03:39:06.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb563e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8d8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb563e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8d8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38116/0 (socket says 172.21.15.121:38116) 2024-09-17T03:39:06.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb563e00640 1 -- 172.21.15.121:0/405684669 learned_addr learned my addr 172.21.15.121:0/405684669 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb563400640 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4ad3b0 0x55bb6d89d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb55aa00640 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4b5590 0x55bb6d8a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb563e00640 1 -- 172.21.15.121:0/405684669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4b5590 msgr2=0x55bb6d8a0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb563e00640 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4b5590 0x55bb6d8a0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb563e00640 1 -- 172.21.15.121:0/405684669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4ad3b0 msgr2=0x55bb6d89d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb563e00640 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4ad3b0 0x55bb6d89d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb563e00640 1 -- 172.21.15.121:0/405684669 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb6d87d840 con 0x55bb6d4d6270 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb55aa00640 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4b5590 0x55bb6d8a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.226+0000 7fb563400640 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4ad3b0 0x55bb6d89d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.227+0000 7fb563e00640 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8d8fb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00bf90 tx=0x7fb55c062000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b037174f24620d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:06.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.227+0000 7fb553400640 1 -- 172.21.15.121:0/405684669 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0623a0 con 0x55bb6d4d6270 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.227+0000 7fb553400640 1 -- 172.21.15.121:0/405684669 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb55c082070 con 0x55bb6d4d6270 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.227+0000 7fb553400640 1 -- 172.21.15.121:0/405684669 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0672c0 con 0x55bb6d4d6270 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.227+0000 7fb571122740 1 -- 172.21.15.121:0/405684669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 msgr2=0x55bb6d8d8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.227+0000 7fb571122740 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8d8fb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00bf90 tx=0x7fb55c062000 comp rx=0 tx=0).stop 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.228+0000 7fb571122740 1 -- 172.21.15.121:0/405684669 shutdown_connections 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.228+0000 7fb571122740 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4d6270 0x55bb6d8d8fb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.228+0000 7fb571122740 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4b5590 0x55bb6d8a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.228+0000 7fb571122740 1 --2- 172.21.15.121:0/405684669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4ad3b0 0x55bb6d89d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.228+0000 7fb571122740 1 -- 172.21.15.121:0/405684669 >> 172.21.15.121:0/405684669 conn(0x55bb6d4ca3c0 msgr2=0x55bb6d89fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.228+0000 7fb571122740 1 -- 172.21.15.121:0/405684669 shutdown_connections 2024-09-17T03:39:06.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.228+0000 7fb571122740 1 -- 172.21.15.121:0/405684669 wait complete. 2024-09-17T03:39:06.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.228+0000 7fb571122740 1 -- start start 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.229+0000 7fb571122740 1 Processor -- start 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.230+0000 7fb571122740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d89d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.230+0000 7fb571122740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d9374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.230+0000 7fb571122740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4d6270 0x55bb6d8a2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.230+0000 7fb571122740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bb6d8bbd00 con 0x55bb6d4b5590 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.230+0000 7fb571122740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bb6d786330 con 0x55bb6d4d6270 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.230+0000 7fb571122740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55bb6d8a2260 con 0x55bb6d4ad3b0 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.230+0000 7fb571122740 10 client.0 _ll_register_callbacks cb 0x7fb55400a830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.230+0000 7fb55aa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d9374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.230+0000 7fb55aa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d9374c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38130/0 (socket says 172.21.15.121:38130) 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.230+0000 7fb55aa00640 1 -- 172.21.15.121:0/1016355031 learned_addr learned my addr 172.21.15.121:0/1016355031 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:06.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb563e00640 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4d6270 0x55bb6d8a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb563400640 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d89d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb55aa00640 1 -- 172.21.15.121:0/1016355031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 msgr2=0x55bb6d89d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb55aa00640 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d89d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb55aa00640 1 -- 172.21.15.121:0/1016355031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4d6270 msgr2=0x55bb6d8a2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb55aa00640 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4d6270 0x55bb6d8a2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb55aa00640 1 -- 172.21.15.121:0/1016355031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb6d8d16e0 con 0x55bb6d4b5590 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb563400640 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d89d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb55aa00640 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d9374c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009850 tx=0x7fb54c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ebf0c070698824 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb550c00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb550c00640 1 -- 172.21.15.121:0/1016355031 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c035040 con 0x55bb6d4b5590 2024-09-17T03:39:06.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb571122740 1 -- 172.21.15.121:0/1016355031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb55c082070 con 0x55bb6d4b5590 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.231+0000 7fb550c00640 1 -- 172.21.15.121:0/1016355031 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fb54c0035f0 con 0x55bb6d4b5590 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb550c00640 1 -- 172.21.15.121:0/1016355031 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb54c04d050 con 0x55bb6d4b5590 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb571122740 10 client.6240 fetch_fsmap learned FSMap version 50 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb571122740 1 -- 172.21.15.121:0/1016355031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55bb6d8d1170 con 0x55bb6d4b5590 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb550c00640 1 -- 172.21.15.121:0/1016355031 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb55c082070 con 0x55bb6d4b5590 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb550c00640 1 -- 172.21.15.121:0/1016355031 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 3502+0+0 (secure 0 0 0) 0x7fb54c050020 con 0x55bb6d4b5590 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb571122740 10 client.6240 fetch_fsmap finished waiting for FSMap version 50 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb571122740 10 client.6240 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb571122740 20 client.6240 populate_metadata read hostname 'smithi121' 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb571122740 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.121:6832/762401029,v1:172.21.15.121:6834/762401029] conn(0x55bb6d941450 0x55bb6d877aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb571122740 4 client.6240 mds_command: new command op to 6132 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb571122740 1 -- 172.21.15.121:0/1016355031 --> [v2:172.21.15.121:6832/762401029,v1:172.21.15.121:6834/762401029] -- command(tid 0: {"prefix": "status"}) -- 0x55bb6d7edfd0 con 0x55bb6d941450 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.232+0000 7fb563400640 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.121:6832/762401029,v1:172.21.15.121:6834/762401029] conn(0x55bb6d941450 0x55bb6d877aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb563400640 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.121:6832/762401029,v1:172.21.15.121:6834/762401029] conn(0x55bb6d941450 0x55bb6d877aa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=840a4736ed6bcc3c server_cookie=719db35a0a5ea2cd in_seq=0 out_seq=0 2024-09-17T03:39:06.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb550c00640 10 client.6240 ms_handle_connect on v2:172.21.15.121:6832/762401029 2024-09-17T03:39:06.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb550c00640 1 -- 172.21.15.121:0/1016355031 <== mds.0 v2:172.21.15.121:6832/762401029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55bb6d7edfd0 con 0x55bb6d941450 2024-09-17T03:39:06.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb550c00640 10 client.6240 handle_command_reply: tid=0 2024-09-17T03:39:06.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb571122740 1 client.6240 shutdown 2024-09-17T03:39:06.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb571122740 1 -- 172.21.15.121:0/1016355031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 msgr2=0x55bb6d9374c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb571122740 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d9374c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009850 tx=0x7fb54c004040 comp rx=0 tx=0).stop 2024-09-17T03:39:06.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb571122740 1 -- 172.21.15.121:0/1016355031 shutdown_connections 2024-09-17T03:39:06.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb571122740 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.121:6832/762401029,v1:172.21.15.121:6834/762401029] conn(0x55bb6d941450 0x55bb6d877aa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb571122740 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bb6d4d6270 0x55bb6d8a2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb571122740 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bb6d4b5590 0x55bb6d9374c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb571122740 1 --2- 172.21.15.121:0/1016355031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bb6d4ad3b0 0x55bb6d89d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.233+0000 7fb550c00640 0 client.6240 ms_handle_reset on v2:172.21.15.121:6832/762401029 2024-09-17T03:39:06.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb571122740 1 -- 172.21.15.121:0/1016355031 >> 172.21.15.121:0/1016355031 conn(0x55bb6d4ca3c0 msgr2=0x55bb6d8bb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:06.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb571122740 1 -- 172.21.15.121:0/1016355031 shutdown_connections 2024-09-17T03:39:06.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb571122740 1 -- 172.21.15.121:0/1016355031 wait complete. 2024-09-17T03:39:06.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb571122740 20 client.6240 trim_cache size 0 max 16384 2024-09-17T03:39:06.238 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:39:06.238 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 6132, 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 6.6253930050000003, 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 50, 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 76, 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 76, 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 11.668650596999999 2024-09-17T03:39:06.239 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:39:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb568e00640 1 -- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078b90 msgr2=0x7fb54007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb568e00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078b90 0x7fb54007b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb55400abe0 tx=0x7fb55400a2d0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb568e00640 1 -- 172.21.15.121:0/38651704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415d3c0 msgr2=0x7fb5641566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb568e00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415d3c0 0x7fb5641566c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00be30 tx=0x7fb55c00bf20 comp rx=0 tx=0).stop 2024-09-17T03:39:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb568e00640 1 -- 172.21.15.121:0/38651704 shutdown_connections 2024-09-17T03:39:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb568e00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078b90 0x7fb54007b0a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb568e00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415d3c0 0x7fb5641566c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb568e00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb56415ca70 0x7fb564156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.234+0000 7fb568e00640 1 --2- 172.21.15.121:0/38651704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5640b5250 0x7fb56413e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.235+0000 7fb568e00640 1 -- 172.21.15.121:0/38651704 >> 172.21.15.121:0/38651704 conn(0x7fb5640d07f0 msgr2=0x7fb56406edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.235+0000 7fb568e00640 1 -- 172.21.15.121:0/38651704 shutdown_connections 2024-09-17T03:39:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.235+0000 7fb568e00640 1 -- 172.21.15.121:0/38651704 wait complete. 2024-09-17T03:39:06.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:39:06.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.477+0000 7f7bffe00640 1 -- 172.21.15.121:0/1888420092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c000b42b0 msgr2=0x7f7c00073290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.477+0000 7f7bffe00640 1 --2- 172.21.15.121:0/1888420092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c000b42b0 0x7f7c00073290 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8005fd0 tx=0x7f7bf802a820 comp rx=0 tx=0).stop 2024-09-17T03:39:06.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.477+0000 7f7bffe00640 1 -- 172.21.15.121:0/1888420092 shutdown_connections 2024-09-17T03:39:06.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.477+0000 7f7bffe00640 1 --2- 172.21.15.121:0/1888420092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c000b42b0 0x7f7c00073290 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.477+0000 7f7bffe00640 1 --2- 172.21.15.121:0/1888420092 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c0006e600 0x7f7c000b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.477+0000 7f7bffe00640 1 -- 172.21.15.121:0/1888420092 >> 172.21.15.121:0/1888420092 conn(0x7f7c000b2440 msgr2=0x7f7c000d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:06.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.477+0000 7f7bffe00640 1 -- 172.21.15.121:0/1888420092 shutdown_connections 2024-09-17T03:39:06.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.477+0000 7f7bffe00640 1 -- 172.21.15.121:0/1888420092 wait complete. 2024-09-17T03:39:06.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.480+0000 7f7bffe00640 1 Processor -- start 2024-09-17T03:39:06.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.480+0000 7f7bffe00640 1 -- start start 2024-09-17T03:39:06.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.481+0000 7f7bffe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c000b42b0 0x7f7c0014bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.481+0000 7f7bffe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c00159170 0x7f7c000ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.481+0000 7f7bffe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c000ca8e0 0x7f7c000b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.481+0000 7f7bffe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00073c70 con 0x7f7c000ca8e0 2024-09-17T03:39:06.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.481+0000 7f7bffe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00073af0 con 0x7f7c000b42b0 2024-09-17T03:39:06.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.481+0000 7f7bffe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7c00073df0 con 0x7f7c00159170 2024-09-17T03:39:06.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bff400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c000ca8e0 0x7f7c000b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bff400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c000ca8e0 0x7f7c000b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38148/0 (socket says 172.21.15.121:38148) 2024-09-17T03:39:06.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bff400640 1 -- 172.21.15.121:0/3696151058 learned_addr learned my addr 172.21.15.121:0/3696151058 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bf6000640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c00159170 0x7f7c000ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bfea00640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c000b42b0 0x7f7c0014bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bff400640 1 -- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c00159170 msgr2=0x7f7c000ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bff400640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c00159170 0x7f7c000ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bff400640 1 -- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c000b42b0 msgr2=0x7f7c0014bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bff400640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c000b42b0 0x7f7c0014bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bff400640 1 -- 172.21.15.121:0/3696151058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c000cb3b0 con 0x7f7c000ca8e0 2024-09-17T03:39:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bfea00640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c000b42b0 0x7f7c0014bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.482+0000 7f7bff400640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c000ca8e0 0x7f7c000b0d80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009cd0 tx=0x7f7bf8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.483+0000 7f7bf7400640 1 -- 172.21.15.121:0/3696151058 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8037040 con 0x7f7c000ca8e0 2024-09-17T03:39:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.483+0000 7f7bf7400640 1 -- 172.21.15.121:0/3696151058 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bf8042070 con 0x7f7c000ca8e0 2024-09-17T03:39:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.483+0000 7f7bf7400640 1 -- 172.21.15.121:0/3696151058 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8004260 con 0x7f7c000ca8e0 2024-09-17T03:39:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.483+0000 7f7bffe00640 1 -- 172.21.15.121:0/3696151058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c000cb0d0 con 0x7f7c000ca8e0 2024-09-17T03:39:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.483+0000 7f7bffe00640 1 -- 172.21.15.121:0/3696151058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0014ca80 con 0x7f7c000ca8e0 2024-09-17T03:39:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.484+0000 7f7bffe00640 1 -- 172.21.15.121:0/3696151058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c000cae20 con 0x7f7c000ca8e0 2024-09-17T03:39:06.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.485+0000 7f7bf7400640 1 -- 172.21.15.121:0/3696151058 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7bf8004400 con 0x7f7c000ca8e0 2024-09-17T03:39:06.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.486+0000 7f7bf7400640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7bdc078bc0 0x7f7bdc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:06.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.486+0000 7f7bf7400640 1 -- 172.21.15.121:0/3696151058 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f7bf80bbda0 con 0x7f7c000ca8e0 2024-09-17T03:39:06.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.487+0000 7f7bfea00640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7bdc078bc0 0x7f7bdc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:06.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.488+0000 7f7bfea00640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7bdc078bc0 0x7f7bdc07b0d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0000f60 tx=0x7f7bf0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.491+0000 7f7bf7400640 1 -- 172.21.15.121:0/3696151058 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7bf8083fb0 con 0x7f7c000ca8e0 2024-09-17T03:39:06.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.714+0000 7f7bffe00640 1 -- 172.21.15.121:0/3696151058 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7c00074380 con 0x7f7c000ca8e0 2024-09-17T03:39:06.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.714+0000 7f7bf7400640 1 -- 172.21.15.121:0/3696151058 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) ==== 53+0+73 (secure 0 0 0) 0x7f7bf80838b0 con 0x7f7c000ca8e0 2024-09-17T03:39:06.714 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:39:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 -- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7bdc078bc0 msgr2=0x7f7bdc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7bdc078bc0 0x7f7bdc07b0d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0000f60 tx=0x7f7bf0009040 comp rx=0 tx=0).stop 2024-09-17T03:39:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 -- 172.21.15.121:0/3696151058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c000ca8e0 msgr2=0x7f7c000b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c000ca8e0 0x7f7c000b0d80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009cd0 tx=0x7f7bf8032d10 comp rx=0 tx=0).stop 2024-09-17T03:39:06.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 -- 172.21.15.121:0/3696151058 shutdown_connections 2024-09-17T03:39:06.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7bdc078bc0 0x7f7bdc07b0d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c000ca8e0 0x7f7c000b0d80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c00159170 0x7f7c000ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 --2- 172.21.15.121:0/3696151058 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c000b42b0 0x7f7c0014bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:06.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 -- 172.21.15.121:0/3696151058 >> 172.21.15.121:0/3696151058 conn(0x7f7c000b2440 msgr2=0x7f7c0015e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:06.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 -- 172.21.15.121:0/3696151058 shutdown_connections 2024-09-17T03:39:06.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:06.717+0000 7f7bffe00640 1 -- 172.21.15.121:0/3696151058 wait complete. 2024-09-17T03:39:06.738 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:39:06.738 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:39:06.738 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:39:06.738 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:39:06.738 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:39:06.738 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:39:06.738 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:39:06.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:39:06.739 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:39:06.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:06.739 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:39:06.775 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:39:06.775 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:39:06.775 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:39:06.775 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:06.775 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:39:06.775 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:06.775 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:06.775 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:06.776 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:39:06.776 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:06.776 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:06.776 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:39:06.776 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:06.776 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:06.776 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:39:06.776 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:06.776 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42510sec preferred_lft 42510sec 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:39:06.777 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:39:06.778 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:39:06.778 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:06.778 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:39:06.778 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:39:06.778 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:39:06.778 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:06.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:06.778 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:39:06.870 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:39:06.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:06.873 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:39:06.910 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:39:06.910 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:39:06.910 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:39:06.910 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:39:06.911 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:39:06.911 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:39:06.911 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:39:06.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:39:06.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:39:06.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:39:06.911 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:39:07.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:39:07.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:39:07.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:07.109 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:39:07.145 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:39:07.145 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:39:07.145 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:39:07.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:07.145 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:39:07.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:39:07.242 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:39:07.277 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:39:07.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:39:07.277 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:39:07.352 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:39:07.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:07.353 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:39:07.548 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:39:07.548 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:39:07.549 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:39:07.569 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:39:07.569 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:39:07.569 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:39:07.569 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:39:07.569 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:39:07.596 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:39:07.597 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:39:07.597 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:39:07.597 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:39:07.597 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:39:07.597 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:39:07.597 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:39:07.597 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:39:07.598 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:39:07.598 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:39:07.598 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:39:07.599 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:39:07.599 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:39:07.604 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:39:07.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:07.605 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:39:07.663 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:39:07.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:39:07.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:39:07.758 INFO:teuthology.orchestra.run.smithi121.stdout:client6252 2024-09-17T03:39:07.759 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:07.759 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:07.794 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:39:08.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.054+0000 7f1db1600640 1 -- 172.21.15.121:0/2364072159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d90004f10 msgr2=0x7f1d9000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:08.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.054+0000 7f1db1600640 1 --2- 172.21.15.121:0/2364072159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d90004f10 0x7f1d9000b9c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1da400c590 tx=0x7f1d90005830 comp rx=0 tx=0).stop 2024-09-17T03:39:08.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.054+0000 7f1dab400640 1 -- 172.21.15.121:0/2364072159 reap_dead start 2024-09-17T03:39:08.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.054+0000 7f1db1600640 1 -- 172.21.15.121:0/2364072159 shutdown_connections 2024-09-17T03:39:08.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.054+0000 7f1db1600640 1 -- 172.21.15.121:0/2364072159 >> 172.21.15.121:0/2364072159 conn(0x7f1dac0b3580 msgr2=0x7f1dac0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:08.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.055+0000 7f1db1600640 1 -- 172.21.15.121:0/2364072159 shutdown_connections 2024-09-17T03:39:08.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.055+0000 7f1db1600640 1 -- 172.21.15.121:0/2364072159 wait complete. 2024-09-17T03:39:08.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.057+0000 7f1db1600640 1 Processor -- start 2024-09-17T03:39:08.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.057+0000 7f1db1600640 1 -- start start 2024-09-17T03:39:08.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.058+0000 7f1db1600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d90004f10 0x7f1dac158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:08.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.058+0000 7f1db1600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dac0c67f0 0x7f1dac14df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:08.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.058+0000 7f1db1600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dac155130 0x7f1dac156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.058+0000 7f1db1600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac06db90 con 0x7f1dac155130 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.058+0000 7f1db1600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac06da10 con 0x7f1dac0c67f0 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.058+0000 7f1db1600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1dac15d320 con 0x7f1d90004f10 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1dab400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dac155130 0x7f1dac156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1dab400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dac155130 0x7f1dac156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38166/0 (socket says 172.21.15.121:38166) 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1dab400640 1 -- 172.21.15.121:0/303308284 learned_addr learned my addr 172.21.15.121:0/303308284 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1daaa00640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d90004f10 0x7f1dac158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1da3e00640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dac0c67f0 0x7f1dac14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1dab400640 1 -- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d90004f10 msgr2=0x7f1dac158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1dab400640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d90004f10 0x7f1dac158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1dab400640 1 -- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dac0c67f0 msgr2=0x7f1dac14df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1dab400640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dac0c67f0 0x7f1dac14df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:08.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1dab400640 1 -- 172.21.15.121:0/303308284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac1f54a0 con 0x7f1dac155130 2024-09-17T03:39:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1da3e00640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dac0c67f0 0x7f1dac14df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.059+0000 7f1dab400640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dac155130 0x7f1dac156930 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1da400c590 tx=0x7f1da4004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.060+0000 7f1da2a00640 1 -- 172.21.15.121:0/303308284 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da402b960 con 0x7f1dac155130 2024-09-17T03:39:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.060+0000 7f1da2a00640 1 -- 172.21.15.121:0/303308284 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1da402bbf0 con 0x7f1dac155130 2024-09-17T03:39:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.060+0000 7f1da2a00640 1 -- 172.21.15.121:0/303308284 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da40060a0 con 0x7f1dac155130 2024-09-17T03:39:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.060+0000 7f1db1600640 1 -- 172.21.15.121:0/303308284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac0c6f20 con 0x7f1dac155130 2024-09-17T03:39:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.060+0000 7f1db1600640 1 -- 172.21.15.121:0/303308284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac158210 con 0x7f1dac155130 2024-09-17T03:39:08.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.061+0000 7f1db1600640 1 -- 172.21.15.121:0/303308284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac15d880 con 0x7f1dac155130 2024-09-17T03:39:08.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.062+0000 7f1da2a00640 1 -- 172.21.15.121:0/303308284 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1da4006240 con 0x7f1dac155130 2024-09-17T03:39:08.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.063+0000 7f1da2a00640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d88078b90 0x7f1d8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:08.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.063+0000 7f1da2a00640 1 -- 172.21.15.121:0/303308284 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f1da40bae00 con 0x7f1dac155130 2024-09-17T03:39:08.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.064+0000 7f1daaa00640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d88078b90 0x7f1d8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:08.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.064+0000 7f1daaa00640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d88078b90 0x7f1d8807b0a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009b90 tx=0x7f1d9c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:08.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.068+0000 7f1da2a00640 1 -- 172.21.15.121:0/303308284 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1da40830b0 con 0x7f1dac155130 2024-09-17T03:39:08.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.287+0000 7f1db1600640 1 -- 172.21.15.121:0/303308284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1dac0c6cb0 con 0x7f1dac155130 2024-09-17T03:39:08.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.287+0000 7f1da2a00640 1 -- 172.21.15.121:0/303308284 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) ==== 53+0+73 (secure 0 0 0) 0x7f1da40829b0 con 0x7f1dac155130 2024-09-17T03:39:08.287 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:39:08.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 -- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d88078b90 msgr2=0x7f1d8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:08.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d88078b90 0x7f1d8807b0a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009b90 tx=0x7f1d9c005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:08.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 -- 172.21.15.121:0/303308284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dac155130 msgr2=0x7f1dac156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:08.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dac155130 0x7f1dac156930 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1da400c590 tx=0x7f1da4004bb0 comp rx=0 tx=0).stop 2024-09-17T03:39:08.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 -- 172.21.15.121:0/303308284 shutdown_connections 2024-09-17T03:39:08.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d88078b90 0x7f1d8807b0a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:08.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1dac155130 0x7f1dac156930 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:08.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1dac0c67f0 0x7f1dac14df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:08.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 --2- 172.21.15.121:0/303308284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d90004f10 0x7f1dac158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:08.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 -- 172.21.15.121:0/303308284 >> 172.21.15.121:0/303308284 conn(0x7f1dac0b3580 msgr2=0x7f1dac15a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:08.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 -- 172.21.15.121:0/303308284 shutdown_connections 2024-09-17T03:39:08.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:08.290+0000 7f1db1600640 1 -- 172.21.15.121:0/303308284 wait complete. 2024-09-17T03:39:08.312 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:39:08.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:39:08.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:39:08.312 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:39:08.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:39:08.312 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:39:08.312 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:39:08.312 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:39:08.313 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:39:08.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:08.313 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:39:08.353 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:08.354 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42505sec preferred_lft 42505sec 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::80c9:d6ff:fe9f:5926/64 scope link 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:08.355 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:39:08.356 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:39:08.356 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d4cd:10ff:feb7:d68f/64 scope link 2024-09-17T03:39:08.356 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:08.356 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:39:08.356 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether fe:db:9e:03:5a:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:39:08.356 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::fcdb:9eff:fe03:5a3e/64 scope link 2024-09-17T03:39:08.356 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:08.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:08.356 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:39:08.453 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:39:08.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:08.456 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:39:08.494 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:39:08.494 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:39:08.494 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:39:08.494 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:39:08.494 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:39:08.495 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:39:08.495 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:39:08.495 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:39:08.495 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:39:08.495 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:39:08.495 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:39:08.613 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:39:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:39:08.684 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:39:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:39:08.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:08.692 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:39:08.728 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:39:08.728 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:39:08.728 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:39:08.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:08.729 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T03:39:08.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:39:08.824 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:39:08.859 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:39:08.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:39:08.859 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:39:08.936 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:39:08.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:08.936 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:39:09.131 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:39:09.131 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:39:09.131 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:39:09.151 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:39:09.151 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:39:09.151 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:39:09.151 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:39:09.151 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:39:09.185 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:39:09.185 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:39:09.185 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:39:09.185 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:39:09.186 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:39:09.186 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:39:09.186 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:39:09.186 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:39:09.187 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:39:09.187 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:39:09.187 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:39:09.187 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:39:09.187 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:39:09.190 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:39:09.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:09.190 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:39:09.246 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:39:09.325 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:39:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:39:09.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:39:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:39:09.337 INFO:teuthology.orchestra.run.smithi176.stdout:client6261 2024-09-17T03:39:09.337 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:09.338 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:09.373 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:39:09.373 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:39:09.468 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:39:09.543 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:39:09.543 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:39:09.543 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:09.544 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:09.582 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:09.582 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:09.659 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:39:09.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.921+0000 7f2f02e00640 1 -- 172.21.15.121:0/2280187920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2efc0cd180 msgr2=0x7f2efc15d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:09.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.921+0000 7f2f02e00640 1 --2- 172.21.15.121:0/2280187920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2efc0cd180 0x7f2efc15d180 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2efc1610d0 tx=0x7f2ee802a4f0 comp rx=0 tx=0).stop 2024-09-17T03:39:09.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.921+0000 7f2f02e00640 1 -- 172.21.15.121:0/2280187920 shutdown_connections 2024-09-17T03:39:09.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.921+0000 7f2f02e00640 1 --2- 172.21.15.121:0/2280187920 >> v2:172.21.15.176:3300/0 conn(0x7f2efc15d6c0 0x7f2efc06d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:09.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.921+0000 7f2f02e00640 1 --2- 172.21.15.121:0/2280187920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2efc0cd180 0x7f2efc15d180 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:09.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.921+0000 7f2f02e00640 1 -- 172.21.15.121:0/2280187920 >> 172.21.15.121:0/2280187920 conn(0x7f2efc0d07f0 msgr2=0x7f2efc0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:09.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.921+0000 7f2f02e00640 1 -- 172.21.15.121:0/2280187920 shutdown_connections 2024-09-17T03:39:09.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.921+0000 7f2f02e00640 1 -- 172.21.15.121:0/2280187920 wait complete. 2024-09-17T03:39:09.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.923+0000 7f2f02e00640 1 Processor -- start 2024-09-17T03:39:09.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.924+0000 7f2f02e00640 1 -- start start 2024-09-17T03:39:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f02e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2efc0b5250 0x7f2efc1f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f02e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2efc0cd180 0x7f2efc141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f02e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2efc15d6c0 0x7f2efc15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f02e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc06df30 con 0x7f2efc0cd180 2024-09-17T03:39:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f02e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc06ddb0 con 0x7f2efc15d6c0 2024-09-17T03:39:09.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f02e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2efc06e0b0 con 0x7f2efc0b5250 2024-09-17T03:39:09.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f01000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2efc0cd180 0x7f2efc141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:09.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f01000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2efc0cd180 0x7f2efc141bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38192/0 (socket says 172.21.15.121:38192) 2024-09-17T03:39:09.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f01000640 1 -- 172.21.15.121:0/1551335522 learned_addr learned my addr 172.21.15.121:0/1551335522 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:09.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f02400640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2efc15d6c0 0x7f2efc15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:09.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.925+0000 7f2f01a00640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2efc0b5250 0x7f2efc1f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:09.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2f01000640 1 -- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2efc0b5250 msgr2=0x7f2efc1f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:09.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2f01000640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2efc0b5250 0x7f2efc1f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:09.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2f01000640 1 -- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2efc15d6c0 msgr2=0x7f2efc15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:09.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2f01000640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2efc15d6c0 0x7f2efc15b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:09.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2f01000640 1 -- 172.21.15.121:0/1551335522 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc142130 con 0x7f2efc0cd180 2024-09-17T03:39:09.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2f01a00640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2efc0b5250 0x7f2efc1f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:09.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2f01000640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2efc0cd180 0x7f2efc141bf0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8034040 tx=0x7f2ee80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:09.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2ef9600640 1 -- 172.21.15.121:0/1551335522 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee803e030 con 0x7f2efc0cd180 2024-09-17T03:39:09.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2ef9600640 1 -- 172.21.15.121:0/1551335522 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ee8003d90 con 0x7f2efc0cd180 2024-09-17T03:39:09.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2f02e00640 1 -- 172.21.15.121:0/1551335522 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc1f9120 con 0x7f2efc0cd180 2024-09-17T03:39:09.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.926+0000 7f2ef9600640 1 -- 172.21.15.121:0/1551335522 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8035040 con 0x7f2efc0cd180 2024-09-17T03:39:09.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.927+0000 7f2f02e00640 1 -- 172.21.15.121:0/1551335522 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc1f96e0 con 0x7f2efc0cd180 2024-09-17T03:39:09.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.928+0000 7f2f02e00640 1 -- 172.21.15.121:0/1551335522 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2efc06e610 con 0x7f2efc0cd180 2024-09-17T03:39:09.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.929+0000 7f2ef9600640 1 -- 172.21.15.121:0/1551335522 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ee8041030 con 0x7f2efc0cd180 2024-09-17T03:39:09.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.930+0000 7f2ef9600640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2edc078b90 0x7f2edc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:09.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.930+0000 7f2ef9600640 1 -- 172.21.15.121:0/1551335522 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f2ee80bb600 con 0x7f2efc0cd180 2024-09-17T03:39:09.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.930+0000 7f2f01a00640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2edc078b90 0x7f2edc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:09.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.931+0000 7f2f01a00640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2edc078b90 0x7f2edc07b0a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009890 tx=0x7f2ef0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:09.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:09.934+0000 7f2ef9600640 1 -- 172.21.15.121:0/1551335522 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2ee8083250 con 0x7f2efc0cd180 2024-09-17T03:39:10.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.129+0000 7f2f02e00640 1 -- 172.21.15.121:0/1551335522 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2efc15e750 con 0x7f2efc0cd180 2024-09-17T03:39:10.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.130+0000 7f2ef9600640 1 -- 172.21.15.121:0/1551335522 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) ==== 80+0+0 (secure 0 0 0) 0x7f2ee8087c80 con 0x7f2efc0cd180 2024-09-17T03:39:10.130 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:39:10.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 -- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2edc078b90 msgr2=0x7f2edc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:10.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2edc078b90 0x7f2edc07b0a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009890 tx=0x7f2ef0008040 comp rx=0 tx=0).stop 2024-09-17T03:39:10.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 -- 172.21.15.121:0/1551335522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2efc0cd180 msgr2=0x7f2efc141bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2efc0cd180 0x7f2efc141bf0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8034040 tx=0x7f2ee80038a0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 -- 172.21.15.121:0/1551335522 shutdown_connections 2024-09-17T03:39:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2efc15d6c0 0x7f2efc15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2edc078b90 0x7f2edc07b0a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2efc0cd180 0x7f2efc141bf0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 --2- 172.21.15.121:0/1551335522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2efc0b5250 0x7f2efc1f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 -- 172.21.15.121:0/1551335522 >> 172.21.15.121:0/1551335522 conn(0x7f2efc0d07f0 msgr2=0x7f2efc0afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 -- 172.21.15.121:0/1551335522 shutdown_connections 2024-09-17T03:39:10.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.132+0000 7f2f02e00640 1 -- 172.21.15.121:0/1551335522 wait complete. 2024-09-17T03:39:10.154 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:39:10.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:10.155 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:39:10.217 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:39:10.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:10.217 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:39:10.253 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:39:10.253 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:10.253 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:10.291 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:10.291 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:10.368 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:39:10.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.590+0000 7fcf67200640 1 -- 172.21.15.121:0/3817444545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf600d0cc0 msgr2=0x7fcf601673d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.590+0000 7fcf67200640 1 --2- 172.21.15.121:0/3817444545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf600d0cc0 0x7fcf601673d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009be0 tx=0x7fcf5802a790 comp rx=0 tx=0).stop 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.591+0000 7fcf67200640 1 -- 172.21.15.121:0/3817444545 shutdown_connections 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.591+0000 7fcf67200640 1 --2- 172.21.15.121:0/3817444545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf600d0cc0 0x7fcf601673d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.591+0000 7fcf67200640 1 -- 172.21.15.121:0/3817444545 >> 172.21.15.121:0/3817444545 conn(0x7fcf600b3580 msgr2=0x7fcf600b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.591+0000 7fcf67200640 1 -- 172.21.15.121:0/3817444545 shutdown_connections 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.591+0000 7fcf67200640 1 -- 172.21.15.121:0/3817444545 wait complete. 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.593+0000 7fcf67200640 1 Processor -- start 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.593+0000 7fcf67200640 1 -- start start 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.594+0000 7fcf67200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6006d800 0x7fcf60153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.594+0000 7fcf67200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf6015a3e0 0x7fcf6015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.594+0000 7fcf67200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf601f6500 0x7fcf6015d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:10.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.594+0000 7fcf67200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60167ca0 con 0x7fcf6015a3e0 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.594+0000 7fcf67200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf60167b20 con 0x7fcf6006d800 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.594+0000 7fcf67200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf60167e20 con 0x7fcf601f6500 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf6015a3e0 0x7fcf6015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf6015a3e0 0x7fcf6015cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38204/0 (socket says 172.21.15.121:38204) 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5f400640 1 -- 172.21.15.121:0/2356132658 learned_addr learned my addr 172.21.15.121:0/2356132658 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf65200640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf601f6500 0x7fcf6015d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5fe00640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6006d800 0x7fcf60153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5f400640 1 -- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf601f6500 msgr2=0x7fcf6015d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5f400640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf601f6500 0x7fcf6015d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5f400640 1 -- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6006d800 msgr2=0x7fcf60153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5f400640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6006d800 0x7fcf60153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5f400640 1 -- 172.21.15.121:0/2356132658 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf60158d70 con 0x7fcf6015a3e0 2024-09-17T03:39:10.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5fe00640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6006d800 0x7fcf60153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:10.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.595+0000 7fcf5f400640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf6015a3e0 0x7fcf6015cbf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00c400 tx=0x7fcf4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:10.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.596+0000 7fcf57e00640 1 -- 172.21.15.121:0/2356132658 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c017070 con 0x7fcf6015a3e0 2024-09-17T03:39:10.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.596+0000 7fcf57e00640 1 -- 172.21.15.121:0/2356132658 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf4c0053c0 con 0x7fcf6015a3e0 2024-09-17T03:39:10.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.596+0000 7fcf57e00640 1 -- 172.21.15.121:0/2356132658 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c003850 con 0x7fcf6015a3e0 2024-09-17T03:39:10.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.596+0000 7fcf67200640 1 -- 172.21.15.121:0/2356132658 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf60159050 con 0x7fcf6015a3e0 2024-09-17T03:39:10.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.596+0000 7fcf67200640 1 -- 172.21.15.121:0/2356132658 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf60159610 con 0x7fcf6015a3e0 2024-09-17T03:39:10.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.597+0000 7fcf67200640 1 -- 172.21.15.121:0/2356132658 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf600ce3c0 con 0x7fcf6015a3e0 2024-09-17T03:39:10.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.598+0000 7fcf57e00640 1 -- 172.21.15.121:0/2356132658 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf4c01a070 con 0x7fcf6015a3e0 2024-09-17T03:39:10.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.599+0000 7fcf57e00640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcf40078b90 0x7fcf4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:10.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.599+0000 7fcf57e00640 1 -- 172.21.15.121:0/2356132658 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fcf4c09a170 con 0x7fcf6015a3e0 2024-09-17T03:39:10.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.599+0000 7fcf5fe00640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcf40078b90 0x7fcf4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:10.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.600+0000 7fcf5fe00640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcf40078b90 0x7fcf4007b0a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf50007b00 tx=0x7fcf50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:10.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.604+0000 7fcf57e00640 1 -- 172.21.15.121:0/2356132658 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcf600ce3c0 con 0x7fcf6015a3e0 2024-09-17T03:39:10.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.798+0000 7fcf67200640 1 -- 172.21.15.121:0/2356132658 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcf6006ddc0 con 0x7fcf6015a3e0 2024-09-17T03:39:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.798+0000 7fcf57e00640 1 -- 172.21.15.121:0/2356132658 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) ==== 80+0+0 (secure 0 0 0) 0x7fcf4c061dd0 con 0x7fcf6015a3e0 2024-09-17T03:39:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 -- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcf40078b90 msgr2=0x7fcf4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcf40078b90 0x7fcf4007b0a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf50007b00 tx=0x7fcf50009040 comp rx=0 tx=0).stop 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 -- 172.21.15.121:0/2356132658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf6015a3e0 msgr2=0x7fcf6015cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf6015a3e0 0x7fcf6015cbf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00c400 tx=0x7fcf4c00c8c0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 -- 172.21.15.121:0/2356132658 shutdown_connections 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf601f6500 0x7fcf6015d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcf40078b90 0x7fcf4007b0a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf6015a3e0 0x7fcf6015cbf0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 --2- 172.21.15.121:0/2356132658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf6006d800 0x7fcf60153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 -- 172.21.15.121:0/2356132658 >> 172.21.15.121:0/2356132658 conn(0x7fcf600b3580 msgr2=0x7fcf600b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 -- 172.21.15.121:0/2356132658 shutdown_connections 2024-09-17T03:39:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:10.801+0000 7fcf67200640 1 -- 172.21.15.121:0/2356132658 wait complete. 2024-09-17T03:39:10.822 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:39:10.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:10.822 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:39:10.886 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:39:10.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:10.887 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:39:10.923 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:39:10.924 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:10.924 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:10.959 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:39:10.959 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:39:10.959 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:10.959 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:10.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:39:10.999 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:11.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.221+0000 7fb569000640 1 -- 172.21.15.121:0/682341821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415e710 msgr2=0x7fb56406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:11.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.221+0000 7fb569000640 1 --2- 172.21.15.121:0/682341821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415e710 0x7fb56406d710 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb5640d4290 tx=0x7fb55402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.221+0000 7fb569000640 1 -- 172.21.15.121:0/682341821 shutdown_connections 2024-09-17T03:39:11.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.221+0000 7fb569000640 1 --2- 172.21.15.121:0/682341821 >> v2:172.21.15.176:3300/0 conn(0x7fb5640d2f50 0x7fb5640d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.221+0000 7fb569000640 1 --2- 172.21.15.121:0/682341821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415e710 0x7fb56406d710 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.221+0000 7fb569000640 1 -- 172.21.15.121:0/682341821 >> 172.21.15.121:0/682341821 conn(0x7fb5640d1560 msgr2=0x7fb5640b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:11.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.221+0000 7fb569000640 1 -- 172.21.15.121:0/682341821 shutdown_connections 2024-09-17T03:39:11.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.221+0000 7fb569000640 1 -- 172.21.15.121:0/682341821 wait complete. 2024-09-17T03:39:11.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.223+0000 7fb569000640 1 Processor -- start 2024-09-17T03:39:11.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.223+0000 7fb569000640 1 -- start start 2024-09-17T03:39:11.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb569000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56406dc50 0x7fb5641e8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:11.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb569000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5640d2f50 0x7fb5641496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:11.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb569000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415e710 0x7fb5641622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:11.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb569000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb5640b7a20 con 0x7fb56415e710 2024-09-17T03:39:11.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb569000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb5640b78a0 con 0x7fb5640d2f50 2024-09-17T03:39:11.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb569000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5640b7ba0 con 0x7fb56406dc50 2024-09-17T03:39:11.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb563e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415e710 0x7fb5641622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:11.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb563e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415e710 0x7fb5641622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38226/0 (socket says 172.21.15.121:38226) 2024-09-17T03:39:11.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb563e00640 1 -- 172.21.15.121:0/1987230218 learned_addr learned my addr 172.21.15.121:0/1987230218 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:11.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb563400640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56406dc50 0x7fb5641e8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb55aa00640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5640d2f50 0x7fb5641496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb563e00640 1 -- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56406dc50 msgr2=0x7fb5641e8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb563e00640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56406dc50 0x7fb5641e8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb563e00640 1 -- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5640d2f50 msgr2=0x7fb5641496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb563e00640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5640d2f50 0x7fb5641496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb563e00640 1 -- 172.21.15.121:0/1987230218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5641f8b10 con 0x7fb56415e710 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb563400640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56406dc50 0x7fb5641e8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.225+0000 7fb55aa00640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5640d2f50 0x7fb5641496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.226+0000 7fb563e00640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415e710 0x7fb5641622e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00e990 tx=0x7fb55c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.226+0000 7fb55be00640 1 -- 172.21.15.121:0/1987230218 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c004d20 con 0x7fb56415e710 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.226+0000 7fb55be00640 1 -- 172.21.15.121:0/1987230218 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb55c00caa0 con 0x7fb56415e710 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.226+0000 7fb55be00640 1 -- 172.21.15.121:0/1987230218 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c005020 con 0x7fb56415e710 2024-09-17T03:39:11.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.226+0000 7fb569000640 1 -- 172.21.15.121:0/1987230218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5641f8df0 con 0x7fb56415e710 2024-09-17T03:39:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.226+0000 7fb569000640 1 -- 172.21.15.121:0/1987230218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5641f93b0 con 0x7fb56415e710 2024-09-17T03:39:11.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.227+0000 7fb569000640 1 -- 172.21.15.121:0/1987230218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5640b8090 con 0x7fb56415e710 2024-09-17T03:39:11.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.229+0000 7fb55be00640 1 -- 172.21.15.121:0/1987230218 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb55c0051c0 con 0x7fb56415e710 2024-09-17T03:39:11.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.230+0000 7fb55be00640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078bc0 0x7fb54007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:11.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.230+0000 7fb55be00640 1 -- 172.21.15.121:0/1987230218 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fb55c09bbe0 con 0x7fb56415e710 2024-09-17T03:39:11.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.231+0000 7fb563400640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078bc0 0x7fb54007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:11.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.232+0000 7fb563400640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078bc0 0x7fb54007b0d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb554034000 tx=0x7fb554004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:11.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.234+0000 7fb55be00640 1 -- 172.21.15.121:0/1987230218 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb55c016030 con 0x7fb56415e710 2024-09-17T03:39:11.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.451+0000 7fb569000640 1 -- 172.21.15.121:0/1987230218 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5641e8660 con 0x7fb56415e710 2024-09-17T03:39:11.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.451+0000 7fb55be00640 1 -- 172.21.15.121:0/1987230218 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5234 (secure 0 0 0) 0x7fb55c063f00 con 0x7fb56415e710 2024-09-17T03:39:11.451 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:11.451 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":50,"btime":"2024-09-17T03:39:02:620623+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5513,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3345012856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3345012856},{"type":"v1","addr":"172.21.15.176:6837","nonce":3345012856}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5519,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1489171016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1489171016},{"type":"v1","addr":"172.21.15.121:6835","nonce":1489171016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2870460783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2870460783},{"type":"v1","addr":"172.21.15.176:6836","nonce":2870460783}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:38:59.095974+0000","modified":"2024-09-17T03:39:02.108102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6132":{"gid":6132,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6834/762401029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":762401029},{"type":"v1","addr":"172.21.15.121:6834","nonce":762401029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6132,"qdb_cluster":[6132]},"id":5}]} 2024-09-17T03:39:11.452 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 50 2024-09-17T03:39:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 -- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078bc0 msgr2=0x7fb54007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078bc0 0x7fb54007b0d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb554034000 tx=0x7fb554004730 comp rx=0 tx=0).stop 2024-09-17T03:39:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 -- 172.21.15.121:0/1987230218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415e710 msgr2=0x7fb5641622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415e710 0x7fb5641622e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00e990 tx=0x7fb55c00ee50 comp rx=0 tx=0).stop 2024-09-17T03:39:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 -- 172.21.15.121:0/1987230218 shutdown_connections 2024-09-17T03:39:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb540078bc0 0x7fb54007b0d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56415e710 0x7fb5641622e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5640d2f50 0x7fb5641496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 --2- 172.21.15.121:0/1987230218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb56406dc50 0x7fb5641e8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 -- 172.21.15.121:0/1987230218 >> 172.21.15.121:0/1987230218 conn(0x7fb5640d1560 msgr2=0x7fb5640d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:11.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 -- 172.21.15.121:0/1987230218 shutdown_connections 2024-09-17T03:39:11.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.454+0000 7fb569000640 1 -- 172.21.15.121:0/1987230218 wait complete. 2024-09-17T03:39:11.477 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.699+0000 7f89e3000640 1 -- 172.21.15.121:0/4059329479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc06ebc0 msgr2=0x7f89dc0b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.699+0000 7f89e3000640 1 --2- 172.21.15.121:0/4059329479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc06ebc0 0x7f89dc0b3bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f89d4005fd0 tx=0x7f89d402a840 comp rx=0 tx=0).stop 2024-09-17T03:39:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.699+0000 7f89e3000640 1 -- 172.21.15.121:0/4059329479 shutdown_connections 2024-09-17T03:39:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.699+0000 7f89e3000640 1 --2- 172.21.15.121:0/4059329479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc06ebc0 0x7f89dc0b3bf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.699+0000 7f89e3000640 1 --2- 172.21.15.121:0/4059329479 >> v2:172.21.15.176:3300/0 conn(0x7f89dc071ba0 0x7f89dc06e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.699+0000 7f89e3000640 1 -- 172.21.15.121:0/4059329479 >> 172.21.15.121:0/4059329479 conn(0x7f89dc073640 msgr2=0x7f89dc073a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.699+0000 7f89e3000640 1 -- 172.21.15.121:0/4059329479 shutdown_connections 2024-09-17T03:39:11.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.699+0000 7f89e3000640 1 -- 172.21.15.121:0/4059329479 wait complete. 2024-09-17T03:39:11.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.701+0000 7f89e3000640 1 Processor -- start 2024-09-17T03:39:11.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.702+0000 7f89e3000640 1 -- start start 2024-09-17T03:39:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.703+0000 7f89e3000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89dc06ebc0 0x7f89dc1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.703+0000 7f89e3000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc071ba0 0x7f89dc15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.703+0000 7f89e3000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0cd330 0x7f89dc14b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.703+0000 7f89e3000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc0b4570 con 0x7f89dc06ebc0 2024-09-17T03:39:11.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.703+0000 7f89e3000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc0b43f0 con 0x7f89dc071ba0 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.703+0000 7f89e3000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f89dc0b46f0 con 0x7f89dc0cd330 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.703+0000 7f89e1c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89dc06ebc0 0x7f89dc1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.703+0000 7f89e1c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89dc06ebc0 0x7f89dc1571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38238/0 (socket says 172.21.15.121:38238) 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.703+0000 7f89e1c00640 1 -- 172.21.15.121:0/3314081666 learned_addr learned my addr 172.21.15.121:0/3314081666 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89e1200640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc071ba0 0x7f89dc15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89e1c00640 1 -- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0cd330 msgr2=0x7f89dc14b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89e1c00640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0cd330 0x7f89dc14b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89e1c00640 1 -- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc071ba0 msgr2=0x7f89dc15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89e1c00640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc071ba0 0x7f89dc15dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89e1c00640 1 -- 172.21.15.121:0/3314081666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc1576f0 con 0x7f89dc06ebc0 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89e1200640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc071ba0 0x7f89dc15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89e1c00640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89dc06ebc0 0x7f89dc1571b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f89d000c500 tx=0x7f89d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89d9600640 1 -- 172.21.15.121:0/3314081666 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0016020 con 0x7f89dc06ebc0 2024-09-17T03:39:11.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89d9600640 1 -- 172.21.15.121:0/3314081666 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89d0012940 con 0x7f89dc06ebc0 2024-09-17T03:39:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89e3000640 1 -- 172.21.15.121:0/3314081666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89dc149140 con 0x7f89dc06ebc0 2024-09-17T03:39:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89d9600640 1 -- 172.21.15.121:0/3314081666 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0012d90 con 0x7f89dc06ebc0 2024-09-17T03:39:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.704+0000 7f89e3000640 1 -- 172.21.15.121:0/3314081666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89dc149700 con 0x7f89dc06ebc0 2024-09-17T03:39:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.706+0000 7f89e3000640 1 -- 172.21.15.121:0/3314081666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89dc0b4c80 con 0x7f89dc06ebc0 2024-09-17T03:39:11.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.707+0000 7f89d9600640 1 -- 172.21.15.121:0/3314081666 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f89d0019020 con 0x7f89dc06ebc0 2024-09-17T03:39:11.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.708+0000 7f89d9600640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f89bc078bc0 0x7f89bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:11.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.708+0000 7f89d9600640 1 -- 172.21.15.121:0/3314081666 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f89d009acf0 con 0x7f89dc06ebc0 2024-09-17T03:39:11.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.708+0000 7f89e1200640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f89bc078bc0 0x7f89bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:11.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.709+0000 7f89e1200640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f89bc078bc0 0x7f89bc07b0d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0cffd0 tx=0x7f89c8005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:11.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.712+0000 7f89d9600640 1 -- 172.21.15.121:0/3314081666 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89d009f070 con 0x7f89dc06ebc0 2024-09-17T03:39:11.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.929+0000 7f89e3000640 1 -- 172.21.15.121:0/3314081666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89dc0aec50 con 0x7f89dc06ebc0 2024-09-17T03:39:11.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.929+0000 7f89d9600640 1 -- 172.21.15.121:0/3314081666 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5234 (secure 0 0 0) 0x7f89d0020030 con 0x7f89dc06ebc0 2024-09-17T03:39:11.929 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:11.929 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":50,"btime":"2024-09-17T03:39:02:620623+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5513,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3345012856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3345012856},{"type":"v1","addr":"172.21.15.176:6837","nonce":3345012856}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5519,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1489171016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1489171016},{"type":"v1","addr":"172.21.15.121:6835","nonce":1489171016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2870460783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2870460783},{"type":"v1","addr":"172.21.15.176:6836","nonce":2870460783}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:38:59.095974+0000","modified":"2024-09-17T03:39:02.108102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6132":{"gid":6132,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6834/762401029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":762401029},{"type":"v1","addr":"172.21.15.121:6834","nonce":762401029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6132,"qdb_cluster":[6132]},"id":5}]} 2024-09-17T03:39:11.930 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 50 2024-09-17T03:39:11.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 -- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f89bc078bc0 msgr2=0x7f89bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:11.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f89bc078bc0 0x7f89bc07b0d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0cffd0 tx=0x7f89c8005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:11.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 -- 172.21.15.121:0/3314081666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89dc06ebc0 msgr2=0x7f89dc1571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:11.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89dc06ebc0 0x7f89dc1571b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f89d000c500 tx=0x7f89d000c9c0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 -- 172.21.15.121:0/3314081666 shutdown_connections 2024-09-17T03:39:11.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89dc0cd330 0x7f89dc14b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89dc071ba0 0x7f89dc15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f89bc078bc0 0x7f89bc07b0d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 --2- 172.21.15.121:0/3314081666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89dc06ebc0 0x7f89dc1571b0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:11.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 -- 172.21.15.121:0/3314081666 >> 172.21.15.121:0/3314081666 conn(0x7f89dc073640 msgr2=0x7f89dc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:11.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 -- 172.21.15.121:0/3314081666 shutdown_connections 2024-09-17T03:39:11.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:11.932+0000 7f89e3000640 1 -- 172.21.15.121:0/3314081666 wait complete. 2024-09-17T03:39:11.957 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.178+0000 7f59d3200640 1 -- 172.21.15.121:0/1472092461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc0ce9e0 msgr2=0x7f59cc0d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.178+0000 7f59d3200640 1 --2- 172.21.15.121:0/1472092461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc0ce9e0 0x7f59cc0d0c40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f59b8005fd0 tx=0x7f59b802a670 comp rx=0 tx=0).stop 2024-09-17T03:39:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.178+0000 7f59d3200640 1 -- 172.21.15.121:0/1472092461 shutdown_connections 2024-09-17T03:39:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.178+0000 7f59d3200640 1 --2- 172.21.15.121:0/1472092461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc0ce9e0 0x7f59cc0d0c40 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.178+0000 7f59d3200640 1 --2- 172.21.15.121:0/1472092461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59cc0cc270 0x7f59cc0d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.178+0000 7f59d3200640 1 -- 172.21.15.121:0/1472092461 >> 172.21.15.121:0/1472092461 conn(0x7f59cc0b3580 msgr2=0x7f59cc0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:12.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.178+0000 7f59d3200640 1 -- 172.21.15.121:0/1472092461 shutdown_connections 2024-09-17T03:39:12.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.178+0000 7f59d3200640 1 -- 172.21.15.121:0/1472092461 wait complete. 2024-09-17T03:39:12.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.180+0000 7f59d3200640 1 Processor -- start 2024-09-17T03:39:12.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.181+0000 7f59d3200640 1 -- start start 2024-09-17T03:39:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59d3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59cc06cde0 0x7f59cc1f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59d3200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc0cc270 0x7f59cc1f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59d3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59cc0ce9e0 0x7f59cc1f9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59d3200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0afad0 con 0x7f59cc0cc270 2024-09-17T03:39:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59d3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0af950 con 0x7f59cc0ce9e0 2024-09-17T03:39:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59d3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc06d900 con 0x7f59cc06cde0 2024-09-17T03:39:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59cb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc0cc270 0x7f59cc1f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59cb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc0cc270 0x7f59cc1f8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38938/0 (socket says 172.21.15.121:38938) 2024-09-17T03:39:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59cbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59cc06cde0 0x7f59cc1f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59cb400640 1 -- 172.21.15.121:0/3782046099 learned_addr learned my addr 172.21.15.121:0/3782046099 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.182+0000 7f59d1200640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59cc0ce9e0 0x7f59cc1f9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59cb400640 1 -- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59cc06cde0 msgr2=0x7f59cc1f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:12.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59cb400640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59cc06cde0 0x7f59cc1f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59cb400640 1 -- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59cc0ce9e0 msgr2=0x7f59cc1f9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:12.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59cb400640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59cc0ce9e0 0x7f59cc1f9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59cb400640 1 -- 172.21.15.121:0/3782046099 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc0ae7c0 con 0x7f59cc0cc270 2024-09-17T03:39:12.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59cb400640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc0cc270 0x7f59cc1f8ec0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f59b8034040 tx=0x7f59b80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59c3e00640 1 -- 172.21.15.121:0/3782046099 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b803e030 con 0x7f59cc0cc270 2024-09-17T03:39:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59c3e00640 1 -- 172.21.15.121:0/3782046099 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59b8003d90 con 0x7f59cc0cc270 2024-09-17T03:39:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59d3200640 1 -- 172.21.15.121:0/3782046099 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59cc074230 con 0x7f59cc0cc270 2024-09-17T03:39:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59c3e00640 1 -- 172.21.15.121:0/3782046099 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8035040 con 0x7f59cc0cc270 2024-09-17T03:39:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.183+0000 7f59d3200640 1 -- 172.21.15.121:0/3782046099 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59cc1584e0 con 0x7f59cc0cc270 2024-09-17T03:39:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.184+0000 7f59d3200640 1 -- 172.21.15.121:0/3782046099 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59cc06d1f0 con 0x7f59cc0cc270 2024-09-17T03:39:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.186+0000 7f59c3e00640 1 -- 172.21.15.121:0/3782046099 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59b8041030 con 0x7f59cc0cc270 2024-09-17T03:39:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.187+0000 7f59c3e00640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59ac078bc0 0x7f59ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.187+0000 7f59c3e00640 1 -- 172.21.15.121:0/3782046099 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f59b80bb6e0 con 0x7f59cc0cc270 2024-09-17T03:39:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.187+0000 7f59cbe00640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59ac078bc0 0x7f59ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:12.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.188+0000 7f59cbe00640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59ac078bc0 0x7f59ac07b0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00bb50 tx=0x7f59bc00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:12.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.191+0000 7f59c3e00640 1 -- 172.21.15.121:0/3782046099 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59b8083220 con 0x7f59cc0cc270 2024-09-17T03:39:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.375+0000 7f59d3200640 1 -- 172.21.15.121:0/3782046099 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59cc0b1d30 con 0x7f59cc0cc270 2024-09-17T03:39:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.377+0000 7f59c3e00640 1 -- 172.21.15.121:0/3782046099 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17005 (secure 0 0 0) 0x7f59b8087c50 con 0x7f59cc0cc270 2024-09-17T03:39:12.377 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:12.377 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":76,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:00.607362+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:38:57.006752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-17T03:38:58.058455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 -- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59ac078bc0 msgr2=0x7f59ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59ac078bc0 0x7f59ac07b0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00bb50 tx=0x7f59bc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 -- 172.21.15.121:0/3782046099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc0cc270 msgr2=0x7f59cc1f8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc0cc270 0x7f59cc1f8ec0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f59b8034040 tx=0x7f59b80038a0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 -- 172.21.15.121:0/3782046099 shutdown_connections 2024-09-17T03:39:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59cc0ce9e0 0x7f59cc1f9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59ac078bc0 0x7f59ac07b0d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc0cc270 0x7f59cc1f8ec0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 --2- 172.21.15.121:0/3782046099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59cc06cde0 0x7f59cc1f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 -- 172.21.15.121:0/3782046099 >> 172.21.15.121:0/3782046099 conn(0x7f59cc0b3580 msgr2=0x7f59cc068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 -- 172.21.15.121:0/3782046099 shutdown_connections 2024-09-17T03:39:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.379+0000 7f59d3200640 1 -- 172.21.15.121:0/3782046099 wait complete. 2024-09-17T03:39:12.401 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:39:12.401 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:12.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.623+0000 7faf13200640 1 -- 172.21.15.121:0/1258872757 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf0c070810 msgr2=0x7faf0c0b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:12.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.623+0000 7faf13200640 1 --2- 172.21.15.121:0/1258872757 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf0c070810 0x7faf0c0b4c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf00009830 tx=0x7faf0002a510 comp rx=0 tx=0).stop 2024-09-17T03:39:12.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.623+0000 7faf13200640 1 -- 172.21.15.121:0/1258872757 shutdown_connections 2024-09-17T03:39:12.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.623+0000 7faf13200640 1 --2- 172.21.15.121:0/1258872757 >> v2:172.21.15.176:3300/0 conn(0x7faf0c160890 0x7faf0c06d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.623+0000 7faf13200640 1 --2- 172.21.15.121:0/1258872757 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf0c070810 0x7faf0c0b4c80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.623+0000 7faf13200640 1 -- 172.21.15.121:0/1258872757 >> 172.21.15.121:0/1258872757 conn(0x7faf0c0b2440 msgr2=0x7faf0c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:12.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.623+0000 7faf13200640 1 -- 172.21.15.121:0/1258872757 shutdown_connections 2024-09-17T03:39:12.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.623+0000 7faf13200640 1 -- 172.21.15.121:0/1258872757 wait complete. 2024-09-17T03:39:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.625+0000 7faf13200640 1 Processor -- start 2024-09-17T03:39:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.625+0000 7faf13200640 1 -- start start 2024-09-17T03:39:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.626+0000 7faf13200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf0c070810 0x7faf0c150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:12.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf13200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf0c0b51c0 0x7faf0c09b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:12.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf13200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf0c150e30 0x7faf0c09bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:12.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf13200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c06dd70 con 0x7faf0c150e30 2024-09-17T03:39:12.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf13200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c06def0 con 0x7faf0c0b51c0 2024-09-17T03:39:12.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf13200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf0c06e070 con 0x7faf0c070810 2024-09-17T03:39:12.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf12800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf0c150e30 0x7faf0c09bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:12.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf12800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf0c150e30 0x7faf0c09bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38950/0 (socket says 172.21.15.121:38950) 2024-09-17T03:39:12.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf12800640 1 -- 172.21.15.121:0/858841956 learned_addr learned my addr 172.21.15.121:0/858841956 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:12.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf11e00640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf0c070810 0x7faf0c150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:12.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf11400640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf0c0b51c0 0x7faf0c09b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:12.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf12800640 1 -- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf0c070810 msgr2=0x7faf0c150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf12800640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf0c070810 0x7faf0c150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf12800640 1 -- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf0c0b51c0 msgr2=0x7faf0c09b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf12800640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf0c0b51c0 0x7faf0c09b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf12800640 1 -- 172.21.15.121:0/858841956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c1508e0 con 0x7faf0c150e30 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf11e00640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf0c070810 0x7faf0c150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.627+0000 7faf11400640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf0c0b51c0 0x7faf0c09b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.628+0000 7faf12800640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf0c150e30 0x7faf0c09bbe0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faf0800efc0 tx=0x7faf0800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.628+0000 7faf06000640 1 -- 172.21.15.121:0/858841956 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08003970 con 0x7faf0c150e30 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.628+0000 7faf06000640 1 -- 172.21.15.121:0/858841956 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf08003c00 con 0x7faf0c150e30 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.628+0000 7faf06000640 1 -- 172.21.15.121:0/858841956 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08004020 con 0x7faf0c150e30 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.628+0000 7faf13200640 1 -- 172.21.15.121:0/858841956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c15e9e0 con 0x7faf0c150e30 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.628+0000 7faf13200640 1 -- 172.21.15.121:0/858841956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c15efa0 con 0x7faf0c150e30 2024-09-17T03:39:12.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.629+0000 7faf13200640 1 -- 172.21.15.121:0/858841956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c150b50 con 0x7faf0c150e30 2024-09-17T03:39:12.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.630+0000 7faf06000640 1 -- 172.21.15.121:0/858841956 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf0801d020 con 0x7faf0c150e30 2024-09-17T03:39:12.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.631+0000 7faf06000640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faef0078bc0 0x7faef007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:12.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.631+0000 7faf06000640 1 -- 172.21.15.121:0/858841956 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7faf0809b540 con 0x7faf0c150e30 2024-09-17T03:39:12.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.632+0000 7faf11e00640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faef0078bc0 0x7faef007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:12.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.632+0000 7faf11e00640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faef0078bc0 0x7faef007b0d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faf00034000 tx=0x7faf00004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:12.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.636+0000 7faf06000640 1 -- 172.21.15.121:0/858841956 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf080637f0 con 0x7faf0c150e30 2024-09-17T03:39:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.852+0000 7faf13200640 1 -- 172.21.15.121:0/858841956 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf0c06e590 con 0x7faf0c150e30 2024-09-17T03:39:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.853+0000 7faf06000640 1 -- 172.21.15.121:0/858841956 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5234 (secure 0 0 0) 0x7faf080630f0 con 0x7faf0c150e30 2024-09-17T03:39:12.853 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:12.854 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":50,"btime":"2024-09-17T03:39:02:620623+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5513,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3345012856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3345012856},{"type":"v1","addr":"172.21.15.176:6837","nonce":3345012856}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5519,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1489171016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1489171016},{"type":"v1","addr":"172.21.15.121:6835","nonce":1489171016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2870460783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2870460783},{"type":"v1","addr":"172.21.15.176:6836","nonce":2870460783}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:38:59.095974+0000","modified":"2024-09-17T03:39:02.108102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6132":{"gid":6132,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6834/762401029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":762401029},{"type":"v1","addr":"172.21.15.121:6834","nonce":762401029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6132,"qdb_cluster":[6132]},"id":5}]} 2024-09-17T03:39:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 50 2024-09-17T03:39:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.855+0000 7faf13200640 1 -- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faef0078bc0 msgr2=0x7faef007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.855+0000 7faf13200640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faef0078bc0 0x7faef007b0d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faf00034000 tx=0x7faf00004730 comp rx=0 tx=0).stop 2024-09-17T03:39:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.855+0000 7faf13200640 1 -- 172.21.15.121:0/858841956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf0c150e30 msgr2=0x7faf0c09bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.856+0000 7faf13200640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf0c150e30 0x7faf0c09bbe0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faf0800efc0 tx=0x7faf0800c800 comp rx=0 tx=0).stop 2024-09-17T03:39:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.856+0000 7faf13200640 1 -- 172.21.15.121:0/858841956 shutdown_connections 2024-09-17T03:39:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.856+0000 7faf13200640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faef0078bc0 0x7faef007b0d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.856+0000 7faf13200640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf0c150e30 0x7faf0c09bbe0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.856+0000 7faf13200640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf0c0b51c0 0x7faf0c09b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.856+0000 7faf13200640 1 --2- 172.21.15.121:0/858841956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf0c070810 0x7faf0c150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.856+0000 7faf13200640 1 -- 172.21.15.121:0/858841956 >> 172.21.15.121:0/858841956 conn(0x7faf0c0b2440 msgr2=0x7faf0c156100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.856+0000 7faf13200640 1 -- 172.21.15.121:0/858841956 shutdown_connections 2024-09-17T03:39:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:12.856+0000 7faf13200640 1 -- 172.21.15.121:0/858841956 wait complete. 2024-09-17T03:39:12.878 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.098+0000 7f72f9200640 1 -- 172.21.15.121:0/113091271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f415a3e0 msgr2=0x7f72f406d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.098+0000 7f72f9200640 1 --2- 172.21.15.121:0/113091271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f415a3e0 0x7f72f406d800 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009830 tx=0x7f72e402a3e0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.098+0000 7f72f9200640 1 -- 172.21.15.121:0/113091271 shutdown_connections 2024-09-17T03:39:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.098+0000 7f72f9200640 1 --2- 172.21.15.121:0/113091271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72f406ddc0 0x7f72f40d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.098+0000 7f72f9200640 1 --2- 172.21.15.121:0/113091271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f415a3e0 0x7f72f406d800 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.098+0000 7f72f9200640 1 -- 172.21.15.121:0/113091271 >> 172.21.15.121:0/113091271 conn(0x7f72f40b3580 msgr2=0x7f72f40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.098+0000 7f72f9200640 1 -- 172.21.15.121:0/113091271 shutdown_connections 2024-09-17T03:39:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.098+0000 7f72f9200640 1 -- 172.21.15.121:0/113091271 wait complete. 2024-09-17T03:39:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.101+0000 7f72f9200640 1 Processor -- start 2024-09-17T03:39:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.101+0000 7f72f9200640 1 -- start start 2024-09-17T03:39:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.102+0000 7f72f9200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f406ddc0 0x7f72f409cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.102+0000 7f72f9200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72f40d0af0 0x7f72f409d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.102+0000 7f72f9200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72f415a3e0 0x7f72f4073e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.102+0000 7f72f9200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72f406f560 con 0x7f72f406ddc0 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.102+0000 7f72f9200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4161190 con 0x7f72f40d0af0 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.102+0000 7f72f9200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72f406f6e0 con 0x7f72f415a3e0 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.102+0000 7f72f1e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f406ddc0 0x7f72f409cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.102+0000 7f72f1e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f406ddc0 0x7f72f409cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38962/0 (socket says 172.21.15.121:38962) 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.102+0000 7f72f1e00640 1 -- 172.21.15.121:0/3758504780 learned_addr learned my addr 172.21.15.121:0/3758504780 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f1400640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72f40d0af0 0x7f72f409d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f2800640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72f415a3e0 0x7f72f4073e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f1e00640 1 -- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72f415a3e0 msgr2=0x7f72f4073e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f1e00640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72f415a3e0 0x7f72f4073e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f1e00640 1 -- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72f40d0af0 msgr2=0x7f72f409d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f1e00640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72f40d0af0 0x7f72f409d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f1e00640 1 -- 172.21.15.121:0/3758504780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f409de00 con 0x7f72f406ddc0 2024-09-17T03:39:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f2800640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72f415a3e0 0x7f72f4073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f1400640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72f40d0af0 0x7f72f409d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f1e00640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f406ddc0 0x7f72f409cf40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f72e402a9d0 tx=0x7f72e4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72ea000640 1 -- 172.21.15.121:0/3758504780 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4031d60 con 0x7f72f406ddc0 2024-09-17T03:39:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72ea000640 1 -- 172.21.15.121:0/3758504780 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e4033e10 con 0x7f72f406ddc0 2024-09-17T03:39:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72ea000640 1 -- 172.21.15.121:0/3758504780 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4005260 con 0x7f72f406ddc0 2024-09-17T03:39:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f9200640 1 -- 172.21.15.121:0/3758504780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f409e0e0 con 0x7f72f406ddc0 2024-09-17T03:39:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.103+0000 7f72f9200640 1 -- 172.21.15.121:0/3758504780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f409c740 con 0x7f72f406ddc0 2024-09-17T03:39:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.104+0000 7f72f9200640 1 -- 172.21.15.121:0/3758504780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f406fb90 con 0x7f72f406ddc0 2024-09-17T03:39:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.106+0000 7f72ea000640 1 -- 172.21.15.121:0/3758504780 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72e4005400 con 0x7f72f406ddc0 2024-09-17T03:39:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.107+0000 7f72ea000640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f72d4078b90 0x7f72d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.107+0000 7f72ea000640 1 -- 172.21.15.121:0/3758504780 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f72e40bc160 con 0x7f72f406ddc0 2024-09-17T03:39:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.107+0000 7f72f1400640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f72d4078b90 0x7f72d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:13.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.108+0000 7f72f1400640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f72d4078b90 0x7f72d407b0a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f72f4099620 tx=0x7f72e0005f10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.111+0000 7f72ea000640 1 -- 172.21.15.121:0/3758504780 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72e403f030 con 0x7f72f406ddc0 2024-09-17T03:39:13.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.331+0000 7f72f9200640 1 -- 172.21.15.121:0/3758504780 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72f4075170 con 0x7f72f406ddc0 2024-09-17T03:39:13.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.332+0000 7f72ea000640 1 -- 172.21.15.121:0/3758504780 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5234 (secure 0 0 0) 0x7f72e4084400 con 0x7f72f406ddc0 2024-09-17T03:39:13.332 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:13.332 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":50,"btime":"2024-09-17T03:39:02:620623+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5513,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3345012856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3345012856},{"type":"v1","addr":"172.21.15.176:6837","nonce":3345012856}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5519,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1489171016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1489171016},{"type":"v1","addr":"172.21.15.121:6835","nonce":1489171016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2870460783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2870460783},{"type":"v1","addr":"172.21.15.176:6836","nonce":2870460783}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:38:59.095974+0000","modified":"2024-09-17T03:39:02.108102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6132":{"gid":6132,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6834/762401029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":762401029},{"type":"v1","addr":"172.21.15.121:6834","nonce":762401029}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6132,"qdb_cluster":[6132]},"id":5}]} 2024-09-17T03:39:13.332 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 50 2024-09-17T03:39:13.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.334+0000 7f72f9200640 1 -- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f72d4078b90 msgr2=0x7f72d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:13.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.334+0000 7f72f9200640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f72d4078b90 0x7f72d407b0a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f72f4099620 tx=0x7f72e0005f10 comp rx=0 tx=0).stop 2024-09-17T03:39:13.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.334+0000 7f72f9200640 1 -- 172.21.15.121:0/3758504780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f406ddc0 msgr2=0x7f72f409cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:13.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.334+0000 7f72f9200640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f406ddc0 0x7f72f409cf40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f72e402a9d0 tx=0x7f72e4033c20 comp rx=0 tx=0).stop 2024-09-17T03:39:13.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.335+0000 7f72f9200640 1 -- 172.21.15.121:0/3758504780 shutdown_connections 2024-09-17T03:39:13.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.335+0000 7f72f9200640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72f415a3e0 0x7f72f4073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.335+0000 7f72f9200640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72f40d0af0 0x7f72f409d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.335+0000 7f72f9200640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f72d4078b90 0x7f72d407b0a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.335+0000 7f72f9200640 1 --2- 172.21.15.121:0/3758504780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f406ddc0 0x7f72f409cf40 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.335+0000 7f72f9200640 1 -- 172.21.15.121:0/3758504780 >> 172.21.15.121:0/3758504780 conn(0x7f72f40b3580 msgr2=0x7f72f40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:13.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.335+0000 7f72f9200640 1 -- 172.21.15.121:0/3758504780 shutdown_connections 2024-09-17T03:39:13.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.335+0000 7f72f9200640 1 -- 172.21.15.121:0/3758504780 wait complete. 2024-09-17T03:39:13.358 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.579+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3974051051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9b8004800 msgr2=0x7fc9b8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.579+0000 7fc9dbc00640 1 --2- 172.21.15.121:0/3974051051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9b8004800 0x7fc9b8004c10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4072e60 tx=0x7fc9b8005830 comp rx=0 tx=0).stop 2024-09-17T03:39:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.579+0000 7fc9d9c00640 1 -- 172.21.15.121:0/3974051051 reap_dead start 2024-09-17T03:39:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.579+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3974051051 shutdown_connections 2024-09-17T03:39:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.579+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3974051051 >> 172.21.15.121:0/3974051051 conn(0x7fc9d40b3580 msgr2=0x7fc9d40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.579+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3974051051 shutdown_connections 2024-09-17T03:39:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.579+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3974051051 wait complete. 2024-09-17T03:39:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.582+0000 7fc9dbc00640 1 Processor -- start 2024-09-17T03:39:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.582+0000 7fc9dbc00640 1 -- start start 2024-09-17T03:39:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.583+0000 7fc9dbc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b8004800 0x7fc9d40c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.583+0000 7fc9dbc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9d40b2920 0x7fc9d40af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.583+0000 7fc9dbc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d415b960 0x7fc9d40af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.583+0000 7fc9dbc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d40d0ec0 con 0x7fc9d40b2920 2024-09-17T03:39:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.583+0000 7fc9dbc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d40d0d40 con 0x7fc9d415b960 2024-09-17T03:39:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.583+0000 7fc9dbc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d406da30 con 0x7fc9b8004800 2024-09-17T03:39:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.583+0000 7fc9cbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9d40b2920 0x7fc9d40af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9cbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9d40b2920 0x7fc9d40af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38978/0 (socket says 172.21.15.121:38978) 2024-09-17T03:39:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9cbe00640 1 -- 172.21.15.121:0/3266597877 learned_addr learned my addr 172.21.15.121:0/3266597877 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9d9200640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b8004800 0x7fc9d40c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9d9c00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d415b960 0x7fc9d40af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:13.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9cbe00640 1 -- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b8004800 msgr2=0x7fc9d40c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:13.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9cbe00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b8004800 0x7fc9d40c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9cbe00640 1 -- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d415b960 msgr2=0x7fc9d40af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:13.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9cbe00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d415b960 0x7fc9d40af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9cbe00640 1 -- 172.21.15.121:0/3266597877 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d41f54f0 con 0x7fc9d40b2920 2024-09-17T03:39:13.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9d9c00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d415b960 0x7fc9d40af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:13.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9cbe00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9d40b2920 0x7fc9d40af050 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c320 tx=0x7fc9bc001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9d1600640 1 -- 172.21.15.121:0/3266597877 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc031040 con 0x7fc9d40b2920 2024-09-17T03:39:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.584+0000 7fc9d1600640 1 -- 172.21.15.121:0/3266597877 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9bc0035f0 con 0x7fc9d40b2920 2024-09-17T03:39:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.585+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3266597877 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d41f57d0 con 0x7fc9d40b2920 2024-09-17T03:39:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.585+0000 7fc9d1600640 1 -- 172.21.15.121:0/3266597877 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc003a00 con 0x7fc9d40b2920 2024-09-17T03:39:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.585+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3266597877 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d41f5d90 con 0x7fc9d40b2920 2024-09-17T03:39:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.586+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3266597877 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d40707c0 con 0x7fc9d40b2920 2024-09-17T03:39:13.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.587+0000 7fc9d1600640 1 -- 172.21.15.121:0/3266597877 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9bc034070 con 0x7fc9d40b2920 2024-09-17T03:39:13.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.588+0000 7fc9d1600640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9b0078b90 0x7fc9b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:13.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.588+0000 7fc9d1600640 1 -- 172.21.15.121:0/3266597877 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fc9bc0baeb0 con 0x7fc9d40b2920 2024-09-17T03:39:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.588+0000 7fc9d9200640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9b0078b90 0x7fc9b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.589+0000 7fc9d9200640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9b0078b90 0x7fc9b007b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009c50 tx=0x7fc9c4005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:13.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.592+0000 7fc9d1600640 1 -- 172.21.15.121:0/3266597877 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9bc0830d0 con 0x7fc9d40b2920 2024-09-17T03:39:13.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.775+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3266597877 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9d41eb2d0 con 0x7fc9d40b2920 2024-09-17T03:39:13.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.776+0000 7fc9d1600640 1 -- 172.21.15.121:0/3266597877 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17005 (secure 0 0 0) 0x7fc9bc0829d0 con 0x7fc9d40b2920 2024-09-17T03:39:13.776 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:13.776 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":76,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:00.607362+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:38:57.006752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-17T03:38:58.058455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:13.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9b0078b90 msgr2=0x7fc9b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:13.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9b0078b90 0x7fc9b007b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009c50 tx=0x7fc9c4005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:13.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3266597877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9d40b2920 msgr2=0x7fc9d40af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:13.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9d40b2920 0x7fc9d40af050 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c320 tx=0x7fc9bc001d20 comp rx=0 tx=0).stop 2024-09-17T03:39:13.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3266597877 shutdown_connections 2024-09-17T03:39:13.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d415b960 0x7fc9d40af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc9b0078b90 0x7fc9b007b0a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9d40b2920 0x7fc9d40af050 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 --2- 172.21.15.121:0/3266597877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9b8004800 0x7fc9d40c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:13.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3266597877 >> 172.21.15.121:0/3266597877 conn(0x7fc9d40b3580 msgr2=0x7fc9d40cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:13.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3266597877 shutdown_connections 2024-09-17T03:39:13.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:13.778+0000 7fc9dbc00640 1 -- 172.21.15.121:0/3266597877 wait complete. 2024-09-17T03:39:13.803 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:39:14.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.025+0000 7fb462a00640 1 -- 172.21.15.121:0/810042297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb45c06d800 msgr2=0x7fb45c0d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:14.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.025+0000 7fb462a00640 1 --2- 172.21.15.121:0/810042297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb45c06d800 0x7fb45c0d05b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb448009830 tx=0x7fb44802a490 comp rx=0 tx=0).stop 2024-09-17T03:39:14.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.025+0000 7fb462a00640 1 -- 172.21.15.121:0/810042297 shutdown_connections 2024-09-17T03:39:14.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.025+0000 7fb462a00640 1 --2- 172.21.15.121:0/810042297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb45c06d800 0x7fb45c0d05b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.025+0000 7fb462a00640 1 -- 172.21.15.121:0/810042297 >> 172.21.15.121:0/810042297 conn(0x7fb45c0b3580 msgr2=0x7fb45c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:14.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.025+0000 7fb462a00640 1 -- 172.21.15.121:0/810042297 shutdown_connections 2024-09-17T03:39:14.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.025+0000 7fb462a00640 1 -- 172.21.15.121:0/810042297 wait complete. 2024-09-17T03:39:14.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.028+0000 7fb462a00640 1 Processor -- start 2024-09-17T03:39:14.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.028+0000 7fb462a00640 1 -- start start 2024-09-17T03:39:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.029+0000 7fb462a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb45c06d800 0x7fb45c15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.029+0000 7fb462a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb45c0d0af0 0x7fb45c1ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.029+0000 7fb462a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c15a3e0 0x7fb45c1f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.029+0000 7fb462a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c15d6b0 con 0x7fb45c15a3e0 2024-09-17T03:39:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.029+0000 7fb462a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c15d530 con 0x7fb45c0d0af0 2024-09-17T03:39:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.029+0000 7fb462a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb45c15d830 con 0x7fb45c06d800 2024-09-17T03:39:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb460a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c15a3e0 0x7fb45c1f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb460a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c15a3e0 0x7fb45c1f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38988/0 (socket says 172.21.15.121:38988) 2024-09-17T03:39:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb460a00640 1 -- 172.21.15.121:0/607003150 learned_addr learned my addr 172.21.15.121:0/607003150 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb45b400640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb45c0d0af0 0x7fb45c1ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb45be00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb45c06d800 0x7fb45c15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb460a00640 1 -- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb45c06d800 msgr2=0x7fb45c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb460a00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb45c06d800 0x7fb45c15dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb460a00640 1 -- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb45c0d0af0 msgr2=0x7fb45c1ec3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb460a00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb45c0d0af0 0x7fb45c1ec3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb460a00640 1 -- 172.21.15.121:0/607003150 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c1f5f10 con 0x7fb45c15a3e0 2024-09-17T03:39:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.030+0000 7fb460a00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c15a3e0 0x7fb45c1f59d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb45400caa0 tx=0x7fb45400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.031+0000 7fb453e00640 1 -- 172.21.15.121:0/607003150 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454016020 con 0x7fb45c15a3e0 2024-09-17T03:39:14.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.031+0000 7fb453e00640 1 -- 172.21.15.121:0/607003150 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb45400ad10 con 0x7fb45c15a3e0 2024-09-17T03:39:14.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.031+0000 7fb453e00640 1 -- 172.21.15.121:0/607003150 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454012680 con 0x7fb45c15a3e0 2024-09-17T03:39:14.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.031+0000 7fb462a00640 1 -- 172.21.15.121:0/607003150 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45c1f6420 con 0x7fb45c15a3e0 2024-09-17T03:39:14.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.031+0000 7fb462a00640 1 -- 172.21.15.121:0/607003150 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb45c0cdee0 con 0x7fb45c15a3e0 2024-09-17T03:39:14.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.032+0000 7fb462a00640 1 -- 172.21.15.121:0/607003150 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45c1f6190 con 0x7fb45c15a3e0 2024-09-17T03:39:14.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.033+0000 7fb453e00640 1 -- 172.21.15.121:0/607003150 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb454019020 con 0x7fb45c15a3e0 2024-09-17T03:39:14.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.034+0000 7fb453e00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb43c078b90 0x7fb43c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:14.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.034+0000 7fb453e00640 1 -- 172.21.15.121:0/607003150 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fb45409af50 con 0x7fb45c15a3e0 2024-09-17T03:39:14.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.035+0000 7fb45be00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb43c078b90 0x7fb43c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:14.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.035+0000 7fb45be00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb43c078b90 0x7fb43c07b0a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb44c000c00 tx=0x7fb44c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:14.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.039+0000 7fb453e00640 1 -- 172.21.15.121:0/607003150 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb454020030 con 0x7fb45c15a3e0 2024-09-17T03:39:14.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.259+0000 7fb462a00640 1 -- 172.21.15.121:0/607003150 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb45c0d05b0 con 0x7fb45c15a3e0 2024-09-17T03:39:14.259 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-17T03:39:14.260+0000 7f1def400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:39:14.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.262+0000 7fb453e00640 1 -- 172.21.15.121:0/607003150 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) ==== 161+0+0 (secure 0 0 0) 0x7fb45c0d0f00 con 0x7fb45c15a3e0 2024-09-17T03:39:14.262 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:39:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 -- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb43c078b90 msgr2=0x7fb43c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb43c078b90 0x7fb43c07b0a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb44c000c00 tx=0x7fb44c009040 comp rx=0 tx=0).stop 2024-09-17T03:39:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 -- 172.21.15.121:0/607003150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c15a3e0 msgr2=0x7fb45c1f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c15a3e0 0x7fb45c1f59d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb45400caa0 tx=0x7fb45400cf60 comp rx=0 tx=0).stop 2024-09-17T03:39:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 -- 172.21.15.121:0/607003150 shutdown_connections 2024-09-17T03:39:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb43c078b90 0x7fb43c07b0a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c15a3e0 0x7fb45c1f59d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb45c0d0af0 0x7fb45c1ec3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 --2- 172.21.15.121:0/607003150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb45c06d800 0x7fb45c15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 -- 172.21.15.121:0/607003150 >> 172.21.15.121:0/607003150 conn(0x7fb45c0b3580 msgr2=0x7fb45c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:14.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 -- 172.21.15.121:0/607003150 shutdown_connections 2024-09-17T03:39:14.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.266+0000 7fb462a00640 1 -- 172.21.15.121:0/607003150 wait complete. 2024-09-17T03:39:14.271 INFO:tasks.ceph.mds.c.smithi121.stderr: -2241> 2024-09-17T03:39:01.578+0000 7efe2c400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:39:14.292 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:39:14.390 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:39:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.522+0000 7ff10c000640 1 -- 172.21.15.121:0/1129957725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff10406ddc0 msgr2=0x7ff1040d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.522+0000 7ff10c000640 1 --2- 172.21.15.121:0/1129957725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff10406ddc0 0x7ff1040d05b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff1040cdc20 tx=0x7ff0f002a440 comp rx=0 tx=0).stop 2024-09-17T03:39:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.522+0000 7ff10c000640 1 -- 172.21.15.121:0/1129957725 shutdown_connections 2024-09-17T03:39:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.522+0000 7ff10c000640 1 --2- 172.21.15.121:0/1129957725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff10406ddc0 0x7ff1040d05b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.522+0000 7ff10c000640 1 --2- 172.21.15.121:0/1129957725 >> v2:172.21.15.176:3300/0 conn(0x7ff10415a3e0 0x7ff10406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.522+0000 7ff10c000640 1 -- 172.21.15.121:0/1129957725 >> 172.21.15.121:0/1129957725 conn(0x7ff1040b3580 msgr2=0x7ff1040b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.522+0000 7ff10c000640 1 -- 172.21.15.121:0/1129957725 shutdown_connections 2024-09-17T03:39:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.522+0000 7ff10c000640 1 -- 172.21.15.121:0/1129957725 wait complete. 2024-09-17T03:39:14.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.524+0000 7ff10c000640 1 Processor -- start 2024-09-17T03:39:14.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.525+0000 7ff10c000640 1 -- start start 2024-09-17T03:39:14.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff10c000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff10406ddc0 0x7ff1041570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff10c000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1040d0af0 0x7ff1040c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff10c000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff10415a3e0 0x7ff1040c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff10c000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff10406e3d0 con 0x7ff1040d0af0 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff10c000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff104161190 con 0x7ff10415a3e0 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff10c000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff10406f560 con 0x7ff10406ddc0 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff108c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1040d0af0 0x7ff1040c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff108c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1040d0af0 0x7ff1040c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39022/0 (socket says 172.21.15.121:39022) 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff108c00640 1 -- 172.21.15.121:0/1237282370 learned_addr learned my addr 172.21.15.121:0/1237282370 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff10a000640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff10415a3e0 0x7ff1040c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.526+0000 7ff109600640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff10406ddc0 0x7ff1041570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff108c00640 1 -- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff10406ddc0 msgr2=0x7ff1041570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:14.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff108c00640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff10406ddc0 0x7ff1041570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff108c00640 1 -- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff10415a3e0 msgr2=0x7ff1040c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:14.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff108c00640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff10415a3e0 0x7ff1040c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:14.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff108c00640 1 -- 172.21.15.121:0/1237282370 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff104074540 con 0x7ff1040d0af0 2024-09-17T03:39:14.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff109600640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff10406ddc0 0x7ff1041570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:14.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff108c00640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1040d0af0 0x7ff1040c5e10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0034040 tx=0x7ff0f00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:14.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff101600640 1 -- 172.21.15.121:0/1237282370 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f003e030 con 0x7ff1040d0af0 2024-09-17T03:39:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff10c000640 1 -- 172.21.15.121:0/1237282370 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff104074820 con 0x7ff1040d0af0 2024-09-17T03:39:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff101600640 1 -- 172.21.15.121:0/1237282370 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0f00047a0 con 0x7ff1040d0af0 2024-09-17T03:39:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.527+0000 7ff101600640 1 -- 172.21.15.121:0/1237282370 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0035040 con 0x7ff1040d0af0 2024-09-17T03:39:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.528+0000 7ff10c000640 1 -- 172.21.15.121:0/1237282370 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff104074de0 con 0x7ff1040d0af0 2024-09-17T03:39:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.529+0000 7ff10c000640 1 -- 172.21.15.121:0/1237282370 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff10406fa30 con 0x7ff1040d0af0 2024-09-17T03:39:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.530+0000 7ff101600640 1 -- 172.21.15.121:0/1237282370 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0f0041030 con 0x7ff1040d0af0 2024-09-17T03:39:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.531+0000 7ff101600640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e4078b90 0x7ff0e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.531+0000 7ff101600640 1 -- 172.21.15.121:0/1237282370 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7ff0f00bb8e0 con 0x7ff1040d0af0 2024-09-17T03:39:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.531+0000 7ff109600640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e4078b90 0x7ff0e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.532+0000 7ff109600640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e4078b90 0x7ff0e407b0a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800ab40 tx=0x7ff0f800a520 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:14.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.536+0000 7ff101600640 1 -- 172.21.15.121:0/1237282370 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1040d0f00 con 0x7ff1040d0af0 2024-09-17T03:39:14.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:14.760+0000 7ff10c000640 1 -- 172.21.15.121:0/1237282370 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff10406eee0 con 0x7ff1040d0af0 2024-09-17T03:39:15.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.264+0000 7ff101600640 1 -- 172.21.15.121:0/1237282370 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) ==== 104+0+0 (secure 0 0 0) 0x7ff0f00833d0 con 0x7ff1040d0af0 2024-09-17T03:39:15.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 -- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e4078b90 msgr2=0x7ff0e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:15.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e4078b90 0x7ff0e407b0a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800ab40 tx=0x7ff0f800a520 comp rx=0 tx=0).stop 2024-09-17T03:39:15.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 -- 172.21.15.121:0/1237282370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1040d0af0 msgr2=0x7ff1040c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:15.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1040d0af0 0x7ff1040c5e10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0034040 tx=0x7ff0f00039e0 comp rx=0 tx=0).stop 2024-09-17T03:39:15.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 -- 172.21.15.121:0/1237282370 shutdown_connections 2024-09-17T03:39:15.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff10415a3e0 0x7ff1040c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:15.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e4078b90 0x7ff0e407b0a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:15.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1040d0af0 0x7ff1040c5e10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:15.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 --2- 172.21.15.121:0/1237282370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff10406ddc0 0x7ff1041570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:15.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 -- 172.21.15.121:0/1237282370 >> 172.21.15.121:0/1237282370 conn(0x7ff1040b3580 msgr2=0x7ff104068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:15.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 -- 172.21.15.121:0/1237282370 shutdown_connections 2024-09-17T03:39:15.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.267+0000 7ff10c000640 1 -- 172.21.15.121:0/1237282370 wait complete. 2024-09-17T03:39:15.291 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:39:15.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.516+0000 7f140be00640 1 -- 172.21.15.121:0/2708637530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f140c074760 msgr2=0x7f140c074b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:15.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.516+0000 7f140be00640 1 --2- 172.21.15.121:0/2708637530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f140c074760 0x7f140c074b70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005fd0 tx=0x7f13f802a540 comp rx=0 tx=0).stop 2024-09-17T03:39:15.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.516+0000 7f140be00640 1 -- 172.21.15.121:0/2708637530 shutdown_connections 2024-09-17T03:39:15.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.516+0000 7f140be00640 1 --2- 172.21.15.121:0/2708637530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f140c074760 0x7f140c074b70 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:15.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.516+0000 7f140be00640 1 --2- 172.21.15.121:0/2708637530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f140c06ece0 0x7f140c06e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:15.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.516+0000 7f140be00640 1 -- 172.21.15.121:0/2708637530 >> 172.21.15.121:0/2708637530 conn(0x7f140c0d0500 msgr2=0x7f140c0d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:15.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.516+0000 7f140be00640 1 -- 172.21.15.121:0/2708637530 shutdown_connections 2024-09-17T03:39:15.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.516+0000 7f140be00640 1 -- 172.21.15.121:0/2708637530 wait complete. 2024-09-17T03:39:15.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.519+0000 7f140be00640 1 Processor -- start 2024-09-17T03:39:15.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.519+0000 7f140be00640 1 -- start start 2024-09-17T03:39:15.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.520+0000 7f140be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f140c06ece0 0x7f140c152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.520+0000 7f140be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f140c074760 0x7f140c14c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.520+0000 7f140be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f140c0ad150 0x7f140c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.520+0000 7f140be00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f140c1531f0 con 0x7f140c074760 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.520+0000 7f140be00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f140c153070 con 0x7f140c0ad150 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.520+0000 7f140be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f140c153370 con 0x7f140c06ece0 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.520+0000 7f140a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f140c074760 0x7f140c14c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.520+0000 7f140a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f140c074760 0x7f140c14c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39038/0 (socket says 172.21.15.121:39038) 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.520+0000 7f140a000640 1 -- 172.21.15.121:0/496346066 learned_addr learned my addr 172.21.15.121:0/496346066 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f140b400640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f140c0ad150 0x7f140c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f140aa00640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f140c06ece0 0x7f140c152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:15.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f140a000640 1 -- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f140c06ece0 msgr2=0x7f140c152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:15.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f140a000640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f140c06ece0 0x7f140c152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:15.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f140a000640 1 -- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f140c0ad150 msgr2=0x7f140c15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:15.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f140a000640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f140c0ad150 0x7f140c15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:15.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f140a000640 1 -- 172.21.15.121:0/496346066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c156a10 con 0x7f140c074760 2024-09-17T03:39:15.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f140a000640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f140c074760 0x7f140c14c060 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034040 tx=0x7f13f80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:15.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f1403400640 1 -- 172.21.15.121:0/496346066 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f803e030 con 0x7f140c074760 2024-09-17T03:39:15.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f1403400640 1 -- 172.21.15.121:0/496346066 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13f8003d90 con 0x7f140c074760 2024-09-17T03:39:15.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.521+0000 7f140be00640 1 -- 172.21.15.121:0/496346066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140c156cf0 con 0x7f140c074760 2024-09-17T03:39:15.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.522+0000 7f1403400640 1 -- 172.21.15.121:0/496346066 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8035040 con 0x7f140c074760 2024-09-17T03:39:15.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.522+0000 7f140be00640 1 -- 172.21.15.121:0/496346066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140c0cf4a0 con 0x7f140c074760 2024-09-17T03:39:15.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.523+0000 7f140be00640 1 -- 172.21.15.121:0/496346066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140c153820 con 0x7f140c074760 2024-09-17T03:39:15.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.524+0000 7f1403400640 1 -- 172.21.15.121:0/496346066 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f13f8041030 con 0x7f140c074760 2024-09-17T03:39:15.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.525+0000 7f1403400640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f13ec078bc0 0x7f13ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:15.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.525+0000 7f1403400640 1 -- 172.21.15.121:0/496346066 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6187+0+0 (secure 0 0 0) 0x7f13f80bb800 con 0x7f140c074760 2024-09-17T03:39:15.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.525+0000 7f140aa00640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f13ec078bc0 0x7f13ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:15.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.526+0000 7f140aa00640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f13ec078bc0 0x7f13ec07b0d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009b30 tx=0x7f13fc005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:15.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.530+0000 7f1403400640 1 -- 172.21.15.121:0/496346066 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f13f8083530 con 0x7f140c074760 2024-09-17T03:39:15.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:15.718+0000 7f140be00640 1 -- 172.21.15.121:0/496346066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f140c0b19d0 con 0x7f140c074760 2024-09-17T03:39:16.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.272+0000 7f1403400640 1 -- 172.21.15.121:0/496346066 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) ==== 181+0+0 (secure 0 0 0) 0x7f13f8087f60 con 0x7f140c074760 2024-09-17T03:39:16.272 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:39:16.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 -- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f13ec078bc0 msgr2=0x7f13ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:16.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f13ec078bc0 0x7f13ec07b0d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009b30 tx=0x7f13fc005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:16.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 -- 172.21.15.121:0/496346066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f140c074760 msgr2=0x7f140c14c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:16.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f140c074760 0x7f140c14c060 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034040 tx=0x7f13f80038a0 comp rx=0 tx=0).stop 2024-09-17T03:39:16.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 -- 172.21.15.121:0/496346066 shutdown_connections 2024-09-17T03:39:16.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f140c0ad150 0x7f140c15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:16.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f13ec078bc0 0x7f13ec07b0d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:16.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f140c074760 0x7f140c14c060 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:16.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 --2- 172.21.15.121:0/496346066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f140c06ece0 0x7f140c152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:16.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 -- 172.21.15.121:0/496346066 >> 172.21.15.121:0/496346066 conn(0x7f140c0d0500 msgr2=0x7f140c09dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:16.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 -- 172.21.15.121:0/496346066 shutdown_connections 2024-09-17T03:39:16.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.275+0000 7f140be00640 1 -- 172.21.15.121:0/496346066 wait complete. 2024-09-17T03:39:16.298 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:39:16.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.523+0000 7f220b800640 1 -- 172.21.15.121:0/2548830276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22040d0d00 msgr2=0x7f220406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:16.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.523+0000 7f220b800640 1 --2- 172.21.15.121:0/2548830276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22040d0d00 0x7f220406db60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f21fc005fd0 tx=0x7f21fc02aa90 comp rx=0 tx=0).stop 2024-09-17T03:39:16.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.523+0000 7f220b800640 1 -- 172.21.15.121:0/2548830276 shutdown_connections 2024-09-17T03:39:16.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.523+0000 7f220b800640 1 --2- 172.21.15.121:0/2548830276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22040d0d00 0x7f220406db60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:16.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.523+0000 7f220b800640 1 --2- 172.21.15.121:0/2548830276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f220415c830 0x7f22040ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:16.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.523+0000 7f220b800640 1 -- 172.21.15.121:0/2548830276 >> 172.21.15.121:0/2548830276 conn(0x7f22040b3620 msgr2=0x7f22040b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:16.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.523+0000 7f220b800640 1 -- 172.21.15.121:0/2548830276 shutdown_connections 2024-09-17T03:39:16.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.523+0000 7f220b800640 1 -- 172.21.15.121:0/2548830276 wait complete. 2024-09-17T03:39:16.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.525+0000 7f220b800640 1 Processor -- start 2024-09-17T03:39:16.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.525+0000 7f220b800640 1 -- start start 2024-09-17T03:39:16.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.527+0000 7f220b800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f220406d750 0x7f2204149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:16.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.527+0000 7f220b800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f220415c830 0x7f22041f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:16.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.527+0000 7f220b800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22041467d0 0x7f2204147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:16.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.527+0000 7f220b800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f220415d420 con 0x7f220406d750 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.527+0000 7f220b800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f220415d2a0 con 0x7f220415c830 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.527+0000 7f220b800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f220415d5a0 con 0x7f22041467d0 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.527+0000 7f2208e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f220406d750 0x7f2204149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.527+0000 7f2208e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f220406d750 0x7f2204149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39064/0 (socket says 172.21.15.121:39064) 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.527+0000 7f2208e00640 1 -- 172.21.15.121:0/3925063911 learned_addr learned my addr 172.21.15.121:0/3925063911 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.527+0000 7f21fbe00640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f220415c830 0x7f22041f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f2208e00640 1 -- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22041467d0 msgr2=0x7f2204147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f2208e00640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22041467d0 0x7f2204147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f2208e00640 1 -- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f220415c830 msgr2=0x7f22041f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f2208e00640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f220415c830 0x7f22041f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f2208e00640 1 -- 172.21.15.121:0/3925063911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22041f6690 con 0x7f220406d750 2024-09-17T03:39:16.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f2208e00640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f220406d750 0x7f2204149c20 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f21f400b440 tx=0x7f21f400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:16.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f2201600640 1 -- 172.21.15.121:0/3925063911 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4015020 con 0x7f220406d750 2024-09-17T03:39:16.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f2201600640 1 -- 172.21.15.121:0/3925063911 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21f4011980 con 0x7f220406d750 2024-09-17T03:39:16.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f220b800640 1 -- 172.21.15.121:0/3925063911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22041f6970 con 0x7f220406d750 2024-09-17T03:39:16.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f2201600640 1 -- 172.21.15.121:0/3925063911 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4011dd0 con 0x7f220406d750 2024-09-17T03:39:16.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.528+0000 7f220b800640 1 -- 172.21.15.121:0/3925063911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22041f6110 con 0x7f220406d750 2024-09-17T03:39:16.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.529+0000 7f220b800640 1 -- 172.21.15.121:0/3925063911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22040cced0 con 0x7f220406d750 2024-09-17T03:39:16.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.531+0000 7f2201600640 1 -- 172.21.15.121:0/3925063911 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21f4018020 con 0x7f220406d750 2024-09-17T03:39:16.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.531+0000 7f2201600640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f21e0078b90 0x7f21e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:16.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.532+0000 7f2201600640 1 -- 172.21.15.121:0/3925063911 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5749+0+0 (secure 0 0 0) 0x7f21f409ae60 con 0x7f220406d750 2024-09-17T03:39:16.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.532+0000 7f21fbe00640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f21e0078b90 0x7f21e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:16.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.534+0000 7f21fbe00640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f21e0078b90 0x7f21e007b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f22040c7200 tx=0x7f21ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:16.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.536+0000 7f2201600640 1 -- 172.21.15.121:0/3925063911 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22040cced0 con 0x7f220406d750 2024-09-17T03:39:16.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:16.722+0000 7f220b800640 1 -- 172.21.15.121:0/3925063911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f220406db60 con 0x7f220406d750 2024-09-17T03:39:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.275+0000 7f2201600640 1 -- 172.21.15.121:0/3925063911 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) ==== 169+0+0 (secure 0 0 0) 0x7f220406db60 con 0x7f220406d750 2024-09-17T03:39:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-17T03:39:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.279+0000 7f220b800640 1 -- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f21e0078b90 msgr2=0x7f21e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.279+0000 7f220b800640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f21e0078b90 0x7f21e007b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f22040c7200 tx=0x7f21ec009040 comp rx=0 tx=0).stop 2024-09-17T03:39:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.279+0000 7f220b800640 1 -- 172.21.15.121:0/3925063911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f220406d750 msgr2=0x7f2204149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.279+0000 7f220b800640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f220406d750 0x7f2204149c20 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f21f400b440 tx=0x7f21f400b900 comp rx=0 tx=0).stop 2024-09-17T03:39:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.279+0000 7f220b800640 1 -- 172.21.15.121:0/3925063911 shutdown_connections 2024-09-17T03:39:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.279+0000 7f220b800640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22041467d0 0x7f2204147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.279+0000 7f220b800640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f220415c830 0x7f22041f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.279+0000 7f220b800640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f21e0078b90 0x7f21e007b0a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.279+0000 7f220b800640 1 --2- 172.21.15.121:0/3925063911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f220406d750 0x7f2204149c20 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.279+0000 7f220b800640 1 -- 172.21.15.121:0/3925063911 >> 172.21.15.121:0/3925063911 conn(0x7f22040b3620 msgr2=0x7f220415a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.280+0000 7f220b800640 1 -- 172.21.15.121:0/3925063911 shutdown_connections 2024-09-17T03:39:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.280+0000 7f220b800640 1 -- 172.21.15.121:0/3925063911 wait complete. 2024-09-17T03:39:17.307 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:39:17.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.530+0000 7f6d67400640 1 -- 172.21.15.121:0/1327547917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d600d0cc0 msgr2=0x7f6d6015cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:17.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.530+0000 7f6d67400640 1 --2- 172.21.15.121:0/1327547917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d600d0cc0 0x7f6d6015cc10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6d58005fd0 tx=0x7f6d5802a980 comp rx=0 tx=0).stop 2024-09-17T03:39:17.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.530+0000 7f6d67400640 1 -- 172.21.15.121:0/1327547917 shutdown_connections 2024-09-17T03:39:17.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.530+0000 7f6d67400640 1 --2- 172.21.15.121:0/1327547917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d600d0cc0 0x7f6d6015cc10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.530+0000 7f6d67400640 1 --2- 172.21.15.121:0/1327547917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d6015a3e0 0x7f6d6006d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.530+0000 7f6d67400640 1 -- 172.21.15.121:0/1327547917 >> 172.21.15.121:0/1327547917 conn(0x7f6d600b3580 msgr2=0x7f6d600b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:17.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.530+0000 7f6d67400640 1 -- 172.21.15.121:0/1327547917 shutdown_connections 2024-09-17T03:39:17.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.530+0000 7f6d67400640 1 -- 172.21.15.121:0/1327547917 wait complete. 2024-09-17T03:39:17.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.532+0000 7f6d67400640 1 Processor -- start 2024-09-17T03:39:17.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.532+0000 7f6d67400640 1 -- start start 2024-09-17T03:39:17.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.534+0000 7f6d67400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d6006ddc0 0x7f6d6015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:17.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.534+0000 7f6d67400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d6015a3e0 0x7f6d60157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:17.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.534+0000 7f6d67400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60157fa0 0x7f6d6015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:17.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.534+0000 7f6d67400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6015d4e0 con 0x7f6d60157fa0 2024-09-17T03:39:17.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.534+0000 7f6d67400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6015d360 con 0x7f6d6015a3e0 2024-09-17T03:39:17.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.534+0000 7f6d67400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d6015d660 con 0x7f6d6006ddc0 2024-09-17T03:39:17.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.534+0000 7f6d65400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60157fa0 0x7f6d6015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:17.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.534+0000 7f6d5fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d6015a3e0 0x7f6d60157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:17.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.534+0000 7f6d65400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60157fa0 0x7f6d6015f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39074/0 (socket says 172.21.15.121:39074) 2024-09-17T03:39:17.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.534+0000 7f6d65400640 1 -- 172.21.15.121:0/2750628402 learned_addr learned my addr 172.21.15.121:0/2750628402 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d65400640 1 -- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d6006ddc0 msgr2=0x7f6d6015eaf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:39:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d65400640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d6006ddc0 0x7f6d6015eaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d65400640 1 -- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d6015a3e0 msgr2=0x7f6d60157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d65400640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d6015a3e0 0x7f6d60157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d65400640 1 -- 172.21.15.121:0/2750628402 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d601f4f20 con 0x7f6d60157fa0 2024-09-17T03:39:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d65400640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60157fa0 0x7f6d6015f4c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6d58033040 tx=0x7f6d58003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d5cc00640 1 -- 172.21.15.121:0/2750628402 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58034040 con 0x7f6d60157fa0 2024-09-17T03:39:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d5cc00640 1 -- 172.21.15.121:0/2750628402 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d58004540 con 0x7f6d60157fa0 2024-09-17T03:39:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d5cc00640 1 -- 172.21.15.121:0/2750628402 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58045480 con 0x7f6d60157fa0 2024-09-17T03:39:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d67400640 1 -- 172.21.15.121:0/2750628402 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d601f51e0 con 0x7f6d60157fa0 2024-09-17T03:39:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.535+0000 7f6d67400640 1 -- 172.21.15.121:0/2750628402 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d601f54c0 con 0x7f6d60157fa0 2024-09-17T03:39:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.536+0000 7f6d67400640 1 -- 172.21.15.121:0/2750628402 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d6015f030 con 0x7f6d60157fa0 2024-09-17T03:39:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.538+0000 7f6d5cc00640 1 -- 172.21.15.121:0/2750628402 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6d58037020 con 0x7f6d60157fa0 2024-09-17T03:39:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.539+0000 7f6d5cc00640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6d40078bc0 0x7f6d4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.539+0000 7f6d5cc00640 1 -- 172.21.15.121:0/2750628402 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7f6d580bc410 con 0x7f6d60157fa0 2024-09-17T03:39:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.540+0000 7f6d64a00640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6d40078bc0 0x7f6d4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.540+0000 7f6d64a00640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6d40078bc0 0x7f6d4007b0d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6d540099e0 tx=0x7f6d54005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:17.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.544+0000 7f6d5cc00640 1 -- 172.21.15.121:0/2750628402 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6d580849b0 con 0x7f6d60157fa0 2024-09-17T03:39:17.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.730+0000 7f6d67400640 1 -- 172.21.15.121:0/2750628402 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f6d60069430 con 0x7f6d60157fa0 2024-09-17T03:39:17.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.734+0000 7f6d5cc00640 1 -- 172.21.15.121:0/2750628402 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v41) ==== 71+0+0 (secure 0 0 0) 0x7f6d580842b0 con 0x7f6d60157fa0 2024-09-17T03:39:17.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 -- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6d40078bc0 msgr2=0x7f6d4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:17.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6d40078bc0 0x7f6d4007b0d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6d540099e0 tx=0x7f6d54005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:17.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 -- 172.21.15.121:0/2750628402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60157fa0 msgr2=0x7f6d6015f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:17.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60157fa0 0x7f6d6015f4c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6d58033040 tx=0x7f6d58003f10 comp rx=0 tx=0).stop 2024-09-17T03:39:17.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 -- 172.21.15.121:0/2750628402 shutdown_connections 2024-09-17T03:39:17.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6d40078bc0 0x7f6d4007b0d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60157fa0 0x7f6d6015f4c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d6015a3e0 0x7f6d60157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 --2- 172.21.15.121:0/2750628402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d6006ddc0 0x7f6d6015eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 -- 172.21.15.121:0/2750628402 >> 172.21.15.121:0/2750628402 conn(0x7f6d600b3580 msgr2=0x7f6d6015ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 -- 172.21.15.121:0/2750628402 shutdown_connections 2024-09-17T03:39:17.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.737+0000 7f6d67400640 1 -- 172.21.15.121:0/2750628402 wait complete. 2024-09-17T03:39:17.759 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject' 2024-09-17T03:39:17.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.980+0000 7efcc4c00640 1 -- 172.21.15.121:0/938041623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcc006d800 msgr2=0x7efcc00d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:17.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.980+0000 7efcc4c00640 1 --2- 172.21.15.121:0/938041623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcc006d800 0x7efcc00d05b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7efcac009830 tx=0x7efcac02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.980+0000 7efcc4c00640 1 -- 172.21.15.121:0/938041623 shutdown_connections 2024-09-17T03:39:17.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.980+0000 7efcc4c00640 1 --2- 172.21.15.121:0/938041623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcc006d800 0x7efcc00d05b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.980+0000 7efcc4c00640 1 -- 172.21.15.121:0/938041623 >> 172.21.15.121:0/938041623 conn(0x7efcc00b3580 msgr2=0x7efcc00b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:17.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.980+0000 7efcc4c00640 1 -- 172.21.15.121:0/938041623 shutdown_connections 2024-09-17T03:39:17.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.981+0000 7efcc4c00640 1 -- 172.21.15.121:0/938041623 wait complete. 2024-09-17T03:39:17.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.983+0000 7efcc4c00640 1 Processor -- start 2024-09-17T03:39:17.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.983+0000 7efcc4c00640 1 -- start start 2024-09-17T03:39:17.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.984+0000 7efcc4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc006d800 0x7efcc01f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:17.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.984+0000 7efcc4c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcc00d0af0 0x7efcc00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:17.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.984+0000 7efcc4c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcc015a3e0 0x7efcc0073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:17.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.984+0000 7efcc4c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efcc015d6b0 con 0x7efcc015a3e0 2024-09-17T03:39:17.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.984+0000 7efcc4c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efcc015d530 con 0x7efcc006d800 2024-09-17T03:39:17.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.984+0000 7efcc4c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efcc015d830 con 0x7efcc00d0af0 2024-09-17T03:39:17.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbe800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcc015a3e0 0x7efcc0073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:17.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbe800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcc015a3e0 0x7efcc0073d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39094/0 (socket says 172.21.15.121:39094) 2024-09-17T03:39:17.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbe800640 1 -- 172.21.15.121:0/2723130060 learned_addr learned my addr 172.21.15.121:0/2723130060 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:17.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbde00640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc006d800 0x7efcc01f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:17.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbd400640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcc00d0af0 0x7efcc00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:17.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbe800640 1 -- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcc00d0af0 msgr2=0x7efcc00737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:17.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbe800640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcc00d0af0 0x7efcc00737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbe800640 1 -- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc006d800 msgr2=0x7efcc01f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:17.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbe800640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc006d800 0x7efcc01f5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:17.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbe800640 1 -- 172.21.15.121:0/2723130060 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc00ca2c0 con 0x7efcc015a3e0 2024-09-17T03:39:17.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcbe800640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcc015a3e0 0x7efcc0073d20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c3f0 tx=0x7efcb800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:17.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.985+0000 7efcb6000640 1 -- 172.21.15.121:0/2723130060 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8018070 con 0x7efcc015a3e0 2024-09-17T03:39:17.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.986+0000 7efcb6000640 1 -- 172.21.15.121:0/2723130060 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcb8006d90 con 0x7efcc015a3e0 2024-09-17T03:39:17.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.986+0000 7efcc4c00640 1 -- 172.21.15.121:0/2723130060 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc015e420 con 0x7efcc015a3e0 2024-09-17T03:39:17.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.986+0000 7efcb6000640 1 -- 172.21.15.121:0/2723130060 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8007290 con 0x7efcc015a3e0 2024-09-17T03:39:17.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.986+0000 7efcc4c00640 1 -- 172.21.15.121:0/2723130060 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc00cf120 con 0x7efcc015a3e0 2024-09-17T03:39:17.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.987+0000 7efcc4c00640 1 -- 172.21.15.121:0/2723130060 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc00d05b0 con 0x7efcc015a3e0 2024-09-17T03:39:17.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.988+0000 7efcb6000640 1 -- 172.21.15.121:0/2723130060 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efcb801b070 con 0x7efcc015a3e0 2024-09-17T03:39:17.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.989+0000 7efcb6000640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efca0078bc0 0x7efca007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:17.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.989+0000 7efcb6000640 1 -- 172.21.15.121:0/2723130060 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7efcb809a260 con 0x7efcc015a3e0 2024-09-17T03:39:17.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.991+0000 7efcbde00640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efca0078bc0 0x7efca007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:17.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.993+0000 7efcb6000640 1 -- 172.21.15.121:0/2723130060 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efcc00d0f00 con 0x7efcc015a3e0 2024-09-17T03:39:17.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:17.994+0000 7efcbde00640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efca0078bc0 0x7efca007b0d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efcb0000f80 tx=0x7efcb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.256+0000 7efcc4c00640 1 -- 172.21.15.121:0/2723130060 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]} v 0) -- 0x7efcc00c36c0 con 0x7efcc015a3e0 2024-09-17T03:39:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.281+0000 7efcb6000640 1 -- 172.21.15.121:0/2723130060 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_session_reject"]}]=0 v222) ==== 142+0+0 (secure 0 0 0) 0x7efcb8062910 con 0x7efcc015a3e0 2024-09-17T03:39:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 -- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efca0078bc0 msgr2=0x7efca007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efca0078bc0 0x7efca007b0d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efcb0000f80 tx=0x7efcb0009040 comp rx=0 tx=0).stop 2024-09-17T03:39:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 -- 172.21.15.121:0/2723130060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcc015a3e0 msgr2=0x7efcc0073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcc015a3e0 0x7efcc0073d20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c3f0 tx=0x7efcb800c8b0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 -- 172.21.15.121:0/2723130060 shutdown_connections 2024-09-17T03:39:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efca0078bc0 0x7efca007b0d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcc015a3e0 0x7efcc0073d20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcc00d0af0 0x7efcc00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 --2- 172.21.15.121:0/2723130060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc006d800 0x7efcc01f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 -- 172.21.15.121:0/2723130060 >> 172.21.15.121:0/2723130060 conn(0x7efcc00b3580 msgr2=0x7efcc0156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 -- 172.21.15.121:0/2723130060 shutdown_connections 2024-09-17T03:39:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.284+0000 7efcc4c00640 1 -- 172.21.15.121:0/2723130060 wait complete. 2024-09-17T03:39:18.308 INFO:tasks.cephfs_test_runner:test_session_reject (tasks.cephfs.test_sessionmap.TestSessionMap) ... skipped 'Requires FUSE client to inject client metadata' 2024-09-17T03:39:18.308 INFO:tasks.cephfs_test_runner:Starting test: test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2024-09-17T03:39:18.308 INFO:tasks.cephfs_test_runner:test_tell_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-17T03:39:18.309 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.538+0000 7fdfa1400640 1 -- 172.21.15.121:0/1792239754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf80004850 msgr2=0x7fdf80004d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.538+0000 7fdfa1400640 1 --2- 172.21.15.121:0/1792239754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf80004850 0x7fdf80004d20 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c070280 tx=0x7fdf80005830 comp rx=0 tx=0).stop 2024-09-17T03:39:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.538+0000 7fdf9b200640 1 -- 172.21.15.121:0/1792239754 reap_dead start 2024-09-17T03:39:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.538+0000 7fdfa1400640 1 -- 172.21.15.121:0/1792239754 shutdown_connections 2024-09-17T03:39:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.538+0000 7fdfa1400640 1 -- 172.21.15.121:0/1792239754 >> 172.21.15.121:0/1792239754 conn(0x7fdf9c0b3580 msgr2=0x7fdf9c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.538+0000 7fdfa1400640 1 -- 172.21.15.121:0/1792239754 shutdown_connections 2024-09-17T03:39:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.538+0000 7fdfa1400640 1 -- 172.21.15.121:0/1792239754 wait complete. 2024-09-17T03:39:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.540+0000 7fdfa1400640 1 Processor -- start 2024-09-17T03:39:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.540+0000 7fdfa1400640 1 -- start start 2024-09-17T03:39:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdfa1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf80004850 0x7fdf9c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdfa1400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf9c1f7d40 0x7fdf9c09d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdfa1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf9c09da90 0x7fdf9c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdfa1400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9c06db90 con 0x7fdf9c09da90 2024-09-17T03:39:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdfa1400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9c06da10 con 0x7fdf80004850 2024-09-17T03:39:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdfa1400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdf9c15d320 con 0x7fdf9c1f7d40 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdf9b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf9c09da90 0x7fdf9c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdf9b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf9c09da90 0x7fdf9c158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39110/0 (socket says 172.21.15.121:39110) 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdf9a800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf80004850 0x7fdf9c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdf9b200640 1 -- 172.21.15.121:0/973478574 learned_addr learned my addr 172.21.15.121:0/973478574 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.542+0000 7fdf99e00640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf9c1f7d40 0x7fdf9c09d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdf9b200640 1 -- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf9c1f7d40 msgr2=0x7fdf9c09d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdf9b200640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf9c1f7d40 0x7fdf9c09d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdf9b200640 1 -- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf80004850 msgr2=0x7fdf9c1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdf9b200640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf80004850 0x7fdf9c1596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdf9b200640 1 -- 172.21.15.121:0/973478574 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9c0cc900 con 0x7fdf9c09da90 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdf9b200640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf9c09da90 0x7fdf9c158320 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c070df0 tx=0x7fdf94001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdf92a00640 1 -- 172.21.15.121:0/973478574 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94003b80 con 0x7fdf9c09da90 2024-09-17T03:39:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdf92a00640 1 -- 172.21.15.121:0/973478574 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf94003e10 con 0x7fdf9c09da90 2024-09-17T03:39:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdfa1400640 1 -- 172.21.15.121:0/973478574 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9c0ccbe0 con 0x7fdf9c09da90 2024-09-17T03:39:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdf92a00640 1 -- 172.21.15.121:0/973478574 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94004290 con 0x7fdf9c09da90 2024-09-17T03:39:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.543+0000 7fdfa1400640 1 -- 172.21.15.121:0/973478574 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf9c09dea0 con 0x7fdf9c09da90 2024-09-17T03:39:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.545+0000 7fdfa1400640 1 -- 172.21.15.121:0/973478574 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf9c0cce00 con 0x7fdf9c09da90 2024-09-17T03:39:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.546+0000 7fdf92a00640 1 -- 172.21.15.121:0/973478574 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf94019020 con 0x7fdf9c09da90 2024-09-17T03:39:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.546+0000 7fdf92a00640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf7c078bc0 0x7fdf7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.547+0000 7fdf92a00640 1 -- 172.21.15.121:0/973478574 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7fdf9409ac00 con 0x7fdf9c09da90 2024-09-17T03:39:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.547+0000 7fdf9a800640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf7c078bc0 0x7fdf7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.548+0000 7fdf9a800640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf7c078bc0 0x7fdf7c07b0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c005eb0 tx=0x7fdf8c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:18.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.551+0000 7fdf92a00640 1 -- 172.21.15.121:0/973478574 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf940a1080 con 0x7fdf9c09da90 2024-09-17T03:39:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.736+0000 7fdfa1400640 1 -- 172.21.15.121:0/973478574 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf9c15d880 con 0x7fdf9c09da90 2024-09-17T03:39:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.737+0000 7fdf92a00640 1 -- 172.21.15.121:0/973478574 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+13366 (secure 0 0 0) 0x7fdf94062b60 con 0x7fdf9c09da90 2024-09-17T03:39:18.737 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:18.737 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":79,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:17.273230+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6834/762401029":"2024-09-18T03:39:14.260799+0000","172.21.15.121:6832/762401029":"2024-09-18T03:39:14.260799+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:18.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.739+0000 7fdfa1400640 1 -- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf7c078bc0 msgr2=0x7fdf7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:18.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.739+0000 7fdfa1400640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf7c078bc0 0x7fdf7c07b0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c005eb0 tx=0x7fdf8c005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.739+0000 7fdfa1400640 1 -- 172.21.15.121:0/973478574 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf9c09da90 msgr2=0x7fdf9c158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.739+0000 7fdfa1400640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf9c09da90 0x7fdf9c158320 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c070df0 tx=0x7fdf94001b80 comp rx=0 tx=0).stop 2024-09-17T03:39:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.739+0000 7fdfa1400640 1 -- 172.21.15.121:0/973478574 shutdown_connections 2024-09-17T03:39:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.739+0000 7fdfa1400640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf7c078bc0 0x7fdf7c07b0d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.739+0000 7fdfa1400640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf9c09da90 0x7fdf9c158320 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.740+0000 7fdfa1400640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf9c1f7d40 0x7fdf9c09d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.740+0000 7fdfa1400640 1 --2- 172.21.15.121:0/973478574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf80004850 0x7fdf9c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.740+0000 7fdfa1400640 1 -- 172.21.15.121:0/973478574 >> 172.21.15.121:0/973478574 conn(0x7fdf9c0b3580 msgr2=0x7fdf9c15e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.740+0000 7fdfa1400640 1 -- 172.21.15.121:0/973478574 shutdown_connections 2024-09-17T03:39:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.740+0000 7fdfa1400640 1 -- 172.21.15.121:0/973478574 wait complete. 2024-09-17T03:39:18.761 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:35:21.303701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:39:18.761 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:39:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.984+0000 7f5344000640 1 -- 172.21.15.121:0/4267741799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f533c06da30 msgr2=0x7f533c0d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.984+0000 7f5344000640 1 --2- 172.21.15.121:0/4267741799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f533c06da30 0x7f533c0d0b70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5334005fd0 tx=0x7f533402a820 comp rx=0 tx=0).stop 2024-09-17T03:39:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.984+0000 7f5344000640 1 -- 172.21.15.121:0/4267741799 shutdown_connections 2024-09-17T03:39:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.984+0000 7f5344000640 1 --2- 172.21.15.121:0/4267741799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f533c06da30 0x7f533c0d0b70 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.984+0000 7f5344000640 1 --2- 172.21.15.121:0/4267741799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533c06d620 0x7f533c0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.984+0000 7f5344000640 1 -- 172.21.15.121:0/4267741799 >> 172.21.15.121:0/4267741799 conn(0x7f533c0b3580 msgr2=0x7f533c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.984+0000 7f5344000640 1 -- 172.21.15.121:0/4267741799 shutdown_connections 2024-09-17T03:39:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.984+0000 7f5344000640 1 -- 172.21.15.121:0/4267741799 wait complete. 2024-09-17T03:39:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.986+0000 7f5344000640 1 Processor -- start 2024-09-17T03:39:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.987+0000 7f5344000640 1 -- start start 2024-09-17T03:39:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5344000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533c06d620 0x7f533c150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5344000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533c06da30 0x7f533c14d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5344000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f533c0cca80 0x7f533c15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5344000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f533c0cb970 con 0x7f533c0cca80 2024-09-17T03:39:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5344000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f533c0cb7f0 con 0x7f533c06da30 2024-09-17T03:39:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5344000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f533c0cbaf0 con 0x7f533c06d620 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5342000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f533c0cca80 0x7f533c15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5342000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f533c0cca80 0x7f533c15d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39122/0 (socket says 172.21.15.121:39122) 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5342000640 1 -- 172.21.15.121:0/3794490198 learned_addr learned my addr 172.21.15.121:0/3794490198 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5340c00640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533c06da30 0x7f533c14d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.988+0000 7f5341600640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533c06d620 0x7f533c150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5342000640 1 -- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533c06d620 msgr2=0x7f533c150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5342000640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533c06d620 0x7f533c150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5342000640 1 -- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533c06da30 msgr2=0x7f533c14d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5342000640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533c06da30 0x7f533c14d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5342000640 1 -- 172.21.15.121:0/3794490198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c1ea250 con 0x7f533c0cca80 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5340c00640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533c06da30 0x7f533c14d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5342000640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f533c0cca80 0x7f533c15d300 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5334009cd0 tx=0x7f5334032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:18.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5339600640 1 -- 172.21.15.121:0/3794490198 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334037040 con 0x7f533c0cca80 2024-09-17T03:39:18.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5339600640 1 -- 172.21.15.121:0/3794490198 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5334042070 con 0x7f533c0cca80 2024-09-17T03:39:18.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5344000640 1 -- 172.21.15.121:0/3794490198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c150ad0 con 0x7f533c0cca80 2024-09-17T03:39:18.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.989+0000 7f5339600640 1 -- 172.21.15.121:0/3794490198 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334003e60 con 0x7f533c0cca80 2024-09-17T03:39:18.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.990+0000 7f5344000640 1 -- 172.21.15.121:0/3794490198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c1f8da0 con 0x7f533c0cca80 2024-09-17T03:39:18.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.990+0000 7f5344000640 1 -- 172.21.15.121:0/3794490198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533c0cbfa0 con 0x7f533c0cca80 2024-09-17T03:39:18.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.992+0000 7f5339600640 1 -- 172.21.15.121:0/3794490198 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5334004280 con 0x7f533c0cca80 2024-09-17T03:39:18.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.993+0000 7f5339600640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f531c078b90 0x7f531c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:18.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.993+0000 7f5339600640 1 -- 172.21.15.121:0/3794490198 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7f53340bb990 con 0x7f533c0cca80 2024-09-17T03:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.993+0000 7f5341600640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f531c078b90 0x7f531c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:18.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.994+0000 7f5341600640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f531c078b90 0x7f531c07b0a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5330001610 tx=0x7f5330009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:18.997+0000 7f5339600640 1 -- 172.21.15.121:0/3794490198 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5334083ea0 con 0x7f533c0cca80 2024-09-17T03:39:19.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.178+0000 7f5344000640 1 -- 172.21.15.121:0/3794490198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f533c072ff0 con 0x7f533c0cca80 2024-09-17T03:39:19.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.178+0000 7f5339600640 1 -- 172.21.15.121:0/3794490198 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7f53340837a0 con 0x7f533c0cca80 2024-09-17T03:39:19.178 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-17T03:39:19.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 -- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f531c078b90 msgr2=0x7f531c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:19.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f531c078b90 0x7f531c07b0a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5330001610 tx=0x7f5330009040 comp rx=0 tx=0).stop 2024-09-17T03:39:19.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 -- 172.21.15.121:0/3794490198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f533c0cca80 msgr2=0x7f533c15d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:19.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f533c0cca80 0x7f533c15d300 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5334009cd0 tx=0x7f5334032c60 comp rx=0 tx=0).stop 2024-09-17T03:39:19.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 -- 172.21.15.121:0/3794490198 shutdown_connections 2024-09-17T03:39:19.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f531c078b90 0x7f531c07b0a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:19.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f533c0cca80 0x7f533c15d300 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:19.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f533c06da30 0x7f533c14d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:19.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 --2- 172.21.15.121:0/3794490198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f533c06d620 0x7f533c150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:19.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 -- 172.21.15.121:0/3794490198 >> 172.21.15.121:0/3794490198 conn(0x7f533c0b3580 msgr2=0x7f533c074510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:19.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 -- 172.21.15.121:0/3794490198 shutdown_connections 2024-09-17T03:39:19.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.181+0000 7f5344000640 1 -- 172.21.15.121:0/3794490198 wait complete. 2024-09-17T03:39:19.202 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2024-09-17T03:39:19.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.426+0000 7f294a400640 1 -- 172.21.15.121:0/2866672095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f294406d620 msgr2=0x7f29440d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:19.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.426+0000 7f294a400640 1 --2- 172.21.15.121:0/2866672095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f294406d620 0x7f29440d0630 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f292c005fd0 tx=0x7f292c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:39:19.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.426+0000 7f294a400640 1 -- 172.21.15.121:0/2866672095 shutdown_connections 2024-09-17T03:39:19.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.426+0000 7f294a400640 1 --2- 172.21.15.121:0/2866672095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f294406da30 0x7f29440d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:19.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.426+0000 7f294a400640 1 --2- 172.21.15.121:0/2866672095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f294406d620 0x7f29440d0630 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:19.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.426+0000 7f294a400640 1 -- 172.21.15.121:0/2866672095 >> 172.21.15.121:0/2866672095 conn(0x7f29440b3580 msgr2=0x7f29440b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:19.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.426+0000 7f294a400640 1 -- 172.21.15.121:0/2866672095 shutdown_connections 2024-09-17T03:39:19.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.426+0000 7f294a400640 1 -- 172.21.15.121:0/2866672095 wait complete. 2024-09-17T03:39:19.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.428+0000 7f294a400640 1 Processor -- start 2024-09-17T03:39:19.428 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.428+0000 7f294a400640 1 -- start start 2024-09-17T03:39:19.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f294a400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f294406d620 0x7f294415c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:19.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f294a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f294406da30 0x7f29440b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:19.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f294a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29440cca80 0x7f29440b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:19.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f294a400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f29440cb970 con 0x7f294406d620 2024-09-17T03:39:19.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f294a400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f29440cb7f0 con 0x7f294406da30 2024-09-17T03:39:19.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f294a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f29440cbaf0 con 0x7f29440cca80 2024-09-17T03:39:19.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f2943400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f294406d620 0x7f294415c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:19.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f2943400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f294406d620 0x7f294415c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39140/0 (socket says 172.21.15.121:39140) 2024-09-17T03:39:19.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f2943400640 1 -- 172.21.15.121:0/3036397319 learned_addr learned my addr 172.21.15.121:0/3036397319 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:19.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f2943400640 1 -- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29440cca80 msgr2=0x7f29440b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:19.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f2943400640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29440cca80 0x7f29440b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:19.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f2943400640 1 -- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f294406da30 msgr2=0x7f29440b1e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:39:19.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f2943400640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f294406da30 0x7f29440b1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:19.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.430+0000 7f2943400640 1 -- 172.21.15.121:0/3036397319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29441f5f70 con 0x7f294406d620 2024-09-17T03:39:19.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.431+0000 7f2943400640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f294406d620 0x7f294415c050 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f293400b420 tx=0x7f293400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:19.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.431+0000 7f293be00640 1 -- 172.21.15.121:0/3036397319 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934011830 con 0x7f294406d620 2024-09-17T03:39:19.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.431+0000 7f293be00640 1 -- 172.21.15.121:0/3036397319 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2934016070 con 0x7f294406d620 2024-09-17T03:39:19.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.431+0000 7f294a400640 1 -- 172.21.15.121:0/3036397319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29441f6470 con 0x7f294406d620 2024-09-17T03:39:19.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.431+0000 7f293be00640 1 -- 172.21.15.121:0/3036397319 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934011d60 con 0x7f294406d620 2024-09-17T03:39:19.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.431+0000 7f294a400640 1 -- 172.21.15.121:0/3036397319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29441f6a30 con 0x7f294406d620 2024-09-17T03:39:19.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.432+0000 7f294a400640 1 -- 172.21.15.121:0/3036397319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29440cbfb0 con 0x7f294406d620 2024-09-17T03:39:19.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.433+0000 7f293be00640 1 -- 172.21.15.121:0/3036397319 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f293401b460 con 0x7f294406d620 2024-09-17T03:39:19.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.434+0000 7f293be00640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2920078b90 0x7f292007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:19.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.434+0000 7f293be00640 1 -- 172.21.15.121:0/3036397319 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7f293409a760 con 0x7f294406d620 2024-09-17T03:39:19.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.435+0000 7f293aa00640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2920078b90 0x7f292007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:19.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.436+0000 7f293aa00640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2920078b90 0x7f292007b0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f292c033000 tx=0x7f292c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:19.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.439+0000 7f293be00640 1 -- 172.21.15.121:0/3036397319 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2934020020 con 0x7f294406d620 2024-09-17T03:39:19.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:19.690+0000 7f294a400640 1 -- 172.21.15.121:0/3036397319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) -- 0x7f294415d680 con 0x7f294406d620 2024-09-17T03:39:20.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.291+0000 7f293be00640 1 -- 172.21.15.121:0/3036397319 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v224) ==== 146+0+0 (secure 0 0 0) 0x7f2934062d00 con 0x7f294406d620 2024-09-17T03:39:20.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.293+0000 7f294a400640 1 -- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2920078b90 msgr2=0x7f292007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.293+0000 7f294a400640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2920078b90 0x7f292007b0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f292c033000 tx=0x7f292c004730 comp rx=0 tx=0).stop 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.293+0000 7f294a400640 1 -- 172.21.15.121:0/3036397319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f294406d620 msgr2=0x7f294415c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.293+0000 7f294a400640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f294406d620 0x7f294415c050 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f293400b420 tx=0x7f293400b8e0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.294+0000 7f294a400640 1 -- 172.21.15.121:0/3036397319 shutdown_connections 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.294+0000 7f294a400640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29440cca80 0x7f29440b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.294+0000 7f294a400640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f294406da30 0x7f29440b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.294+0000 7f294a400640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2920078b90 0x7f292007b0a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.294+0000 7f294a400640 1 --2- 172.21.15.121:0/3036397319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f294406d620 0x7f294415c050 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.294+0000 7f294a400640 1 -- 172.21.15.121:0/3036397319 >> 172.21.15.121:0/3036397319 conn(0x7f29440b3580 msgr2=0x7f29440702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.294+0000 7f294a400640 1 -- 172.21.15.121:0/3036397319 shutdown_connections 2024-09-17T03:39:20.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.294+0000 7f294a400640 1 -- 172.21.15.121:0/3036397319 wait complete. 2024-09-17T03:39:20.315 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:39:20.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.535+0000 7f1878400640 1 -- 172.21.15.121:0/2386400590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1870164620 msgr2=0x7f1870166a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:20.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.535+0000 7f1878400640 1 --2- 172.21.15.121:0/2386400590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1870164620 0x7f1870166a40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1868009860 tx=0x7f186802a540 comp rx=0 tx=0).stop 2024-09-17T03:39:20.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.536+0000 7f1878400640 1 -- 172.21.15.121:0/2386400590 shutdown_connections 2024-09-17T03:39:20.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.536+0000 7f1878400640 1 --2- 172.21.15.121:0/2386400590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1870164620 0x7f1870166a40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.536+0000 7f1878400640 1 -- 172.21.15.121:0/2386400590 >> 172.21.15.121:0/2386400590 conn(0x7f18700cd5c0 msgr2=0x7f18700cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:20.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.536+0000 7f1878400640 1 -- 172.21.15.121:0/2386400590 shutdown_connections 2024-09-17T03:39:20.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.536+0000 7f1878400640 1 -- 172.21.15.121:0/2386400590 wait complete. 2024-09-17T03:39:20.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.538+0000 7f1878400640 1 Processor -- start 2024-09-17T03:39:20.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.538+0000 7f1878400640 1 -- start start 2024-09-17T03:39:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.539+0000 7f1878400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1870070440 0x7f1870166290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.539+0000 7f1878400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18700cea40 0x7f1870144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.539+0000 7f1878400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1870164620 0x7f1870159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.539+0000 7f1878400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f18700cf6e0 con 0x7f1870070440 2024-09-17T03:39:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.539+0000 7f1878400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f18700cf560 con 0x7f1870164620 2024-09-17T03:39:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.539+0000 7f1878400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1870166f80 con 0x7f18700cea40 2024-09-17T03:39:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.539+0000 7f1875a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1870070440 0x7f1870166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.540+0000 7f1875a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1870070440 0x7f1870166290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39158/0 (socket says 172.21.15.121:39158) 2024-09-17T03:39:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.540+0000 7f1875a00640 1 -- 172.21.15.121:0/294879936 learned_addr learned my addr 172.21.15.121:0/294879936 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.540+0000 7f1875a00640 1 -- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18700cea40 msgr2=0x7f1870144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.540+0000 7f1875a00640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18700cea40 0x7f1870144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.540+0000 7f1875a00640 1 -- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1870164620 msgr2=0x7f1870159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.540+0000 7f1875a00640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1870164620 0x7f1870159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.540+0000 7f1875a00640 1 -- 172.21.15.121:0/294879936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187014d2a0 con 0x7f1870070440 2024-09-17T03:39:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.540+0000 7f1875a00640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1870070440 0x7f1870166290 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f186400cb40 tx=0x7f186400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:20.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.540+0000 7f186d600640 1 -- 172.21.15.121:0/294879936 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864016020 con 0x7f1870070440 2024-09-17T03:39:20.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.541+0000 7f186d600640 1 -- 172.21.15.121:0/294879936 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f186400ad90 con 0x7f1870070440 2024-09-17T03:39:20.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.541+0000 7f186d600640 1 -- 172.21.15.121:0/294879936 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864012680 con 0x7f1870070440 2024-09-17T03:39:20.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.541+0000 7f1878400640 1 -- 172.21.15.121:0/294879936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f187014d580 con 0x7f1870070440 2024-09-17T03:39:20.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.541+0000 7f1878400640 1 -- 172.21.15.121:0/294879936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f187014db40 con 0x7f1870070440 2024-09-17T03:39:20.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.542+0000 7f1878400640 1 -- 172.21.15.121:0/294879936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1870155dd0 con 0x7f1870070440 2024-09-17T03:39:20.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.543+0000 7f186d600640 1 -- 172.21.15.121:0/294879936 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1864019020 con 0x7f1870070440 2024-09-17T03:39:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.544+0000 7f186d600640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1850078bc0 0x7f185007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.544+0000 7f186d600640 1 -- 172.21.15.121:0/294879936 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7f186409b290 con 0x7f1870070440 2024-09-17T03:39:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.544+0000 7f1875000640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1850078bc0 0x7f185007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:20.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.545+0000 7f1875000640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1850078bc0 0x7f185007b0d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f185c006fd0 tx=0x7f185c006bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:20.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.549+0000 7f186d600640 1 -- 172.21.15.121:0/294879936 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1864020020 con 0x7f1870070440 2024-09-17T03:39:20.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.731+0000 7f1878400640 1 -- 172.21.15.121:0/294879936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f1870153810 con 0x7f1870070440 2024-09-17T03:39:20.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.732+0000 7f186d600640 1 -- 172.21.15.121:0/294879936 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v41) ==== 59+0+2294 (secure 0 0 0) 0x7f18640637a0 con 0x7f1870070440 2024-09-17T03:39:20.732 INFO:teuthology.orchestra.run.smithi121.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:39:20.732 INFO:teuthology.orchestra.run.smithi121.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:39:20.732 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:39:20.732 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_client 20/20 2024-09-17T03:39:20.732 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3249.879374 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3414.976419 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3347.142673 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3524.210167 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 7230.495988 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4229.547603 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4520.738354 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4185.245448 2024-09-17T03:39:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds 20/20 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_ms 2/2 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_frag true 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_verify_scatter true 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced client_mount_timeout 600 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_client 20/20 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_ms 1/1 2024-09-17T03:39:20.734 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:39:20.735 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:39:20.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 -- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1850078bc0 msgr2=0x7f185007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:20.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1850078bc0 0x7f185007b0d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f185c006fd0 tx=0x7f185c006bc0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 -- 172.21.15.121:0/294879936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1870070440 msgr2=0x7f1870166290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:20.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1870070440 0x7f1870166290 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f186400cb40 tx=0x7f186400a060 comp rx=0 tx=0).stop 2024-09-17T03:39:20.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 -- 172.21.15.121:0/294879936 shutdown_connections 2024-09-17T03:39:20.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1870164620 0x7f1870159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18700cea40 0x7f1870144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1850078bc0 0x7f185007b0d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 --2- 172.21.15.121:0/294879936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1870070440 0x7f1870166290 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 -- 172.21.15.121:0/294879936 >> 172.21.15.121:0/294879936 conn(0x7f18700cd5c0 msgr2=0x7f18700cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:20.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 -- 172.21.15.121:0/294879936 shutdown_connections 2024-09-17T03:39:20.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.734+0000 7f1878400640 1 -- 172.21.15.121:0/294879936 wait complete. 2024-09-17T03:39:20.757 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:39:20.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.981+0000 7f512fe00640 1 -- 172.21.15.121:0/337777699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f512806d620 msgr2=0x7f51280d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.981+0000 7f512fe00640 1 --2- 172.21.15.121:0/337777699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f512806d620 0x7f51280d0630 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f51280cdc20 tx=0x7f511402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.981+0000 7f512fe00640 1 -- 172.21.15.121:0/337777699 shutdown_connections 2024-09-17T03:39:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.981+0000 7f512fe00640 1 --2- 172.21.15.121:0/337777699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f512806d620 0x7f51280d0630 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.981+0000 7f512fe00640 1 --2- 172.21.15.121:0/337777699 >> v2:172.21.15.176:3300/0 conn(0x7f51280cca80 0x7f51280707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.982+0000 7f512fe00640 1 -- 172.21.15.121:0/337777699 >> 172.21.15.121:0/337777699 conn(0x7f51280b3580 msgr2=0x7f51280b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.982+0000 7f512fe00640 1 -- 172.21.15.121:0/337777699 shutdown_connections 2024-09-17T03:39:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.982+0000 7f512fe00640 1 -- 172.21.15.121:0/337777699 wait complete. 2024-09-17T03:39:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.984+0000 7f512fe00640 1 Processor -- start 2024-09-17T03:39:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.984+0000 7f512fe00640 1 -- start start 2024-09-17T03:39:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.985+0000 7f512fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f512806d620 0x7f51280c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.985+0000 7f512fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512806da30 0x7f51280afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.985+0000 7f512fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51280cca80 0x7f5128153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.985+0000 7f512fe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f51280d0cf0 con 0x7f512806d620 2024-09-17T03:39:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.985+0000 7f512fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f51280d0b70 con 0x7f51280cca80 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.985+0000 7f512fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f51280d0e70 con 0x7f512806da30 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f512806d620 0x7f51280c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512d400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f512806d620 0x7f51280c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39176/0 (socket says 172.21.15.121:39176) 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512d400640 1 -- 172.21.15.121:0/3231356111 learned_addr learned my addr 172.21.15.121:0/3231356111 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512ca00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512806da30 0x7f51280afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512de00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51280cca80 0x7f5128153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512d400640 1 -- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512806da30 msgr2=0x7f51280afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512d400640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512806da30 0x7f51280afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512d400640 1 -- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51280cca80 msgr2=0x7f5128153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512d400640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51280cca80 0x7f5128153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512d400640 1 -- 172.21.15.121:0/3231356111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512809a3d0 con 0x7f512806d620 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512ca00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512806da30 0x7f51280afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512de00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51280cca80 0x7f5128153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512d400640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f512806d620 0x7f51280c6610 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f511c00c970 tx=0x7f511c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f5125600640 1 -- 172.21.15.121:0/3231356111 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c007bb0 con 0x7f512806d620 2024-09-17T03:39:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f5125600640 1 -- 172.21.15.121:0/3231356111 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f511c007e40 con 0x7f512806d620 2024-09-17T03:39:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.986+0000 7f512fe00640 1 -- 172.21.15.121:0/3231356111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512809a6b0 con 0x7f512806d620 2024-09-17T03:39:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.987+0000 7f5125600640 1 -- 172.21.15.121:0/3231356111 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c00f690 con 0x7f512806d620 2024-09-17T03:39:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.987+0000 7f512fe00640 1 -- 172.21.15.121:0/3231356111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512809cdb0 con 0x7f512806d620 2024-09-17T03:39:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.988+0000 7f512fe00640 1 -- 172.21.15.121:0/3231356111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5128074bc0 con 0x7f512806d620 2024-09-17T03:39:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.989+0000 7f5125600640 1 -- 172.21.15.121:0/3231356111 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f511c00f830 con 0x7f512806d620 2024-09-17T03:39:20.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.990+0000 7f5125600640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5108078b90 0x7f510807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:20.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.990+0000 7f5125600640 1 -- 172.21.15.121:0/3231356111 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7f511c09b4c0 con 0x7f512806d620 2024-09-17T03:39:20.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.990+0000 7f512ca00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5108078b90 0x7f510807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:20.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.991+0000 7f512ca00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5108078b90 0x7f510807b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5114033000 tx=0x7f5114004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:20.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:20.994+0000 7f5125600640 1 -- 172.21.15.121:0/3231356111 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f511c014030 con 0x7f512806d620 2024-09-17T03:39:21.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.178+0000 7f512fe00640 1 -- 172.21.15.121:0/3231356111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f51280748e0 con 0x7f512806d620 2024-09-17T03:39:21.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.183+0000 7f5125600640 1 -- 172.21.15.121:0/3231356111 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f511c063a60 con 0x7f512806d620 2024-09-17T03:39:21.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 -- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5108078b90 msgr2=0x7f510807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:21.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5108078b90 0x7f510807b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5114033000 tx=0x7f5114004730 comp rx=0 tx=0).stop 2024-09-17T03:39:21.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 -- 172.21.15.121:0/3231356111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f512806d620 msgr2=0x7f51280c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:21.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f512806d620 0x7f51280c6610 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f511c00c970 tx=0x7f511c00ce30 comp rx=0 tx=0).stop 2024-09-17T03:39:21.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 -- 172.21.15.121:0/3231356111 shutdown_connections 2024-09-17T03:39:21.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51280cca80 0x7f5128153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:21.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512806da30 0x7f51280afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:21.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5108078b90 0x7f510807b0a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:21.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 --2- 172.21.15.121:0/3231356111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f512806d620 0x7f51280c6610 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:21.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 -- 172.21.15.121:0/3231356111 >> 172.21.15.121:0/3231356111 conn(0x7f51280b3580 msgr2=0x7f51280cd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:21.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 -- 172.21.15.121:0/3231356111 shutdown_connections 2024-09-17T03:39:21.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.186+0000 7f512fe00640 1 -- 172.21.15.121:0/3231356111 wait complete. 2024-09-17T03:39:21.212 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:39:21.212 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:39:21.312 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:39:21.421 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:39:21.422 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:21.422 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:21.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:39:21.457 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:21.457 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:21.495 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:39:21.495 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:21.495 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:21.523 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:39:21.533 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:39:21.535 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:39:21.535 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:21.535 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:21.574 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:39:21.574 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:39:21.574 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.795+0000 7f2de9a00640 1 -- 172.21.15.121:0/1185488673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de40d0cc0 msgr2=0x7f2de41673d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.795+0000 7f2de9a00640 1 --2- 172.21.15.121:0/1185488673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de40d0cc0 0x7f2de41673d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009830 tx=0x7f2ddc02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:39:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.796+0000 7f2de9a00640 1 -- 172.21.15.121:0/1185488673 shutdown_connections 2024-09-17T03:39:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.796+0000 7f2de9a00640 1 --2- 172.21.15.121:0/1185488673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de40d0cc0 0x7f2de41673d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.796+0000 7f2de9a00640 1 -- 172.21.15.121:0/1185488673 >> 172.21.15.121:0/1185488673 conn(0x7f2de40b3580 msgr2=0x7f2de40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.796+0000 7f2de9a00640 1 -- 172.21.15.121:0/1185488673 shutdown_connections 2024-09-17T03:39:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.796+0000 7f2de9a00640 1 -- 172.21.15.121:0/1185488673 wait complete. 2024-09-17T03:39:21.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.798+0000 7f2de9a00640 1 Processor -- start 2024-09-17T03:39:21.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.798+0000 7f2de9a00640 1 -- start start 2024-09-17T03:39:21.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.799+0000 7f2de9a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de406d800 0x7f2de4158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:21.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.799+0000 7f2de9a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2de415a3e0 0x7f2de4158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.799+0000 7f2de9a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de41f3780 0x7f2de41f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.799+0000 7f2de9a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4167ca0 con 0x7f2de41f3780 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.799+0000 7f2de9a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4167b20 con 0x7f2de406d800 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.799+0000 7f2de9a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2de4167e20 con 0x7f2de415a3e0 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de41f3780 0x7f2de41f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de41f3780 0x7f2de41f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39202/0 (socket says 172.21.15.121:39202) 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de3400640 1 -- 172.21.15.121:0/1801496373 learned_addr learned my addr 172.21.15.121:0/1801496373 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de2a00640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de406d800 0x7f2de4158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de2000640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2de415a3e0 0x7f2de4158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de3400640 1 -- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2de415a3e0 msgr2=0x7f2de4158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de3400640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2de415a3e0 0x7f2de4158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de3400640 1 -- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de406d800 msgr2=0x7f2de4158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de3400640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de406d800 0x7f2de4158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de3400640 1 -- 172.21.15.121:0/1801496373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de4154130 con 0x7f2de41f3780 2024-09-17T03:39:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.800+0000 7f2de3400640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de41f3780 0x7f2de41f3b90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc02aa90 tx=0x7f2ddc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.801+0000 7f2ddaa00640 1 -- 172.21.15.121:0/1801496373 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc031d60 con 0x7f2de41f3780 2024-09-17T03:39:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.801+0000 7f2ddaa00640 1 -- 172.21.15.121:0/1801496373 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ddc033e10 con 0x7f2de41f3780 2024-09-17T03:39:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.801+0000 7f2ddaa00640 1 -- 172.21.15.121:0/1801496373 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc005260 con 0x7f2de41f3780 2024-09-17T03:39:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.801+0000 7f2de9a00640 1 -- 172.21.15.121:0/1801496373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de4073a60 con 0x7f2de41f3780 2024-09-17T03:39:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.801+0000 7f2de9a00640 1 -- 172.21.15.121:0/1801496373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de4074020 con 0x7f2de41f3780 2024-09-17T03:39:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.802+0000 7f2de9a00640 1 -- 172.21.15.121:0/1801496373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de40737d0 con 0x7f2de41f3780 2024-09-17T03:39:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.803+0000 7f2ddaa00640 1 -- 172.21.15.121:0/1801496373 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ddc005400 con 0x7f2de41f3780 2024-09-17T03:39:21.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.804+0000 7f2ddaa00640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2dc4078b90 0x7f2dc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:21.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.805+0000 7f2ddaa00640 1 -- 172.21.15.121:0/1801496373 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7f2ddc0bbdd0 con 0x7f2de41f3780 2024-09-17T03:39:21.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.805+0000 7f2de2a00640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2dc4078b90 0x7f2dc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:21.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.806+0000 7f2de2a00640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2dc4078b90 0x7f2dc407b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40012e0 tx=0x7f2dd4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:21.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:21.809+0000 7f2ddaa00640 1 -- 172.21.15.121:0/1801496373 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2ddc03f030 con 0x7f2de41f3780 2024-09-17T03:39:22.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.027+0000 7f2de9a00640 1 -- 172.21.15.121:0/1801496373 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2de4074a00 con 0x7f2de41f3780 2024-09-17T03:39:22.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.028+0000 7f2ddaa00640 1 -- 172.21.15.121:0/1801496373 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+3923 (secure 0 0 0) 0x7f2de4074a00 con 0x7f2de41f3780 2024-09-17T03:39:22.028 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:22.028 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":52,"btime":"2024-09-17T03:39:15:263333+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5513,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3345012856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3345012856},{"type":"v1","addr":"172.21.15.176:6837","nonce":3345012856}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5519,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1489171016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":1489171016},{"type":"v1","addr":"172.21.15.121:6835","nonce":1489171016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2870460783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2870460783},{"type":"v1","addr":"172.21.15.176:6836","nonce":2870460783}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6327,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/3607110766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3607110766},{"type":"v1","addr":"172.21.15.121:6834","nonce":3607110766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[]} 2024-09-17T03:39:22.028 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 52 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 -- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2dc4078b90 msgr2=0x7f2dc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2dc4078b90 0x7f2dc407b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40012e0 tx=0x7f2dd4009040 comp rx=0 tx=0).stop 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 -- 172.21.15.121:0/1801496373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de41f3780 msgr2=0x7f2de41f3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de41f3780 0x7f2de41f3b90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc02aa90 tx=0x7f2ddc033c20 comp rx=0 tx=0).stop 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 -- 172.21.15.121:0/1801496373 shutdown_connections 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2dc4078b90 0x7f2dc407b0a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de41f3780 0x7f2de41f3b90 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2de415a3e0 0x7f2de4158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 --2- 172.21.15.121:0/1801496373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de406d800 0x7f2de4158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 -- 172.21.15.121:0/1801496373 >> 172.21.15.121:0/1801496373 conn(0x7f2de40b3580 msgr2=0x7f2de415cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 -- 172.21.15.121:0/1801496373 shutdown_connections 2024-09-17T03:39:22.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.031+0000 7f2de9a00640 1 -- 172.21.15.121:0/1801496373 wait complete. 2024-09-17T03:39:22.053 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:39:22.053 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:39:22.053 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:39:22.053 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:39:22.053 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:39:22.053 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:39:22.054 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:39:22.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:39:22.054 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:39:22.054 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:39:22.054 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:39:22.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:39:22.054 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:39:22.055 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:39:22.055 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:39:22.055 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:39:22.077 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:39:22.077 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:39:22.078 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:39:22.078 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:39:22.079 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:39:22.080 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:39:22.081 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:39:22.082 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:39:22.122 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:39:22.122 DEBUG:teuthology.parallel:result is None 2024-09-17T03:39:22.125 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:39:22.126 DEBUG:teuthology.parallel:result is None 2024-09-17T03:39:22.126 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:39:22.127 DEBUG:teuthology.parallel:result is None 2024-09-17T03:39:22.129 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:39:22.130 DEBUG:teuthology.parallel:result is None 2024-09-17T03:39:22.130 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:39:22.322 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:39:22.328 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:39:22.337 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:39:22.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.362+0000 7fbcbbe00640 1 -- 172.21.15.121:0/3894224008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcbc0d34f0 msgr2=0x7fbcbc162290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:22.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.362+0000 7fbcbbe00640 1 --2- 172.21.15.121:0/3894224008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcbc0d34f0 0x7fbcbc162290 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc08c820 tx=0x7fbca802a560 comp rx=0 tx=0).stop 2024-09-17T03:39:22.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.362+0000 7fbcbbe00640 1 -- 172.21.15.121:0/3894224008 shutdown_connections 2024-09-17T03:39:22.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.362+0000 7fbcbbe00640 1 --2- 172.21.15.121:0/3894224008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcbc0d34f0 0x7fbcbc162290 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:22.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.362+0000 7fbcbbe00640 1 --2- 172.21.15.121:0/3894224008 >> v2:172.21.15.176:3300/0 conn(0x7fbcbc0ba040 0x7fbcbc0d2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:22.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.362+0000 7fbcbbe00640 1 -- 172.21.15.121:0/3894224008 >> 172.21.15.121:0/3894224008 conn(0x7fbcbc0d4a60 msgr2=0x7fbcbc0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:22.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.362+0000 7fbcbbe00640 1 -- 172.21.15.121:0/3894224008 shutdown_connections 2024-09-17T03:39:22.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.362+0000 7fbcbbe00640 1 -- 172.21.15.121:0/3894224008 wait complete. 2024-09-17T03:39:22.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.364+0000 7fbcbbe00640 1 Processor -- start 2024-09-17T03:39:22.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.365+0000 7fbcbbe00640 1 -- start start 2024-09-17T03:39:22.365 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T03:39:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.366+0000 7fbcbbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcbc0ba040 0x7fbcbc0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.366+0000 7fbcbbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0d34f0 0x7fbcbc0b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.366+0000 7fbcbbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc1627d0 0x7fbcbc0b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.366+0000 7fbcbbe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc15fb50 con 0x7fbcbc0ba040 2024-09-17T03:39:22.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.366+0000 7fbcbbe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc15f9d0 con 0x7fbcbc1627d0 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.366+0000 7fbcbbe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbcbc06d4f0 con 0x7fbcbc0d34f0 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.366+0000 7fbcbaa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcbc0ba040 0x7fbcbc0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.366+0000 7fbcbaa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcbc0ba040 0x7fbcbc0cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47512/0 (socket says 172.21.15.121:47512) 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.366+0000 7fbcbaa00640 1 -- 172.21.15.121:0/2522839096 learned_addr learned my addr 172.21.15.121:0/2522839096 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.366+0000 7fbcbb400640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc1627d0 0x7fbcbc0b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcba000640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0d34f0 0x7fbcbc0b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcbaa00640 1 -- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0d34f0 msgr2=0x7fbcbc0b8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcbaa00640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0d34f0 0x7fbcbc0b8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcbaa00640 1 -- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc1627d0 msgr2=0x7fbcbc0b94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcbaa00640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc1627d0 0x7fbcbc0b94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcbaa00640 1 -- 172.21.15.121:0/2522839096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc0ca280 con 0x7fbcbc0ba040 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcbb400640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc1627d0 0x7fbcbc0b94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:22.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcbaa00640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcbc0ba040 0x7fbcbc0cda70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00e790 tx=0x7fbcac00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:22.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcb3400640 1 -- 172.21.15.121:0/2522839096 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00eea0 con 0x7fbcbc0ba040 2024-09-17T03:39:22.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcb3400640 1 -- 172.21.15.121:0/2522839096 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcac00cdb0 con 0x7fbcbc0ba040 2024-09-17T03:39:22.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcb3400640 1 -- 172.21.15.121:0/2522839096 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac010690 con 0x7fbcbc0ba040 2024-09-17T03:39:22.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.367+0000 7fbcbbe00640 1 -- 172.21.15.121:0/2522839096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcbc1f94c0 con 0x7fbcbc0ba040 2024-09-17T03:39:22.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.368+0000 7fbcbbe00640 1 -- 172.21.15.121:0/2522839096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcbc1f8f00 con 0x7fbcbc0ba040 2024-09-17T03:39:22.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.369+0000 7fbcbbe00640 1 -- 172.21.15.121:0/2522839096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcbc06d9a0 con 0x7fbcbc0ba040 2024-09-17T03:39:22.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.370+0000 7fbcb3400640 1 -- 172.21.15.121:0/2522839096 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcac010830 con 0x7fbcbc0ba040 2024-09-17T03:39:22.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.371+0000 7fbcb3400640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbc9c078b90 0x7fbc9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:22.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.371+0000 7fbcb3400640 1 -- 172.21.15.121:0/2522839096 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7fbcac09b660 con 0x7fbcbc0ba040 2024-09-17T03:39:22.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.372+0000 7fbcba000640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbc9c078b90 0x7fbc9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:22.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.372+0000 7fbcba000640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbc9c078b90 0x7fbc9c07b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbca8033000 tx=0x7fbca8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:22.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.376+0000 7fbcb3400640 1 -- 172.21.15.121:0/2522839096 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbcac063520 con 0x7fbcbc0ba040 2024-09-17T03:39:22.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:22.571+0000 7fbcbbe00640 1 -- 172.21.15.121:0/2522839096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fbcbc0cac70 con 0x7fbcbc0ba040 2024-09-17T03:39:23.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.318+0000 7fbcb3400640 1 -- 172.21.15.121:0/2522839096 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) ==== 97+0+0 (secure 0 0 0) 0x7fbcac067f50 con 0x7fbcbc0ba040 2024-09-17T03:39:23.318 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-17T03:39:23.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 -- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbc9c078b90 msgr2=0x7fbc9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:23.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbc9c078b90 0x7fbc9c07b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbca8033000 tx=0x7fbca8004730 comp rx=0 tx=0).stop 2024-09-17T03:39:23.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 -- 172.21.15.121:0/2522839096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcbc0ba040 msgr2=0x7fbcbc0cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:23.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcbc0ba040 0x7fbcbc0cda70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00e790 tx=0x7fbcac00ec50 comp rx=0 tx=0).stop 2024-09-17T03:39:23.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 -- 172.21.15.121:0/2522839096 shutdown_connections 2024-09-17T03:39:23.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcbc1627d0 0x7fbcbc0b94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcbc0d34f0 0x7fbcbc0b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbc9c078b90 0x7fbc9c07b0a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 --2- 172.21.15.121:0/2522839096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcbc0ba040 0x7fbcbc0cda70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 -- 172.21.15.121:0/2522839096 >> 172.21.15.121:0/2522839096 conn(0x7fbcbc0d4a60 msgr2=0x7fbcbc0d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:23.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.321+0000 7fbcbbe00640 1 -- 172.21.15.121:0/2522839096 shutdown_connections 2024-09-17T03:39:23.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.322+0000 7fbcbbe00640 1 -- 172.21.15.121:0/2522839096 wait complete. 2024-09-17T03:39:23.345 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:39:23.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.566+0000 7f6701a00640 1 -- 172.21.15.121:0/1959824328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66fc0d3510 msgr2=0x7f66fc0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:23.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.566+0000 7f6701a00640 1 --2- 172.21.15.121:0/1959824328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66fc0d3510 0x7f66fc0cf4e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0d1f70 tx=0x7f66f402aa10 comp rx=0 tx=0).stop 2024-09-17T03:39:23.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.566+0000 7f6701a00640 1 -- 172.21.15.121:0/1959824328 shutdown_connections 2024-09-17T03:39:23.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.566+0000 7f6701a00640 1 --2- 172.21.15.121:0/1959824328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66fc0d3510 0x7f66fc0cf4e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.566+0000 7f6701a00640 1 --2- 172.21.15.121:0/1959824328 >> v2:172.21.15.176:3300/0 conn(0x7f66fc0b7eb0 0x7f66fc0d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.566+0000 7f6701a00640 1 --2- 172.21.15.121:0/1959824328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66fc06d7c0 0x7f66fc0b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.566+0000 7f6701a00640 1 -- 172.21.15.121:0/1959824328 >> 172.21.15.121:0/1959824328 conn(0x7f66fc0d1750 msgr2=0x7f66fc0b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:23.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.566+0000 7f6701a00640 1 -- 172.21.15.121:0/1959824328 shutdown_connections 2024-09-17T03:39:23.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.566+0000 7f6701a00640 1 -- 172.21.15.121:0/1959824328 wait complete. 2024-09-17T03:39:23.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.568+0000 7f6701a00640 1 Processor -- start 2024-09-17T03:39:23.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.568+0000 7f6701a00640 1 -- start start 2024-09-17T03:39:23.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f6701a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66fc06d7c0 0x7f66fc14fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:23.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f6701a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66fc0b7eb0 0x7f66fc1f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:23.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f6701a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66fc0d3510 0x7f66fc14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:23.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f6701a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc15eac0 con 0x7f66fc06d7c0 2024-09-17T03:39:23.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f6701a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc06e4d0 con 0x7f66fc0b7eb0 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f6701a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f66fc15ec40 con 0x7f66fc0d3510 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f66fbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66fc06d7c0 0x7f66fc14fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f66fbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66fc06d7c0 0x7f66fc14fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47526/0 (socket says 172.21.15.121:47526) 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f66fbe00640 1 -- 172.21.15.121:0/3205003251 learned_addr learned my addr 172.21.15.121:0/3205003251 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f66f3e00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66fc0b7eb0 0x7f66fc1f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f6701000640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66fc0d3510 0x7f66fc14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f66fbe00640 1 -- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66fc0d3510 msgr2=0x7f66fc14f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f66fbe00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66fc0d3510 0x7f66fc14f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f66fbe00640 1 -- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66fc0b7eb0 msgr2=0x7f66fc1f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f66fbe00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66fc0b7eb0 0x7f66fc1f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.570+0000 7f66fbe00640 1 -- 172.21.15.121:0/3205003251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc0abf20 con 0x7f66fc06d7c0 2024-09-17T03:39:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.571+0000 7f66fbe00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66fc06d7c0 0x7f66fc14fbf0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00c940 tx=0x7f66ec00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:23.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.571+0000 7f66f8c00640 1 -- 172.21.15.121:0/3205003251 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec007bb0 con 0x7f66fc06d7c0 2024-09-17T03:39:23.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.571+0000 7f66f8c00640 1 -- 172.21.15.121:0/3205003251 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66ec007e40 con 0x7f66fc06d7c0 2024-09-17T03:39:23.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.571+0000 7f6701a00640 1 -- 172.21.15.121:0/3205003251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66fc0ac200 con 0x7f66fc06d7c0 2024-09-17T03:39:23.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.571+0000 7f66f8c00640 1 -- 172.21.15.121:0/3205003251 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00f690 con 0x7f66fc06d7c0 2024-09-17T03:39:23.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.571+0000 7f6701a00640 1 -- 172.21.15.121:0/3205003251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66fc14e6e0 con 0x7f66fc06d7c0 2024-09-17T03:39:23.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.572+0000 7f6701a00640 1 -- 172.21.15.121:0/3205003251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66fc0cfca0 con 0x7f66fc06d7c0 2024-09-17T03:39:23.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.574+0000 7f66f8c00640 1 -- 172.21.15.121:0/3205003251 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66ec00f830 con 0x7f66fc06d7c0 2024-09-17T03:39:23.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.574+0000 7f66f8c00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d8078b90 0x7f66d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:23.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.575+0000 7f66f8c00640 1 -- 172.21.15.121:0/3205003251 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7f66ec09b330 con 0x7f66fc06d7c0 2024-09-17T03:39:23.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.575+0000 7f66f3e00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d8078b90 0x7f66d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:23.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.576+0000 7f66f3e00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d8078b90 0x7f66d807b0a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f66e4005d70 tx=0x7f66e4005d00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:23.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.579+0000 7f66f8c00640 1 -- 172.21.15.121:0/3205003251 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66ec014030 con 0x7f66fc06d7c0 2024-09-17T03:39:23.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.828+0000 7f6701a00640 1 -- 172.21.15.121:0/3205003251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f66fc0d0080 con 0x7f66fc06d7c0 2024-09-17T03:39:23.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.829+0000 7f66f8c00640 1 -- 172.21.15.121:0/3205003251 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f66ec0639c0 con 0x7f66fc06d7c0 2024-09-17T03:39:23.829 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:23.829 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:39:23.829 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-17T03:39:23.829 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.829 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-17T03:39:23.829 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohm64sFGhAAJDdFwMDkudwacQaLfvbAdg==", 2024-09-17T03:39:23.829 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.829 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:23.829 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmIGvPNRAAvE+tovzn5WadGa9C/P/A3A==", 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.830 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.c", 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmV/btJxAAmhL4jXk0LVdzCPaNi9Hzhg==", 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.831 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.d", 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmeQccCBAAtTfeUysbtoqrKjwaKRWyvg==", 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDE+OhmBxJKNRAAGxPaH7R2JtcFVO5kR/Qh2A==", 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.832 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDI+OhmRtvFCBAAOG/1XD75Atl6ztUGPw3PKA==", 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.833 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL+OhmwzDzIxAA9Z/IIRphtZK1jbS2sIXeJQ==", 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.3", 2024-09-17T03:39:23.834 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDO+Ohm94g0NBAAmxtHPev4OOM0YfOQt7N5Jg==", 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.4", 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDV+Ohmj7OoCBAA/Hrj9dHVT98lURPWJE3r/g==", 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:23.835 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.5", 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDY+Ohmc29QFxAAGsMy0+9MviYohok8JpL+ZA==", 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.836 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.6", 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDb+OhmDO8tKRAAq6bn/I54WKTdN6XiviHNsQ==", 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.7", 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDe+OhmUuFwNxAAgAeDJiL/TIGDuDAC+dXCyA==", 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.837 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw==", 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.838 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohmec7LKRAAl5nAqPEncglNL2FbRlD0oA==", 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.2", 2024-09-17T03:39:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohme/hCHxAAdP8DjxaXWMGi/Fw+85zUFA==", 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.3", 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmivFTNBAA5f47Lq5CE+iXt3i+5fUJGA==", 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:23.840 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC/+OhmXWj6GBAAh/FBw0ElmHixSBXm8PPeAg==", 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.841 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohmsn9CDxAAzjtaZG1qe4XTnBge+t3vlA==", 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.y", 2024-09-17T03:39:23.842 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmQfYJAxAA6Mc5PiIb5VDamVU5Vhx3aQ==", 2024-09-17T03:39:23.843 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:23.843 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:39:23.843 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:39:23.843 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:23.843 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.843 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:23.843 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-17T03:39:23.843 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:39:23.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 -- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d8078b90 msgr2=0x7f66d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:23.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d8078b90 0x7f66d807b0a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f66e4005d70 tx=0x7f66e4005d00 comp rx=0 tx=0).stop 2024-09-17T03:39:23.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 -- 172.21.15.121:0/3205003251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66fc06d7c0 msgr2=0x7f66fc14fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:23.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66fc06d7c0 0x7f66fc14fbf0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00c940 tx=0x7f66ec00ce00 comp rx=0 tx=0).stop 2024-09-17T03:39:23.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 -- 172.21.15.121:0/3205003251 shutdown_connections 2024-09-17T03:39:23.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66fc0d3510 0x7f66fc14f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66fc0b7eb0 0x7f66fc1f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f66d8078b90 0x7f66d807b0a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 --2- 172.21.15.121:0/3205003251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66fc06d7c0 0x7f66fc14fbf0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:23.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 -- 172.21.15.121:0/3205003251 >> 172.21.15.121:0/3205003251 conn(0x7f66fc0d1750 msgr2=0x7f66fc0cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:23.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 -- 172.21.15.121:0/3205003251 shutdown_connections 2024-09-17T03:39:23.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:23.831+0000 7f6701a00640 1 -- 172.21.15.121:0/3205003251 wait complete. 2024-09-17T03:39:23.854 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:39:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.074+0000 7fafdac00640 1 -- 172.21.15.121:0/4019981853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafd406d800 msgr2=0x7fafd40d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.074+0000 7fafdac00640 1 --2- 172.21.15.121:0/4019981853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafd406d800 0x7fafd40d05b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009830 tx=0x7fafc002a3f0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.074+0000 7fafdac00640 1 -- 172.21.15.121:0/4019981853 shutdown_connections 2024-09-17T03:39:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.074+0000 7fafdac00640 1 --2- 172.21.15.121:0/4019981853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafd406d800 0x7fafd40d05b0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.074+0000 7fafdac00640 1 -- 172.21.15.121:0/4019981853 >> 172.21.15.121:0/4019981853 conn(0x7fafd40b3580 msgr2=0x7fafd40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.074+0000 7fafdac00640 1 -- 172.21.15.121:0/4019981853 shutdown_connections 2024-09-17T03:39:24.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.074+0000 7fafdac00640 1 -- 172.21.15.121:0/4019981853 wait complete. 2024-09-17T03:39:24.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.077+0000 7fafdac00640 1 Processor -- start 2024-09-17T03:39:24.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.077+0000 7fafdac00640 1 -- start start 2024-09-17T03:39:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.078+0000 7fafdac00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafd406d800 0x7fafd4154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.078+0000 7fafdac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd40d0af0 0x7fafd409d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.078+0000 7fafdac00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd415a3e0 0x7fafd409dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.078+0000 7fafdac00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fafd415d6b0 con 0x7fafd406d800 2024-09-17T03:39:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.078+0000 7fafdac00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fafd415d530 con 0x7fafd415a3e0 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.078+0000 7fafdac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fafd415d830 con 0x7fafd40d0af0 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.078+0000 7fafd3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafd406d800 0x7fafd4154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.078+0000 7fafd3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafd406d800 0x7fafd4154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47546/0 (socket says 172.21.15.121:47546) 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafd3e00640 1 -- 172.21.15.121:0/4171687047 learned_addr learned my addr 172.21.15.121:0/4171687047 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafd8c00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd415a3e0 0x7fafd409dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafd3400640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd40d0af0 0x7fafd409d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafd3e00640 1 -- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd40d0af0 msgr2=0x7fafd409d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafd3e00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd40d0af0 0x7fafd409d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafd3e00640 1 -- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd415a3e0 msgr2=0x7fafd409dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafd3e00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd415a3e0 0x7fafd409dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafd3e00640 1 -- 172.21.15.121:0/4171687047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd40cc970 con 0x7fafd406d800 2024-09-17T03:39:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafd8c00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd415a3e0 0x7fafd409dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:24.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafd3e00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafd406d800 0x7fafd4154b20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fafc400b3f0 tx=0x7fafc400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:24.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.079+0000 7fafcbe00640 1 -- 172.21.15.121:0/4171687047 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4015020 con 0x7fafd406d800 2024-09-17T03:39:24.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.080+0000 7fafcbe00640 1 -- 172.21.15.121:0/4171687047 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc4011920 con 0x7fafd406d800 2024-09-17T03:39:24.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.080+0000 7fafcbe00640 1 -- 172.21.15.121:0/4171687047 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4011d70 con 0x7fafd406d800 2024-09-17T03:39:24.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.080+0000 7fafdac00640 1 -- 172.21.15.121:0/4171687047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd40c45e0 con 0x7fafd406d800 2024-09-17T03:39:24.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.080+0000 7fafdac00640 1 -- 172.21.15.121:0/4171687047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd4155060 con 0x7fafd406d800 2024-09-17T03:39:24.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.081+0000 7fafdac00640 1 -- 172.21.15.121:0/4171687047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd40d05b0 con 0x7fafd406d800 2024-09-17T03:39:24.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.082+0000 7fafcbe00640 1 -- 172.21.15.121:0/4171687047 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafc4018020 con 0x7fafd406d800 2024-09-17T03:39:24.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.083+0000 7fafcbe00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fafb4078bc0 0x7fafb407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:24.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.083+0000 7fafcbe00640 1 -- 172.21.15.121:0/4171687047 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7fafc409ac10 con 0x7fafd406d800 2024-09-17T03:39:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.083+0000 7fafd3400640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fafb4078bc0 0x7fafb407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.084+0000 7fafd3400640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fafb4078bc0 0x7fafb407b0d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fafc0034000 tx=0x7fafc0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:24.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.087+0000 7fafcbe00640 1 -- 172.21.15.121:0/4171687047 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fafc401f020 con 0x7fafd406d800 2024-09-17T03:39:24.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.274+0000 7fafdac00640 1 -- 172.21.15.121:0/4171687047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fafd415dff0 con 0x7fafd406d800 2024-09-17T03:39:24.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.275+0000 7fafcbe00640 1 -- 172.21.15.121:0/4171687047 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) ==== 84+0+65 (secure 0 0 0) 0x7fafc4063200 con 0x7fafd406d800 2024-09-17T03:39:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:24.275 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-17T03:39:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-17T03:39:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-17T03:39:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:24.275 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-17T03:39:24.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 -- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fafb4078bc0 msgr2=0x7fafb407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:24.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fafb4078bc0 0x7fafb407b0d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fafc0034000 tx=0x7fafc0004730 comp rx=0 tx=0).stop 2024-09-17T03:39:24.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 -- 172.21.15.121:0/4171687047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafd406d800 msgr2=0x7fafd4154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:24.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafd406d800 0x7fafd4154b20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fafc400b3f0 tx=0x7fafc400b8b0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 -- 172.21.15.121:0/4171687047 shutdown_connections 2024-09-17T03:39:24.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafd415a3e0 0x7fafd409dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafd40d0af0 0x7fafd409d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fafb4078bc0 0x7fafb407b0d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 --2- 172.21.15.121:0/4171687047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafd406d800 0x7fafd4154b20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 -- 172.21.15.121:0/4171687047 >> 172.21.15.121:0/4171687047 conn(0x7fafd40b3580 msgr2=0x7fafd415a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:24.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 -- 172.21.15.121:0/4171687047 shutdown_connections 2024-09-17T03:39:24.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.277+0000 7fafdac00640 1 -- 172.21.15.121:0/4171687047 wait complete. 2024-09-17T03:39:24.303 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:39:24.303 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:39:24.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.532+0000 7fe53fe00640 1 -- 172.21.15.121:0/3274545015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe53815c830 msgr2=0x7fe5380ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:24.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.532+0000 7fe53fe00640 1 --2- 172.21.15.121:0/3274545015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe53815c830 0x7fe5380ccba0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe5380b3190 tx=0x7fe52c02a580 comp rx=0 tx=0).stop 2024-09-17T03:39:24.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.532+0000 7fe53fe00640 1 -- 172.21.15.121:0/3274545015 shutdown_connections 2024-09-17T03:39:24.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.532+0000 7fe53fe00640 1 --2- 172.21.15.121:0/3274545015 >> v2:172.21.15.176:3300/0 conn(0x7fe5380d05f0 0x7fe5380d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.532+0000 7fe53fe00640 1 --2- 172.21.15.121:0/3274545015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53806d750 0x7fe53806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.532+0000 7fe53fe00640 1 --2- 172.21.15.121:0/3274545015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe53815c830 0x7fe5380ccba0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.532+0000 7fe53fe00640 1 -- 172.21.15.121:0/3274545015 >> 172.21.15.121:0/3274545015 conn(0x7fe5380b3620 msgr2=0x7fe5380b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:24.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.532+0000 7fe53fe00640 1 -- 172.21.15.121:0/3274545015 shutdown_connections 2024-09-17T03:39:24.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.532+0000 7fe53fe00640 1 -- 172.21.15.121:0/3274545015 wait complete. 2024-09-17T03:39:24.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.534+0000 7fe53fe00640 1 Processor -- start 2024-09-17T03:39:24.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.535+0000 7fe53fe00640 1 -- start start 2024-09-17T03:39:24.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.536+0000 7fe53fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53806d750 0x7fe538099880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:24.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.536+0000 7fe53fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5380d05f0 0x7fe5381f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:24.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.536+0000 7fe53fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53815c830 0x7fe5381f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:24.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.536+0000 7fe53fe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe53815d210 con 0x7fe5380d05f0 2024-09-17T03:39:24.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.536+0000 7fe53fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe53815d090 con 0x7fe53806d750 2024-09-17T03:39:24.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.536+0000 7fe53fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe53815d390 con 0x7fe53815c830 2024-09-17T03:39:24.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.536+0000 7fe53ca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5380d05f0 0x7fe5381f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:24.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.536+0000 7fe53ca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5380d05f0 0x7fe5381f8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47550/0 (socket says 172.21.15.121:47550) 2024-09-17T03:39:24.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.537+0000 7fe53ca00640 1 -- 172.21.15.121:0/2172243621 learned_addr learned my addr 172.21.15.121:0/2172243621 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:24.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.537+0000 7fe53d400640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53806d750 0x7fe538099880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.537+0000 7fe53de00640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53815c830 0x7fe5381f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.537+0000 7fe53ca00640 1 -- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53815c830 msgr2=0x7fe5381f94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.537+0000 7fe53ca00640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53815c830 0x7fe5381f94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.537+0000 7fe53ca00640 1 -- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53806d750 msgr2=0x7fe538099880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.537+0000 7fe53ca00640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53806d750 0x7fe538099880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.537+0000 7fe53ca00640 1 -- 172.21.15.121:0/2172243621 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5381f9cd0 con 0x7fe5380d05f0 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.537+0000 7fe53ca00640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5380d05f0 0x7fe5381f8f80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe52400b410 tx=0x7fe52400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.537+0000 7fe535600640 1 -- 172.21.15.121:0/2172243621 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524015020 con 0x7fe5380d05f0 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.538+0000 7fe535600640 1 -- 172.21.15.121:0/2172243621 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe524011940 con 0x7fe5380d05f0 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.538+0000 7fe535600640 1 -- 172.21.15.121:0/2172243621 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524011d90 con 0x7fe5380d05f0 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.538+0000 7fe53fe00640 1 -- 172.21.15.121:0/2172243621 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5381f58e0 con 0x7fe5380d05f0 2024-09-17T03:39:24.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.538+0000 7fe53fe00640 1 -- 172.21.15.121:0/2172243621 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5381f5ea0 con 0x7fe5380d05f0 2024-09-17T03:39:24.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.539+0000 7fe53fe00640 1 -- 172.21.15.121:0/2172243621 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5380d0c00 con 0x7fe5380d05f0 2024-09-17T03:39:24.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.540+0000 7fe535600640 1 -- 172.21.15.121:0/2172243621 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe524018020 con 0x7fe5380d05f0 2024-09-17T03:39:24.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.541+0000 7fe535600640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe518078b90 0x7fe51807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:24.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.541+0000 7fe535600640 1 -- 172.21.15.121:0/2172243621 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7fe52409aab0 con 0x7fe5380d05f0 2024-09-17T03:39:24.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.542+0000 7fe53d400640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe518078b90 0x7fe51807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:24.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.545+0000 7fe53d400640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe518078b90 0x7fe51807b0a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe52c033000 tx=0x7fe52c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:24.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.546+0000 7fe535600640 1 -- 172.21.15.121:0/2172243621 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe5380d0c00 con 0x7fe5380d05f0 2024-09-17T03:39:24.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:24.729+0000 7fe53fe00640 1 -- 172.21.15.121:0/2172243621 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe5381f9a60 con 0x7fe5380d05f0 2024-09-17T03:39:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.337+0000 7fe535600640 1 -- 172.21.15.121:0/2172243621 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) ==== 138+0+0 (secure 0 0 0) 0x7fe52401f020 con 0x7fe5380d05f0 2024-09-17T03:39:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-17T03:39:25.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.340+0000 7fe53fe00640 1 -- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe518078b90 msgr2=0x7fe51807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.340+0000 7fe53fe00640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe518078b90 0x7fe51807b0a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe52c033000 tx=0x7fe52c004730 comp rx=0 tx=0).stop 2024-09-17T03:39:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.340+0000 7fe53fe00640 1 -- 172.21.15.121:0/2172243621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5380d05f0 msgr2=0x7fe5381f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.340+0000 7fe53fe00640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5380d05f0 0x7fe5381f8f80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe52400b410 tx=0x7fe52400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:39:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.340+0000 7fe53fe00640 1 -- 172.21.15.121:0/2172243621 shutdown_connections 2024-09-17T03:39:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.340+0000 7fe53fe00640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe53815c830 0x7fe5381f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.340+0000 7fe53fe00640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe518078b90 0x7fe51807b0a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.340+0000 7fe53fe00640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5380d05f0 0x7fe5381f8f80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.340+0000 7fe53fe00640 1 --2- 172.21.15.121:0/2172243621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe53806d750 0x7fe538099880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.340+0000 7fe53fe00640 1 -- 172.21.15.121:0/2172243621 >> 172.21.15.121:0/2172243621 conn(0x7fe5380b3620 msgr2=0x7fe5380af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:25.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.341+0000 7fe53fe00640 1 -- 172.21.15.121:0/2172243621 shutdown_connections 2024-09-17T03:39:25.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.341+0000 7fe53fe00640 1 -- 172.21.15.121:0/2172243621 wait complete. 2024-09-17T03:39:25.373 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:39:25.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.601+0000 7f69f8800640 1 -- 172.21.15.121:0/2173398707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f00d0cc0 msgr2=0x7f69f015cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:25.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.601+0000 7f69f8800640 1 --2- 172.21.15.121:0/2173398707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f00d0cc0 0x7f69f015cc10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f69f00cdc20 tx=0x7f69ec02a9a0 comp rx=0 tx=0).stop 2024-09-17T03:39:25.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.601+0000 7f69f8800640 1 -- 172.21.15.121:0/2173398707 shutdown_connections 2024-09-17T03:39:25.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.601+0000 7f69f8800640 1 --2- 172.21.15.121:0/2173398707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f00d0cc0 0x7f69f015cc10 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:25.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.601+0000 7f69f8800640 1 --2- 172.21.15.121:0/2173398707 >> v2:172.21.15.176:3300/0 conn(0x7f69f015a3e0 0x7f69f006d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:25.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.601+0000 7f69f8800640 1 -- 172.21.15.121:0/2173398707 >> 172.21.15.121:0/2173398707 conn(0x7f69f00b3580 msgr2=0x7f69f00b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:25.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.601+0000 7f69f8800640 1 -- 172.21.15.121:0/2173398707 shutdown_connections 2024-09-17T03:39:25.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.601+0000 7f69f8800640 1 -- 172.21.15.121:0/2173398707 wait complete. 2024-09-17T03:39:25.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.603+0000 7f69f8800640 1 Processor -- start 2024-09-17T03:39:25.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.603+0000 7f69f8800640 1 -- start start 2024-09-17T03:39:25.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f8800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f006ddc0 0x7f69f0074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:25.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f8800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f015a3e0 0x7f69f015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:25.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f8800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69f0155fb0 0x7f69f015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:25.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f8800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f69f015d4e0 con 0x7f69f006ddc0 2024-09-17T03:39:25.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f8800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69f015d360 con 0x7f69f015a3e0 2024-09-17T03:39:25.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f8800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f69f015d660 con 0x7f69f0155fb0 2024-09-17T03:39:25.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f006ddc0 0x7f69f0074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:25.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f006ddc0 0x7f69f0074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47562/0 (socket says 172.21.15.121:47562) 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f5e00640 1 -- 172.21.15.121:0/3709502448 learned_addr learned my addr 172.21.15.121:0/3709502448 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f5400640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f015a3e0 0x7f69f015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.605+0000 7f69f6800640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69f0155fb0 0x7f69f015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69f5e00640 1 -- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69f0155fb0 msgr2=0x7f69f015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69f5e00640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69f0155fb0 0x7f69f015adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69f5e00640 1 -- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f015a3e0 msgr2=0x7f69f015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69f5e00640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f015a3e0 0x7f69f015a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69f5e00640 1 -- 172.21.15.121:0/3709502448 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f01f9a20 con 0x7f69f006ddc0 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69f5e00640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f006ddc0 0x7f69f0074790 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f69e400e790 tx=0x7f69e400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69ea000640 1 -- 172.21.15.121:0/3709502448 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e400eea0 con 0x7f69f006ddc0 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69ea000640 1 -- 172.21.15.121:0/3709502448 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69e400cdb0 con 0x7f69f006ddc0 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69f8800640 1 -- 172.21.15.121:0/3709502448 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f00c7880 con 0x7f69f006ddc0 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69ea000640 1 -- 172.21.15.121:0/3709502448 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4010690 con 0x7f69f006ddc0 2024-09-17T03:39:25.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.606+0000 7f69f8800640 1 -- 172.21.15.121:0/3709502448 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f00c75a0 con 0x7f69f006ddc0 2024-09-17T03:39:25.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.607+0000 7f69f8800640 1 -- 172.21.15.121:0/3709502448 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f015ec90 con 0x7f69f006ddc0 2024-09-17T03:39:25.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.609+0000 7f69ea000640 1 -- 172.21.15.121:0/3709502448 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69e4010830 con 0x7f69f006ddc0 2024-09-17T03:39:25.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.610+0000 7f69ea000640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f69d4078bc0 0x7f69d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:25.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.610+0000 7f69ea000640 1 -- 172.21.15.121:0/3709502448 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5619+0+0 (secure 0 0 0) 0x7f69e409bf20 con 0x7f69f006ddc0 2024-09-17T03:39:25.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.610+0000 7f69f5400640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f69d4078bc0 0x7f69d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:25.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.611+0000 7f69f5400640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f69d4078bc0 0x7f69d407b0d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f69f00ce400 tx=0x7f69e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:25.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.613+0000 7f69ea000640 1 -- 172.21.15.121:0/3709502448 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f69e4063d40 con 0x7f69f006ddc0 2024-09-17T03:39:25.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:25.795+0000 7f69f8800640 1 -- 172.21.15.121:0/3709502448 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f69f00ce430 con 0x7f69f006ddc0 2024-09-17T03:39:26.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.339+0000 7f69ea000640 1 -- 172.21.15.121:0/3709502448 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) ==== 170+0+0 (secure 0 0 0) 0x7f69e4068770 con 0x7f69f006ddc0 2024-09-17T03:39:26.340 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-17T03:39:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 -- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f69d4078bc0 msgr2=0x7f69d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f69d4078bc0 0x7f69d407b0d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f69f00ce400 tx=0x7f69e0009040 comp rx=0 tx=0).stop 2024-09-17T03:39:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 -- 172.21.15.121:0/3709502448 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f006ddc0 msgr2=0x7f69f0074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f006ddc0 0x7f69f0074790 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f69e400e790 tx=0x7f69e400ec50 comp rx=0 tx=0).stop 2024-09-17T03:39:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 -- 172.21.15.121:0/3709502448 shutdown_connections 2024-09-17T03:39:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69f0155fb0 0x7f69f015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69f015a3e0 0x7f69f015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f69d4078bc0 0x7f69d407b0d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 --2- 172.21.15.121:0/3709502448 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f006ddc0 0x7f69f0074790 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:26.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 -- 172.21.15.121:0/3709502448 >> 172.21.15.121:0/3709502448 conn(0x7f69f00b3580 msgr2=0x7f69f00b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 -- 172.21.15.121:0/3709502448 shutdown_connections 2024-09-17T03:39:26.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.343+0000 7f69f8800640 1 -- 172.21.15.121:0/3709502448 wait complete. 2024-09-17T03:39:26.379 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:39:26.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.604+0000 7f8b61000640 1 -- 172.21.15.121:0/3046729667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b40004800 msgr2=0x7f8b40004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:26.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.604+0000 7f8b61000640 1 --2- 172.21.15.121:0/3046729667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b40004800 0x7f8b40004c10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8b44006f60 tx=0x7f8b40005830 comp rx=0 tx=0).stop 2024-09-17T03:39:26.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.604+0000 7f8b5be00640 1 -- 172.21.15.121:0/3046729667 reap_dead start 2024-09-17T03:39:26.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.605+0000 7f8b61000640 1 -- 172.21.15.121:0/3046729667 shutdown_connections 2024-09-17T03:39:26.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.605+0000 7f8b61000640 1 -- 172.21.15.121:0/3046729667 >> 172.21.15.121:0/3046729667 conn(0x7f8b5c0d07f0 msgr2=0x7f8b5c0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:26.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.605+0000 7f8b61000640 1 -- 172.21.15.121:0/3046729667 shutdown_connections 2024-09-17T03:39:26.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.605+0000 7f8b61000640 1 -- 172.21.15.121:0/3046729667 wait complete. 2024-09-17T03:39:26.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.607+0000 7f8b61000640 1 Processor -- start 2024-09-17T03:39:26.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.607+0000 7f8b61000640 1 -- start start 2024-09-17T03:39:26.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.608+0000 7f8b61000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b40004800 0x7f8b5c153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:26.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.608+0000 7f8b61000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b5c1440e0 0x7f8b5c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:26.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b61000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b5c1432c0 0x7f8b5c1436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:26.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b61000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c1655b0 con 0x7f8b40004800 2024-09-17T03:39:26.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b61000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c165430 con 0x7f8b5c1432c0 2024-09-17T03:39:26.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b61000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5c165730 con 0x7f8b5c1440e0 2024-09-17T03:39:26.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b5b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b40004800 0x7f8b5c153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b5b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b40004800 0x7f8b5c153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47578/0 (socket says 172.21.15.121:47578) 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b5b400640 1 -- 172.21.15.121:0/875927070 learned_addr learned my addr 172.21.15.121:0/875927070 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b53e00640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b5c1440e0 0x7f8b5c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b5b400640 1 -- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b5c1440e0 msgr2=0x7f8b5c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b5b400640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b5c1440e0 0x7f8b5c0cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b5be00640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b5c1432c0 0x7f8b5c1436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b5b400640 1 -- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b5c1432c0 msgr2=0x7f8b5c1436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b5b400640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b5c1432c0 0x7f8b5c1436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b5b400640 1 -- 172.21.15.121:0/875927070 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c142220 con 0x7f8b40004800 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b53e00640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b5c1440e0 0x7f8b5c0cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:26.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.609+0000 7f8b5be00640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b5c1432c0 0x7f8b5c1436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:26.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.610+0000 7f8b5b400640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b40004800 0x7f8b5c153400 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c003dd0 tx=0x7f8b4c0017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:26.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.610+0000 7f8b53400640 1 -- 172.21.15.121:0/875927070 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c011640 con 0x7f8b40004800 2024-09-17T03:39:26.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.610+0000 7f8b53400640 1 -- 172.21.15.121:0/875927070 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b4c016020 con 0x7f8b40004800 2024-09-17T03:39:26.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.610+0000 7f8b53400640 1 -- 172.21.15.121:0/875927070 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c011aa0 con 0x7f8b40004800 2024-09-17T03:39:26.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.610+0000 7f8b61000640 1 -- 172.21.15.121:0/875927070 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c142500 con 0x7f8b40004800 2024-09-17T03:39:26.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.610+0000 7f8b61000640 1 -- 172.21.15.121:0/875927070 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c142ac0 con 0x7f8b40004800 2024-09-17T03:39:26.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.611+0000 7f8b61000640 1 -- 172.21.15.121:0/875927070 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5c15ca70 con 0x7f8b40004800 2024-09-17T03:39:26.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.613+0000 7f8b53400640 1 -- 172.21.15.121:0/875927070 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b4c011c40 con 0x7f8b40004800 2024-09-17T03:39:26.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.613+0000 7f8b53400640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8b38078b90 0x7f8b3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:26.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.614+0000 7f8b53400640 1 -- 172.21.15.121:0/875927070 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6001+0+0 (secure 0 0 0) 0x7f8b4c09bc00 con 0x7f8b40004800 2024-09-17T03:39:26.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.614+0000 7f8b53e00640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8b38078b90 0x7f8b3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:26.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.615+0000 7f8b53e00640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8b38078b90 0x7f8b3807b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8b44033000 tx=0x7f8b4402d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:26.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.619+0000 7f8b53400640 1 -- 172.21.15.121:0/875927070 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b4c020020 con 0x7f8b40004800 2024-09-17T03:39:26.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:26.836+0000 7f8b61000640 1 -- 172.21.15.121:0/875927070 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8b5c075a70 con 0x7f8b40004800 2024-09-17T03:39:27.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.371+0000 7f8b53400640 1 -- 172.21.15.121:0/875927070 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v55) ==== 174+0+0 (secure 0 0 0) 0x7f8b4c063f00 con 0x7f8b40004800 2024-09-17T03:39:27.371 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 13 and data pool 14 2024-09-17T03:39:27.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.375+0000 7f8b61000640 1 -- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8b38078b90 msgr2=0x7f8b3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:27.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.375+0000 7f8b61000640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8b38078b90 0x7f8b3807b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8b44033000 tx=0x7f8b4402d000 comp rx=0 tx=0).stop 2024-09-17T03:39:27.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.375+0000 7f8b61000640 1 -- 172.21.15.121:0/875927070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b40004800 msgr2=0x7f8b5c153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:27.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.375+0000 7f8b61000640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b40004800 0x7f8b5c153400 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c003dd0 tx=0x7f8b4c0017f0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.375+0000 7f8b61000640 1 -- 172.21.15.121:0/875927070 shutdown_connections 2024-09-17T03:39:27.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.375+0000 7f8b61000640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b5c1432c0 0x7f8b5c1436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.375+0000 7f8b61000640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b5c1440e0 0x7f8b5c0cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.375+0000 7f8b61000640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8b38078b90 0x7f8b3807b0a0 secure :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8b44033000 tx=0x7f8b4402d000 comp rx=0 tx=0).stop 2024-09-17T03:39:27.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.375+0000 7f8b61000640 1 --2- 172.21.15.121:0/875927070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b40004800 0x7f8b5c153400 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.375+0000 7f8b61000640 1 -- 172.21.15.121:0/875927070 >> 172.21.15.121:0/875927070 conn(0x7f8b5c0d07f0 msgr2=0x7f8b5c0ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:27.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.378+0000 7f8b61000640 1 -- 172.21.15.121:0/875927070 shutdown_connections 2024-09-17T03:39:27.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.380+0000 7f8b61000640 1 -- 172.21.15.121:0/875927070 wait complete. 2024-09-17T03:39:27.415 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.635+0000 7fd40b200640 1 -- 172.21.15.121:0/3076961822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c0cf2f0 msgr2=0x7fd40c0cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.635+0000 7fd40b200640 1 --2- 172.21.15.121:0/3076961822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c0cf2f0 0x7fd40c0cf700 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4005fd0 tx=0x7fd3f402a540 comp rx=0 tx=0).stop 2024-09-17T03:39:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.635+0000 7fd40b200640 1 -- 172.21.15.121:0/3076961822 shutdown_connections 2024-09-17T03:39:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.635+0000 7fd40b200640 1 --2- 172.21.15.121:0/3076961822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c0cf2f0 0x7fd40c0cf700 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.635+0000 7fd40b200640 1 --2- 172.21.15.121:0/3076961822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c162df0 0x7fd40c15e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.635+0000 7fd40b200640 1 -- 172.21.15.121:0/3076961822 >> 172.21.15.121:0/3076961822 conn(0x7fd40c0d16a0 msgr2=0x7fd40c0b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:27.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.635+0000 7fd40b200640 1 -- 172.21.15.121:0/3076961822 shutdown_connections 2024-09-17T03:39:27.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.635+0000 7fd40b200640 1 -- 172.21.15.121:0/3076961822 wait complete. 2024-09-17T03:39:27.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.637+0000 7fd40b200640 1 Processor -- start 2024-09-17T03:39:27.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.637+0000 7fd40b200640 1 -- start start 2024-09-17T03:39:27.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd40b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd40c0b7980 0x7fd40c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd40b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c0cf2f0 0x7fd40c14f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd40b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c162df0 0x7fd40c14fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd40b200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c0d3160 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd40b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c0d2fe0 con 0x7fd40c0b7980 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd40b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd40c0d32e0 con 0x7fd40c162df0 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd409400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c0cf2f0 0x7fd40c14f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd409400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c0cf2f0 0x7fd40c14f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47594/0 (socket says 172.21.15.121:47594) 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd409400640 1 -- 172.21.15.121:0/1250840366 learned_addr learned my addr 172.21.15.121:0/1250840366 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd409e00640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd40c0b7980 0x7fd40c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.639+0000 7fd40a800640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c162df0 0x7fd40c14fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.640+0000 7fd409400640 1 -- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c162df0 msgr2=0x7fd40c14fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:27.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.640+0000 7fd409400640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c162df0 0x7fd40c14fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.640+0000 7fd409400640 1 -- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd40c0b7980 msgr2=0x7fd40c0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:27.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.640+0000 7fd409400640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd40c0b7980 0x7fd40c0b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.640+0000 7fd409400640 1 -- 172.21.15.121:0/1250840366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c0acab0 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.640+0000 7fd409400640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c0cf2f0 0x7fd40c14f6a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4034040 tx=0x7fd3f40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:27.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.640+0000 7fd402000640 1 -- 172.21.15.121:0/1250840366 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f403e030 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.640+0000 7fd402000640 1 -- 172.21.15.121:0/1250840366 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3f4003d90 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.640+0000 7fd40b200640 1 -- 172.21.15.121:0/1250840366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40c14d640 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.640+0000 7fd402000640 1 -- 172.21.15.121:0/1250840366 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4035040 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.641+0000 7fd40b200640 1 -- 172.21.15.121:0/1250840366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40c14dc00 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.641+0000 7fd40b200640 1 -- 172.21.15.121:0/1250840366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40c0ac820 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.643+0000 7fd402000640 1 -- 172.21.15.121:0/1250840366 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3f4041030 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.644+0000 7fd402000640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e8078b90 0x7fd3e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:27.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.644+0000 7fd402000640 1 -- 172.21.15.121:0/1250840366 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fd3f40bb690 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.644+0000 7fd409e00640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e8078b90 0x7fd3e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:27.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.645+0000 7fd409e00640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e8078b90 0x7fd3e807b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004630 tx=0x7fd3fc00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:27.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.648+0000 7fd402000640 1 -- 172.21.15.121:0/1250840366 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd3f4083250 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.833+0000 7fd40b200640 1 -- 172.21.15.121:0/1250840366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd40c0b8ec0 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.834+0000 7fd402000640 1 -- 172.21.15.121:0/1250840366 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+17066 (secure 0 0 0) 0x7fd40c0b8ec0 con 0x7fd40c0cf2f0 2024-09-17T03:39:27.834 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:27.834 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":86,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:26.837897+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:39:24.742016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-17T03:39:25.808448+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:27.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.836+0000 7fd40b200640 1 -- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e8078b90 msgr2=0x7fd3e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:27.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.836+0000 7fd40b200640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e8078b90 0x7fd3e807b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004630 tx=0x7fd3fc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.836+0000 7fd40b200640 1 -- 172.21.15.121:0/1250840366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c0cf2f0 msgr2=0x7fd40c14f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:27.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.836+0000 7fd40b200640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c0cf2f0 0x7fd40c14f6a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4034040 tx=0x7fd3f40038a0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.837+0000 7fd40b200640 1 -- 172.21.15.121:0/1250840366 shutdown_connections 2024-09-17T03:39:27.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.837+0000 7fd40b200640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd40c162df0 0x7fd40c14fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.837+0000 7fd40b200640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd3e8078b90 0x7fd3e807b0a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.837+0000 7fd40b200640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c0cf2f0 0x7fd40c14f6a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.837+0000 7fd40b200640 1 --2- 172.21.15.121:0/1250840366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd40c0b7980 0x7fd40c0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:27.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.837+0000 7fd40b200640 1 -- 172.21.15.121:0/1250840366 >> 172.21.15.121:0/1250840366 conn(0x7fd40c0d16a0 msgr2=0x7fd40c15f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:27.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.837+0000 7fd40b200640 1 -- 172.21.15.121:0/1250840366 shutdown_connections 2024-09-17T03:39:27.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:27.837+0000 7fd40b200640 1 -- 172.21.15.121:0/1250840366 wait complete. 2024-09-17T03:39:27.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:28.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.083+0000 7f4c82600640 1 -- 172.21.15.121:0/2650400220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c64004d40 msgr2=0x7f4c640051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:28.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.083+0000 7f4c82600640 1 --2- 172.21.15.121:0/2650400220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c64004d40 0x7f4c640051f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0ce420 tx=0x7f4c64005830 comp rx=0 tx=0).stop 2024-09-17T03:39:28.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.083+0000 7f4c81c00640 1 -- 172.21.15.121:0/2650400220 reap_dead start 2024-09-17T03:39:28.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.083+0000 7f4c82600640 1 -- 172.21.15.121:0/2650400220 shutdown_connections 2024-09-17T03:39:28.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.083+0000 7f4c82600640 1 -- 172.21.15.121:0/2650400220 >> 172.21.15.121:0/2650400220 conn(0x7f4c7c073640 msgr2=0x7f4c7c073a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:28.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.083+0000 7f4c82600640 1 -- 172.21.15.121:0/2650400220 shutdown_connections 2024-09-17T03:39:28.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.083+0000 7f4c82600640 1 -- 172.21.15.121:0/2650400220 wait complete. 2024-09-17T03:39:28.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.086+0000 7f4c82600640 1 Processor -- start 2024-09-17T03:39:28.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.086+0000 7f4c82600640 1 -- start start 2024-09-17T03:39:28.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.087+0000 7f4c82600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c64004d40 0x7f4c7c15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:28.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.087+0000 7f4c82600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c1511c0 0x7f4c7c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:28.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.087+0000 7f4c82600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c7c1515d0 0x7f4c7c06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.087+0000 7f4c82600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c0b4300 con 0x7f4c7c1511c0 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.087+0000 7f4c82600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c071ef0 con 0x7f4c64004d40 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.087+0000 7f4c82600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c0b4480 con 0x7f4c7c1515d0 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.087+0000 7f4c7be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c1511c0 0x7f4c7c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.087+0000 7f4c7be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c1511c0 0x7f4c7c06d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47612/0 (socket says 172.21.15.121:47612) 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c7be00640 1 -- 172.21.15.121:0/1289375902 learned_addr learned my addr 172.21.15.121:0/1289375902 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c81c00640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c7c1515d0 0x7f4c7c06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c81200640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c64004d40 0x7f4c7c15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c7be00640 1 -- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c7c1515d0 msgr2=0x7f4c7c06dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c7be00640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c7c1515d0 0x7f4c7c06dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c7be00640 1 -- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c64004d40 msgr2=0x7f4c7c15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c7be00640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c64004d40 0x7f4c7c15f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c7be00640 1 -- 172.21.15.121:0/1289375902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c1f87d0 con 0x7f4c7c1511c0 2024-09-17T03:39:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c81200640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c64004d40 0x7f4c7c15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c7be00640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c1511c0 0x7f4c7c06d670 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f4c68004e20 tx=0x7f4c68001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.088+0000 7f4c78c00640 1 -- 172.21.15.121:0/1289375902 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68015020 con 0x7f4c7c1511c0 2024-09-17T03:39:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.089+0000 7f4c78c00640 1 -- 172.21.15.121:0/1289375902 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c68011960 con 0x7f4c7c1511c0 2024-09-17T03:39:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.089+0000 7f4c78c00640 1 -- 172.21.15.121:0/1289375902 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68011d70 con 0x7f4c7c1511c0 2024-09-17T03:39:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.089+0000 7f4c82600640 1 -- 172.21.15.121:0/1289375902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c1f8a70 con 0x7f4c7c1511c0 2024-09-17T03:39:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.089+0000 7f4c82600640 1 -- 172.21.15.121:0/1289375902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1f9030 con 0x7f4c7c1511c0 2024-09-17T03:39:28.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.090+0000 7f4c82600640 1 -- 172.21.15.121:0/1289375902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7c15f710 con 0x7f4c7c1511c0 2024-09-17T03:39:28.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.091+0000 7f4c78c00640 1 -- 172.21.15.121:0/1289375902 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c68018020 con 0x7f4c7c1511c0 2024-09-17T03:39:28.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.092+0000 7f4c78c00640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c5c078b90 0x7f4c5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:28.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.092+0000 7f4c78c00640 1 -- 172.21.15.121:0/1289375902 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f4c6809b860 con 0x7f4c7c1511c0 2024-09-17T03:39:28.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.093+0000 7f4c81200640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c5c078b90 0x7f4c5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:28.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.093+0000 7f4c81200640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c5c078b90 0x7f4c5c07b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009c50 tx=0x7f4c70005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:28.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.096+0000 7f4c78c00640 1 -- 172.21.15.121:0/1289375902 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c6801f020 con 0x7f4c7c1511c0 2024-09-17T03:39:28.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.280+0000 7f4c82600640 1 -- 172.21.15.121:0/1289375902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c7c0b3bf0 con 0x7f4c7c1511c0 2024-09-17T03:39:28.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.281+0000 7f4c78c00640 1 -- 172.21.15.121:0/1289375902 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+17066 (secure 0 0 0) 0x7f4c68063b10 con 0x7f4c7c1511c0 2024-09-17T03:39:28.281 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:28.281 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":86,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:26.837897+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:39:24.742016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-17T03:39:25.808448+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:28.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.283+0000 7f4c82600640 1 -- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c5c078b90 msgr2=0x7f4c5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:28.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.283+0000 7f4c82600640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c5c078b90 0x7f4c5c07b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009c50 tx=0x7f4c70005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:28.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.283+0000 7f4c82600640 1 -- 172.21.15.121:0/1289375902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c1511c0 msgr2=0x7f4c7c06d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:28.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.283+0000 7f4c82600640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c1511c0 0x7f4c7c06d670 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f4c68004e20 tx=0x7f4c68001630 comp rx=0 tx=0).stop 2024-09-17T03:39:28.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.284+0000 7f4c82600640 1 -- 172.21.15.121:0/1289375902 shutdown_connections 2024-09-17T03:39:28.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.284+0000 7f4c82600640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c7c1515d0 0x7f4c7c06dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:28.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.284+0000 7f4c82600640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4c5c078b90 0x7f4c5c07b0a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:28.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.284+0000 7f4c82600640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c1511c0 0x7f4c7c06d670 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:28.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.284+0000 7f4c82600640 1 --2- 172.21.15.121:0/1289375902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c64004d40 0x7f4c7c15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:28.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.284+0000 7f4c82600640 1 -- 172.21.15.121:0/1289375902 >> 172.21.15.121:0/1289375902 conn(0x7f4c7c073640 msgr2=0x7f4c7c15b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:28.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.284+0000 7f4c82600640 1 -- 172.21.15.121:0/1289375902 shutdown_connections 2024-09-17T03:39:28.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.284+0000 7f4c82600640 1 -- 172.21.15.121:0/1289375902 wait complete. 2024-09-17T03:39:28.309 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:39:28.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.535+0000 7fefd3800640 1 -- 172.21.15.121:0/1040104587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefcc0d0060 msgr2=0x7fefcc15d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:28.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.535+0000 7fefd3800640 1 --2- 172.21.15.121:0/1040104587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefcc0d0060 0x7fefcc15d7c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fefc4005fd0 tx=0x7fefc402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:39:28.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.535+0000 7fefd3800640 1 -- 172.21.15.121:0/1040104587 shutdown_connections 2024-09-17T03:39:28.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.535+0000 7fefd3800640 1 --2- 172.21.15.121:0/1040104587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefcc0d0060 0x7fefcc15d7c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:28.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.535+0000 7fefd3800640 1 -- 172.21.15.121:0/1040104587 >> 172.21.15.121:0/1040104587 conn(0x7fefcc0d05f0 msgr2=0x7fefcc0d0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:28.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.535+0000 7fefd3800640 1 -- 172.21.15.121:0/1040104587 shutdown_connections 2024-09-17T03:39:28.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.535+0000 7fefd3800640 1 -- 172.21.15.121:0/1040104587 wait complete. 2024-09-17T03:39:28.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.537+0000 7fefd3800640 1 Processor -- start 2024-09-17T03:39:28.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.537+0000 7fefd3800640 1 -- start start 2024-09-17T03:39:28.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd3800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefcc06dad0 0x7fefcc157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:28.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd3800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefcc0d0060 0x7fefcc151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:28.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd3800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefcc1519d0 0x7fefcc151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:28.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd3800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc0b3ef0 con 0x7fefcc06dad0 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd3800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc0b3d70 con 0x7fefcc1519d0 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd3800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fefcc0b4070 con 0x7fefcc0d0060 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefcc06dad0 0x7fefcc157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd0e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefcc06dad0 0x7fefcc157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47628/0 (socket says 172.21.15.121:47628) 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd0e00640 1 -- 172.21.15.121:0/2668435567 learned_addr learned my addr 172.21.15.121:0/2668435567 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd1800640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefcc1519d0 0x7fefcc151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefcbe00640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefcc0d0060 0x7fefcc151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.539+0000 7fefd0e00640 1 -- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefcc0d0060 msgr2=0x7fefcc151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefd0e00640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefcc0d0060 0x7fefcc151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefd0e00640 1 -- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefcc1519d0 msgr2=0x7fefcc151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefd0e00640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefcc1519d0 0x7fefcc151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefd0e00640 1 -- 172.21.15.121:0/2668435567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefcc152320 con 0x7fefcc06dad0 2024-09-17T03:39:28.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefd1800640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefcc1519d0 0x7fefcc151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:28.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefd0e00640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefcc06dad0 0x7fefcc157800 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fefc0001220 tx=0x7fefc000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:28.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefc8c00640 1 -- 172.21.15.121:0/2668435567 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0011790 con 0x7fefcc06dad0 2024-09-17T03:39:28.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefc8c00640 1 -- 172.21.15.121:0/2668435567 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefc0017070 con 0x7fefcc06dad0 2024-09-17T03:39:28.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefd3800640 1 -- 172.21.15.121:0/2668435567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefcc157d40 con 0x7fefcc06dad0 2024-09-17T03:39:28.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefc8c00640 1 -- 172.21.15.121:0/2668435567 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0011cc0 con 0x7fefcc06dad0 2024-09-17T03:39:28.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.540+0000 7fefd3800640 1 -- 172.21.15.121:0/2668435567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefcc1f48c0 con 0x7fefcc06dad0 2024-09-17T03:39:28.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.541+0000 7fefd3800640 1 -- 172.21.15.121:0/2668435567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefcc15d7c0 con 0x7fefcc06dad0 2024-09-17T03:39:28.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.543+0000 7fefc8c00640 1 -- 172.21.15.121:0/2668435567 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fefc001c460 con 0x7fefcc06dad0 2024-09-17T03:39:28.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.543+0000 7fefc8c00640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefac078b90 0x7fefac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:28.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.544+0000 7fefc8c00640 1 -- 172.21.15.121:0/2668435567 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fefc009ac90 con 0x7fefcc06dad0 2024-09-17T03:39:28.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.544+0000 7fefcbe00640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefac078b90 0x7fefac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:28.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.545+0000 7fefcbe00640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefac078b90 0x7fefac07b0a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fefb8007fd0 tx=0x7fefb8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:28.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.548+0000 7fefc8c00640 1 -- 172.21.15.121:0/2668435567 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fefcc152320 con 0x7fefcc06dad0 2024-09-17T03:39:28.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:28.766+0000 7fefd3800640 1 -- 172.21.15.121:0/2668435567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fefcc0b39e0 con 0x7fefcc06dad0 2024-09-17T03:39:29.322 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-17T03:39:29.322+0000 7f5782800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.383+0000 7fefc8c00640 1 -- 172.21.15.121:0/2668435567 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v58) ==== 118+0+0 (secure 0 0 0) 0x7fefc0062fd0 con 0x7fefcc06dad0 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.385+0000 7fefd3800640 1 -- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefac078b90 msgr2=0x7fefac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.385+0000 7fefd3800640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefac078b90 0x7fefac07b0a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fefb8007fd0 tx=0x7fefb8009040 comp rx=0 tx=0).stop 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.385+0000 7fefd3800640 1 -- 172.21.15.121:0/2668435567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefcc06dad0 msgr2=0x7fefcc157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.385+0000 7fefd3800640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefcc06dad0 0x7fefcc157800 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fefc0001220 tx=0x7fefc000c890 comp rx=0 tx=0).stop 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.386+0000 7fefd3800640 1 -- 172.21.15.121:0/2668435567 shutdown_connections 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.386+0000 7fefd3800640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fefcc1519d0 0x7fefcc151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.386+0000 7fefd3800640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fefcc0d0060 0x7fefcc151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.386+0000 7fefd3800640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fefac078b90 0x7fefac07b0a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.386+0000 7fefd3800640 1 --2- 172.21.15.121:0/2668435567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefcc06dad0 0x7fefcc157800 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.386+0000 7fefd3800640 1 -- 172.21.15.121:0/2668435567 >> 172.21.15.121:0/2668435567 conn(0x7fefcc0d05f0 msgr2=0x7fefcc15e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.386+0000 7fefd3800640 1 -- 172.21.15.121:0/2668435567 shutdown_connections 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.386+0000 7fefd3800640 1 -- 172.21.15.121:0/2668435567 wait complete. 2024-09-17T03:39:29.408 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:39:29.408 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:39:29.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.632+0000 7f36a6800640 1 -- 172.21.15.121:0/338940229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36a00cd180 msgr2=0x7f36a015d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.632+0000 7f36a6800640 1 --2- 172.21.15.121:0/338940229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36a00cd180 0x7f36a015d180 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f368c009900 tx=0x7f368c02a580 comp rx=0 tx=0).stop 2024-09-17T03:39:29.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.632+0000 7f36a6800640 1 -- 172.21.15.121:0/338940229 shutdown_connections 2024-09-17T03:39:29.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.632+0000 7f36a6800640 1 --2- 172.21.15.121:0/338940229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36a015d6c0 0x7f36a006d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.632+0000 7f36a6800640 1 --2- 172.21.15.121:0/338940229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36a00cd180 0x7f36a015d180 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.632+0000 7f36a6800640 1 -- 172.21.15.121:0/338940229 >> 172.21.15.121:0/338940229 conn(0x7f36a00d07f0 msgr2=0x7f36a00b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.632+0000 7f36a6800640 1 -- 172.21.15.121:0/338940229 shutdown_connections 2024-09-17T03:39:29.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.632+0000 7f36a6800640 1 -- 172.21.15.121:0/338940229 wait complete. 2024-09-17T03:39:29.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.635+0000 7f36a6800640 1 Processor -- start 2024-09-17T03:39:29.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.635+0000 7f36a6800640 1 -- start start 2024-09-17T03:39:29.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.636+0000 7f36a6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36a00b5250 0x7f36a014ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.636+0000 7f36a6800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36a00cd180 0x7f36a015e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.636+0000 7f36a6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36a015d6c0 0x7f36a015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.636+0000 7f36a6800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f36a006e010 con 0x7f36a00b5250 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.636+0000 7f36a6800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f36a006de90 con 0x7f36a015d6c0 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.636+0000 7f36a6800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f36a006e190 con 0x7f36a00cd180 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.636+0000 7f36a5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36a00b5250 0x7f36a014ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.636+0000 7f36a5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36a00b5250 0x7f36a014ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47642/0 (socket says 172.21.15.121:47642) 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.636+0000 7f36a5400640 1 -- 172.21.15.121:0/821090646 learned_addr learned my addr 172.21.15.121:0/821090646 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.636+0000 7f36a4a00640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36a00cd180 0x7f36a015e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f36a5e00640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36a015d6c0 0x7f36a015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f36a5400640 1 -- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36a00cd180 msgr2=0x7f36a015e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f36a5400640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36a00cd180 0x7f36a015e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f36a5400640 1 -- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36a015d6c0 msgr2=0x7f36a015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f36a5400640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36a015d6c0 0x7f36a015e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f36a5400640 1 -- 172.21.15.121:0/821090646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a01f8ef0 con 0x7f36a00b5250 2024-09-17T03:39:29.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f36a5400640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36a00b5250 0x7f36a014ff10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f369400c740 tx=0x7f369400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f369d600640 1 -- 172.21.15.121:0/821090646 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694003bc0 con 0x7f36a00b5250 2024-09-17T03:39:29.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f369d600640 1 -- 172.21.15.121:0/821090646 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f369400ce50 con 0x7f36a00b5250 2024-09-17T03:39:29.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f36a6800640 1 -- 172.21.15.121:0/821090646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a01f91d0 con 0x7f36a00b5250 2024-09-17T03:39:29.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.637+0000 7f369d600640 1 -- 172.21.15.121:0/821090646 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369400a850 con 0x7f36a00b5250 2024-09-17T03:39:29.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.638+0000 7f36a6800640 1 -- 172.21.15.121:0/821090646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a01f9790 con 0x7f36a00b5250 2024-09-17T03:39:29.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.639+0000 7f36a6800640 1 -- 172.21.15.121:0/821090646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a0069450 con 0x7f36a00b5250 2024-09-17T03:39:29.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.640+0000 7f369d600640 1 -- 172.21.15.121:0/821090646 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f369400a9f0 con 0x7f36a00b5250 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.641+0000 7f369d600640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3680078bc0 0x7f368007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.641+0000 7f369d600640 1 -- 172.21.15.121:0/821090646 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f369409ab30 con 0x7f36a00b5250 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.642+0000 7f36a4a00640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3680078bc0 0x7f368007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.643+0000 7f36a4a00640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3680078bc0 0x7f368007b0d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f368c033000 tx=0x7f368c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.646+0000 7f369d600640 1 -- 172.21.15.121:0/821090646 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36a0069450 con 0x7f36a00b5250 2024-09-17T03:39:29.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:29.864+0000 7f36a6800640 1 -- 172.21.15.121:0/821090646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f36a006e6b0 con 0x7f36a00b5250 2024-09-17T03:39:30.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.384+0000 7f369d600640 1 -- 172.21.15.121:0/821090646 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v59) ==== 122+0+0 (secure 0 0 0) 0x7f3694062820 con 0x7f36a00b5250 2024-09-17T03:39:30.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 -- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3680078bc0 msgr2=0x7f368007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:30.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3680078bc0 0x7f368007b0d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f368c033000 tx=0x7f368c004730 comp rx=0 tx=0).stop 2024-09-17T03:39:30.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 -- 172.21.15.121:0/821090646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36a00b5250 msgr2=0x7f36a014ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:30.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36a00b5250 0x7f36a014ff10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f369400c740 tx=0x7f369400cc00 comp rx=0 tx=0).stop 2024-09-17T03:39:30.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 -- 172.21.15.121:0/821090646 shutdown_connections 2024-09-17T03:39:30.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36a015d6c0 0x7f36a015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36a00cd180 0x7f36a015e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3680078bc0 0x7f368007b0d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 --2- 172.21.15.121:0/821090646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36a00b5250 0x7f36a014ff10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 -- 172.21.15.121:0/821090646 >> 172.21.15.121:0/821090646 conn(0x7f36a00d07f0 msgr2=0x7f36a015b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:30.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 -- 172.21.15.121:0/821090646 shutdown_connections 2024-09-17T03:39:30.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.388+0000 7f36a6800640 1 -- 172.21.15.121:0/821090646 wait complete. 2024-09-17T03:39:30.414 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:39:30.414 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:30.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.635+0000 7f02a7400640 1 -- 172.21.15.121:0/460111559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a015a3e0 msgr2=0x7f02a006d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:30.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.635+0000 7f02a7400640 1 --2- 172.21.15.121:0/460111559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a015a3e0 0x7f02a006d800 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0294009830 tx=0x7f029402a3f0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.635+0000 7f02a7400640 1 -- 172.21.15.121:0/460111559 shutdown_connections 2024-09-17T03:39:30.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.635+0000 7f02a7400640 1 --2- 172.21.15.121:0/460111559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a015a3e0 0x7f02a006d800 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.635+0000 7f02a7400640 1 -- 172.21.15.121:0/460111559 >> 172.21.15.121:0/460111559 conn(0x7f02a00b3580 msgr2=0x7f02a00b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:30.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.636+0000 7f02a7400640 1 -- 172.21.15.121:0/460111559 shutdown_connections 2024-09-17T03:39:30.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.636+0000 7f02a7400640 1 -- 172.21.15.121:0/460111559 wait complete. 2024-09-17T03:39:30.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.638+0000 7f02a7400640 1 Processor -- start 2024-09-17T03:39:30.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.638+0000 7f02a7400640 1 -- start start 2024-09-17T03:39:30.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.639+0000 7f02a7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a006ddc0 0x7f02a015c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:30.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.639+0000 7f02a7400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a015a3e0 0x7f02a00b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:30.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.639+0000 7f02a7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a00c7590 0x7f02a00746e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:30.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.639+0000 7f02a7400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f02a015d6b0 con 0x7f02a00c7590 2024-09-17T03:39:30.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.639+0000 7f02a7400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f02a015d530 con 0x7f02a015a3e0 2024-09-17T03:39:30.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.639+0000 7f02a7400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f02a015d830 con 0x7f02a006ddc0 2024-09-17T03:39:30.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a00c7590 0x7f02a00746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:30.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a4a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a006ddc0 0x7f02a015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:30.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a00c7590 0x7f02a00746e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47650/0 (socket says 172.21.15.121:47650) 2024-09-17T03:39:30.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a4a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a006ddc0 0x7f02a015c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:39192/0 (socket says 172.21.15.121:39192) 2024-09-17T03:39:30.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a5400640 1 -- 172.21.15.121:0/12514315 learned_addr learned my addr 172.21.15.121:0/12514315 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:30.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f029fe00640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a015a3e0 0x7f02a00b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:30.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a5400640 1 -- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a006ddc0 msgr2=0x7f02a015c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:30.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a5400640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a006ddc0 0x7f02a015c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a5400640 1 -- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a015a3e0 msgr2=0x7f02a00b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:30.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a5400640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a015a3e0 0x7f02a00b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a5400640 1 -- 172.21.15.121:0/12514315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a00736b0 con 0x7f02a00c7590 2024-09-17T03:39:30.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.640+0000 7f02a5400640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a00c7590 0x7f02a00746e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f029800ba10 tx=0x7f029800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:30.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.641+0000 7f029cc00640 1 -- 172.21.15.121:0/12514315 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298019070 con 0x7f02a00c7590 2024-09-17T03:39:30.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.641+0000 7f029cc00640 1 -- 172.21.15.121:0/12514315 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f029800cc30 con 0x7f02a00c7590 2024-09-17T03:39:30.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.641+0000 7f029cc00640 1 -- 172.21.15.121:0/12514315 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029800ce60 con 0x7f02a00c7590 2024-09-17T03:39:30.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.641+0000 7f02a7400640 1 -- 172.21.15.121:0/12514315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a0073920 con 0x7f02a00c7590 2024-09-17T03:39:30.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.641+0000 7f02a7400640 1 -- 172.21.15.121:0/12514315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a0073ee0 con 0x7f02a00c7590 2024-09-17T03:39:30.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.642+0000 7f02a7400640 1 -- 172.21.15.121:0/12514315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a006d800 con 0x7f02a00c7590 2024-09-17T03:39:30.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.643+0000 7f029cc00640 1 -- 172.21.15.121:0/12514315 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f029801c070 con 0x7f02a00c7590 2024-09-17T03:39:30.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.644+0000 7f029cc00640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0280078bc0 0x7f028007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:30.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.644+0000 7f029cc00640 1 -- 172.21.15.121:0/12514315 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f029809aa40 con 0x7f02a00c7590 2024-09-17T03:39:30.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.644+0000 7f02a4a00640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0280078bc0 0x7f028007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:30.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.645+0000 7f02a4a00640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0280078bc0 0x7f028007b0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0294034000 tx=0x7f0294004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:30.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.649+0000 7f029cc00640 1 -- 172.21.15.121:0/12514315 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0298062600 con 0x7f02a00c7590 2024-09-17T03:39:30.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.867+0000 7f02a7400640 1 -- 172.21.15.121:0/12514315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02a015c580 con 0x7f02a00c7590 2024-09-17T03:39:30.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.867+0000 7f029cc00640 1 -- 172.21.15.121:0/12514315 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5234 (secure 0 0 0) 0x7f0298067030 con 0x7f02a00c7590 2024-09-17T03:39:30.867 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:30.867 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":59,"btime":"2024-09-17T03:39:30:383696+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5711,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2693481679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2693481679},{"type":"v1","addr":"172.21.15.176:6837","nonce":2693481679}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6154,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2108616236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2108616236},{"type":"v1","addr":"172.21.15.121:6833","nonce":2108616236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/814740200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":814740200},{"type":"v1","addr":"172.21.15.176:6835","nonce":814740200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:26.837842+0000","modified":"2024-09-17T03:39:29.865327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6420":{"gid":6420,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3165070053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3165070053},{"type":"v1","addr":"172.21.15.121:6835","nonce":3165070053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6420,"qdb_cluster":[6420]},"id":6}]} 2024-09-17T03:39:30.867 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 59 2024-09-17T03:39:30.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.869+0000 7f02a7400640 1 -- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0280078bc0 msgr2=0x7f028007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.869+0000 7f02a7400640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0280078bc0 0x7f028007b0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0294034000 tx=0x7f0294004730 comp rx=0 tx=0).stop 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.869+0000 7f02a7400640 1 -- 172.21.15.121:0/12514315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a00c7590 msgr2=0x7f02a00746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.869+0000 7f02a7400640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a00c7590 0x7f02a00746e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f029800ba10 tx=0x7f029800bed0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.870+0000 7f02a7400640 1 -- 172.21.15.121:0/12514315 shutdown_connections 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.870+0000 7f02a7400640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0280078bc0 0x7f028007b0d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.870+0000 7f02a7400640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02a00c7590 0x7f02a00746e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.870+0000 7f02a7400640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02a015a3e0 0x7f02a00b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.870+0000 7f02a7400640 1 --2- 172.21.15.121:0/12514315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02a006ddc0 0x7f02a015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.870+0000 7f02a7400640 1 -- 172.21.15.121:0/12514315 >> 172.21.15.121:0/12514315 conn(0x7f02a00b3580 msgr2=0x7f02a0155670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.870+0000 7f02a7400640 1 -- 172.21.15.121:0/12514315 shutdown_connections 2024-09-17T03:39:30.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:30.870+0000 7f02a7400640 1 -- 172.21.15.121:0/12514315 wait complete. 2024-09-17T03:39:30.896 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:31.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.115+0000 7f560fa00640 1 -- 172.21.15.121:0/2488755037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56080d0cc0 msgr2=0x7f56081673d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:31.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.115+0000 7f560fa00640 1 --2- 172.21.15.121:0/2488755037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56080d0cc0 0x7f56081673d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5600005fd0 tx=0x7f560002a820 comp rx=0 tx=0).stop 2024-09-17T03:39:31.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.115+0000 7f560fa00640 1 -- 172.21.15.121:0/2488755037 shutdown_connections 2024-09-17T03:39:31.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.115+0000 7f560fa00640 1 --2- 172.21.15.121:0/2488755037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f56080d0cc0 0x7f56081673d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.115+0000 7f560fa00640 1 -- 172.21.15.121:0/2488755037 >> 172.21.15.121:0/2488755037 conn(0x7f56080b3580 msgr2=0x7f56080b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:31.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.115+0000 7f560fa00640 1 -- 172.21.15.121:0/2488755037 shutdown_connections 2024-09-17T03:39:31.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.115+0000 7f560fa00640 1 -- 172.21.15.121:0/2488755037 wait complete. 2024-09-17T03:39:31.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.118+0000 7f560fa00640 1 Processor -- start 2024-09-17T03:39:31.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.118+0000 7f560fa00640 1 -- start start 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.119+0000 7f560fa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f560806d800 0x7f56081542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.119+0000 7f560fa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f560815a3e0 0x7f56081f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.119+0000 7f560fa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56081f9690 0x7f56081f9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.119+0000 7f560fa00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5608167ca0 con 0x7f560815a3e0 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.119+0000 7f560fa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5608167b20 con 0x7f56081f9690 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.119+0000 7f560fa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5608167e20 con 0x7f560806d800 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.119+0000 7f5607e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f560815a3e0 0x7f56081f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.119+0000 7f5607e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f560815a3e0 0x7f56081f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47664/0 (socket says 172.21.15.121:47664) 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.119+0000 7f5607e00640 1 -- 172.21.15.121:0/135860359 learned_addr learned my addr 172.21.15.121:0/135860359 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f560d000640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f560806d800 0x7f56081542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f560da00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56081f9690 0x7f56081f9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f5607e00640 1 -- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f560806d800 msgr2=0x7f56081542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:31.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f5607e00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f560806d800 0x7f56081542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f5607e00640 1 -- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56081f9690 msgr2=0x7f56081f9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:31.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f5607e00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56081f9690 0x7f56081f9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f5607e00640 1 -- 172.21.15.121:0/135860359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5608074cf0 con 0x7f560815a3e0 2024-09-17T03:39:31.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f5607e00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f560815a3e0 0x7f56081f9150 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c390 tx=0x7f55f400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f5604c00640 1 -- 172.21.15.121:0/135860359 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4017070 con 0x7f560815a3e0 2024-09-17T03:39:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f5604c00640 1 -- 172.21.15.121:0/135860359 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55f40035f0 con 0x7f560815a3e0 2024-09-17T03:39:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.120+0000 7f560fa00640 1 -- 172.21.15.121:0/135860359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5608074fd0 con 0x7f560815a3e0 2024-09-17T03:39:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.121+0000 7f5604c00640 1 -- 172.21.15.121:0/135860359 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4003a20 con 0x7f560815a3e0 2024-09-17T03:39:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.121+0000 7f560fa00640 1 -- 172.21.15.121:0/135860359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560815f160 con 0x7f560815a3e0 2024-09-17T03:39:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.122+0000 7f560fa00640 1 -- 172.21.15.121:0/135860359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560806ddc0 con 0x7f560815a3e0 2024-09-17T03:39:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.123+0000 7f5604c00640 1 -- 172.21.15.121:0/135860359 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55f401a070 con 0x7f560815a3e0 2024-09-17T03:39:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.124+0000 7f5604c00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f55e8078b90 0x7f55e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.124+0000 7f5604c00640 1 -- 172.21.15.121:0/135860359 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f55f409a180 con 0x7f560815a3e0 2024-09-17T03:39:31.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.124+0000 7f560d000640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f55e8078b90 0x7f55e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:31.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.125+0000 7f560d000640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f55e8078b90 0x7f55e807b0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f55fc007d60 tx=0x7f55fc007cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:31.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.128+0000 7f5604c00640 1 -- 172.21.15.121:0/135860359 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55f4061dd0 con 0x7f560815a3e0 2024-09-17T03:39:31.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.313+0000 7f560fa00640 1 -- 172.21.15.121:0/135860359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5608158fe0 con 0x7f560815a3e0 2024-09-17T03:39:31.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.315+0000 7f5604c00640 1 -- 172.21.15.121:0/135860359 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+17053 (secure 0 0 0) 0x7f55f4066800 con 0x7f560815a3e0 2024-09-17T03:39:31.315 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:31.315 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":87,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:28.371793+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:39:24.742016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-17T03:39:25.808448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:31.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 -- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f55e8078b90 msgr2=0x7f55e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f55e8078b90 0x7f55e807b0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f55fc007d60 tx=0x7f55fc007cf0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 -- 172.21.15.121:0/135860359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f560815a3e0 msgr2=0x7f56081f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f560815a3e0 0x7f56081f9150 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c390 tx=0x7f55f400c850 comp rx=0 tx=0).stop 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 -- 172.21.15.121:0/135860359 shutdown_connections 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56081f9690 0x7f56081f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f55e8078b90 0x7f55e807b0a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f560815a3e0 0x7f56081f9150 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 --2- 172.21.15.121:0/135860359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f560806d800 0x7f56081542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 -- 172.21.15.121:0/135860359 >> 172.21.15.121:0/135860359 conn(0x7f56080b3580 msgr2=0x7f560815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 -- 172.21.15.121:0/135860359 shutdown_connections 2024-09-17T03:39:31.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.317+0000 7f560fa00640 1 -- 172.21.15.121:0/135860359 wait complete. 2024-09-17T03:39:31.343 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:39:31.343 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:39:31.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.565+0000 7f6482200640 1 -- 172.21.15.121:0/2892582035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c06ee60 msgr2=0x7f647c0734a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:31.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.565+0000 7f6482200640 1 --2- 172.21.15.121:0/2892582035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c06ee60 0x7f647c0734a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f646c005fd0 tx=0x7f646c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.566+0000 7f6482200640 1 -- 172.21.15.121:0/2892582035 shutdown_connections 2024-09-17T03:39:31.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.566+0000 7f6482200640 1 --2- 172.21.15.121:0/2892582035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f647c0739e0 0x7f647c06df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.566+0000 7f6482200640 1 --2- 172.21.15.121:0/2892582035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c06ee60 0x7f647c0734a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.566+0000 7f6482200640 1 -- 172.21.15.121:0/2892582035 >> 172.21.15.121:0/2892582035 conn(0x7f647c0b2440 msgr2=0x7f647c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:31.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.566+0000 7f6482200640 1 -- 172.21.15.121:0/2892582035 shutdown_connections 2024-09-17T03:39:31.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.566+0000 7f6482200640 1 -- 172.21.15.121:0/2892582035 wait complete. 2024-09-17T03:39:31.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.568+0000 7f6482200640 1 Processor -- start 2024-09-17T03:39:31.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.568+0000 7f6482200640 1 -- start start 2024-09-17T03:39:31.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.569+0000 7f6482200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f647c06e460 0x7f647c0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:31.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.569+0000 7f6482200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0739e0 0x7f647c09d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:31.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.569+0000 7f6482200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f647c15ce40 0x7f647c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:31.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.569+0000 7f6482200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f647c06f660 con 0x7f647c15ce40 2024-09-17T03:39:31.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.569+0000 7f6482200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f647c06f4e0 con 0x7f647c0739e0 2024-09-17T03:39:31.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.569+0000 7f6482200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f647c06f7e0 con 0x7f647c06e460 2024-09-17T03:39:31.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6481800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f647c15ce40 0x7f647c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6481800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f647c15ce40 0x7f647c15d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47668/0 (socket says 172.21.15.121:47668) 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6481800640 1 -- 172.21.15.121:0/568919775 learned_addr learned my addr 172.21.15.121:0/568919775 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6480e00640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f647c06e460 0x7f647c0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6473e00640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0739e0 0x7f647c09d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6481800640 1 -- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f647c06e460 msgr2=0x7f647c0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6481800640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f647c06e460 0x7f647c0ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6481800640 1 -- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0739e0 msgr2=0x7f647c09d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6481800640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0739e0 0x7f647c09d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6481800640 1 -- 172.21.15.121:0/568919775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c15d790 con 0x7f647c15ce40 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.570+0000 7f6481800640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f647c15ce40 0x7f647c15d250 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6474002230 tx=0x7f647400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.571+0000 7f6479600640 1 -- 172.21.15.121:0/568919775 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474003b70 con 0x7f647c15ce40 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.571+0000 7f6479600640 1 -- 172.21.15.121:0/568919775 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6474003d10 con 0x7f647c15ce40 2024-09-17T03:39:31.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.571+0000 7f6482200640 1 -- 172.21.15.121:0/568919775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c1f8700 con 0x7f647c15ce40 2024-09-17T03:39:31.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.571+0000 7f6479600640 1 -- 172.21.15.121:0/568919775 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474005330 con 0x7f647c15ce40 2024-09-17T03:39:31.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.571+0000 7f6482200640 1 -- 172.21.15.121:0/568919775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c1f8ee0 con 0x7f647c15ce40 2024-09-17T03:39:31.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.572+0000 7f6482200640 1 -- 172.21.15.121:0/568919775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c1f8950 con 0x7f647c15ce40 2024-09-17T03:39:31.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.573+0000 7f6479600640 1 -- 172.21.15.121:0/568919775 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f64740056e0 con 0x7f647c15ce40 2024-09-17T03:39:31.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.574+0000 7f6479600640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6458078b90 0x7f645807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:31.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.574+0000 7f6479600640 1 -- 172.21.15.121:0/568919775 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f647409ae30 con 0x7f647c15ce40 2024-09-17T03:39:31.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.575+0000 7f6480e00640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6458078b90 0x7f645807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:31.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.576+0000 7f6480e00640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6458078b90 0x7f645807b0a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f646c033000 tx=0x7f646c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:31.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.579+0000 7f6479600640 1 -- 172.21.15.121:0/568919775 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f647c15d790 con 0x7f647c15ce40 2024-09-17T03:39:31.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.758+0000 7f6482200640 1 -- 172.21.15.121:0/568919775 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f647c0ca6b0 con 0x7f6458078b90 2024-09-17T03:39:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.764+0000 7f6479600640 1 -- 172.21.15.121:0/568919775 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252064 (secure 0 0 0) 0x7f646c0055c0 con 0x7f6458078b90 2024-09-17T03:39:31.766 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:31.767 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:39:31.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 -- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6458078b90 msgr2=0x7f645807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:31.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6458078b90 0x7f645807b0a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f646c033000 tx=0x7f646c004730 comp rx=0 tx=0).stop 2024-09-17T03:39:31.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 -- 172.21.15.121:0/568919775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f647c15ce40 msgr2=0x7f647c15d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:31.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f647c15ce40 0x7f647c15d250 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6474002230 tx=0x7f647400cb90 comp rx=0 tx=0).stop 2024-09-17T03:39:31.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 -- 172.21.15.121:0/568919775 shutdown_connections 2024-09-17T03:39:31.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6458078b90 0x7f645807b0a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f647c15ce40 0x7f647c15d250 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0739e0 0x7f647c09d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 --2- 172.21.15.121:0/568919775 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f647c06e460 0x7f647c0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:31.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 -- 172.21.15.121:0/568919775 >> 172.21.15.121:0/568919775 conn(0x7f647c0b2440 msgr2=0x7f647c154e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:31.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 -- 172.21.15.121:0/568919775 shutdown_connections 2024-09-17T03:39:31.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:31.768+0000 7f6482200640 1 -- 172.21.15.121:0/568919775 wait complete. 2024-09-17T03:39:31.790 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2024-09-17T03:39:31.339734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259036,"kb_used_data":9520,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715684,"statfs":{"total":773094113280,"available":772828860416,"internally_reserved":0,"allocated":9748480,"data_stored":5052129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.998115"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385547+0000","last_change":"2024-09-17T03:39:27.397982+0000","last_active":"2024-09-17T03:39:28.385547+0000","last_peered":"2024-09-17T03:39:28.385547+0000","last_clean":"2024-09-17T03:39:28.385547+0000","last_became_active":"2024-09-17T03:39:27.397674+0000","last_became_peered":"2024-09-17T03:39:27.397674+0000","last_unstale":"2024-09-17T03:39:28.385547+0000","last_undegraded":"2024-09-17T03:39:28.385547+0000","last_fullsized":"2024-09-17T03:39:28.385547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:16.050198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916514+0000","last_change":"2024-09-17T03:39:27.386337+0000","last_active":"2024-09-17T03:39:28.916514+0000","last_peered":"2024-09-17T03:39:28.916514+0000","last_clean":"2024-09-17T03:39:28.916514+0000","last_became_active":"2024-09-17T03:39:27.385858+0000","last_became_peered":"2024-09-17T03:39:27.385858+0000","last_unstale":"2024-09-17T03:39:28.916514+0000","last_undegraded":"2024-09-17T03:39:28.916514+0000","last_fullsized":"2024-09-17T03:39:28.916514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:25.851210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385373+0000","last_change":"2024-09-17T03:39:27.386285+0000","last_active":"2024-09-17T03:39:28.385373+0000","last_peered":"2024-09-17T03:39:28.385373+0000","last_clean":"2024-09-17T03:39:28.385373+0000","last_became_active":"2024-09-17T03:39:27.385903+0000","last_became_peered":"2024-09-17T03:39:27.385903+0000","last_unstale":"2024-09-17T03:39:28.385373+0000","last_undegraded":"2024-09-17T03:39:28.385373+0000","last_fullsized":"2024-09-17T03:39:28.385373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:41.951872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.383456+0000","last_change":"2024-09-17T03:39:27.374295+0000","last_active":"2024-09-17T03:39:28.383456+0000","last_peered":"2024-09-17T03:39:28.383456+0000","last_clean":"2024-09-17T03:39:28.383456+0000","last_became_active":"2024-09-17T03:39:27.372759+0000","last_became_peered":"2024-09-17T03:39:27.372759+0000","last_unstale":"2024-09-17T03:39:28.383456+0000","last_undegraded":"2024-09-17T03:39:28.383456+0000","last_fullsized":"2024-09-17T03:39:28.383456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:29.657096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916460+0000","last_change":"2024-09-17T03:39:27.383140+0000","last_active":"2024-09-17T03:39:28.916460+0000","last_peered":"2024-09-17T03:39:28.916460+0000","last_clean":"2024-09-17T03:39:28.916460+0000","last_became_active":"2024-09-17T03:39:27.382509+0000","last_became_peered":"2024-09-17T03:39:27.382509+0000","last_unstale":"2024-09-17T03:39:28.916460+0000","last_undegraded":"2024-09-17T03:39:28.916460+0000","last_fullsized":"2024-09-17T03:39:28.916460+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:29.963365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.398051+0000","last_change":"2024-09-17T03:39:27.392641+0000","last_active":"2024-09-17T03:39:27.398051+0000","last_peered":"2024-09-17T03:39:27.398051+0000","last_clean":"2024-09-17T03:39:27.398051+0000","last_became_active":"2024-09-17T03:39:27.391291+0000","last_became_peered":"2024-09-17T03:39:27.391291+0000","last_unstale":"2024-09-17T03:39:27.398051+0000","last_undegraded":"2024-09-17T03:39:27.398051+0000","last_fullsized":"2024-09-17T03:39:27.398051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:14.731864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462048+0000","last_change":"2024-09-17T03:39:27.396407+0000","last_active":"2024-09-17T03:39:28.462048+0000","last_peered":"2024-09-17T03:39:28.462048+0000","last_clean":"2024-09-17T03:39:28.462048+0000","last_became_active":"2024-09-17T03:39:27.396203+0000","last_became_peered":"2024-09-17T03:39:27.396203+0000","last_unstale":"2024-09-17T03:39:28.462048+0000","last_undegraded":"2024-09-17T03:39:28.462048+0000","last_fullsized":"2024-09-17T03:39:28.462048+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:28.523962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.393143+0000","last_change":"2024-09-17T03:39:27.385894+0000","last_active":"2024-09-17T03:39:27.393143+0000","last_peered":"2024-09-17T03:39:27.393143+0000","last_clean":"2024-09-17T03:39:27.393143+0000","last_became_active":"2024-09-17T03:39:27.385056+0000","last_became_peered":"2024-09-17T03:39:27.385056+0000","last_unstale":"2024-09-17T03:39:27.393143+0000","last_undegraded":"2024-09-17T03:39:27.393143+0000","last_fullsized":"2024-09-17T03:39:27.393143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:49.272666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462302+0000","last_change":"2024-09-17T03:39:27.382203+0000","last_active":"2024-09-17T03:39:28.462302+0000","last_peered":"2024-09-17T03:39:28.462302+0000","last_clean":"2024-09-17T03:39:28.462302+0000","last_became_active":"2024-09-17T03:39:27.381857+0000","last_became_peered":"2024-09-17T03:39:27.381857+0000","last_unstale":"2024-09-17T03:39:28.462302+0000","last_undegraded":"2024-09-17T03:39:28.462302+0000","last_fullsized":"2024-09-17T03:39:28.462302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:47.210348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385478+0000","last_change":"2024-09-17T03:39:27.401284+0000","last_active":"2024-09-17T03:39:28.385478+0000","last_peered":"2024-09-17T03:39:28.385478+0000","last_clean":"2024-09-17T03:39:28.385478+0000","last_became_active":"2024-09-17T03:39:27.400969+0000","last_became_peered":"2024-09-17T03:39:27.400969+0000","last_unstale":"2024-09-17T03:39:28.385478+0000","last_undegraded":"2024-09-17T03:39:28.385478+0000","last_fullsized":"2024-09-17T03:39:28.385478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:40.283159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462150+0000","last_change":"2024-09-17T03:39:27.382535+0000","last_active":"2024-09-17T03:39:28.462150+0000","last_peered":"2024-09-17T03:39:28.462150+0000","last_clean":"2024-09-17T03:39:28.462150+0000","last_became_active":"2024-09-17T03:39:27.381402+0000","last_became_peered":"2024-09-17T03:39:27.381402+0000","last_unstale":"2024-09-17T03:39:28.462150+0000","last_undegraded":"2024-09-17T03:39:28.462150+0000","last_fullsized":"2024-09-17T03:39:28.462150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:41.434489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385454+0000","last_change":"2024-09-17T03:39:27.402378+0000","last_active":"2024-09-17T03:39:28.385454+0000","last_peered":"2024-09-17T03:39:28.385454+0000","last_clean":"2024-09-17T03:39:28.385454+0000","last_became_active":"2024-09-17T03:39:27.402077+0000","last_became_peered":"2024-09-17T03:39:27.402077+0000","last_unstale":"2024-09-17T03:39:28.385454+0000","last_undegraded":"2024-09-17T03:39:28.385454+0000","last_fullsized":"2024-09-17T03:39:28.385454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:19.530825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995071+0000","last_change":"2024-09-17T03:39:27.384268+0000","last_active":"2024-09-17T03:39:28.995071+0000","last_peered":"2024-09-17T03:39:28.995071+0000","last_clean":"2024-09-17T03:39:28.995071+0000","last_became_active":"2024-09-17T03:39:27.383965+0000","last_became_peered":"2024-09-17T03:39:27.383965+0000","last_unstale":"2024-09-17T03:39:28.995071+0000","last_undegraded":"2024-09-17T03:39:28.995071+0000","last_fullsized":"2024-09-17T03:39:28.995071+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:51.955957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995178+0000","last_change":"2024-09-17T03:39:27.373496+0000","last_active":"2024-09-17T03:39:28.995178+0000","last_peered":"2024-09-17T03:39:28.995178+0000","last_clean":"2024-09-17T03:39:28.995178+0000","last_became_active":"2024-09-17T03:39:27.373138+0000","last_became_peered":"2024-09-17T03:39:27.373138+0000","last_unstale":"2024-09-17T03:39:28.995178+0000","last_undegraded":"2024-09-17T03:39:28.995178+0000","last_fullsized":"2024-09-17T03:39:28.995178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:58.705353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.383287+0000","last_change":"2024-09-17T03:39:27.387416+0000","last_active":"2024-09-17T03:39:28.383287+0000","last_peered":"2024-09-17T03:39:28.383287+0000","last_clean":"2024-09-17T03:39:28.383287+0000","last_became_active":"2024-09-17T03:39:27.387037+0000","last_became_peered":"2024-09-17T03:39:27.387037+0000","last_unstale":"2024-09-17T03:39:28.383287+0000","last_undegraded":"2024-09-17T03:39:28.383287+0000","last_fullsized":"2024-09-17T03:39:28.383287+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:36.360576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.393091+0000","last_change":"2024-09-17T03:39:27.384584+0000","last_active":"2024-09-17T03:39:27.393091+0000","last_peered":"2024-09-17T03:39:27.393091+0000","last_clean":"2024-09-17T03:39:27.393091+0000","last_became_active":"2024-09-17T03:39:27.384264+0000","last_became_peered":"2024-09-17T03:39:27.384264+0000","last_unstale":"2024-09-17T03:39:27.393091+0000","last_undegraded":"2024-09-17T03:39:27.393091+0000","last_fullsized":"2024-09-17T03:39:27.393091+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:35.476750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.397818+0000","last_change":"2024-09-17T03:39:27.391345+0000","last_active":"2024-09-17T03:39:27.397818+0000","last_peered":"2024-09-17T03:39:27.397818+0000","last_clean":"2024-09-17T03:39:27.397818+0000","last_became_active":"2024-09-17T03:39:27.391010+0000","last_became_peered":"2024-09-17T03:39:27.391010+0000","last_unstale":"2024-09-17T03:39:27.397818+0000","last_undegraded":"2024-09-17T03:39:27.397818+0000","last_fullsized":"2024-09-17T03:39:27.397818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:16.121725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385500+0000","last_change":"2024-09-17T03:39:27.382184+0000","last_active":"2024-09-17T03:39:28.385500+0000","last_peered":"2024-09-17T03:39:28.385500+0000","last_clean":"2024-09-17T03:39:28.385500+0000","last_became_active":"2024-09-17T03:39:27.381864+0000","last_became_peered":"2024-09-17T03:39:27.381864+0000","last_unstale":"2024-09-17T03:39:28.385500+0000","last_undegraded":"2024-09-17T03:39:28.385500+0000","last_fullsized":"2024-09-17T03:39:28.385500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:06.594080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994819+0000","last_change":"2024-09-17T03:39:27.386474+0000","last_active":"2024-09-17T03:39:28.994819+0000","last_peered":"2024-09-17T03:39:28.994819+0000","last_clean":"2024-09-17T03:39:28.994819+0000","last_became_active":"2024-09-17T03:39:27.386163+0000","last_became_peered":"2024-09-17T03:39:27.386163+0000","last_unstale":"2024-09-17T03:39:28.994819+0000","last_undegraded":"2024-09-17T03:39:28.994819+0000","last_fullsized":"2024-09-17T03:39:28.994819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:09.704866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.392980+0000","last_change":"2024-09-17T03:39:27.389539+0000","last_active":"2024-09-17T03:39:27.392980+0000","last_peered":"2024-09-17T03:39:27.392980+0000","last_clean":"2024-09-17T03:39:27.392980+0000","last_became_active":"2024-09-17T03:39:27.389178+0000","last_became_peered":"2024-09-17T03:39:27.389178+0000","last_unstale":"2024-09-17T03:39:27.392980+0000","last_undegraded":"2024-09-17T03:39:27.392980+0000","last_fullsized":"2024-09-17T03:39:27.392980+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:47.625515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916461+0000","last_change":"2024-09-17T03:39:27.383499+0000","last_active":"2024-09-17T03:39:28.916461+0000","last_peered":"2024-09-17T03:39:28.916461+0000","last_clean":"2024-09-17T03:39:28.916461+0000","last_became_active":"2024-09-17T03:39:27.382876+0000","last_became_peered":"2024-09-17T03:39:27.382876+0000","last_unstale":"2024-09-17T03:39:28.916461+0000","last_undegraded":"2024-09-17T03:39:28.916461+0000","last_fullsized":"2024-09-17T03:39:28.916461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:34.015664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994997+0000","last_change":"2024-09-17T03:39:27.387278+0000","last_active":"2024-09-17T03:39:28.994997+0000","last_peered":"2024-09-17T03:39:28.994997+0000","last_clean":"2024-09-17T03:39:28.994997+0000","last_became_active":"2024-09-17T03:39:27.386953+0000","last_became_peered":"2024-09-17T03:39:27.386953+0000","last_unstale":"2024-09-17T03:39:28.994997+0000","last_undegraded":"2024-09-17T03:39:28.994997+0000","last_fullsized":"2024-09-17T03:39:28.994997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:57.549934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916418+0000","last_change":"2024-09-17T03:39:27.377433+0000","last_active":"2024-09-17T03:39:28.916418+0000","last_peered":"2024-09-17T03:39:28.916418+0000","last_clean":"2024-09-17T03:39:28.916418+0000","last_became_active":"2024-09-17T03:39:27.375989+0000","last_became_peered":"2024-09-17T03:39:27.375989+0000","last_unstale":"2024-09-17T03:39:28.916418+0000","last_undegraded":"2024-09-17T03:39:28.916418+0000","last_fullsized":"2024-09-17T03:39:28.916418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:53.015608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.382829+0000","last_change":"2024-09-17T03:39:27.387583+0000","last_active":"2024-09-17T03:39:28.382829+0000","last_peered":"2024-09-17T03:39:28.382829+0000","last_clean":"2024-09-17T03:39:28.382829+0000","last_became_active":"2024-09-17T03:39:27.387232+0000","last_became_peered":"2024-09-17T03:39:27.387232+0000","last_unstale":"2024-09-17T03:39:28.382829+0000","last_undegraded":"2024-09-17T03:39:28.382829+0000","last_fullsized":"2024-09-17T03:39:28.382829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:46.885989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916510+0000","last_change":"2024-09-17T03:39:27.380380+0000","last_active":"2024-09-17T03:39:28.916510+0000","last_peered":"2024-09-17T03:39:28.916510+0000","last_clean":"2024-09-17T03:39:28.916510+0000","last_became_active":"2024-09-17T03:39:27.379946+0000","last_became_peered":"2024-09-17T03:39:27.379946+0000","last_unstale":"2024-09-17T03:39:28.916510+0000","last_undegraded":"2024-09-17T03:39:28.916510+0000","last_fullsized":"2024-09-17T03:39:28.916510+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:57.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916614+0000","last_change":"2024-09-17T03:39:27.383061+0000","last_active":"2024-09-17T03:39:28.916614+0000","last_peered":"2024-09-17T03:39:28.916614+0000","last_clean":"2024-09-17T03:39:28.916614+0000","last_became_active":"2024-09-17T03:39:27.379936+0000","last_became_peered":"2024-09-17T03:39:27.379936+0000","last_unstale":"2024-09-17T03:39:28.916614+0000","last_undegraded":"2024-09-17T03:39:28.916614+0000","last_fullsized":"2024-09-17T03:39:28.916614+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:22.783665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385486+0000","last_change":"2024-09-17T03:39:27.383343+0000","last_active":"2024-09-17T03:39:28.385486+0000","last_peered":"2024-09-17T03:39:28.385486+0000","last_clean":"2024-09-17T03:39:28.385486+0000","last_became_active":"2024-09-17T03:39:27.382793+0000","last_became_peered":"2024-09-17T03:39:27.382793+0000","last_unstale":"2024-09-17T03:39:28.385486+0000","last_undegraded":"2024-09-17T03:39:28.385486+0000","last_fullsized":"2024-09-17T03:39:28.385486+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:56.396187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995184+0000","last_change":"2024-09-17T03:39:27.395432+0000","last_active":"2024-09-17T03:39:28.995184+0000","last_peered":"2024-09-17T03:39:28.995184+0000","last_clean":"2024-09-17T03:39:28.995184+0000","last_became_active":"2024-09-17T03:39:27.395018+0000","last_became_peered":"2024-09-17T03:39:27.395018+0000","last_unstale":"2024-09-17T03:39:28.995184+0000","last_undegraded":"2024-09-17T03:39:28.995184+0000","last_fullsized":"2024-09-17T03:39:28.995184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:55.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916695+0000","last_change":"2024-09-17T03:39:27.376578+0000","last_active":"2024-09-17T03:39:28.916695+0000","last_peered":"2024-09-17T03:39:28.916695+0000","last_clean":"2024-09-17T03:39:28.916695+0000","last_became_active":"2024-09-17T03:39:27.376212+0000","last_became_peered":"2024-09-17T03:39:27.376212+0000","last_unstale":"2024-09-17T03:39:28.916695+0000","last_undegraded":"2024-09-17T03:39:28.916695+0000","last_fullsized":"2024-09-17T03:39:28.916695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:21.880149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916097+0000","last_change":"2024-09-17T03:39:27.396281+0000","last_active":"2024-09-17T03:39:28.916097+0000","last_peered":"2024-09-17T03:39:28.916097+0000","last_clean":"2024-09-17T03:39:28.916097+0000","last_became_active":"2024-09-17T03:39:27.391352+0000","last_became_peered":"2024-09-17T03:39:27.391352+0000","last_unstale":"2024-09-17T03:39:28.916097+0000","last_undegraded":"2024-09-17T03:39:28.916097+0000","last_fullsized":"2024-09-17T03:39:28.916097+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:09.339294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994449+0000","last_change":"2024-09-17T03:39:27.393386+0000","last_active":"2024-09-17T03:39:28.994449+0000","last_peered":"2024-09-17T03:39:28.994449+0000","last_clean":"2024-09-17T03:39:28.994449+0000","last_became_active":"2024-09-17T03:39:27.392056+0000","last_became_peered":"2024-09-17T03:39:27.392056+0000","last_unstale":"2024-09-17T03:39:28.994449+0000","last_undegraded":"2024-09-17T03:39:28.994449+0000","last_fullsized":"2024-09-17T03:39:28.994449+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:02.970289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.393118+0000","last_change":"2024-09-17T03:39:27.384956+0000","last_active":"2024-09-17T03:39:27.393118+0000","last_peered":"2024-09-17T03:39:27.393118+0000","last_clean":"2024-09-17T03:39:27.393118+0000","last_became_active":"2024-09-17T03:39:27.384580+0000","last_became_peered":"2024-09-17T03:39:27.384580+0000","last_unstale":"2024-09-17T03:39:27.393118+0000","last_undegraded":"2024-09-17T03:39:27.393118+0000","last_fullsized":"2024-09-17T03:39:27.393118+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:00.221061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384853+0000","last_change":"2024-09-17T03:39:27.394333+0000","last_active":"2024-09-17T03:39:28.384853+0000","last_peered":"2024-09-17T03:39:28.384853+0000","last_clean":"2024-09-17T03:39:28.384853+0000","last_became_active":"2024-09-17T03:39:27.387631+0000","last_became_peered":"2024-09-17T03:39:27.387631+0000","last_unstale":"2024-09-17T03:39:28.384853+0000","last_undegraded":"2024-09-17T03:39:28.384853+0000","last_fullsized":"2024-09-17T03:39:28.384853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:16.844366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916853+0000","last_change":"2024-09-17T03:39:26.366636+0000","last_active":"2024-09-17T03:39:28.916853+0000","last_peered":"2024-09-17T03:39:28.916853+0000","last_clean":"2024-09-17T03:39:28.916853+0000","last_became_active":"2024-09-17T03:39:26.365626+0000","last_became_peered":"2024-09-17T03:39:26.365626+0000","last_unstale":"2024-09-17T03:39:28.916853+0000","last_undegraded":"2024-09-17T03:39:28.916853+0000","last_fullsized":"2024-09-17T03:39:28.916853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:55.048635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.394522+0000","last_change":"2024-09-17T03:39:27.391006+0000","last_active":"2024-09-17T03:39:27.394522+0000","last_peered":"2024-09-17T03:39:27.394522+0000","last_clean":"2024-09-17T03:39:27.394522+0000","last_became_active":"2024-09-17T03:39:27.390408+0000","last_became_peered":"2024-09-17T03:39:27.390408+0000","last_unstale":"2024-09-17T03:39:27.394522+0000","last_undegraded":"2024-09-17T03:39:27.394522+0000","last_fullsized":"2024-09-17T03:39:27.394522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:39.928299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995139+0000","last_change":"2024-09-17T03:39:26.370163+0000","last_active":"2024-09-17T03:39:28.995139+0000","last_peered":"2024-09-17T03:39:28.995139+0000","last_clean":"2024-09-17T03:39:28.995139+0000","last_became_active":"2024-09-17T03:39:26.366699+0000","last_became_peered":"2024-09-17T03:39:26.366699+0000","last_unstale":"2024-09-17T03:39:28.995139+0000","last_undegraded":"2024-09-17T03:39:28.995139+0000","last_fullsized":"2024-09-17T03:39:28.995139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:00.568459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462447+0000","last_change":"2024-09-17T03:39:27.387294+0000","last_active":"2024-09-17T03:39:28.462447+0000","last_peered":"2024-09-17T03:39:28.462447+0000","last_clean":"2024-09-17T03:39:28.462447+0000","last_became_active":"2024-09-17T03:39:27.385228+0000","last_became_peered":"2024-09-17T03:39:27.385228+0000","last_unstale":"2024-09-17T03:39:28.462447+0000","last_undegraded":"2024-09-17T03:39:28.462447+0000","last_fullsized":"2024-09-17T03:39:28.462447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:45.349482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916274+0000","last_change":"2024-09-17T03:39:26.361592+0000","last_active":"2024-09-17T03:39:28.916274+0000","last_peered":"2024-09-17T03:39:28.916274+0000","last_clean":"2024-09-17T03:39:28.916274+0000","last_became_active":"2024-09-17T03:39:26.361257+0000","last_became_peered":"2024-09-17T03:39:26.361257+0000","last_unstale":"2024-09-17T03:39:28.916274+0000","last_undegraded":"2024-09-17T03:39:28.916274+0000","last_fullsized":"2024-09-17T03:39:28.916274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:34.558760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.386030+0000","last_change":"2024-09-17T03:39:27.403576+0000","last_active":"2024-09-17T03:39:28.386030+0000","last_peered":"2024-09-17T03:39:28.386030+0000","last_clean":"2024-09-17T03:39:28.386030+0000","last_became_active":"2024-09-17T03:39:27.400306+0000","last_became_peered":"2024-09-17T03:39:27.400306+0000","last_unstale":"2024-09-17T03:39:28.386030+0000","last_undegraded":"2024-09-17T03:39:28.386030+0000","last_fullsized":"2024-09-17T03:39:28.386030+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:59.926142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995026+0000","last_change":"2024-09-17T03:39:26.370388+0000","last_active":"2024-09-17T03:39:28.995026+0000","last_peered":"2024-09-17T03:39:28.995026+0000","last_clean":"2024-09-17T03:39:28.995026+0000","last_became_active":"2024-09-17T03:39:26.370066+0000","last_became_peered":"2024-09-17T03:39:26.370066+0000","last_unstale":"2024-09-17T03:39:28.995026+0000","last_undegraded":"2024-09-17T03:39:28.995026+0000","last_fullsized":"2024-09-17T03:39:28.995026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:36.079390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994824+0000","last_change":"2024-09-17T03:39:27.397002+0000","last_active":"2024-09-17T03:39:28.994824+0000","last_peered":"2024-09-17T03:39:28.994824+0000","last_clean":"2024-09-17T03:39:28.994824+0000","last_became_active":"2024-09-17T03:39:27.396676+0000","last_became_peered":"2024-09-17T03:39:27.396676+0000","last_unstale":"2024-09-17T03:39:28.994824+0000","last_undegraded":"2024-09-17T03:39:28.994824+0000","last_fullsized":"2024-09-17T03:39:28.994824+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:21.782027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994494+0000","last_change":"2024-09-17T03:39:26.366514+0000","last_active":"2024-09-17T03:39:28.994494+0000","last_peered":"2024-09-17T03:39:28.994494+0000","last_clean":"2024-09-17T03:39:28.994494+0000","last_became_active":"2024-09-17T03:39:26.366080+0000","last_became_peered":"2024-09-17T03:39:26.366080+0000","last_unstale":"2024-09-17T03:39:28.994494+0000","last_undegraded":"2024-09-17T03:39:28.994494+0000","last_fullsized":"2024-09-17T03:39:28.994494+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:50.953811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462272+0000","last_change":"2024-09-17T03:39:27.381811+0000","last_active":"2024-09-17T03:39:28.462272+0000","last_peered":"2024-09-17T03:39:28.462272+0000","last_clean":"2024-09-17T03:39:28.462272+0000","last_became_active":"2024-09-17T03:39:27.381547+0000","last_became_peered":"2024-09-17T03:39:27.381547+0000","last_unstale":"2024-09-17T03:39:28.462272+0000","last_undegraded":"2024-09-17T03:39:28.462272+0000","last_fullsized":"2024-09-17T03:39:28.462272+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:30.096755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994824+0000","last_change":"2024-09-17T03:39:26.364077+0000","last_active":"2024-09-17T03:39:28.994824+0000","last_peered":"2024-09-17T03:39:28.994824+0000","last_clean":"2024-09-17T03:39:28.994824+0000","last_became_active":"2024-09-17T03:39:26.363767+0000","last_became_peered":"2024-09-17T03:39:26.363767+0000","last_unstale":"2024-09-17T03:39:28.994824+0000","last_undegraded":"2024-09-17T03:39:28.994824+0000","last_fullsized":"2024-09-17T03:39:28.994824+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:18.528679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.393187+0000","last_change":"2024-09-17T03:39:27.384623+0000","last_active":"2024-09-17T03:39:27.393187+0000","last_peered":"2024-09-17T03:39:27.393187+0000","last_clean":"2024-09-17T03:39:27.393187+0000","last_became_active":"2024-09-17T03:39:27.384095+0000","last_became_peered":"2024-09-17T03:39:27.384095+0000","last_unstale":"2024-09-17T03:39:27.393187+0000","last_undegraded":"2024-09-17T03:39:27.393187+0000","last_fullsized":"2024-09-17T03:39:27.393187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:12.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.383739+0000","last_change":"2024-09-17T03:39:26.367594+0000","last_active":"2024-09-17T03:39:28.383739+0000","last_peered":"2024-09-17T03:39:28.383739+0000","last_clean":"2024-09-17T03:39:28.383739+0000","last_became_active":"2024-09-17T03:39:26.367016+0000","last_became_peered":"2024-09-17T03:39:26.367016+0000","last_unstale":"2024-09-17T03:39:28.383739+0000","last_undegraded":"2024-09-17T03:39:28.383739+0000","last_fullsized":"2024-09-17T03:39:28.383739+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:02.201025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384600+0000","last_change":"2024-09-17T03:39:27.389736+0000","last_active":"2024-09-17T03:39:28.384600+0000","last_peered":"2024-09-17T03:39:28.384600+0000","last_clean":"2024-09-17T03:39:28.384600+0000","last_became_active":"2024-09-17T03:39:27.389410+0000","last_became_peered":"2024-09-17T03:39:27.389410+0000","last_unstale":"2024-09-17T03:39:28.384600+0000","last_undegraded":"2024-09-17T03:39:28.384600+0000","last_fullsized":"2024-09-17T03:39:28.384600+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:44.156493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.915984+0000","last_change":"2024-09-17T03:39:26.362478+0000","last_active":"2024-09-17T03:39:28.915984+0000","last_peered":"2024-09-17T03:39:28.915984+0000","last_clean":"2024-09-17T03:39:28.915984+0000","last_became_active":"2024-09-17T03:39:26.362198+0000","last_became_peered":"2024-09-17T03:39:26.362198+0000","last_unstale":"2024-09-17T03:39:28.915984+0000","last_undegraded":"2024-09-17T03:39:28.915984+0000","last_fullsized":"2024-09-17T03:39:28.915984+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:32.503369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916281+0000","last_change":"2024-09-17T03:39:27.400479+0000","last_active":"2024-09-17T03:39:28.916281+0000","last_peered":"2024-09-17T03:39:28.916281+0000","last_clean":"2024-09-17T03:39:28.916281+0000","last_became_active":"2024-09-17T03:39:27.400133+0000","last_became_peered":"2024-09-17T03:39:27.400133+0000","last_unstale":"2024-09-17T03:39:28.916281+0000","last_undegraded":"2024-09-17T03:39:28.916281+0000","last_fullsized":"2024-09-17T03:39:28.916281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:41.519151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916848+0000","last_change":"2024-09-17T03:39:26.363130+0000","last_active":"2024-09-17T03:39:28.916848+0000","last_peered":"2024-09-17T03:39:28.916848+0000","last_clean":"2024-09-17T03:39:28.916848+0000","last_became_active":"2024-09-17T03:39:26.362028+0000","last_became_peered":"2024-09-17T03:39:26.362028+0000","last_unstale":"2024-09-17T03:39:28.916848+0000","last_undegraded":"2024-09-17T03:39:28.916848+0000","last_fullsized":"2024-09-17T03:39:28.916848+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:40.949726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462221+0000","last_change":"2024-09-17T03:39:27.371585+0000","last_active":"2024-09-17T03:39:28.462221+0000","last_peered":"2024-09-17T03:39:28.462221+0000","last_clean":"2024-09-17T03:39:28.462221+0000","last_became_active":"2024-09-17T03:39:27.371248+0000","last_became_peered":"2024-09-17T03:39:27.371248+0000","last_unstale":"2024-09-17T03:39:28.462221+0000","last_undegraded":"2024-09-17T03:39:28.462221+0000","last_fullsized":"2024-09-17T03:39:28.462221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:53.409029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385585+0000","last_change":"2024-09-17T03:39:26.372967+0000","last_active":"2024-09-17T03:39:28.385585+0000","last_peered":"2024-09-17T03:39:28.385585+0000","last_clean":"2024-09-17T03:39:28.385585+0000","last_became_active":"2024-09-17T03:39:26.372592+0000","last_became_peered":"2024-09-17T03:39:26.372592+0000","last_unstale":"2024-09-17T03:39:28.385585+0000","last_undegraded":"2024-09-17T03:39:28.385585+0000","last_fullsized":"2024-09-17T03:39:28.385585+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:36.834299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385154+0000","last_change":"2024-09-17T03:39:27.399300+0000","last_active":"2024-09-17T03:39:28.385154+0000","last_peered":"2024-09-17T03:39:28.385154+0000","last_clean":"2024-09-17T03:39:28.385154+0000","last_became_active":"2024-09-17T03:39:27.398950+0000","last_became_peered":"2024-09-17T03:39:27.398950+0000","last_unstale":"2024-09-17T03:39:28.385154+0000","last_undegraded":"2024-09-17T03:39:28.385154+0000","last_fullsized":"2024-09-17T03:39:28.385154+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:55.112468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462448+0000","last_change":"2024-09-17T03:39:26.368725+0000","last_active":"2024-09-17T03:39:28.462448+0000","last_peered":"2024-09-17T03:39:28.462448+0000","last_clean":"2024-09-17T03:39:28.462448+0000","last_became_active":"2024-09-17T03:39:26.368393+0000","last_became_peered":"2024-09-17T03:39:26.368393+0000","last_unstale":"2024-09-17T03:39:28.462448+0000","last_undegraded":"2024-09-17T03:39:28.462448+0000","last_fullsized":"2024-09-17T03:39:28.462448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:41.186127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.397850+0000","last_change":"2024-09-17T03:39:27.391590+0000","last_active":"2024-09-17T03:39:27.397850+0000","last_peered":"2024-09-17T03:39:27.397850+0000","last_clean":"2024-09-17T03:39:27.397850+0000","last_became_active":"2024-09-17T03:39:27.391172+0000","last_became_peered":"2024-09-17T03:39:27.391172+0000","last_unstale":"2024-09-17T03:39:27.397850+0000","last_undegraded":"2024-09-17T03:39:27.397850+0000","last_fullsized":"2024-09-17T03:39:27.397850+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:06.169922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"86'6","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384872+0000","last_change":"2024-09-17T03:39:26.366363+0000","last_active":"2024-09-17T03:39:28.384872+0000","last_peered":"2024-09-17T03:39:28.384872+0000","last_clean":"2024-09-17T03:39:28.384872+0000","last_became_active":"2024-09-17T03:39:26.366011+0000","last_became_peered":"2024-09-17T03:39:26.366011+0000","last_unstale":"2024-09-17T03:39:28.384872+0000","last_undegraded":"2024-09-17T03:39:28.384872+0000","last_fullsized":"2024-09-17T03:39:28.384872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:54.273098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.383421+0000","last_change":"2024-09-17T03:39:27.385650+0000","last_active":"2024-09-17T03:39:28.383421+0000","last_peered":"2024-09-17T03:39:28.383421+0000","last_clean":"2024-09-17T03:39:28.383421+0000","last_became_active":"2024-09-17T03:39:27.382968+0000","last_became_peered":"2024-09-17T03:39:27.382968+0000","last_unstale":"2024-09-17T03:39:28.383421+0000","last_undegraded":"2024-09-17T03:39:28.383421+0000","last_fullsized":"2024-09-17T03:39:28.383421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:21.880149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916552+0000","last_change":"2024-09-17T03:39:26.360338+0000","last_active":"2024-09-17T03:39:28.916552+0000","last_peered":"2024-09-17T03:39:28.916552+0000","last_clean":"2024-09-17T03:39:28.916552+0000","last_became_active":"2024-09-17T03:39:26.360014+0000","last_became_peered":"2024-09-17T03:39:26.360014+0000","last_unstale":"2024-09-17T03:39:28.916552+0000","last_undegraded":"2024-09-17T03:39:28.916552+0000","last_fullsized":"2024-09-17T03:39:28.916552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:56.997149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916256+0000","last_change":"2024-09-17T03:39:27.379304+0000","last_active":"2024-09-17T03:39:28.916256+0000","last_peered":"2024-09-17T03:39:28.916256+0000","last_clean":"2024-09-17T03:39:28.916256+0000","last_became_active":"2024-09-17T03:39:27.378737+0000","last_became_peered":"2024-09-17T03:39:27.378737+0000","last_unstale":"2024-09-17T03:39:28.916256+0000","last_undegraded":"2024-09-17T03:39:28.916256+0000","last_fullsized":"2024-09-17T03:39:28.916256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:23.701035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384041+0000","last_change":"2024-09-17T03:39:26.356255+0000","last_active":"2024-09-17T03:39:28.384041+0000","last_peered":"2024-09-17T03:39:28.384041+0000","last_clean":"2024-09-17T03:39:28.384041+0000","last_became_active":"2024-09-17T03:39:26.355834+0000","last_became_peered":"2024-09-17T03:39:26.355834+0000","last_unstale":"2024-09-17T03:39:28.384041+0000","last_undegraded":"2024-09-17T03:39:28.384041+0000","last_fullsized":"2024-09-17T03:39:28.384041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:44.169376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384183+0000","last_change":"2024-09-17T03:39:27.387515+0000","last_active":"2024-09-17T03:39:28.384183+0000","last_peered":"2024-09-17T03:39:28.384183+0000","last_clean":"2024-09-17T03:39:28.384183+0000","last_became_active":"2024-09-17T03:39:27.387125+0000","last_became_peered":"2024-09-17T03:39:27.387125+0000","last_unstale":"2024-09-17T03:39:28.384183+0000","last_undegraded":"2024-09-17T03:39:28.384183+0000","last_fullsized":"2024-09-17T03:39:28.384183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:44.722140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.383557+0000","last_change":"2024-09-17T03:39:26.362792+0000","last_active":"2024-09-17T03:39:28.383557+0000","last_peered":"2024-09-17T03:39:28.383557+0000","last_clean":"2024-09-17T03:39:28.383557+0000","last_became_active":"2024-09-17T03:39:26.362454+0000","last_became_peered":"2024-09-17T03:39:26.362454+0000","last_unstale":"2024-09-17T03:39:28.383557+0000","last_undegraded":"2024-09-17T03:39:28.383557+0000","last_fullsized":"2024-09-17T03:39:28.383557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:20.779881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995295+0000","last_change":"2024-09-17T03:39:27.387265+0000","last_active":"2024-09-17T03:39:28.995295+0000","last_peered":"2024-09-17T03:39:28.995295+0000","last_clean":"2024-09-17T03:39:28.995295+0000","last_became_active":"2024-09-17T03:39:27.386928+0000","last_became_peered":"2024-09-17T03:39:27.386928+0000","last_unstale":"2024-09-17T03:39:28.995295+0000","last_undegraded":"2024-09-17T03:39:28.995295+0000","last_fullsized":"2024-09-17T03:39:28.995295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:29.963365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"86'8","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.382950+0000","last_change":"2024-09-17T03:39:26.369662+0000","last_active":"2024-09-17T03:39:28.382950+0000","last_peered":"2024-09-17T03:39:28.382950+0000","last_clean":"2024-09-17T03:39:28.382950+0000","last_became_active":"2024-09-17T03:39:26.369287+0000","last_became_peered":"2024-09-17T03:39:26.369287+0000","last_unstale":"2024-09-17T03:39:28.382950+0000","last_undegraded":"2024-09-17T03:39:28.382950+0000","last_fullsized":"2024-09-17T03:39:28.382950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:13.857240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995379+0000","last_change":"2024-09-17T03:39:27.390553+0000","last_active":"2024-09-17T03:39:28.995379+0000","last_peered":"2024-09-17T03:39:28.995379+0000","last_clean":"2024-09-17T03:39:28.995379+0000","last_became_active":"2024-09-17T03:39:27.390163+0000","last_became_peered":"2024-09-17T03:39:27.390163+0000","last_unstale":"2024-09-17T03:39:28.995379+0000","last_undegraded":"2024-09-17T03:39:28.995379+0000","last_fullsized":"2024-09-17T03:39:28.995379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:23.701035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994729+0000","last_change":"2024-09-17T03:39:26.367801+0000","last_active":"2024-09-17T03:39:28.994729+0000","last_peered":"2024-09-17T03:39:28.994729+0000","last_clean":"2024-09-17T03:39:28.994729+0000","last_became_active":"2024-09-17T03:39:26.367495+0000","last_became_peered":"2024-09-17T03:39:26.367495+0000","last_unstale":"2024-09-17T03:39:28.994729+0000","last_undegraded":"2024-09-17T03:39:28.994729+0000","last_fullsized":"2024-09-17T03:39:28.994729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:38.624197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462397+0000","last_change":"2024-09-17T03:39:27.382995+0000","last_active":"2024-09-17T03:39:28.462397+0000","last_peered":"2024-09-17T03:39:28.462397+0000","last_clean":"2024-09-17T03:39:28.462397+0000","last_became_active":"2024-09-17T03:39:27.381151+0000","last_became_peered":"2024-09-17T03:39:27.381151+0000","last_unstale":"2024-09-17T03:39:28.462397+0000","last_undegraded":"2024-09-17T03:39:28.462397+0000","last_fullsized":"2024-09-17T03:39:28.462397+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:29.673983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995168+0000","last_change":"2024-09-17T03:39:26.371539+0000","last_active":"2024-09-17T03:39:28.995168+0000","last_peered":"2024-09-17T03:39:28.995168+0000","last_clean":"2024-09-17T03:39:28.995168+0000","last_became_active":"2024-09-17T03:39:26.371268+0000","last_became_peered":"2024-09-17T03:39:26.371268+0000","last_unstale":"2024-09-17T03:39:28.995168+0000","last_undegraded":"2024-09-17T03:39:28.995168+0000","last_fullsized":"2024-09-17T03:39:28.995168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:43.570191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916781+0000","last_change":"2024-09-17T03:39:27.389009+0000","last_active":"2024-09-17T03:39:28.916781+0000","last_peered":"2024-09-17T03:39:28.916781+0000","last_clean":"2024-09-17T03:39:28.916781+0000","last_became_active":"2024-09-17T03:39:27.388616+0000","last_became_peered":"2024-09-17T03:39:27.388616+0000","last_unstale":"2024-09-17T03:39:28.916781+0000","last_undegraded":"2024-09-17T03:39:28.916781+0000","last_fullsized":"2024-09-17T03:39:28.916781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:44.722140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995215+0000","last_change":"2024-09-17T03:39:26.365005+0000","last_active":"2024-09-17T03:39:28.995215+0000","last_peered":"2024-09-17T03:39:28.995215+0000","last_clean":"2024-09-17T03:39:28.995215+0000","last_became_active":"2024-09-17T03:39:26.364701+0000","last_became_peered":"2024-09-17T03:39:26.364701+0000","last_unstale":"2024-09-17T03:39:28.995215+0000","last_undegraded":"2024-09-17T03:39:28.995215+0000","last_fullsized":"2024-09-17T03:39:28.995215+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:55.394041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.405085+0000","last_change":"2024-09-17T03:39:27.397628+0000","last_active":"2024-09-17T03:39:27.405085+0000","last_peered":"2024-09-17T03:39:27.405085+0000","last_clean":"2024-09-17T03:39:27.405085+0000","last_became_active":"2024-09-17T03:39:27.397132+0000","last_became_peered":"2024-09-17T03:39:27.397132+0000","last_unstale":"2024-09-17T03:39:27.405085+0000","last_undegraded":"2024-09-17T03:39:27.405085+0000","last_fullsized":"2024-09-17T03:39:27.405085+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:14.750350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.461924+0000","last_change":"2024-09-17T03:39:26.362094+0000","last_active":"2024-09-17T03:39:28.461924+0000","last_peered":"2024-09-17T03:39:28.461924+0000","last_clean":"2024-09-17T03:39:28.461924+0000","last_became_active":"2024-09-17T03:39:26.361796+0000","last_became_peered":"2024-09-17T03:39:26.361796+0000","last_unstale":"2024-09-17T03:39:28.461924+0000","last_undegraded":"2024-09-17T03:39:28.461924+0000","last_fullsized":"2024-09-17T03:39:28.461924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:39.832861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994947+0000","last_change":"2024-09-17T03:39:27.382033+0000","last_active":"2024-09-17T03:39:28.994947+0000","last_peered":"2024-09-17T03:39:28.994947+0000","last_clean":"2024-09-17T03:39:28.994947+0000","last_became_active":"2024-09-17T03:39:27.381734+0000","last_became_peered":"2024-09-17T03:39:27.381734+0000","last_unstale":"2024-09-17T03:39:28.994947+0000","last_undegraded":"2024-09-17T03:39:28.994947+0000","last_fullsized":"2024-09-17T03:39:28.994947+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:10.191485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.379618+0000","last_change":"2024-09-17T03:39:26.369987+0000","last_active":"2024-09-17T03:39:27.379618+0000","last_peered":"2024-09-17T03:39:27.379618+0000","last_clean":"2024-09-17T03:39:27.379618+0000","last_became_active":"2024-09-17T03:39:26.369648+0000","last_became_peered":"2024-09-17T03:39:26.369648+0000","last_unstale":"2024-09-17T03:39:27.379618+0000","last_undegraded":"2024-09-17T03:39:27.379618+0000","last_fullsized":"2024-09-17T03:39:27.379618+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:23.096640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994860+0000","last_change":"2024-09-17T03:39:27.384638+0000","last_active":"2024-09-17T03:39:28.994860+0000","last_peered":"2024-09-17T03:39:28.994860+0000","last_clean":"2024-09-17T03:39:28.994860+0000","last_became_active":"2024-09-17T03:39:27.384393+0000","last_became_peered":"2024-09-17T03:39:27.384393+0000","last_unstale":"2024-09-17T03:39:28.994860+0000","last_undegraded":"2024-09-17T03:39:28.994860+0000","last_fullsized":"2024-09-17T03:39:28.994860+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:51.196239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995017+0000","last_change":"2024-09-17T03:39:26.369598+0000","last_active":"2024-09-17T03:39:28.995017+0000","last_peered":"2024-09-17T03:39:28.995017+0000","last_clean":"2024-09-17T03:39:28.995017+0000","last_became_active":"2024-09-17T03:39:26.369278+0000","last_became_peered":"2024-09-17T03:39:26.369278+0000","last_unstale":"2024-09-17T03:39:28.995017+0000","last_undegraded":"2024-09-17T03:39:28.995017+0000","last_fullsized":"2024-09-17T03:39:28.995017+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:52.448342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384745+0000","last_change":"2024-09-17T03:39:27.393580+0000","last_active":"2024-09-17T03:39:28.384745+0000","last_peered":"2024-09-17T03:39:28.384745+0000","last_clean":"2024-09-17T03:39:28.384745+0000","last_became_active":"2024-09-17T03:39:27.388666+0000","last_became_peered":"2024-09-17T03:39:27.388666+0000","last_unstale":"2024-09-17T03:39:28.384745+0000","last_undegraded":"2024-09-17T03:39:28.384745+0000","last_fullsized":"2024-09-17T03:39:28.384745+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:42.942514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994716+0000","last_change":"2024-09-17T03:39:26.363964+0000","last_active":"2024-09-17T03:39:28.994716+0000","last_peered":"2024-09-17T03:39:28.994716+0000","last_clean":"2024-09-17T03:39:28.994716+0000","last_became_active":"2024-09-17T03:39:26.363096+0000","last_became_peered":"2024-09-17T03:39:26.363096+0000","last_unstale":"2024-09-17T03:39:28.994716+0000","last_undegraded":"2024-09-17T03:39:28.994716+0000","last_fullsized":"2024-09-17T03:39:28.994716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:39.281013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994606+0000","last_change":"2024-09-17T03:39:27.388484+0000","last_active":"2024-09-17T03:39:28.994606+0000","last_peered":"2024-09-17T03:39:28.994606+0000","last_clean":"2024-09-17T03:39:28.994606+0000","last_became_active":"2024-09-17T03:39:27.388237+0000","last_became_peered":"2024-09-17T03:39:27.388237+0000","last_unstale":"2024-09-17T03:39:28.994606+0000","last_undegraded":"2024-09-17T03:39:28.994606+0000","last_fullsized":"2024-09-17T03:39:28.994606+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:57.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462344+0000","last_change":"2024-09-17T03:39:26.363615+0000","last_active":"2024-09-17T03:39:28.462344+0000","last_peered":"2024-09-17T03:39:28.462344+0000","last_clean":"2024-09-17T03:39:28.462344+0000","last_became_active":"2024-09-17T03:39:26.363331+0000","last_became_peered":"2024-09-17T03:39:26.363331+0000","last_unstale":"2024-09-17T03:39:28.462344+0000","last_undegraded":"2024-09-17T03:39:28.462344+0000","last_fullsized":"2024-09-17T03:39:28.462344+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:24.066584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995067+0000","last_change":"2024-09-17T03:39:27.406858+0000","last_active":"2024-09-17T03:39:28.995067+0000","last_peered":"2024-09-17T03:39:28.995067+0000","last_clean":"2024-09-17T03:39:28.995067+0000","last_became_active":"2024-09-17T03:39:27.406522+0000","last_became_peered":"2024-09-17T03:39:27.406522+0000","last_unstale":"2024-09-17T03:39:28.995067+0000","last_undegraded":"2024-09-17T03:39:28.995067+0000","last_fullsized":"2024-09-17T03:39:28.995067+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:45.171522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462312+0000","last_change":"2024-09-17T03:39:26.365432+0000","last_active":"2024-09-17T03:39:28.462312+0000","last_peered":"2024-09-17T03:39:28.462312+0000","last_clean":"2024-09-17T03:39:28.462312+0000","last_became_active":"2024-09-17T03:39:26.365168+0000","last_became_peered":"2024-09-17T03:39:26.365168+0000","last_unstale":"2024-09-17T03:39:28.462312+0000","last_undegraded":"2024-09-17T03:39:28.462312+0000","last_fullsized":"2024-09-17T03:39:28.462312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:31.784371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995250+0000","last_change":"2024-09-17T03:39:27.406324+0000","last_active":"2024-09-17T03:39:28.995250+0000","last_peered":"2024-09-17T03:39:28.995250+0000","last_clean":"2024-09-17T03:39:28.995250+0000","last_became_active":"2024-09-17T03:39:27.397500+0000","last_became_peered":"2024-09-17T03:39:27.397500+0000","last_unstale":"2024-09-17T03:39:28.995250+0000","last_undegraded":"2024-09-17T03:39:28.995250+0000","last_fullsized":"2024-09-17T03:39:28.995250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:09.339294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994683+0000","last_change":"2024-09-17T03:39:26.367697+0000","last_active":"2024-09-17T03:39:28.994683+0000","last_peered":"2024-09-17T03:39:28.994683+0000","last_clean":"2024-09-17T03:39:28.994683+0000","last_became_active":"2024-09-17T03:39:26.367388+0000","last_became_peered":"2024-09-17T03:39:26.367388+0000","last_unstale":"2024-09-17T03:39:28.994683+0000","last_undegraded":"2024-09-17T03:39:28.994683+0000","last_fullsized":"2024-09-17T03:39:28.994683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:38.257378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916782+0000","last_change":"2024-09-17T03:39:27.380192+0000","last_active":"2024-09-17T03:39:28.916782+0000","last_peered":"2024-09-17T03:39:28.916782+0000","last_clean":"2024-09-17T03:39:28.916782+0000","last_became_active":"2024-09-17T03:39:27.379539+0000","last_became_peered":"2024-09-17T03:39:27.379539+0000","last_unstale":"2024-09-17T03:39:28.916782+0000","last_undegraded":"2024-09-17T03:39:28.916782+0000","last_fullsized":"2024-09-17T03:39:28.916782+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:17.324387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462185+0000","last_change":"2024-09-17T03:39:26.371970+0000","last_active":"2024-09-17T03:39:28.462185+0000","last_peered":"2024-09-17T03:39:28.462185+0000","last_clean":"2024-09-17T03:39:28.462185+0000","last_became_active":"2024-09-17T03:39:26.371610+0000","last_became_peered":"2024-09-17T03:39:26.371610+0000","last_unstale":"2024-09-17T03:39:28.462185+0000","last_undegraded":"2024-09-17T03:39:28.462185+0000","last_fullsized":"2024-09-17T03:39:28.462185+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:18.413378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.405123+0000","last_change":"2024-09-17T03:39:27.398794+0000","last_active":"2024-09-17T03:39:27.405123+0000","last_peered":"2024-09-17T03:39:27.405123+0000","last_clean":"2024-09-17T03:39:27.405123+0000","last_became_active":"2024-09-17T03:39:27.398487+0000","last_became_peered":"2024-09-17T03:39:27.398487+0000","last_unstale":"2024-09-17T03:39:27.405123+0000","last_undegraded":"2024-09-17T03:39:27.405123+0000","last_fullsized":"2024-09-17T03:39:27.405123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:33.712789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384764+0000","last_change":"2024-09-17T03:39:26.366176+0000","last_active":"2024-09-17T03:39:28.384764+0000","last_peered":"2024-09-17T03:39:28.384764+0000","last_clean":"2024-09-17T03:39:28.384764+0000","last_became_active":"2024-09-17T03:39:26.364951+0000","last_became_peered":"2024-09-17T03:39:26.364951+0000","last_unstale":"2024-09-17T03:39:28.384764+0000","last_undegraded":"2024-09-17T03:39:28.384764+0000","last_fullsized":"2024-09-17T03:39:28.384764+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:48.280125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384404+0000","last_change":"2024-09-17T03:39:27.377664+0000","last_active":"2024-09-17T03:39:28.384404+0000","last_peered":"2024-09-17T03:39:28.384404+0000","last_clean":"2024-09-17T03:39:28.384404+0000","last_became_active":"2024-09-17T03:39:27.377328+0000","last_became_peered":"2024-09-17T03:39:27.377328+0000","last_unstale":"2024-09-17T03:39:28.384404+0000","last_undegraded":"2024-09-17T03:39:28.384404+0000","last_fullsized":"2024-09-17T03:39:28.384404+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:56.050781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.915991+0000","last_change":"2024-09-17T03:39:26.362114+0000","last_active":"2024-09-17T03:39:28.915991+0000","last_peered":"2024-09-17T03:39:28.915991+0000","last_clean":"2024-09-17T03:39:28.915991+0000","last_became_active":"2024-09-17T03:39:26.361386+0000","last_became_peered":"2024-09-17T03:39:26.361386+0000","last_unstale":"2024-09-17T03:39:28.915991+0000","last_undegraded":"2024-09-17T03:39:28.915991+0000","last_fullsized":"2024-09-17T03:39:28.915991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:28.654950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995251+0000","last_change":"2024-09-17T03:39:27.387137+0000","last_active":"2024-09-17T03:39:28.995251+0000","last_peered":"2024-09-17T03:39:28.995251+0000","last_clean":"2024-09-17T03:39:28.995251+0000","last_became_active":"2024-09-17T03:39:27.386544+0000","last_became_peered":"2024-09-17T03:39:27.386544+0000","last_unstale":"2024-09-17T03:39:28.995251+0000","last_undegraded":"2024-09-17T03:39:28.995251+0000","last_fullsized":"2024-09-17T03:39:28.995251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:31.234798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916328+0000","last_change":"2024-09-17T03:39:26.364565+0000","last_active":"2024-09-17T03:39:28.916328+0000","last_peered":"2024-09-17T03:39:28.916328+0000","last_clean":"2024-09-17T03:39:28.916328+0000","last_became_active":"2024-09-17T03:39:26.364280+0000","last_became_peered":"2024-09-17T03:39:26.364280+0000","last_unstale":"2024-09-17T03:39:28.916328+0000","last_undegraded":"2024-09-17T03:39:28.916328+0000","last_fullsized":"2024-09-17T03:39:28.916328+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:35.358430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.392961+0000","last_change":"2024-09-17T03:39:27.389882+0000","last_active":"2024-09-17T03:39:27.392961+0000","last_peered":"2024-09-17T03:39:27.392961+0000","last_clean":"2024-09-17T03:39:27.392961+0000","last_became_active":"2024-09-17T03:39:27.389584+0000","last_became_peered":"2024-09-17T03:39:27.389584+0000","last_unstale":"2024-09-17T03:39:27.392961+0000","last_undegraded":"2024-09-17T03:39:27.392961+0000","last_fullsized":"2024-09-17T03:39:27.392961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:45.015434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.915995+0000","last_change":"2024-09-17T03:39:26.366039+0000","last_active":"2024-09-17T03:39:28.915995+0000","last_peered":"2024-09-17T03:39:28.915995+0000","last_clean":"2024-09-17T03:39:28.915995+0000","last_became_active":"2024-09-17T03:39:26.365727+0000","last_became_peered":"2024-09-17T03:39:26.365727+0000","last_unstale":"2024-09-17T03:39:28.915995+0000","last_undegraded":"2024-09-17T03:39:28.915995+0000","last_fullsized":"2024-09-17T03:39:28.915995+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:50.095971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916680+0000","last_change":"2024-09-17T03:39:27.394485+0000","last_active":"2024-09-17T03:39:28.916680+0000","last_peered":"2024-09-17T03:39:28.916680+0000","last_clean":"2024-09-17T03:39:28.916680+0000","last_became_active":"2024-09-17T03:39:27.394211+0000","last_became_peered":"2024-09-17T03:39:27.394211+0000","last_unstale":"2024-09-17T03:39:28.916680+0000","last_undegraded":"2024-09-17T03:39:28.916680+0000","last_fullsized":"2024-09-17T03:39:28.916680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:46.885989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384946+0000","last_change":"2024-09-17T03:39:26.357327+0000","last_active":"2024-09-17T03:39:28.384946+0000","last_peered":"2024-09-17T03:39:28.384946+0000","last_clean":"2024-09-17T03:39:28.384946+0000","last_became_active":"2024-09-17T03:39:26.356955+0000","last_became_peered":"2024-09-17T03:39:26.356955+0000","last_unstale":"2024-09-17T03:39:28.384946+0000","last_undegraded":"2024-09-17T03:39:28.384946+0000","last_fullsized":"2024-09-17T03:39:28.384946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:08.337148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":235,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916134+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:39:28.916134+0000","last_peered":"2024-09-17T03:39:28.916134+0000","last_clean":"2024-09-17T03:39:28.916134+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:39:28.916134+0000","last_undegraded":"2024-09-17T03:39:28.916134+0000","last_fullsized":"2024-09-17T03:39:28.916134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1064960,"data_stored":485054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":486790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1658880,"data_stored":1075422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":486778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":485658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1671168,"data_stored":1076108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":485124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1040384,"data_stored":471195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:39:31.794 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:39:32.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.048+0000 7f7ebec00640 1 -- 172.21.15.121:0/1930649857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7eb806d620 msgr2=0x7f7eb80d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:32.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.048+0000 7f7ebec00640 1 --2- 172.21.15.121:0/1930649857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7eb806d620 0x7f7eb80d0630 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4005fd0 tx=0x7f7ea402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.048+0000 7f7ebec00640 1 -- 172.21.15.121:0/1930649857 shutdown_connections 2024-09-17T03:39:32.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.048+0000 7f7ebec00640 1 --2- 172.21.15.121:0/1930649857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7eb806d620 0x7f7eb80d0630 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.048+0000 7f7ebec00640 1 --2- 172.21.15.121:0/1930649857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eb80cca80 0x7f7eb80707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.048+0000 7f7ebec00640 1 -- 172.21.15.121:0/1930649857 >> 172.21.15.121:0/1930649857 conn(0x7f7eb80b3580 msgr2=0x7f7eb80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:32.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.048+0000 7f7ebec00640 1 -- 172.21.15.121:0/1930649857 shutdown_connections 2024-09-17T03:39:32.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.048+0000 7f7ebec00640 1 -- 172.21.15.121:0/1930649857 wait complete. 2024-09-17T03:39:32.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.050+0000 7f7ebec00640 1 Processor -- start 2024-09-17T03:39:32.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.050+0000 7f7ebec00640 1 -- start start 2024-09-17T03:39:32.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7ebec00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eb806d620 0x7f7eb80c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:32.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7ebec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eb806da30 0x7f7eb80c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7ebec00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7eb80cca80 0x7f7eb815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7ebec00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb80d0b70 con 0x7f7eb80cca80 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7ebec00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb80d0cf0 con 0x7f7eb806d620 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7ebec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb80d0e70 con 0x7f7eb806da30 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7ebcc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7eb80cca80 0x7f7eb815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7ebcc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7eb80cca80 0x7f7eb815cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51154/0 (socket says 172.21.15.121:51154) 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7ebcc00640 1 -- 172.21.15.121:0/4102123260 learned_addr learned my addr 172.21.15.121:0/4102123260 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7eb7400640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eb806da30 0x7f7eb80c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.052+0000 7f7eb7e00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eb806d620 0x7f7eb80c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7ebcc00640 1 -- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eb806da30 msgr2=0x7f7eb80c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7ebcc00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eb806da30 0x7f7eb80c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7ebcc00640 1 -- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eb806d620 msgr2=0x7f7eb80c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7ebcc00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eb806d620 0x7f7eb80c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7ebcc00640 1 -- 172.21.15.121:0/4102123260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb815d400 con 0x7f7eb80cca80 2024-09-17T03:39:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7ebcc00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7eb80cca80 0x7f7eb815cec0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000b9a0 tx=0x7f7eb000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7eafe00640 1 -- 172.21.15.121:0/4102123260 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0019070 con 0x7f7eb80cca80 2024-09-17T03:39:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7eafe00640 1 -- 172.21.15.121:0/4102123260 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7eb000cc90 con 0x7f7eb80cca80 2024-09-17T03:39:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7eafe00640 1 -- 172.21.15.121:0/4102123260 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00146a0 con 0x7f7eb80cca80 2024-09-17T03:39:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7ebec00640 1 -- 172.21.15.121:0/4102123260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb80c5900 con 0x7f7eb80cca80 2024-09-17T03:39:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.053+0000 7f7ebec00640 1 -- 172.21.15.121:0/4102123260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb80b11f0 con 0x7f7eb80cca80 2024-09-17T03:39:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.054+0000 7f7ebec00640 1 -- 172.21.15.121:0/4102123260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb80c5670 con 0x7f7eb80cca80 2024-09-17T03:39:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.056+0000 7f7eafe00640 1 -- 172.21.15.121:0/4102123260 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7eb001c070 con 0x7f7eb80cca80 2024-09-17T03:39:32.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.057+0000 7f7eafe00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e98078b90 0x7f7e9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:32.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.057+0000 7f7eafe00640 1 -- 172.21.15.121:0/4102123260 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f7eb009a9d0 con 0x7f7eb80cca80 2024-09-17T03:39:32.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.057+0000 7f7eb7e00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e98078b90 0x7f7e9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:32.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.058+0000 7f7eb7e00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e98078b90 0x7f7e9807b0a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8004630 tx=0x7f7ea800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:32.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.061+0000 7f7eafe00640 1 -- 172.21.15.121:0/4102123260 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7eb00626b0 con 0x7f7eb80cca80 2024-09-17T03:39:32.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.243+0000 7f7ebec00640 1 -- 172.21.15.121:0/4102123260 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7eb80b0d00 con 0x7f7e98078b90 2024-09-17T03:39:32.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.249+0000 7f7eafe00640 1 -- 172.21.15.121:0/4102123260 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252064 (secure 0 0 0) 0x7f7eb80b0d00 con 0x7f7e98078b90 2024-09-17T03:39:32.251 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:32.253 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:39:32.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 -- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e98078b90 msgr2=0x7f7e9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:32.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e98078b90 0x7f7e9807b0a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8004630 tx=0x7f7ea800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 -- 172.21.15.121:0/4102123260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7eb80cca80 msgr2=0x7f7eb815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:32.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7eb80cca80 0x7f7eb815cec0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000b9a0 tx=0x7f7eb000be60 comp rx=0 tx=0).stop 2024-09-17T03:39:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 -- 172.21.15.121:0/4102123260 shutdown_connections 2024-09-17T03:39:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e98078b90 0x7f7e9807b0a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7eb80cca80 0x7f7eb815cec0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eb806da30 0x7f7eb80c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 --2- 172.21.15.121:0/4102123260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eb806d620 0x7f7eb80c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 -- 172.21.15.121:0/4102123260 >> 172.21.15.121:0/4102123260 conn(0x7f7eb80b3580 msgr2=0x7f7eb8161090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 -- 172.21.15.121:0/4102123260 shutdown_connections 2024-09-17T03:39:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.253+0000 7f7ebec00640 1 -- 172.21.15.121:0/4102123260 wait complete. 2024-09-17T03:39:32.275 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2024-09-17T03:39:31.339734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259036,"kb_used_data":9520,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715684,"statfs":{"total":773094113280,"available":772828860416,"internally_reserved":0,"allocated":9748480,"data_stored":5052129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.998115"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385547+0000","last_change":"2024-09-17T03:39:27.397982+0000","last_active":"2024-09-17T03:39:28.385547+0000","last_peered":"2024-09-17T03:39:28.385547+0000","last_clean":"2024-09-17T03:39:28.385547+0000","last_became_active":"2024-09-17T03:39:27.397674+0000","last_became_peered":"2024-09-17T03:39:27.397674+0000","last_unstale":"2024-09-17T03:39:28.385547+0000","last_undegraded":"2024-09-17T03:39:28.385547+0000","last_fullsized":"2024-09-17T03:39:28.385547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:16.050198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916514+0000","last_change":"2024-09-17T03:39:27.386337+0000","last_active":"2024-09-17T03:39:28.916514+0000","last_peered":"2024-09-17T03:39:28.916514+0000","last_clean":"2024-09-17T03:39:28.916514+0000","last_became_active":"2024-09-17T03:39:27.385858+0000","last_became_peered":"2024-09-17T03:39:27.385858+0000","last_unstale":"2024-09-17T03:39:28.916514+0000","last_undegraded":"2024-09-17T03:39:28.916514+0000","last_fullsized":"2024-09-17T03:39:28.916514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:25.851210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385373+0000","last_change":"2024-09-17T03:39:27.386285+0000","last_active":"2024-09-17T03:39:28.385373+0000","last_peered":"2024-09-17T03:39:28.385373+0000","last_clean":"2024-09-17T03:39:28.385373+0000","last_became_active":"2024-09-17T03:39:27.385903+0000","last_became_peered":"2024-09-17T03:39:27.385903+0000","last_unstale":"2024-09-17T03:39:28.385373+0000","last_undegraded":"2024-09-17T03:39:28.385373+0000","last_fullsized":"2024-09-17T03:39:28.385373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:41.951872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.383456+0000","last_change":"2024-09-17T03:39:27.374295+0000","last_active":"2024-09-17T03:39:28.383456+0000","last_peered":"2024-09-17T03:39:28.383456+0000","last_clean":"2024-09-17T03:39:28.383456+0000","last_became_active":"2024-09-17T03:39:27.372759+0000","last_became_peered":"2024-09-17T03:39:27.372759+0000","last_unstale":"2024-09-17T03:39:28.383456+0000","last_undegraded":"2024-09-17T03:39:28.383456+0000","last_fullsized":"2024-09-17T03:39:28.383456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:29.657096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916460+0000","last_change":"2024-09-17T03:39:27.383140+0000","last_active":"2024-09-17T03:39:28.916460+0000","last_peered":"2024-09-17T03:39:28.916460+0000","last_clean":"2024-09-17T03:39:28.916460+0000","last_became_active":"2024-09-17T03:39:27.382509+0000","last_became_peered":"2024-09-17T03:39:27.382509+0000","last_unstale":"2024-09-17T03:39:28.916460+0000","last_undegraded":"2024-09-17T03:39:28.916460+0000","last_fullsized":"2024-09-17T03:39:28.916460+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:29.963365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.398051+0000","last_change":"2024-09-17T03:39:27.392641+0000","last_active":"2024-09-17T03:39:27.398051+0000","last_peered":"2024-09-17T03:39:27.398051+0000","last_clean":"2024-09-17T03:39:27.398051+0000","last_became_active":"2024-09-17T03:39:27.391291+0000","last_became_peered":"2024-09-17T03:39:27.391291+0000","last_unstale":"2024-09-17T03:39:27.398051+0000","last_undegraded":"2024-09-17T03:39:27.398051+0000","last_fullsized":"2024-09-17T03:39:27.398051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:14.731864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462048+0000","last_change":"2024-09-17T03:39:27.396407+0000","last_active":"2024-09-17T03:39:28.462048+0000","last_peered":"2024-09-17T03:39:28.462048+0000","last_clean":"2024-09-17T03:39:28.462048+0000","last_became_active":"2024-09-17T03:39:27.396203+0000","last_became_peered":"2024-09-17T03:39:27.396203+0000","last_unstale":"2024-09-17T03:39:28.462048+0000","last_undegraded":"2024-09-17T03:39:28.462048+0000","last_fullsized":"2024-09-17T03:39:28.462048+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:28.523962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.393143+0000","last_change":"2024-09-17T03:39:27.385894+0000","last_active":"2024-09-17T03:39:27.393143+0000","last_peered":"2024-09-17T03:39:27.393143+0000","last_clean":"2024-09-17T03:39:27.393143+0000","last_became_active":"2024-09-17T03:39:27.385056+0000","last_became_peered":"2024-09-17T03:39:27.385056+0000","last_unstale":"2024-09-17T03:39:27.393143+0000","last_undegraded":"2024-09-17T03:39:27.393143+0000","last_fullsized":"2024-09-17T03:39:27.393143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:49.272666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462302+0000","last_change":"2024-09-17T03:39:27.382203+0000","last_active":"2024-09-17T03:39:28.462302+0000","last_peered":"2024-09-17T03:39:28.462302+0000","last_clean":"2024-09-17T03:39:28.462302+0000","last_became_active":"2024-09-17T03:39:27.381857+0000","last_became_peered":"2024-09-17T03:39:27.381857+0000","last_unstale":"2024-09-17T03:39:28.462302+0000","last_undegraded":"2024-09-17T03:39:28.462302+0000","last_fullsized":"2024-09-17T03:39:28.462302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:47.210348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385478+0000","last_change":"2024-09-17T03:39:27.401284+0000","last_active":"2024-09-17T03:39:28.385478+0000","last_peered":"2024-09-17T03:39:28.385478+0000","last_clean":"2024-09-17T03:39:28.385478+0000","last_became_active":"2024-09-17T03:39:27.400969+0000","last_became_peered":"2024-09-17T03:39:27.400969+0000","last_unstale":"2024-09-17T03:39:28.385478+0000","last_undegraded":"2024-09-17T03:39:28.385478+0000","last_fullsized":"2024-09-17T03:39:28.385478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:40.283159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462150+0000","last_change":"2024-09-17T03:39:27.382535+0000","last_active":"2024-09-17T03:39:28.462150+0000","last_peered":"2024-09-17T03:39:28.462150+0000","last_clean":"2024-09-17T03:39:28.462150+0000","last_became_active":"2024-09-17T03:39:27.381402+0000","last_became_peered":"2024-09-17T03:39:27.381402+0000","last_unstale":"2024-09-17T03:39:28.462150+0000","last_undegraded":"2024-09-17T03:39:28.462150+0000","last_fullsized":"2024-09-17T03:39:28.462150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:41.434489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385454+0000","last_change":"2024-09-17T03:39:27.402378+0000","last_active":"2024-09-17T03:39:28.385454+0000","last_peered":"2024-09-17T03:39:28.385454+0000","last_clean":"2024-09-17T03:39:28.385454+0000","last_became_active":"2024-09-17T03:39:27.402077+0000","last_became_peered":"2024-09-17T03:39:27.402077+0000","last_unstale":"2024-09-17T03:39:28.385454+0000","last_undegraded":"2024-09-17T03:39:28.385454+0000","last_fullsized":"2024-09-17T03:39:28.385454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:19.530825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995071+0000","last_change":"2024-09-17T03:39:27.384268+0000","last_active":"2024-09-17T03:39:28.995071+0000","last_peered":"2024-09-17T03:39:28.995071+0000","last_clean":"2024-09-17T03:39:28.995071+0000","last_became_active":"2024-09-17T03:39:27.383965+0000","last_became_peered":"2024-09-17T03:39:27.383965+0000","last_unstale":"2024-09-17T03:39:28.995071+0000","last_undegraded":"2024-09-17T03:39:28.995071+0000","last_fullsized":"2024-09-17T03:39:28.995071+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:51.955957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995178+0000","last_change":"2024-09-17T03:39:27.373496+0000","last_active":"2024-09-17T03:39:28.995178+0000","last_peered":"2024-09-17T03:39:28.995178+0000","last_clean":"2024-09-17T03:39:28.995178+0000","last_became_active":"2024-09-17T03:39:27.373138+0000","last_became_peered":"2024-09-17T03:39:27.373138+0000","last_unstale":"2024-09-17T03:39:28.995178+0000","last_undegraded":"2024-09-17T03:39:28.995178+0000","last_fullsized":"2024-09-17T03:39:28.995178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:58.705353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.383287+0000","last_change":"2024-09-17T03:39:27.387416+0000","last_active":"2024-09-17T03:39:28.383287+0000","last_peered":"2024-09-17T03:39:28.383287+0000","last_clean":"2024-09-17T03:39:28.383287+0000","last_became_active":"2024-09-17T03:39:27.387037+0000","last_became_peered":"2024-09-17T03:39:27.387037+0000","last_unstale":"2024-09-17T03:39:28.383287+0000","last_undegraded":"2024-09-17T03:39:28.383287+0000","last_fullsized":"2024-09-17T03:39:28.383287+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:36.360576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.393091+0000","last_change":"2024-09-17T03:39:27.384584+0000","last_active":"2024-09-17T03:39:27.393091+0000","last_peered":"2024-09-17T03:39:27.393091+0000","last_clean":"2024-09-17T03:39:27.393091+0000","last_became_active":"2024-09-17T03:39:27.384264+0000","last_became_peered":"2024-09-17T03:39:27.384264+0000","last_unstale":"2024-09-17T03:39:27.393091+0000","last_undegraded":"2024-09-17T03:39:27.393091+0000","last_fullsized":"2024-09-17T03:39:27.393091+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:35.476750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.397818+0000","last_change":"2024-09-17T03:39:27.391345+0000","last_active":"2024-09-17T03:39:27.397818+0000","last_peered":"2024-09-17T03:39:27.397818+0000","last_clean":"2024-09-17T03:39:27.397818+0000","last_became_active":"2024-09-17T03:39:27.391010+0000","last_became_peered":"2024-09-17T03:39:27.391010+0000","last_unstale":"2024-09-17T03:39:27.397818+0000","last_undegraded":"2024-09-17T03:39:27.397818+0000","last_fullsized":"2024-09-17T03:39:27.397818+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:16.121725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385500+0000","last_change":"2024-09-17T03:39:27.382184+0000","last_active":"2024-09-17T03:39:28.385500+0000","last_peered":"2024-09-17T03:39:28.385500+0000","last_clean":"2024-09-17T03:39:28.385500+0000","last_became_active":"2024-09-17T03:39:27.381864+0000","last_became_peered":"2024-09-17T03:39:27.381864+0000","last_unstale":"2024-09-17T03:39:28.385500+0000","last_undegraded":"2024-09-17T03:39:28.385500+0000","last_fullsized":"2024-09-17T03:39:28.385500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:06.594080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994819+0000","last_change":"2024-09-17T03:39:27.386474+0000","last_active":"2024-09-17T03:39:28.994819+0000","last_peered":"2024-09-17T03:39:28.994819+0000","last_clean":"2024-09-17T03:39:28.994819+0000","last_became_active":"2024-09-17T03:39:27.386163+0000","last_became_peered":"2024-09-17T03:39:27.386163+0000","last_unstale":"2024-09-17T03:39:28.994819+0000","last_undegraded":"2024-09-17T03:39:28.994819+0000","last_fullsized":"2024-09-17T03:39:28.994819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:09.704866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.392980+0000","last_change":"2024-09-17T03:39:27.389539+0000","last_active":"2024-09-17T03:39:27.392980+0000","last_peered":"2024-09-17T03:39:27.392980+0000","last_clean":"2024-09-17T03:39:27.392980+0000","last_became_active":"2024-09-17T03:39:27.389178+0000","last_became_peered":"2024-09-17T03:39:27.389178+0000","last_unstale":"2024-09-17T03:39:27.392980+0000","last_undegraded":"2024-09-17T03:39:27.392980+0000","last_fullsized":"2024-09-17T03:39:27.392980+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:47.625515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916461+0000","last_change":"2024-09-17T03:39:27.383499+0000","last_active":"2024-09-17T03:39:28.916461+0000","last_peered":"2024-09-17T03:39:28.916461+0000","last_clean":"2024-09-17T03:39:28.916461+0000","last_became_active":"2024-09-17T03:39:27.382876+0000","last_became_peered":"2024-09-17T03:39:27.382876+0000","last_unstale":"2024-09-17T03:39:28.916461+0000","last_undegraded":"2024-09-17T03:39:28.916461+0000","last_fullsized":"2024-09-17T03:39:28.916461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:34.015664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994997+0000","last_change":"2024-09-17T03:39:27.387278+0000","last_active":"2024-09-17T03:39:28.994997+0000","last_peered":"2024-09-17T03:39:28.994997+0000","last_clean":"2024-09-17T03:39:28.994997+0000","last_became_active":"2024-09-17T03:39:27.386953+0000","last_became_peered":"2024-09-17T03:39:27.386953+0000","last_unstale":"2024-09-17T03:39:28.994997+0000","last_undegraded":"2024-09-17T03:39:28.994997+0000","last_fullsized":"2024-09-17T03:39:28.994997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:57.549934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916418+0000","last_change":"2024-09-17T03:39:27.377433+0000","last_active":"2024-09-17T03:39:28.916418+0000","last_peered":"2024-09-17T03:39:28.916418+0000","last_clean":"2024-09-17T03:39:28.916418+0000","last_became_active":"2024-09-17T03:39:27.375989+0000","last_became_peered":"2024-09-17T03:39:27.375989+0000","last_unstale":"2024-09-17T03:39:28.916418+0000","last_undegraded":"2024-09-17T03:39:28.916418+0000","last_fullsized":"2024-09-17T03:39:28.916418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:53.015608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.382829+0000","last_change":"2024-09-17T03:39:27.387583+0000","last_active":"2024-09-17T03:39:28.382829+0000","last_peered":"2024-09-17T03:39:28.382829+0000","last_clean":"2024-09-17T03:39:28.382829+0000","last_became_active":"2024-09-17T03:39:27.387232+0000","last_became_peered":"2024-09-17T03:39:27.387232+0000","last_unstale":"2024-09-17T03:39:28.382829+0000","last_undegraded":"2024-09-17T03:39:28.382829+0000","last_fullsized":"2024-09-17T03:39:28.382829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:46.885989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916510+0000","last_change":"2024-09-17T03:39:27.380380+0000","last_active":"2024-09-17T03:39:28.916510+0000","last_peered":"2024-09-17T03:39:28.916510+0000","last_clean":"2024-09-17T03:39:28.916510+0000","last_became_active":"2024-09-17T03:39:27.379946+0000","last_became_peered":"2024-09-17T03:39:27.379946+0000","last_unstale":"2024-09-17T03:39:28.916510+0000","last_undegraded":"2024-09-17T03:39:28.916510+0000","last_fullsized":"2024-09-17T03:39:28.916510+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:57.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916614+0000","last_change":"2024-09-17T03:39:27.383061+0000","last_active":"2024-09-17T03:39:28.916614+0000","last_peered":"2024-09-17T03:39:28.916614+0000","last_clean":"2024-09-17T03:39:28.916614+0000","last_became_active":"2024-09-17T03:39:27.379936+0000","last_became_peered":"2024-09-17T03:39:27.379936+0000","last_unstale":"2024-09-17T03:39:28.916614+0000","last_undegraded":"2024-09-17T03:39:28.916614+0000","last_fullsized":"2024-09-17T03:39:28.916614+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:22.783665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385486+0000","last_change":"2024-09-17T03:39:27.383343+0000","last_active":"2024-09-17T03:39:28.385486+0000","last_peered":"2024-09-17T03:39:28.385486+0000","last_clean":"2024-09-17T03:39:28.385486+0000","last_became_active":"2024-09-17T03:39:27.382793+0000","last_became_peered":"2024-09-17T03:39:27.382793+0000","last_unstale":"2024-09-17T03:39:28.385486+0000","last_undegraded":"2024-09-17T03:39:28.385486+0000","last_fullsized":"2024-09-17T03:39:28.385486+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:56.396187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995184+0000","last_change":"2024-09-17T03:39:27.395432+0000","last_active":"2024-09-17T03:39:28.995184+0000","last_peered":"2024-09-17T03:39:28.995184+0000","last_clean":"2024-09-17T03:39:28.995184+0000","last_became_active":"2024-09-17T03:39:27.395018+0000","last_became_peered":"2024-09-17T03:39:27.395018+0000","last_unstale":"2024-09-17T03:39:28.995184+0000","last_undegraded":"2024-09-17T03:39:28.995184+0000","last_fullsized":"2024-09-17T03:39:28.995184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:55.275244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916695+0000","last_change":"2024-09-17T03:39:27.376578+0000","last_active":"2024-09-17T03:39:28.916695+0000","last_peered":"2024-09-17T03:39:28.916695+0000","last_clean":"2024-09-17T03:39:28.916695+0000","last_became_active":"2024-09-17T03:39:27.376212+0000","last_became_peered":"2024-09-17T03:39:27.376212+0000","last_unstale":"2024-09-17T03:39:28.916695+0000","last_undegraded":"2024-09-17T03:39:28.916695+0000","last_fullsized":"2024-09-17T03:39:28.916695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:21.880149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916097+0000","last_change":"2024-09-17T03:39:27.396281+0000","last_active":"2024-09-17T03:39:28.916097+0000","last_peered":"2024-09-17T03:39:28.916097+0000","last_clean":"2024-09-17T03:39:28.916097+0000","last_became_active":"2024-09-17T03:39:27.391352+0000","last_became_peered":"2024-09-17T03:39:27.391352+0000","last_unstale":"2024-09-17T03:39:28.916097+0000","last_undegraded":"2024-09-17T03:39:28.916097+0000","last_fullsized":"2024-09-17T03:39:28.916097+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:09.339294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994449+0000","last_change":"2024-09-17T03:39:27.393386+0000","last_active":"2024-09-17T03:39:28.994449+0000","last_peered":"2024-09-17T03:39:28.994449+0000","last_clean":"2024-09-17T03:39:28.994449+0000","last_became_active":"2024-09-17T03:39:27.392056+0000","last_became_peered":"2024-09-17T03:39:27.392056+0000","last_unstale":"2024-09-17T03:39:28.994449+0000","last_undegraded":"2024-09-17T03:39:28.994449+0000","last_fullsized":"2024-09-17T03:39:28.994449+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:02.970289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.393118+0000","last_change":"2024-09-17T03:39:27.384956+0000","last_active":"2024-09-17T03:39:27.393118+0000","last_peered":"2024-09-17T03:39:27.393118+0000","last_clean":"2024-09-17T03:39:27.393118+0000","last_became_active":"2024-09-17T03:39:27.384580+0000","last_became_peered":"2024-09-17T03:39:27.384580+0000","last_unstale":"2024-09-17T03:39:27.393118+0000","last_undegraded":"2024-09-17T03:39:27.393118+0000","last_fullsized":"2024-09-17T03:39:27.393118+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:00.221061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384853+0000","last_change":"2024-09-17T03:39:27.394333+0000","last_active":"2024-09-17T03:39:28.384853+0000","last_peered":"2024-09-17T03:39:28.384853+0000","last_clean":"2024-09-17T03:39:28.384853+0000","last_became_active":"2024-09-17T03:39:27.387631+0000","last_became_peered":"2024-09-17T03:39:27.387631+0000","last_unstale":"2024-09-17T03:39:28.384853+0000","last_undegraded":"2024-09-17T03:39:28.384853+0000","last_fullsized":"2024-09-17T03:39:28.384853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:16.844366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916853+0000","last_change":"2024-09-17T03:39:26.366636+0000","last_active":"2024-09-17T03:39:28.916853+0000","last_peered":"2024-09-17T03:39:28.916853+0000","last_clean":"2024-09-17T03:39:28.916853+0000","last_became_active":"2024-09-17T03:39:26.365626+0000","last_became_peered":"2024-09-17T03:39:26.365626+0000","last_unstale":"2024-09-17T03:39:28.916853+0000","last_undegraded":"2024-09-17T03:39:28.916853+0000","last_fullsized":"2024-09-17T03:39:28.916853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:55.048635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.394522+0000","last_change":"2024-09-17T03:39:27.391006+0000","last_active":"2024-09-17T03:39:27.394522+0000","last_peered":"2024-09-17T03:39:27.394522+0000","last_clean":"2024-09-17T03:39:27.394522+0000","last_became_active":"2024-09-17T03:39:27.390408+0000","last_became_peered":"2024-09-17T03:39:27.390408+0000","last_unstale":"2024-09-17T03:39:27.394522+0000","last_undegraded":"2024-09-17T03:39:27.394522+0000","last_fullsized":"2024-09-17T03:39:27.394522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:39.928299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995139+0000","last_change":"2024-09-17T03:39:26.370163+0000","last_active":"2024-09-17T03:39:28.995139+0000","last_peered":"2024-09-17T03:39:28.995139+0000","last_clean":"2024-09-17T03:39:28.995139+0000","last_became_active":"2024-09-17T03:39:26.366699+0000","last_became_peered":"2024-09-17T03:39:26.366699+0000","last_unstale":"2024-09-17T03:39:28.995139+0000","last_undegraded":"2024-09-17T03:39:28.995139+0000","last_fullsized":"2024-09-17T03:39:28.995139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:00.568459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462447+0000","last_change":"2024-09-17T03:39:27.387294+0000","last_active":"2024-09-17T03:39:28.462447+0000","last_peered":"2024-09-17T03:39:28.462447+0000","last_clean":"2024-09-17T03:39:28.462447+0000","last_became_active":"2024-09-17T03:39:27.385228+0000","last_became_peered":"2024-09-17T03:39:27.385228+0000","last_unstale":"2024-09-17T03:39:28.462447+0000","last_undegraded":"2024-09-17T03:39:28.462447+0000","last_fullsized":"2024-09-17T03:39:28.462447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:45.349482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916274+0000","last_change":"2024-09-17T03:39:26.361592+0000","last_active":"2024-09-17T03:39:28.916274+0000","last_peered":"2024-09-17T03:39:28.916274+0000","last_clean":"2024-09-17T03:39:28.916274+0000","last_became_active":"2024-09-17T03:39:26.361257+0000","last_became_peered":"2024-09-17T03:39:26.361257+0000","last_unstale":"2024-09-17T03:39:28.916274+0000","last_undegraded":"2024-09-17T03:39:28.916274+0000","last_fullsized":"2024-09-17T03:39:28.916274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:34.558760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.386030+0000","last_change":"2024-09-17T03:39:27.403576+0000","last_active":"2024-09-17T03:39:28.386030+0000","last_peered":"2024-09-17T03:39:28.386030+0000","last_clean":"2024-09-17T03:39:28.386030+0000","last_became_active":"2024-09-17T03:39:27.400306+0000","last_became_peered":"2024-09-17T03:39:27.400306+0000","last_unstale":"2024-09-17T03:39:28.386030+0000","last_undegraded":"2024-09-17T03:39:28.386030+0000","last_fullsized":"2024-09-17T03:39:28.386030+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:59.926142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995026+0000","last_change":"2024-09-17T03:39:26.370388+0000","last_active":"2024-09-17T03:39:28.995026+0000","last_peered":"2024-09-17T03:39:28.995026+0000","last_clean":"2024-09-17T03:39:28.995026+0000","last_became_active":"2024-09-17T03:39:26.370066+0000","last_became_peered":"2024-09-17T03:39:26.370066+0000","last_unstale":"2024-09-17T03:39:28.995026+0000","last_undegraded":"2024-09-17T03:39:28.995026+0000","last_fullsized":"2024-09-17T03:39:28.995026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:36.079390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994824+0000","last_change":"2024-09-17T03:39:27.397002+0000","last_active":"2024-09-17T03:39:28.994824+0000","last_peered":"2024-09-17T03:39:28.994824+0000","last_clean":"2024-09-17T03:39:28.994824+0000","last_became_active":"2024-09-17T03:39:27.396676+0000","last_became_peered":"2024-09-17T03:39:27.396676+0000","last_unstale":"2024-09-17T03:39:28.994824+0000","last_undegraded":"2024-09-17T03:39:28.994824+0000","last_fullsized":"2024-09-17T03:39:28.994824+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:21.782027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994494+0000","last_change":"2024-09-17T03:39:26.366514+0000","last_active":"2024-09-17T03:39:28.994494+0000","last_peered":"2024-09-17T03:39:28.994494+0000","last_clean":"2024-09-17T03:39:28.994494+0000","last_became_active":"2024-09-17T03:39:26.366080+0000","last_became_peered":"2024-09-17T03:39:26.366080+0000","last_unstale":"2024-09-17T03:39:28.994494+0000","last_undegraded":"2024-09-17T03:39:28.994494+0000","last_fullsized":"2024-09-17T03:39:28.994494+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:50.953811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462272+0000","last_change":"2024-09-17T03:39:27.381811+0000","last_active":"2024-09-17T03:39:28.462272+0000","last_peered":"2024-09-17T03:39:28.462272+0000","last_clean":"2024-09-17T03:39:28.462272+0000","last_became_active":"2024-09-17T03:39:27.381547+0000","last_became_peered":"2024-09-17T03:39:27.381547+0000","last_unstale":"2024-09-17T03:39:28.462272+0000","last_undegraded":"2024-09-17T03:39:28.462272+0000","last_fullsized":"2024-09-17T03:39:28.462272+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:30.096755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994824+0000","last_change":"2024-09-17T03:39:26.364077+0000","last_active":"2024-09-17T03:39:28.994824+0000","last_peered":"2024-09-17T03:39:28.994824+0000","last_clean":"2024-09-17T03:39:28.994824+0000","last_became_active":"2024-09-17T03:39:26.363767+0000","last_became_peered":"2024-09-17T03:39:26.363767+0000","last_unstale":"2024-09-17T03:39:28.994824+0000","last_undegraded":"2024-09-17T03:39:28.994824+0000","last_fullsized":"2024-09-17T03:39:28.994824+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:18.528679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.393187+0000","last_change":"2024-09-17T03:39:27.384623+0000","last_active":"2024-09-17T03:39:27.393187+0000","last_peered":"2024-09-17T03:39:27.393187+0000","last_clean":"2024-09-17T03:39:27.393187+0000","last_became_active":"2024-09-17T03:39:27.384095+0000","last_became_peered":"2024-09-17T03:39:27.384095+0000","last_unstale":"2024-09-17T03:39:27.393187+0000","last_undegraded":"2024-09-17T03:39:27.393187+0000","last_fullsized":"2024-09-17T03:39:27.393187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:12.128566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.383739+0000","last_change":"2024-09-17T03:39:26.367594+0000","last_active":"2024-09-17T03:39:28.383739+0000","last_peered":"2024-09-17T03:39:28.383739+0000","last_clean":"2024-09-17T03:39:28.383739+0000","last_became_active":"2024-09-17T03:39:26.367016+0000","last_became_peered":"2024-09-17T03:39:26.367016+0000","last_unstale":"2024-09-17T03:39:28.383739+0000","last_undegraded":"2024-09-17T03:39:28.383739+0000","last_fullsized":"2024-09-17T03:39:28.383739+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:02.201025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384600+0000","last_change":"2024-09-17T03:39:27.389736+0000","last_active":"2024-09-17T03:39:28.384600+0000","last_peered":"2024-09-17T03:39:28.384600+0000","last_clean":"2024-09-17T03:39:28.384600+0000","last_became_active":"2024-09-17T03:39:27.389410+0000","last_became_peered":"2024-09-17T03:39:27.389410+0000","last_unstale":"2024-09-17T03:39:28.384600+0000","last_undegraded":"2024-09-17T03:39:28.384600+0000","last_fullsized":"2024-09-17T03:39:28.384600+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:44.156493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.915984+0000","last_change":"2024-09-17T03:39:26.362478+0000","last_active":"2024-09-17T03:39:28.915984+0000","last_peered":"2024-09-17T03:39:28.915984+0000","last_clean":"2024-09-17T03:39:28.915984+0000","last_became_active":"2024-09-17T03:39:26.362198+0000","last_became_peered":"2024-09-17T03:39:26.362198+0000","last_unstale":"2024-09-17T03:39:28.915984+0000","last_undegraded":"2024-09-17T03:39:28.915984+0000","last_fullsized":"2024-09-17T03:39:28.915984+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:32.503369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916281+0000","last_change":"2024-09-17T03:39:27.400479+0000","last_active":"2024-09-17T03:39:28.916281+0000","last_peered":"2024-09-17T03:39:28.916281+0000","last_clean":"2024-09-17T03:39:28.916281+0000","last_became_active":"2024-09-17T03:39:27.400133+0000","last_became_peered":"2024-09-17T03:39:27.400133+0000","last_unstale":"2024-09-17T03:39:28.916281+0000","last_undegraded":"2024-09-17T03:39:28.916281+0000","last_fullsized":"2024-09-17T03:39:28.916281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:41.519151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916848+0000","last_change":"2024-09-17T03:39:26.363130+0000","last_active":"2024-09-17T03:39:28.916848+0000","last_peered":"2024-09-17T03:39:28.916848+0000","last_clean":"2024-09-17T03:39:28.916848+0000","last_became_active":"2024-09-17T03:39:26.362028+0000","last_became_peered":"2024-09-17T03:39:26.362028+0000","last_unstale":"2024-09-17T03:39:28.916848+0000","last_undegraded":"2024-09-17T03:39:28.916848+0000","last_fullsized":"2024-09-17T03:39:28.916848+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:40.949726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462221+0000","last_change":"2024-09-17T03:39:27.371585+0000","last_active":"2024-09-17T03:39:28.462221+0000","last_peered":"2024-09-17T03:39:28.462221+0000","last_clean":"2024-09-17T03:39:28.462221+0000","last_became_active":"2024-09-17T03:39:27.371248+0000","last_became_peered":"2024-09-17T03:39:27.371248+0000","last_unstale":"2024-09-17T03:39:28.462221+0000","last_undegraded":"2024-09-17T03:39:28.462221+0000","last_fullsized":"2024-09-17T03:39:28.462221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:53.409029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385585+0000","last_change":"2024-09-17T03:39:26.372967+0000","last_active":"2024-09-17T03:39:28.385585+0000","last_peered":"2024-09-17T03:39:28.385585+0000","last_clean":"2024-09-17T03:39:28.385585+0000","last_became_active":"2024-09-17T03:39:26.372592+0000","last_became_peered":"2024-09-17T03:39:26.372592+0000","last_unstale":"2024-09-17T03:39:28.385585+0000","last_undegraded":"2024-09-17T03:39:28.385585+0000","last_fullsized":"2024-09-17T03:39:28.385585+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:36.834299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.385154+0000","last_change":"2024-09-17T03:39:27.399300+0000","last_active":"2024-09-17T03:39:28.385154+0000","last_peered":"2024-09-17T03:39:28.385154+0000","last_clean":"2024-09-17T03:39:28.385154+0000","last_became_active":"2024-09-17T03:39:27.398950+0000","last_became_peered":"2024-09-17T03:39:27.398950+0000","last_unstale":"2024-09-17T03:39:28.385154+0000","last_undegraded":"2024-09-17T03:39:28.385154+0000","last_fullsized":"2024-09-17T03:39:28.385154+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:55.112468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462448+0000","last_change":"2024-09-17T03:39:26.368725+0000","last_active":"2024-09-17T03:39:28.462448+0000","last_peered":"2024-09-17T03:39:28.462448+0000","last_clean":"2024-09-17T03:39:28.462448+0000","last_became_active":"2024-09-17T03:39:26.368393+0000","last_became_peered":"2024-09-17T03:39:26.368393+0000","last_unstale":"2024-09-17T03:39:28.462448+0000","last_undegraded":"2024-09-17T03:39:28.462448+0000","last_fullsized":"2024-09-17T03:39:28.462448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:41.186127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.397850+0000","last_change":"2024-09-17T03:39:27.391590+0000","last_active":"2024-09-17T03:39:27.397850+0000","last_peered":"2024-09-17T03:39:27.397850+0000","last_clean":"2024-09-17T03:39:27.397850+0000","last_became_active":"2024-09-17T03:39:27.391172+0000","last_became_peered":"2024-09-17T03:39:27.391172+0000","last_unstale":"2024-09-17T03:39:27.397850+0000","last_undegraded":"2024-09-17T03:39:27.397850+0000","last_fullsized":"2024-09-17T03:39:27.397850+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:06.169922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"86'6","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384872+0000","last_change":"2024-09-17T03:39:26.366363+0000","last_active":"2024-09-17T03:39:28.384872+0000","last_peered":"2024-09-17T03:39:28.384872+0000","last_clean":"2024-09-17T03:39:28.384872+0000","last_became_active":"2024-09-17T03:39:26.366011+0000","last_became_peered":"2024-09-17T03:39:26.366011+0000","last_unstale":"2024-09-17T03:39:28.384872+0000","last_undegraded":"2024-09-17T03:39:28.384872+0000","last_fullsized":"2024-09-17T03:39:28.384872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:54.273098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.383421+0000","last_change":"2024-09-17T03:39:27.385650+0000","last_active":"2024-09-17T03:39:28.383421+0000","last_peered":"2024-09-17T03:39:28.383421+0000","last_clean":"2024-09-17T03:39:28.383421+0000","last_became_active":"2024-09-17T03:39:27.382968+0000","last_became_peered":"2024-09-17T03:39:27.382968+0000","last_unstale":"2024-09-17T03:39:28.383421+0000","last_undegraded":"2024-09-17T03:39:28.383421+0000","last_fullsized":"2024-09-17T03:39:28.383421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:21.880149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916552+0000","last_change":"2024-09-17T03:39:26.360338+0000","last_active":"2024-09-17T03:39:28.916552+0000","last_peered":"2024-09-17T03:39:28.916552+0000","last_clean":"2024-09-17T03:39:28.916552+0000","last_became_active":"2024-09-17T03:39:26.360014+0000","last_became_peered":"2024-09-17T03:39:26.360014+0000","last_unstale":"2024-09-17T03:39:28.916552+0000","last_undegraded":"2024-09-17T03:39:28.916552+0000","last_fullsized":"2024-09-17T03:39:28.916552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:56.997149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916256+0000","last_change":"2024-09-17T03:39:27.379304+0000","last_active":"2024-09-17T03:39:28.916256+0000","last_peered":"2024-09-17T03:39:28.916256+0000","last_clean":"2024-09-17T03:39:28.916256+0000","last_became_active":"2024-09-17T03:39:27.378737+0000","last_became_peered":"2024-09-17T03:39:27.378737+0000","last_unstale":"2024-09-17T03:39:28.916256+0000","last_undegraded":"2024-09-17T03:39:28.916256+0000","last_fullsized":"2024-09-17T03:39:28.916256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:23.701035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384041+0000","last_change":"2024-09-17T03:39:26.356255+0000","last_active":"2024-09-17T03:39:28.384041+0000","last_peered":"2024-09-17T03:39:28.384041+0000","last_clean":"2024-09-17T03:39:28.384041+0000","last_became_active":"2024-09-17T03:39:26.355834+0000","last_became_peered":"2024-09-17T03:39:26.355834+0000","last_unstale":"2024-09-17T03:39:28.384041+0000","last_undegraded":"2024-09-17T03:39:28.384041+0000","last_fullsized":"2024-09-17T03:39:28.384041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:44.169376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384183+0000","last_change":"2024-09-17T03:39:27.387515+0000","last_active":"2024-09-17T03:39:28.384183+0000","last_peered":"2024-09-17T03:39:28.384183+0000","last_clean":"2024-09-17T03:39:28.384183+0000","last_became_active":"2024-09-17T03:39:27.387125+0000","last_became_peered":"2024-09-17T03:39:27.387125+0000","last_unstale":"2024-09-17T03:39:28.384183+0000","last_undegraded":"2024-09-17T03:39:28.384183+0000","last_fullsized":"2024-09-17T03:39:28.384183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:44.722140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.383557+0000","last_change":"2024-09-17T03:39:26.362792+0000","last_active":"2024-09-17T03:39:28.383557+0000","last_peered":"2024-09-17T03:39:28.383557+0000","last_clean":"2024-09-17T03:39:28.383557+0000","last_became_active":"2024-09-17T03:39:26.362454+0000","last_became_peered":"2024-09-17T03:39:26.362454+0000","last_unstale":"2024-09-17T03:39:28.383557+0000","last_undegraded":"2024-09-17T03:39:28.383557+0000","last_fullsized":"2024-09-17T03:39:28.383557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:20.779881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995295+0000","last_change":"2024-09-17T03:39:27.387265+0000","last_active":"2024-09-17T03:39:28.995295+0000","last_peered":"2024-09-17T03:39:28.995295+0000","last_clean":"2024-09-17T03:39:28.995295+0000","last_became_active":"2024-09-17T03:39:27.386928+0000","last_became_peered":"2024-09-17T03:39:27.386928+0000","last_unstale":"2024-09-17T03:39:28.995295+0000","last_undegraded":"2024-09-17T03:39:28.995295+0000","last_fullsized":"2024-09-17T03:39:28.995295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:29.963365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"86'8","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.382950+0000","last_change":"2024-09-17T03:39:26.369662+0000","last_active":"2024-09-17T03:39:28.382950+0000","last_peered":"2024-09-17T03:39:28.382950+0000","last_clean":"2024-09-17T03:39:28.382950+0000","last_became_active":"2024-09-17T03:39:26.369287+0000","last_became_peered":"2024-09-17T03:39:26.369287+0000","last_unstale":"2024-09-17T03:39:28.382950+0000","last_undegraded":"2024-09-17T03:39:28.382950+0000","last_fullsized":"2024-09-17T03:39:28.382950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:13.857240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995379+0000","last_change":"2024-09-17T03:39:27.390553+0000","last_active":"2024-09-17T03:39:28.995379+0000","last_peered":"2024-09-17T03:39:28.995379+0000","last_clean":"2024-09-17T03:39:28.995379+0000","last_became_active":"2024-09-17T03:39:27.390163+0000","last_became_peered":"2024-09-17T03:39:27.390163+0000","last_unstale":"2024-09-17T03:39:28.995379+0000","last_undegraded":"2024-09-17T03:39:28.995379+0000","last_fullsized":"2024-09-17T03:39:28.995379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:23.701035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994729+0000","last_change":"2024-09-17T03:39:26.367801+0000","last_active":"2024-09-17T03:39:28.994729+0000","last_peered":"2024-09-17T03:39:28.994729+0000","last_clean":"2024-09-17T03:39:28.994729+0000","last_became_active":"2024-09-17T03:39:26.367495+0000","last_became_peered":"2024-09-17T03:39:26.367495+0000","last_unstale":"2024-09-17T03:39:28.994729+0000","last_undegraded":"2024-09-17T03:39:28.994729+0000","last_fullsized":"2024-09-17T03:39:28.994729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:38.624197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462397+0000","last_change":"2024-09-17T03:39:27.382995+0000","last_active":"2024-09-17T03:39:28.462397+0000","last_peered":"2024-09-17T03:39:28.462397+0000","last_clean":"2024-09-17T03:39:28.462397+0000","last_became_active":"2024-09-17T03:39:27.381151+0000","last_became_peered":"2024-09-17T03:39:27.381151+0000","last_unstale":"2024-09-17T03:39:28.462397+0000","last_undegraded":"2024-09-17T03:39:28.462397+0000","last_fullsized":"2024-09-17T03:39:28.462397+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:29.673983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995168+0000","last_change":"2024-09-17T03:39:26.371539+0000","last_active":"2024-09-17T03:39:28.995168+0000","last_peered":"2024-09-17T03:39:28.995168+0000","last_clean":"2024-09-17T03:39:28.995168+0000","last_became_active":"2024-09-17T03:39:26.371268+0000","last_became_peered":"2024-09-17T03:39:26.371268+0000","last_unstale":"2024-09-17T03:39:28.995168+0000","last_undegraded":"2024-09-17T03:39:28.995168+0000","last_fullsized":"2024-09-17T03:39:28.995168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:43.570191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916781+0000","last_change":"2024-09-17T03:39:27.389009+0000","last_active":"2024-09-17T03:39:28.916781+0000","last_peered":"2024-09-17T03:39:28.916781+0000","last_clean":"2024-09-17T03:39:28.916781+0000","last_became_active":"2024-09-17T03:39:27.388616+0000","last_became_peered":"2024-09-17T03:39:27.388616+0000","last_unstale":"2024-09-17T03:39:28.916781+0000","last_undegraded":"2024-09-17T03:39:28.916781+0000","last_fullsized":"2024-09-17T03:39:28.916781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:44.722140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995215+0000","last_change":"2024-09-17T03:39:26.365005+0000","last_active":"2024-09-17T03:39:28.995215+0000","last_peered":"2024-09-17T03:39:28.995215+0000","last_clean":"2024-09-17T03:39:28.995215+0000","last_became_active":"2024-09-17T03:39:26.364701+0000","last_became_peered":"2024-09-17T03:39:26.364701+0000","last_unstale":"2024-09-17T03:39:28.995215+0000","last_undegraded":"2024-09-17T03:39:28.995215+0000","last_fullsized":"2024-09-17T03:39:28.995215+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:55.394041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.405085+0000","last_change":"2024-09-17T03:39:27.397628+0000","last_active":"2024-09-17T03:39:27.405085+0000","last_peered":"2024-09-17T03:39:27.405085+0000","last_clean":"2024-09-17T03:39:27.405085+0000","last_became_active":"2024-09-17T03:39:27.397132+0000","last_became_peered":"2024-09-17T03:39:27.397132+0000","last_unstale":"2024-09-17T03:39:27.405085+0000","last_undegraded":"2024-09-17T03:39:27.405085+0000","last_fullsized":"2024-09-17T03:39:27.405085+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:14.750350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.461924+0000","last_change":"2024-09-17T03:39:26.362094+0000","last_active":"2024-09-17T03:39:28.461924+0000","last_peered":"2024-09-17T03:39:28.461924+0000","last_clean":"2024-09-17T03:39:28.461924+0000","last_became_active":"2024-09-17T03:39:26.361796+0000","last_became_peered":"2024-09-17T03:39:26.361796+0000","last_unstale":"2024-09-17T03:39:28.461924+0000","last_undegraded":"2024-09-17T03:39:28.461924+0000","last_fullsized":"2024-09-17T03:39:28.461924+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:39.832861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994947+0000","last_change":"2024-09-17T03:39:27.382033+0000","last_active":"2024-09-17T03:39:28.994947+0000","last_peered":"2024-09-17T03:39:28.994947+0000","last_clean":"2024-09-17T03:39:28.994947+0000","last_became_active":"2024-09-17T03:39:27.381734+0000","last_became_peered":"2024-09-17T03:39:27.381734+0000","last_unstale":"2024-09-17T03:39:28.994947+0000","last_undegraded":"2024-09-17T03:39:28.994947+0000","last_fullsized":"2024-09-17T03:39:28.994947+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:10.191485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.379618+0000","last_change":"2024-09-17T03:39:26.369987+0000","last_active":"2024-09-17T03:39:27.379618+0000","last_peered":"2024-09-17T03:39:27.379618+0000","last_clean":"2024-09-17T03:39:27.379618+0000","last_became_active":"2024-09-17T03:39:26.369648+0000","last_became_peered":"2024-09-17T03:39:26.369648+0000","last_unstale":"2024-09-17T03:39:27.379618+0000","last_undegraded":"2024-09-17T03:39:27.379618+0000","last_fullsized":"2024-09-17T03:39:27.379618+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:23.096640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994860+0000","last_change":"2024-09-17T03:39:27.384638+0000","last_active":"2024-09-17T03:39:28.994860+0000","last_peered":"2024-09-17T03:39:28.994860+0000","last_clean":"2024-09-17T03:39:28.994860+0000","last_became_active":"2024-09-17T03:39:27.384393+0000","last_became_peered":"2024-09-17T03:39:27.384393+0000","last_unstale":"2024-09-17T03:39:28.994860+0000","last_undegraded":"2024-09-17T03:39:28.994860+0000","last_fullsized":"2024-09-17T03:39:28.994860+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:51.196239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995017+0000","last_change":"2024-09-17T03:39:26.369598+0000","last_active":"2024-09-17T03:39:28.995017+0000","last_peered":"2024-09-17T03:39:28.995017+0000","last_clean":"2024-09-17T03:39:28.995017+0000","last_became_active":"2024-09-17T03:39:26.369278+0000","last_became_peered":"2024-09-17T03:39:26.369278+0000","last_unstale":"2024-09-17T03:39:28.995017+0000","last_undegraded":"2024-09-17T03:39:28.995017+0000","last_fullsized":"2024-09-17T03:39:28.995017+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:52.448342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384745+0000","last_change":"2024-09-17T03:39:27.393580+0000","last_active":"2024-09-17T03:39:28.384745+0000","last_peered":"2024-09-17T03:39:28.384745+0000","last_clean":"2024-09-17T03:39:28.384745+0000","last_became_active":"2024-09-17T03:39:27.388666+0000","last_became_peered":"2024-09-17T03:39:27.388666+0000","last_unstale":"2024-09-17T03:39:28.384745+0000","last_undegraded":"2024-09-17T03:39:28.384745+0000","last_fullsized":"2024-09-17T03:39:28.384745+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:42.942514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994716+0000","last_change":"2024-09-17T03:39:26.363964+0000","last_active":"2024-09-17T03:39:28.994716+0000","last_peered":"2024-09-17T03:39:28.994716+0000","last_clean":"2024-09-17T03:39:28.994716+0000","last_became_active":"2024-09-17T03:39:26.363096+0000","last_became_peered":"2024-09-17T03:39:26.363096+0000","last_unstale":"2024-09-17T03:39:28.994716+0000","last_undegraded":"2024-09-17T03:39:28.994716+0000","last_fullsized":"2024-09-17T03:39:28.994716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:39.281013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994606+0000","last_change":"2024-09-17T03:39:27.388484+0000","last_active":"2024-09-17T03:39:28.994606+0000","last_peered":"2024-09-17T03:39:28.994606+0000","last_clean":"2024-09-17T03:39:28.994606+0000","last_became_active":"2024-09-17T03:39:27.388237+0000","last_became_peered":"2024-09-17T03:39:27.388237+0000","last_unstale":"2024-09-17T03:39:28.994606+0000","last_undegraded":"2024-09-17T03:39:28.994606+0000","last_fullsized":"2024-09-17T03:39:28.994606+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:57.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462344+0000","last_change":"2024-09-17T03:39:26.363615+0000","last_active":"2024-09-17T03:39:28.462344+0000","last_peered":"2024-09-17T03:39:28.462344+0000","last_clean":"2024-09-17T03:39:28.462344+0000","last_became_active":"2024-09-17T03:39:26.363331+0000","last_became_peered":"2024-09-17T03:39:26.363331+0000","last_unstale":"2024-09-17T03:39:28.462344+0000","last_undegraded":"2024-09-17T03:39:28.462344+0000","last_fullsized":"2024-09-17T03:39:28.462344+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:24.066584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995067+0000","last_change":"2024-09-17T03:39:27.406858+0000","last_active":"2024-09-17T03:39:28.995067+0000","last_peered":"2024-09-17T03:39:28.995067+0000","last_clean":"2024-09-17T03:39:28.995067+0000","last_became_active":"2024-09-17T03:39:27.406522+0000","last_became_peered":"2024-09-17T03:39:27.406522+0000","last_unstale":"2024-09-17T03:39:28.995067+0000","last_undegraded":"2024-09-17T03:39:28.995067+0000","last_fullsized":"2024-09-17T03:39:28.995067+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:45.171522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462312+0000","last_change":"2024-09-17T03:39:26.365432+0000","last_active":"2024-09-17T03:39:28.462312+0000","last_peered":"2024-09-17T03:39:28.462312+0000","last_clean":"2024-09-17T03:39:28.462312+0000","last_became_active":"2024-09-17T03:39:26.365168+0000","last_became_peered":"2024-09-17T03:39:26.365168+0000","last_unstale":"2024-09-17T03:39:28.462312+0000","last_undegraded":"2024-09-17T03:39:28.462312+0000","last_fullsized":"2024-09-17T03:39:28.462312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:31.784371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995250+0000","last_change":"2024-09-17T03:39:27.406324+0000","last_active":"2024-09-17T03:39:28.995250+0000","last_peered":"2024-09-17T03:39:28.995250+0000","last_clean":"2024-09-17T03:39:28.995250+0000","last_became_active":"2024-09-17T03:39:27.397500+0000","last_became_peered":"2024-09-17T03:39:27.397500+0000","last_unstale":"2024-09-17T03:39:28.995250+0000","last_undegraded":"2024-09-17T03:39:28.995250+0000","last_fullsized":"2024-09-17T03:39:28.995250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:09.339294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.994683+0000","last_change":"2024-09-17T03:39:26.367697+0000","last_active":"2024-09-17T03:39:28.994683+0000","last_peered":"2024-09-17T03:39:28.994683+0000","last_clean":"2024-09-17T03:39:28.994683+0000","last_became_active":"2024-09-17T03:39:26.367388+0000","last_became_peered":"2024-09-17T03:39:26.367388+0000","last_unstale":"2024-09-17T03:39:28.994683+0000","last_undegraded":"2024-09-17T03:39:28.994683+0000","last_fullsized":"2024-09-17T03:39:28.994683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:38.257378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916782+0000","last_change":"2024-09-17T03:39:27.380192+0000","last_active":"2024-09-17T03:39:28.916782+0000","last_peered":"2024-09-17T03:39:28.916782+0000","last_clean":"2024-09-17T03:39:28.916782+0000","last_became_active":"2024-09-17T03:39:27.379539+0000","last_became_peered":"2024-09-17T03:39:27.379539+0000","last_unstale":"2024-09-17T03:39:28.916782+0000","last_undegraded":"2024-09-17T03:39:28.916782+0000","last_fullsized":"2024-09-17T03:39:28.916782+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:17.324387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.462185+0000","last_change":"2024-09-17T03:39:26.371970+0000","last_active":"2024-09-17T03:39:28.462185+0000","last_peered":"2024-09-17T03:39:28.462185+0000","last_clean":"2024-09-17T03:39:28.462185+0000","last_became_active":"2024-09-17T03:39:26.371610+0000","last_became_peered":"2024-09-17T03:39:26.371610+0000","last_unstale":"2024-09-17T03:39:28.462185+0000","last_undegraded":"2024-09-17T03:39:28.462185+0000","last_fullsized":"2024-09-17T03:39:28.462185+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:18.413378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.405123+0000","last_change":"2024-09-17T03:39:27.398794+0000","last_active":"2024-09-17T03:39:27.405123+0000","last_peered":"2024-09-17T03:39:27.405123+0000","last_clean":"2024-09-17T03:39:27.405123+0000","last_became_active":"2024-09-17T03:39:27.398487+0000","last_became_peered":"2024-09-17T03:39:27.398487+0000","last_unstale":"2024-09-17T03:39:27.405123+0000","last_undegraded":"2024-09-17T03:39:27.405123+0000","last_fullsized":"2024-09-17T03:39:27.405123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:33.712789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384764+0000","last_change":"2024-09-17T03:39:26.366176+0000","last_active":"2024-09-17T03:39:28.384764+0000","last_peered":"2024-09-17T03:39:28.384764+0000","last_clean":"2024-09-17T03:39:28.384764+0000","last_became_active":"2024-09-17T03:39:26.364951+0000","last_became_peered":"2024-09-17T03:39:26.364951+0000","last_unstale":"2024-09-17T03:39:28.384764+0000","last_undegraded":"2024-09-17T03:39:28.384764+0000","last_fullsized":"2024-09-17T03:39:28.384764+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:48.280125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384404+0000","last_change":"2024-09-17T03:39:27.377664+0000","last_active":"2024-09-17T03:39:28.384404+0000","last_peered":"2024-09-17T03:39:28.384404+0000","last_clean":"2024-09-17T03:39:28.384404+0000","last_became_active":"2024-09-17T03:39:27.377328+0000","last_became_peered":"2024-09-17T03:39:27.377328+0000","last_unstale":"2024-09-17T03:39:28.384404+0000","last_undegraded":"2024-09-17T03:39:28.384404+0000","last_fullsized":"2024-09-17T03:39:28.384404+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:56.050781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.915991+0000","last_change":"2024-09-17T03:39:26.362114+0000","last_active":"2024-09-17T03:39:28.915991+0000","last_peered":"2024-09-17T03:39:28.915991+0000","last_clean":"2024-09-17T03:39:28.915991+0000","last_became_active":"2024-09-17T03:39:26.361386+0000","last_became_peered":"2024-09-17T03:39:26.361386+0000","last_unstale":"2024-09-17T03:39:28.915991+0000","last_undegraded":"2024-09-17T03:39:28.915991+0000","last_fullsized":"2024-09-17T03:39:28.915991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:28.654950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.995251+0000","last_change":"2024-09-17T03:39:27.387137+0000","last_active":"2024-09-17T03:39:28.995251+0000","last_peered":"2024-09-17T03:39:28.995251+0000","last_clean":"2024-09-17T03:39:28.995251+0000","last_became_active":"2024-09-17T03:39:27.386544+0000","last_became_peered":"2024-09-17T03:39:27.386544+0000","last_unstale":"2024-09-17T03:39:28.995251+0000","last_undegraded":"2024-09-17T03:39:28.995251+0000","last_fullsized":"2024-09-17T03:39:28.995251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:31.234798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916328+0000","last_change":"2024-09-17T03:39:26.364565+0000","last_active":"2024-09-17T03:39:28.916328+0000","last_peered":"2024-09-17T03:39:28.916328+0000","last_clean":"2024-09-17T03:39:28.916328+0000","last_became_active":"2024-09-17T03:39:26.364280+0000","last_became_peered":"2024-09-17T03:39:26.364280+0000","last_unstale":"2024-09-17T03:39:28.916328+0000","last_undegraded":"2024-09-17T03:39:28.916328+0000","last_fullsized":"2024-09-17T03:39:28.916328+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:35.358430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-17T03:39:27.392961+0000","last_change":"2024-09-17T03:39:27.389882+0000","last_active":"2024-09-17T03:39:27.392961+0000","last_peered":"2024-09-17T03:39:27.392961+0000","last_clean":"2024-09-17T03:39:27.392961+0000","last_became_active":"2024-09-17T03:39:27.389584+0000","last_became_peered":"2024-09-17T03:39:27.389584+0000","last_unstale":"2024-09-17T03:39:27.392961+0000","last_undegraded":"2024-09-17T03:39:27.392961+0000","last_fullsized":"2024-09-17T03:39:27.392961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:45.015434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.915995+0000","last_change":"2024-09-17T03:39:26.366039+0000","last_active":"2024-09-17T03:39:28.915995+0000","last_peered":"2024-09-17T03:39:28.915995+0000","last_clean":"2024-09-17T03:39:28.915995+0000","last_became_active":"2024-09-17T03:39:26.365727+0000","last_became_peered":"2024-09-17T03:39:26.365727+0000","last_unstale":"2024-09-17T03:39:28.915995+0000","last_undegraded":"2024-09-17T03:39:28.915995+0000","last_fullsized":"2024-09-17T03:39:28.915995+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:50.095971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916680+0000","last_change":"2024-09-17T03:39:27.394485+0000","last_active":"2024-09-17T03:39:28.916680+0000","last_peered":"2024-09-17T03:39:28.916680+0000","last_clean":"2024-09-17T03:39:28.916680+0000","last_became_active":"2024-09-17T03:39:27.394211+0000","last_became_peered":"2024-09-17T03:39:27.394211+0000","last_unstale":"2024-09-17T03:39:28.916680+0000","last_undegraded":"2024-09-17T03:39:28.916680+0000","last_fullsized":"2024-09-17T03:39:28.916680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:26.337809+0000","last_clean_scrub_stamp":"2024-09-17T03:39:26.337809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:46.885989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.384946+0000","last_change":"2024-09-17T03:39:26.357327+0000","last_active":"2024-09-17T03:39:28.384946+0000","last_peered":"2024-09-17T03:39:28.384946+0000","last_clean":"2024-09-17T03:39:28.384946+0000","last_became_active":"2024-09-17T03:39:26.356955+0000","last_became_peered":"2024-09-17T03:39:26.356955+0000","last_unstale":"2024-09-17T03:39:28.384946+0000","last_undegraded":"2024-09-17T03:39:28.384946+0000","last_fullsized":"2024-09-17T03:39:28.384946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:25.335663+0000","last_clean_scrub_stamp":"2024-09-17T03:39:25.335663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:08.337148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":235,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:39:28.916134+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:39:28.916134+0000","last_peered":"2024-09-17T03:39:28.916134+0000","last_clean":"2024-09-17T03:39:28.916134+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:39:28.916134+0000","last_undegraded":"2024-09-17T03:39:28.916134+0000","last_fullsized":"2024-09-17T03:39:28.916134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1064960,"data_stored":485054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":486790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1658880,"data_stored":1075422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":486778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":485658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32820,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339020,"statfs":{"total":96636764160,"available":96603156480,"internally_reserved":0,"allocated":1671168,"data_stored":1076108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":485124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1040384,"data_stored":471195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:39:32.280 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:39:32.280 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:39:32.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.546+0000 7f48cbe00640 1 -- 172.21.15.121:0/4272683988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48b0005250 msgr2=0x7f48b000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.546+0000 7f48cbe00640 1 --2- 172.21.15.121:0/4272683988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48b0005250 0x7f48b000b9c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c630 tx=0x7f48b0005830 comp rx=0 tx=0).stop 2024-09-17T03:39:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.546+0000 7f48cbe00640 1 -- 172.21.15.121:0/4272683988 shutdown_connections 2024-09-17T03:39:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.546+0000 7f48cbe00640 1 --2- 172.21.15.121:0/4272683988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48b0005250 0x7f48b000b9c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.546+0000 7f48cbe00640 1 -- 172.21.15.121:0/4272683988 >> 172.21.15.121:0/4272683988 conn(0x7f48cc0b2440 msgr2=0x7f48cc0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.547+0000 7f48cbe00640 1 -- 172.21.15.121:0/4272683988 shutdown_connections 2024-09-17T03:39:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.547+0000 7f48cbe00640 1 -- 172.21.15.121:0/4272683988 wait complete. 2024-09-17T03:39:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.549+0000 7f48cbe00640 1 Processor -- start 2024-09-17T03:39:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.549+0000 7f48cbe00640 1 -- start start 2024-09-17T03:39:32.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.550+0000 7f48cbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48b0005250 0x7f48cc09d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:32.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.550+0000 7f48cbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc0ccad0 0x7f48cc0cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:32.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.550+0000 7f48cbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48cc0acf40 0x7f48cc0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:32.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.550+0000 7f48cbe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc0b4c80 con 0x7f48cc0acf40 2024-09-17T03:39:32.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.550+0000 7f48cbe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc06f050 con 0x7f48cc0ccad0 2024-09-17T03:39:32.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.550+0000 7f48cbe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc0b4e00 con 0x7f48b0005250 2024-09-17T03:39:32.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48cb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48cc0acf40 0x7f48cc0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:32.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48cb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48cc0acf40 0x7f48cc0ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51170/0 (socket says 172.21.15.121:51170) 2024-09-17T03:39:32.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48cb400640 1 -- 172.21.15.121:0/120730781 learned_addr learned my addr 172.21.15.121:0/120730781 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:32.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48caa00640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48b0005250 0x7f48cc09d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:32.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48c2000640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc0ccad0 0x7f48cc0cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:32.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48cb400640 1 -- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48b0005250 msgr2=0x7f48cc09d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:32.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48cb400640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48b0005250 0x7f48cc09d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48cb400640 1 -- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc0ccad0 msgr2=0x7f48cc0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:32.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48cb400640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc0ccad0 0x7f48cc0cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48cb400640 1 -- 172.21.15.121:0/120730781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc0ad890 con 0x7f48cc0acf40 2024-09-17T03:39:32.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.551+0000 7f48cb400640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48cc0acf40 0x7f48cc0ad350 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c750 tx=0x7f48c4003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:32.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.552+0000 7f48c3400640 1 -- 172.21.15.121:0/120730781 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4039070 con 0x7f48cc0acf40 2024-09-17T03:39:32.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.552+0000 7f48c3400640 1 -- 172.21.15.121:0/120730781 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48c402bae0 con 0x7f48cc0acf40 2024-09-17T03:39:32.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.552+0000 7f48c3400640 1 -- 172.21.15.121:0/120730781 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4006140 con 0x7f48cc0acf40 2024-09-17T03:39:32.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.552+0000 7f48cbe00640 1 -- 172.21.15.121:0/120730781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc1f6640 con 0x7f48cc0acf40 2024-09-17T03:39:32.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.552+0000 7f48cbe00640 1 -- 172.21.15.121:0/120730781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc1f6c00 con 0x7f48cc0acf40 2024-09-17T03:39:32.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.553+0000 7f48cbe00640 1 -- 172.21.15.121:0/120730781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48cc160340 con 0x7f48cc0acf40 2024-09-17T03:39:32.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.554+0000 7f48c3400640 1 -- 172.21.15.121:0/120730781 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48c40062e0 con 0x7f48cc0acf40 2024-09-17T03:39:32.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.555+0000 7f48c3400640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48a8078b90 0x7f48a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:32.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.555+0000 7f48c3400640 1 -- 172.21.15.121:0/120730781 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f48c40ba620 con 0x7f48cc0acf40 2024-09-17T03:39:32.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.555+0000 7f48caa00640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48a8078b90 0x7f48a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:32.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.556+0000 7f48caa00640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48a8078b90 0x7f48a807b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009ad0 tx=0x7f48bc005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:32.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.560+0000 7f48c3400640 1 -- 172.21.15.121:0/120730781 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f48c4044030 con 0x7f48cc0acf40 2024-09-17T03:39:32.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.811+0000 7f48cbe00640 1 -- 172.21.15.121:0/120730781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f48cc1f2ce0 con 0x7f48cc0acf40 2024-09-17T03:39:32.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.814+0000 7f48c3400640 1 -- 172.21.15.121:0/120730781 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f48cc0ad890 con 0x7f48cc0acf40 2024-09-17T03:39:32.815 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-17T03:39:32.815 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw== 2024-09-17T03:39:32.815 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-17T03:39:32.816 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-17T03:39:32.816 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:39:32.816 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-17T03:39:32.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 -- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48a8078b90 msgr2=0x7f48a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:32.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48a8078b90 0x7f48a807b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009ad0 tx=0x7f48bc005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:32.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 -- 172.21.15.121:0/120730781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48cc0acf40 msgr2=0x7f48cc0ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:32.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48cc0acf40 0x7f48cc0ad350 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c750 tx=0x7f48c4003b80 comp rx=0 tx=0).stop 2024-09-17T03:39:32.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 -- 172.21.15.121:0/120730781 shutdown_connections 2024-09-17T03:39:32.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48a8078b90 0x7f48a807b0a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48cc0acf40 0x7f48cc0ad350 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48cc0ccad0 0x7f48cc0cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 --2- 172.21.15.121:0/120730781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f48b0005250 0x7f48cc09d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:32.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 -- 172.21.15.121:0/120730781 >> 172.21.15.121:0/120730781 conn(0x7f48cc0b2440 msgr2=0x7f48cc0b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:32.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 -- 172.21.15.121:0/120730781 shutdown_connections 2024-09-17T03:39:32.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:32.817+0000 7f48cbe00640 1 -- 172.21.15.121:0/120730781 wait complete. 2024-09-17T03:39:32.844 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:33.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.064+0000 7f9d3b200640 1 -- 172.21.15.121:0/2408730864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c070810 msgr2=0x7f9d3c0b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.064+0000 7f9d3b200640 1 --2- 172.21.15.121:0/2408730864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c070810 0x7f9d3c0b4c80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c005fd0 tx=0x7f9d2c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.064+0000 7f9d3b200640 1 -- 172.21.15.121:0/2408730864 shutdown_connections 2024-09-17T03:39:33.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.064+0000 7f9d3b200640 1 --2- 172.21.15.121:0/2408730864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d3c0b51c0 0x7f9d3c160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.064+0000 7f9d3b200640 1 --2- 172.21.15.121:0/2408730864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c070810 0x7f9d3c0b4c80 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.064+0000 7f9d3b200640 1 -- 172.21.15.121:0/2408730864 >> 172.21.15.121:0/2408730864 conn(0x7f9d3c0b2440 msgr2=0x7f9d3c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:33.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.064+0000 7f9d3b200640 1 -- 172.21.15.121:0/2408730864 shutdown_connections 2024-09-17T03:39:33.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.064+0000 7f9d3b200640 1 -- 172.21.15.121:0/2408730864 wait complete. 2024-09-17T03:39:33.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.066+0000 7f9d3b200640 1 Processor -- start 2024-09-17T03:39:33.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.066+0000 7f9d3b200640 1 -- start start 2024-09-17T03:39:33.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d3b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c070810 0x7f9d3c13ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d3b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c0b51c0 0x7f9d3c0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d3b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d3c1606c0 0x7f9d3c0acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d3b200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c0b30b0 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d3b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c06f000 con 0x7f9d3c070810 2024-09-17T03:39:33.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d3b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3c15d2a0 con 0x7f9d3c1606c0 2024-09-17T03:39:33.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d39400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c0b51c0 0x7f9d3c0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d39400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c0b51c0 0x7f9d3c0cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51184/0 (socket says 172.21.15.121:51184) 2024-09-17T03:39:33.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d39400640 1 -- 172.21.15.121:0/611181382 learned_addr learned my addr 172.21.15.121:0/611181382 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:33.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d39e00640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c070810 0x7f9d3c13ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.068+0000 7f9d3a800640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d3c1606c0 0x7f9d3c0acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d39400640 1 -- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d3c1606c0 msgr2=0x7f9d3c0acf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d39400640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d3c1606c0 0x7f9d3c0acf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d39400640 1 -- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c070810 msgr2=0x7f9d3c13ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d39400640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c070810 0x7f9d3c13ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d39400640 1 -- 172.21.15.121:0/611181382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3c13bfb0 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d3a800640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d3c1606c0 0x7f9d3c0acf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:33.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d39e00640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c070810 0x7f9d3c13ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:33.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d39400640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c0b51c0 0x7f9d3c0cf840 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800d770 tx=0x7f9d2800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:33.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d32000640 1 -- 172.21.15.121:0/611181382 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28017070 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d32000640 1 -- 172.21.15.121:0/611181382 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d28009d20 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d32000640 1 -- 172.21.15.121:0/611181382 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d280106c0 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d3b200640 1 -- 172.21.15.121:0/611181382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3c0cfd80 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.069+0000 7f9d3b200640 1 -- 172.21.15.121:0/611181382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d3c1f7130 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.070+0000 7f9d3b200640 1 -- 172.21.15.121:0/611181382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d3c15d790 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.072+0000 7f9d32000640 1 -- 172.21.15.121:0/611181382 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d2801a070 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.072+0000 7f9d32000640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9d1c078b90 0x7f9d1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.073+0000 7f9d32000640 1 -- 172.21.15.121:0/611181382 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f9d2809b0e0 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.073+0000 7f9d39e00640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9d1c078b90 0x7f9d1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.074+0000 7f9d39e00640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9d1c078b90 0x7f9d1c07b0a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c034000 tx=0x7f9d2c004ab0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:33.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.077+0000 7f9d32000640 1 -- 172.21.15.121:0/611181382 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9d28063380 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.295+0000 7f9d3b200640 1 -- 172.21.15.121:0/611181382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d3c15b370 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.296+0000 7f9d32000640 1 -- 172.21.15.121:0/611181382 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5234 (secure 0 0 0) 0x7f9d28062c80 con 0x7f9d3c0b51c0 2024-09-17T03:39:33.297 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:33.297 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":59,"btime":"2024-09-17T03:39:30:383696+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5711,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2693481679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2693481679},{"type":"v1","addr":"172.21.15.176:6837","nonce":2693481679}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6154,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2108616236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2108616236},{"type":"v1","addr":"172.21.15.121:6833","nonce":2108616236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/814740200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":814740200},{"type":"v1","addr":"172.21.15.176:6835","nonce":814740200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:26.837842+0000","modified":"2024-09-17T03:39:29.865327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6420":{"gid":6420,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3165070053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3165070053},{"type":"v1","addr":"172.21.15.121:6835","nonce":3165070053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6420,"qdb_cluster":[6420]},"id":6}]} 2024-09-17T03:39:33.297 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 59 2024-09-17T03:39:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.298+0000 7f9d3b200640 1 -- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9d1c078b90 msgr2=0x7f9d1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.298+0000 7f9d3b200640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9d1c078b90 0x7f9d1c07b0a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c034000 tx=0x7f9d2c004ab0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.298+0000 7f9d3b200640 1 -- 172.21.15.121:0/611181382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c0b51c0 msgr2=0x7f9d3c0cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.298+0000 7f9d3b200640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c0b51c0 0x7f9d3c0cf840 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800d770 tx=0x7f9d2800dc30 comp rx=0 tx=0).stop 2024-09-17T03:39:33.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.298+0000 7f9d3b200640 1 -- 172.21.15.121:0/611181382 shutdown_connections 2024-09-17T03:39:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.298+0000 7f9d3b200640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d3c1606c0 0x7f9d3c0acf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.298+0000 7f9d3b200640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9d1c078b90 0x7f9d1c07b0a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.298+0000 7f9d3b200640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d3c0b51c0 0x7f9d3c0cf840 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.298+0000 7f9d3b200640 1 --2- 172.21.15.121:0/611181382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d3c070810 0x7f9d3c13ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.298+0000 7f9d3b200640 1 -- 172.21.15.121:0/611181382 >> 172.21.15.121:0/611181382 conn(0x7f9d3c0b2440 msgr2=0x7f9d3c145b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:33.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.299+0000 7f9d3b200640 1 -- 172.21.15.121:0/611181382 shutdown_connections 2024-09-17T03:39:33.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.299+0000 7f9d3b200640 1 -- 172.21.15.121:0/611181382 wait complete. 2024-09-17T03:39:33.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:39:26.837842+0000', 'modified': '2024-09-17T03:39:29.865327+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6420}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6420': {'gid': 6420, 'name': 'a', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6835/3165070053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 3165070053}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 3165070053}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6420, 'qdb_cluster': [6420]} 2024-09-17T03:39:33.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:39:33.725 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:39:33.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.950+0000 7fe815a00640 1 -- 172.21.15.121:0/1336862632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7f4004d40 msgr2=0x7fe7f4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.950+0000 7fe815a00640 1 --2- 172.21.15.121:0/1336862632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7f4004d40 0x7fe7f4005150 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe8101610d0 tx=0x7fe7f4005830 comp rx=0 tx=0).stop 2024-09-17T03:39:33.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.950+0000 7fe815000640 1 -- 172.21.15.121:0/1336862632 reap_dead start 2024-09-17T03:39:33.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.950+0000 7fe815a00640 1 -- 172.21.15.121:0/1336862632 shutdown_connections 2024-09-17T03:39:33.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.950+0000 7fe815a00640 1 -- 172.21.15.121:0/1336862632 >> 172.21.15.121:0/1336862632 conn(0x7fe8100d07f0 msgr2=0x7fe8100b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:33.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.950+0000 7fe815a00640 1 -- 172.21.15.121:0/1336862632 shutdown_connections 2024-09-17T03:39:33.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.950+0000 7fe815a00640 1 -- 172.21.15.121:0/1336862632 wait complete. 2024-09-17T03:39:33.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.952+0000 7fe815a00640 1 Processor -- start 2024-09-17T03:39:33.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.952+0000 7fe815a00640 1 -- start start 2024-09-17T03:39:33.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe815a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7f4004d40 0x7fe810159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe815a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe810152d00 0x7fe8101f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe815a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8101f6db0 0x7fe810156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe815a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe81006da40 con 0x7fe7f4004d40 2024-09-17T03:39:33.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe815a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe81006d8c0 con 0x7fe810152d00 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe815a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe81006dbc0 con 0x7fe8101f6db0 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe80fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7f4004d40 0x7fe810159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe80fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7f4004d40 0x7fe810159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51202/0 (socket says 172.21.15.121:51202) 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe80fe00640 1 -- 172.21.15.121:0/487064148 learned_addr learned my addr 172.21.15.121:0/487064148 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe815000640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8101f6db0 0x7fe810156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe80f400640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe810152d00 0x7fe8101f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe80fe00640 1 -- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8101f6db0 msgr2=0x7fe810156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe80fe00640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8101f6db0 0x7fe810156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe80fe00640 1 -- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe810152d00 msgr2=0x7fe8101f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe80fe00640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe810152d00 0x7fe8101f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.954+0000 7fe80fe00640 1 -- 172.21.15.121:0/487064148 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8101f71c0 con 0x7fe7f4004d40 2024-09-17T03:39:33.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.955+0000 7fe80fe00640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7f4004d40 0x7fe810159430 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe800006600 tx=0x7fe8000039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:33.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.955+0000 7fe807e00640 1 -- 172.21.15.121:0/487064148 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800015070 con 0x7fe7f4004d40 2024-09-17T03:39:33.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.955+0000 7fe807e00640 1 -- 172.21.15.121:0/487064148 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe800011900 con 0x7fe7f4004d40 2024-09-17T03:39:33.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.955+0000 7fe815a00640 1 -- 172.21.15.121:0/487064148 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe810159970 con 0x7fe7f4004d40 2024-09-17T03:39:33.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.955+0000 7fe807e00640 1 -- 172.21.15.121:0/487064148 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800011d30 con 0x7fe7f4004d40 2024-09-17T03:39:33.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.955+0000 7fe815a00640 1 -- 172.21.15.121:0/487064148 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8100a9a70 con 0x7fe7f4004d40 2024-09-17T03:39:33.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.957+0000 7fe807e00640 1 -- 172.21.15.121:0/487064148 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe800018070 con 0x7fe7f4004d40 2024-09-17T03:39:33.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.958+0000 7fe807e00640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe7f0078b90 0x7fe7f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.958+0000 7fe807e00640 1 -- 172.21.15.121:0/487064148 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fe80009bcc0 con 0x7fe7f4004d40 2024-09-17T03:39:33.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.959+0000 7fe81e0d7740 1 Processor -- start 2024-09-17T03:39:33.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.959+0000 7fe80f400640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe7f0078b90 0x7fe7f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.959+0000 7fe81e0d7740 1 -- start start 2024-09-17T03:39:33.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.960+0000 7fe80f400640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe7f0078b90 0x7fe7f007b0a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe8100ae740 tx=0x7fe7fc005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.960+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x55587141ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.960+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55587100a3b0 0x5558713d4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.960+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555871012590 0x5558713d4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.960+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55587135d430 con 0x55587100a3b0 2024-09-17T03:39:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.960+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55587134d5d0 con 0x555871012590 2024-09-17T03:39:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55587133ca00 con 0x555871033270 2024-09-17T03:39:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe80f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55587100a3b0 0x5558713d4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe80f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55587100a3b0 0x5558713d4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51216/0 (socket says 172.21.15.121:51216) 2024-09-17T03:39:33.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe80f400640 1 -- 172.21.15.121:0/371339548 learned_addr learned my addr 172.21.15.121:0/371339548 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe815000640 1 --2- 172.21.15.121:0/371339548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555871012590 0x5558713d4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe80fe00640 1 --2- 172.21.15.121:0/371339548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x55587141ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe80f400640 1 -- 172.21.15.121:0/371339548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 msgr2=0x55587141ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe80f400640 1 --2- 172.21.15.121:0/371339548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x55587141ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe80f400640 1 -- 172.21.15.121:0/371339548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555871012590 msgr2=0x5558713d4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe80f400640 1 --2- 172.21.15.121:0/371339548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555871012590 0x5558713d4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.961+0000 7fe80f400640 1 -- 172.21.15.121:0/371339548 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555871305520 con 0x55587100a3b0 2024-09-17T03:39:33.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.962+0000 7fe80f400640 1 --2- 172.21.15.121:0/371339548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55587100a3b0 0x5558713d4150 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc01e520 tx=0x7fe7fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec0d911f2d659c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:33.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.962+0000 7fe804c00640 1 -- 172.21.15.121:0/371339548 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc02e070 con 0x55587100a3b0 2024-09-17T03:39:33.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.962+0000 7fe804c00640 1 -- 172.21.15.121:0/371339548 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7fc01ebd0 con 0x55587100a3b0 2024-09-17T03:39:33.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.962+0000 7fe804c00640 1 -- 172.21.15.121:0/371339548 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc01ede0 con 0x55587100a3b0 2024-09-17T03:39:33.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.963+0000 7fe81e0d7740 1 -- 172.21.15.121:0/371339548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55587100a3b0 msgr2=0x5558713d4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.963+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/371339548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55587100a3b0 0x5558713d4150 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc01e520 tx=0x7fe7fc017000 comp rx=0 tx=0).stop 2024-09-17T03:39:33.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.963+0000 7fe81e0d7740 1 -- 172.21.15.121:0/371339548 shutdown_connections 2024-09-17T03:39:33.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.963+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/371339548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555871012590 0x5558713d4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.963+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/371339548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55587100a3b0 0x5558713d4150 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.963+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/371339548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x55587141ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.963+0000 7fe81e0d7740 1 -- 172.21.15.121:0/371339548 >> 172.21.15.121:0/371339548 conn(0x5558710273c0 msgr2=0x5558713d9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:33.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.963+0000 7fe81e0d7740 1 -- 172.21.15.121:0/371339548 shutdown_connections 2024-09-17T03:39:33.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.963+0000 7fe81e0d7740 1 -- 172.21.15.121:0/371339548 wait complete. 2024-09-17T03:39:33.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.964+0000 7fe81e0d7740 1 -- start start 2024-09-17T03:39:33.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.964+0000 7fe81e0d7740 1 Processor -- start 2024-09-17T03:39:33.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558713efd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x55587141c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x55587141ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5558712e3330 con 0x555871012590 2024-09-17T03:39:33.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555871340810 con 0x55587100a3b0 2024-09-17T03:39:33.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5558710ad620 con 0x555871033270 2024-09-17T03:39:33.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe81e0d7740 10 client.0 _ll_register_callbacks cb 0x5558712e8420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:33.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe80f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x55587141c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe80f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x55587141c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51220/0 (socket says 172.21.15.121:51220) 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe80f400640 1 -- 172.21.15.121:0/2264935298 learned_addr learned my addr 172.21.15.121:0/2264935298 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe815000640 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x55587141ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe80fe00640 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558713efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe80f400640 1 -- 172.21.15.121:0/2264935298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 msgr2=0x55587141ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe80f400640 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x55587141ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe80f400640 1 -- 172.21.15.121:0/2264935298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 msgr2=0x5558713efd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe80f400640 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558713efd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.966+0000 7fe80f400640 1 -- 172.21.15.121:0/2264935298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587109e850 con 0x555871012590 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe80f400640 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x55587141c860 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc02c040 tx=0x7fe7fc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75671dcdb441c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:33.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe7f9600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:39:33.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe7f9600640 1 -- 172.21.15.121:0/2264935298 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc02e030 con 0x555871012590 2024-09-17T03:39:33.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe7f9600640 1 -- 172.21.15.121:0/2264935298 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fe7fc024040 con 0x555871012590 2024-09-17T03:39:33.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe81e0d7740 1 -- 172.21.15.121:0/2264935298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7fc01ebd0 con 0x555871012590 2024-09-17T03:39:33.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe7f9600640 1 -- 172.21.15.121:0/2264935298 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fe7fc01ed80 con 0x555871012590 2024-09-17T03:39:33.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe81e0d7740 10 client.6546 fetch_fsmap learned FSMap version 59 2024-09-17T03:39:33.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe81e0d7740 1 -- 172.21.15.121:0/2264935298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x5558711156b0 con 0x555871012590 2024-09-17T03:39:33.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe7f9600640 1 -- 172.21.15.121:0/2264935298 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7fc01ebd0 con 0x555871012590 2024-09-17T03:39:33.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe7f9600640 1 -- 172.21.15.121:0/2264935298 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 59) ==== 3502+0+0 (secure 0 0 0) 0x7fe7fc005020 con 0x555871012590 2024-09-17T03:39:33.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe81e0d7740 10 client.6546 fetch_fsmap finished waiting for FSMap version 59 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe81e0d7740 10 client.6546 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe81e0d7740 20 client.6546 populate_metadata read hostname 'smithi121' 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.967+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x555870ff1e40 0x5558713ee7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.968+0000 7fe81e0d7740 4 client.6546 mds_command: new command op to 6420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.968+0000 7fe81e0d7740 1 -- 172.21.15.121:0/2264935298 --> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55587134f520 con 0x555870ff1e40 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.968+0000 7fe80fe00640 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x555870ff1e40 0x5558713ee7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.968+0000 7fe80fe00640 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x555870ff1e40 0x5558713ee7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc9f2740971abc86 server_cookie=f6f9e780c5b7bdc3 in_seq=0 out_seq=0 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.968+0000 7fe7f9600640 10 client.6546 ms_handle_connect on v2:172.21.15.121:6834/3165070053 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.969+0000 7fe7f9600640 1 -- 172.21.15.121:0/2264935298 <== mds.0 v2:172.21.15.121:6834/3165070053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55587134f520 con 0x555870ff1e40 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.969+0000 7fe7f9600640 10 client.6546 handle_command_reply: tid=0 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.969+0000 7fe81e0d7740 1 client.6546 shutdown 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.969+0000 7fe81e0d7740 1 -- 172.21.15.121:0/2264935298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 msgr2=0x55587141c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.969+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x55587141c860 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc02c040 tx=0x7fe7fc004570 comp rx=0 tx=0).stop 2024-09-17T03:39:33.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.969+0000 7fe81e0d7740 1 -- 172.21.15.121:0/2264935298 shutdown_connections 2024-09-17T03:39:33.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.969+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x555870ff1e40 0x5558713ee7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.970+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x55587141ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.970+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x55587141c860 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.970+0000 7fe7f9600640 0 client.6546 ms_handle_reset on v2:172.21.15.121:6834/3165070053 2024-09-17T03:39:33.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.970+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/2264935298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558713efd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.970+0000 7fe81e0d7740 1 -- 172.21.15.121:0/2264935298 >> 172.21.15.121:0/2264935298 conn(0x5558710273c0 msgr2=0x5558714006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:33.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.970+0000 7fe81e0d7740 1 -- 172.21.15.121:0/2264935298 shutdown_connections 2024-09-17T03:39:33.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.970+0000 7fe81e0d7740 1 -- 172.21.15.121:0/2264935298 wait complete. 2024-09-17T03:39:33.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.970+0000 7fe81e0d7740 20 client.6546 trim_cache size 0 max 16384 2024-09-17T03:39:33.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.989+0000 7fe81e0d7740 1 Processor -- start 2024-09-17T03:39:33.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.989+0000 7fe81e0d7740 1 -- start start 2024-09-17T03:39:33.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.990+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558713faf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.990+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x555871418000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.990+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x555871418540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.990+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe810073ae0 con 0x555871012590 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.990+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe810072e40 con 0x55587100a3b0 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.990+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe810073490 con 0x555871033270 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe80f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x555871418000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe80f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x555871418000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51222/0 (socket says 172.21.15.121:51222) 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe80f400640 1 -- 172.21.15.121:0/134350151 learned_addr learned my addr 172.21.15.121:0/134350151 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe815000640 1 --2- 172.21.15.121:0/134350151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x555871418540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe80fe00640 1 --2- 172.21.15.121:0/134350151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558713faf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe80f400640 1 -- 172.21.15.121:0/134350151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 msgr2=0x555871418540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe80f400640 1 --2- 172.21.15.121:0/134350151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x555871418540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe80f400640 1 -- 172.21.15.121:0/134350151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 msgr2=0x5558713faf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:33.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe80f400640 1 --2- 172.21.15.121:0/134350151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558713faf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe80f400640 1 -- 172.21.15.121:0/134350151 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558713d9780 con 0x555871012590 2024-09-17T03:39:33.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe80f400640 1 --2- 172.21.15.121:0/134350151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x555871418000 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc012d20 tx=0x7fe7fc01ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997194d4fa006d82 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe7fbe00640 1 -- 172.21.15.121:0/134350151 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc043070 con 0x555871012590 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.991+0000 7fe7fbe00640 1 -- 172.21.15.121:0/134350151 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7fc030050 con 0x555871012590 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.992+0000 7fe7fbe00640 1 -- 172.21.15.121:0/134350151 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc02e070 con 0x555871012590 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.992+0000 7fe81e0d7740 1 -- 172.21.15.121:0/134350151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 msgr2=0x555871418000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.992+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/134350151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x555871418000 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc012d20 tx=0x7fe7fc01ea60 comp rx=0 tx=0).stop 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.992+0000 7fe81e0d7740 1 -- 172.21.15.121:0/134350151 shutdown_connections 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.992+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/134350151 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871033270 0x555871418540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.992+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/134350151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871012590 0x555871418000 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.992+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/134350151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558713faf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.992+0000 7fe81e0d7740 1 -- 172.21.15.121:0/134350151 >> 172.21.15.121:0/134350151 conn(0x5558710273c0 msgr2=0x5558713d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:33.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.992+0000 7fe81e0d7740 1 -- 172.21.15.121:0/134350151 shutdown_connections 2024-09-17T03:39:33.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.992+0000 7fe81e0d7740 1 -- 172.21.15.121:0/134350151 wait complete. 2024-09-17T03:39:33.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.993+0000 7fe81e0d7740 1 -- start start 2024-09-17T03:39:33.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.993+0000 7fe81e0d7740 1 Processor -- start 2024-09-17T03:39:33.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.995+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558714a1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.995+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871012590 0x555871444e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.995+0000 7fe81e0d7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871033270 0x5558714a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.995+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5558713ef6e0 con 0x555871033270 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.995+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5558713ede60 con 0x55587100a3b0 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.995+0000 7fe81e0d7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555871435ac0 con 0x555871012590 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.995+0000 7fe81e0d7740 10 client.0 _ll_register_callbacks cb 0x7fe7fc004390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.995+0000 7fe815000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871033270 0x5558714a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.995+0000 7fe815000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871033270 0x5558714a5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51234/0 (socket says 172.21.15.121:51234) 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.995+0000 7fe815000640 1 -- 172.21.15.121:0/1564749594 learned_addr learned my addr 172.21.15.121:0/1564749594 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe80f400640 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871012590 0x555871444e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe80fe00640 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558714a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe815000640 1 -- 172.21.15.121:0/1564749594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871012590 msgr2=0x555871444e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe815000640 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871012590 0x555871444e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe815000640 1 -- 172.21.15.121:0/1564749594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 msgr2=0x5558714a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:33.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe815000640 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558714a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe815000640 1 -- 172.21.15.121:0/1564749594 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587141ed40 con 0x555871033270 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe815000640 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871033270 0x5558714a5350 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe808036040 tx=0x7fe808004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0acf2b372592bb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe7f9600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe7f9600640 1 -- 172.21.15.121:0/1564749594 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808038040 con 0x555871033270 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe7f9600640 1 -- 172.21.15.121:0/1564749594 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fe808003b70 con 0x555871033270 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.996+0000 7fe81e0d7740 1 -- 172.21.15.121:0/1564749594 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7fc030050 con 0x555871033270 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe7f9600640 1 -- 172.21.15.121:0/1564749594 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fe808050050 con 0x555871033270 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe81e0d7740 10 client.6552 fetch_fsmap learned FSMap version 59 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe81e0d7740 1 -- 172.21.15.121:0/1564749594 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x5558714a5bf0 con 0x555871033270 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe7f9600640 1 -- 172.21.15.121:0/1564749594 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7fc030050 con 0x555871033270 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe7f9600640 1 -- 172.21.15.121:0/1564749594 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 59) ==== 3502+0+0 (secure 0 0 0) 0x7fe808053020 con 0x555871033270 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe81e0d7740 10 client.6552 fetch_fsmap finished waiting for FSMap version 59 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe81e0d7740 10 client.6552 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe81e0d7740 20 client.6552 populate_metadata read hostname 'smithi121' 2024-09-17T03:39:34.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x555871418620 0x5558713d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe81e0d7740 4 client.6552 mds_command: new command op to 6420 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe81e0d7740 1 -- 172.21.15.121:0/1564749594 --> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] -- command(tid 0: {"prefix": "status"}) -- 0x55587134afd0 con 0x555871418620 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.997+0000 7fe80fe00640 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x555871418620 0x5558713d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe80fe00640 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x555871418620 0x5558713d3110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a35efb89542e855e server_cookie=ed26f36cfbd6e9e7 in_seq=0 out_seq=0 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe7f9600640 10 client.6552 ms_handle_connect on v2:172.21.15.121:6834/3165070053 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe7f9600640 1 -- 172.21.15.121:0/1564749594 <== mds.0 v2:172.21.15.121:6834/3165070053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55587134afd0 con 0x555871418620 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe7f9600640 10 client.6552 handle_command_reply: tid=0 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe81e0d7740 1 client.6552 shutdown 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe81e0d7740 1 -- 172.21.15.121:0/1564749594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871033270 msgr2=0x5558714a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871033270 0x5558714a5350 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe808036040 tx=0x7fe808004ab0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe81e0d7740 1 -- 172.21.15.121:0/1564749594 shutdown_connections 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x555871418620 0x5558713d3110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555871033270 0x5558714a5350 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555871012590 0x555871444e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe81e0d7740 1 --2- 172.21.15.121:0/1564749594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55587100a3b0 0x5558714a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe7f9600640 0 client.6552 ms_handle_reset on v2:172.21.15.121:6834/3165070053 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.998+0000 7fe81e0d7740 1 -- 172.21.15.121:0/1564749594 >> 172.21.15.121:0/1564749594 conn(0x5558710273c0 msgr2=0x5558713d9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe81e0d7740 1 -- 172.21.15.121:0/1564749594 shutdown_connections 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe81e0d7740 1 -- 172.21.15.121:0/1564749594 wait complete. 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe81e0d7740 20 client.6552 trim_cache size 0 max 16384 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:39:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 6420, 2024-09-17T03:39:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:39:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:39:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:39:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 6.6263778369999997, 2024-09-17T03:39:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 59, 2024-09-17T03:39:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 87, 2024-09-17T03:39:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 87, 2024-09-17T03:39:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 11.666021487 2024-09-17T03:39:34.003 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:39:34.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe815a00640 1 -- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe7f0078b90 msgr2=0x7fe7f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:34.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe815a00640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe7f0078b90 0x7fe7f007b0a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe8100ae740 tx=0x7fe7fc005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:34.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe815a00640 1 -- 172.21.15.121:0/487064148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7f4004d40 msgr2=0x7fe810159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:34.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe815a00640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7f4004d40 0x7fe810159430 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe800006600 tx=0x7fe8000039c0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe815a00640 1 -- 172.21.15.121:0/487064148 shutdown_connections 2024-09-17T03:39:34.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe815a00640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8101f6db0 0x7fe810156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe815a00640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe810152d00 0x7fe8101f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe815a00640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe7f0078b90 0x7fe7f007b0a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe815a00640 1 --2- 172.21.15.121:0/487064148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7f4004d40 0x7fe810159430 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:33.999+0000 7fe815a00640 1 -- 172.21.15.121:0/487064148 >> 172.21.15.121:0/487064148 conn(0x7fe8100d07f0 msgr2=0x7fe8100b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:34.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.000+0000 7fe815a00640 1 -- 172.21.15.121:0/487064148 shutdown_connections 2024-09-17T03:39:34.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.000+0000 7fe815a00640 1 -- 172.21.15.121:0/487064148 wait complete. 2024-09-17T03:39:34.023 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:39:34.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.243+0000 7fba6a200640 1 -- 172.21.15.121:0/3735876951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba6406d800 msgr2=0x7fba640d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:34.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.243+0000 7fba6a200640 1 --2- 172.21.15.121:0/3735876951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba6406d800 0x7fba640d05b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009830 tx=0x7fba4c02a3f0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.243+0000 7fba6a200640 1 -- 172.21.15.121:0/3735876951 shutdown_connections 2024-09-17T03:39:34.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.243+0000 7fba6a200640 1 --2- 172.21.15.121:0/3735876951 >> v2:172.21.15.176:3300/0 conn(0x7fba640d0af0 0x7fba6415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.243+0000 7fba6a200640 1 --2- 172.21.15.121:0/3735876951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba6406d800 0x7fba640d05b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.243+0000 7fba6a200640 1 -- 172.21.15.121:0/3735876951 >> 172.21.15.121:0/3735876951 conn(0x7fba640b3580 msgr2=0x7fba640b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:34.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.243+0000 7fba6a200640 1 -- 172.21.15.121:0/3735876951 shutdown_connections 2024-09-17T03:39:34.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.243+0000 7fba6a200640 1 -- 172.21.15.121:0/3735876951 wait complete. 2024-09-17T03:39:34.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.245+0000 7fba6a200640 1 Processor -- start 2024-09-17T03:39:34.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.246+0000 7fba6a200640 1 -- start start 2024-09-17T03:39:34.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.247+0000 7fba6a200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba6406d800 0x7fba641f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:34.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.247+0000 7fba6a200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba640d0af0 0x7fba641f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:34.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.247+0000 7fba6a200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba6415a3e0 0x7fba641f9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:34.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.247+0000 7fba6a200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba6415d4e0 con 0x7fba640d0af0 2024-09-17T03:39:34.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.247+0000 7fba6a200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fba6415d360 con 0x7fba6406d800 2024-09-17T03:39:34.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.247+0000 7fba6a200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fba6415d660 con 0x7fba6415a3e0 2024-09-17T03:39:34.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.247+0000 7fba5be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba640d0af0 0x7fba641f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:34.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.247+0000 7fba5be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba640d0af0 0x7fba641f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51240/0 (socket says 172.21.15.121:51240) 2024-09-17T03:39:34.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.247+0000 7fba5be00640 1 -- 172.21.15.121:0/1519820198 learned_addr learned my addr 172.21.15.121:0/1519820198 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:34.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.247+0000 7fba63400640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba6406d800 0x7fba641f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:34.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.248+0000 7fba63e00640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba6415a3e0 0x7fba641f9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:34.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.248+0000 7fba5be00640 1 -- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba6415a3e0 msgr2=0x7fba641f9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:34.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.248+0000 7fba5be00640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba6415a3e0 0x7fba641f9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.248+0000 7fba5be00640 1 -- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba6406d800 msgr2=0x7fba641f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:34.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.248+0000 7fba5be00640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba6406d800 0x7fba641f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.248+0000 7fba5be00640 1 -- 172.21.15.121:0/1519820198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba64099e80 con 0x7fba640d0af0 2024-09-17T03:39:34.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.248+0000 7fba63400640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba6406d800 0x7fba641f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:39:34.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.248+0000 7fba5be00640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba640d0af0 0x7fba641f9800 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fba4c02a9e0 tx=0x7fba4c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:34.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.249+0000 7fba5b400640 1 -- 172.21.15.121:0/1519820198 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c005c90 con 0x7fba640d0af0 2024-09-17T03:39:34.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.249+0000 7fba5b400640 1 -- 172.21.15.121:0/1519820198 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba4c031e50 con 0x7fba640d0af0 2024-09-17T03:39:34.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.249+0000 7fba6a200640 1 -- 172.21.15.121:0/1519820198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba640c93a0 con 0x7fba640d0af0 2024-09-17T03:39:34.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.249+0000 7fba5b400640 1 -- 172.21.15.121:0/1519820198 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c005260 con 0x7fba640d0af0 2024-09-17T03:39:34.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.249+0000 7fba6a200640 1 -- 172.21.15.121:0/1519820198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba640cdfb0 con 0x7fba640d0af0 2024-09-17T03:39:34.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.250+0000 7fba6a200640 1 -- 172.21.15.121:0/1519820198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6415db80 con 0x7fba640d0af0 2024-09-17T03:39:34.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.251+0000 7fba5b400640 1 -- 172.21.15.121:0/1519820198 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba4c005400 con 0x7fba640d0af0 2024-09-17T03:39:34.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.252+0000 7fba5b400640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fba40078bc0 0x7fba4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:34.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.253+0000 7fba5b400640 1 -- 172.21.15.121:0/1519820198 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fba4c0bbe10 con 0x7fba640d0af0 2024-09-17T03:39:34.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.253+0000 7fba63400640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fba40078bc0 0x7fba4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:34.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.254+0000 7fba63400640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fba40078bc0 0x7fba4007b0d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fba54007fd0 tx=0x7fba54007cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:34.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.257+0000 7fba5b400640 1 -- 172.21.15.121:0/1519820198 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fba4c0bf030 con 0x7fba640d0af0 2024-09-17T03:39:34.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.480+0000 7fba6a200640 1 -- 172.21.15.121:0/1519820198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fba640c9130 con 0x7fba640d0af0 2024-09-17T03:39:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.481+0000 7fba5b400640 1 -- 172.21.15.121:0/1519820198 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) ==== 53+0+73 (secure 0 0 0) 0x7fba4c03f030 con 0x7fba640d0af0 2024-09-17T03:39:34.481 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:39:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.483+0000 7fba6a200640 1 -- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fba40078bc0 msgr2=0x7fba4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.483+0000 7fba6a200640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fba40078bc0 0x7fba4007b0d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fba54007fd0 tx=0x7fba54007cf0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.483+0000 7fba6a200640 1 -- 172.21.15.121:0/1519820198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba640d0af0 msgr2=0x7fba641f9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.483+0000 7fba6a200640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba640d0af0 0x7fba641f9800 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fba4c02a9e0 tx=0x7fba4c033c20 comp rx=0 tx=0).stop 2024-09-17T03:39:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.483+0000 7fba6a200640 1 -- 172.21.15.121:0/1519820198 shutdown_connections 2024-09-17T03:39:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.483+0000 7fba6a200640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba6415a3e0 0x7fba641f9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.483+0000 7fba6a200640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fba40078bc0 0x7fba4007b0d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.483+0000 7fba6a200640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba640d0af0 0x7fba641f9800 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.483+0000 7fba6a200640 1 --2- 172.21.15.121:0/1519820198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba6406d800 0x7fba641f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.483+0000 7fba6a200640 1 -- 172.21.15.121:0/1519820198 >> 172.21.15.121:0/1519820198 conn(0x7fba640b3580 msgr2=0x7fba6415b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.484+0000 7fba6a200640 1 -- 172.21.15.121:0/1519820198 shutdown_connections 2024-09-17T03:39:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34.484+0000 7fba6a200640 1 -- 172.21.15.121:0/1519820198 wait complete. 2024-09-17T03:39:34.509 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:39:34.509 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:39:34.509 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:39:34.509 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:39:34.510 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:39:34.510 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:39:34.510 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:39:34.510 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:39:34.510 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:39:34.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:34.510 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:39:34.546 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:39:34.546 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:39:34.546 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:39:34.546 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:34.546 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:39:34.546 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:34.546 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:34.546 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:34.546 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:39:34.546 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42482sec preferred_lft 42482sec 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:34.547 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:39:34.548 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:34.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:34.549 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:39:34.640 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:39:34.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:34.645 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:39:34.680 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:39:34.680 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:39:34.681 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:39:34.681 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:39:34.681 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:39:34.681 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:39:34.681 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:39:34.681 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:39:34.681 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:39:34.681 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:39:34.681 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:39:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:39:34.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:39:34.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:34.877 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:39:34.913 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:39:34.913 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:39:34.913 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:39:34.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:34.913 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:39:35.009 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:39:35.009 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:39:35.044 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:39:35.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:39:35.045 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:39:35.119 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:39:35.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:35.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:39:35.313 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:39:35.313 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:39:35.313 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:39:35.335 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:39:35.335 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:39:35.335 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:39:35.335 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:39:35.335 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:39:35.368 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:39:35.368 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:39:35.368 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:39:35.369 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:39:35.369 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:39:35.369 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:39:35.369 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:39:35.369 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:39:35.370 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:39:35.370 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:39:35.370 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:39:35.370 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:39:35.370 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:39:35.373 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:39:35.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:35.374 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:39:35.432 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:39:35.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:39:35.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:39:35.526 INFO:teuthology.orchestra.run.smithi121.stdout:client5801 2024-09-17T03:39:35.527 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:35.527 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:35.562 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:39:35.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.821+0000 7feeb1a00640 1 -- 172.21.15.121:0/2920675047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee90004800 msgr2=0x7fee90004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:35.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.821+0000 7feeb1a00640 1 --2- 172.21.15.121:0/2920675047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee90004800 0x7fee90004c10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7feeac163350 tx=0x7fee90005830 comp rx=0 tx=0).stop 2024-09-17T03:39:35.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.821+0000 7feeb1a00640 1 -- 172.21.15.121:0/2920675047 shutdown_connections 2024-09-17T03:39:35.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.821+0000 7feeb1a00640 1 --2- 172.21.15.121:0/2920675047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee90004800 0x7fee90004c10 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:35.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.821+0000 7feeb1a00640 1 -- 172.21.15.121:0/2920675047 >> 172.21.15.121:0/2920675047 conn(0x7feeac0b4130 msgr2=0x7feeac0b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:35.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.821+0000 7feeb1a00640 1 -- 172.21.15.121:0/2920675047 shutdown_connections 2024-09-17T03:39:35.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.822+0000 7feeb1a00640 1 -- 172.21.15.121:0/2920675047 wait complete. 2024-09-17T03:39:35.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.824+0000 7feeb1a00640 1 Processor -- start 2024-09-17T03:39:35.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.824+0000 7feeb1a00640 1 -- start start 2024-09-17T03:39:35.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeb1a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee90004800 0x7feeac157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:35.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeb1a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeac0b5a50 0x7feeac0b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:35.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeb1a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeac0b6d30 0x7feeac0b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:35.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeb1a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feeac0ceed0 con 0x7feeac0b6d30 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeb1a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feeac15f9f0 con 0x7fee90004800 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeb1a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feeac0cf050 con 0x7feeac0b5a50 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeb1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeac0b6d30 0x7feeac0b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeabe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee90004800 0x7feeac157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeabe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee90004800 0x7feeac157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:44744/0 (socket says 172.21.15.121:44744) 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeabe00640 1 -- 172.21.15.121:0/1821420366 learned_addr learned my addr 172.21.15.121:0/1821420366 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeb1000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeac0b6d30 0x7feeac0b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51258/0 (socket says 172.21.15.121:51258) 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.826+0000 7feeab400640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeac0b5a50 0x7feeac0b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.827+0000 7feeb1000640 1 -- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeac0b5a50 msgr2=0x7feeac0b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.827+0000 7feeb1000640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeac0b5a50 0x7feeac0b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.827+0000 7feeb1000640 1 -- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee90004800 msgr2=0x7feeac157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.827+0000 7feeb1000640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee90004800 0x7feeac157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:35.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.827+0000 7feeb1000640 1 -- 172.21.15.121:0/1821420366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac0b5ff0 con 0x7feeac0b6d30 2024-09-17T03:39:35.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.827+0000 7feeb1000640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeac0b6d30 0x7feeac0b12c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7feeac0cec40 tx=0x7feea40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:35.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.828+0000 7feea3e00640 1 -- 172.21.15.121:0/1821420366 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4011870 con 0x7feeac0b6d30 2024-09-17T03:39:35.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.828+0000 7feea3e00640 1 -- 172.21.15.121:0/1821420366 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feea4017070 con 0x7feeac0b6d30 2024-09-17T03:39:35.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.828+0000 7feea3e00640 1 -- 172.21.15.121:0/1821420366 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4011dc0 con 0x7feeac0b6d30 2024-09-17T03:39:35.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.828+0000 7feeb1a00640 1 -- 172.21.15.121:0/1821420366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeac0b62d0 con 0x7feeac0b6d30 2024-09-17T03:39:35.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.828+0000 7feeb1a00640 1 -- 172.21.15.121:0/1821420366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeac0b6890 con 0x7feeac0b6d30 2024-09-17T03:39:35.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.829+0000 7feeb1a00640 1 -- 172.21.15.121:0/1821420366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeac0cf5b0 con 0x7feeac0b6d30 2024-09-17T03:39:35.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.830+0000 7feea3e00640 1 -- 172.21.15.121:0/1821420366 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feea401c460 con 0x7feeac0b6d30 2024-09-17T03:39:35.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.831+0000 7feea3e00640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee8c078b90 0x7fee8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:35.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.831+0000 7feea3e00640 1 -- 172.21.15.121:0/1821420366 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7feea409b640 con 0x7feeac0b6d30 2024-09-17T03:39:35.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.832+0000 7feeabe00640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee8c078b90 0x7fee8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:35.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.832+0000 7feeabe00640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee8c078b90 0x7fee8c07b0a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fee9c004650 tx=0x7fee9c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:35.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:35.836+0000 7feea3e00640 1 -- 172.21.15.121:0/1821420366 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feea4063200 con 0x7feeac0b6d30 2024-09-17T03:39:36.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.057+0000 7feeb1a00640 1 -- 172.21.15.121:0/1821420366 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7feeac0b48c0 con 0x7feeac0b6d30 2024-09-17T03:39:36.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.057+0000 7feea3e00640 1 -- 172.21.15.121:0/1821420366 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) ==== 53+0+73 (secure 0 0 0) 0x7feea4067c30 con 0x7feeac0b6d30 2024-09-17T03:39:36.057 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:39:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 -- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee8c078b90 msgr2=0x7fee8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee8c078b90 0x7fee8c07b0a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fee9c004650 tx=0x7fee9c005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 -- 172.21.15.121:0/1821420366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeac0b6d30 msgr2=0x7feeac0b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeac0b6d30 0x7feeac0b12c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7feeac0cec40 tx=0x7feea40019b0 comp rx=0 tx=0).stop 2024-09-17T03:39:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 -- 172.21.15.121:0/1821420366 shutdown_connections 2024-09-17T03:39:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee8c078b90 0x7fee8c07b0a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeac0b6d30 0x7feeac0b12c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feeac0b5a50 0x7feeac0b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 --2- 172.21.15.121:0/1821420366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee90004800 0x7feeac157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 -- 172.21.15.121:0/1821420366 >> 172.21.15.121:0/1821420366 conn(0x7feeac0b4130 msgr2=0x7feeac0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:36.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 -- 172.21.15.121:0/1821420366 shutdown_connections 2024-09-17T03:39:36.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:36.060+0000 7feeb1a00640 1 -- 172.21.15.121:0/1821420366 wait complete. 2024-09-17T03:39:36.086 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:39:36.086 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:39:36.086 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:39:36.086 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:39:36.086 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:39:36.086 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:39:36.086 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:39:36.086 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:39:36.086 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:39:36.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:36.087 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:39:36.128 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:39:36.128 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:39:36.128 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:39:36.128 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:36.128 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:39:36.128 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42478sec preferred_lft 42478sec 2024-09-17T03:39:36.129 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::80c9:d6ff:fe9f:5926/64 scope link 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d4cd:10ff:feb7:d68f/64 scope link 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:39:36.130 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether fe:db:9e:03:5a:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:39:36.131 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::fcdb:9eff:fe03:5a3e/64 scope link 2024-09-17T03:39:36.131 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:39:36.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:36.131 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:39:36.226 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:39:36.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:36.229 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:39:36.265 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:39:36.265 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:39:36.266 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:39:36.266 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:39:36.266 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:39:36.266 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:39:36.266 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:39:36.266 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:39:36.266 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:39:36.266 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:39:36.266 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:39:36.384 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:39:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:39:36.455 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:39:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:39:36.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:36.463 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:39:36.498 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:39:36.498 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:39:36.499 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:39:36.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:36.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T03:39:36.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:39:36.595 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:39:36.630 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:39:36.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:39:36.630 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:39:36.704 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:39:36.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:36.704 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:39:36.900 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:39:36.900 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:39:36.900 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:39:36.920 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:39:36.920 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:39:36.920 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:39:36.920 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:39:36.920 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:39:36.951 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:39:36.951 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:39:36.951 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:39:36.951 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:39:36.951 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:39:36.951 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:39:36.951 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:39:36.951 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:39:36.952 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:39:36.952 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:39:36.952 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:39:36.952 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:39:36.953 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:39:36.956 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:39:36.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:36.956 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:39:37.011 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:39:37.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:39:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:39:37.094 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:39:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:39:37.102 INFO:teuthology.orchestra.run.smithi176.stdout:client6564 2024-09-17T03:39:37.102 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:37.102 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:37.137 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds ms_async_reap_threshold 1 2024-09-17T03:39:37.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.372+0000 7f16ef800640 1 -- 172.21.15.121:0/3297562833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16d0004800 msgr2=0x7f16d0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:37.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.372+0000 7f16ef800640 1 --2- 172.21.15.121:0/3297562833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16d0004800 0x7f16d0004c10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c470 tx=0x7f16d0005830 comp rx=0 tx=0).stop 2024-09-17T03:39:37.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.372+0000 7f16ef800640 1 -- 172.21.15.121:0/3297562833 shutdown_connections 2024-09-17T03:39:37.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.372+0000 7f16ef800640 1 --2- 172.21.15.121:0/3297562833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16d0004800 0x7f16d0004c10 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.372+0000 7f16ef800640 1 -- 172.21.15.121:0/3297562833 >> 172.21.15.121:0/3297562833 conn(0x7f16e80b3580 msgr2=0x7f16e80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:37.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.372+0000 7f16ef800640 1 -- 172.21.15.121:0/3297562833 shutdown_connections 2024-09-17T03:39:37.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.372+0000 7f16ef800640 1 -- 172.21.15.121:0/3297562833 wait complete. 2024-09-17T03:39:37.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.375+0000 7f16ef800640 1 Processor -- start 2024-09-17T03:39:37.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.375+0000 7f16ef800640 1 -- start start 2024-09-17T03:39:37.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.376+0000 7f16ef800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d0004800 0x7f16e80999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.376+0000 7f16ef800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16e815f340 0x7f16e815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.376+0000 7f16ef800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16e815be10 0x7f16e81f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.376+0000 7f16ef800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f16e806e150 con 0x7f16e815be10 2024-09-17T03:39:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.376+0000 7f16ef800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16e806dfd0 con 0x7f16d0004800 2024-09-17T03:39:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.376+0000 7f16ef800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16e806e2d0 con 0x7f16e815f340 2024-09-17T03:39:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.377+0000 7f16ed800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16e815be10 0x7f16e81f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.377+0000 7f16ed800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16e815be10 0x7f16e81f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51278/0 (socket says 172.21.15.121:51278) 2024-09-17T03:39:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.377+0000 7f16ed800640 1 -- 172.21.15.121:0/1332547076 learned_addr learned my addr 172.21.15.121:0/1332547076 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.377+0000 7f16e7e00640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16e815f340 0x7f16e815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:37.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.377+0000 7f16ece00640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d0004800 0x7f16e80999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:37.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.377+0000 7f16ed800640 1 -- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16e815f340 msgr2=0x7f16e815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:37.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.377+0000 7f16ed800640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16e815f340 0x7f16e815b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.377+0000 7f16ed800640 1 -- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d0004800 msgr2=0x7f16e80999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:37.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.377+0000 7f16ed800640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d0004800 0x7f16e80999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.377+0000 7f16ed800640 1 -- 172.21.15.121:0/1332547076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e815c220 con 0x7f16e815be10 2024-09-17T03:39:37.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.378+0000 7f16ed800640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16e815be10 0x7f16e81f5070 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f16e8070e30 tx=0x7f16e0011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:37.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.378+0000 7f16e4c00640 1 -- 172.21.15.121:0/1332547076 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0004b20 con 0x7f16e815be10 2024-09-17T03:39:37.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.378+0000 7f16e4c00640 1 -- 172.21.15.121:0/1332547076 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16e0004cc0 con 0x7f16e815be10 2024-09-17T03:39:37.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.378+0000 7f16e4c00640 1 -- 172.21.15.121:0/1332547076 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0003bd0 con 0x7f16e815be10 2024-09-17T03:39:37.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.378+0000 7f16ef800640 1 -- 172.21.15.121:0/1332547076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e81f8640 con 0x7f16e815be10 2024-09-17T03:39:37.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.378+0000 7f16ef800640 1 -- 172.21.15.121:0/1332547076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e81f8c00 con 0x7f16e815be10 2024-09-17T03:39:37.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.379+0000 7f16ef800640 1 -- 172.21.15.121:0/1332547076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e80d0770 con 0x7f16e815be10 2024-09-17T03:39:37.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.380+0000 7f16e4c00640 1 -- 172.21.15.121:0/1332547076 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16e0004030 con 0x7f16e815be10 2024-09-17T03:39:37.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.381+0000 7f16e4c00640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f16c8078bc0 0x7f16c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:37.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.381+0000 7f16e4c00640 1 -- 172.21.15.121:0/1332547076 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f16e009b630 con 0x7f16e815be10 2024-09-17T03:39:37.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.382+0000 7f16ece00640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f16c8078bc0 0x7f16c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:37.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.382+0000 7f16ece00640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f16c8078bc0 0x7f16c807b0d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f16dc006850 tx=0x7f16dc0067e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:37.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.386+0000 7f16e4c00640 1 -- 172.21.15.121:0/1332547076 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f16e815c220 con 0x7f16e815be10 2024-09-17T03:39:37.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.569+0000 7f16ef800640 1 -- 172.21.15.121:0/1332547076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=ms_async_reap_threshold}] v 0) -- 0x7f16e8159c20 con 0x7f16e815be10 2024-09-17T03:39:37.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.574+0000 7f16e4c00640 1 -- 172.21.15.121:0/1332547076 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=ms_async_reap_threshold}]=0 v43)=0 v43) ==== 121+0+0 (secure 0 0 0) 0x7f16e0063280 con 0x7f16e815be10 2024-09-17T03:39:37.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 -- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f16c8078bc0 msgr2=0x7f16c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:37.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f16c8078bc0 0x7f16c807b0d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f16dc006850 tx=0x7f16dc0067e0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 -- 172.21.15.121:0/1332547076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16e815be10 msgr2=0x7f16e81f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:37.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16e815be10 0x7f16e81f5070 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f16e8070e30 tx=0x7f16e0011f80 comp rx=0 tx=0).stop 2024-09-17T03:39:37.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 -- 172.21.15.121:0/1332547076 shutdown_connections 2024-09-17T03:39:37.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f16c8078bc0 0x7f16c807b0d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16e815be10 0x7f16e81f5070 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16e815f340 0x7f16e815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 --2- 172.21.15.121:0/1332547076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d0004800 0x7f16e80999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 -- 172.21.15.121:0/1332547076 >> 172.21.15.121:0/1332547076 conn(0x7f16e80b3580 msgr2=0x7f16e80cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:37.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 -- 172.21.15.121:0/1332547076 shutdown_connections 2024-09-17T03:39:37.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.577+0000 7f16ef800640 1 -- 172.21.15.121:0/1332547076 wait complete. 2024-09-17T03:39:37.602 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:37.602 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:37.637 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:37.638 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:37.713 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:39:37.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.975+0000 7f2bf5400640 1 -- 172.21.15.121:0/3287994990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bf00cd180 msgr2=0x7f2bf015d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:37.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.975+0000 7f2bf5400640 1 --2- 172.21.15.121:0/3287994990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bf00cd180 0x7f2bf015d180 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009830 tx=0x7f2bdc02a520 comp rx=0 tx=0).stop 2024-09-17T03:39:37.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.975+0000 7f2bf5400640 1 -- 172.21.15.121:0/3287994990 shutdown_connections 2024-09-17T03:39:37.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.975+0000 7f2bf5400640 1 --2- 172.21.15.121:0/3287994990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bf00cd180 0x7f2bf015d180 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.975+0000 7f2bf5400640 1 -- 172.21.15.121:0/3287994990 >> 172.21.15.121:0/3287994990 conn(0x7f2bf00d07f0 msgr2=0x7f2bf00b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:37.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.975+0000 7f2bf5400640 1 -- 172.21.15.121:0/3287994990 shutdown_connections 2024-09-17T03:39:37.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.975+0000 7f2bf5400640 1 -- 172.21.15.121:0/3287994990 wait complete. 2024-09-17T03:39:37.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.977+0000 7f2bf5400640 1 Processor -- start 2024-09-17T03:39:37.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.977+0000 7f2bf5400640 1 -- start start 2024-09-17T03:39:37.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2bf5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bf00b5250 0x7f2bf0148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2bf5400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2bf00cd180 0x7f2bf01f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2bf5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2bf015d6c0 0x7f2bf01f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2bf5400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf006e1b0 con 0x7f2bf00b5250 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2bf5400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf006e030 con 0x7f2bf015d6c0 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2bf5400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf006e330 con 0x7f2bf00cd180 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2befe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bf00b5250 0x7f2bf0148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2befe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bf00b5250 0x7f2bf0148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51288/0 (socket says 172.21.15.121:51288) 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2befe00640 1 -- 172.21.15.121:0/3136454031 learned_addr learned my addr 172.21.15.121:0/3136454031 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2bef400640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2bf00cd180 0x7f2bf01f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2bf4a00640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2bf015d6c0 0x7f2bf01f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:37.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2befe00640 1 -- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2bf00cd180 msgr2=0x7f2bf01f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:37.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2befe00640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2bf00cd180 0x7f2bf01f6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2befe00640 1 -- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2bf015d6c0 msgr2=0x7f2bf01f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:37.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2befe00640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2bf015d6c0 0x7f2bf01f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:37.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.979+0000 7f2befe00640 1 -- 172.21.15.121:0/3136454031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf0149a00 con 0x7f2bf00b5250 2024-09-17T03:39:37.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.980+0000 7f2befe00640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bf00b5250 0x7f2bf0148d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2be000c770 tx=0x7f2be000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:37.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.980+0000 7f2be7e00640 1 -- 172.21.15.121:0/3136454031 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0017070 con 0x7f2bf00b5250 2024-09-17T03:39:37.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.980+0000 7f2be7e00640 1 -- 172.21.15.121:0/3136454031 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2be0005070 con 0x7f2bf00b5250 2024-09-17T03:39:37.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.980+0000 7f2bf5400640 1 -- 172.21.15.121:0/3136454031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf0149ce0 con 0x7f2bf00b5250 2024-09-17T03:39:37.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.980+0000 7f2be7e00640 1 -- 172.21.15.121:0/3136454031 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0005460 con 0x7f2bf00b5250 2024-09-17T03:39:37.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.980+0000 7f2bf5400640 1 -- 172.21.15.121:0/3136454031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf014a2a0 con 0x7f2bf00b5250 2024-09-17T03:39:37.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.981+0000 7f2bf5400640 1 -- 172.21.15.121:0/3136454031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf006d410 con 0x7f2bf00b5250 2024-09-17T03:39:37.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.982+0000 7f2be7e00640 1 -- 172.21.15.121:0/3136454031 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2be001a070 con 0x7f2bf00b5250 2024-09-17T03:39:37.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.983+0000 7f2be7e00640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bd0078b90 0x7f2bd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:37.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.983+0000 7f2be7e00640 1 -- 172.21.15.121:0/3136454031 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f2be009a600 con 0x7f2bf00b5250 2024-09-17T03:39:37.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.984+0000 7f2bef400640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bd0078b90 0x7f2bd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:37.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.985+0000 7f2bef400640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bd0078b90 0x7f2bd007b0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc034000 tx=0x7f2bdc004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:37.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:37.988+0000 7f2be7e00640 1 -- 172.21.15.121:0/3136454031 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2be0062810 con 0x7f2bf00b5250 2024-09-17T03:39:38.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.181+0000 7f2bf5400640 1 -- 172.21.15.121:0/3136454031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2bf006fbd0 con 0x7f2bf00b5250 2024-09-17T03:39:38.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.182+0000 7f2be7e00640 1 -- 172.21.15.121:0/3136454031 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) ==== 80+0+0 (secure 0 0 0) 0x7f2be0062110 con 0x7f2bf00b5250 2024-09-17T03:39:38.182 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:39:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.184+0000 7f2bf5400640 1 -- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bd0078b90 msgr2=0x7f2bd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.184+0000 7f2bf5400640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bd0078b90 0x7f2bd007b0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc034000 tx=0x7f2bdc004730 comp rx=0 tx=0).stop 2024-09-17T03:39:38.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.184+0000 7f2bf5400640 1 -- 172.21.15.121:0/3136454031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bf00b5250 msgr2=0x7f2bf0148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.184+0000 7f2bf5400640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bf00b5250 0x7f2bf0148d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2be000c770 tx=0x7f2be000cc30 comp rx=0 tx=0).stop 2024-09-17T03:39:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.184+0000 7f2bf5400640 1 -- 172.21.15.121:0/3136454031 shutdown_connections 2024-09-17T03:39:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.184+0000 7f2bf5400640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2bf015d6c0 0x7f2bf01f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.184+0000 7f2bf5400640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2bf00cd180 0x7f2bf01f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.184+0000 7f2bf5400640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2bd0078b90 0x7f2bd007b0a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.184+0000 7f2bf5400640 1 --2- 172.21.15.121:0/3136454031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bf00b5250 0x7f2bf0148d80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.184+0000 7f2bf5400640 1 -- 172.21.15.121:0/3136454031 >> 172.21.15.121:0/3136454031 conn(0x7f2bf00d07f0 msgr2=0x7f2bf015cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.185+0000 7f2bf5400640 1 -- 172.21.15.121:0/3136454031 shutdown_connections 2024-09-17T03:39:38.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.185+0000 7f2bf5400640 1 -- 172.21.15.121:0/3136454031 wait complete. 2024-09-17T03:39:38.210 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:39:38.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:38.210 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:39:38.272 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:39:38.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:38.273 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:39:38.308 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:38.309 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:38.346 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:38.346 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:38.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:39:38.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.644+0000 7f5e3f200640 1 -- 172.21.15.121:0/2744392940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e3806d620 msgr2=0x7f5e380d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:38.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.644+0000 7f5e3f200640 1 --2- 172.21.15.121:0/2744392940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e3806d620 0x7f5e380d0630 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009830 tx=0x7f5e2402a520 comp rx=0 tx=0).stop 2024-09-17T03:39:38.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.644+0000 7f5e3f200640 1 -- 172.21.15.121:0/2744392940 shutdown_connections 2024-09-17T03:39:38.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.644+0000 7f5e3f200640 1 --2- 172.21.15.121:0/2744392940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e3806d620 0x7f5e380d0630 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.644+0000 7f5e3f200640 1 -- 172.21.15.121:0/2744392940 >> 172.21.15.121:0/2744392940 conn(0x7f5e380b3580 msgr2=0x7f5e380b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:38.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.644+0000 7f5e3f200640 1 -- 172.21.15.121:0/2744392940 shutdown_connections 2024-09-17T03:39:38.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.644+0000 7f5e3f200640 1 -- 172.21.15.121:0/2744392940 wait complete. 2024-09-17T03:39:38.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.647+0000 7f5e3f200640 1 Processor -- start 2024-09-17T03:39:38.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.647+0000 7f5e3f200640 1 -- start start 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.648+0000 7f5e3f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e3806d620 0x7f5e380c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.648+0000 7f5e3f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e3806da30 0x7f5e380994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.648+0000 7f5e3f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e380cca80 0x7f5e3815dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.648+0000 7f5e3f200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5e380d0f00 con 0x7f5e3806da30 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.648+0000 7f5e3f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5e380d0d80 con 0x7f5e380cca80 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.648+0000 7f5e3f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5e380cbf00 con 0x7f5e3806d620 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.648+0000 7f5e37400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e3806da30 0x7f5e380994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.648+0000 7f5e37400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e3806da30 0x7f5e380994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51294/0 (socket says 172.21.15.121:51294) 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.648+0000 7f5e37400640 1 -- 172.21.15.121:0/744781581 learned_addr learned my addr 172.21.15.121:0/744781581 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.649+0000 7f5e3d200640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e380cca80 0x7f5e3815dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.649+0000 7f5e37e00640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e3806d620 0x7f5e380c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.649+0000 7f5e37400640 1 -- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e3806d620 msgr2=0x7f5e380c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:38.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.649+0000 7f5e37400640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e3806d620 0x7f5e380c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.649+0000 7f5e37400640 1 -- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e380cca80 msgr2=0x7f5e3815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:38.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.649+0000 7f5e37400640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e380cca80 0x7f5e3815dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.649+0000 7f5e37400640 1 -- 172.21.15.121:0/744781581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3814e700 con 0x7f5e3806da30 2024-09-17T03:39:38.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.649+0000 7f5e37e00640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e3806d620 0x7f5e380c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:38.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.649+0000 7f5e37400640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e3806da30 0x7f5e380994c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009950 tx=0x7f5e24033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:38.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.649+0000 7f5e2fe00640 1 -- 172.21.15.121:0/744781581 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24031d60 con 0x7f5e3806da30 2024-09-17T03:39:38.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.650+0000 7f5e2fe00640 1 -- 172.21.15.121:0/744781581 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e24005020 con 0x7f5e3806da30 2024-09-17T03:39:38.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.650+0000 7f5e2fe00640 1 -- 172.21.15.121:0/744781581 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24005470 con 0x7f5e3806da30 2024-09-17T03:39:38.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.650+0000 7f5e3f200640 1 -- 172.21.15.121:0/744781581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e380b02d0 con 0x7f5e3806da30 2024-09-17T03:39:38.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.650+0000 7f5e3f200640 1 -- 172.21.15.121:0/744781581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e380b0890 con 0x7f5e3806da30 2024-09-17T03:39:38.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.651+0000 7f5e3f200640 1 -- 172.21.15.121:0/744781581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e380b0040 con 0x7f5e3806da30 2024-09-17T03:39:38.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.652+0000 7f5e2fe00640 1 -- 172.21.15.121:0/744781581 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e240047a0 con 0x7f5e3806da30 2024-09-17T03:39:38.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.653+0000 7f5e2fe00640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e18078bc0 0x7f5e1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:38.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.653+0000 7f5e2fe00640 1 -- 172.21.15.121:0/744781581 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f5e240bc170 con 0x7f5e3806da30 2024-09-17T03:39:38.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.654+0000 7f5e37e00640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e18078bc0 0x7f5e1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:38.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.654+0000 7f5e37e00640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e18078bc0 0x7f5e1807b0d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5e28007fd0 tx=0x7f5e28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:38.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.657+0000 7f5e2fe00640 1 -- 172.21.15.121:0/744781581 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e3814e700 con 0x7f5e3806da30 2024-09-17T03:39:38.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.851+0000 7f5e3f200640 1 -- 172.21.15.121:0/744781581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5e380d05b0 con 0x7f5e3806da30 2024-09-17T03:39:38.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.852+0000 7f5e2fe00640 1 -- 172.21.15.121:0/744781581 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) ==== 80+0+0 (secure 0 0 0) 0x7f5e2403f030 con 0x7f5e3806da30 2024-09-17T03:39:38.852 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:39:38.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 -- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e18078bc0 msgr2=0x7f5e1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:38.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e18078bc0 0x7f5e1807b0d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5e28007fd0 tx=0x7f5e28009040 comp rx=0 tx=0).stop 2024-09-17T03:39:38.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 -- 172.21.15.121:0/744781581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e3806da30 msgr2=0x7f5e380994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:38.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e3806da30 0x7f5e380994c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009950 tx=0x7f5e24033ce0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 -- 172.21.15.121:0/744781581 shutdown_connections 2024-09-17T03:39:38.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e380cca80 0x7f5e3815dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5e18078bc0 0x7f5e1807b0d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e3806da30 0x7f5e380994c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 --2- 172.21.15.121:0/744781581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e3806d620 0x7f5e380c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:38.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 -- 172.21.15.121:0/744781581 >> 172.21.15.121:0/744781581 conn(0x7f5e380b3580 msgr2=0x7f5e3806dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:38.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 -- 172.21.15.121:0/744781581 shutdown_connections 2024-09-17T03:39:38.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:38.854+0000 7f5e3f200640 1 -- 172.21.15.121:0/744781581 wait complete. 2024-09-17T03:39:38.879 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:39:38.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:38.879 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:39:38.942 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:39:38.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:38.942 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:39:38.978 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:39.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.198+0000 7fc76f800640 1 -- 172.21.15.121:0/2192766278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7680ce510 msgr2=0x7fc7680cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.198+0000 7fc76f800640 1 --2- 172.21.15.121:0/2192766278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7680ce510 0x7fc7680cea40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc76806ea00 tx=0x7fc75402a970 comp rx=0 tx=0).stop 2024-09-17T03:39:39.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.199+0000 7fc76f800640 1 -- 172.21.15.121:0/2192766278 shutdown_connections 2024-09-17T03:39:39.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.199+0000 7fc76f800640 1 --2- 172.21.15.121:0/2192766278 >> v2:172.21.15.176:3300/0 conn(0x7fc7680b3b30 0x7fc7680b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.199+0000 7fc76f800640 1 --2- 172.21.15.121:0/2192766278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7680ce510 0x7fc7680cea40 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.199+0000 7fc76f800640 1 --2- 172.21.15.121:0/2192766278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc768160e40 0x7fc768153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.199+0000 7fc76f800640 1 -- 172.21.15.121:0/2192766278 >> 172.21.15.121:0/2192766278 conn(0x7fc7680cd5c0 msgr2=0x7fc7680cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:39.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.199+0000 7fc76f800640 1 -- 172.21.15.121:0/2192766278 shutdown_connections 2024-09-17T03:39:39.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.199+0000 7fc76f800640 1 -- 172.21.15.121:0/2192766278 wait complete. 2024-09-17T03:39:39.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.201+0000 7fc76f800640 1 Processor -- start 2024-09-17T03:39:39.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.201+0000 7fc76f800640 1 -- start start 2024-09-17T03:39:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76f800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7680b3b30 0x7fc768155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76f800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680ce510 0x7fc7680afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76f800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7681458b0 0x7fc768145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76f800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc76815d4c0 con 0x7fc7681458b0 2024-09-17T03:39:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76f800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc76815d340 con 0x7fc7680ce510 2024-09-17T03:39:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76f800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc76815d640 con 0x7fc7680b3b30 2024-09-17T03:39:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76d800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7681458b0 0x7fc768145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76d800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7681458b0 0x7fc768145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51326/0 (socket says 172.21.15.121:51326) 2024-09-17T03:39:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76d800640 1 -- 172.21.15.121:0/3072062501 learned_addr learned my addr 172.21.15.121:0/3072062501 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:39.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc767e00640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680ce510 0x7fc7680afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76ce00640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7680b3b30 0x7fc768155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76d800640 1 -- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7680b3b30 msgr2=0x7fc768155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76d800640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7680b3b30 0x7fc768155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76d800640 1 -- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680ce510 msgr2=0x7fc7680afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76d800640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680ce510 0x7fc7680afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.203+0000 7fc76d800640 1 -- 172.21.15.121:0/3072062501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc768156600 con 0x7fc7681458b0 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.204+0000 7fc76d800640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7681458b0 0x7fc768145cc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc76000e680 tx=0x7fc76000eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.204+0000 7fc764c00640 1 -- 172.21.15.121:0/3072062501 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76000cab0 con 0x7fc7681458b0 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.204+0000 7fc764c00640 1 -- 172.21.15.121:0/3072062501 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc76000cc50 con 0x7fc7681458b0 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.204+0000 7fc76f800640 1 -- 172.21.15.121:0/3072062501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7681568e0 con 0x7fc7681458b0 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.204+0000 7fc764c00640 1 -- 172.21.15.121:0/3072062501 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760005020 con 0x7fc7681458b0 2024-09-17T03:39:39.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.204+0000 7fc76f800640 1 -- 172.21.15.121:0/3072062501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc768146930 con 0x7fc7681458b0 2024-09-17T03:39:39.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.205+0000 7fc76f800640 1 -- 172.21.15.121:0/3072062501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc768146b90 con 0x7fc7681458b0 2024-09-17T03:39:39.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.206+0000 7fc764c00640 1 -- 172.21.15.121:0/3072062501 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7600051c0 con 0x7fc7681458b0 2024-09-17T03:39:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.207+0000 7fc764c00640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc748078b90 0x7fc74807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.207+0000 7fc764c00640 1 -- 172.21.15.121:0/3072062501 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fc76009b620 con 0x7fc7681458b0 2024-09-17T03:39:39.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.208+0000 7fc76ce00640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc748078b90 0x7fc74807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.209+0000 7fc76ce00640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc748078b90 0x7fc74807b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc758009b30 tx=0x7fc758005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:39.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.212+0000 7fc764c00640 1 -- 172.21.15.121:0/3072062501 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc760063270 con 0x7fc7681458b0 2024-09-17T03:39:39.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.431+0000 7fc76f800640 1 -- 172.21.15.121:0/3072062501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc768145210 con 0x7fc7681458b0 2024-09-17T03:39:39.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.432+0000 7fc764c00640 1 -- 172.21.15.121:0/3072062501 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5234 (secure 0 0 0) 0x7fc760067ca0 con 0x7fc7681458b0 2024-09-17T03:39:39.432 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:39.432 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":59,"btime":"2024-09-17T03:39:30:383696+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5711,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2693481679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2693481679},{"type":"v1","addr":"172.21.15.176:6837","nonce":2693481679}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6154,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2108616236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2108616236},{"type":"v1","addr":"172.21.15.121:6833","nonce":2108616236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/814740200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":814740200},{"type":"v1","addr":"172.21.15.176:6835","nonce":814740200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:26.837842+0000","modified":"2024-09-17T03:39:29.865327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6420":{"gid":6420,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3165070053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3165070053},{"type":"v1","addr":"172.21.15.121:6835","nonce":3165070053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6420,"qdb_cluster":[6420]},"id":6}]} 2024-09-17T03:39:39.432 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 59 2024-09-17T03:39:39.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.434+0000 7fc76f800640 1 -- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc748078b90 msgr2=0x7fc74807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.434+0000 7fc76f800640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc748078b90 0x7fc74807b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc758009b30 tx=0x7fc758005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.434+0000 7fc76f800640 1 -- 172.21.15.121:0/3072062501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7681458b0 msgr2=0x7fc768145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.434+0000 7fc76f800640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7681458b0 0x7fc768145cc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc76000e680 tx=0x7fc76000eb40 comp rx=0 tx=0).stop 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.435+0000 7fc76f800640 1 -- 172.21.15.121:0/3072062501 shutdown_connections 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.435+0000 7fc76f800640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc748078b90 0x7fc74807b0a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.435+0000 7fc76f800640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7681458b0 0x7fc768145cc0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.435+0000 7fc76f800640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680ce510 0x7fc7680afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.435+0000 7fc76f800640 1 --2- 172.21.15.121:0/3072062501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7680b3b30 0x7fc768155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.435+0000 7fc76f800640 1 -- 172.21.15.121:0/3072062501 >> 172.21.15.121:0/3072062501 conn(0x7fc7680cd5c0 msgr2=0x7fc76815c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.435+0000 7fc76f800640 1 -- 172.21.15.121:0/3072062501 shutdown_connections 2024-09-17T03:39:39.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.435+0000 7fc76f800640 1 -- 172.21.15.121:0/3072062501 wait complete. 2024-09-17T03:39:39.457 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-17T03:39:39.694 INFO:teuthology.orchestra.run.smithi121.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":23,"msgr_send_messages":23,"msgr_recv_bytes":6970,"msgr_send_bytes":12163,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.013876562,"msgr_running_send_time":0.001324212,"msgr_running_recv_time":0.008827125,"msgr_running_fast_dispatch_time":0.000443743,"msgr_send_messages_queue_lat":{"avgcount":22,"sum":0.261860596,"avgtime":0.011902754},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":100,"msgr_send_messages":92,"msgr_recv_bytes":136785,"msgr_send_bytes":53479,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.016733290,"msgr_running_send_time":0.005062023,"msgr_running_recv_time":0.017074411,"msgr_running_fast_dispatch_time":0.000318256,"msgr_send_messages_queue_lat":{"avgcount":91,"sum":0.166579964,"avgtime":0.001830549},"msgr_handle_ack_lat":{"avgcount":29,"sum":0.000010378,"avgtime":0.000000357},"msgr_recv_encrypted_bytes":125728,"msgr_send_encrypted_bytes":11728},"AsyncMessenger::Worker-2":{"msgr_recv_messages":24,"msgr_send_messages":27,"msgr_recv_bytes":6330,"msgr_send_bytes":78430,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.009727478,"msgr_running_send_time":0.001437981,"msgr_running_recv_time":0.007605449,"msgr_running_fast_dispatch_time":0.000480886,"msgr_send_messages_queue_lat":{"avgcount":26,"sum":0.131520340,"avgtime":0.005058474},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000002701,"avgtime":0.000000540},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":63600},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.001958099,"avgtime":0.000036261}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000055096,"avgtime":0.000027548}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.004924632,"avgtime":0.000169814},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":55,"traverse_hit":53,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197031,"rdpos":0,"jlat":{"avgcount":5,"sum":0.011877226,"avgtime":0.002375445},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":109876,"heap":332230656},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":26,"sum":0.004319732,"avgtime":0.000166143},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000276351,"avgtime":0.000138175},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000328549,"avgtime":0.000328549},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":28,"average_load":14,"avg_session_uptime":1,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225505,"buffer_anon_items":87,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53984,"mds_co_items":218,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13847,"op_resend":37,"op_reply":43,"op_latency":{"avgcount":43,"sum":0.954987697,"avgtime":0.022209016},"op_inflight":0,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":87,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":143,"get_sum":133215,"get_or_fail_fail":0,"get_or_fail_success":143,"take":0,"take_sum":0,"put":143,"put_sum":133215,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13847,"put":43,"put_sum":13847,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x564e9c0d1520":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2727,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":5,"put_sum":2727,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:39:39.696 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 6970, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 23, "msgr_running_fast_dispatch_time": 0.000443743, "msgr_running_recv_time": 0.008827125, "msgr_running_send_time": 0.001324212, "msgr_running_total_time": 0.013876562, "msgr_send_bytes": 12163, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 23, "msgr_send_messages_queue_lat": { "avgcount": 22, "avgtime": 0.011902754, "sum": 0.261860596 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 29, "avgtime": 3.57e-07, "sum": 1.0378e-05 }, "msgr_recv_bytes": 136785, "msgr_recv_encrypted_bytes": 125728, "msgr_recv_messages": 100, "msgr_running_fast_dispatch_time": 0.000318256, "msgr_running_recv_time": 0.017074411, "msgr_running_send_time": 0.005062023, "msgr_running_total_time": 0.01673329, "msgr_send_bytes": 53479, "msgr_send_encrypted_bytes": 11728, "msgr_send_messages": 92, "msgr_send_messages_queue_lat": { "avgcount": 91, "avgtime": 0.001830549, "sum": 0.166579964 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 5.4e-07, "sum": 2.701e-06 }, "msgr_recv_bytes": 6330, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 24, "msgr_running_fast_dispatch_time": 0.000480886, "msgr_running_recv_time": 0.007605449, "msgr_running_send_time": 0.001437981, "msgr_running_total_time": 0.009727478, "msgr_send_bytes": 78430, "msgr_send_encrypted_bytes": 63600, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 26, "avgtime": 0.005058474, "sum": 0.13152034 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 3.6261e-05, "sum": 0.001958099 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 2.7548e-05, "sum": 5.5096e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000169814, "sum": 0.004924632 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 55, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 53, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002375445, "sum": 0.011877226 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197031 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 332230656, "ino": 13, "ino+": 13, "ino-": 0, "rss": 109876 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 26, "avgtime": 0.000166143, "sum": 0.004319732 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000138175, "sum": 0.000276351 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000328549, "sum": 0.000328549 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 14, "avg_session_uptime": 1, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 28 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225505, "buffer_anon_items": 87, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53984, "mds_co_items": 218, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 87, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 43, "avgtime": 0.022209016, "sum": 0.954987697 }, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 37, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13847, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 143, "get_or_fail_fail": 0, "get_or_fail_success": 143, "get_started": 0, "get_sum": 133215, "max": 104857600, "put": 143, "put_sum": 133215, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13847, "take": 43, "take_sum": 13847, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x564e9c0d1520": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2727, "max": 3758096384, "put": 5, "put_sum": 2727, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:39:39.696 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 session ls 2024-09-17T03:39:39.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.920+0000 7f6f26200640 1 -- 172.21.15.121:0/231696613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f2006ddc0 msgr2=0x7f6f200d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.920+0000 7f6f26200640 1 --2- 172.21.15.121:0/231696613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f2006ddc0 0x7f6f200d05b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6f200cdc20 tx=0x7f6f0c02a410 comp rx=0 tx=0).stop 2024-09-17T03:39:39.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.921+0000 7f6f26200640 1 -- 172.21.15.121:0/231696613 shutdown_connections 2024-09-17T03:39:39.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.921+0000 7f6f26200640 1 --2- 172.21.15.121:0/231696613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f2006ddc0 0x7f6f200d05b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.921+0000 7f6f26200640 1 --2- 172.21.15.121:0/231696613 >> v2:172.21.15.176:3300/0 conn(0x7f6f2015a3e0 0x7f6f2006d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.921+0000 7f6f26200640 1 -- 172.21.15.121:0/231696613 >> 172.21.15.121:0/231696613 conn(0x7f6f200b3580 msgr2=0x7f6f200b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:39.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.921+0000 7f6f26200640 1 -- 172.21.15.121:0/231696613 shutdown_connections 2024-09-17T03:39:39.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.921+0000 7f6f26200640 1 -- 172.21.15.121:0/231696613 wait complete. 2024-09-17T03:39:39.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.923+0000 7f6f26200640 1 Processor -- start 2024-09-17T03:39:39.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.923+0000 7f6f26200640 1 -- start start 2024-09-17T03:39:39.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.924+0000 7f6f26200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f2006ddc0 0x7f6f20154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.924+0000 7f6f26200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f200d0af0 0x7f6f201590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.924+0000 7f6f26200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f2015a3e0 0x7f6f20159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.924+0000 7f6f26200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2006f560 con 0x7f6f200d0af0 2024-09-17T03:39:39.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.924+0000 7f6f26200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20161190 con 0x7f6f2015a3e0 2024-09-17T03:39:39.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.924+0000 7f6f26200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2006f6e0 con 0x7f6f2006ddc0 2024-09-17T03:39:39.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.925+0000 7f6f1ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f200d0af0 0x7f6f201590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.925+0000 7f6f1ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f200d0af0 0x7f6f201590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51354/0 (socket says 172.21.15.121:51354) 2024-09-17T03:39:39.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.925+0000 7f6f1ea00640 1 -- 172.21.15.121:0/2875240980 learned_addr learned my addr 172.21.15.121:0/2875240980 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:39.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.925+0000 7f6f1fe00640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f2015a3e0 0x7f6f20159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.925+0000 7f6f1f400640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f2006ddc0 0x7f6f20154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.925+0000 7f6f1ea00640 1 -- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f2006ddc0 msgr2=0x7f6f20154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.925+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f2006ddc0 0x7f6f20154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.925+0000 7f6f1ea00640 1 -- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f2015a3e0 msgr2=0x7f6f20159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.925+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f2015a3e0 0x7f6f20159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.925+0000 7f6f1ea00640 1 -- 172.21.15.121:0/2875240980 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f200c40e0 con 0x7f6f200d0af0 2024-09-17T03:39:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.926+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f200d0af0 0x7f6f201590e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009920 tx=0x7f6f0c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:39.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.926+0000 7f6f17400640 1 -- 172.21.15.121:0/2875240980 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c031d60 con 0x7f6f200d0af0 2024-09-17T03:39:39.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.926+0000 7f6f17400640 1 -- 172.21.15.121:0/2875240980 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f0c033e10 con 0x7f6f200d0af0 2024-09-17T03:39:39.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.926+0000 7f6f17400640 1 -- 172.21.15.121:0/2875240980 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c005260 con 0x7f6f200d0af0 2024-09-17T03:39:39.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.926+0000 7f6f26200640 1 -- 172.21.15.121:0/2875240980 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2009dc40 con 0x7f6f200d0af0 2024-09-17T03:39:39.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.926+0000 7f6f26200640 1 -- 172.21.15.121:0/2875240980 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f200c7e10 con 0x7f6f200d0af0 2024-09-17T03:39:39.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.928+0000 7f6f17400640 1 -- 172.21.15.121:0/2875240980 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f0c005400 con 0x7f6f200d0af0 2024-09-17T03:39:39.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.929+0000 7f6f17400640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f00078bc0 0x7f6f0007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.929+0000 7f6f17400640 1 -- 172.21.15.121:0/2875240980 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f6f0c0bbff0 con 0x7f6f200d0af0 2024-09-17T03:39:39.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.929+0000 7f6f1f400640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f00078bc0 0x7f6f0007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.930+0000 7f6f2d2d9740 1 Processor -- start 2024-09-17T03:39:39.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.930+0000 7f6f2d2d9740 1 -- start start 2024-09-17T03:39:39.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.930+0000 7f6f1f400640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f00078bc0 0x7f6f0007b0d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009b30 tx=0x7f6f10005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:39.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.931+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d5e390 0x557f9414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.931+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d354d0 0x557f9412fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.931+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d3d6b0 0x557f941302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.931+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557f940786f0 con 0x557f93d5e390 2024-09-17T03:39:39.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x557f94067b20 con 0x557f93d3d6b0 2024-09-17T03:39:39.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x557f9406b930 con 0x557f93d354d0 2024-09-17T03:39:39.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d5e390 0x557f9414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d5e390 0x557f9414d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51356/0 (socket says 172.21.15.121:51356) 2024-09-17T03:39:39.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1f400640 1 -- 172.21.15.121:0/1761626033 learned_addr learned my addr 172.21.15.121:0/1761626033 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:39.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/1761626033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d354d0 0x557f9412fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1fe00640 1 --2- 172.21.15.121:0/1761626033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d3d6b0 0x557f941302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1f400640 1 -- 172.21.15.121:0/1761626033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d354d0 msgr2=0x557f9412fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:39.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1f400640 1 --2- 172.21.15.121:0/1761626033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d354d0 0x557f9412fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1f400640 1 -- 172.21.15.121:0/1761626033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d3d6b0 msgr2=0x557f941302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:39.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1f400640 1 --2- 172.21.15.121:0/1761626033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d3d6b0 0x557f941302d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1f400640 1 -- 172.21.15.121:0/1761626033 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f93dc9970 con 0x557f93d5e390 2024-09-17T03:39:39.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.932+0000 7f6f1f400640 1 --2- 172.21.15.121:0/1761626033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d5e390 0x557f9414d0c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6f10011ec0 tx=0x7f6f10014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13256c59af4373a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:39.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.933+0000 7f6f0b400640 1 -- 172.21.15.121:0/1761626033 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000ebf0 con 0x557f93d5e390 2024-09-17T03:39:39.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.933+0000 7f6f0b400640 1 -- 172.21.15.121:0/1761626033 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f10004020 con 0x557f93d5e390 2024-09-17T03:39:39.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.933+0000 7f6f0b400640 1 -- 172.21.15.121:0/1761626033 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10004410 con 0x557f93d5e390 2024-09-17T03:39:39.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.934+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1761626033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d5e390 msgr2=0x557f9414d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.934+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/1761626033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d5e390 0x557f9414d0c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6f10011ec0 tx=0x7f6f10014000 comp rx=0 tx=0).stop 2024-09-17T03:39:39.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.934+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1761626033 shutdown_connections 2024-09-17T03:39:39.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.934+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/1761626033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d3d6b0 0x557f941302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.934+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/1761626033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d354d0 0x557f9412fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.934+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/1761626033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d5e390 0x557f9414d0c0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.934+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1761626033 >> 172.21.15.121:0/1761626033 conn(0x557f93d524e0 msgr2=0x557f94105fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:39.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.934+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1761626033 shutdown_connections 2024-09-17T03:39:39.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.934+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1761626033 wait complete. 2024-09-17T03:39:39.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.935+0000 7f6f2d2d9740 1 -- start start 2024-09-17T03:39:39.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.935+0000 7f6f2d2d9740 1 Processor -- start 2024-09-17T03:39:39.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.936+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f941428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.936+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d3d6b0 0x557f94142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d5e390 0x557f941292e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557f93dd8740 con 0x557f93d354d0 2024-09-17T03:39:39.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x557f9400e290 con 0x557f93d3d6b0 2024-09-17T03:39:39.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x557f94101040 con 0x557f93d5e390 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f2d2d9740 10 client.0 _ll_register_callbacks cb 0x557f93feb1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f1f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f941428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f1f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f941428d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51360/0 (socket says 172.21.15.121:51360) 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f1f400640 1 -- 172.21.15.121:0/1628147859 learned_addr learned my addr 172.21.15.121:0/1628147859 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d3d6b0 0x557f94142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f1fe00640 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d5e390 0x557f941292e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f1f400640 1 -- 172.21.15.121:0/1628147859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d5e390 msgr2=0x557f941292e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f1f400640 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d5e390 0x557f941292e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f1f400640 1 -- 172.21.15.121:0/1628147859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d3d6b0 msgr2=0x557f94142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f1f400640 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d3d6b0 0x557f94142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.937+0000 7f6f1f400640 1 -- 172.21.15.121:0/1628147859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f93e407d0 con 0x557f93d354d0 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6f1f400640 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f941428d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000eae0 tx=0x7f6f1000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85721286727682ce server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6effe00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:39:39.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6effe00640 1 -- 172.21.15.121:0/1628147859 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100043e0 con 0x557f93d354d0 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6effe00640 1 -- 172.21.15.121:0/1628147859 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f6f10009040 con 0x557f93d354d0 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1628147859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f10004020 con 0x557f93d354d0 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6effe00640 1 -- 172.21.15.121:0/1628147859 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f6f10039050 con 0x557f93d354d0 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6f2d2d9740 10 client.6609 fetch_fsmap learned FSMap version 59 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1628147859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x557f9412c990 con 0x557f93d354d0 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6effe00640 1 -- 172.21.15.121:0/1628147859 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f10004020 con 0x557f93d354d0 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6effe00640 1 -- 172.21.15.121:0/1628147859 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 59) ==== 3502+0+0 (secure 0 0 0) 0x7f6f1003c020 con 0x557f93d354d0 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6f2d2d9740 10 client.6609 fetch_fsmap finished waiting for FSMap version 59 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6f2d2d9740 10 client.6609 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6f2d2d9740 20 client.6609 populate_metadata read hostname 'smithi121' 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.938+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x557f93d1cf60 0x557f941280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.939+0000 7f6f2d2d9740 4 client.6609 mds_command: new command op to 6420 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.939+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1628147859 --> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f9407a640 con 0x557f93d1cf60 2024-09-17T03:39:39.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.939+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x557f93d1cf60 0x557f941280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.939+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x557f93d1cf60 0x557f941280c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50b262e61c2da1db server_cookie=9ba04e8f848c8f28 in_seq=0 out_seq=0 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.939+0000 7f6effe00640 10 client.6609 ms_handle_connect on v2:172.21.15.121:6834/3165070053 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6effe00640 1 -- 172.21.15.121:0/1628147859 <== mds.0 v2:172.21.15.121:6834/3165070053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f9407a640 con 0x557f93d1cf60 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6effe00640 10 client.6609 handle_command_reply: tid=0 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 client.6609 shutdown 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1628147859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 msgr2=0x557f941428d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f941428d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000eae0 tx=0x7f6f1000eb10 comp rx=0 tx=0).stop 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1628147859 shutdown_connections 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x557f93d1cf60 0x557f941280c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d5e390 0x557f941292e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d3d6b0 0x557f94142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6effe00640 0 client.6609 ms_handle_reset on v2:172.21.15.121:6834/3165070053 2024-09-17T03:39:39.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/1628147859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f941428d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1628147859 >> 172.21.15.121:0/1628147859 conn(0x557f93d524e0 msgr2=0x557f940ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:39.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1628147859 shutdown_connections 2024-09-17T03:39:39.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.940+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/1628147859 wait complete. 2024-09-17T03:39:39.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.941+0000 7f6f2d2d9740 20 client.6609 trim_cache size 0 max 16384 2024-09-17T03:39:39.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.960+0000 7f6f2d2d9740 1 Processor -- start 2024-09-17T03:39:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.960+0000 7f6f2d2d9740 1 -- start start 2024-09-17T03:39:39.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.961+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d354d0 0x557f9414ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.961+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d3d6b0 0x557f9414cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.961+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 0x557f94106c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.961+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201fe500 con 0x557f93d3d6b0 2024-09-17T03:39:39.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.961+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6f200cf210 con 0x557f93d5e390 2024-09-17T03:39:39.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.961+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f200c6d70 con 0x557f93d354d0 2024-09-17T03:39:39.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.961+0000 7f6f1ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d3d6b0 0x557f9414cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.961+0000 7f6f1ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d3d6b0 0x557f9414cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51366/0 (socket says 172.21.15.121:51366) 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.961+0000 7f6f1ea00640 1 -- 172.21.15.121:0/101396870 learned_addr learned my addr 172.21.15.121:0/101396870 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f1fe00640 1 --2- 172.21.15.121:0/101396870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 0x557f94106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f1f400640 1 --2- 172.21.15.121:0/101396870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d354d0 0x557f9414ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f1ea00640 1 -- 172.21.15.121:0/101396870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d354d0 msgr2=0x557f9414ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/101396870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d354d0 0x557f9414ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f1ea00640 1 -- 172.21.15.121:0/101396870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 msgr2=0x557f94106c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/101396870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 0x557f94106c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f1ea00640 1 -- 172.21.15.121:0/101396870 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f9411f1d0 con 0x557f93d3d6b0 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/101396870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d3d6b0 0x557f9414cf90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c083bb0 tx=0x7f6f0c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c88a0e74a122f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f0aa00640 1 -- 172.21.15.121:0/101396870 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c048040 con 0x557f93d3d6b0 2024-09-17T03:39:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f0aa00640 1 -- 172.21.15.121:0/101396870 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f0c0a2070 con 0x557f93d3d6b0 2024-09-17T03:39:39.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.962+0000 7f6f0aa00640 1 -- 172.21.15.121:0/101396870 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c083c20 con 0x557f93d3d6b0 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.963+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/101396870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d3d6b0 msgr2=0x557f9414cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.963+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/101396870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d3d6b0 0x557f9414cf90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c083bb0 tx=0x7f6f0c086040 comp rx=0 tx=0).stop 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.963+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/101396870 shutdown_connections 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.963+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/101396870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 0x557f94106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.963+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/101396870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d3d6b0 0x557f9414cf90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.963+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/101396870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d354d0 0x557f9414ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.963+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/101396870 >> 172.21.15.121:0/101396870 conn(0x557f93d524e0 msgr2=0x557f9414d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.963+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/101396870 shutdown_connections 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.963+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/101396870 wait complete. 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.964+0000 7f6f2d2d9740 1 -- start start 2024-09-17T03:39:39.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.964+0000 7f6f2d2d9740 1 Processor -- start 2024-09-17T03:39:39.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f9411b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d3d6b0 0x557f941c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f2d2d9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 0x557f9414ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f200c9000 con 0x557f93d354d0 2024-09-17T03:39:39.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x557f9414c190 con 0x557f93d5e390 2024-09-17T03:39:39.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f2d2d9740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x557f941cec40 con 0x557f93d3d6b0 2024-09-17T03:39:39.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f2d2d9740 10 client.0 _ll_register_callbacks cb 0x7f6f10011d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:39.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f9411b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f9411b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51372/0 (socket says 172.21.15.121:51372) 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1f400640 1 -- 172.21.15.121:0/3737503979 learned_addr learned my addr 172.21.15.121:0/3737503979 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1fe00640 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 0x557f9414ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d3d6b0 0x557f941c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1f400640 1 -- 172.21.15.121:0/3737503979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d3d6b0 msgr2=0x557f941c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1f400640 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d3d6b0 0x557f941c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1f400640 1 -- 172.21.15.121:0/3737503979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 msgr2=0x557f9414ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1f400640 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 0x557f9414ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1f400640 1 -- 172.21.15.121:0/3737503979 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f94159430 con 0x557f93d354d0 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1fe00640 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 0x557f9414ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.966+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d3d6b0 0x557f941c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.967+0000 7f6f1f400640 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f9411b9d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000eae0 tx=0x7f6f10003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c194dd5924427 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.967+0000 7f6effe00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.967+0000 7f6effe00640 1 -- 172.21.15.121:0/3737503979 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1002a070 con 0x557f93d354d0 2024-09-17T03:39:39.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.967+0000 7f6effe00640 1 -- 172.21.15.121:0/3737503979 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f6f10009040 con 0x557f93d354d0 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.967+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/3737503979 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f0c0a2070 con 0x557f93d354d0 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.967+0000 7f6effe00640 1 -- 172.21.15.121:0/3737503979 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f6f100043e0 con 0x557f93d354d0 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.967+0000 7f6f2d2d9740 10 client.6615 fetch_fsmap learned FSMap version 59 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.967+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/3737503979 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x557f941ce980 con 0x557f93d354d0 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.967+0000 7f6effe00640 1 -- 172.21.15.121:0/3737503979 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f0c0a2070 con 0x557f93d354d0 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.968+0000 7f6effe00640 1 -- 172.21.15.121:0/3737503979 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 59) ==== 3502+0+0 (secure 0 0 0) 0x7f6f10045050 con 0x557f93d354d0 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.968+0000 7f6f2d2d9740 10 client.6615 fetch_fsmap finished waiting for FSMap version 59 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.968+0000 7f6f2d2d9740 10 client.6615 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.968+0000 7f6f2d2d9740 20 client.6615 populate_metadata read hostname 'smithi121' 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.968+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x557f9414cf70 0x557f941d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:39.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.968+0000 7f6f2d2d9740 4 client.6615 mds_command: new command op to 6420 tid=0 multi_id=0 [{"prefix": "session ls"}] 2024-09-17T03:39:39.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.968+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/3737503979 --> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] -- command(tid 0: {"prefix": "session ls"}) -- 0x557f940760f0 con 0x557f9414cf70 2024-09-17T03:39:39.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.968+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x557f9414cf70 0x557f941d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:39.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f1ea00640 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x557f9414cf70 0x557f941d1fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b8702770b4affe1 server_cookie=2059eae0dd2f6ae0 in_seq=0 out_seq=0 2024-09-17T03:39:39.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6effe00640 10 client.6615 ms_handle_connect on v2:172.21.15.121:6834/3165070053 2024-09-17T03:39:39.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6effe00640 1 -- 172.21.15.121:0/3737503979 <== mds.0 v2:172.21.15.121:6834/3165070053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557f940760f0 con 0x557f9414cf70 2024-09-17T03:39:39.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6effe00640 10 client.6615 handle_command_reply: tid=0 2024-09-17T03:39:39.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 client.6615 shutdown 2024-09-17T03:39:39.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/3737503979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 msgr2=0x557f9411b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f9411b9d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000eae0 tx=0x7f6f10003e30 comp rx=0 tx=0).stop 2024-09-17T03:39:39.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/3737503979 shutdown_connections 2024-09-17T03:39:39.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.121:6834/3165070053,v1:172.21.15.121:6835/3165070053] conn(0x557f9414cf70 0x557f941d1fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557f93d5e390 0x557f9414ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557f93d3d6b0 0x557f941c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6effe00640 0 client.6615 ms_handle_reset on v2:172.21.15.121:6834/3165070053 2024-09-17T03:39:39.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 --2- 172.21.15.121:0/3737503979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557f93d354d0 0x557f9411b9d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/3737503979 >> 172.21.15.121:0/3737503979 conn(0x557f93d524e0 msgr2=0x557f9414e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:39.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/3737503979 shutdown_connections 2024-09-17T03:39:39.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 1 -- 172.21.15.121:0/3737503979 wait complete. 2024-09-17T03:39:39.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.969+0000 7f6f2d2d9740 20 client.6615 trim_cache size 0 max 16384 2024-09-17T03:39:39.976 INFO:teuthology.orchestra.run.smithi121.stdout:[] 2024-09-17T03:39:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 -- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f00078bc0 msgr2=0x7f6f0007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f00078bc0 0x7f6f0007b0d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009b30 tx=0x7f6f10005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 -- 172.21.15.121:0/2875240980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f200d0af0 msgr2=0x7f6f201590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f200d0af0 0x7f6f201590e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009920 tx=0x7f6f0c033c20 comp rx=0 tx=0).stop 2024-09-17T03:39:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 -- 172.21.15.121:0/2875240980 shutdown_connections 2024-09-17T03:39:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f2015a3e0 0x7f6f20159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6f00078bc0 0x7f6f0007b0d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f200d0af0 0x7f6f201590e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 --2- 172.21.15.121:0/2875240980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f2006ddc0 0x7f6f20154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:39.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 -- 172.21.15.121:0/2875240980 >> 172.21.15.121:0/2875240980 conn(0x7f6f200b3580 msgr2=0x7f6f20074c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:39.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 -- 172.21.15.121:0/2875240980 shutdown_connections 2024-09-17T03:39:39.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:39.970+0000 7f6f26200640 1 -- 172.21.15.121:0/2875240980 wait complete. 2024-09-17T03:39:39.991 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-17T03:39:40.230 INFO:teuthology.orchestra.run.smithi121.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":23,"msgr_send_messages":23,"msgr_recv_bytes":6970,"msgr_send_bytes":12163,"msgr_created_connections":7,"msgr_active_connections":2,"msgr_running_total_time":0.014094031,"msgr_running_send_time":0.001324212,"msgr_running_recv_time":0.008827125,"msgr_running_fast_dispatch_time":0.000443743,"msgr_send_messages_queue_lat":{"avgcount":22,"sum":0.261860596,"avgtime":0.011902754},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":1872,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":102,"msgr_send_messages":94,"msgr_recv_bytes":137075,"msgr_send_bytes":78122,"msgr_created_connections":9,"msgr_active_connections":3,"msgr_running_total_time":0.017900378,"msgr_running_send_time":0.005198264,"msgr_running_recv_time":0.017960273,"msgr_running_fast_dispatch_time":0.000318256,"msgr_send_messages_queue_lat":{"avgcount":93,"sum":0.166611181,"avgtime":0.001791518},"msgr_handle_ack_lat":{"avgcount":31,"sum":0.000010695,"avgtime":0.000000345},"msgr_recv_encrypted_bytes":125728,"msgr_send_encrypted_bytes":11728},"AsyncMessenger::Worker-2":{"msgr_recv_messages":24,"msgr_send_messages":27,"msgr_recv_bytes":6330,"msgr_send_bytes":78430,"msgr_created_connections":6,"msgr_active_connections":3,"msgr_running_total_time":0.009727478,"msgr_running_send_time":0.001437981,"msgr_running_recv_time":0.007605449,"msgr_running_fast_dispatch_time":0.000480886,"msgr_send_messages_queue_lat":{"avgcount":26,"sum":0.131520340,"avgtime":0.005058474},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000002701,"avgtime":0.000000540},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":63600},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.001958099,"avgtime":0.000036261}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000055096,"avgtime":0.000027548}},"mds":{"request":29,"reply":29,"reply_latency":{"avgcount":29,"sum":0.004924632,"avgtime":0.000169814},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":2,"subtrees":2,"traverse":55,"traverse_hit":53,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":8,"evex":0,"evtrm":0,"ev":8,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4197031,"rdpos":0,"jlat":{"avgcount":5,"sum":0.011877226,"avgtime":0.002375445},"replayed":0},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":0,"cap+":2,"cap-":2,"rss":109876,"heap":332230656},"mds_server":{"dispatch_client_request":29,"dispatch_server_request":0,"handle_client_request":29,"handle_client_session":6,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":26,"sum":0.004319732,"avgtime":0.000166143},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000276351,"avgtime":0.000138175},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000328549,"avgtime":0.000328549},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":0,"session_add":2,"session_remove":2,"sessions_open":0,"sessions_stale":0,"total_load":28,"average_load":14,"avg_session_uptime":1,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225505,"buffer_anon_items":87,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53984,"mds_co_items":218,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":13847,"op_resend":37,"op_reply":43,"op_latency":{"avgcount":43,"sum":0.954987697,"avgtime":0.022209016},"op_inflight":0,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":5,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":87,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":145,"get_sum":133325,"get_or_fail_fail":0,"get_or_fail_success":145,"take":0,"take_sum":0,"put":145,"put_sum":133325,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":13847,"put":43,"put_sum":13847,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":43,"take_sum":43,"put":43,"put_sum":43,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x564e9c0d1520":{"val":0,"max":3758096384,"get_started":0,"get":8,"get_sum":2727,"get_or_fail_fail":0,"get_or_fail_success":8,"take":0,"take_sum":0,"put":5,"put_sum":2727,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":0}} 2024-09-17T03:39:40.232 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 6970, "msgr_recv_encrypted_bytes": 1872, "msgr_recv_messages": 23, "msgr_running_fast_dispatch_time": 0.000443743, "msgr_running_recv_time": 0.008827125, "msgr_running_send_time": 0.001324212, "msgr_running_total_time": 0.014094031, "msgr_send_bytes": 12163, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 23, "msgr_send_messages_queue_lat": { "avgcount": 22, "avgtime": 0.011902754, "sum": 0.261860596 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 3, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 31, "avgtime": 3.45e-07, "sum": 1.0695e-05 }, "msgr_recv_bytes": 137075, "msgr_recv_encrypted_bytes": 125728, "msgr_recv_messages": 102, "msgr_running_fast_dispatch_time": 0.000318256, "msgr_running_recv_time": 0.017960273, "msgr_running_send_time": 0.005198264, "msgr_running_total_time": 0.017900378, "msgr_send_bytes": 78122, "msgr_send_encrypted_bytes": 11728, "msgr_send_messages": 94, "msgr_send_messages_queue_lat": { "avgcount": 93, "avgtime": 0.001791518, "sum": 0.166611181 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 5.4e-07, "sum": 2.701e-06 }, "msgr_recv_bytes": 6330, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 24, "msgr_running_fast_dispatch_time": 0.000480886, "msgr_running_recv_time": 0.007605449, "msgr_running_send_time": 0.001437981, "msgr_running_total_time": 0.009727478, "msgr_send_bytes": 78430, "msgr_send_encrypted_bytes": 63600, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 26, "avgtime": 0.005058474, "sum": 0.13152034 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 3.6261e-05, "sum": 0.001958099 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 2.7548e-05, "sum": 5.5096e-05 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 29, "reply_latency": { "avgcount": 29, "avgtime": 0.000169814, "sum": 0.004924632 }, "request": 29, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 55, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 53, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 8, "evadd": 8, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002375445, "sum": 0.011877226 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4197031 }, "mds_mem": { "cap": 0, "cap+": 2, "cap-": 2, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 332230656, "ino": 13, "ino+": 13, "ino-": 0, "rss": 109876 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 29, "dispatch_server_request": 0, "handle_client_request": 29, "handle_client_session": 6, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 26, "avgtime": 0.000166143, "sum": 0.004319732 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000138175, "sum": 0.000276351 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000328549, "sum": 0.000328549 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 14, "avg_session_uptime": 1, "mdthresh_evicted": 0, "session_add": 2, "session_count": 0, "session_remove": 2, "sessions_open": 0, "sessions_stale": 0, "total_load": 28 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225505, "buffer_anon_items": 87, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53984, "mds_co_items": 218, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 87, "map_full": 0, "map_inc": 1, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 43, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 43, "avgtime": 0.022209016, "sum": 0.954987697 }, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 37, "op_rmw": 0, "op_send": 43, "op_send_bytes": 13847, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 145, "get_or_fail_fail": 0, "get_or_fail_success": 145, "get_started": 0, "get_sum": 133325, "max": 104857600, "put": 145, "put_sum": 133325, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 43, "put_sum": 13847, "take": 43, "take_sum": 13847, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 43, "put_sum": 43, "take": 43, "take_sum": 43, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x564e9c0d1520": { "get": 8, "get_or_fail_fail": 0, "get_or_fail_success": 8, "get_started": 0, "get_sum": 2727, "max": 3758096384, "put": 5, "put_sum": 2727, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 0 } } 2024-09-17T03:39:40.232 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T03:39:40.232 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:39:40.232 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:39:40.311 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:39:40.409 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:39:40.409 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:39:40.409 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:40.409 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:40.444 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:39:40.444 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:39:40.445 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:40.445 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:40.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:39:40.481 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:39:40.481 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:40.481 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:40.520 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:39:40.520 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:39:40.520 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:40.520 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:40.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:39:40.557 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:40.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.780+0000 7f5b91600640 1 -- 172.21.15.121:0/2450364163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8c070810 msgr2=0x7f5b8c0b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:40.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.780+0000 7f5b91600640 1 --2- 172.21.15.121:0/2450364163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8c070810 0x7f5b8c0b4c80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c157220 tx=0x7f5b7c02a530 comp rx=0 tx=0).stop 2024-09-17T03:39:40.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.780+0000 7f5b91600640 1 -- 172.21.15.121:0/2450364163 shutdown_connections 2024-09-17T03:39:40.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.780+0000 7f5b91600640 1 --2- 172.21.15.121:0/2450364163 >> v2:172.21.15.176:3300/0 conn(0x7f5b8c160890 0x7f5b8c06d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:40.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.780+0000 7f5b91600640 1 --2- 172.21.15.121:0/2450364163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8c070810 0x7f5b8c0b4c80 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:40.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.780+0000 7f5b91600640 1 -- 172.21.15.121:0/2450364163 >> 172.21.15.121:0/2450364163 conn(0x7f5b8c0b2440 msgr2=0x7f5b8c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:40.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.780+0000 7f5b91600640 1 -- 172.21.15.121:0/2450364163 shutdown_connections 2024-09-17T03:39:40.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.780+0000 7f5b91600640 1 -- 172.21.15.121:0/2450364163 wait complete. 2024-09-17T03:39:40.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.782+0000 7f5b91600640 1 Processor -- start 2024-09-17T03:39:40.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.783+0000 7f5b91600640 1 -- start start 2024-09-17T03:39:40.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.784+0000 7f5b91600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8c070810 0x7f5b8c0ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:40.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.784+0000 7f5b91600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b51c0 0x7f5b8c0ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:40.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.784+0000 7f5b91600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c1f65a0 0x7f5b8c1f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:40.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.784+0000 7f5b91600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c06dd70 con 0x7f5b8c070810 2024-09-17T03:39:40.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.784+0000 7f5b91600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c06f000 con 0x7f5b8c1f65a0 2024-09-17T03:39:40.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.784+0000 7f5b91600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8c06def0 con 0x7f5b8c0b51c0 2024-09-17T03:39:40.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.784+0000 7f5b8be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8c070810 0x7f5b8c0ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:40.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.784+0000 7f5b8be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8c070810 0x7f5b8c0ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51394/0 (socket says 172.21.15.121:51394) 2024-09-17T03:39:40.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.784+0000 7f5b8be00640 1 -- 172.21.15.121:0/1314178293 learned_addr learned my addr 172.21.15.121:0/1314178293 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:40.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b8b400640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b51c0 0x7f5b8c0ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:40.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b90c00640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c1f65a0 0x7f5b8c1f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:40.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b8be00640 1 -- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b51c0 msgr2=0x7f5b8c0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:40.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b8be00640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b51c0 0x7f5b8c0ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:40.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b8be00640 1 -- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c1f65a0 msgr2=0x7f5b8c1f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:40.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b8be00640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c1f65a0 0x7f5b8c1f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:40.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b8be00640 1 -- 172.21.15.121:0/1314178293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c1f6ef0 con 0x7f5b8c070810 2024-09-17T03:39:40.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b8be00640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8c070810 0x7f5b8c0ceb00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c02ab20 tx=0x7f5b7c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:40.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b83e00640 1 -- 172.21.15.121:0/1314178293 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c031d60 con 0x7f5b8c070810 2024-09-17T03:39:40.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b83e00640 1 -- 172.21.15.121:0/1314178293 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b7c033e10 con 0x7f5b8c070810 2024-09-17T03:39:40.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b91600640 1 -- 172.21.15.121:0/1314178293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8c0cf310 con 0x7f5b8c070810 2024-09-17T03:39:40.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.785+0000 7f5b83e00640 1 -- 172.21.15.121:0/1314178293 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c005260 con 0x7f5b8c070810 2024-09-17T03:39:40.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.786+0000 7f5b91600640 1 -- 172.21.15.121:0/1314178293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8c0cf5d0 con 0x7f5b8c070810 2024-09-17T03:39:40.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.787+0000 7f5b91600640 1 -- 172.21.15.121:0/1314178293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8c06e3f0 con 0x7f5b8c070810 2024-09-17T03:39:40.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.788+0000 7f5b83e00640 1 -- 172.21.15.121:0/1314178293 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b7c005400 con 0x7f5b8c070810 2024-09-17T03:39:40.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.789+0000 7f5b83e00640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5b6c078b90 0x7f5b6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:40.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.789+0000 7f5b83e00640 1 -- 172.21.15.121:0/1314178293 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f5b7c0bc100 con 0x7f5b8c070810 2024-09-17T03:39:40.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.789+0000 7f5b8b400640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5b6c078b90 0x7f5b6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:40.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.790+0000 7f5b8b400640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5b6c078b90 0x7f5b6c07b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5b78007fd0 tx=0x7f5b78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:40.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:40.793+0000 7f5b83e00640 1 -- 172.21.15.121:0/1314178293 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5b8c1f6ef0 con 0x7f5b8c070810 2024-09-17T03:39:41.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.013+0000 7f5b91600640 1 -- 172.21.15.121:0/1314178293 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b8c09d860 con 0x7f5b8c070810 2024-09-17T03:39:41.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.014+0000 7f5b83e00640 1 -- 172.21.15.121:0/1314178293 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5234 (secure 0 0 0) 0x7f5b7c03f030 con 0x7f5b8c070810 2024-09-17T03:39:41.014 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:41.014 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":59,"btime":"2024-09-17T03:39:30:383696+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5711,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2693481679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2693481679},{"type":"v1","addr":"172.21.15.176:6837","nonce":2693481679}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6154,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2108616236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2108616236},{"type":"v1","addr":"172.21.15.121:6833","nonce":2108616236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/814740200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":814740200},{"type":"v1","addr":"172.21.15.176:6835","nonce":814740200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:26.837842+0000","modified":"2024-09-17T03:39:29.865327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6420":{"gid":6420,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3165070053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3165070053},{"type":"v1","addr":"172.21.15.121:6835","nonce":3165070053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6420,"qdb_cluster":[6420]},"id":6}]} 2024-09-17T03:39:41.014 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 59 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.016+0000 7f5b91600640 1 -- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5b6c078b90 msgr2=0x7f5b6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.016+0000 7f5b91600640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5b6c078b90 0x7f5b6c07b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5b78007fd0 tx=0x7f5b78009040 comp rx=0 tx=0).stop 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.016+0000 7f5b91600640 1 -- 172.21.15.121:0/1314178293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8c070810 msgr2=0x7f5b8c0ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.016+0000 7f5b91600640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8c070810 0x7f5b8c0ceb00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c02ab20 tx=0x7f5b7c033c20 comp rx=0 tx=0).stop 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.017+0000 7f5b91600640 1 -- 172.21.15.121:0/1314178293 shutdown_connections 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.017+0000 7f5b91600640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c1f65a0 0x7f5b8c1f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.017+0000 7f5b91600640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b51c0 0x7f5b8c0ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.017+0000 7f5b91600640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5b6c078b90 0x7f5b6c07b0a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.017+0000 7f5b91600640 1 --2- 172.21.15.121:0/1314178293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8c070810 0x7f5b8c0ceb00 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.017+0000 7f5b91600640 1 -- 172.21.15.121:0/1314178293 >> 172.21.15.121:0/1314178293 conn(0x7f5b8c0b2440 msgr2=0x7f5b8c0b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.017+0000 7f5b91600640 1 -- 172.21.15.121:0/1314178293 shutdown_connections 2024-09-17T03:39:41.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.017+0000 7f5b91600640 1 -- 172.21.15.121:0/1314178293 wait complete. 2024-09-17T03:39:41.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:41.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.265+0000 7fdf16400640 1 -- 172.21.15.121:0/34669395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4004800 msgr2=0x7fdef4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.265+0000 7fdf16400640 1 --2- 172.21.15.121:0/34669395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4004800 0x7fdef4004c10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fdf100751b0 tx=0x7fdef4005830 comp rx=0 tx=0).stop 2024-09-17T03:39:41.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.265+0000 7fdf16400640 1 -- 172.21.15.121:0/34669395 shutdown_connections 2024-09-17T03:39:41.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.265+0000 7fdf16400640 1 --2- 172.21.15.121:0/34669395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4004800 0x7fdef4004c10 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.265+0000 7fdf16400640 1 -- 172.21.15.121:0/34669395 >> 172.21.15.121:0/34669395 conn(0x7fdf100b2440 msgr2=0x7fdf100d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:41.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.265+0000 7fdf16400640 1 -- 172.21.15.121:0/34669395 shutdown_connections 2024-09-17T03:39:41.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.265+0000 7fdf16400640 1 -- 172.21.15.121:0/34669395 wait complete. 2024-09-17T03:39:41.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.268+0000 7fdf16400640 1 Processor -- start 2024-09-17T03:39:41.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.268+0000 7fdf16400640 1 -- start start 2024-09-17T03:39:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.269+0000 7fdf16400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4004800 0x7fdf1009c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.269+0000 7fdf16400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf10144370 0x7fdf1013eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.269+0000 7fdf16400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1015b630 0x7fdf1015ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:41.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.269+0000 7fdf16400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdf100b4c80 con 0x7fdef4004800 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.269+0000 7fdf16400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1006f000 con 0x7fdf1015b630 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.269+0000 7fdf16400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdf100b4e00 con 0x7fdf10144370 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.269+0000 7fdf15000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4004800 0x7fdf1009c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.269+0000 7fdf15000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4004800 0x7fdf1009c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51422/0 (socket says 172.21.15.121:51422) 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.269+0000 7fdf15000640 1 -- 172.21.15.121:0/1194887146 learned_addr learned my addr 172.21.15.121:0/1194887146 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf15000640 1 -- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf10144370 msgr2=0x7fdf1013eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf07e00640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf10144370 0x7fdf1013eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf15a00640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1015b630 0x7fdf1015ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf15000640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf10144370 0x7fdf1013eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf15000640 1 -- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1015b630 msgr2=0x7fdf1015ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf15000640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1015b630 0x7fdf1015ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf15000640 1 -- 172.21.15.121:0/1194887146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1015bf80 con 0x7fdef4004800 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf07e00640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf10144370 0x7fdf1013eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:41.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf15a00640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1015b630 0x7fdf1015ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf15000640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4004800 0x7fdf1009c900 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fdf00011a40 tx=0x7fdf00011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf0d600640 1 -- 172.21.15.121:0/1194887146 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0001e070 con 0x7fdef4004800 2024-09-17T03:39:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf0d600640 1 -- 172.21.15.121:0/1194887146 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf00004460 con 0x7fdef4004800 2024-09-17T03:39:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf16400640 1 -- 172.21.15.121:0/1194887146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1009d150 con 0x7fdef4004800 2024-09-17T03:39:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.270+0000 7fdf0d600640 1 -- 172.21.15.121:0/1194887146 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000fc00 con 0x7fdef4004800 2024-09-17T03:39:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.271+0000 7fdf16400640 1 -- 172.21.15.121:0/1194887146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf1009d710 con 0x7fdef4004800 2024-09-17T03:39:41.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.272+0000 7fdf16400640 1 -- 172.21.15.121:0/1194887146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf101602f0 con 0x7fdef4004800 2024-09-17T03:39:41.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.273+0000 7fdf0d600640 1 -- 172.21.15.121:0/1194887146 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf00021070 con 0x7fdef4004800 2024-09-17T03:39:41.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.274+0000 7fdf0d600640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdeec078b90 0x7fdeec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:41.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.274+0000 7fdf0d600640 1 -- 172.21.15.121:0/1194887146 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fdf0009b920 con 0x7fdef4004800 2024-09-17T03:39:41.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.275+0000 7fdf07e00640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdeec078b90 0x7fdeec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:41.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.275+0000 7fdf07e00640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdeec078b90 0x7fdeec07b0a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdef8033000 tx=0x7fdef802d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:41.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.279+0000 7fdf0d600640 1 -- 172.21.15.121:0/1194887146 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf1015bf80 con 0x7fdef4004800 2024-09-17T03:39:41.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.496+0000 7fdf16400640 1 -- 172.21.15.121:0/1194887146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf100d0080 con 0x7fdef4004800 2024-09-17T03:39:41.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.496+0000 7fdf0d600640 1 -- 172.21.15.121:0/1194887146 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5234 (secure 0 0 0) 0x7fdf00063570 con 0x7fdef4004800 2024-09-17T03:39:41.497 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:41.497 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":59,"btime":"2024-09-17T03:39:30:383696+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5711,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2693481679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2693481679},{"type":"v1","addr":"172.21.15.176:6837","nonce":2693481679}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6154,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2108616236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2108616236},{"type":"v1","addr":"172.21.15.121:6833","nonce":2108616236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/814740200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":814740200},{"type":"v1","addr":"172.21.15.176:6835","nonce":814740200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:26.837842+0000","modified":"2024-09-17T03:39:29.865327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6420":{"gid":6420,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3165070053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3165070053},{"type":"v1","addr":"172.21.15.121:6835","nonce":3165070053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6420,"qdb_cluster":[6420]},"id":6}]} 2024-09-17T03:39:41.497 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 59 2024-09-17T03:39:41.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 -- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdeec078b90 msgr2=0x7fdeec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdeec078b90 0x7fdeec07b0a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdef8033000 tx=0x7fdef802d000 comp rx=0 tx=0).stop 2024-09-17T03:39:41.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 -- 172.21.15.121:0/1194887146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4004800 msgr2=0x7fdf1009c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4004800 0x7fdf1009c900 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fdf00011a40 tx=0x7fdf00011f00 comp rx=0 tx=0).stop 2024-09-17T03:39:41.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 -- 172.21.15.121:0/1194887146 shutdown_connections 2024-09-17T03:39:41.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf1015b630 0x7fdf1015ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf10144370 0x7fdf1013eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdeec078b90 0x7fdeec07b0a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 --2- 172.21.15.121:0/1194887146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4004800 0x7fdf1009c900 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 -- 172.21.15.121:0/1194887146 >> 172.21.15.121:0/1194887146 conn(0x7fdf100b2440 msgr2=0x7fdf10144d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:41.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 -- 172.21.15.121:0/1194887146 shutdown_connections 2024-09-17T03:39:41.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.499+0000 7fdf16400640 1 -- 172.21.15.121:0/1194887146 wait complete. 2024-09-17T03:39:41.521 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:41.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.743+0000 7f2150e00640 1 -- 172.21.15.121:0/988550440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f214c160180 msgr2=0x7f214c160590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.743+0000 7f2150e00640 1 --2- 172.21.15.121:0/988550440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f214c160180 0x7f214c160590 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f2134009830 tx=0x7f213402a510 comp rx=0 tx=0).stop 2024-09-17T03:39:41.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.743+0000 7f2150e00640 1 -- 172.21.15.121:0/988550440 shutdown_connections 2024-09-17T03:39:41.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.743+0000 7f2150e00640 1 --2- 172.21.15.121:0/988550440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f214c06d830 0x7f214c06dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.743+0000 7f2150e00640 1 --2- 172.21.15.121:0/988550440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f214c160180 0x7f214c160590 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.743+0000 7f2150e00640 1 -- 172.21.15.121:0/988550440 >> 172.21.15.121:0/988550440 conn(0x7f214c0b2440 msgr2=0x7f214c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:41.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.743+0000 7f2150e00640 1 -- 172.21.15.121:0/988550440 shutdown_connections 2024-09-17T03:39:41.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.743+0000 7f2150e00640 1 -- 172.21.15.121:0/988550440 wait complete. 2024-09-17T03:39:41.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.745+0000 7f2150e00640 1 Processor -- start 2024-09-17T03:39:41.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.745+0000 7f2150e00640 1 -- start start 2024-09-17T03:39:41.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f2150e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f214c06d830 0x7f214c0cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:41.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f2150e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f214c070810 0x7f214c1f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:41.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f2150e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f214c160180 0x7f214c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:41.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f2150e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f214c06ef70 con 0x7f214c06d830 2024-09-17T03:39:41.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f2150e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f214c06edf0 con 0x7f214c160180 2024-09-17T03:39:41.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f2150e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f214c06e180 con 0x7f214c070810 2024-09-17T03:39:41.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f214b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f214c06d830 0x7f214c0cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f214b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f214c06d830 0x7f214c0cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51440/0 (socket says 172.21.15.121:51440) 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f214b400640 1 -- 172.21.15.121:0/2786463465 learned_addr learned my addr 172.21.15.121:0/2786463465 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f214be00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f214c160180 0x7f214c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.747+0000 7f2142a00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f214c070810 0x7f214c1f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f214b400640 1 -- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f214c070810 msgr2=0x7f214c1f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f214b400640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f214c070810 0x7f214c1f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f214b400640 1 -- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f214c160180 msgr2=0x7f214c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f214b400640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f214c160180 0x7f214c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f214b400640 1 -- 172.21.15.121:0/2786463465 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c0ccc00 con 0x7f214c06d830 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f2142a00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f214c070810 0x7f214c1f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:41.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f214b400640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f214c06d830 0x7f214c0cdca0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c730 tx=0x7f213c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:41.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f2143e00640 1 -- 172.21.15.121:0/2786463465 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c016020 con 0x7f214c06d830 2024-09-17T03:39:41.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f2143e00640 1 -- 172.21.15.121:0/2786463465 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f213c00a950 con 0x7f214c06d830 2024-09-17T03:39:41.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f2150e00640 1 -- 172.21.15.121:0/2786463465 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214c0ccee0 con 0x7f214c06d830 2024-09-17T03:39:41.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f2143e00640 1 -- 172.21.15.121:0/2786463465 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c00ada0 con 0x7f214c06d830 2024-09-17T03:39:41.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.748+0000 7f2150e00640 1 -- 172.21.15.121:0/2786463465 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214c0cd4a0 con 0x7f214c06d830 2024-09-17T03:39:41.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.749+0000 7f2150e00640 1 -- 172.21.15.121:0/2786463465 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214c06e710 con 0x7f214c06d830 2024-09-17T03:39:41.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.750+0000 7f2143e00640 1 -- 172.21.15.121:0/2786463465 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f213c019020 con 0x7f214c06d830 2024-09-17T03:39:41.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.751+0000 7f2143e00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2128078bc0 0x7f212807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:41.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.752+0000 7f2143e00640 1 -- 172.21.15.121:0/2786463465 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f213c09ad50 con 0x7f214c06d830 2024-09-17T03:39:41.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.752+0000 7f2142a00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2128078bc0 0x7f212807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:41.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.753+0000 7f2142a00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2128078bc0 0x7f212807b0d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2134034000 tx=0x7f2134004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:41.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.756+0000 7f2143e00640 1 -- 172.21.15.121:0/2786463465 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f213c09e030 con 0x7f214c06d830 2024-09-17T03:39:41.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.941+0000 7f2150e00640 1 -- 172.21.15.121:0/2786463465 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f214c06f890 con 0x7f214c06d830 2024-09-17T03:39:41.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.942+0000 7f2143e00640 1 -- 172.21.15.121:0/2786463465 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+17053 (secure 0 0 0) 0x7f213c020020 con 0x7f214c06d830 2024-09-17T03:39:41.942 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:41.942 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":87,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:28.371793+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:39:24.742016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-17T03:39:25.808448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 -- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2128078bc0 msgr2=0x7f212807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2128078bc0 0x7f212807b0d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2134034000 tx=0x7f2134004730 comp rx=0 tx=0).stop 2024-09-17T03:39:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 -- 172.21.15.121:0/2786463465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f214c06d830 msgr2=0x7f214c0cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f214c06d830 0x7f214c0cdca0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c730 tx=0x7f213c00cbf0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 -- 172.21.15.121:0/2786463465 shutdown_connections 2024-09-17T03:39:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f214c160180 0x7f214c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f214c070810 0x7f214c1f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2128078bc0 0x7f212807b0d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 --2- 172.21.15.121:0/2786463465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f214c06d830 0x7f214c0cdca0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 -- 172.21.15.121:0/2786463465 >> 172.21.15.121:0/2786463465 conn(0x7f214c0b2440 msgr2=0x7f214c0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 -- 172.21.15.121:0/2786463465 shutdown_connections 2024-09-17T03:39:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:41.945+0000 7f2150e00640 1 -- 172.21.15.121:0/2786463465 wait complete. 2024-09-17T03:39:41.967 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:39:41.967 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:42.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.190+0000 7fc1b8e00640 1 -- 172.21.15.121:0/2438732126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc198004800 msgr2=0x7fc198004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:42.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.190+0000 7fc1b8e00640 1 --2- 172.21.15.121:0/2438732126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc198004800 0x7fc198004c10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009b50 tx=0x7fc198005830 comp rx=0 tx=0).stop 2024-09-17T03:39:42.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.190+0000 7fc1b2800640 1 -- 172.21.15.121:0/2438732126 reap_dead start 2024-09-17T03:39:42.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.190+0000 7fc1b8e00640 1 -- 172.21.15.121:0/2438732126 shutdown_connections 2024-09-17T03:39:42.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.190+0000 7fc1b8e00640 1 -- 172.21.15.121:0/2438732126 >> 172.21.15.121:0/2438732126 conn(0x7fc1b40b3580 msgr2=0x7fc1b40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:42.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.190+0000 7fc1b8e00640 1 -- 172.21.15.121:0/2438732126 shutdown_connections 2024-09-17T03:39:42.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.190+0000 7fc1b8e00640 1 -- 172.21.15.121:0/2438732126 wait complete. 2024-09-17T03:39:42.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.192+0000 7fc1b8e00640 1 Processor -- start 2024-09-17T03:39:42.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.192+0000 7fc1b8e00640 1 -- start start 2024-09-17T03:39:42.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.194+0000 7fc1b8e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198004800 0x7fc1b40749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:42.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.194+0000 7fc1b8e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1b40cf4d0 0x7fc1b40b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.194+0000 7fc1b8e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1b40cf8e0 0x7fc1b40b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.194+0000 7fc1b8e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b40d05b0 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.194+0000 7fc1b8e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b4161190 con 0x7fc198004800 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.194+0000 7fc1b8e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b40d0730 con 0x7fc1b40cf8e0 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.194+0000 7fc1a9400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1b40cf4d0 0x7fc1b40b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.194+0000 7fc1a9400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1b40cf4d0 0x7fc1b40b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55198/0 (socket says 172.21.15.121:55198) 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.194+0000 7fc1a9400640 1 -- 172.21.15.121:0/3511866179 learned_addr learned my addr 172.21.15.121:0/3511866179 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1b1e00640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198004800 0x7fc1b40749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1b2800640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1b40cf8e0 0x7fc1b40b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1a9400640 1 -- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1b40cf8e0 msgr2=0x7fc1b40b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:42.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1a9400640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1b40cf8e0 0x7fc1b40b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1a9400640 1 -- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198004800 msgr2=0x7fc1b40749f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:42.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1a9400640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198004800 0x7fc1b40749f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1a9400640 1 -- 172.21.15.121:0/3511866179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b40cec10 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1b2800640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1b40cf8e0 0x7fc1b40b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:42.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1a9400640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1b40cf4d0 0x7fc1b40b1450 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009a70 tx=0x7fc19c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:42.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1aaa00640 1 -- 172.21.15.121:0/3511866179 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c043070 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1aaa00640 1 -- 172.21.15.121:0/3511866179 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc19c004320 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1b8e00640 1 -- 172.21.15.121:0/3511866179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b40ce090 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1aaa00640 1 -- 172.21.15.121:0/3511866179 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c038040 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.195+0000 7fc1b8e00640 1 -- 172.21.15.121:0/3511866179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b40ce650 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.197+0000 7fc1b8e00640 1 -- 172.21.15.121:0/3511866179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b409e170 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.198+0000 7fc1aaa00640 1 -- 172.21.15.121:0/3511866179 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc19c046070 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.199+0000 7fc1aaa00640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc190078b90 0x7fc19007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:42.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.199+0000 7fc1aaa00640 1 -- 172.21.15.121:0/3511866179 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fc19c0bb4e0 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.199+0000 7fc1b1e00640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc190078b90 0x7fc19007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:42.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.200+0000 7fc1b1e00640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc190078b90 0x7fc19007b0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009c30 tx=0x7fc1a4005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:42.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.203+0000 7fc1aaa00640 1 -- 172.21.15.121:0/3511866179 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc19c0830a0 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.423+0000 7fc1b8e00640 1 -- 172.21.15.121:0/3511866179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1b40ca650 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.424+0000 7fc1aaa00640 1 -- 172.21.15.121:0/3511866179 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5234 (secure 0 0 0) 0x7fc19c087ad0 con 0x7fc1b40cf4d0 2024-09-17T03:39:42.424 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:42.424 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":59,"btime":"2024-09-17T03:39:30:383696+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5711,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2693481679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2693481679},{"type":"v1","addr":"172.21.15.176:6837","nonce":2693481679}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6154,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2108616236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2108616236},{"type":"v1","addr":"172.21.15.121:6833","nonce":2108616236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/814740200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":814740200},{"type":"v1","addr":"172.21.15.176:6835","nonce":814740200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:26.837842+0000","modified":"2024-09-17T03:39:29.865327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6420":{"gid":6420,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3165070053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3165070053},{"type":"v1","addr":"172.21.15.121:6835","nonce":3165070053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6420,"qdb_cluster":[6420]},"id":6}]} 2024-09-17T03:39:42.424 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 59 2024-09-17T03:39:42.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.426+0000 7fc1b8e00640 1 -- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc190078b90 msgr2=0x7fc19007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.426+0000 7fc1b8e00640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc190078b90 0x7fc19007b0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009c30 tx=0x7fc1a4005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.426+0000 7fc1b8e00640 1 -- 172.21.15.121:0/3511866179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1b40cf4d0 msgr2=0x7fc1b40b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.426+0000 7fc1b8e00640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1b40cf4d0 0x7fc1b40b1450 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009a70 tx=0x7fc19c033670 comp rx=0 tx=0).stop 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.427+0000 7fc1b8e00640 1 -- 172.21.15.121:0/3511866179 shutdown_connections 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.427+0000 7fc1b8e00640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1b40cf8e0 0x7fc1b40b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.427+0000 7fc1b8e00640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc190078b90 0x7fc19007b0a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.427+0000 7fc1b8e00640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1b40cf4d0 0x7fc1b40b1450 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.427+0000 7fc1b8e00640 1 --2- 172.21.15.121:0/3511866179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198004800 0x7fc1b40749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.427+0000 7fc1b8e00640 1 -- 172.21.15.121:0/3511866179 >> 172.21.15.121:0/3511866179 conn(0x7fc1b40b3580 msgr2=0x7fc1b415edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.427+0000 7fc1b8e00640 1 -- 172.21.15.121:0/3511866179 shutdown_connections 2024-09-17T03:39:42.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.427+0000 7fc1b8e00640 1 -- 172.21.15.121:0/3511866179 wait complete. 2024-09-17T03:39:42.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:42.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.676+0000 7fec65200640 1 -- 172.21.15.121:0/1068877246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60164620 msgr2=0x7fec60166a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:42.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.676+0000 7fec65200640 1 --2- 172.21.15.121:0/1068877246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60164620 0x7fec60166a40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fec58009be0 tx=0x7fec5802a8d0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.676+0000 7fec65200640 1 -- 172.21.15.121:0/1068877246 shutdown_connections 2024-09-17T03:39:42.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.676+0000 7fec65200640 1 --2- 172.21.15.121:0/1068877246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec60164620 0x7fec60166a40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.676+0000 7fec65200640 1 -- 172.21.15.121:0/1068877246 >> 172.21.15.121:0/1068877246 conn(0x7fec600cd5c0 msgr2=0x7fec600cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:42.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.676+0000 7fec65200640 1 -- 172.21.15.121:0/1068877246 shutdown_connections 2024-09-17T03:39:42.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.676+0000 7fec65200640 1 -- 172.21.15.121:0/1068877246 wait complete. 2024-09-17T03:39:42.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.678+0000 7fec65200640 1 Processor -- start 2024-09-17T03:39:42.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.678+0000 7fec65200640 1 -- start start 2024-09-17T03:39:42.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec65200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec60070440 0x7fec60147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:42.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec65200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600cea40 0x7fec60159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:42.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec65200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec60164620 0x7fec6014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:42.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec65200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fec600cf6e0 con 0x7fec600cea40 2024-09-17T03:39:42.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec65200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fec600cf560 con 0x7fec60070440 2024-09-17T03:39:42.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec65200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fec60166f80 con 0x7fec60164620 2024-09-17T03:39:42.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec55400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600cea40 0x7fec60159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:42.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec55400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600cea40 0x7fec60159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55206/0 (socket says 172.21.15.121:55206) 2024-09-17T03:39:42.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec55400640 1 -- 172.21.15.121:0/632899022 learned_addr learned my addr 172.21.15.121:0/632899022 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:42.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec5de00640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec60070440 0x7fec60147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:42.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec5e800640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec60164620 0x7fec6014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:42.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec55400640 1 -- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec60164620 msgr2=0x7fec6014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:42.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec55400640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec60164620 0x7fec6014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec55400640 1 -- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec60070440 msgr2=0x7fec60147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:42.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec55400640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec60070440 0x7fec60147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.680+0000 7fec55400640 1 -- 172.21.15.121:0/632899022 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec60166220 con 0x7fec600cea40 2024-09-17T03:39:42.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.681+0000 7fec55400640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600cea40 0x7fec60159f80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fec4800c370 tx=0x7fec4800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:42.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.681+0000 7fec56a00640 1 -- 172.21.15.121:0/632899022 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48011790 con 0x7fec600cea40 2024-09-17T03:39:42.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.681+0000 7fec56a00640 1 -- 172.21.15.121:0/632899022 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec48017070 con 0x7fec600cea40 2024-09-17T03:39:42.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.681+0000 7fec56a00640 1 -- 172.21.15.121:0/632899022 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48011c80 con 0x7fec600cea40 2024-09-17T03:39:42.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.681+0000 7fec65200640 1 -- 172.21.15.121:0/632899022 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6014d5d0 con 0x7fec600cea40 2024-09-17T03:39:42.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.681+0000 7fec65200640 1 -- 172.21.15.121:0/632899022 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6014db90 con 0x7fec600cea40 2024-09-17T03:39:42.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.682+0000 7fec65200640 1 -- 172.21.15.121:0/632899022 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec60165f90 con 0x7fec600cea40 2024-09-17T03:39:42.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.684+0000 7fec56a00640 1 -- 172.21.15.121:0/632899022 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec4801c460 con 0x7fec600cea40 2024-09-17T03:39:42.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.684+0000 7fec56a00640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fec3c078bc0 0x7fec3c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:42.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.685+0000 7fec56a00640 1 -- 172.21.15.121:0/632899022 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fec4809abc0 con 0x7fec600cea40 2024-09-17T03:39:42.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.685+0000 7fec5de00640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fec3c078bc0 0x7fec3c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:42.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.686+0000 7fec5de00640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fec3c078bc0 0x7fec3c07b0d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fec50006fd0 tx=0x7fec50009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:42.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.689+0000 7fec56a00640 1 -- 172.21.15.121:0/632899022 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec48062780 con 0x7fec600cea40 2024-09-17T03:39:42.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.906+0000 7fec65200640 1 -- 172.21.15.121:0/632899022 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec60155dd0 con 0x7fec600cea40 2024-09-17T03:39:42.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.907+0000 7fec56a00640 1 -- 172.21.15.121:0/632899022 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5234 (secure 0 0 0) 0x7fec480671b0 con 0x7fec600cea40 2024-09-17T03:39:42.907 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:42.907 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":59,"btime":"2024-09-17T03:39:30:383696+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5711,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2693481679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2693481679},{"type":"v1","addr":"172.21.15.176:6837","nonce":2693481679}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6154,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2108616236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2108616236},{"type":"v1","addr":"172.21.15.121:6833","nonce":2108616236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/814740200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":814740200},{"type":"v1","addr":"172.21.15.176:6835","nonce":814740200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:26.837842+0000","modified":"2024-09-17T03:39:29.865327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6420":{"gid":6420,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/3165070053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3165070053},{"type":"v1","addr":"172.21.15.121:6835","nonce":3165070053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6420,"qdb_cluster":[6420]},"id":6}]} 2024-09-17T03:39:42.907 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 59 2024-09-17T03:39:42.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.909+0000 7fec65200640 1 -- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fec3c078bc0 msgr2=0x7fec3c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:42.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.909+0000 7fec65200640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fec3c078bc0 0x7fec3c07b0d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fec50006fd0 tx=0x7fec50009060 comp rx=0 tx=0).stop 2024-09-17T03:39:42.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.909+0000 7fec65200640 1 -- 172.21.15.121:0/632899022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600cea40 msgr2=0x7fec60159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:42.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.909+0000 7fec65200640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600cea40 0x7fec60159f80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fec4800c370 tx=0x7fec4800c830 comp rx=0 tx=0).stop 2024-09-17T03:39:42.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.910+0000 7fec65200640 1 -- 172.21.15.121:0/632899022 shutdown_connections 2024-09-17T03:39:42.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.910+0000 7fec65200640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec60164620 0x7fec6014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.910+0000 7fec65200640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fec3c078bc0 0x7fec3c07b0d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.910+0000 7fec65200640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec600cea40 0x7fec60159f80 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.910+0000 7fec65200640 1 --2- 172.21.15.121:0/632899022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec60070440 0x7fec60147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:42.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.910+0000 7fec65200640 1 -- 172.21.15.121:0/632899022 >> 172.21.15.121:0/632899022 conn(0x7fec600cd5c0 msgr2=0x7fec600cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:42.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.910+0000 7fec65200640 1 -- 172.21.15.121:0/632899022 shutdown_connections 2024-09-17T03:39:42.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:42.910+0000 7fec65200640 1 -- 172.21.15.121:0/632899022 wait complete. 2024-09-17T03:39:42.933 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:43.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.151+0000 7f8503200640 1 -- 172.21.15.121:0/1407468828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f850415f7f0 msgr2=0x7f8504072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:43.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.151+0000 7f8503200640 1 --2- 172.21.15.121:0/1407468828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f850415f7f0 0x7f8504072db0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f850415ed70 tx=0x7f84f002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.151+0000 7f8503200640 1 -- 172.21.15.121:0/1407468828 shutdown_connections 2024-09-17T03:39:43.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.151+0000 7f8503200640 1 --2- 172.21.15.121:0/1407468828 >> v2:172.21.15.176:3300/0 conn(0x7f85040732f0 0x7f8504161390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.151+0000 7f8503200640 1 --2- 172.21.15.121:0/1407468828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f850415f7f0 0x7f8504072db0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.151+0000 7f8503200640 1 --2- 172.21.15.121:0/1407468828 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f850415ff30 0x7f85041557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.151+0000 7f8503200640 1 -- 172.21.15.121:0/1407468828 >> 172.21.15.121:0/1407468828 conn(0x7f85040b2440 msgr2=0x7f85040d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:43.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.152+0000 7f8503200640 1 -- 172.21.15.121:0/1407468828 shutdown_connections 2024-09-17T03:39:43.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.152+0000 7f8503200640 1 -- 172.21.15.121:0/1407468828 wait complete. 2024-09-17T03:39:43.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.154+0000 7f8503200640 1 Processor -- start 2024-09-17T03:39:43.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.154+0000 7f8503200640 1 -- start start 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.155+0000 7f8503200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85040732f0 0x7f850414ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.155+0000 7f8503200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f850415f7f0 0x7f85041f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.155+0000 7f8503200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f850415ff30 0x7f85041f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.155+0000 7f8503200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f85040d0ca0 con 0x7f850415f7f0 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.155+0000 7f8503200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85040d0b20 con 0x7f850415ff30 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.155+0000 7f8503200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85041618d0 con 0x7f85040732f0 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f850415f7f0 0x7f85041f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f850415f7f0 0x7f85041f84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55218/0 (socket says 172.21.15.121:55218) 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501400640 1 -- 172.21.15.121:0/3183385082 learned_addr learned my addr 172.21.15.121:0/3183385082 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501e00640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85040732f0 0x7f850414ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:43.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8502800640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f850415ff30 0x7f85041f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:43.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501400640 1 -- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85040732f0 msgr2=0x7f850414ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:43.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501400640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85040732f0 0x7f850414ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501400640 1 -- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f850415ff30 msgr2=0x7f85041f8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:43.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501400640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f850415ff30 0x7f85041f8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501400640 1 -- 172.21.15.121:0/3183385082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85041582d0 con 0x7f850415f7f0 2024-09-17T03:39:43.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501e00640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85040732f0 0x7f850414ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:43.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8502800640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f850415ff30 0x7f85041f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:43.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.156+0000 7f8501400640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f850415f7f0 0x7f85041f84c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f84f0034040 tx=0x7f84f00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:43.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.157+0000 7f84fa000640 1 -- 172.21.15.121:0/3183385082 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f003e030 con 0x7f850415f7f0 2024-09-17T03:39:43.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.157+0000 7f84fa000640 1 -- 172.21.15.121:0/3183385082 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84f0003ca0 con 0x7f850415f7f0 2024-09-17T03:39:43.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.157+0000 7f84fa000640 1 -- 172.21.15.121:0/3183385082 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0035040 con 0x7f850415f7f0 2024-09-17T03:39:43.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.157+0000 7f8503200640 1 -- 172.21.15.121:0/3183385082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850409aaf0 con 0x7f850415f7f0 2024-09-17T03:39:43.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.157+0000 7f8503200640 1 -- 172.21.15.121:0/3183385082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8504158570 con 0x7f850415f7f0 2024-09-17T03:39:43.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.158+0000 7f8503200640 1 -- 172.21.15.121:0/3183385082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8504161e60 con 0x7f850415f7f0 2024-09-17T03:39:43.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.159+0000 7f84fa000640 1 -- 172.21.15.121:0/3183385082 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84f0041030 con 0x7f850415f7f0 2024-09-17T03:39:43.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.160+0000 7f84fa000640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f84e4078b90 0x7f84e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:43.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.160+0000 7f84fa000640 1 -- 172.21.15.121:0/3183385082 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f84f00bb640 con 0x7f850415f7f0 2024-09-17T03:39:43.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.160+0000 7f8501e00640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f84e4078b90 0x7f84e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:43.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.161+0000 7f8501e00640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f84e4078b90 0x7f84e407b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009b80 tx=0x7f84f4005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:43.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.164+0000 7f84fa000640 1 -- 172.21.15.121:0/3183385082 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84f0083850 con 0x7f850415f7f0 2024-09-17T03:39:43.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.347+0000 7f8503200640 1 -- 172.21.15.121:0/3183385082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f850414b2c0 con 0x7f850415f7f0 2024-09-17T03:39:43.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.348+0000 7f84fa000640 1 -- 172.21.15.121:0/3183385082 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+17053 (secure 0 0 0) 0x7f84f0083150 con 0x7f850415f7f0 2024-09-17T03:39:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:43.348 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":87,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:28.371793+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:39:24.742016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-17T03:39:25.808448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.350+0000 7f8503200640 1 -- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f84e4078b90 msgr2=0x7f84e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.350+0000 7f8503200640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f84e4078b90 0x7f84e407b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009b80 tx=0x7f84f4005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.350+0000 7f8503200640 1 -- 172.21.15.121:0/3183385082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f850415f7f0 msgr2=0x7f85041f84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.350+0000 7f8503200640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f850415f7f0 0x7f85041f84c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f84f0034040 tx=0x7f84f00038a0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.350+0000 7f8503200640 1 -- 172.21.15.121:0/3183385082 shutdown_connections 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.350+0000 7f8503200640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f850415ff30 0x7f85041f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.350+0000 7f8503200640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f84e4078b90 0x7f84e407b0a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.350+0000 7f8503200640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f850415f7f0 0x7f85041f84c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.350+0000 7f8503200640 1 --2- 172.21.15.121:0/3183385082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85040732f0 0x7f850414ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.350+0000 7f8503200640 1 -- 172.21.15.121:0/3183385082 >> 172.21.15.121:0/3183385082 conn(0x7f85040b2440 msgr2=0x7f85040afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:43.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.351+0000 7f8503200640 1 -- 172.21.15.121:0/3183385082 shutdown_connections 2024-09-17T03:39:43.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.351+0000 7f8503200640 1 -- 172.21.15.121:0/3183385082 wait complete. 2024-09-17T03:39:43.374 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:39:43.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.598+0000 7f1fbc200640 1 -- 172.21.15.121:0/2644131989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fb406cde0 msgr2=0x7f1fb406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.598+0000 7f1fbc200640 1 --2- 172.21.15.121:0/2644131989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fb406cde0 0x7f1fb406d1f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4072960 tx=0x7f1fac02aac0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.598+0000 7f1fbc200640 1 -- 172.21.15.121:0/2644131989 shutdown_connections 2024-09-17T03:39:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.598+0000 7f1fbc200640 1 --2- 172.21.15.121:0/2644131989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fb406cde0 0x7f1fb406d1f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.598+0000 7f1fbc200640 1 --2- 172.21.15.121:0/2644131989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fb40ce9e0 0x7f1fb40d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.598+0000 7f1fbc200640 1 --2- 172.21.15.121:0/2644131989 >> v2:172.21.15.176:3300/0 conn(0x7f1fb40cc270 0x7f1fb40d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.598+0000 7f1fbc200640 1 -- 172.21.15.121:0/2644131989 >> 172.21.15.121:0/2644131989 conn(0x7f1fb40b3580 msgr2=0x7f1fb40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.598+0000 7f1fbc200640 1 -- 172.21.15.121:0/2644131989 shutdown_connections 2024-09-17T03:39:43.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.598+0000 7f1fbc200640 1 -- 172.21.15.121:0/2644131989 wait complete. 2024-09-17T03:39:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.601+0000 7f1fbc200640 1 Processor -- start 2024-09-17T03:39:43.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.601+0000 7f1fbc200640 1 -- start start 2024-09-17T03:39:43.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fbc200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fb406cde0 0x7f1fb41f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:43.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fbc200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fb40cc270 0x7f1fb40c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:43.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fbc200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fb40ce9e0 0x7f1fb409cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:43.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fbc200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb406d730 con 0x7f1fb406cde0 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fbc200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb406d8b0 con 0x7f1fb40ce9e0 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fbc200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb406da30 con 0x7f1fb40cc270 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fb9800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fb406cde0 0x7f1fb41f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fb9800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fb406cde0 0x7f1fb41f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55238/0 (socket says 172.21.15.121:55238) 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fb9800640 1 -- 172.21.15.121:0/1924283966 learned_addr learned my addr 172.21.15.121:0/1924283966 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fba200640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fb40ce9e0 0x7f1fb409cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.602+0000 7f1fb8e00640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fb40cc270 0x7f1fb40c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.603+0000 7f1fb9800640 1 -- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fb40cc270 msgr2=0x7f1fb40c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.603+0000 7f1fb9800640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fb40cc270 0x7f1fb40c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.603+0000 7f1fb9800640 1 -- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fb40ce9e0 msgr2=0x7f1fb409cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.603+0000 7f1fb9800640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fb40ce9e0 0x7f1fb409cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.603+0000 7f1fb9800640 1 -- 172.21.15.121:0/1924283966 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb41f4230 con 0x7f1fb406cde0 2024-09-17T03:39:43.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.603+0000 7f1fb9800640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fb406cde0 0x7f1fb41f3770 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800e710 tx=0x7f1fa800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:43.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.603+0000 7f1fb1600640 1 -- 172.21.15.121:0/1924283966 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800cab0 con 0x7f1fb406cde0 2024-09-17T03:39:43.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.603+0000 7f1fb1600640 1 -- 172.21.15.121:0/1924283966 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fa800cd40 con 0x7f1fb406cde0 2024-09-17T03:39:43.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.603+0000 7f1fb1600640 1 -- 172.21.15.121:0/1924283966 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8010690 con 0x7f1fb406cde0 2024-09-17T03:39:43.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.603+0000 7f1fbc200640 1 -- 172.21.15.121:0/1924283966 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb41f4510 con 0x7f1fb406cde0 2024-09-17T03:39:43.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.604+0000 7f1fbc200640 1 -- 172.21.15.121:0/1924283966 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb41f3cb0 con 0x7f1fb406cde0 2024-09-17T03:39:43.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.605+0000 7f1fbc200640 1 -- 172.21.15.121:0/1924283966 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb406d1f0 con 0x7f1fb406cde0 2024-09-17T03:39:43.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.606+0000 7f1fb1600640 1 -- 172.21.15.121:0/1924283966 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fa8010a40 con 0x7f1fb406cde0 2024-09-17T03:39:43.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.607+0000 7f1fb1600640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1f94078b90 0x7f1f9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:43.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.607+0000 7f1fb1600640 1 -- 172.21.15.121:0/1924283966 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f1fa809ba90 con 0x7f1fb406cde0 2024-09-17T03:39:43.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.607+0000 7f1fb8e00640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1f94078b90 0x7f1f9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:43.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.608+0000 7f1fb8e00640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1f94078b90 0x7f1f9407b0a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1fb406e270 tx=0x7f1fa0005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:43.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.611+0000 7f1fb1600640 1 -- 172.21.15.121:0/1924283966 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1fa8063650 con 0x7f1fb406cde0 2024-09-17T03:39:43.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.833+0000 7f1fbc200640 1 -- 172.21.15.121:0/1924283966 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1fb4074240 con 0x7f1fb406cde0 2024-09-17T03:39:43.834 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-17T03:39:43.834+0000 7f1def400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:39:43.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.836+0000 7f1fb1600640 1 -- 172.21.15.121:0/1924283966 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v60) ==== 161+0+0 (secure 0 0 0) 0x7f1fa809b070 con 0x7f1fb406cde0 2024-09-17T03:39:43.836 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:39:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 -- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1f94078b90 msgr2=0x7f1f9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1f94078b90 0x7f1f9407b0a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1fb406e270 tx=0x7f1fa0005f90 comp rx=0 tx=0).stop 2024-09-17T03:39:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 -- 172.21.15.121:0/1924283966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fb406cde0 msgr2=0x7f1fb41f3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fb406cde0 0x7f1fb41f3770 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800e710 tx=0x7f1fa800ebd0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 -- 172.21.15.121:0/1924283966 shutdown_connections 2024-09-17T03:39:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fb40ce9e0 0x7f1fb409cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fb40cc270 0x7f1fb40c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1f94078b90 0x7f1f9407b0a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 --2- 172.21.15.121:0/1924283966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fb406cde0 0x7f1fb41f3770 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 -- 172.21.15.121:0/1924283966 >> 172.21.15.121:0/1924283966 conn(0x7f1fb40b3580 msgr2=0x7f1fb4074760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:43.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 -- 172.21.15.121:0/1924283966 shutdown_connections 2024-09-17T03:39:43.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:43.840+0000 7f1fbc200640 1 -- 172.21.15.121:0/1924283966 wait complete. 2024-09-17T03:39:43.848 INFO:tasks.ceph.mds.a.smithi121.stderr: -2386> 2024-09-17T03:39:29.322+0000 7f5782800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:39:43.872 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:39:43.973 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:39:44.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.105+0000 7f1a6a000640 1 -- 172.21.15.121:0/4002686091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a640b5250 msgr2=0x7f1a640cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:44.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.105+0000 7f1a6a000640 1 --2- 172.21.15.121:0/4002686091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a640b5250 0x7f1a640cd180 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009850 tx=0x7f1a5402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:39:44.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.105+0000 7f1a6a000640 1 -- 172.21.15.121:0/4002686091 shutdown_connections 2024-09-17T03:39:44.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.105+0000 7f1a6a000640 1 --2- 172.21.15.121:0/4002686091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a6415d590 0x7f1a6406d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:44.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.105+0000 7f1a6a000640 1 --2- 172.21.15.121:0/4002686091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a640b5250 0x7f1a640cd180 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:44.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.105+0000 7f1a6a000640 1 -- 172.21.15.121:0/4002686091 >> 172.21.15.121:0/4002686091 conn(0x7f1a640d07f0 msgr2=0x7f1a640b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:44.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.105+0000 7f1a6a000640 1 -- 172.21.15.121:0/4002686091 shutdown_connections 2024-09-17T03:39:44.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.105+0000 7f1a6a000640 1 -- 172.21.15.121:0/4002686091 wait complete. 2024-09-17T03:39:44.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.108+0000 7f1a6a000640 1 Processor -- start 2024-09-17T03:39:44.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.108+0000 7f1a6a000640 1 -- start start 2024-09-17T03:39:44.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.109+0000 7f1a6a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a640b5250 0x7f1a6413f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:44.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.109+0000 7f1a6a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a6415ca70 0x7f1a641f9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:44.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.109+0000 7f1a6a000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a6415d590 0x7f1a640b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:44.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.109+0000 7f1a6a000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6406dfb0 con 0x7f1a640b5250 2024-09-17T03:39:44.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.109+0000 7f1a6a000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6406de30 con 0x7f1a6415d590 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.109+0000 7f1a6a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6406e130 con 0x7f1a6415ca70 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.109+0000 7f1a68c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a640b5250 0x7f1a6413f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.109+0000 7f1a68c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a640b5250 0x7f1a6413f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55260/0 (socket says 172.21.15.121:55260) 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.109+0000 7f1a68c00640 1 -- 172.21.15.121:0/1795808106 learned_addr learned my addr 172.21.15.121:0/1795808106 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.110+0000 7f1a69600640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a6415d590 0x7f1a640b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.110+0000 7f1a5be00640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a6415ca70 0x7f1a641f9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.110+0000 7f1a68c00640 1 -- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a6415ca70 msgr2=0x7f1a641f9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.110+0000 7f1a68c00640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a6415ca70 0x7f1a641f9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.110+0000 7f1a68c00640 1 -- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a6415d590 msgr2=0x7f1a640b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.110+0000 7f1a68c00640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a6415d590 0x7f1a640b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.110+0000 7f1a68c00640 1 -- 172.21.15.121:0/1795808106 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a64141ff0 con 0x7f1a640b5250 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.110+0000 7f1a68c00640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a640b5250 0x7f1a6413f4e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1a54000c00 tx=0x7f1a54005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.110+0000 7f1a61600640 1 -- 172.21.15.121:0/1795808106 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5403f070 con 0x7f1a640b5250 2024-09-17T03:39:44.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.110+0000 7f1a61600640 1 -- 172.21.15.121:0/1795808106 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a54004340 con 0x7f1a640b5250 2024-09-17T03:39:44.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.111+0000 7f1a61600640 1 -- 172.21.15.121:0/1795808106 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54033e60 con 0x7f1a640b5250 2024-09-17T03:39:44.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.111+0000 7f1a6a000640 1 -- 172.21.15.121:0/1795808106 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a641422d0 con 0x7f1a640b5250 2024-09-17T03:39:44.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.111+0000 7f1a6a000640 1 -- 172.21.15.121:0/1795808106 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a64142890 con 0x7f1a640b5250 2024-09-17T03:39:44.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.112+0000 7f1a6a000640 1 -- 172.21.15.121:0/1795808106 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a6406e650 con 0x7f1a640b5250 2024-09-17T03:39:44.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.113+0000 7f1a61600640 1 -- 172.21.15.121:0/1795808106 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a54042070 con 0x7f1a640b5250 2024-09-17T03:39:44.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.114+0000 7f1a61600640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a40078bc0 0x7f1a4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:44.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.114+0000 7f1a61600640 1 -- 172.21.15.121:0/1795808106 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7f1a540bbda0 con 0x7f1a640b5250 2024-09-17T03:39:44.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.114+0000 7f1a5be00640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a40078bc0 0x7f1a4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:44.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.115+0000 7f1a5be00640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a40078bc0 0x7f1a4007b0d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1a640af610 tx=0x7f1a4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:44.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.119+0000 7f1a61600640 1 -- 172.21.15.121:0/1795808106 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1a54083ff0 con 0x7f1a640b5250 2024-09-17T03:39:44.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.337+0000 7f1a6a000640 1 -- 172.21.15.121:0/1795808106 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1a6406ad90 con 0x7f1a640b5250 2024-09-17T03:39:44.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.838+0000 7f1a61600640 1 -- 172.21.15.121:0/1795808106 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) ==== 104+0+0 (secure 0 0 0) 0x7f1a54031770 con 0x7f1a640b5250 2024-09-17T03:39:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 -- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a40078bc0 msgr2=0x7f1a4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a40078bc0 0x7f1a4007b0d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1a640af610 tx=0x7f1a4c009040 comp rx=0 tx=0).stop 2024-09-17T03:39:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 -- 172.21.15.121:0/1795808106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a640b5250 msgr2=0x7f1a6413f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a640b5250 0x7f1a6413f4e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1a54000c00 tx=0x7f1a54005270 comp rx=0 tx=0).stop 2024-09-17T03:39:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 -- 172.21.15.121:0/1795808106 shutdown_connections 2024-09-17T03:39:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a6415d590 0x7f1a640b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:44.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a6415ca70 0x7f1a641f9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1a40078bc0 0x7f1a4007b0d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 --2- 172.21.15.121:0/1795808106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a640b5250 0x7f1a6413f4e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 -- 172.21.15.121:0/1795808106 >> 172.21.15.121:0/1795808106 conn(0x7f1a640d07f0 msgr2=0x7f1a64160740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 -- 172.21.15.121:0/1795808106 shutdown_connections 2024-09-17T03:39:44.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:44.841+0000 7f1a6a000640 1 -- 172.21.15.121:0/1795808106 wait complete. 2024-09-17T03:39:44.869 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:39:45.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.092+0000 7f42bd600640 1 -- 172.21.15.121:0/3054619175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b80d0d00 msgr2=0x7f42b806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:45.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.092+0000 7f42bd600640 1 --2- 172.21.15.121:0/3054619175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b80d0d00 0x7f42b806db60 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f42b80b4250 tx=0x7f42b002aa30 comp rx=0 tx=0).stop 2024-09-17T03:39:45.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.092+0000 7f42bd600640 1 -- 172.21.15.121:0/3054619175 shutdown_connections 2024-09-17T03:39:45.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.092+0000 7f42bd600640 1 --2- 172.21.15.121:0/3054619175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b80d0d00 0x7f42b806db60 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:45.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.092+0000 7f42bd600640 1 --2- 172.21.15.121:0/3054619175 >> v2:172.21.15.176:3300/0 conn(0x7f42b815c830 0x7f42b80ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:45.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.092+0000 7f42bd600640 1 -- 172.21.15.121:0/3054619175 >> 172.21.15.121:0/3054619175 conn(0x7f42b80b3620 msgr2=0x7f42b80b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:45.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.092+0000 7f42bd600640 1 -- 172.21.15.121:0/3054619175 shutdown_connections 2024-09-17T03:39:45.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.092+0000 7f42bd600640 1 -- 172.21.15.121:0/3054619175 wait complete. 2024-09-17T03:39:45.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.095+0000 7f42bd600640 1 Processor -- start 2024-09-17T03:39:45.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.095+0000 7f42bd600640 1 -- start start 2024-09-17T03:39:45.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.096+0000 7f42bd600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b806d750 0x7f42b81f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:45.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.096+0000 7f42bd600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b815c830 0x7f42b8150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:45.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.096+0000 7f42bd600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b80ae190 0x7f42b80ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:45.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.096+0000 7f42bd600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42b815d420 con 0x7f42b806d750 2024-09-17T03:39:45.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.096+0000 7f42bd600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f42b815d2a0 con 0x7f42b80ae190 2024-09-17T03:39:45.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.096+0000 7f42bd600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f42b815d5a0 con 0x7f42b815c830 2024-09-17T03:39:45.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.096+0000 7f42b6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b806d750 0x7f42b81f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:45.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.096+0000 7f42b6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b806d750 0x7f42b81f54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55288/0 (socket says 172.21.15.121:55288) 2024-09-17T03:39:45.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.096+0000 7f42b6a00640 1 -- 172.21.15.121:0/2459845898 learned_addr learned my addr 172.21.15.121:0/2459845898 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:45.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42b7400640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b80ae190 0x7f42b80ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:45.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42b6000640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b815c830 0x7f42b8150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:45.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42b6a00640 1 -- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b815c830 msgr2=0x7f42b8150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42b6a00640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b815c830 0x7f42b8150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42b6a00640 1 -- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b80ae190 msgr2=0x7f42b80ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42b6a00640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b80ae190 0x7f42b80ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42b6a00640 1 -- 172.21.15.121:0/2459845898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b80aeae0 con 0x7f42b806d750 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42b7400640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b80ae190 0x7f42b80ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42b6a00640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b806d750 0x7f42b81f54d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f42a800d740 tx=0x7f42a800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42aea00640 1 -- 172.21.15.121:0/2459845898 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8017070 con 0x7f42b806d750 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42aea00640 1 -- 172.21.15.121:0/2459845898 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42a8009cc0 con 0x7f42b806d750 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42bd600640 1 -- 172.21.15.121:0/2459845898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b81f5f30 con 0x7f42b806d750 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.097+0000 7f42aea00640 1 -- 172.21.15.121:0/2459845898 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a80106c0 con 0x7f42b806d750 2024-09-17T03:39:45.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.098+0000 7f42bd600640 1 -- 172.21.15.121:0/2459845898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b809a490 con 0x7f42b806d750 2024-09-17T03:39:45.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.099+0000 7f42bd600640 1 -- 172.21.15.121:0/2459845898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b815da70 con 0x7f42b806d750 2024-09-17T03:39:45.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.100+0000 7f42aea00640 1 -- 172.21.15.121:0/2459845898 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42a801a070 con 0x7f42b806d750 2024-09-17T03:39:45.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.101+0000 7f42aea00640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4298078bc0 0x7f429807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:45.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.101+0000 7f42aea00640 1 -- 172.21.15.121:0/2459845898 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6187+0+0 (secure 0 0 0) 0x7f42a809afd0 con 0x7f42b806d750 2024-09-17T03:39:45.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.101+0000 7f42b6000640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4298078bc0 0x7f429807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:45.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.102+0000 7f42b6000640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4298078bc0 0x7f429807b0d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f42a4006fd0 tx=0x7f42a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:45.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.105+0000 7f42aea00640 1 -- 172.21.15.121:0/2459845898 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42b80aeae0 con 0x7f42b806d750 2024-09-17T03:39:45.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.287+0000 7f42bd600640 1 -- 172.21.15.121:0/2459845898 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42b8074ea0 con 0x7f42b806d750 2024-09-17T03:39:45.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.844+0000 7f42aea00640 1 -- 172.21.15.121:0/2459845898 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) ==== 181+0+0 (secure 0 0 0) 0x7f42a80632b0 con 0x7f42b806d750 2024-09-17T03:39:45.844 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:39:45.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 -- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4298078bc0 msgr2=0x7f429807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:45.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4298078bc0 0x7f429807b0d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f42a4006fd0 tx=0x7f42a4008040 comp rx=0 tx=0).stop 2024-09-17T03:39:45.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 -- 172.21.15.121:0/2459845898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b806d750 msgr2=0x7f42b81f54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:45.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b806d750 0x7f42b81f54d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f42a800d740 tx=0x7f42a800dc00 comp rx=0 tx=0).stop 2024-09-17T03:39:45.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 -- 172.21.15.121:0/2459845898 shutdown_connections 2024-09-17T03:39:45.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b80ae190 0x7f42b80ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:45.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b815c830 0x7f42b8150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:45.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4298078bc0 0x7f429807b0d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:45.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 --2- 172.21.15.121:0/2459845898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42b806d750 0x7f42b81f54d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:45.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 -- 172.21.15.121:0/2459845898 >> 172.21.15.121:0/2459845898 conn(0x7f42b80b3620 msgr2=0x7f42b8074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:45.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 -- 172.21.15.121:0/2459845898 shutdown_connections 2024-09-17T03:39:45.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:45.847+0000 7f42bd600640 1 -- 172.21.15.121:0/2459845898 wait complete. 2024-09-17T03:39:45.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:39:46.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.160+0000 7f00cd200640 1 -- 172.21.15.121:0/2367819698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00c806d750 msgr2=0x7f00c806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:46.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.160+0000 7f00cd200640 1 --2- 172.21.15.121:0/2367819698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00c806d750 0x7f00c806db60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009860 tx=0x7f00b002a540 comp rx=0 tx=0).stop 2024-09-17T03:39:46.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.160+0000 7f00cd200640 1 -- 172.21.15.121:0/2367819698 shutdown_connections 2024-09-17T03:39:46.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.160+0000 7f00cd200640 1 --2- 172.21.15.121:0/2367819698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00c80d05f0 0x7f00c80d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:46.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.160+0000 7f00cd200640 1 --2- 172.21.15.121:0/2367819698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00c806d750 0x7f00c806db60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:46.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.160+0000 7f00cd200640 1 -- 172.21.15.121:0/2367819698 >> 172.21.15.121:0/2367819698 conn(0x7f00c80b3620 msgr2=0x7f00c80b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:46.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.160+0000 7f00cd200640 1 -- 172.21.15.121:0/2367819698 shutdown_connections 2024-09-17T03:39:46.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.160+0000 7f00cd200640 1 -- 172.21.15.121:0/2367819698 wait complete. 2024-09-17T03:39:46.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.163+0000 7f00cd200640 1 Processor -- start 2024-09-17T03:39:46.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.163+0000 7f00cd200640 1 -- start start 2024-09-17T03:39:46.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.164+0000 7f00cd200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00c806d750 0x7f00c8152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:46.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.164+0000 7f00cd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c80d05f0 0x7f00c815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:46.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.164+0000 7f00cd200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00c815c830 0x7f00c815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:46.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.164+0000 7f00cd200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00c815d420 con 0x7f00c80d05f0 2024-09-17T03:39:46.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.164+0000 7f00cd200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f00c815d2a0 con 0x7f00c815c830 2024-09-17T03:39:46.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.164+0000 7f00cd200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f00c815d5a0 con 0x7f00c806d750 2024-09-17T03:39:46.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.164+0000 7f00bd400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c80d05f0 0x7f00c815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:46.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.165+0000 7f00bd400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c80d05f0 0x7f00c815b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55304/0 (socket says 172.21.15.121:55304) 2024-09-17T03:39:46.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.165+0000 7f00bd400640 1 -- 172.21.15.121:0/490832653 learned_addr learned my addr 172.21.15.121:0/490832653 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:46.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.165+0000 7f00c6800640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00c815c830 0x7f00c815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:46.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.165+0000 7f00c5e00640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00c806d750 0x7f00c8152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:46.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.165+0000 7f00bd400640 1 -- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00c806d750 msgr2=0x7f00c8152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:46.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.165+0000 7f00bd400640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00c806d750 0x7f00c8152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:46.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.165+0000 7f00bd400640 1 -- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00c815c830 msgr2=0x7f00c815b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:46.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.165+0000 7f00bd400640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00c815c830 0x7f00c815b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:46.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.165+0000 7f00bd400640 1 -- 172.21.15.121:0/490832653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c8153000 con 0x7f00c80d05f0 2024-09-17T03:39:46.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.165+0000 7f00bd400640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c80d05f0 0x7f00c815b360 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009980 tx=0x7f00b0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:46.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.166+0000 7f00bea00640 1 -- 172.21.15.121:0/490832653 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0005c90 con 0x7f00c80d05f0 2024-09-17T03:39:46.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.166+0000 7f00cd200640 1 -- 172.21.15.121:0/490832653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c80b1480 con 0x7f00c80d05f0 2024-09-17T03:39:46.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.166+0000 7f00bea00640 1 -- 172.21.15.121:0/490832653 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00b0031e50 con 0x7f00c80d05f0 2024-09-17T03:39:46.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.166+0000 7f00bea00640 1 -- 172.21.15.121:0/490832653 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0005260 con 0x7f00c80d05f0 2024-09-17T03:39:46.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.166+0000 7f00cd200640 1 -- 172.21.15.121:0/490832653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c80b1a40 con 0x7f00c80d05f0 2024-09-17T03:39:46.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.167+0000 7f00cd200640 1 -- 172.21.15.121:0/490832653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c815daa0 con 0x7f00c80d05f0 2024-09-17T03:39:46.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.168+0000 7f00bea00640 1 -- 172.21.15.121:0/490832653 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f00b0005400 con 0x7f00c80d05f0 2024-09-17T03:39:46.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.169+0000 7f00bea00640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f00a4078b90 0x7f00a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:46.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.169+0000 7f00bea00640 1 -- 172.21.15.121:0/490832653 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5749+0+0 (secure 0 0 0) 0x7f00b00bbd30 con 0x7f00c80d05f0 2024-09-17T03:39:46.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.169+0000 7f00c5e00640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f00a4078b90 0x7f00a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:46.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.170+0000 7f00c5e00640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f00a4078b90 0x7f00a407b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f00b8007d60 tx=0x7f00b8007cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:46.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.174+0000 7f00bea00640 1 -- 172.21.15.121:0/490832653 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f00c8153000 con 0x7f00c80d05f0 2024-09-17T03:39:46.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.359+0000 7f00cd200640 1 -- 172.21.15.121:0/490832653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f00c80b3ad0 con 0x7f00c80d05f0 2024-09-17T03:39:46.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.846+0000 7f00bea00640 1 -- 172.21.15.121:0/490832653 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) ==== 169+0+0 (secure 0 0 0) 0x7f00b003f030 con 0x7f00c80d05f0 2024-09-17T03:39:46.846 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-17T03:39:46.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.849+0000 7f00cd200640 1 -- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f00a4078b90 msgr2=0x7f00a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:46.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.849+0000 7f00cd200640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f00a4078b90 0x7f00a407b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f00b8007d60 tx=0x7f00b8007cf0 comp rx=0 tx=0).stop 2024-09-17T03:39:46.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.849+0000 7f00cd200640 1 -- 172.21.15.121:0/490832653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c80d05f0 msgr2=0x7f00c815b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:46.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.849+0000 7f00cd200640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c80d05f0 0x7f00c815b360 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009980 tx=0x7f00b0033c20 comp rx=0 tx=0).stop 2024-09-17T03:39:46.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.850+0000 7f00cd200640 1 -- 172.21.15.121:0/490832653 shutdown_connections 2024-09-17T03:39:46.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.850+0000 7f00cd200640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00c815c830 0x7f00c815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:46.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.850+0000 7f00cd200640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f00a4078b90 0x7f00a407b0a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:46.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.850+0000 7f00cd200640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00c80d05f0 0x7f00c815b360 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:46.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.850+0000 7f00cd200640 1 --2- 172.21.15.121:0/490832653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00c806d750 0x7f00c8152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:46.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.850+0000 7f00cd200640 1 -- 172.21.15.121:0/490832653 >> 172.21.15.121:0/490832653 conn(0x7f00c80b3620 msgr2=0x7f00c8153300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:46.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.850+0000 7f00cd200640 1 -- 172.21.15.121:0/490832653 shutdown_connections 2024-09-17T03:39:46.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:46.850+0000 7f00cd200640 1 -- 172.21.15.121:0/490832653 wait complete. 2024-09-17T03:39:46.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:39:47.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.103+0000 7f7fe7e00640 1 -- 172.21.15.121:0/347892671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe815ca70 msgr2=0x7f7fe815ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:47.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.103+0000 7f7fe7e00640 1 --2- 172.21.15.121:0/347892671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe815ca70 0x7f7fe815ce80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80750b0 tx=0x7f7fd002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.103+0000 7f7fe7e00640 1 -- 172.21.15.121:0/347892671 shutdown_connections 2024-09-17T03:39:47.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.103+0000 7f7fe7e00640 1 --2- 172.21.15.121:0/347892671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe815ca70 0x7f7fe815ce80 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.103+0000 7f7fe7e00640 1 --2- 172.21.15.121:0/347892671 >> v2:172.21.15.176:3300/0 conn(0x7f7fe80b5250 0x7f7fe80cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.103+0000 7f7fe7e00640 1 -- 172.21.15.121:0/347892671 >> 172.21.15.121:0/347892671 conn(0x7f7fe80d07f0 msgr2=0x7f7fe80b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:47.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.103+0000 7f7fe7e00640 1 -- 172.21.15.121:0/347892671 shutdown_connections 2024-09-17T03:39:47.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.103+0000 7f7fe7e00640 1 -- 172.21.15.121:0/347892671 wait complete. 2024-09-17T03:39:47.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.106+0000 7f7fe7e00640 1 Processor -- start 2024-09-17T03:39:47.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.106+0000 7f7fe7e00640 1 -- start start 2024-09-17T03:39:47.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.107+0000 7f7fe7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe80b5250 0x7f7fe8147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:47.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.107+0000 7f7fe7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe815ca70 0x7f7fe81440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.107+0000 7f7fe7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe815d3c0 0x7f7fe80a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.107+0000 7f7fe7e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8160770 con 0x7f7fe80b5250 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.107+0000 7f7fe7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe806e780 con 0x7f7fe815d3c0 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.107+0000 7f7fe7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe81608f0 con 0x7f7fe815ca70 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.107+0000 7f7fe6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe80b5250 0x7f7fe8147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.107+0000 7f7fe6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe80b5250 0x7f7fe8147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55326/0 (socket says 172.21.15.121:55326) 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.107+0000 7f7fe6a00640 1 -- 172.21.15.121:0/2634132993 learned_addr learned my addr 172.21.15.121:0/2634132993 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fde000640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe815ca70 0x7f7fe81440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fe7400640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe815d3c0 0x7f7fe80a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fe6a00640 1 -- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe815ca70 msgr2=0x7f7fe81440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fe6a00640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe815ca70 0x7f7fe81440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fe6a00640 1 -- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe815d3c0 msgr2=0x7f7fe80a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:47.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fe6a00640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe815d3c0 0x7f7fe80a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fe6a00640 1 -- 172.21.15.121:0/2634132993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe8147980 con 0x7f7fe80b5250 2024-09-17T03:39:47.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fde000640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe815ca70 0x7f7fe81440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:47.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fe7400640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe815d3c0 0x7f7fe80a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:47.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fe6a00640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe80b5250 0x7f7fe8147440 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800e7f0 tx=0x7f7fd800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:47.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fdf400640 1 -- 172.21.15.121:0/2634132993 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800ccc0 con 0x7f7fe80b5250 2024-09-17T03:39:47.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fdf400640 1 -- 172.21.15.121:0/2634132993 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fd8010430 con 0x7f7fe80b5250 2024-09-17T03:39:47.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fe7e00640 1 -- 172.21.15.121:0/2634132993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe81f8820 con 0x7f7fe80b5250 2024-09-17T03:39:47.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.108+0000 7f7fdf400640 1 -- 172.21.15.121:0/2634132993 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8010840 con 0x7f7fe80b5250 2024-09-17T03:39:47.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.109+0000 7f7fe7e00640 1 -- 172.21.15.121:0/2634132993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe81f8de0 con 0x7f7fe80b5250 2024-09-17T03:39:47.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.110+0000 7f7fe7e00640 1 -- 172.21.15.121:0/2634132993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe8160e10 con 0x7f7fe80b5250 2024-09-17T03:39:47.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.111+0000 7f7fdf400640 1 -- 172.21.15.121:0/2634132993 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fd80109e0 con 0x7f7fe80b5250 2024-09-17T03:39:47.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.112+0000 7f7fdf400640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc4078b90 0x7f7fc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:47.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.112+0000 7f7fdf400640 1 -- 172.21.15.121:0/2634132993 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5335+0+0 (secure 0 0 0) 0x7f7fd809b6d0 con 0x7f7fe80b5250 2024-09-17T03:39:47.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.112+0000 7f7fde000640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc4078b90 0x7f7fc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:47.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.113+0000 7f7fde000640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc4078b90 0x7f7fc407b0a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0034000 tx=0x7f7fd0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:47.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.116+0000 7f7fdf400640 1 -- 172.21.15.121:0/2634132993 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7fe8147980 con 0x7f7fe80b5250 2024-09-17T03:39:47.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.298+0000 7f7fe7e00640 1 -- 172.21.15.121:0/2634132993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f7fe81f9430 con 0x7f7fe80b5250 2024-09-17T03:39:47.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.303+0000 7f7fdf400640 1 -- 172.21.15.121:0/2634132993 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v44) ==== 71+0+0 (secure 0 0 0) 0x7f7fd8063be0 con 0x7f7fe80b5250 2024-09-17T03:39:47.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 -- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc4078b90 msgr2=0x7f7fc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:47.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc4078b90 0x7f7fc407b0a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0034000 tx=0x7f7fd0004730 comp rx=0 tx=0).stop 2024-09-17T03:39:47.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 -- 172.21.15.121:0/2634132993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe80b5250 msgr2=0x7f7fe8147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:47.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe80b5250 0x7f7fe8147440 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800e7f0 tx=0x7f7fd800ecb0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 -- 172.21.15.121:0/2634132993 shutdown_connections 2024-09-17T03:39:47.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fe815d3c0 0x7f7fe80a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fe815ca70 0x7f7fe81440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7fc4078b90 0x7f7fc407b0a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 --2- 172.21.15.121:0/2634132993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fe80b5250 0x7f7fe8147440 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 -- 172.21.15.121:0/2634132993 >> 172.21.15.121:0/2634132993 conn(0x7f7fe80d07f0 msgr2=0x7f7fe806f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:47.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 -- 172.21.15.121:0/2634132993 shutdown_connections 2024-09-17T03:39:47.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.305+0000 7f7fe7e00640 1 -- 172.21.15.121:0/2634132993 wait complete. 2024-09-17T03:39:47.327 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close' 2024-09-17T03:39:47.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.549+0000 7fa16a600640 1 -- 172.21.15.121:0/1726380583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1640b5b80 msgr2=0x7fa1640afb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:47.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.549+0000 7fa16a600640 1 --2- 172.21.15.121:0/1726380583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1640b5b80 0x7fa1640afb20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa154009830 tx=0x7fa15402a510 comp rx=0 tx=0).stop 2024-09-17T03:39:47.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.549+0000 7fa16a600640 1 -- 172.21.15.121:0/1726380583 shutdown_connections 2024-09-17T03:39:47.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.549+0000 7fa16a600640 1 --2- 172.21.15.121:0/1726380583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1640b0060 0x7fa164162440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.549+0000 7fa16a600640 1 --2- 172.21.15.121:0/1726380583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1640b5b80 0x7fa1640afb20 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.549+0000 7fa16a600640 1 -- 172.21.15.121:0/1726380583 >> 172.21.15.121:0/1726380583 conn(0x7fa164073fe0 msgr2=0x7fa1640743f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:47.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.549+0000 7fa16a600640 1 -- 172.21.15.121:0/1726380583 shutdown_connections 2024-09-17T03:39:47.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.549+0000 7fa16a600640 1 -- 172.21.15.121:0/1726380583 wait complete. 2024-09-17T03:39:47.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.551+0000 7fa16a600640 1 Processor -- start 2024-09-17T03:39:47.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.552+0000 7fa16a600640 1 -- start start 2024-09-17T03:39:47.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa16a600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1640b0060 0x7fa1640c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:47.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa16a600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1640b5b80 0x7fa16414bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa16a600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa164162980 0x7fa1641f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa16a600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa16415f6e0 con 0x7fa164162980 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa16a600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa16415f560 con 0x7fa1640b0060 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa16a600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa16415f860 con 0x7fa1640b5b80 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa163e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa164162980 0x7fa1641f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa163e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa164162980 0x7fa1641f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55346/0 (socket says 172.21.15.121:55346) 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa163e00640 1 -- 172.21.15.121:0/295823741 learned_addr learned my addr 172.21.15.121:0/295823741 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa163400640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1640b0060 0x7fa1640c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.553+0000 7fa15aa00640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1640b5b80 0x7fa16414bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa163e00640 1 -- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1640b5b80 msgr2=0x7fa16414bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa163e00640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1640b5b80 0x7fa16414bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa163e00640 1 -- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1640b0060 msgr2=0x7fa1640c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:47.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa163e00640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1640b0060 0x7fa1640c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa163e00640 1 -- 172.21.15.121:0/295823741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16414ee70 con 0x7fa164162980 2024-09-17T03:39:47.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa163400640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1640b0060 0x7fa1640c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:47.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa163e00640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa164162980 0x7fa1641f52b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00c6c0 tx=0x7fa15c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:47.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa15be00640 1 -- 172.21.15.121:0/295823741 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c017070 con 0x7fa164162980 2024-09-17T03:39:47.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa15be00640 1 -- 172.21.15.121:0/295823741 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa15c003c60 con 0x7fa164162980 2024-09-17T03:39:47.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa16a600640 1 -- 172.21.15.121:0/295823741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa16414f150 con 0x7fa164162980 2024-09-17T03:39:47.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa15be00640 1 -- 172.21.15.121:0/295823741 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c0052d0 con 0x7fa164162980 2024-09-17T03:39:47.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.554+0000 7fa16a600640 1 -- 172.21.15.121:0/295823741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa16414f710 con 0x7fa164162980 2024-09-17T03:39:47.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.556+0000 7fa16a600640 1 -- 172.21.15.121:0/295823741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa164162440 con 0x7fa164162980 2024-09-17T03:39:47.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.557+0000 7fa15be00640 1 -- 172.21.15.121:0/295823741 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa15c01a070 con 0x7fa164162980 2024-09-17T03:39:47.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.558+0000 7fa15be00640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa140078bc0 0x7fa14007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:47.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.558+0000 7fa15be00640 1 -- 172.21.15.121:0/295823741 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5335+0+0 (secure 0 0 0) 0x7fa15c09a1e0 con 0x7fa164162980 2024-09-17T03:39:47.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.558+0000 7fa163400640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa140078bc0 0x7fa14007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:47.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.559+0000 7fa163400640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa140078bc0 0x7fa14007b0d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa154034000 tx=0x7fa154004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:47.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.562+0000 7fa15be00640 1 -- 172.21.15.121:0/295823741 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa164162d90 con 0x7fa164162980 2024-09-17T03:39:47.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.813+0000 7fa16a600640 1 -- 172.21.15.121:0/295823741 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]} v 0) -- 0x7fa1640c6880 con 0x7fa164162980 2024-09-17T03:39:47.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.854+0000 7fa15be00640 1 -- 172.21.15.121:0/295823741 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_conn_close"]}]=0 v249) ==== 143+0+0 (secure 0 0 0) 0x7fa15c0620a0 con 0x7fa164162980 2024-09-17T03:39:47.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 -- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa140078bc0 msgr2=0x7fa14007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:47.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa140078bc0 0x7fa14007b0d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa154034000 tx=0x7fa154004730 comp rx=0 tx=0).stop 2024-09-17T03:39:47.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 -- 172.21.15.121:0/295823741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa164162980 msgr2=0x7fa1641f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:47.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa164162980 0x7fa1641f52b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00c6c0 tx=0x7fa15c00cb80 comp rx=0 tx=0).stop 2024-09-17T03:39:47.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 -- 172.21.15.121:0/295823741 shutdown_connections 2024-09-17T03:39:47.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa140078bc0 0x7fa14007b0d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa164162980 0x7fa1641f52b0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1640b5b80 0x7fa16414bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 --2- 172.21.15.121:0/295823741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1640b0060 0x7fa1640c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:47.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 -- 172.21.15.121:0/295823741 >> 172.21.15.121:0/295823741 conn(0x7fa164073fe0 msgr2=0x7fa164161910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:47.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 -- 172.21.15.121:0/295823741 shutdown_connections 2024-09-17T03:39:47.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:47.857+0000 7fa16a600640 1 -- 172.21.15.121:0/295823741 wait complete. 2024-09-17T03:39:47.883 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2024-09-17T03:39:47.883 INFO:tasks.cephfs_test_runner:Starting test: test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) That when a `tell` command is sent using the python CLI, 2024-09-17T03:39:47.883 INFO:tasks.cephfs_test_runner:test_tell_session_drop (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-17T03:39:47.883 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:48.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.110+0000 7f2a05c00640 1 -- 172.21.15.121:0/1337918179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a000d0cc0 msgr2=0x7f2a0015cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:48.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.110+0000 7f2a05c00640 1 --2- 172.21.15.121:0/1337918179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a000d0cc0 0x7f2a0015cc10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2a000cdc20 tx=0x7f29f802a9a0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.110+0000 7f2a05c00640 1 -- 172.21.15.121:0/1337918179 shutdown_connections 2024-09-17T03:39:48.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.110+0000 7f2a05c00640 1 --2- 172.21.15.121:0/1337918179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a000d0cc0 0x7f2a0015cc10 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.110+0000 7f2a05c00640 1 --2- 172.21.15.121:0/1337918179 >> v2:172.21.15.176:3300/0 conn(0x7f2a0015a3e0 0x7f2a0006d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.110+0000 7f2a05c00640 1 -- 172.21.15.121:0/1337918179 >> 172.21.15.121:0/1337918179 conn(0x7f2a000b3580 msgr2=0x7f2a000b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:48.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.110+0000 7f2a05c00640 1 -- 172.21.15.121:0/1337918179 shutdown_connections 2024-09-17T03:39:48.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.110+0000 7f2a05c00640 1 -- 172.21.15.121:0/1337918179 wait complete. 2024-09-17T03:39:48.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.112+0000 7f2a05c00640 1 Processor -- start 2024-09-17T03:39:48.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.113+0000 7f2a05c00640 1 -- start start 2024-09-17T03:39:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f2a05c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a0006ddc0 0x7f2a001f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f2a05c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a0015a3e0 0x7f2a001f8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f2a05c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a00099360 0x7f2a00073a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f2a05c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0015d4e0 con 0x7f2a0015a3e0 2024-09-17T03:39:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f2a05c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0015d360 con 0x7f2a0006ddc0 2024-09-17T03:39:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f2a05c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0015d660 con 0x7f2a00099360 2024-09-17T03:39:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f29f7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a0015a3e0 0x7f2a001f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f29f7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a0015a3e0 0x7f2a001f8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55360/0 (socket says 172.21.15.121:55360) 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f29f7e00640 1 -- 172.21.15.121:0/911928693 learned_addr learned my addr 172.21.15.121:0/911928693 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f29fea00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a0006ddc0 0x7f2a001f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.114+0000 7f29ff400640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a00099360 0x7f2a00073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.115+0000 7f29f7e00640 1 -- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a00099360 msgr2=0x7f2a00073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.115+0000 7f29f7e00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a00099360 0x7f2a00073a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.115+0000 7f29f7e00640 1 -- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a0006ddc0 msgr2=0x7f2a001f9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.115+0000 7f29f7e00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a0006ddc0 0x7f2a001f9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.115+0000 7f29f7e00640 1 -- 172.21.15.121:0/911928693 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a000b1630 con 0x7f2a0015a3e0 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.115+0000 7f29f7e00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a0015a3e0 0x7f2a001f8950 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c370 tx=0x7f29e800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.115+0000 7f29f6a00640 1 -- 172.21.15.121:0/911928693 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8017070 con 0x7f2a0015a3e0 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.115+0000 7f29f6a00640 1 -- 172.21.15.121:0/911928693 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29e80053c0 con 0x7f2a0015a3e0 2024-09-17T03:39:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.115+0000 7f2a05c00640 1 -- 172.21.15.121:0/911928693 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a000b1910 con 0x7f2a0015a3e0 2024-09-17T03:39:48.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.115+0000 7f29f6a00640 1 -- 172.21.15.121:0/911928693 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8003850 con 0x7f2a0015a3e0 2024-09-17T03:39:48.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.116+0000 7f2a05c00640 1 -- 172.21.15.121:0/911928693 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a001f96b0 con 0x7f2a0015a3e0 2024-09-17T03:39:48.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.117+0000 7f2a05c00640 1 -- 172.21.15.121:0/911928693 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0015db10 con 0x7f2a0015a3e0 2024-09-17T03:39:48.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.118+0000 7f29f6a00640 1 -- 172.21.15.121:0/911928693 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29e801a070 con 0x7f2a0015a3e0 2024-09-17T03:39:48.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.119+0000 7f29f6a00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29dc078bc0 0x7f29dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:48.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.119+0000 7f29f6a00640 1 -- 172.21.15.121:0/911928693 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5335+0+0 (secure 0 0 0) 0x7f29e8099df0 con 0x7f2a0015a3e0 2024-09-17T03:39:48.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.119+0000 7f29fea00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29dc078bc0 0x7f29dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:48.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.120+0000 7f29fea00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29dc078bc0 0x7f29dc07b0d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f29f000bb50 tx=0x7f29f000b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:48.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.123+0000 7f29f6a00640 1 -- 172.21.15.121:0/911928693 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29e8061dd0 con 0x7f2a0015a3e0 2024-09-17T03:39:48.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.309+0000 7f2a05c00640 1 -- 172.21.15.121:0/911928693 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a001e8400 con 0x7f2a0015a3e0 2024-09-17T03:39:48.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.310+0000 7f29f6a00640 1 -- 172.21.15.121:0/911928693 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+13368 (secure 0 0 0) 0x7f29e8066800 con 0x7f2a0015a3e0 2024-09-17T03:39:48.310 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:48.310 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":90,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:46.844952+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6835/3165070053":"2024-09-18T03:39:43.835037+0000","172.21.15.121:6834/3165070053":"2024-09-18T03:39:43.835037+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:48.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 -- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29dc078bc0 msgr2=0x7f29dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:48.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29dc078bc0 0x7f29dc07b0d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f29f000bb50 tx=0x7f29f000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 -- 172.21.15.121:0/911928693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a0015a3e0 msgr2=0x7f2a001f8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:48.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a0015a3e0 0x7f2a001f8950 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c370 tx=0x7f29e800c830 comp rx=0 tx=0).stop 2024-09-17T03:39:48.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 -- 172.21.15.121:0/911928693 shutdown_connections 2024-09-17T03:39:48.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a00099360 0x7f2a00073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f29dc078bc0 0x7f29dc07b0d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a0015a3e0 0x7f2a001f8950 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 --2- 172.21.15.121:0/911928693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a0006ddc0 0x7f2a001f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 -- 172.21.15.121:0/911928693 >> 172.21.15.121:0/911928693 conn(0x7f2a000b3580 msgr2=0x7f2a000ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:48.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.312+0000 7f2a05c00640 1 -- 172.21.15.121:0/911928693 shutdown_connections 2024-09-17T03:39:48.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.313+0000 7f2a05c00640 1 -- 172.21.15.121:0/911928693 wait complete. 2024-09-17T03:39:48.336 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:35:21.303701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:39:48.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:39:48.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.561+0000 7f92dfa00640 1 -- 172.21.15.121:0/861805019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92d815cbf0 msgr2=0x7f92d815d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:48.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.561+0000 7f92dfa00640 1 --2- 172.21.15.121:0/861805019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92d815cbf0 0x7f92d815d000 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009830 tx=0x7f92c402a510 comp rx=0 tx=0).stop 2024-09-17T03:39:48.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.562+0000 7f92dfa00640 1 -- 172.21.15.121:0/861805019 shutdown_connections 2024-09-17T03:39:48.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.562+0000 7f92dfa00640 1 --2- 172.21.15.121:0/861805019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92d815cbf0 0x7f92d815d000 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.562+0000 7f92dfa00640 1 -- 172.21.15.121:0/861805019 >> 172.21.15.121:0/861805019 conn(0x7f92d8073fe0 msgr2=0x7f92d80743f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:48.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.562+0000 7f92dfa00640 1 -- 172.21.15.121:0/861805019 shutdown_connections 2024-09-17T03:39:48.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.562+0000 7f92dfa00640 1 -- 172.21.15.121:0/861805019 wait complete. 2024-09-17T03:39:48.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.564+0000 7f92dfa00640 1 Processor -- start 2024-09-17T03:39:48.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.564+0000 7f92dfa00640 1 -- start start 2024-09-17T03:39:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.565+0000 7f92dfa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92d80703a0 0x7f92d80b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.565+0000 7f92dfa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d8145de0 0x7f92d81419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.565+0000 7f92dfa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92d815cbf0 0x7f92d81f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.565+0000 7f92dfa00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f92d815e1b0 con 0x7f92d815cbf0 2024-09-17T03:39:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.565+0000 7f92dfa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f92d815e030 con 0x7f92d8145de0 2024-09-17T03:39:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.565+0000 7f92dfa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92d815e330 con 0x7f92d80703a0 2024-09-17T03:39:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.566+0000 7f92dda00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92d815cbf0 0x7f92d81f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.566+0000 7f92dda00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92d815cbf0 0x7f92d81f8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55390/0 (socket says 172.21.15.121:55390) 2024-09-17T03:39:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.566+0000 7f92dda00640 1 -- 172.21.15.121:0/556964631 learned_addr learned my addr 172.21.15.121:0/556964631 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:48.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.566+0000 7f92dd000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92d80703a0 0x7f92d80b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.566+0000 7f92d7e00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d8145de0 0x7f92d81419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.566+0000 7f92dda00640 1 -- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92d80703a0 msgr2=0x7f92d80b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.566+0000 7f92dda00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92d80703a0 0x7f92d80b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.566+0000 7f92dda00640 1 -- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d8145de0 msgr2=0x7f92d81419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.566+0000 7f92dda00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d8145de0 0x7f92d81419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.566+0000 7f92dda00640 1 -- 172.21.15.121:0/556964631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d80b5f10 con 0x7f92d815cbf0 2024-09-17T03:39:48.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.567+0000 7f92dda00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92d815cbf0 0x7f92d81f8960 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c730 tx=0x7f92d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:48.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.567+0000 7f92d4c00640 1 -- 172.21.15.121:0/556964631 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0003b70 con 0x7f92d815cbf0 2024-09-17T03:39:48.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.567+0000 7f92d4c00640 1 -- 172.21.15.121:0/556964631 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92d0003d30 con 0x7f92d815cbf0 2024-09-17T03:39:48.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.567+0000 7f92dfa00640 1 -- 172.21.15.121:0/556964631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d80b61f0 con 0x7f92d815cbf0 2024-09-17T03:39:48.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.567+0000 7f92d4c00640 1 -- 172.21.15.121:0/556964631 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d00052d0 con 0x7f92d815cbf0 2024-09-17T03:39:48.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.567+0000 7f92dfa00640 1 -- 172.21.15.121:0/556964631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d80af660 con 0x7f92d815cbf0 2024-09-17T03:39:48.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.568+0000 7f92dfa00640 1 -- 172.21.15.121:0/556964631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d815d000 con 0x7f92d815cbf0 2024-09-17T03:39:48.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.569+0000 7f92d4c00640 1 -- 172.21.15.121:0/556964631 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92d0005680 con 0x7f92d815cbf0 2024-09-17T03:39:48.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.571+0000 7f92d4c00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f92b8078b90 0x7f92b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.571+0000 7f92d4c00640 1 -- 172.21.15.121:0/556964631 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5335+0+0 (secure 0 0 0) 0x7f92d009aa10 con 0x7f92d815cbf0 2024-09-17T03:39:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.571+0000 7f92dd000640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f92b8078b90 0x7f92b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:48.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.572+0000 7f92dd000640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f92b8078b90 0x7f92b807b0a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0017b0 tx=0x7f92cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.575+0000 7f92d4c00640 1 -- 172.21.15.121:0/556964631 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f92d0062960 con 0x7f92d815cbf0 2024-09-17T03:39:48.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.756+0000 7f92dfa00640 1 -- 172.21.15.121:0/556964631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f92d81453b0 con 0x7f92d815cbf0 2024-09-17T03:39:48.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.757+0000 7f92d4c00640 1 -- 172.21.15.121:0/556964631 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f92d0067390 con 0x7f92d815cbf0 2024-09-17T03:39:48.756 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-17T03:39:48.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 -- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f92b8078b90 msgr2=0x7f92b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:48.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f92b8078b90 0x7f92b807b0a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0017b0 tx=0x7f92cc009040 comp rx=0 tx=0).stop 2024-09-17T03:39:48.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 -- 172.21.15.121:0/556964631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92d815cbf0 msgr2=0x7f92d81f8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:48.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92d815cbf0 0x7f92d81f8960 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c730 tx=0x7f92d000cbf0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 -- 172.21.15.121:0/556964631 shutdown_connections 2024-09-17T03:39:48.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f92b8078b90 0x7f92b807b0a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92d815cbf0 0x7f92d81f8960 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d8145de0 0x7f92d81419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 --2- 172.21.15.121:0/556964631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92d80703a0 0x7f92d80b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:48.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 -- 172.21.15.121:0/556964631 >> 172.21.15.121:0/556964631 conn(0x7f92d8073fe0 msgr2=0x7f92d8144570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:48.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 -- 172.21.15.121:0/556964631 shutdown_connections 2024-09-17T03:39:48.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:48.759+0000 7f92dfa00640 1 -- 172.21.15.121:0/556964631 wait complete. 2024-09-17T03:39:48.784 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2024-09-17T03:39:49.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.006+0000 7fdf64c00640 1 -- 172.21.15.121:0/692427808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf6015a3e0 msgr2=0x7fdf6006d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:49.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.006+0000 7fdf64c00640 1 --2- 172.21.15.121:0/692427808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf6015a3e0 0x7fdf6006d800 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdf50005fd0 tx=0x7fdf5002a400 comp rx=0 tx=0).stop 2024-09-17T03:39:49.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.006+0000 7fdf64c00640 1 -- 172.21.15.121:0/692427808 shutdown_connections 2024-09-17T03:39:49.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.006+0000 7fdf64c00640 1 --2- 172.21.15.121:0/692427808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf6006ddc0 0x7fdf600d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:49.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.006+0000 7fdf64c00640 1 --2- 172.21.15.121:0/692427808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf6015a3e0 0x7fdf6006d800 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:49.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.006+0000 7fdf64c00640 1 -- 172.21.15.121:0/692427808 >> 172.21.15.121:0/692427808 conn(0x7fdf600b3580 msgr2=0x7fdf600b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:49.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.006+0000 7fdf64c00640 1 -- 172.21.15.121:0/692427808 shutdown_connections 2024-09-17T03:39:49.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.006+0000 7fdf64c00640 1 -- 172.21.15.121:0/692427808 wait complete. 2024-09-17T03:39:49.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.009+0000 7fdf64c00640 1 Processor -- start 2024-09-17T03:39:49.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.009+0000 7fdf64c00640 1 -- start start 2024-09-17T03:39:49.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.010+0000 7fdf64c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf6006ddc0 0x7fdf600997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:49.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.010+0000 7fdf64c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf600d0af0 0x7fdf600cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:49.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.010+0000 7fdf64c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf6015a3e0 0x7fdf600ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:49.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.010+0000 7fdf64c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6006f560 con 0x7fdf6015a3e0 2024-09-17T03:39:49.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.010+0000 7fdf64c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60161190 con 0x7fdf6006ddc0 2024-09-17T03:39:49.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.010+0000 7fdf64c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdf6006f6e0 con 0x7fdf600d0af0 2024-09-17T03:39:49.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.010+0000 7fdf5e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf6015a3e0 0x7fdf600ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:49.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.011+0000 7fdf5de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf6006ddc0 0x7fdf600997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:49.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.011+0000 7fdf5e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf6015a3e0 0x7fdf600ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55408/0 (socket says 172.21.15.121:55408) 2024-09-17T03:39:49.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.011+0000 7fdf5d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf600d0af0 0x7fdf600cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:49.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.011+0000 7fdf5e800640 1 -- 172.21.15.121:0/3541162024 learned_addr learned my addr 172.21.15.121:0/3541162024 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:49.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.011+0000 7fdf5e800640 1 -- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf600d0af0 msgr2=0x7fdf600cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:49.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.011+0000 7fdf5e800640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf600d0af0 0x7fdf600cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:49.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.011+0000 7fdf5e800640 1 -- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf6006ddc0 msgr2=0x7fdf600997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:49.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.011+0000 7fdf5e800640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf6006ddc0 0x7fdf600997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:49.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.011+0000 7fdf5e800640 1 -- 172.21.15.121:0/3541162024 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf601553e0 con 0x7fdf6015a3e0 2024-09-17T03:39:49.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.011+0000 7fdf5e800640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf6015a3e0 0x7fdf600ce2a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800b9a0 tx=0x7fdf5800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:49.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.012+0000 7fdf56000640 1 -- 172.21.15.121:0/3541162024 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58019070 con 0x7fdf6015a3e0 2024-09-17T03:39:49.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.012+0000 7fdf56000640 1 -- 172.21.15.121:0/3541162024 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf5800cc90 con 0x7fdf6015a3e0 2024-09-17T03:39:49.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.012+0000 7fdf64c00640 1 -- 172.21.15.121:0/3541162024 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf60155140 con 0x7fdf6015a3e0 2024-09-17T03:39:49.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.012+0000 7fdf56000640 1 -- 172.21.15.121:0/3541162024 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf580146a0 con 0x7fdf6015a3e0 2024-09-17T03:39:49.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.012+0000 7fdf64c00640 1 -- 172.21.15.121:0/3541162024 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf601f9260 con 0x7fdf6015a3e0 2024-09-17T03:39:49.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.013+0000 7fdf64c00640 1 -- 172.21.15.121:0/3541162024 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf6015eb00 con 0x7fdf6015a3e0 2024-09-17T03:39:49.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.014+0000 7fdf56000640 1 -- 172.21.15.121:0/3541162024 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf5801c070 con 0x7fdf6015a3e0 2024-09-17T03:39:49.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.015+0000 7fdf56000640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf40078bc0 0x7fdf4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:49.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.015+0000 7fdf56000640 1 -- 172.21.15.121:0/3541162024 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5335+0+0 (secure 0 0 0) 0x7fdf5809a780 con 0x7fdf6015a3e0 2024-09-17T03:39:49.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.016+0000 7fdf5de00640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf40078bc0 0x7fdf4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:49.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.016+0000 7fdf5de00640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf40078bc0 0x7fdf4007b0d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdf50033000 tx=0x7fdf50004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:49.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.019+0000 7fdf56000640 1 -- 172.21.15.121:0/3541162024 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf580626d0 con 0x7fdf6015a3e0 2024-09-17T03:39:49.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.268+0000 7fdf64c00640 1 -- 172.21.15.121:0/3541162024 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) -- 0x7fdf6006f210 con 0x7fdf6015a3e0 2024-09-17T03:39:49.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.864+0000 7fdf56000640 1 -- 172.21.15.121:0/3541162024 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v251) ==== 148+0+0 (secure 0 0 0) 0x7fdf58067100 con 0x7fdf6015a3e0 2024-09-17T03:39:49.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.866+0000 7fdf64c00640 1 -- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf40078bc0 msgr2=0x7fdf4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:49.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.866+0000 7fdf64c00640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf40078bc0 0x7fdf4007b0d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdf50033000 tx=0x7fdf50004730 comp rx=0 tx=0).stop 2024-09-17T03:39:49.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.866+0000 7fdf64c00640 1 -- 172.21.15.121:0/3541162024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf6015a3e0 msgr2=0x7fdf600ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:49.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.866+0000 7fdf64c00640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf6015a3e0 0x7fdf600ce2a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800b9a0 tx=0x7fdf5800be60 comp rx=0 tx=0).stop 2024-09-17T03:39:49.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.866+0000 7fdf64c00640 1 -- 172.21.15.121:0/3541162024 shutdown_connections 2024-09-17T03:39:49.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.866+0000 7fdf64c00640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdf40078bc0 0x7fdf4007b0d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:49.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.866+0000 7fdf64c00640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf6015a3e0 0x7fdf600ce2a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:49.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.866+0000 7fdf64c00640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf600d0af0 0x7fdf600cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:49.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.866+0000 7fdf64c00640 1 --2- 172.21.15.121:0/3541162024 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf6006ddc0 0x7fdf600997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:49.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.866+0000 7fdf64c00640 1 -- 172.21.15.121:0/3541162024 >> 172.21.15.121:0/3541162024 conn(0x7fdf600b3580 msgr2=0x7fdf600cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:49.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.867+0000 7fdf64c00640 1 -- 172.21.15.121:0/3541162024 shutdown_connections 2024-09-17T03:39:49.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:49.867+0000 7fdf64c00640 1 -- 172.21.15.121:0/3541162024 wait complete. 2024-09-17T03:39:49.888 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:39:50.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.109+0000 7f6acfe00640 1 -- 172.21.15.121:0/2593372518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ac806da30 msgr2=0x7f6ac80d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:50.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.109+0000 7f6acfe00640 1 --2- 172.21.15.121:0/2593372518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ac806da30 0x7f6ac80d0b70 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80cdc20 tx=0x7f6ac002a980 comp rx=0 tx=0).stop 2024-09-17T03:39:50.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.109+0000 7f6acfe00640 1 -- 172.21.15.121:0/2593372518 shutdown_connections 2024-09-17T03:39:50.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.109+0000 7f6acfe00640 1 --2- 172.21.15.121:0/2593372518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ac806da30 0x7f6ac80d0b70 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.109+0000 7f6acfe00640 1 --2- 172.21.15.121:0/2593372518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ac806d620 0x7f6ac80d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.109+0000 7f6acfe00640 1 --2- 172.21.15.121:0/2593372518 >> v2:172.21.15.176:3300/0 conn(0x7f6ac80cca80 0x7f6ac80707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.109+0000 7f6acfe00640 1 -- 172.21.15.121:0/2593372518 >> 172.21.15.121:0/2593372518 conn(0x7f6ac80b3580 msgr2=0x7f6ac80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:50.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.109+0000 7f6acfe00640 1 -- 172.21.15.121:0/2593372518 shutdown_connections 2024-09-17T03:39:50.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.109+0000 7f6acfe00640 1 -- 172.21.15.121:0/2593372518 wait complete. 2024-09-17T03:39:50.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.112+0000 7f6acfe00640 1 Processor -- start 2024-09-17T03:39:50.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.112+0000 7f6acfe00640 1 -- start start 2024-09-17T03:39:50.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac806d620 0x7f6ac81f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ac806da30 0x7f6ac81f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ac80cca80 0x7f6ac80c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acfe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80cb7f0 con 0x7f6ac80cca80 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acfe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80cc860 con 0x7f6ac806d620 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acfe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac80cb970 con 0x7f6ac806da30 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acde00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ac80cca80 0x7f6ac80c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acd400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac806d620 0x7f6ac81f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ac806da30 0x7f6ac81f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acde00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ac80cca80 0x7f6ac80c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55424/0 (socket says 172.21.15.121:55424) 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.113+0000 7f6acde00640 1 -- 172.21.15.121:0/980670091 learned_addr learned my addr 172.21.15.121:0/980670091 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.114+0000 7f6acde00640 1 -- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ac806da30 msgr2=0x7f6ac81f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:50.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.114+0000 7f6acde00640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ac806da30 0x7f6ac81f29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.114+0000 7f6acde00640 1 -- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac806d620 msgr2=0x7f6ac81f24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:50.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.114+0000 7f6acde00640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac806d620 0x7f6ac81f24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.114+0000 7f6acde00640 1 -- 172.21.15.121:0/980670091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac80b25d0 con 0x7f6ac80cca80 2024-09-17T03:39:50.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.114+0000 7f6acd400640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac806d620 0x7f6ac81f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:39:50.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.114+0000 7f6acde00640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ac80cca80 0x7f6ac80c8f40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009d60 tx=0x7f6ac0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:50.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.115+0000 7f6ac5600640 1 -- 172.21.15.121:0/980670091 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0034040 con 0x7f6ac80cca80 2024-09-17T03:39:50.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.115+0000 7f6ac5600640 1 -- 172.21.15.121:0/980670091 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ac0004540 con 0x7f6ac80cca80 2024-09-17T03:39:50.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.115+0000 7f6ac5600640 1 -- 172.21.15.121:0/980670091 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0045480 con 0x7f6ac80cca80 2024-09-17T03:39:50.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.115+0000 7f6acfe00640 1 -- 172.21.15.121:0/980670091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac80b1810 con 0x7f6ac80cca80 2024-09-17T03:39:50.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.115+0000 7f6acfe00640 1 -- 172.21.15.121:0/980670091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac80b1dd0 con 0x7f6ac80cca80 2024-09-17T03:39:50.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.116+0000 7f6acfe00640 1 -- 172.21.15.121:0/980670091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac80707c0 con 0x7f6ac80cca80 2024-09-17T03:39:50.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.117+0000 7f6ac5600640 1 -- 172.21.15.121:0/980670091 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ac0037020 con 0x7f6ac80cca80 2024-09-17T03:39:50.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.118+0000 7f6ac5600640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6aa8078b90 0x7f6aa807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:50.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.118+0000 7f6ac5600640 1 -- 172.21.15.121:0/980670091 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5335+0+0 (secure 0 0 0) 0x7f6ac00bc430 con 0x7f6ac80cca80 2024-09-17T03:39:50.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.118+0000 7f6acd400640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6aa8078b90 0x7f6aa807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:50.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.119+0000 7f6acd400640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6aa8078b90 0x7f6aa807b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6abc005fd0 tx=0x7f6abc00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:50.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.122+0000 7f6ac5600640 1 -- 172.21.15.121:0/980670091 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ac0084390 con 0x7f6ac80cca80 2024-09-17T03:39:50.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.307+0000 7f6acfe00640 1 -- 172.21.15.121:0/980670091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6ac806e190 con 0x7f6ac80cca80 2024-09-17T03:39:50.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.307+0000 7f6ac5600640 1 -- 172.21.15.121:0/980670091 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v44) ==== 59+0+2294 (secure 0 0 0) 0x7f6ac0088dc0 con 0x7f6ac80cca80 2024-09-17T03:39:50.307 INFO:teuthology.orchestra.run.smithi121.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:39:50.307 INFO:teuthology.orchestra.run.smithi121.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:39:50.307 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_client 20/20 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3249.879374 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3414.976419 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3347.142673 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3524.210167 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 7230.495988 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4229.547603 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4520.738354 2024-09-17T03:39:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4185.245448 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds 20/20 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_ms 2/2 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_frag true 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_verify_scatter true 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced client_mount_timeout 600 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_client 20/20 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_ms 1/1 2024-09-17T03:39:50.309 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:39:50.310 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:39:50.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 -- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6aa8078b90 msgr2=0x7f6aa807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6aa8078b90 0x7f6aa807b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6abc005fd0 tx=0x7f6abc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 -- 172.21.15.121:0/980670091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ac80cca80 msgr2=0x7f6ac80c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ac80cca80 0x7f6ac80c8f40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009d60 tx=0x7f6ac0003f90 comp rx=0 tx=0).stop 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 -- 172.21.15.121:0/980670091 shutdown_connections 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6aa8078b90 0x7f6aa807b0a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ac80cca80 0x7f6ac80c8f40 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ac806da30 0x7f6ac81f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 --2- 172.21.15.121:0/980670091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ac806d620 0x7f6ac81f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 -- 172.21.15.121:0/980670091 >> 172.21.15.121:0/980670091 conn(0x7f6ac80b3580 msgr2=0x7f6ac815e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 -- 172.21.15.121:0/980670091 shutdown_connections 2024-09-17T03:39:50.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.310+0000 7f6acfe00640 1 -- 172.21.15.121:0/980670091 wait complete. 2024-09-17T03:39:50.334 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:39:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.559+0000 7f844e400640 1 -- 172.21.15.121:0/3818357692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844806ddc0 msgr2=0x7f84480d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.559+0000 7f844e400640 1 --2- 172.21.15.121:0/3818357692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844806ddc0 0x7f84480d05b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f84480cdc20 tx=0x7f843402a410 comp rx=0 tx=0).stop 2024-09-17T03:39:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.559+0000 7f844e400640 1 -- 172.21.15.121:0/3818357692 shutdown_connections 2024-09-17T03:39:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.559+0000 7f844e400640 1 --2- 172.21.15.121:0/3818357692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844806ddc0 0x7f84480d05b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.559+0000 7f844e400640 1 --2- 172.21.15.121:0/3818357692 >> v2:172.21.15.176:3300/0 conn(0x7f844815a3e0 0x7f844806d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.559+0000 7f844e400640 1 -- 172.21.15.121:0/3818357692 >> 172.21.15.121:0/3818357692 conn(0x7f84480b3580 msgr2=0x7f84480b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.559+0000 7f844e400640 1 -- 172.21.15.121:0/3818357692 shutdown_connections 2024-09-17T03:39:50.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.559+0000 7f844e400640 1 -- 172.21.15.121:0/3818357692 wait complete. 2024-09-17T03:39:50.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.561+0000 7f844e400640 1 Processor -- start 2024-09-17T03:39:50.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.561+0000 7f844e400640 1 -- start start 2024-09-17T03:39:50.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.562+0000 7f844e400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844806ddc0 0x7f8448158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:50.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f844e400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84480d0af0 0x7f84481f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f844e400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f844815a3e0 0x7f8448073d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f844e400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f844806f560 con 0x7f844806ddc0 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f844e400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8448161190 con 0x7f844815a3e0 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f844e400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f844806f6e0 con 0x7f84480d0af0 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8447400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844806ddc0 0x7f8448158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8447400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844806ddc0 0x7f8448158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55448/0 (socket says 172.21.15.121:55448) 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8447400640 1 -- 172.21.15.121:0/1039600653 learned_addr learned my addr 172.21.15.121:0/1039600653 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8446a00640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84480d0af0 0x7f84481f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8447e00640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f844815a3e0 0x7f8448073d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8447400640 1 -- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84480d0af0 msgr2=0x7f84481f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8447400640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84480d0af0 0x7f84481f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8447400640 1 -- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f844815a3e0 msgr2=0x7f8448073d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8447400640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f844815a3e0 0x7f8448073d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8447400640 1 -- 172.21.15.121:0/1039600653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8448158de0 con 0x7f844806ddc0 2024-09-17T03:39:50.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.563+0000 7f8447400640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844806ddc0 0x7f8448158470 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f843800e7c0 tx=0x7f843800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:50.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.564+0000 7f843f400640 1 -- 172.21.15.121:0/1039600653 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843800ccc0 con 0x7f844806ddc0 2024-09-17T03:39:50.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.564+0000 7f843f400640 1 -- 172.21.15.121:0/1039600653 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8438010430 con 0x7f844806ddc0 2024-09-17T03:39:50.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.564+0000 7f844e400640 1 -- 172.21.15.121:0/1039600653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84481590c0 con 0x7f844806ddc0 2024-09-17T03:39:50.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.564+0000 7f843f400640 1 -- 172.21.15.121:0/1039600653 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438010860 con 0x7f844806ddc0 2024-09-17T03:39:50.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.564+0000 7f844e400640 1 -- 172.21.15.121:0/1039600653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8448159680 con 0x7f844806ddc0 2024-09-17T03:39:50.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.565+0000 7f844e400640 1 -- 172.21.15.121:0/1039600653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844806fbb0 con 0x7f844806ddc0 2024-09-17T03:39:50.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.566+0000 7f843f400640 1 -- 172.21.15.121:0/1039600653 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8438010a00 con 0x7f844806ddc0 2024-09-17T03:39:50.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.568+0000 7f843f400640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8428078b90 0x7f842807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:50.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.568+0000 7f843f400640 1 -- 172.21.15.121:0/1039600653 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5335+0+0 (secure 0 0 0) 0x7f843809b5f0 con 0x7f844806ddc0 2024-09-17T03:39:50.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.568+0000 7f8446a00640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8428078b90 0x7f842807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:50.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.569+0000 7f8446a00640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8428078b90 0x7f842807b0a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8434034000 tx=0x7f8434004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:50.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.572+0000 7f843f400640 1 -- 172.21.15.121:0/1039600653 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8438063b90 con 0x7f844806ddc0 2024-09-17T03:39:50.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.754+0000 7f844e400640 1 -- 172.21.15.121:0/1039600653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8448156580 con 0x7f844806ddc0 2024-09-17T03:39:50.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.759+0000 7f843f400640 1 -- 172.21.15.121:0/1039600653 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v45)=0 v45) ==== 122+0+0 (secure 0 0 0) 0x7f8438063490 con 0x7f844806ddc0 2024-09-17T03:39:50.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 -- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8428078b90 msgr2=0x7f842807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:50.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8428078b90 0x7f842807b0a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8434034000 tx=0x7f8434004730 comp rx=0 tx=0).stop 2024-09-17T03:39:50.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 -- 172.21.15.121:0/1039600653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844806ddc0 msgr2=0x7f8448158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:50.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844806ddc0 0x7f8448158470 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f843800e7c0 tx=0x7f843800ec80 comp rx=0 tx=0).stop 2024-09-17T03:39:50.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 -- 172.21.15.121:0/1039600653 shutdown_connections 2024-09-17T03:39:50.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f844815a3e0 0x7f8448073d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84480d0af0 0x7f84481f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8428078b90 0x7f842807b0a0 secure :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8434034000 tx=0x7f8434004730 comp rx=0 tx=0).stop 2024-09-17T03:39:50.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 --2- 172.21.15.121:0/1039600653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844806ddc0 0x7f8448158470 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:50.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 -- 172.21.15.121:0/1039600653 >> 172.21.15.121:0/1039600653 conn(0x7f84480b3580 msgr2=0x7f8448156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:50.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 -- 172.21.15.121:0/1039600653 shutdown_connections 2024-09-17T03:39:50.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:50.761+0000 7f844e400640 1 -- 172.21.15.121:0/1039600653 wait complete. 2024-09-17T03:39:50.782 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:39:50.783 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:39:50.875 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:39:50.965 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:39:50.965 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:50.965 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:51.001 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:39:51.001 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:51.001 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:51.038 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:39:51.038 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:39:51.038 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:51.076 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:39:51.076 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:39:51.076 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:39:51.114 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:39:51.114 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:39:51.115 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:39:51.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.337+0000 7f65b4a00640 1 -- 172.21.15.121:0/4260132798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b0070810 msgr2=0x7f65b00b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:51.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.337+0000 7f65b4a00640 1 --2- 172.21.15.121:0/4260132798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b0070810 0x7f65b00b4c80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f65b00cffe0 tx=0x7f65a002a560 comp rx=0 tx=0).stop 2024-09-17T03:39:51.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.337+0000 7f65b4a00640 1 -- 172.21.15.121:0/4260132798 shutdown_connections 2024-09-17T03:39:51.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.337+0000 7f65b4a00640 1 --2- 172.21.15.121:0/4260132798 >> v2:172.21.15.176:3300/0 conn(0x7f65b00b51c0 0x7f65b0160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.337+0000 7f65b4a00640 1 --2- 172.21.15.121:0/4260132798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b0070810 0x7f65b00b4c80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.337+0000 7f65b4a00640 1 -- 172.21.15.121:0/4260132798 >> 172.21.15.121:0/4260132798 conn(0x7f65b00b2440 msgr2=0x7f65b00d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:51.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.337+0000 7f65b4a00640 1 -- 172.21.15.121:0/4260132798 shutdown_connections 2024-09-17T03:39:51.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.337+0000 7f65b4a00640 1 -- 172.21.15.121:0/4260132798 wait complete. 2024-09-17T03:39:51.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.339+0000 7f65b4a00640 1 Processor -- start 2024-09-17T03:39:51.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.339+0000 7f65b4a00640 1 -- start start 2024-09-17T03:39:51.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65b4a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0070810 0x7f65b0144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:51.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65b4a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65b00b51c0 0x7f65b009d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65b4a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b01606c0 0x7f65b00ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65b4a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f65b00b30b0 con 0x7f65b01606c0 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65b4a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f65b006f000 con 0x7f65b00b51c0 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65b4a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f65b015d2a0 con 0x7f65b0070810 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65af200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b01606c0 0x7f65b00ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65af200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b01606c0 0x7f65b00ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55462/0 (socket says 172.21.15.121:55462) 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65af200640 1 -- 172.21.15.121:0/2870612808 learned_addr learned my addr 172.21.15.121:0/2870612808 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65ae800640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0070810 0x7f65b0144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.341+0000 7f65a5e00640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65b00b51c0 0x7f65b009d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65af200640 1 -- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0070810 msgr2=0x7f65b0144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65af200640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0070810 0x7f65b0144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65af200640 1 -- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65b00b51c0 msgr2=0x7f65b009d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:51.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65af200640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65b00b51c0 0x7f65b009d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65af200640 1 -- 172.21.15.121:0/2870612808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b00cceb0 con 0x7f65b01606c0 2024-09-17T03:39:51.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65af200640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b01606c0 0x7f65b00ce9e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f65a800b410 tx=0x7f65a800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:51.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65a7400640 1 -- 172.21.15.121:0/2870612808 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8015030 con 0x7f65b01606c0 2024-09-17T03:39:51.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65a7400640 1 -- 172.21.15.121:0/2870612808 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65a8004020 con 0x7f65b01606c0 2024-09-17T03:39:51.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65a7400640 1 -- 172.21.15.121:0/2870612808 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8004470 con 0x7f65b01606c0 2024-09-17T03:39:51.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65b4a00640 1 -- 172.21.15.121:0/2870612808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b00cd190 con 0x7f65b01606c0 2024-09-17T03:39:51.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.342+0000 7f65b4a00640 1 -- 172.21.15.121:0/2870612808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b00cd750 con 0x7f65b01606c0 2024-09-17T03:39:51.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.344+0000 7f65b4a00640 1 -- 172.21.15.121:0/2870612808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b00d0e40 con 0x7f65b01606c0 2024-09-17T03:39:51.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.345+0000 7f65a7400640 1 -- 172.21.15.121:0/2870612808 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f65a8018070 con 0x7f65b01606c0 2024-09-17T03:39:51.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.346+0000 7f65a7400640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f658c078b90 0x7f658c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:51.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.346+0000 7f65a7400640 1 -- 172.21.15.121:0/2870612808 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5335+0+0 (secure 0 0 0) 0x7f65a809a770 con 0x7f65b01606c0 2024-09-17T03:39:51.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.346+0000 7f65ae800640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f658c078b90 0x7f658c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:51.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.347+0000 7f65ae800640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f658c078b90 0x7f658c07b0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f65a0033000 tx=0x7f65a0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:51.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.350+0000 7f65a7400640 1 -- 172.21.15.121:0/2870612808 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f65b00d0e40 con 0x7f65b01606c0 2024-09-17T03:39:51.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.568+0000 7f65b4a00640 1 -- 172.21.15.121:0/2870612808 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65b00ccc40 con 0x7f65b01606c0 2024-09-17T03:39:51.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.569+0000 7f65a7400640 1 -- 172.21.15.121:0/2870612808 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+3917 (secure 0 0 0) 0x7f65a8062c80 con 0x7f65b01606c0 2024-09-17T03:39:51.569 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:51.569 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":61,"btime":"2024-09-17T03:39:44:837324+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5711,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2693481679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2693481679},{"type":"v1","addr":"172.21.15.176:6837","nonce":2693481679}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6154,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2108616236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2108616236},{"type":"v1","addr":"172.21.15.121:6833","nonce":2108616236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":53},{"gid":6163,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/814740200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":814740200},{"type":"v1","addr":"172.21.15.176:6835","nonce":814740200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6672,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/737199486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":737199486},{"type":"v1","addr":"172.21.15.121:6835","nonce":737199486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[]} 2024-09-17T03:39:51.569 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 61 2024-09-17T03:39:51.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.571+0000 7f65b4a00640 1 -- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f658c078b90 msgr2=0x7f658c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:51.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.571+0000 7f65b4a00640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f658c078b90 0x7f658c07b0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f65a0033000 tx=0x7f65a0004730 comp rx=0 tx=0).stop 2024-09-17T03:39:51.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.571+0000 7f65b4a00640 1 -- 172.21.15.121:0/2870612808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b01606c0 msgr2=0x7f65b00ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:51.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.571+0000 7f65b4a00640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b01606c0 0x7f65b00ce9e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f65a800b410 tx=0x7f65a800b8d0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.572+0000 7f65b4a00640 1 -- 172.21.15.121:0/2870612808 shutdown_connections 2024-09-17T03:39:51.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.572+0000 7f65b4a00640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f658c078b90 0x7f658c07b0a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.572+0000 7f65b4a00640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b01606c0 0x7f65b00ce9e0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.572+0000 7f65b4a00640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65b00b51c0 0x7f65b009d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.572+0000 7f65b4a00640 1 --2- 172.21.15.121:0/2870612808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f65b0070810 0x7f65b0144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.572+0000 7f65b4a00640 1 -- 172.21.15.121:0/2870612808 >> 172.21.15.121:0/2870612808 conn(0x7f65b00b2440 msgr2=0x7f65b00d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:51.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.572+0000 7f65b4a00640 1 -- 172.21.15.121:0/2870612808 shutdown_connections 2024-09-17T03:39:51.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.572+0000 7f65b4a00640 1 -- 172.21.15.121:0/2870612808 wait complete. 2024-09-17T03:39:51.596 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:39:51.596 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:39:51.596 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:39:51.596 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:39:51.596 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:39:51.597 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:39:51.597 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:39:51.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:39:51.597 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:39:51.597 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:39:51.597 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:39:51.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:39:51.598 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:39:51.598 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:39:51.598 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:39:51.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:39:51.618 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:39:51.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:39:51.622 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:39:51.623 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:39:51.629 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:39:51.631 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:39:51.632 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:39:51.632 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:39:51.633 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:39:51.666 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:39:51.667 DEBUG:teuthology.parallel:result is None 2024-09-17T03:39:51.669 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:39:51.669 DEBUG:teuthology.parallel:result is None 2024-09-17T03:39:51.671 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:39:51.676 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:39:51.676 DEBUG:teuthology.parallel:result is None 2024-09-17T03:39:51.681 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:39:51.681 DEBUG:teuthology.parallel:result is None 2024-09-17T03:39:51.681 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:39:51.861 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:39:51.865 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:39:51.879 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T03:39:51.882 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:39:51.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.947+0000 7efc61800640 1 -- 172.21.15.121:0/433592734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5c0d0cc0 msgr2=0x7efc5c1673d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.947+0000 7efc61800640 1 --2- 172.21.15.121:0/433592734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5c0d0cc0 0x7efc5c1673d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efc54009860 tx=0x7efc5402a480 comp rx=0 tx=0).stop 2024-09-17T03:39:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.947+0000 7efc61800640 1 -- 172.21.15.121:0/433592734 shutdown_connections 2024-09-17T03:39:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.947+0000 7efc61800640 1 --2- 172.21.15.121:0/433592734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5c0d0cc0 0x7efc5c1673d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.947+0000 7efc61800640 1 -- 172.21.15.121:0/433592734 >> 172.21.15.121:0/433592734 conn(0x7efc5c0b3580 msgr2=0x7efc5c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.948+0000 7efc61800640 1 -- 172.21.15.121:0/433592734 shutdown_connections 2024-09-17T03:39:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.948+0000 7efc61800640 1 -- 172.21.15.121:0/433592734 wait complete. 2024-09-17T03:39:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.950+0000 7efc61800640 1 Processor -- start 2024-09-17T03:39:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.950+0000 7efc61800640 1 -- start start 2024-09-17T03:39:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.951+0000 7efc61800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc5c06d800 0x7efc5c0994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.951+0000 7efc61800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5c15a3e0 0x7efc5c1f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.951+0000 7efc61800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5c099ae0 0x7efc5c1f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.951+0000 7efc61800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c167ca0 con 0x7efc5c06d800 2024-09-17T03:39:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.951+0000 7efc61800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c167b20 con 0x7efc5c099ae0 2024-09-17T03:39:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.951+0000 7efc61800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efc5c167e20 con 0x7efc5c15a3e0 2024-09-17T03:39:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc5aa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc5c06d800 0x7efc5c0994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:51.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc5aa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc5c06d800 0x7efc5c0994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46358/0 (socket says 172.21.15.121:46358) 2024-09-17T03:39:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc5aa00640 1 -- 172.21.15.121:0/4218269261 learned_addr learned my addr 172.21.15.121:0/4218269261 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc52000640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5c15a3e0 0x7efc5c1f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc5b400640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5c099ae0 0x7efc5c1f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc5aa00640 1 -- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5c15a3e0 msgr2=0x7efc5c1f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc5aa00640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5c15a3e0 0x7efc5c1f8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc5aa00640 1 -- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5c099ae0 msgr2=0x7efc5c1f9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc5aa00640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5c099ae0 0x7efc5c1f9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc5aa00640 1 -- 172.21.15.121:0/4218269261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5c154780 con 0x7efc5c06d800 2024-09-17T03:39:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.952+0000 7efc5aa00640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc5c06d800 0x7efc5c0994c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00c770 tx=0x7efc4c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.953+0000 7efc53400640 1 -- 172.21.15.121:0/4218269261 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c003b70 con 0x7efc5c06d800 2024-09-17T03:39:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.953+0000 7efc53400640 1 -- 172.21.15.121:0/4218269261 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc4c003d10 con 0x7efc5c06d800 2024-09-17T03:39:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.953+0000 7efc61800640 1 -- 172.21.15.121:0/4218269261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5c1f9a80 con 0x7efc5c06d800 2024-09-17T03:39:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.953+0000 7efc53400640 1 -- 172.21.15.121:0/4218269261 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00aab0 con 0x7efc5c06d800 2024-09-17T03:39:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.953+0000 7efc61800640 1 -- 172.21.15.121:0/4218269261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5c075000 con 0x7efc5c06d800 2024-09-17T03:39:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.954+0000 7efc61800640 1 -- 172.21.15.121:0/4218269261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5c15bff0 con 0x7efc5c06d800 2024-09-17T03:39:51.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.955+0000 7efc53400640 1 -- 172.21.15.121:0/4218269261 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efc4c00ac50 con 0x7efc5c06d800 2024-09-17T03:39:51.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.956+0000 7efc53400640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc38078b90 0x7efc3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:51.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.957+0000 7efc53400640 1 -- 172.21.15.121:0/4218269261 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7efc4c09aa30 con 0x7efc5c06d800 2024-09-17T03:39:51.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.957+0000 7efc52000640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc38078b90 0x7efc3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:51.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.958+0000 7efc52000640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc38078b90 0x7efc3807b0a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efc44000c00 tx=0x7efc44007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:51.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:51.961+0000 7efc53400640 1 -- 172.21.15.121:0/4218269261 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efc4c062870 con 0x7efc5c06d800 2024-09-17T03:39:52.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.155+0000 7efc61800640 1 -- 172.21.15.121:0/4218269261 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efc5c06ddc0 con 0x7efc5c06d800 2024-09-17T03:39:52.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.884+0000 7efc53400640 1 -- 172.21.15.121:0/4218269261 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) ==== 97+0+0 (secure 0 0 0) 0x7efc4c0672a0 con 0x7efc5c06d800 2024-09-17T03:39:52.884 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-17T03:39:52.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.887+0000 7efc61800640 1 -- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc38078b90 msgr2=0x7efc3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:52.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.887+0000 7efc61800640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc38078b90 0x7efc3807b0a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efc44000c00 tx=0x7efc44007ef0 comp rx=0 tx=0).stop 2024-09-17T03:39:52.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.887+0000 7efc61800640 1 -- 172.21.15.121:0/4218269261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc5c06d800 msgr2=0x7efc5c0994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:52.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.887+0000 7efc61800640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc5c06d800 0x7efc5c0994c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00c770 tx=0x7efc4c00cc30 comp rx=0 tx=0).stop 2024-09-17T03:39:52.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.887+0000 7efc61800640 1 -- 172.21.15.121:0/4218269261 shutdown_connections 2024-09-17T03:39:52.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.887+0000 7efc61800640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5c099ae0 0x7efc5c1f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:52.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.887+0000 7efc61800640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5c15a3e0 0x7efc5c1f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:52.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.887+0000 7efc61800640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc38078b90 0x7efc3807b0a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:52.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.887+0000 7efc61800640 1 --2- 172.21.15.121:0/4218269261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc5c06d800 0x7efc5c0994c0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:52.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.887+0000 7efc61800640 1 -- 172.21.15.121:0/4218269261 >> 172.21.15.121:0/4218269261 conn(0x7efc5c0b3580 msgr2=0x7efc5c15cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:52.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.888+0000 7efc61800640 1 -- 172.21.15.121:0/4218269261 shutdown_connections 2024-09-17T03:39:52.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:52.888+0000 7efc61800640 1 -- 172.21.15.121:0/4218269261 wait complete. 2024-09-17T03:39:52.913 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:39:53.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.134+0000 7f615ca00640 1 -- 172.21.15.121:0/766837716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f613c003a00 msgr2=0x7f613c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:53.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.134+0000 7f615ca00640 1 --2- 172.21.15.121:0/766837716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f613c003a00 0x7f613c003e70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6148009b50 tx=0x7f613c005830 comp rx=0 tx=0).stop 2024-09-17T03:39:53.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.134+0000 7f6157200640 1 -- 172.21.15.121:0/766837716 reap_dead start 2024-09-17T03:39:53.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.135+0000 7f615ca00640 1 -- 172.21.15.121:0/766837716 shutdown_connections 2024-09-17T03:39:53.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.135+0000 7f615ca00640 1 -- 172.21.15.121:0/766837716 >> 172.21.15.121:0/766837716 conn(0x7f61580b2440 msgr2=0x7f61580d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:53.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.135+0000 7f615ca00640 1 -- 172.21.15.121:0/766837716 shutdown_connections 2024-09-17T03:39:53.135 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.135+0000 7f615ca00640 1 -- 172.21.15.121:0/766837716 wait complete. 2024-09-17T03:39:53.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.137+0000 7f615ca00640 1 Processor -- start 2024-09-17T03:39:53.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.137+0000 7f615ca00640 1 -- start start 2024-09-17T03:39:53.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.138+0000 7f615ca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613c003a00 0x7f61581563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:53.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.138+0000 7f615ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6158144a00 0x7f6158073e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:53.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f615ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6158144f50 0x7f6158074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:53.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f615ca00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6158160890 con 0x7f613c003a00 2024-09-17T03:39:53.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f615ca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f615806f000 con 0x7f6158144f50 2024-09-17T03:39:53.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f615ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6158160a10 con 0x7f6158144a00 2024-09-17T03:39:53.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f6156800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613c003a00 0x7f61581563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:53.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f6156800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613c003a00 0x7f61581563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46380/0 (socket says 172.21.15.121:46380) 2024-09-17T03:39:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f6156800640 1 -- 172.21.15.121:0/4205358697 learned_addr learned my addr 172.21.15.121:0/4205358697 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f6156800640 1 -- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6158144a00 msgr2=0x7f6158073e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f6156800640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6158144a00 0x7f6158073e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f6156800640 1 -- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6158144f50 msgr2=0x7f6158074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f6156800640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6158144f50 0x7f6158074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f6156800640 1 -- 172.21.15.121:0/4205358697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61581568f0 con 0x7f613c003a00 2024-09-17T03:39:53.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.139+0000 7f6156800640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613c003a00 0x7f61581563b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6148009a70 tx=0x7f6148033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.140+0000 7f614ea00640 1 -- 172.21.15.121:0/4205358697 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148043070 con 0x7f613c003a00 2024-09-17T03:39:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.140+0000 7f614ea00640 1 -- 172.21.15.121:0/4205358697 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6148004320 con 0x7f613c003a00 2024-09-17T03:39:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.140+0000 7f614ea00640 1 -- 172.21.15.121:0/4205358697 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148038040 con 0x7f613c003a00 2024-09-17T03:39:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.140+0000 7f615ca00640 1 -- 172.21.15.121:0/4205358697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61580cfa50 con 0x7f613c003a00 2024-09-17T03:39:53.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.140+0000 7f615ca00640 1 -- 172.21.15.121:0/4205358697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61580ccba0 con 0x7f613c003a00 2024-09-17T03:39:53.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.141+0000 7f615ca00640 1 -- 172.21.15.121:0/4205358697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61580b4c80 con 0x7f613c003a00 2024-09-17T03:39:53.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.142+0000 7f614ea00640 1 -- 172.21.15.121:0/4205358697 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f614802b8b0 con 0x7f613c003a00 2024-09-17T03:39:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.143+0000 7f614ea00640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6138078b90 0x7f613807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.143+0000 7f614ea00640 1 -- 172.21.15.121:0/4205358697 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7f61480bb200 con 0x7f613c003a00 2024-09-17T03:39:53.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.144+0000 7f6155e00640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6138078b90 0x7f613807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:53.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.144+0000 7f6155e00640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6138078b90 0x7f613807b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6144001c00 tx=0x7f6144001b90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:53.147 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.148+0000 7f614ea00640 1 -- 172.21.15.121:0/4205358697 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6148083110 con 0x7f613c003a00 2024-09-17T03:39:53.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.403+0000 7f615ca00640 1 -- 172.21.15.121:0/4205358697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6158069370 con 0x7f613c003a00 2024-09-17T03:39:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.404+0000 7f614ea00640 1 -- 172.21.15.121:0/4205358697 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f6148087b40 con 0x7f613c003a00 2024-09-17T03:39:53.404 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:53.404 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:39:53.404 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-17T03:39:53.404 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.404 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-17T03:39:53.404 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohm64sFGhAAJDdFwMDkudwacQaLfvbAdg==", 2024-09-17T03:39:53.404 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmIGvPNRAAvE+tovzn5WadGa9C/P/A3A==", 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:39:53.405 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.c", 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmV/btJxAAmhL4jXk0LVdzCPaNi9Hzhg==", 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.406 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.d", 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmeQccCBAAtTfeUysbtoqrKjwaKRWyvg==", 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDE+OhmBxJKNRAAGxPaH7R2JtcFVO5kR/Qh2A==", 2024-09-17T03:39:53.407 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDI+OhmRtvFCBAAOG/1XD75Atl6ztUGPw3PKA==", 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.408 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL+OhmwzDzIxAA9Z/IIRphtZK1jbS2sIXeJQ==", 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.409 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.3", 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDO+Ohm94g0NBAAmxtHPev4OOM0YfOQt7N5Jg==", 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.4", 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDV+Ohmj7OoCBAA/Hrj9dHVT98lURPWJE3r/g==", 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.410 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:53.411 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:53.411 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.411 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.411 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.411 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.5", 2024-09-17T03:39:53.411 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDY+Ohmc29QFxAAGsMy0+9MviYohok8JpL+ZA==", 2024-09-17T03:39:53.411 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.411 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:53.411 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.6", 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDb+OhmDO8tKRAAq6bn/I54WKTdN6XiviHNsQ==", 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.412 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.7", 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDe+OhmUuFwNxAAgAeDJiL/TIGDuDAC+dXCyA==", 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw==", 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.413 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohmec7LKRAAl5nAqPEncglNL2FbRlD0oA==", 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:39:53.414 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.2", 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohme/hCHxAAdP8DjxaXWMGi/Fw+85zUFA==", 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.3", 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmivFTNBAA5f47Lq5CE+iXt3i+5fUJGA==", 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC/+OhmXWj6GBAAh/FBw0ElmHixSBXm8PPeAg==", 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohmsn9CDxAAzjtaZG1qe4XTnBge+t3vlA==", 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.y", 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmQfYJAxAA6Mc5PiIb5VDamVU5Vhx3aQ==", 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-17T03:39:53.418 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:39:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.406+0000 7f615ca00640 1 -- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6138078b90 msgr2=0x7f613807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.406+0000 7f615ca00640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6138078b90 0x7f613807b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6144001c00 tx=0x7f6144001b90 comp rx=0 tx=0).stop 2024-09-17T03:39:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.406+0000 7f615ca00640 1 -- 172.21.15.121:0/4205358697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613c003a00 msgr2=0x7f61581563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:53.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.406+0000 7f615ca00640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613c003a00 0x7f61581563b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6148009a70 tx=0x7f6148033670 comp rx=0 tx=0).stop 2024-09-17T03:39:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.406+0000 7f615ca00640 1 -- 172.21.15.121:0/4205358697 shutdown_connections 2024-09-17T03:39:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.406+0000 7f615ca00640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6158144f50 0x7f6158074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.407+0000 7f615ca00640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6158144a00 0x7f6158073e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.407+0000 7f615ca00640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6138078b90 0x7f613807b0a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.407+0000 7f615ca00640 1 --2- 172.21.15.121:0/4205358697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613c003a00 0x7f61581563b0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.407+0000 7f615ca00640 1 -- 172.21.15.121:0/4205358697 >> 172.21.15.121:0/4205358697 conn(0x7f61580b2440 msgr2=0x7f6158145700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.407+0000 7f615ca00640 1 -- 172.21.15.121:0/4205358697 shutdown_connections 2024-09-17T03:39:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.407+0000 7f615ca00640 1 -- 172.21.15.121:0/4205358697 wait complete. 2024-09-17T03:39:53.429 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:39:53.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.650+0000 7ff7cba00640 1 -- 172.21.15.121:0/3567400324 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c415a3e0 msgr2=0x7ff7c406d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:53.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.650+0000 7ff7cba00640 1 --2- 172.21.15.121:0/3567400324 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c415a3e0 0x7ff7c406d800 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4005fd0 tx=0x7ff7b402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.650+0000 7ff7cba00640 1 -- 172.21.15.121:0/3567400324 shutdown_connections 2024-09-17T03:39:53.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.650+0000 7ff7cba00640 1 --2- 172.21.15.121:0/3567400324 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c406ddc0 0x7ff7c40d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.650+0000 7ff7cba00640 1 --2- 172.21.15.121:0/3567400324 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c415a3e0 0x7ff7c406d800 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.650+0000 7ff7cba00640 1 -- 172.21.15.121:0/3567400324 >> 172.21.15.121:0/3567400324 conn(0x7ff7c40b3580 msgr2=0x7ff7c40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:53.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.650+0000 7ff7cba00640 1 -- 172.21.15.121:0/3567400324 shutdown_connections 2024-09-17T03:39:53.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.650+0000 7ff7cba00640 1 -- 172.21.15.121:0/3567400324 wait complete. 2024-09-17T03:39:53.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.652+0000 7ff7cba00640 1 Processor -- start 2024-09-17T03:39:53.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.652+0000 7ff7cba00640 1 -- start start 2024-09-17T03:39:53.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7cba00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c406ddc0 0x7ff7c415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:53.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7cba00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c40d0af0 0x7ff7c415f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:53.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7cba00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c415a3e0 0x7ff7c41f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7cba00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c406f560 con 0x7ff7c40d0af0 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7cba00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c4161190 con 0x7ff7c406ddc0 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7cba00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c406f6e0 con 0x7ff7c415a3e0 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7c3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c40d0af0 0x7ff7c415f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7c3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c40d0af0 0x7ff7c415f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46400/0 (socket says 172.21.15.121:46400) 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7c3e00640 1 -- 172.21.15.121:0/412885174 learned_addr learned my addr 172.21.15.121:0/412885174 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7c9000640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c406ddc0 0x7ff7c415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.654+0000 7ff7c9a00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c415a3e0 0x7ff7c41f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7c3e00640 1 -- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c415a3e0 msgr2=0x7ff7c41f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7c3e00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c415a3e0 0x7ff7c41f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7c3e00640 1 -- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c406ddc0 msgr2=0x7ff7c415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7c3e00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c406ddc0 0x7ff7c415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7c3e00640 1 -- 172.21.15.121:0/412885174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c41598f0 con 0x7ff7c40d0af0 2024-09-17T03:39:53.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7c3e00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c40d0af0 0x7ff7c415f390 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000d700 tx=0x7ff7b000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:53.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7c0c00640 1 -- 172.21.15.121:0/412885174 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0017070 con 0x7ff7c40d0af0 2024-09-17T03:39:53.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7c0c00640 1 -- 172.21.15.121:0/412885174 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7b0005310 con 0x7ff7c40d0af0 2024-09-17T03:39:53.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7cba00640 1 -- 172.21.15.121:0/412885174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c41f5e00 con 0x7ff7c40d0af0 2024-09-17T03:39:53.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7c0c00640 1 -- 172.21.15.121:0/412885174 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00097c0 con 0x7ff7c40d0af0 2024-09-17T03:39:53.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.655+0000 7ff7cba00640 1 -- 172.21.15.121:0/412885174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c41f63c0 con 0x7ff7c40d0af0 2024-09-17T03:39:53.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.656+0000 7ff7cba00640 1 -- 172.21.15.121:0/412885174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c406fb90 con 0x7ff7c40d0af0 2024-09-17T03:39:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.658+0000 7ff7c0c00640 1 -- 172.21.15.121:0/412885174 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff7b0009960 con 0x7ff7c40d0af0 2024-09-17T03:39:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.659+0000 7ff7c0c00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7a4078bc0 0x7ff7a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:53.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.659+0000 7ff7c0c00640 1 -- 172.21.15.121:0/412885174 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7ff7b009aa40 con 0x7ff7c40d0af0 2024-09-17T03:39:53.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.659+0000 7ff7c9000640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7a4078bc0 0x7ff7a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:53.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.660+0000 7ff7c9000640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7a4078bc0 0x7ff7a407b0d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4033000 tx=0x7ff7b4004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:53.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.663+0000 7ff7c0c00640 1 -- 172.21.15.121:0/412885174 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff7b0062b10 con 0x7ff7c40d0af0 2024-09-17T03:39:53.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.846+0000 7ff7cba00640 1 -- 172.21.15.121:0/412885174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff7c40c6c70 con 0x7ff7c40d0af0 2024-09-17T03:39:53.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.847+0000 7ff7c0c00640 1 -- 172.21.15.121:0/412885174 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) ==== 84+0+65 (secure 0 0 0) 0x7ff7b009ae20 con 0x7ff7c40d0af0 2024-09-17T03:39:53.848 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:53.848 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-17T03:39:53.848 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:39:53.848 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-17T03:39:53.849 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-17T03:39:53.849 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:39:53.849 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-17T03:39:53.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.849+0000 7ff7cba00640 1 -- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7a4078bc0 msgr2=0x7ff7a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.849+0000 7ff7cba00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7a4078bc0 0x7ff7a407b0d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4033000 tx=0x7ff7b4004730 comp rx=0 tx=0).stop 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.849+0000 7ff7cba00640 1 -- 172.21.15.121:0/412885174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c40d0af0 msgr2=0x7ff7c415f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.849+0000 7ff7cba00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c40d0af0 0x7ff7c415f390 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000d700 tx=0x7ff7b000dbc0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.849+0000 7ff7cba00640 1 -- 172.21.15.121:0/412885174 shutdown_connections 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.849+0000 7ff7cba00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c415a3e0 0x7ff7c41f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.849+0000 7ff7cba00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7a4078bc0 0x7ff7a407b0d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.849+0000 7ff7cba00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c40d0af0 0x7ff7c415f390 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.849+0000 7ff7cba00640 1 --2- 172.21.15.121:0/412885174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c406ddc0 0x7ff7c415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.849+0000 7ff7cba00640 1 -- 172.21.15.121:0/412885174 >> 172.21.15.121:0/412885174 conn(0x7ff7c40b3580 msgr2=0x7ff7c40cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.850+0000 7ff7cba00640 1 -- 172.21.15.121:0/412885174 shutdown_connections 2024-09-17T03:39:53.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:53.850+0000 7ff7cba00640 1 -- 172.21.15.121:0/412885174 wait complete. 2024-09-17T03:39:53.876 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:39:53.876 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:39:54.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.103+0000 7fd61be00640 1 -- 172.21.15.121:0/407052414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd600004800 msgr2=0x7fd600004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:54.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.103+0000 7fd61be00640 1 --2- 172.21.15.121:0/407052414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd600004800 0x7fd600004c10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd6080016c0 tx=0x7fd600005830 comp rx=0 tx=0).stop 2024-09-17T03:39:54.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.103+0000 7fd61be00640 1 -- 172.21.15.121:0/407052414 shutdown_connections 2024-09-17T03:39:54.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.103+0000 7fd61be00640 1 --2- 172.21.15.121:0/407052414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd600004800 0x7fd600004c10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:54.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.103+0000 7fd61be00640 1 -- 172.21.15.121:0/407052414 >> 172.21.15.121:0/407052414 conn(0x7fd61c0d1350 msgr2=0x7fd61c073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:54.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.103+0000 7fd61be00640 1 -- 172.21.15.121:0/407052414 shutdown_connections 2024-09-17T03:39:54.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.103+0000 7fd61be00640 1 -- 172.21.15.121:0/407052414 wait complete. 2024-09-17T03:39:54.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.105+0000 7fd61be00640 1 Processor -- start 2024-09-17T03:39:54.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.105+0000 7fd61be00640 1 -- start start 2024-09-17T03:39:54.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd600004800 0x7fd61c070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:54.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd61c155e40 0x7fd61c1493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:54.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd61c15b6b0 0x7fd61c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:54.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61be00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c0afd30 con 0x7fd600004800 2024-09-17T03:39:54.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61be00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c15db90 con 0x7fd61c155e40 2024-09-17T03:39:54.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd61c0afeb0 con 0x7fd61c15b6b0 2024-09-17T03:39:54.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd600004800 0x7fd61c070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:54.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd600004800 0x7fd61c070170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46416/0 (socket says 172.21.15.121:46416) 2024-09-17T03:39:54.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61aa00640 1 -- 172.21.15.121:0/1449832217 learned_addr learned my addr 172.21.15.121:0/1449832217 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:54.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61a000640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd61c155e40 0x7fd61c1493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:54.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.107+0000 7fd61b400640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd61c15b6b0 0x7fd61c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:54.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd61aa00640 1 -- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd61c15b6b0 msgr2=0x7fd61c15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:54.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd61aa00640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd61c15b6b0 0x7fd61c15bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:54.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd61aa00640 1 -- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd61c155e40 msgr2=0x7fd61c1493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:54.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd61aa00640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd61c155e40 0x7fd61c1493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:54.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd61aa00640 1 -- 172.21.15.121:0/1449832217 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c15c000 con 0x7fd600004800 2024-09-17T03:39:54.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd61aa00640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd600004800 0x7fd61c070170 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd60c006290 tx=0x7fd60c006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:54.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd612a00640 1 -- 172.21.15.121:0/1449832217 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00fb40 con 0x7fd600004800 2024-09-17T03:39:54.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd612a00640 1 -- 172.21.15.121:0/1449832217 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd60c016020 con 0x7fd600004800 2024-09-17T03:39:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd61be00640 1 -- 172.21.15.121:0/1449832217 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61c1f96c0 con 0x7fd600004800 2024-09-17T03:39:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd612a00640 1 -- 172.21.15.121:0/1449832217 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c011430 con 0x7fd600004800 2024-09-17T03:39:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.108+0000 7fd61be00640 1 -- 172.21.15.121:0/1449832217 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61c1f8be0 con 0x7fd600004800 2024-09-17T03:39:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.109+0000 7fd61be00640 1 -- 172.21.15.121:0/1449832217 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd61c150b40 con 0x7fd600004800 2024-09-17T03:39:54.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.111+0000 7fd612a00640 1 -- 172.21.15.121:0/1449832217 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd60c0115d0 con 0x7fd600004800 2024-09-17T03:39:54.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.112+0000 7fd612a00640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5fc078bc0 0x7fd5fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.112+0000 7fd612a00640 1 -- 172.21.15.121:0/1449832217 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7fd60c09b7e0 con 0x7fd600004800 2024-09-17T03:39:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.112+0000 7fd61a000640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5fc078bc0 0x7fd5fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:54.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.113+0000 7fd61a000640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5fc078bc0 0x7fd5fc07b0d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd608032000 tx=0x7fd60802c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:54.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.116+0000 7fd612a00640 1 -- 172.21.15.121:0/1449832217 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd60c020020 con 0x7fd600004800 2024-09-17T03:39:54.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.299+0000 7fd61be00640 1 -- 172.21.15.121:0/1449832217 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd61c149930 con 0x7fd600004800 2024-09-17T03:39:54.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.894+0000 7fd612a00640 1 -- 172.21.15.121:0/1449832217 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) ==== 138+0+0 (secure 0 0 0) 0x7fd61c15c000 con 0x7fd600004800 2024-09-17T03:39:54.896 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-17T03:39:54.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.897+0000 7fd61be00640 1 -- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5fc078bc0 msgr2=0x7fd5fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:54.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.897+0000 7fd61be00640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5fc078bc0 0x7fd5fc07b0d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd608032000 tx=0x7fd60802c040 comp rx=0 tx=0).stop 2024-09-17T03:39:54.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.897+0000 7fd61be00640 1 -- 172.21.15.121:0/1449832217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd600004800 msgr2=0x7fd61c070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:54.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.897+0000 7fd61be00640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd600004800 0x7fd61c070170 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd60c006290 tx=0x7fd60c006750 comp rx=0 tx=0).stop 2024-09-17T03:39:54.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.897+0000 7fd61be00640 1 -- 172.21.15.121:0/1449832217 shutdown_connections 2024-09-17T03:39:54.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.897+0000 7fd61be00640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd61c15b6b0 0x7fd61c15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:54.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.897+0000 7fd61be00640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd61c155e40 0x7fd61c1493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:54.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.897+0000 7fd61be00640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd5fc078bc0 0x7fd5fc07b0d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:54.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.897+0000 7fd61be00640 1 --2- 172.21.15.121:0/1449832217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd600004800 0x7fd61c070170 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:54.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.897+0000 7fd61be00640 1 -- 172.21.15.121:0/1449832217 >> 172.21.15.121:0/1449832217 conn(0x7fd61c0d1350 msgr2=0x7fd61c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:54.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.898+0000 7fd61be00640 1 -- 172.21.15.121:0/1449832217 shutdown_connections 2024-09-17T03:39:54.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:54.898+0000 7fd61be00640 1 -- 172.21.15.121:0/1449832217 wait complete. 2024-09-17T03:39:54.931 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:39:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.160+0000 7f251b200640 1 -- 172.21.15.121:0/1659737944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2514160180 msgr2=0x7f2514160590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.160+0000 7f251b200640 1 --2- 172.21.15.121:0/1659737944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2514160180 0x7f2514160590 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2504009830 tx=0x7f250402a510 comp rx=0 tx=0).stop 2024-09-17T03:39:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.161+0000 7f251b200640 1 -- 172.21.15.121:0/1659737944 shutdown_connections 2024-09-17T03:39:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.161+0000 7f251b200640 1 --2- 172.21.15.121:0/1659737944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f251406d830 0x7f251406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.161+0000 7f251b200640 1 --2- 172.21.15.121:0/1659737944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2514160180 0x7f2514160590 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.161+0000 7f251b200640 1 -- 172.21.15.121:0/1659737944 >> 172.21.15.121:0/1659737944 conn(0x7f25140b2440 msgr2=0x7f25140d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.161+0000 7f251b200640 1 -- 172.21.15.121:0/1659737944 shutdown_connections 2024-09-17T03:39:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.161+0000 7f251b200640 1 -- 172.21.15.121:0/1659737944 wait complete. 2024-09-17T03:39:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.163+0000 7f251b200640 1 Processor -- start 2024-09-17T03:39:55.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.163+0000 7f251b200640 1 -- start start 2024-09-17T03:39:55.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.164+0000 7f251b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f251406d830 0x7f25140cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:55.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.164+0000 7f251b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2514070810 0x7f251415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.164+0000 7f251b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2514160180 0x7f251415b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.164+0000 7f251b200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f251406ef70 con 0x7f251406d830 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.164+0000 7f251b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f251406edf0 con 0x7f2514160180 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.164+0000 7f251b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f251406e180 con 0x7f2514070810 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.165+0000 7f2519e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f251406d830 0x7f25140cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.165+0000 7f2519e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f251406d830 0x7f25140cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46440/0 (socket says 172.21.15.121:46440) 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.165+0000 7f2519e00640 1 -- 172.21.15.121:0/2914065528 learned_addr learned my addr 172.21.15.121:0/2914065528 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.165+0000 7f2519e00640 1 -- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2514070810 msgr2=0x7f251415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.165+0000 7f2519e00640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2514070810 0x7f251415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.165+0000 7f2519e00640 1 -- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2514160180 msgr2=0x7f251415b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.165+0000 7f2519e00640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2514160180 0x7f251415b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.165+0000 7f2519e00640 1 -- 172.21.15.121:0/2914065528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2514135970 con 0x7f251406d830 2024-09-17T03:39:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.165+0000 7f2519e00640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f251406d830 0x7f25140cf690 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f250800c3d0 tx=0x7f250800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:55.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.165+0000 7f250e000640 1 -- 172.21.15.121:0/2914065528 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508011790 con 0x7f251406d830 2024-09-17T03:39:55.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.166+0000 7f250e000640 1 -- 172.21.15.121:0/2914065528 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2508017070 con 0x7f251406d830 2024-09-17T03:39:55.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.166+0000 7f251b200640 1 -- 172.21.15.121:0/2914065528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25141f7880 con 0x7f251406d830 2024-09-17T03:39:55.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.166+0000 7f250e000640 1 -- 172.21.15.121:0/2914065528 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508011cc0 con 0x7f251406d830 2024-09-17T03:39:55.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.166+0000 7f251b200640 1 -- 172.21.15.121:0/2914065528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25140ccdb0 con 0x7f251406d830 2024-09-17T03:39:55.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.167+0000 7f251b200640 1 -- 172.21.15.121:0/2914065528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f251406e710 con 0x7f251406d830 2024-09-17T03:39:55.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.168+0000 7f250e000640 1 -- 172.21.15.121:0/2914065528 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f250801c460 con 0x7f251406d830 2024-09-17T03:39:55.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.169+0000 7f250e000640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f24f8078b90 0x7f24f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:55.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.169+0000 7f250e000640 1 -- 172.21.15.121:0/2914065528 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5619+0+0 (secure 0 0 0) 0x7f250809b5f0 con 0x7f251406d830 2024-09-17T03:39:55.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.170+0000 7f2519400640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f24f8078b90 0x7f24f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:55.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.171+0000 7f2519400640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f24f8078b90 0x7f24f807b0a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2504034000 tx=0x7f25040046c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:55.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.173+0000 7f250e000640 1 -- 172.21.15.121:0/2914065528 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2514160ad0 con 0x7f251406d830 2024-09-17T03:39:55.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.357+0000 7f251b200640 1 -- 172.21.15.121:0/2914065528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2514145d80 con 0x7f251406d830 2024-09-17T03:39:55.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.901+0000 7f250e000640 1 -- 172.21.15.121:0/2914065528 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) ==== 170+0+0 (secure 0 0 0) 0x7f2508063a80 con 0x7f251406d830 2024-09-17T03:39:55.903 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-17T03:39:55.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.904+0000 7f251b200640 1 -- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f24f8078b90 msgr2=0x7f24f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:55.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.904+0000 7f251b200640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f24f8078b90 0x7f24f807b0a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2504034000 tx=0x7f25040046c0 comp rx=0 tx=0).stop 2024-09-17T03:39:55.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.904+0000 7f251b200640 1 -- 172.21.15.121:0/2914065528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f251406d830 msgr2=0x7f25140cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:55.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.904+0000 7f251b200640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f251406d830 0x7f25140cf690 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f250800c3d0 tx=0x7f250800c890 comp rx=0 tx=0).stop 2024-09-17T03:39:55.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.904+0000 7f251b200640 1 -- 172.21.15.121:0/2914065528 shutdown_connections 2024-09-17T03:39:55.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.904+0000 7f251b200640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2514160180 0x7f251415b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:55.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.904+0000 7f251b200640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2514070810 0x7f251415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:55.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.904+0000 7f251b200640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f24f8078b90 0x7f24f807b0a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:55.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.904+0000 7f251b200640 1 --2- 172.21.15.121:0/2914065528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f251406d830 0x7f25140cf690 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:55.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.904+0000 7f251b200640 1 -- 172.21.15.121:0/2914065528 >> 172.21.15.121:0/2914065528 conn(0x7f25140b2440 msgr2=0x7f25140b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:55.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.905+0000 7f251b200640 1 -- 172.21.15.121:0/2914065528 shutdown_connections 2024-09-17T03:39:55.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:55.905+0000 7f251b200640 1 -- 172.21.15.121:0/2914065528 wait complete. 2024-09-17T03:39:55.945 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:39:56.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.169+0000 7f8d76200640 1 -- 172.21.15.121:0/3949580423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d70070290 msgr2=0x7f8d700cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:56.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.169+0000 7f8d76200640 1 --2- 172.21.15.121:0/3949580423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d70070290 0x7f8d700cc870 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c005fd0 tx=0x7f8d5c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:39:56.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.169+0000 7f8d76200640 1 -- 172.21.15.121:0/3949580423 shutdown_connections 2024-09-17T03:39:56.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.169+0000 7f8d76200640 1 --2- 172.21.15.121:0/3949580423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d70070290 0x7f8d700cc870 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:56.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.169+0000 7f8d76200640 1 --2- 172.21.15.121:0/3949580423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d701623f0 0x7f8d700d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:56.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.169+0000 7f8d76200640 1 -- 172.21.15.121:0/3949580423 >> 172.21.15.121:0/3949580423 conn(0x7f8d700cee80 msgr2=0x7f8d700cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:56.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.169+0000 7f8d76200640 1 -- 172.21.15.121:0/3949580423 shutdown_connections 2024-09-17T03:39:56.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.169+0000 7f8d76200640 1 -- 172.21.15.121:0/3949580423 wait complete. 2024-09-17T03:39:56.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.171+0000 7f8d76200640 1 Processor -- start 2024-09-17T03:39:56.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.172+0000 7f8d76200640 1 -- start start 2024-09-17T03:39:56.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.173+0000 7f8d76200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d70070290 0x7f8d701576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.173+0000 7f8d76200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d700b3ca0 0x7f8d701f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.173+0000 7f8d76200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d701623f0 0x7f8d701f9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.173+0000 7f8d76200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7015f370 con 0x7f8d701623f0 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.173+0000 7f8d76200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d700ccfc0 con 0x7f8d700b3ca0 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.173+0000 7f8d76200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7015f4f0 con 0x7f8d70070290 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d75800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d701623f0 0x7f8d701f9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d75800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d701623f0 0x7f8d701f9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46458/0 (socket says 172.21.15.121:46458) 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d75800640 1 -- 172.21.15.121:0/4222866545 learned_addr learned my addr 172.21.15.121:0/4222866545 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d74e00640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d70070290 0x7f8d701576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d6fe00640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d700b3ca0 0x7f8d701f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d75800640 1 -- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d70070290 msgr2=0x7f8d701576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d75800640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d70070290 0x7f8d701576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:56.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d75800640 1 -- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d700b3ca0 msgr2=0x7f8d701f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:56.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d75800640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d700b3ca0 0x7f8d701f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:56.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d75800640 1 -- 172.21.15.121:0/4222866545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d701f9e60 con 0x7f8d701623f0 2024-09-17T03:39:56.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.174+0000 7f8d75800640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d701623f0 0x7f8d701f9520 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800c3c0 tx=0x7f8d6800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:56.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.175+0000 7f8d6cc00640 1 -- 172.21.15.121:0/4222866545 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68017070 con 0x7f8d701623f0 2024-09-17T03:39:56.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.175+0000 7f8d6cc00640 1 -- 172.21.15.121:0/4222866545 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d680035f0 con 0x7f8d701623f0 2024-09-17T03:39:56.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.175+0000 7f8d6cc00640 1 -- 172.21.15.121:0/4222866545 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68003a80 con 0x7f8d701623f0 2024-09-17T03:39:56.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.175+0000 7f8d76200640 1 -- 172.21.15.121:0/4222866545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d700ae950 con 0x7f8d701623f0 2024-09-17T03:39:56.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.175+0000 7f8d76200640 1 -- 172.21.15.121:0/4222866545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d700b2d20 con 0x7f8d701623f0 2024-09-17T03:39:56.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.176+0000 7f8d76200640 1 -- 172.21.15.121:0/4222866545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d700b2f60 con 0x7f8d701623f0 2024-09-17T03:39:56.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.177+0000 7f8d6cc00640 1 -- 172.21.15.121:0/4222866545 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d6801a070 con 0x7f8d701623f0 2024-09-17T03:39:56.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.178+0000 7f8d6cc00640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d50078b90 0x7f8d5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:56.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.178+0000 7f8d6cc00640 1 -- 172.21.15.121:0/4222866545 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6001+0+0 (secure 0 0 0) 0x7f8d6809a110 con 0x7f8d701623f0 2024-09-17T03:39:56.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.179+0000 7f8d74e00640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d50078b90 0x7f8d5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:56.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.180+0000 7f8d74e00640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d50078b90 0x7f8d5007b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8d60005fd0 tx=0x7f8d60009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:56.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.183+0000 7f8d6cc00640 1 -- 172.21.15.121:0/4222866545 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8d68061d30 con 0x7f8d701623f0 2024-09-17T03:39:56.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.405+0000 7f8d76200640 1 -- 172.21.15.121:0/4222866545 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8d700ae250 con 0x7f8d701623f0 2024-09-17T03:39:56.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.904+0000 7f8d6cc00640 1 -- 172.21.15.121:0/4222866545 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v64) ==== 174+0+0 (secure 0 0 0) 0x7f8d700ae250 con 0x7f8d701623f0 2024-09-17T03:39:56.905 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 15 and data pool 16 2024-09-17T03:39:56.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 -- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d50078b90 msgr2=0x7f8d5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d50078b90 0x7f8d5007b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8d60005fd0 tx=0x7f8d60009500 comp rx=0 tx=0).stop 2024-09-17T03:39:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 -- 172.21.15.121:0/4222866545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d701623f0 msgr2=0x7f8d701f9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d701623f0 0x7f8d701f9520 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800c3c0 tx=0x7f8d6800c880 comp rx=0 tx=0).stop 2024-09-17T03:39:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 -- 172.21.15.121:0/4222866545 shutdown_connections 2024-09-17T03:39:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8d50078b90 0x7f8d5007b0a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d701623f0 0x7f8d701f9520 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d700b3ca0 0x7f8d701f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 --2- 172.21.15.121:0/4222866545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d70070290 0x7f8d701576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 -- 172.21.15.121:0/4222866545 >> 172.21.15.121:0/4222866545 conn(0x7f8d700cee80 msgr2=0x7f8d700cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:56.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 -- 172.21.15.121:0/4222866545 shutdown_connections 2024-09-17T03:39:56.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:56.907+0000 7f8d76200640 1 -- 172.21.15.121:0/4222866545 wait complete. 2024-09-17T03:39:56.956 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:57.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.178+0000 7f3ae2200640 1 -- 172.21.15.121:0/46257638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ac0003c50 msgr2=0x7f3ac0004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:57.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.178+0000 7f3ae2200640 1 --2- 172.21.15.121:0/46257638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ac0003c50 0x7f3ac0004080 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f3acc001830 tx=0x7f3ac0005830 comp rx=0 tx=0).stop 2024-09-17T03:39:57.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.178+0000 7f3adbe00640 1 -- 172.21.15.121:0/46257638 reap_dead start 2024-09-17T03:39:57.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.178+0000 7f3ae2200640 1 -- 172.21.15.121:0/46257638 shutdown_connections 2024-09-17T03:39:57.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.178+0000 7f3ae2200640 1 -- 172.21.15.121:0/46257638 >> 172.21.15.121:0/46257638 conn(0x7f3adc0b3580 msgr2=0x7f3adc0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:57.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.178+0000 7f3ae2200640 1 -- 172.21.15.121:0/46257638 shutdown_connections 2024-09-17T03:39:57.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.178+0000 7f3ae2200640 1 -- 172.21.15.121:0/46257638 wait complete. 2024-09-17T03:39:57.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.180+0000 7f3ae2200640 1 Processor -- start 2024-09-17T03:39:57.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.180+0000 7f3ae2200640 1 -- start start 2024-09-17T03:39:57.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3ae2200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ac0003c50 0x7f3adc1f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:57.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3ae2200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3adc0c9f00 0x7f3adc155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:57.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3ae2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3adc073d50 0x7f3adc074160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:57.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3ae2200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc0d0940 con 0x7f3adc0c9f00 2024-09-17T03:39:57.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3ae2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc0d07c0 con 0x7f3adc073d50 2024-09-17T03:39:57.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3ae2200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3adc15d320 con 0x7f3ac0003c50 2024-09-17T03:39:57.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3ad2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3adc0c9f00 0x7f3adc155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:57.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3adb400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ac0003c50 0x7f3adc1f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:57.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3ad2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3adc0c9f00 0x7f3adc155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46476/0 (socket says 172.21.15.121:46476) 2024-09-17T03:39:57.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3ad2a00640 1 -- 172.21.15.121:0/1523351651 learned_addr learned my addr 172.21.15.121:0/1523351651 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:57.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.182+0000 7f3adbe00640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3adc073d50 0x7f3adc074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ad2a00640 1 -- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ac0003c50 msgr2=0x7f3adc1f3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ad2a00640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ac0003c50 0x7f3adc1f3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ad2a00640 1 -- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3adc073d50 msgr2=0x7f3adc074160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ad2a00640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3adc073d50 0x7f3adc074160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ad2a00640 1 -- 172.21.15.121:0/1523351651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3adc0746a0 con 0x7f3adc0c9f00 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3adbe00640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3adc073d50 0x7f3adc074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ad2a00640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3adc0c9f00 0x7f3adc155ff0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4011a80 tx=0x7f3ac4011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ad3e00640 1 -- 172.21.15.121:0/1523351651 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400fe10 con 0x7f3adc0c9f00 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ad3e00640 1 -- 172.21.15.121:0/1523351651 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ac4016070 con 0x7f3adc0c9f00 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ae2200640 1 -- 172.21.15.121:0/1523351651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3adc156530 con 0x7f3adc0c9f00 2024-09-17T03:39:57.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ad3e00640 1 -- 172.21.15.121:0/1523351651 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4012690 con 0x7f3adc0c9f00 2024-09-17T03:39:57.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.183+0000 7f3ae2200640 1 -- 172.21.15.121:0/1523351651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3adc1f3c00 con 0x7f3adc0c9f00 2024-09-17T03:39:57.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.185+0000 7f3ae2200640 1 -- 172.21.15.121:0/1523351651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3adc15ea00 con 0x7f3adc0c9f00 2024-09-17T03:39:57.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.186+0000 7f3ad3e00640 1 -- 172.21.15.121:0/1523351651 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ac4018030 con 0x7f3adc0c9f00 2024-09-17T03:39:57.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.187+0000 7f3ad3e00640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3ab8078b90 0x7f3ab807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:57.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.187+0000 7f3ad3e00640 1 -- 172.21.15.121:0/1523351651 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f3ac409b840 con 0x7f3adc0c9f00 2024-09-17T03:39:57.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.187+0000 7f3adb400640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3ab8078b90 0x7f3ab807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:57.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.188+0000 7f3adb400640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3ab8078b90 0x7f3ab807b0a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3acc032000 tx=0x7f3acc001360 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:57.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.191+0000 7f3ad3e00640 1 -- 172.21.15.121:0/1523351651 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3adc0746a0 con 0x7f3adc0c9f00 2024-09-17T03:39:57.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.377+0000 7f3ae2200640 1 -- 172.21.15.121:0/1523351651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3adc1f3990 con 0x7f3adc0c9f00 2024-09-17T03:39:57.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.378+0000 7f3ad3e00640 1 -- 172.21.15.121:0/1523351651 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+17022 (secure 0 0 0) 0x7f3ac406c020 con 0x7f3adc0c9f00 2024-09-17T03:39:57.380 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:57.380 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":97,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:56.408182+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:39:54.312958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-17T03:39:55.372103+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 -- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3ab8078b90 msgr2=0x7f3ab807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3ab8078b90 0x7f3ab807b0a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3acc032000 tx=0x7f3acc001360 comp rx=0 tx=0).stop 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 -- 172.21.15.121:0/1523351651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3adc0c9f00 msgr2=0x7f3adc155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3adc0c9f00 0x7f3adc155ff0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4011a80 tx=0x7f3ac4011f40 comp rx=0 tx=0).stop 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 -- 172.21.15.121:0/1523351651 shutdown_connections 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3adc073d50 0x7f3adc074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3ab8078b90 0x7f3ab807b0a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3adc0c9f00 0x7f3adc155ff0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 --2- 172.21.15.121:0/1523351651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ac0003c50 0x7f3adc1f3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 -- 172.21.15.121:0/1523351651 >> 172.21.15.121:0/1523351651 conn(0x7f3adc0b3580 msgr2=0x7f3adc0cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 -- 172.21.15.121:0/1523351651 shutdown_connections 2024-09-17T03:39:57.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.381+0000 7f3ae2200640 1 -- 172.21.15.121:0/1523351651 wait complete. 2024-09-17T03:39:57.406 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:39:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.627+0000 7f0f7c600640 1 -- 172.21.15.121:0/1524758386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c004800 msgr2=0x7f0f5c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.627+0000 7f0f7c600640 1 --2- 172.21.15.121:0/1524758386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c004800 0x7f0f5c004c10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000c470 tx=0x7f0f5c005830 comp rx=0 tx=0).stop 2024-09-17T03:39:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.627+0000 7f0f7c600640 1 -- 172.21.15.121:0/1524758386 shutdown_connections 2024-09-17T03:39:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.627+0000 7f0f7c600640 1 --2- 172.21.15.121:0/1524758386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c004800 0x7f0f5c004c10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.627+0000 7f0f7c600640 1 -- 172.21.15.121:0/1524758386 >> 172.21.15.121:0/1524758386 conn(0x7f0f740b3580 msgr2=0x7f0f740b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:57.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.627+0000 7f0f7c600640 1 -- 172.21.15.121:0/1524758386 shutdown_connections 2024-09-17T03:39:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.627+0000 7f0f7c600640 1 -- 172.21.15.121:0/1524758386 wait complete. 2024-09-17T03:39:57.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.629+0000 7f0f7c600640 1 Processor -- start 2024-09-17T03:39:57.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.629+0000 7f0f7c600640 1 -- start start 2024-09-17T03:39:57.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f7c600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f5c004800 0x7f0f740c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f7c600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f74159800 0x7f0f741f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f7c600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f741f6730 0x7f0f741f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f7c600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7406e150 con 0x7f0f74159800 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f7c600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7406dfd0 con 0x7f0f741f6730 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f7c600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7406e2d0 con 0x7f0f5c004800 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f79200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f74159800 0x7f0f741f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f79200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f74159800 0x7f0f741f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46504/0 (socket says 172.21.15.121:46504) 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f79200640 1 -- 172.21.15.121:0/2697868418 learned_addr learned my addr 172.21.15.121:0/2697868418 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f79c00640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f5c004800 0x7f0f740c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.631+0000 7f0f7a600640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f741f6730 0x7f0f741f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f79200640 1 -- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f5c004800 msgr2=0x7f0f740c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f79200640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f5c004800 0x7f0f740c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f79200640 1 -- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f741f6730 msgr2=0x7f0f741f6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:57.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f79200640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f741f6730 0x7f0f741f6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f79200640 1 -- 172.21.15.121:0/2697868418 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f74159c10 con 0x7f0f74159800 2024-09-17T03:39:57.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f7a600640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f741f6730 0x7f0f741f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:57.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f79200640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f74159800 0x7f0f741f5fc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002b2d0 tx=0x7f0f60001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f71600640 1 -- 172.21.15.121:0/2697868418 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60042070 con 0x7f0f74159800 2024-09-17T03:39:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f71600640 1 -- 172.21.15.121:0/2697868418 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f600066e0 con 0x7f0f74159800 2024-09-17T03:39:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f71600640 1 -- 172.21.15.121:0/2697868418 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60039070 con 0x7f0f74159800 2024-09-17T03:39:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f7c600640 1 -- 172.21.15.121:0/2697868418 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f741f6500 con 0x7f0f74159800 2024-09-17T03:39:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.632+0000 7f0f7c600640 1 -- 172.21.15.121:0/2697868418 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f74158d20 con 0x7f0f74159800 2024-09-17T03:39:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.633+0000 7f0f7c600640 1 -- 172.21.15.121:0/2697868418 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7415a020 con 0x7f0f74159800 2024-09-17T03:39:57.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.635+0000 7f0f71600640 1 -- 172.21.15.121:0/2697868418 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f60045070 con 0x7f0f74159800 2024-09-17T03:39:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.636+0000 7f0f71600640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f54078bc0 0x7f0f5407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.636+0000 7f0f71600640 1 -- 172.21.15.121:0/2697868418 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f0f600ba700 con 0x7f0f74159800 2024-09-17T03:39:57.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.637+0000 7f0f79c00640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f54078bc0 0x7f0f5407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:57.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.638+0000 7f0f79c00640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f54078bc0 0x7f0f5407b0d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0f68006fd0 tx=0x7f0f68006d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:57.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.641+0000 7f0f71600640 1 -- 172.21.15.121:0/2697868418 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f7415a020 con 0x7f0f74159800 2024-09-17T03:39:57.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.826+0000 7f0f7c600640 1 -- 172.21.15.121:0/2697868418 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f74070c50 con 0x7f0f74159800 2024-09-17T03:39:57.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.827+0000 7f0f71600640 1 -- 172.21.15.121:0/2697868418 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+17022 (secure 0 0 0) 0x7f0f74070c50 con 0x7f0f74159800 2024-09-17T03:39:57.828 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:39:57.828 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":97,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:56.408182+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:39:54.312958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-17T03:39:55.372103+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 -- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f54078bc0 msgr2=0x7f0f5407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f54078bc0 0x7f0f5407b0d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0f68006fd0 tx=0x7f0f68006d10 comp rx=0 tx=0).stop 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 -- 172.21.15.121:0/2697868418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f74159800 msgr2=0x7f0f741f5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f74159800 0x7f0f741f5fc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002b2d0 tx=0x7f0f60001360 comp rx=0 tx=0).stop 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 -- 172.21.15.121:0/2697868418 shutdown_connections 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f741f6730 0x7f0f741f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0f54078bc0 0x7f0f5407b0d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f74159800 0x7f0f741f5fc0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 --2- 172.21.15.121:0/2697868418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f5c004800 0x7f0f740c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 -- 172.21.15.121:0/2697868418 >> 172.21.15.121:0/2697868418 conn(0x7f0f740b3580 msgr2=0x7f0f740cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 -- 172.21.15.121:0/2697868418 shutdown_connections 2024-09-17T03:39:57.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:57.830+0000 7f0f7c600640 1 -- 172.21.15.121:0/2697868418 wait complete. 2024-09-17T03:39:57.853 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:39:58.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.079+0000 7f6ebdc00640 1 -- 172.21.15.121:0/323182601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb8074350 msgr2=0x7f6eb806f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:58.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.079+0000 7f6ebdc00640 1 --2- 172.21.15.121:0/323182601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb8074350 0x7f6eb806f560 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0005fd0 tx=0x7f6eb002aa10 comp rx=0 tx=0).stop 2024-09-17T03:39:58.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.079+0000 7f6ebdc00640 1 -- 172.21.15.121:0/323182601 shutdown_connections 2024-09-17T03:39:58.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.079+0000 7f6ebdc00640 1 --2- 172.21.15.121:0/323182601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb8074350 0x7f6eb806f560 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:58.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.079+0000 7f6ebdc00640 1 --2- 172.21.15.121:0/323182601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6eb8070100 0x7f6eb80d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:58.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.079+0000 7f6ebdc00640 1 -- 172.21.15.121:0/323182601 >> 172.21.15.121:0/323182601 conn(0x7f6eb80b3580 msgr2=0x7f6eb80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:58.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.079+0000 7f6ebdc00640 1 -- 172.21.15.121:0/323182601 shutdown_connections 2024-09-17T03:39:58.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.079+0000 7f6ebdc00640 1 -- 172.21.15.121:0/323182601 wait complete. 2024-09-17T03:39:58.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.081+0000 7f6ebdc00640 1 Processor -- start 2024-09-17T03:39:58.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.082+0000 7f6ebdc00640 1 -- start start 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.083+0000 7f6ebdc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6eb8070100 0x7f6eb80b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.083+0000 7f6ebdc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6eb8074350 0x7f6eb80b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.083+0000 7f6ebdc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb80d0bc0 0x7f6eb8156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.083+0000 7f6ebdc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb806faa0 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.083+0000 7f6ebdc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb815ad90 con 0x7f6eb8074350 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.083+0000 7f6ebdc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb806fc20 con 0x7f6eb8070100 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.083+0000 7f6eb7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb80d0bc0 0x7f6eb8156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.083+0000 7f6eb7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb80d0bc0 0x7f6eb8156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46520/0 (socket says 172.21.15.121:46520) 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.083+0000 7f6eb7400640 1 -- 172.21.15.121:0/2830052597 learned_addr learned my addr 172.21.15.121:0/2830052597 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eb6a00640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6eb8070100 0x7f6eb80b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:58.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eb6000640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6eb8074350 0x7f6eb80b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:58.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eb7400640 1 -- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6eb8070100 msgr2=0x7f6eb80b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:58.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eb7400640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6eb8070100 0x7f6eb80b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:58.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eb7400640 1 -- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6eb8074350 msgr2=0x7f6eb80b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:58.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eb7400640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6eb8074350 0x7f6eb80b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:58.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eb7400640 1 -- 172.21.15.121:0/2830052597 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb8152b10 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eb7400640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb80d0bc0 0x7f6eb8156680 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009d90 tx=0x7f6eb0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eaea00640 1 -- 172.21.15.121:0/2830052597 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0033050 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eaea00640 1 -- 172.21.15.121:0/2830052597 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6eb0004450 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.084+0000 7f6eaea00640 1 -- 172.21.15.121:0/2830052597 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0038450 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.085+0000 7f6ebdc00640 1 -- 172.21.15.121:0/2830052597 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb8152df0 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.085+0000 7f6ebdc00640 1 -- 172.21.15.121:0/2830052597 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb809d920 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.086+0000 7f6ebdc00640 1 -- 172.21.15.121:0/2830052597 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb8157ac0 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.087+0000 7f6eaea00640 1 -- 172.21.15.121:0/2830052597 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6eb0036070 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.088+0000 7f6eaea00640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e98078b90 0x7f6e9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:58.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.088+0000 7f6eaea00640 1 -- 172.21.15.121:0/2830052597 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f6eb00bc240 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.088+0000 7f6eb6a00640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e98078b90 0x7f6e9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:58.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.089+0000 7f6eb6a00640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e98078b90 0x7f6e9807b0a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800bb50 tx=0x7f6ea800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:58.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.093+0000 7f6eaea00640 1 -- 172.21.15.121:0/2830052597 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6eb0083e90 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.313+0000 7f6ebdc00640 1 -- 172.21.15.121:0/2830052597 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6eb80cda30 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.894 INFO:tasks.ceph.mds.b.smithi176.stderr:2024-09-17T03:39:58.894+0000 7f39c8000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:39:58.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.940+0000 7f6eaea00640 1 -- 172.21.15.121:0/2830052597 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) ==== 118+0+0 (secure 0 0 0) 0x7f6eb00888c0 con 0x7f6eb80d0bc0 2024-09-17T03:39:58.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 -- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e98078b90 msgr2=0x7f6e9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:58.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e98078b90 0x7f6e9807b0a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800bb50 tx=0x7f6ea800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:39:58.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 -- 172.21.15.121:0/2830052597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb80d0bc0 msgr2=0x7f6eb8156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:58.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb80d0bc0 0x7f6eb8156680 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009d90 tx=0x7f6eb0003f10 comp rx=0 tx=0).stop 2024-09-17T03:39:58.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 -- 172.21.15.121:0/2830052597 shutdown_connections 2024-09-17T03:39:58.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6e98078b90 0x7f6e9807b0a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:58.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb80d0bc0 0x7f6eb8156680 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6eb8074350 0x7f6eb80b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 --2- 172.21.15.121:0/2830052597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6eb8070100 0x7f6eb80b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 -- 172.21.15.121:0/2830052597 >> 172.21.15.121:0/2830052597 conn(0x7f6eb80b3580 msgr2=0x7f6eb806ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 -- 172.21.15.121:0/2830052597 shutdown_connections 2024-09-17T03:39:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:58.943+0000 7f6ebdc00640 1 -- 172.21.15.121:0/2830052597 wait complete. 2024-09-17T03:39:58.966 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:39:58.966 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:39:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.190+0000 7fe8c2600640 1 -- 172.21.15.121:0/2204803767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8bc0d0cc0 msgr2=0x7fe8bc15cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.190+0000 7fe8c2600640 1 --2- 172.21.15.121:0/2204803767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8bc0d0cc0 0x7fe8bc15cc10 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0cdc20 tx=0x7fe8b402a410 comp rx=0 tx=0).stop 2024-09-17T03:39:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.190+0000 7fe8c2600640 1 -- 172.21.15.121:0/2204803767 shutdown_connections 2024-09-17T03:39:59.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.190+0000 7fe8c2600640 1 --2- 172.21.15.121:0/2204803767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8bc0d0cc0 0x7fe8bc15cc10 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.190+0000 7fe8c2600640 1 --2- 172.21.15.121:0/2204803767 >> v2:172.21.15.176:3300/0 conn(0x7fe8bc15a3e0 0x7fe8bc06d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.190+0000 7fe8c2600640 1 -- 172.21.15.121:0/2204803767 >> 172.21.15.121:0/2204803767 conn(0x7fe8bc0b3580 msgr2=0x7fe8bc0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.190+0000 7fe8c2600640 1 -- 172.21.15.121:0/2204803767 shutdown_connections 2024-09-17T03:39:59.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.190+0000 7fe8c2600640 1 -- 172.21.15.121:0/2204803767 wait complete. 2024-09-17T03:39:59.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.192+0000 7fe8c2600640 1 Processor -- start 2024-09-17T03:39:59.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.193+0000 7fe8c2600640 1 -- start start 2024-09-17T03:39:59.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.194+0000 7fe8c2600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc06ddc0 0x7fe8bc1f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.194+0000 7fe8c2600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8bc15a3e0 0x7fe8bc155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.194+0000 7fe8c2600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0c7220 0x7fe8bc158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.194+0000 7fe8c2600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc15d4e0 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.194+0000 7fe8c2600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc15d360 con 0x7fe8bc06ddc0 2024-09-17T03:39:59.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.194+0000 7fe8c2600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe8bc15d660 con 0x7fe8bc0c7220 2024-09-17T03:39:59.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.194+0000 7fe8baa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8bc15a3e0 0x7fe8bc155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8baa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8bc15a3e0 0x7fe8bc155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46528/0 (socket says 172.21.15.121:46528) 2024-09-17T03:39:59.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8baa00640 1 -- 172.21.15.121:0/539369238 learned_addr learned my addr 172.21.15.121:0/539369238 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:39:59.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8bbe00640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0c7220 0x7fe8bc158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8bb400640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc06ddc0 0x7fe8bc1f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8baa00640 1 -- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0c7220 msgr2=0x7fe8bc158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8baa00640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0c7220 0x7fe8bc158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8baa00640 1 -- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc06ddc0 msgr2=0x7fe8bc1f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8baa00640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc06ddc0 0x7fe8bc1f6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8baa00640 1 -- 172.21.15.121:0/539369238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc1f6cc0 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8bbe00640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0c7220 0x7fe8bc158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:59.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8bb400640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc06ddc0 0x7fe8bc1f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:59.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8baa00640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8bc15a3e0 0x7fe8bc155f10 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800c400 tx=0x7fe8a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8b3400640 1 -- 172.21.15.121:0/539369238 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8011790 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8b3400640 1 -- 172.21.15.121:0/539369238 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8a8017070 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.195+0000 7fe8c2600640 1 -- 172.21.15.121:0/539369238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8bc073150 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.196+0000 7fe8b3400640 1 -- 172.21.15.121:0/539369238 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8011cc0 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.196+0000 7fe8c2600640 1 -- 172.21.15.121:0/539369238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8bc073710 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.197+0000 7fe8c2600640 1 -- 172.21.15.121:0/539369238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8bc15ec90 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.198+0000 7fe8b3400640 1 -- 172.21.15.121:0/539369238 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8a801c460 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.199+0000 7fe8b3400640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe89c078b90 0x7fe89c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.199+0000 7fe8b3400640 1 -- 172.21.15.121:0/539369238 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fe8a809ad90 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.200+0000 7fe8bb400640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe89c078b90 0x7fe89c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.200+0000 7fe8bb400640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe89c078b90 0x7fe89c07b0a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac005fd0 tx=0x7fe8ac009480 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.204+0000 7fe8b3400640 1 -- 172.21.15.121:0/539369238 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8a8063060 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.422+0000 7fe8c2600640 1 -- 172.21.15.121:0/539369238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe8bc072ee0 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.946+0000 7fe8b3400640 1 -- 172.21.15.121:0/539369238 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7fe8a8062960 con 0x7fe8bc15a3e0 2024-09-17T03:39:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 -- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe89c078b90 msgr2=0x7fe89c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe89c078b90 0x7fe89c07b0a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac005fd0 tx=0x7fe8ac009480 comp rx=0 tx=0).stop 2024-09-17T03:39:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 -- 172.21.15.121:0/539369238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8bc15a3e0 msgr2=0x7fe8bc155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8bc15a3e0 0x7fe8bc155f10 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800c400 tx=0x7fe8a800c8c0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 -- 172.21.15.121:0/539369238 shutdown_connections 2024-09-17T03:39:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8bc0c7220 0x7fe8bc158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe89c078b90 0x7fe89c07b0a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8bc15a3e0 0x7fe8bc155f10 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 --2- 172.21.15.121:0/539369238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8bc06ddc0 0x7fe8bc1f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 -- 172.21.15.121:0/539369238 >> 172.21.15.121:0/539369238 conn(0x7fe8bc0b3580 msgr2=0x7fe8bc0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 -- 172.21.15.121:0/539369238 shutdown_connections 2024-09-17T03:39:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:39:59.949+0000 7fe8c2600640 1 -- 172.21.15.121:0/539369238 wait complete. 2024-09-17T03:39:59.971 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:39:59.971 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.195+0000 7efeb2600640 1 -- 172.21.15.121:0/271261889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac160890 msgr2=0x7efeac06d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.195+0000 7efeb2600640 1 --2- 172.21.15.121:0/271261889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac160890 0x7efeac06d830 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efea4005fd0 tx=0x7efea402aa90 comp rx=0 tx=0).stop 2024-09-17T03:40:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.195+0000 7efeb2600640 1 -- 172.21.15.121:0/271261889 shutdown_connections 2024-09-17T03:40:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.195+0000 7efeb2600640 1 --2- 172.21.15.121:0/271261889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac160890 0x7efeac06d830 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.195+0000 7efeb2600640 1 --2- 172.21.15.121:0/271261889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeac070810 0x7efeac0b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.195+0000 7efeb2600640 1 -- 172.21.15.121:0/271261889 >> 172.21.15.121:0/271261889 conn(0x7efeac0b2440 msgr2=0x7efeac0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.195+0000 7efeb2600640 1 -- 172.21.15.121:0/271261889 shutdown_connections 2024-09-17T03:40:00.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.195+0000 7efeb2600640 1 -- 172.21.15.121:0/271261889 wait complete. 2024-09-17T03:40:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.198+0000 7efeb2600640 1 Processor -- start 2024-09-17T03:40:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.198+0000 7efeb2600640 1 -- start start 2024-09-17T03:40:00.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.199+0000 7efeb2600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeac070810 0x7efeac0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.199+0000 7efeb2600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0b51c0 0x7efeac0ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.199+0000 7efeb2600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeac0ceaf0 0x7efeac0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.199+0000 7efeb2600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efeac06def0 con 0x7efeac0b51c0 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.199+0000 7efeb2600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efeac06dd70 con 0x7efeac0ceaf0 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.199+0000 7efeb2600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efeac06e070 con 0x7efeac070810 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.199+0000 7efeabe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0b51c0 0x7efeac0ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeabe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0b51c0 0x7efeac0ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46534/0 (socket says 172.21.15.121:46534) 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeabe00640 1 -- 172.21.15.121:0/1189491863 learned_addr learned my addr 172.21.15.121:0/1189491863 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeb1200640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeac070810 0x7efeac0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeb1c00640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeac0ceaf0 0x7efeac0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeabe00640 1 -- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeac070810 msgr2=0x7efeac0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeabe00640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeac070810 0x7efeac0ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeabe00640 1 -- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeac0ceaf0 msgr2=0x7efeac0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeabe00640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeac0ceaf0 0x7efeac0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeabe00640 1 -- 172.21.15.121:0/1189491863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeac1552a0 con 0x7efeac0b51c0 2024-09-17T03:40:00.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeb1c00640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeac0ceaf0 0x7efeac0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:00.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.200+0000 7efeabe00640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0b51c0 0x7efeac0ccad0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c400 tx=0x7efe9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:00.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.201+0000 7efea8c00640 1 -- 172.21.15.121:0/1189491863 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98017070 con 0x7efeac0b51c0 2024-09-17T03:40:00.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.201+0000 7efea8c00640 1 -- 172.21.15.121:0/1189491863 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe980053c0 con 0x7efeac0b51c0 2024-09-17T03:40:00.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.201+0000 7efea8c00640 1 -- 172.21.15.121:0/1189491863 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98003850 con 0x7efeac0b51c0 2024-09-17T03:40:00.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.201+0000 7efeb2600640 1 -- 172.21.15.121:0/1189491863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeac155580 con 0x7efeac0b51c0 2024-09-17T03:40:00.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.201+0000 7efeb2600640 1 -- 172.21.15.121:0/1189491863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeac09baa0 con 0x7efeac0b51c0 2024-09-17T03:40:00.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.202+0000 7efeb2600640 1 -- 172.21.15.121:0/1189491863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeac15fc80 con 0x7efeac0b51c0 2024-09-17T03:40:00.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.203+0000 7efea8c00640 1 -- 172.21.15.121:0/1189491863 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe9801a070 con 0x7efeac0b51c0 2024-09-17T03:40:00.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.204+0000 7efea8c00640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efe8c078bc0 0x7efe8c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.204+0000 7efea8c00640 1 -- 172.21.15.121:0/1189491863 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7efe9809a2c0 con 0x7efeac0b51c0 2024-09-17T03:40:00.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.204+0000 7efeb1200640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efe8c078bc0 0x7efe8c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.205+0000 7efeb1200640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efe8c078bc0 0x7efe8c07b0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efe9c004630 tx=0x7efe9c00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:00.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.208+0000 7efea8c00640 1 -- 172.21.15.121:0/1189491863 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efeac15fc80 con 0x7efeac0b51c0 2024-09-17T03:40:00.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.426+0000 7efeb2600640 1 -- 172.21.15.121:0/1189491863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efeac06e590 con 0x7efeac0b51c0 2024-09-17T03:40:00.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.426+0000 7efea8c00640 1 -- 172.21.15.121:0/1189491863 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7efe98061e80 con 0x7efeac0b51c0 2024-09-17T03:40:00.427 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:00.427 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":68,"btime":"2024-09-17T03:39:59:942558+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3550639124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3550639124},{"type":"v1","addr":"172.21.15.176:6836","nonce":3550639124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/479907239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":479907239},{"type":"v1","addr":"172.21.15.121:6833","nonce":479907239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3992738504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3992738504},{"type":"v1","addr":"172.21.15.121:6835","nonce":3992738504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:56.408137+0000","modified":"2024-09-17T03:39:59.424876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/3841878149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3841878149},{"type":"v1","addr":"172.21.15.176:6837","nonce":3841878149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6768,"qdb_cluster":[6768]},"id":7}]} 2024-09-17T03:40:00.428 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 68 2024-09-17T03:40:00.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 -- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efe8c078bc0 msgr2=0x7efe8c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efe8c078bc0 0x7efe8c07b0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efe9c004630 tx=0x7efe9c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 -- 172.21.15.121:0/1189491863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0b51c0 msgr2=0x7efeac0ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0b51c0 0x7efeac0ccad0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c400 tx=0x7efe9800c8c0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 -- 172.21.15.121:0/1189491863 shutdown_connections 2024-09-17T03:40:00.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeac0ceaf0 0x7efeac0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efe8c078bc0 0x7efe8c07b0d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0b51c0 0x7efeac0ccad0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 --2- 172.21.15.121:0/1189491863 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efeac070810 0x7efeac0ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 -- 172.21.15.121:0/1189491863 >> 172.21.15.121:0/1189491863 conn(0x7efeac0b2440 msgr2=0x7efeac1561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:00.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 -- 172.21.15.121:0/1189491863 shutdown_connections 2024-09-17T03:40:00.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.429+0000 7efeb2600640 1 -- 172.21.15.121:0/1189491863 wait complete. 2024-09-17T03:40:00.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:00.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.673+0000 7f0d9b600640 1 -- 172.21.15.121:0/3736574436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d940ce9e0 msgr2=0x7f0d940d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.673+0000 7f0d9b600640 1 --2- 172.21.15.121:0/3736574436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d940ce9e0 0x7f0d940d0c40 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0d94072960 tx=0x7f0d8002a6c0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.673+0000 7f0d9b600640 1 -- 172.21.15.121:0/3736574436 shutdown_connections 2024-09-17T03:40:00.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.673+0000 7f0d9b600640 1 --2- 172.21.15.121:0/3736574436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d940ce9e0 0x7f0d940d0c40 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.673+0000 7f0d9b600640 1 --2- 172.21.15.121:0/3736574436 >> v2:172.21.15.176:3300/0 conn(0x7f0d940cc270 0x7f0d940d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.673+0000 7f0d9b600640 1 -- 172.21.15.121:0/3736574436 >> 172.21.15.121:0/3736574436 conn(0x7f0d940b3580 msgr2=0x7f0d940b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:00.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.673+0000 7f0d9b600640 1 -- 172.21.15.121:0/3736574436 shutdown_connections 2024-09-17T03:40:00.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.673+0000 7f0d9b600640 1 -- 172.21.15.121:0/3736574436 wait complete. 2024-09-17T03:40:00.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.675+0000 7f0d9b600640 1 Processor -- start 2024-09-17T03:40:00.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.675+0000 7f0d9b600640 1 -- start start 2024-09-17T03:40:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d9b600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d9406cde0 0x7f0d9409de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d9b600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d940cc270 0x7f0d94099800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d9b600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d940ce9e0 0x7f0d940ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d9b600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0d940af950 con 0x7f0d9406cde0 2024-09-17T03:40:00.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d9b600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9406f140 con 0x7f0d940cc270 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d9b600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0d940afad0 con 0x7f0d940ce9e0 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d98c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d9406cde0 0x7f0d9409de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d98c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d9406cde0 0x7f0d9409de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46552/0 (socket says 172.21.15.121:46552) 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d98c00640 1 -- 172.21.15.121:0/661094300 learned_addr learned my addr 172.21.15.121:0/661094300 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d93e00640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d940cc270 0x7f0d94099800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.677+0000 7f0d99600640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d940ce9e0 0x7f0d940ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d98c00640 1 -- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d940ce9e0 msgr2=0x7f0d940ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d98c00640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d940ce9e0 0x7f0d940ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d98c00640 1 -- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d940cc270 msgr2=0x7f0d94099800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d98c00640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d940cc270 0x7f0d94099800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d98c00640 1 -- 172.21.15.121:0/661094300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9409cd60 con 0x7f0d9406cde0 2024-09-17T03:40:00.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d93e00640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d940cc270 0x7f0d94099800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d98c00640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d9406cde0 0x7f0d9409de00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800d740 tx=0x7f0d8800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d90c00640 1 -- 172.21.15.121:0/661094300 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88017070 con 0x7f0d9406cde0 2024-09-17T03:40:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d90c00640 1 -- 172.21.15.121:0/661094300 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d88009d20 con 0x7f0d9406cde0 2024-09-17T03:40:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d9b600640 1 -- 172.21.15.121:0/661094300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9409d040 con 0x7f0d9406cde0 2024-09-17T03:40:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d90c00640 1 -- 172.21.15.121:0/661094300 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d880106c0 con 0x7f0d9406cde0 2024-09-17T03:40:00.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.678+0000 7f0d9b600640 1 -- 172.21.15.121:0/661094300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9409d600 con 0x7f0d9406cde0 2024-09-17T03:40:00.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.679+0000 7f0d9b600640 1 -- 172.21.15.121:0/661094300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9406dac0 con 0x7f0d9406cde0 2024-09-17T03:40:00.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.681+0000 7f0d90c00640 1 -- 172.21.15.121:0/661094300 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d8801a070 con 0x7f0d9406cde0 2024-09-17T03:40:00.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.682+0000 7f0d90c00640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d74078bc0 0x7f0d7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.682+0000 7f0d90c00640 1 -- 172.21.15.121:0/661094300 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f0d8809b320 con 0x7f0d9406cde0 2024-09-17T03:40:00.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.682+0000 7f0d93e00640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d74078bc0 0x7f0d7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.683+0000 7f0d93e00640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d74078bc0 0x7f0d7407b0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0d80033000 tx=0x7f0d80004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:00.686 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.685+0000 7f0d90c00640 1 -- 172.21.15.121:0/661094300 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0d880637d0 con 0x7f0d9406cde0 2024-09-17T03:40:00.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.867+0000 7f0d9b600640 1 -- 172.21.15.121:0/661094300 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d940b18b0 con 0x7f0d9406cde0 2024-09-17T03:40:00.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.868+0000 7f0d90c00640 1 -- 172.21.15.121:0/661094300 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+17009 (secure 0 0 0) 0x7f0d880630d0 con 0x7f0d9406cde0 2024-09-17T03:40:00.869 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:00.869 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":98,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:57.906019+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:39:54.312958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-17T03:39:55.372103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:00.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.870+0000 7f0d9b600640 1 -- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d74078bc0 msgr2=0x7f0d7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.870+0000 7f0d9b600640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d74078bc0 0x7f0d7407b0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0d80033000 tx=0x7f0d80004730 comp rx=0 tx=0).stop 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.870+0000 7f0d9b600640 1 -- 172.21.15.121:0/661094300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d9406cde0 msgr2=0x7f0d9409de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.870+0000 7f0d9b600640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d9406cde0 0x7f0d9409de00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800d740 tx=0x7f0d8800dc00 comp rx=0 tx=0).stop 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.870+0000 7f0d9b600640 1 -- 172.21.15.121:0/661094300 shutdown_connections 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.870+0000 7f0d9b600640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d940ce9e0 0x7f0d940ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.870+0000 7f0d9b600640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d940cc270 0x7f0d94099800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.870+0000 7f0d9b600640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0d74078bc0 0x7f0d7407b0d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.870+0000 7f0d9b600640 1 --2- 172.21.15.121:0/661094300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d9406cde0 0x7f0d9409de00 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.871+0000 7f0d9b600640 1 -- 172.21.15.121:0/661094300 >> 172.21.15.121:0/661094300 conn(0x7f0d940b3580 msgr2=0x7f0d940cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.871+0000 7f0d9b600640 1 -- 172.21.15.121:0/661094300 shutdown_connections 2024-09-17T03:40:00.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:00.871+0000 7f0d9b600640 1 -- 172.21.15.121:0/661094300 wait complete. 2024-09-17T03:40:00.894 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:40:00.894 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:01.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.111+0000 7fd93e000640 1 -- 172.21.15.121:0/3097990590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd93806d800 msgr2=0x7fd9380d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.111+0000 7fd93e000640 1 --2- 172.21.15.121:0/3097990590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd93806d800 0x7fd9380d05b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd924005fd0 tx=0x7fd92402a560 comp rx=0 tx=0).stop 2024-09-17T03:40:01.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.111+0000 7fd93e000640 1 -- 172.21.15.121:0/3097990590 shutdown_connections 2024-09-17T03:40:01.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.111+0000 7fd93e000640 1 --2- 172.21.15.121:0/3097990590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd93806d800 0x7fd9380d05b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.112+0000 7fd93e000640 1 -- 172.21.15.121:0/3097990590 >> 172.21.15.121:0/3097990590 conn(0x7fd9380b3580 msgr2=0x7fd9380b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:01.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.112+0000 7fd93e000640 1 -- 172.21.15.121:0/3097990590 shutdown_connections 2024-09-17T03:40:01.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.112+0000 7fd93e000640 1 -- 172.21.15.121:0/3097990590 wait complete. 2024-09-17T03:40:01.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.114+0000 7fd93e000640 1 Processor -- start 2024-09-17T03:40:01.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.114+0000 7fd93e000640 1 -- start start 2024-09-17T03:40:01.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.115+0000 7fd93e000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd93806d800 0x7fd93815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.115+0000 7fd93e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9380d0af0 0x7fd93815f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.115+0000 7fd93e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd93815a3e0 0x7fd9380736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.115+0000 7fd93e000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd93815d6b0 con 0x7fd9380d0af0 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.115+0000 7fd93e000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd93815d530 con 0x7fd93815a3e0 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.115+0000 7fd93e000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd93815d830 con 0x7fd93806d800 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd936a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9380d0af0 0x7fd93815f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd936a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9380d0af0 0x7fd93815f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46570/0 (socket says 172.21.15.121:46570) 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd936a00640 1 -- 172.21.15.121:0/768966352 learned_addr learned my addr 172.21.15.121:0/768966352 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd937400640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd93806d800 0x7fd93815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd937e00640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd93815a3e0 0x7fd9380736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd936a00640 1 -- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd93806d800 msgr2=0x7fd93815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd936a00640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd93806d800 0x7fd93815f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd936a00640 1 -- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd93815a3e0 msgr2=0x7fd9380736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd936a00640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd93815a3e0 0x7fd9380736b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd936a00640 1 -- 172.21.15.121:0/768966352 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd938153da0 con 0x7fd9380d0af0 2024-09-17T03:40:01.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd937400640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd93806d800 0x7fd93815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:01.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.116+0000 7fd936a00640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9380d0af0 0x7fd93815f850 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd924034040 tx=0x7fd924003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:01.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.117+0000 7fd92f400640 1 -- 172.21.15.121:0/768966352 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92403e030 con 0x7fd9380d0af0 2024-09-17T03:40:01.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.117+0000 7fd92f400640 1 -- 172.21.15.121:0/768966352 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd924003e00 con 0x7fd9380d0af0 2024-09-17T03:40:01.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.117+0000 7fd92f400640 1 -- 172.21.15.121:0/768966352 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924035040 con 0x7fd9380d0af0 2024-09-17T03:40:01.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.117+0000 7fd93e000640 1 -- 172.21.15.121:0/768966352 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd938154080 con 0x7fd9380d0af0 2024-09-17T03:40:01.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.117+0000 7fd93e000640 1 -- 172.21.15.121:0/768966352 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd938155a70 con 0x7fd9380d0af0 2024-09-17T03:40:01.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.118+0000 7fd93e000640 1 -- 172.21.15.121:0/768966352 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd938159bb0 con 0x7fd9380d0af0 2024-09-17T03:40:01.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.119+0000 7fd92f400640 1 -- 172.21.15.121:0/768966352 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd924041030 con 0x7fd9380d0af0 2024-09-17T03:40:01.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.120+0000 7fd92f400640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd918078bc0 0x7fd91807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.120+0000 7fd92f400640 1 -- 172.21.15.121:0/768966352 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fd9240bb670 con 0x7fd9380d0af0 2024-09-17T03:40:01.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.120+0000 7fd937400640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd918078bc0 0x7fd91807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.121+0000 7fd937400640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd918078bc0 0x7fd91807b0d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd928007fd0 tx=0x7fd928009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:01.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.124+0000 7fd92f400640 1 -- 172.21.15.121:0/768966352 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd924083360 con 0x7fd9380d0af0 2024-09-17T03:40:01.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.305+0000 7fd93e000640 1 -- 172.21.15.121:0/768966352 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9380ce990 con 0x7fd918078bc0 2024-09-17T03:40:01.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.310+0000 7fd92f400640 1 -- 172.21.15.121:0/768966352 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242372 (secure 0 0 0) 0x7fd9380ce990 con 0x7fd918078bc0 2024-09-17T03:40:01.314 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:01.315 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:40:01.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 -- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd918078bc0 msgr2=0x7fd91807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd918078bc0 0x7fd91807b0d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd928007fd0 tx=0x7fd928009040 comp rx=0 tx=0).stop 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 -- 172.21.15.121:0/768966352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9380d0af0 msgr2=0x7fd93815f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9380d0af0 0x7fd93815f850 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd924034040 tx=0x7fd924003910 comp rx=0 tx=0).stop 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 -- 172.21.15.121:0/768966352 shutdown_connections 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd93815a3e0 0x7fd9380736b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd918078bc0 0x7fd91807b0d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9380d0af0 0x7fd93815f850 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 --2- 172.21.15.121:0/768966352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd93806d800 0x7fd93815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 -- 172.21.15.121:0/768966352 >> 172.21.15.121:0/768966352 conn(0x7fd9380b3580 msgr2=0x7fd9380ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 -- 172.21.15.121:0/768966352 shutdown_connections 2024-09-17T03:40:01.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.314+0000 7fd93e000640 1 -- 172.21.15.121:0/768966352 wait complete. 2024-09-17T03:40:01.340 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-17T03:39:59.346864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":94,"acting":94,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259832,"kb_used_data":10292,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714888,"statfs":{"total":773094113280,"available":772828045312,"internally_reserved":0,"allocated":10539008,"data_stored":5427464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.447462"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.950021+0000","last_change":"2024-09-17T03:39:56.934758+0000","last_active":"2024-09-17T03:39:56.950021+0000","last_peered":"2024-09-17T03:39:56.950021+0000","last_clean":"2024-09-17T03:39:56.950021+0000","last_became_active":"2024-09-17T03:39:56.933789+0000","last_became_peered":"2024-09-17T03:39:56.933789+0000","last_unstale":"2024-09-17T03:39:56.950021+0000","last_undegraded":"2024-09-17T03:39:56.950021+0000","last_fullsized":"2024-09-17T03:39:56.950021+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:50.482550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.947811+0000","last_change":"2024-09-17T03:39:56.928969+0000","last_active":"2024-09-17T03:39:56.947811+0000","last_peered":"2024-09-17T03:39:56.947811+0000","last_clean":"2024-09-17T03:39:56.947811+0000","last_became_active":"2024-09-17T03:39:56.925800+0000","last_became_peered":"2024-09-17T03:39:56.925800+0000","last_unstale":"2024-09-17T03:39:56.947811+0000","last_undegraded":"2024-09-17T03:39:56.947811+0000","last_fullsized":"2024-09-17T03:39:56.947811+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:04.610212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.951396+0000","last_change":"2024-09-17T03:39:56.935132+0000","last_active":"2024-09-17T03:39:56.951396+0000","last_peered":"2024-09-17T03:39:56.951396+0000","last_clean":"2024-09-17T03:39:56.951396+0000","last_became_active":"2024-09-17T03:39:56.934799+0000","last_became_peered":"2024-09-17T03:39:56.934799+0000","last_unstale":"2024-09-17T03:39:56.951396+0000","last_undegraded":"2024-09-17T03:39:56.951396+0000","last_fullsized":"2024-09-17T03:39:56.951396+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:16.895957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.950016+0000","last_change":"2024-09-17T03:39:56.934368+0000","last_active":"2024-09-17T03:39:56.950016+0000","last_peered":"2024-09-17T03:39:56.950016+0000","last_clean":"2024-09-17T03:39:56.950016+0000","last_became_active":"2024-09-17T03:39:56.933485+0000","last_became_peered":"2024-09-17T03:39:56.933485+0000","last_unstale":"2024-09-17T03:39:56.950016+0000","last_undegraded":"2024-09-17T03:39:56.950016+0000","last_fullsized":"2024-09-17T03:39:56.950016+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:43.231818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.949933+0000","last_change":"2024-09-17T03:39:56.931889+0000","last_active":"2024-09-17T03:39:56.949933+0000","last_peered":"2024-09-17T03:39:56.949933+0000","last_clean":"2024-09-17T03:39:56.949933+0000","last_became_active":"2024-09-17T03:39:56.931556+0000","last_became_peered":"2024-09-17T03:39:56.931556+0000","last_unstale":"2024-09-17T03:39:56.949933+0000","last_undegraded":"2024-09-17T03:39:56.949933+0000","last_fullsized":"2024-09-17T03:39:56.949933+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:15.668687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.907960+0000","last_change":"2024-09-17T03:39:54.907960+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.907960+0000","last_undegraded":"2024-09-17T03:39:54.907960+0000","last_fullsized":"2024-09-17T03:39:54.907960+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.905693+0000","last_change":"2024-09-17T03:39:54.905693+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.905693+0000","last_undegraded":"2024-09-17T03:39:54.905693+0000","last_fullsized":"2024-09-17T03:39:54.905693+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.905136+0000","last_change":"2024-09-17T03:39:54.905136+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.905136+0000","last_undegraded":"2024-09-17T03:39:54.905136+0000","last_fullsized":"2024-09-17T03:39:54.905136+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.903556+0000","last_change":"2024-09-17T03:39:54.903556+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.903556+0000","last_undegraded":"2024-09-17T03:39:54.903556+0000","last_fullsized":"2024-09-17T03:39:54.903556+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.951331+0000","last_change":"2024-09-17T03:39:56.935075+0000","last_active":"2024-09-17T03:39:56.951331+0000","last_peered":"2024-09-17T03:39:56.951331+0000","last_clean":"2024-09-17T03:39:56.951331+0000","last_became_active":"2024-09-17T03:39:56.934788+0000","last_became_peered":"2024-09-17T03:39:56.934788+0000","last_unstale":"2024-09-17T03:39:56.951331+0000","last_undegraded":"2024-09-17T03:39:56.951331+0000","last_fullsized":"2024-09-17T03:39:56.951331+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:41.961769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.908717+0000","last_change":"2024-09-17T03:39:54.908717+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.908717+0000","last_undegraded":"2024-09-17T03:39:54.908717+0000","last_fullsized":"2024-09-17T03:39:54.908717+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.949964+0000","last_change":"2024-09-17T03:39:56.933557+0000","last_active":"2024-09-17T03:39:56.949964+0000","last_peered":"2024-09-17T03:39:56.949964+0000","last_clean":"2024-09-17T03:39:56.949964+0000","last_became_active":"2024-09-17T03:39:56.932995+0000","last_became_peered":"2024-09-17T03:39:56.932995+0000","last_unstale":"2024-09-17T03:39:56.949964+0000","last_undegraded":"2024-09-17T03:39:56.949964+0000","last_fullsized":"2024-09-17T03:39:56.949964+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:10.019014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.903333+0000","last_change":"2024-09-17T03:39:54.903333+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.903333+0000","last_undegraded":"2024-09-17T03:39:54.903333+0000","last_fullsized":"2024-09-17T03:39:54.903333+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.905074+0000","last_change":"2024-09-17T03:39:54.905074+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.905074+0000","last_undegraded":"2024-09-17T03:39:54.905074+0000","last_fullsized":"2024-09-17T03:39:54.905074+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.951684+0000","last_change":"2024-09-17T03:39:56.942772+0000","last_active":"2024-09-17T03:39:56.951684+0000","last_peered":"2024-09-17T03:39:56.951684+0000","last_clean":"2024-09-17T03:39:56.951684+0000","last_became_active":"2024-09-17T03:39:56.941892+0000","last_became_peered":"2024-09-17T03:39:56.941892+0000","last_unstale":"2024-09-17T03:39:56.951684+0000","last_undegraded":"2024-09-17T03:39:56.951684+0000","last_fullsized":"2024-09-17T03:39:56.951684+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:12.494943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.908193+0000","last_change":"2024-09-17T03:39:54.908193+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.908193+0000","last_undegraded":"2024-09-17T03:39:54.908193+0000","last_fullsized":"2024-09-17T03:39:54.908193+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.949537+0000","last_change":"2024-09-17T03:39:56.930922+0000","last_active":"2024-09-17T03:39:56.949537+0000","last_peered":"2024-09-17T03:39:56.949537+0000","last_clean":"2024-09-17T03:39:56.949537+0000","last_became_active":"2024-09-17T03:39:56.930581+0000","last_became_peered":"2024-09-17T03:39:56.930581+0000","last_unstale":"2024-09-17T03:39:56.949537+0000","last_undegraded":"2024-09-17T03:39:56.949537+0000","last_fullsized":"2024-09-17T03:39:56.949537+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:28.075400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.901353+0000","last_change":"2024-09-17T03:39:54.901353+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.901353+0000","last_undegraded":"2024-09-17T03:39:54.901353+0000","last_fullsized":"2024-09-17T03:39:54.901353+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.954412+0000","last_change":"2024-09-17T03:39:56.948173+0000","last_active":"2024-09-17T03:39:56.954412+0000","last_peered":"2024-09-17T03:39:56.954412+0000","last_clean":"2024-09-17T03:39:56.954412+0000","last_became_active":"2024-09-17T03:39:56.947135+0000","last_became_peered":"2024-09-17T03:39:56.947135+0000","last_unstale":"2024-09-17T03:39:56.954412+0000","last_undegraded":"2024-09-17T03:39:56.954412+0000","last_fullsized":"2024-09-17T03:39:56.954412+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:31.221871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.903458+0000","last_change":"2024-09-17T03:39:54.903458+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.903458+0000","last_undegraded":"2024-09-17T03:39:54.903458+0000","last_fullsized":"2024-09-17T03:39:54.903458+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.900675+0000","last_change":"2024-09-17T03:39:54.900675+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.900675+0000","last_undegraded":"2024-09-17T03:39:54.900675+0000","last_fullsized":"2024-09-17T03:39:54.900675+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.907793+0000","last_change":"2024-09-17T03:39:54.907793+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.907793+0000","last_undegraded":"2024-09-17T03:39:54.907793+0000","last_fullsized":"2024-09-17T03:39:54.907793+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.951806+0000","last_change":"2024-09-17T03:39:55.932184+0000","last_active":"2024-09-17T03:39:56.951806+0000","last_peered":"2024-09-17T03:39:56.951806+0000","last_clean":"2024-09-17T03:39:56.951806+0000","last_became_active":"2024-09-17T03:39:55.931597+0000","last_became_peered":"2024-09-17T03:39:55.931597+0000","last_unstale":"2024-09-17T03:39:56.951806+0000","last_undegraded":"2024-09-17T03:39:56.951806+0000","last_fullsized":"2024-09-17T03:39:56.951806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:13.509683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.902261+0000","last_change":"2024-09-17T03:39:54.902261+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.902261+0000","last_undegraded":"2024-09-17T03:39:54.902261+0000","last_fullsized":"2024-09-17T03:39:54.902261+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.920934+0000","last_change":"2024-09-17T03:39:55.920645+0000","last_active":"2024-09-17T03:39:56.920934+0000","last_peered":"2024-09-17T03:39:56.920934+0000","last_clean":"2024-09-17T03:39:56.920934+0000","last_became_active":"2024-09-17T03:39:55.920323+0000","last_became_peered":"2024-09-17T03:39:55.920323+0000","last_unstale":"2024-09-17T03:39:56.920934+0000","last_undegraded":"2024-09-17T03:39:56.920934+0000","last_fullsized":"2024-09-17T03:39:56.920934+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:30.476028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.907797+0000","last_change":"2024-09-17T03:39:54.907797+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.907797+0000","last_undegraded":"2024-09-17T03:39:54.907797+0000","last_fullsized":"2024-09-17T03:39:54.907797+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.900615+0000","last_change":"2024-09-17T03:39:54.900615+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.900615+0000","last_undegraded":"2024-09-17T03:39:54.900615+0000","last_fullsized":"2024-09-17T03:39:54.900615+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.904378+0000","last_change":"2024-09-17T03:39:54.904378+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.904378+0000","last_undegraded":"2024-09-17T03:39:54.904378+0000","last_fullsized":"2024-09-17T03:39:54.904378+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.900700+0000","last_change":"2024-09-17T03:39:54.900700+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.900700+0000","last_undegraded":"2024-09-17T03:39:54.900700+0000","last_fullsized":"2024-09-17T03:39:54.900700+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.952046+0000","last_change":"2024-09-17T03:39:56.944358+0000","last_active":"2024-09-17T03:39:56.952046+0000","last_peered":"2024-09-17T03:39:56.952046+0000","last_clean":"2024-09-17T03:39:56.952046+0000","last_became_active":"2024-09-17T03:39:56.943968+0000","last_became_peered":"2024-09-17T03:39:56.943968+0000","last_unstale":"2024-09-17T03:39:56.952046+0000","last_undegraded":"2024-09-17T03:39:56.952046+0000","last_fullsized":"2024-09-17T03:39:56.952046+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:11.633345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.904687+0000","last_change":"2024-09-17T03:39:54.904687+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.904687+0000","last_undegraded":"2024-09-17T03:39:54.904687+0000","last_fullsized":"2024-09-17T03:39:54.904687+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.906955+0000","last_change":"2024-09-17T03:39:54.906955+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.906955+0000","last_undegraded":"2024-09-17T03:39:54.906955+0000","last_fullsized":"2024-09-17T03:39:54.906955+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.900704+0000","last_change":"2024-09-17T03:39:54.900704+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.900704+0000","last_undegraded":"2024-09-17T03:39:54.900704+0000","last_fullsized":"2024-09-17T03:39:54.900704+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.951564+0000","last_change":"2024-09-17T03:39:56.943282+0000","last_active":"2024-09-17T03:39:56.951564+0000","last_peered":"2024-09-17T03:39:56.951564+0000","last_clean":"2024-09-17T03:39:56.951564+0000","last_became_active":"2024-09-17T03:39:56.942296+0000","last_became_peered":"2024-09-17T03:39:56.942296+0000","last_unstale":"2024-09-17T03:39:56.951564+0000","last_undegraded":"2024-09-17T03:39:56.951564+0000","last_fullsized":"2024-09-17T03:39:56.951564+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:39.836016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.902268+0000","last_change":"2024-09-17T03:39:54.902268+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.902268+0000","last_undegraded":"2024-09-17T03:39:54.902268+0000","last_fullsized":"2024-09-17T03:39:54.902268+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.905955+0000","last_change":"2024-09-17T03:39:54.905955+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.905955+0000","last_undegraded":"2024-09-17T03:39:54.905955+0000","last_fullsized":"2024-09-17T03:39:54.905955+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.904732+0000","last_change":"2024-09-17T03:39:54.904732+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.904732+0000","last_undegraded":"2024-09-17T03:39:54.904732+0000","last_fullsized":"2024-09-17T03:39:54.904732+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.907980+0000","last_change":"2024-09-17T03:39:54.907980+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.907980+0000","last_undegraded":"2024-09-17T03:39:54.907980+0000","last_fullsized":"2024-09-17T03:39:54.907980+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.921038+0000","last_change":"2024-09-17T03:39:55.930825+0000","last_active":"2024-09-17T03:39:56.921038+0000","last_peered":"2024-09-17T03:39:56.921038+0000","last_clean":"2024-09-17T03:39:56.921038+0000","last_became_active":"2024-09-17T03:39:55.930384+0000","last_became_peered":"2024-09-17T03:39:55.930384+0000","last_unstale":"2024-09-17T03:39:56.921038+0000","last_undegraded":"2024-09-17T03:39:56.921038+0000","last_fullsized":"2024-09-17T03:39:56.921038+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:19.433730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.952075+0000","last_change":"2024-09-17T03:39:56.945252+0000","last_active":"2024-09-17T03:39:56.952075+0000","last_peered":"2024-09-17T03:39:56.952075+0000","last_clean":"2024-09-17T03:39:56.952075+0000","last_became_active":"2024-09-17T03:39:56.944923+0000","last_became_peered":"2024-09-17T03:39:56.944923+0000","last_unstale":"2024-09-17T03:39:56.952075+0000","last_undegraded":"2024-09-17T03:39:56.952075+0000","last_fullsized":"2024-09-17T03:39:56.952075+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:41.053563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.907863+0000","last_change":"2024-09-17T03:39:54.907863+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.907863+0000","last_undegraded":"2024-09-17T03:39:54.907863+0000","last_fullsized":"2024-09-17T03:39:54.907863+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.954346+0000","last_change":"2024-09-17T03:39:56.947693+0000","last_active":"2024-09-17T03:39:56.954346+0000","last_peered":"2024-09-17T03:39:56.954346+0000","last_clean":"2024-09-17T03:39:56.954346+0000","last_became_active":"2024-09-17T03:39:56.947225+0000","last_became_peered":"2024-09-17T03:39:56.947225+0000","last_unstale":"2024-09-17T03:39:56.954346+0000","last_undegraded":"2024-09-17T03:39:56.954346+0000","last_fullsized":"2024-09-17T03:39:56.954346+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:38.938550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.906448+0000","last_change":"2024-09-17T03:39:54.906448+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.906448+0000","last_undegraded":"2024-09-17T03:39:54.906448+0000","last_fullsized":"2024-09-17T03:39:54.906448+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.903113+0000","last_change":"2024-09-17T03:39:54.903113+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.903113+0000","last_undegraded":"2024-09-17T03:39:54.903113+0000","last_fullsized":"2024-09-17T03:39:54.903113+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-17T03:39:54.904985+0000","last_change":"2024-09-17T03:39:54.904985+0000","last_active":"2024-09-17T03:39:54.894457+0000","last_peered":"2024-09-17T03:39:54.894457+0000","last_clean":"2024-09-17T03:39:54.894457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:54.904985+0000","last_undegraded":"2024-09-17T03:39:54.904985+0000","last_fullsized":"2024-09-17T03:39:54.904985+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:39:55.896949+0000","last_change":"2024-09-17T03:39:55.896949+0000","last_active":"2024-09-17T03:39:55.896949+0000","last_peered":"2024-09-17T03:39:55.896949+0000","last_clean":"2024-09-17T03:39:55.896949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:39:55.896949+0000","last_undegraded":"2024-09-17T03:39:55.896949+0000","last_fullsized":"2024-09-17T03:39:55.896949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.949182+0000","last_change":"2024-09-17T03:39:55.926985+0000","last_active":"2024-09-17T03:39:56.949182+0000","last_peered":"2024-09-17T03:39:56.949182+0000","last_clean":"2024-09-17T03:39:56.949182+0000","last_became_active":"2024-09-17T03:39:55.926661+0000","last_became_peered":"2024-09-17T03:39:55.926661+0000","last_unstale":"2024-09-17T03:39:56.949182+0000","last_undegraded":"2024-09-17T03:39:56.949182+0000","last_fullsized":"2024-09-17T03:39:56.949182+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:55.867796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":249,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:39:54.905408+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:39:54.905408+0000","last_peered":"2024-09-17T03:39:54.905408+0000","last_clean":"2024-09-17T03:39:54.905408+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:39:54.905408+0000","last_undegraded":"2024-09-17T03:39:54.905408+0000","last_fullsized":"2024-09-17T03:39:54.905408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":28,"acting":28,"num_store_stats":1},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":526003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1159168,"data_stored":526003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509497,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1753088,"data_stored":1116371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1159168,"data_stored":526003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1171456,"data_stored":532212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1765376,"data_stored":1122580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1171456,"data_stored":532212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1200128,"data_stored":546080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:01.344 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:01.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.600+0000 7f2664600640 1 -- 172.21.15.121:0/3168958491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f26440040b0 msgr2=0x7f2644004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.600+0000 7f2664600640 1 --2- 172.21.15.121:0/3168958491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f26440040b0 0x7f2644004800 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f265c072680 tx=0x7f2644005830 comp rx=0 tx=0).stop 2024-09-17T03:40:01.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.600+0000 7f2662600640 1 -- 172.21.15.121:0/3168958491 reap_dead start 2024-09-17T03:40:01.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.601+0000 7f2664600640 1 -- 172.21.15.121:0/3168958491 shutdown_connections 2024-09-17T03:40:01.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.601+0000 7f2664600640 1 -- 172.21.15.121:0/3168958491 >> 172.21.15.121:0/3168958491 conn(0x7f265c0b3580 msgr2=0x7f265c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:01.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.601+0000 7f2664600640 1 -- 172.21.15.121:0/3168958491 shutdown_connections 2024-09-17T03:40:01.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.601+0000 7f2664600640 1 -- 172.21.15.121:0/3168958491 wait complete. 2024-09-17T03:40:01.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.603+0000 7f2664600640 1 Processor -- start 2024-09-17T03:40:01.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.603+0000 7f2664600640 1 -- start start 2024-09-17T03:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2664600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26440040b0 0x7f265c1f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2664600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f265c1e6050 0x7f265c1e6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2664600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f265c1e69a0 0x7f265c1e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2664600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f265c06db90 con 0x7f265c1e6050 2024-09-17T03:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2664600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f265c06da10 con 0x7f265c1e69a0 2024-09-17T03:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2664600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f265c1611c0 con 0x7f26440040b0 2024-09-17T03:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2661200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f265c1e6050 0x7f265c1e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2661200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f265c1e6050 0x7f265c1e6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46590/0 (socket says 172.21.15.121:46590) 2024-09-17T03:40:01.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2661200640 1 -- 172.21.15.121:0/222330407 learned_addr learned my addr 172.21.15.121:0/222330407 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:01.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2661200640 1 -- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26440040b0 msgr2=0x7f265c1f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2661200640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26440040b0 0x7f265c1f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2661200640 1 -- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f265c1e69a0 msgr2=0x7f265c1e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2661200640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f265c1e69a0 0x7f265c1e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2661200640 1 -- 172.21.15.121:0/222330407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265c1f2f40 con 0x7f265c1e6050 2024-09-17T03:40:01.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.605+0000 7f2661200640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f265c1e6050 0x7f265c1e6460 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f2648031040 tx=0x7f2648001110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.606+0000 7f2659600640 1 -- 172.21.15.121:0/222330407 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648032030 con 0x7f265c1e6050 2024-09-17T03:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.606+0000 7f2659600640 1 -- 172.21.15.121:0/222330407 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26480038e0 con 0x7f265c1e6050 2024-09-17T03:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.606+0000 7f2664600640 1 -- 172.21.15.121:0/222330407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265c1f6530 con 0x7f265c1e6050 2024-09-17T03:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.606+0000 7f2659600640 1 -- 172.21.15.121:0/222330407 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648003cf0 con 0x7f265c1e6050 2024-09-17T03:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.606+0000 7f2664600640 1 -- 172.21.15.121:0/222330407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f265c1f34e0 con 0x7f265c1e6050 2024-09-17T03:40:01.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.607+0000 7f2664600640 1 -- 172.21.15.121:0/222330407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f265c15cc10 con 0x7f265c1e6050 2024-09-17T03:40:01.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.608+0000 7f2659600640 1 -- 172.21.15.121:0/222330407 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2648035020 con 0x7f265c1e6050 2024-09-17T03:40:01.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.609+0000 7f2659600640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f263c078bc0 0x7f263c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.609+0000 7f2659600640 1 -- 172.21.15.121:0/222330407 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f26480bb3b0 con 0x7f265c1e6050 2024-09-17T03:40:01.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.610+0000 7f2661c00640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f263c078bc0 0x7f263c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.610+0000 7f2661c00640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f263c078bc0 0x7f263c07b0d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2650009ab0 tx=0x7f2650009390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:01.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.613+0000 7f2659600640 1 -- 172.21.15.121:0/222330407 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f26480836d0 con 0x7f265c1e6050 2024-09-17T03:40:01.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.793+0000 7f2664600640 1 -- 172.21.15.121:0/222330407 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f265c1f6760 con 0x7f263c078bc0 2024-09-17T03:40:01.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.799+0000 7f2659600640 1 -- 172.21.15.121:0/222330407 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252078 (secure 0 0 0) 0x7f265c1f6760 con 0x7f263c078bc0 2024-09-17T03:40:01.802 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:01.803 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:40:01.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 -- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f263c078bc0 msgr2=0x7f263c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f263c078bc0 0x7f263c07b0d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2650009ab0 tx=0x7f2650009390 comp rx=0 tx=0).stop 2024-09-17T03:40:01.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 -- 172.21.15.121:0/222330407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f265c1e6050 msgr2=0x7f265c1e6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f265c1e6050 0x7f265c1e6460 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f2648031040 tx=0x7f2648001110 comp rx=0 tx=0).stop 2024-09-17T03:40:01.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 -- 172.21.15.121:0/222330407 shutdown_connections 2024-09-17T03:40:01.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f265c1e69a0 0x7f265c1e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f263c078bc0 0x7f263c07b0d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f265c1e6050 0x7f265c1e6460 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 --2- 172.21.15.121:0/222330407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26440040b0 0x7f265c1f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 -- 172.21.15.121:0/222330407 >> 172.21.15.121:0/222330407 conn(0x7f265c0b3580 msgr2=0x7f265c155e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:01.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 -- 172.21.15.121:0/222330407 shutdown_connections 2024-09-17T03:40:01.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:01.803+0000 7f2664600640 1 -- 172.21.15.121:0/222330407 wait complete. 2024-09-17T03:40:01.829 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-17T03:40:01.347390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260196,"kb_used_data":10652,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714524,"statfs":{"total":773094113280,"available":772827672576,"internally_reserved":0,"allocated":10907648,"data_stored":5600768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001374"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.950021+0000","last_change":"2024-09-17T03:39:56.934758+0000","last_active":"2024-09-17T03:39:56.950021+0000","last_peered":"2024-09-17T03:39:56.950021+0000","last_clean":"2024-09-17T03:39:56.950021+0000","last_became_active":"2024-09-17T03:39:56.933789+0000","last_became_peered":"2024-09-17T03:39:56.933789+0000","last_unstale":"2024-09-17T03:39:56.950021+0000","last_undegraded":"2024-09-17T03:39:56.950021+0000","last_fullsized":"2024-09-17T03:39:56.950021+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:50.482550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467487+0000","last_change":"2024-09-17T03:39:56.928438+0000","last_active":"2024-09-17T03:39:58.467487+0000","last_peered":"2024-09-17T03:39:58.467487+0000","last_clean":"2024-09-17T03:39:58.467487+0000","last_became_active":"2024-09-17T03:39:56.927628+0000","last_became_peered":"2024-09-17T03:39:56.927628+0000","last_unstale":"2024-09-17T03:39:58.467487+0000","last_undegraded":"2024-09-17T03:39:58.467487+0000","last_fullsized":"2024-09-17T03:39:58.467487+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:33.114973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467031+0000","last_change":"2024-09-17T03:39:56.938113+0000","last_active":"2024-09-17T03:39:58.467031+0000","last_peered":"2024-09-17T03:39:58.467031+0000","last_clean":"2024-09-17T03:39:58.467031+0000","last_became_active":"2024-09-17T03:39:56.936904+0000","last_became_peered":"2024-09-17T03:39:56.936904+0000","last_unstale":"2024-09-17T03:39:58.467031+0000","last_undegraded":"2024-09-17T03:39:58.467031+0000","last_fullsized":"2024-09-17T03:39:58.467031+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:37.891702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.947811+0000","last_change":"2024-09-17T03:39:56.928969+0000","last_active":"2024-09-17T03:39:56.947811+0000","last_peered":"2024-09-17T03:39:56.947811+0000","last_clean":"2024-09-17T03:39:56.947811+0000","last_became_active":"2024-09-17T03:39:56.925800+0000","last_became_peered":"2024-09-17T03:39:56.925800+0000","last_unstale":"2024-09-17T03:39:56.947811+0000","last_undegraded":"2024-09-17T03:39:56.947811+0000","last_fullsized":"2024-09-17T03:39:56.947811+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:04.610212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.951396+0000","last_change":"2024-09-17T03:39:56.935132+0000","last_active":"2024-09-17T03:39:56.951396+0000","last_peered":"2024-09-17T03:39:56.951396+0000","last_clean":"2024-09-17T03:39:56.951396+0000","last_became_active":"2024-09-17T03:39:56.934799+0000","last_became_peered":"2024-09-17T03:39:56.934799+0000","last_unstale":"2024-09-17T03:39:56.951396+0000","last_undegraded":"2024-09-17T03:39:56.951396+0000","last_fullsized":"2024-09-17T03:39:56.951396+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:16.895957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467404+0000","last_change":"2024-09-17T03:39:56.936667+0000","last_active":"2024-09-17T03:39:58.467404+0000","last_peered":"2024-09-17T03:39:58.467404+0000","last_clean":"2024-09-17T03:39:58.467404+0000","last_became_active":"2024-09-17T03:39:56.936345+0000","last_became_peered":"2024-09-17T03:39:56.936345+0000","last_unstale":"2024-09-17T03:39:58.467404+0000","last_undegraded":"2024-09-17T03:39:58.467404+0000","last_fullsized":"2024-09-17T03:39:58.467404+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:58.172696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466958+0000","last_change":"2024-09-17T03:39:56.931427+0000","last_active":"2024-09-17T03:39:58.466958+0000","last_peered":"2024-09-17T03:39:58.466958+0000","last_clean":"2024-09-17T03:39:58.466958+0000","last_became_active":"2024-09-17T03:39:56.931149+0000","last_became_peered":"2024-09-17T03:39:56.931149+0000","last_unstale":"2024-09-17T03:39:58.466958+0000","last_undegraded":"2024-09-17T03:39:58.466958+0000","last_fullsized":"2024-09-17T03:39:58.466958+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:00.919024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.914130+0000","last_change":"2024-09-17T03:39:56.942945+0000","last_active":"2024-09-17T03:39:57.914130+0000","last_peered":"2024-09-17T03:39:57.914130+0000","last_clean":"2024-09-17T03:39:57.914130+0000","last_became_active":"2024-09-17T03:39:56.942609+0000","last_became_peered":"2024-09-17T03:39:56.942609+0000","last_unstale":"2024-09-17T03:39:57.914130+0000","last_undegraded":"2024-09-17T03:39:57.914130+0000","last_fullsized":"2024-09-17T03:39:57.914130+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:41.311060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467677+0000","last_change":"2024-09-17T03:39:56.924829+0000","last_active":"2024-09-17T03:39:58.467677+0000","last_peered":"2024-09-17T03:39:58.467677+0000","last_clean":"2024-09-17T03:39:58.467677+0000","last_became_active":"2024-09-17T03:39:56.924338+0000","last_became_peered":"2024-09-17T03:39:56.924338+0000","last_unstale":"2024-09-17T03:39:58.467677+0000","last_undegraded":"2024-09-17T03:39:58.467677+0000","last_fullsized":"2024-09-17T03:39:58.467677+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:41.439109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.914188+0000","last_change":"2024-09-17T03:39:56.948253+0000","last_active":"2024-09-17T03:39:57.914188+0000","last_peered":"2024-09-17T03:39:57.914188+0000","last_clean":"2024-09-17T03:39:57.914188+0000","last_became_active":"2024-09-17T03:39:56.947935+0000","last_became_peered":"2024-09-17T03:39:56.947935+0000","last_unstale":"2024-09-17T03:39:57.914188+0000","last_undegraded":"2024-09-17T03:39:57.914188+0000","last_fullsized":"2024-09-17T03:39:57.914188+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:04.287892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.913156+0000","last_change":"2024-09-17T03:39:56.928381+0000","last_active":"2024-09-17T03:39:57.913156+0000","last_peered":"2024-09-17T03:39:57.913156+0000","last_clean":"2024-09-17T03:39:57.913156+0000","last_became_active":"2024-09-17T03:39:56.928028+0000","last_became_peered":"2024-09-17T03:39:56.928028+0000","last_unstale":"2024-09-17T03:39:57.913156+0000","last_undegraded":"2024-09-17T03:39:57.913156+0000","last_fullsized":"2024-09-17T03:39:57.913156+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:05.621617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467631+0000","last_change":"2024-09-17T03:39:56.943679+0000","last_active":"2024-09-17T03:39:58.467631+0000","last_peered":"2024-09-17T03:39:58.467631+0000","last_clean":"2024-09-17T03:39:58.467631+0000","last_became_active":"2024-09-17T03:39:56.943195+0000","last_became_peered":"2024-09-17T03:39:56.943195+0000","last_unstale":"2024-09-17T03:39:58.467631+0000","last_undegraded":"2024-09-17T03:39:58.467631+0000","last_fullsized":"2024-09-17T03:39:58.467631+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:04.432192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.950016+0000","last_change":"2024-09-17T03:39:56.934368+0000","last_active":"2024-09-17T03:39:56.950016+0000","last_peered":"2024-09-17T03:39:56.950016+0000","last_clean":"2024-09-17T03:39:56.950016+0000","last_became_active":"2024-09-17T03:39:56.933485+0000","last_became_peered":"2024-09-17T03:39:56.933485+0000","last_unstale":"2024-09-17T03:39:56.950016+0000","last_undegraded":"2024-09-17T03:39:56.950016+0000","last_fullsized":"2024-09-17T03:39:56.950016+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:43.231818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467335+0000","last_change":"2024-09-17T03:39:56.944779+0000","last_active":"2024-09-17T03:39:58.467335+0000","last_peered":"2024-09-17T03:39:58.467335+0000","last_clean":"2024-09-17T03:39:58.467335+0000","last_became_active":"2024-09-17T03:39:56.941919+0000","last_became_peered":"2024-09-17T03:39:56.941919+0000","last_unstale":"2024-09-17T03:39:58.467335+0000","last_undegraded":"2024-09-17T03:39:58.467335+0000","last_fullsized":"2024-09-17T03:39:58.467335+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:32.133352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466283+0000","last_change":"2024-09-17T03:39:56.924596+0000","last_active":"2024-09-17T03:39:58.466283+0000","last_peered":"2024-09-17T03:39:58.466283+0000","last_clean":"2024-09-17T03:39:58.466283+0000","last_became_active":"2024-09-17T03:39:56.924226+0000","last_became_peered":"2024-09-17T03:39:56.924226+0000","last_unstale":"2024-09-17T03:39:58.466283+0000","last_undegraded":"2024-09-17T03:39:58.466283+0000","last_fullsized":"2024-09-17T03:39:58.466283+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:27.109074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466538+0000","last_change":"2024-09-17T03:39:56.935435+0000","last_active":"2024-09-17T03:39:58.466538+0000","last_peered":"2024-09-17T03:39:58.466538+0000","last_clean":"2024-09-17T03:39:58.466538+0000","last_became_active":"2024-09-17T03:39:56.934943+0000","last_became_peered":"2024-09-17T03:39:56.934943+0000","last_unstale":"2024-09-17T03:39:58.466538+0000","last_undegraded":"2024-09-17T03:39:58.466538+0000","last_fullsized":"2024-09-17T03:39:58.466538+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:10.993629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467144+0000","last_change":"2024-09-17T03:39:56.938467+0000","last_active":"2024-09-17T03:39:58.467144+0000","last_peered":"2024-09-17T03:39:58.467144+0000","last_clean":"2024-09-17T03:39:58.467144+0000","last_became_active":"2024-09-17T03:39:56.937478+0000","last_became_peered":"2024-09-17T03:39:56.937478+0000","last_unstale":"2024-09-17T03:39:58.467144+0000","last_undegraded":"2024-09-17T03:39:58.467144+0000","last_fullsized":"2024-09-17T03:39:58.467144+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:22.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467620+0000","last_change":"2024-09-17T03:39:56.925545+0000","last_active":"2024-09-17T03:39:58.467620+0000","last_peered":"2024-09-17T03:39:58.467620+0000","last_clean":"2024-09-17T03:39:58.467620+0000","last_became_active":"2024-09-17T03:39:56.924714+0000","last_became_peered":"2024-09-17T03:39:56.924714+0000","last_unstale":"2024-09-17T03:39:58.467620+0000","last_undegraded":"2024-09-17T03:39:58.467620+0000","last_fullsized":"2024-09-17T03:39:58.467620+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:36.660095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.949933+0000","last_change":"2024-09-17T03:39:56.931889+0000","last_active":"2024-09-17T03:39:56.949933+0000","last_peered":"2024-09-17T03:39:56.949933+0000","last_clean":"2024-09-17T03:39:56.949933+0000","last_became_active":"2024-09-17T03:39:56.931556+0000","last_became_peered":"2024-09-17T03:39:56.931556+0000","last_unstale":"2024-09-17T03:39:56.949933+0000","last_undegraded":"2024-09-17T03:39:56.949933+0000","last_fullsized":"2024-09-17T03:39:56.949933+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:15.668687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466950+0000","last_change":"2024-09-17T03:39:56.931789+0000","last_active":"2024-09-17T03:39:58.466950+0000","last_peered":"2024-09-17T03:39:58.466950+0000","last_clean":"2024-09-17T03:39:58.466950+0000","last_became_active":"2024-09-17T03:39:56.931432+0000","last_became_peered":"2024-09-17T03:39:56.931432+0000","last_unstale":"2024-09-17T03:39:58.466950+0000","last_undegraded":"2024-09-17T03:39:58.466950+0000","last_fullsized":"2024-09-17T03:39:58.466950+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:59.655895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466874+0000","last_change":"2024-09-17T03:39:56.948157+0000","last_active":"2024-09-17T03:39:58.466874+0000","last_peered":"2024-09-17T03:39:58.466874+0000","last_clean":"2024-09-17T03:39:58.466874+0000","last_became_active":"2024-09-17T03:39:56.947734+0000","last_became_peered":"2024-09-17T03:39:56.947734+0000","last_unstale":"2024-09-17T03:39:58.466874+0000","last_undegraded":"2024-09-17T03:39:58.466874+0000","last_fullsized":"2024-09-17T03:39:58.466874+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:15.237291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.284221+0000","last_change":"2024-09-17T03:39:56.932761+0000","last_active":"2024-09-17T03:39:58.284221+0000","last_peered":"2024-09-17T03:39:58.284221+0000","last_clean":"2024-09-17T03:39:58.284221+0000","last_became_active":"2024-09-17T03:39:56.932401+0000","last_became_peered":"2024-09-17T03:39:56.932401+0000","last_unstale":"2024-09-17T03:39:58.284221+0000","last_undegraded":"2024-09-17T03:39:58.284221+0000","last_fullsized":"2024-09-17T03:39:58.284221+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:52.342805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.914742+0000","last_change":"2024-09-17T03:39:56.941056+0000","last_active":"2024-09-17T03:39:57.914742+0000","last_peered":"2024-09-17T03:39:57.914742+0000","last_clean":"2024-09-17T03:39:57.914742+0000","last_became_active":"2024-09-17T03:39:56.939796+0000","last_became_peered":"2024-09-17T03:39:56.939796+0000","last_unstale":"2024-09-17T03:39:57.914742+0000","last_undegraded":"2024-09-17T03:39:57.914742+0000","last_fullsized":"2024-09-17T03:39:57.914742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:27.470506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.913626+0000","last_change":"2024-09-17T03:39:56.945346+0000","last_active":"2024-09-17T03:39:57.913626+0000","last_peered":"2024-09-17T03:39:57.913626+0000","last_clean":"2024-09-17T03:39:57.913626+0000","last_became_active":"2024-09-17T03:39:56.944917+0000","last_became_peered":"2024-09-17T03:39:56.944917+0000","last_unstale":"2024-09-17T03:39:57.913626+0000","last_undegraded":"2024-09-17T03:39:57.913626+0000","last_fullsized":"2024-09-17T03:39:57.913626+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:04.432192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.468166+0000","last_change":"2024-09-17T03:39:56.927159+0000","last_active":"2024-09-17T03:39:58.468166+0000","last_peered":"2024-09-17T03:39:58.468166+0000","last_clean":"2024-09-17T03:39:58.468166+0000","last_became_active":"2024-09-17T03:39:56.926882+0000","last_became_peered":"2024-09-17T03:39:56.926882+0000","last_unstale":"2024-09-17T03:39:58.468166+0000","last_undegraded":"2024-09-17T03:39:58.468166+0000","last_fullsized":"2024-09-17T03:39:58.468166+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:30.864273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.468084+0000","last_change":"2024-09-17T03:39:56.934936+0000","last_active":"2024-09-17T03:39:58.468084+0000","last_peered":"2024-09-17T03:39:58.468084+0000","last_clean":"2024-09-17T03:39:58.468084+0000","last_became_active":"2024-09-17T03:39:56.930465+0000","last_became_peered":"2024-09-17T03:39:56.930465+0000","last_unstale":"2024-09-17T03:39:58.468084+0000","last_undegraded":"2024-09-17T03:39:58.468084+0000","last_fullsized":"2024-09-17T03:39:58.468084+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:14.908622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467524+0000","last_change":"2024-09-17T03:39:56.926089+0000","last_active":"2024-09-17T03:39:58.467524+0000","last_peered":"2024-09-17T03:39:58.467524+0000","last_clean":"2024-09-17T03:39:58.467524+0000","last_became_active":"2024-09-17T03:39:56.925807+0000","last_became_peered":"2024-09-17T03:39:56.925807+0000","last_unstale":"2024-09-17T03:39:58.467524+0000","last_undegraded":"2024-09-17T03:39:58.467524+0000","last_fullsized":"2024-09-17T03:39:58.467524+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:59.233124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467659+0000","last_change":"2024-09-17T03:39:56.937626+0000","last_active":"2024-09-17T03:39:58.467659+0000","last_peered":"2024-09-17T03:39:58.467659+0000","last_clean":"2024-09-17T03:39:58.467659+0000","last_became_active":"2024-09-17T03:39:56.932647+0000","last_became_peered":"2024-09-17T03:39:56.932647+0000","last_unstale":"2024-09-17T03:39:58.467659+0000","last_undegraded":"2024-09-17T03:39:58.467659+0000","last_fullsized":"2024-09-17T03:39:58.467659+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:50.143374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.915357+0000","last_change":"2024-09-17T03:39:56.943500+0000","last_active":"2024-09-17T03:39:57.915357+0000","last_peered":"2024-09-17T03:39:57.915357+0000","last_clean":"2024-09-17T03:39:57.915357+0000","last_became_active":"2024-09-17T03:39:56.943136+0000","last_became_peered":"2024-09-17T03:39:56.943136+0000","last_unstale":"2024-09-17T03:39:57.915357+0000","last_undegraded":"2024-09-17T03:39:57.915357+0000","last_fullsized":"2024-09-17T03:39:57.915357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:33.229500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.912757+0000","last_change":"2024-09-17T03:39:56.938332+0000","last_active":"2024-09-17T03:39:57.912757+0000","last_peered":"2024-09-17T03:39:57.912757+0000","last_clean":"2024-09-17T03:39:57.912757+0000","last_became_active":"2024-09-17T03:39:56.937997+0000","last_became_peered":"2024-09-17T03:39:56.937997+0000","last_unstale":"2024-09-17T03:39:57.912757+0000","last_undegraded":"2024-09-17T03:39:57.912757+0000","last_fullsized":"2024-09-17T03:39:57.912757+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:09.155810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467015+0000","last_change":"2024-09-17T03:39:56.942383+0000","last_active":"2024-09-17T03:39:58.467015+0000","last_peered":"2024-09-17T03:39:58.467015+0000","last_clean":"2024-09-17T03:39:58.467015+0000","last_became_active":"2024-09-17T03:39:56.939051+0000","last_became_peered":"2024-09-17T03:39:56.939051+0000","last_unstale":"2024-09-17T03:39:58.467015+0000","last_undegraded":"2024-09-17T03:39:58.467015+0000","last_fullsized":"2024-09-17T03:39:58.467015+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:52.784396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.284272+0000","last_change":"2024-09-17T03:39:56.931147+0000","last_active":"2024-09-17T03:39:58.284272+0000","last_peered":"2024-09-17T03:39:58.284272+0000","last_clean":"2024-09-17T03:39:58.284272+0000","last_became_active":"2024-09-17T03:39:56.930786+0000","last_became_peered":"2024-09-17T03:39:56.930786+0000","last_unstale":"2024-09-17T03:39:58.284272+0000","last_undegraded":"2024-09-17T03:39:58.284272+0000","last_fullsized":"2024-09-17T03:39:58.284272+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:27.109074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466876+0000","last_change":"2024-09-17T03:39:56.935396+0000","last_active":"2024-09-17T03:39:58.466876+0000","last_peered":"2024-09-17T03:39:58.466876+0000","last_clean":"2024-09-17T03:39:58.466876+0000","last_became_active":"2024-09-17T03:39:56.935074+0000","last_became_peered":"2024-09-17T03:39:56.935074+0000","last_unstale":"2024-09-17T03:39:58.466876+0000","last_undegraded":"2024-09-17T03:39:58.466876+0000","last_fullsized":"2024-09-17T03:39:58.466876+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:20.073039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":19,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.284511+0000","last_change":"2024-09-17T03:39:55.924020+0000","last_active":"2024-09-17T03:39:58.284511+0000","last_peered":"2024-09-17T03:39:58.284511+0000","last_clean":"2024-09-17T03:39:58.284511+0000","last_became_active":"2024-09-17T03:39:55.923524+0000","last_became_peered":"2024-09-17T03:39:55.923524+0000","last_unstale":"2024-09-17T03:39:58.284511+0000","last_undegraded":"2024-09-17T03:39:58.284511+0000","last_fullsized":"2024-09-17T03:39:58.284511+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:13.728169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.914988+0000","last_change":"2024-09-17T03:39:56.940345+0000","last_active":"2024-09-17T03:39:57.914988+0000","last_peered":"2024-09-17T03:39:57.914988+0000","last_clean":"2024-09-17T03:39:57.914988+0000","last_became_active":"2024-09-17T03:39:56.939764+0000","last_became_peered":"2024-09-17T03:39:56.939764+0000","last_unstale":"2024-09-17T03:39:57.914988+0000","last_undegraded":"2024-09-17T03:39:57.914988+0000","last_fullsized":"2024-09-17T03:39:57.914988+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:10.604630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466805+0000","last_change":"2024-09-17T03:39:55.933893+0000","last_active":"2024-09-17T03:39:58.466805+0000","last_peered":"2024-09-17T03:39:58.466805+0000","last_clean":"2024-09-17T03:39:58.466805+0000","last_became_active":"2024-09-17T03:39:55.933383+0000","last_became_peered":"2024-09-17T03:39:55.933383+0000","last_unstale":"2024-09-17T03:39:58.466805+0000","last_undegraded":"2024-09-17T03:39:58.466805+0000","last_fullsized":"2024-09-17T03:39:58.466805+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:41.970071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466196+0000","last_change":"2024-09-17T03:39:56.942808+0000","last_active":"2024-09-17T03:39:58.466196+0000","last_peered":"2024-09-17T03:39:58.466196+0000","last_clean":"2024-09-17T03:39:58.466196+0000","last_became_active":"2024-09-17T03:39:56.942549+0000","last_became_peered":"2024-09-17T03:39:56.942549+0000","last_unstale":"2024-09-17T03:39:58.466196+0000","last_undegraded":"2024-09-17T03:39:58.466196+0000","last_fullsized":"2024-09-17T03:39:58.466196+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:20.755379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467138+0000","last_change":"2024-09-17T03:39:55.929544+0000","last_active":"2024-09-17T03:39:58.467138+0000","last_peered":"2024-09-17T03:39:58.467138+0000","last_clean":"2024-09-17T03:39:58.467138+0000","last_became_active":"2024-09-17T03:39:55.927882+0000","last_became_peered":"2024-09-17T03:39:55.927882+0000","last_unstale":"2024-09-17T03:39:58.467138+0000","last_undegraded":"2024-09-17T03:39:58.467138+0000","last_fullsized":"2024-09-17T03:39:58.467138+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:42.905970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.912681+0000","last_change":"2024-09-17T03:39:56.932934+0000","last_active":"2024-09-17T03:39:57.912681+0000","last_peered":"2024-09-17T03:39:57.912681+0000","last_clean":"2024-09-17T03:39:57.912681+0000","last_became_active":"2024-09-17T03:39:56.932631+0000","last_became_peered":"2024-09-17T03:39:56.932631+0000","last_unstale":"2024-09-17T03:39:57.912681+0000","last_undegraded":"2024-09-17T03:39:57.912681+0000","last_fullsized":"2024-09-17T03:39:57.912681+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:36.279401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.915111+0000","last_change":"2024-09-17T03:39:55.926105+0000","last_active":"2024-09-17T03:39:57.915111+0000","last_peered":"2024-09-17T03:39:57.915111+0000","last_clean":"2024-09-17T03:39:57.915111+0000","last_became_active":"2024-09-17T03:39:55.925740+0000","last_became_peered":"2024-09-17T03:39:55.925740+0000","last_unstale":"2024-09-17T03:39:57.915111+0000","last_undegraded":"2024-09-17T03:39:57.915111+0000","last_fullsized":"2024-09-17T03:39:57.915111+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:05.221356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.951331+0000","last_change":"2024-09-17T03:39:56.935075+0000","last_active":"2024-09-17T03:39:56.951331+0000","last_peered":"2024-09-17T03:39:56.951331+0000","last_clean":"2024-09-17T03:39:56.951331+0000","last_became_active":"2024-09-17T03:39:56.934788+0000","last_became_peered":"2024-09-17T03:39:56.934788+0000","last_unstale":"2024-09-17T03:39:56.951331+0000","last_undegraded":"2024-09-17T03:39:56.951331+0000","last_fullsized":"2024-09-17T03:39:56.951331+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:41.961769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.912595+0000","last_change":"2024-09-17T03:39:55.931151+0000","last_active":"2024-09-17T03:39:57.912595+0000","last_peered":"2024-09-17T03:39:57.912595+0000","last_clean":"2024-09-17T03:39:57.912595+0000","last_became_active":"2024-09-17T03:39:55.930814+0000","last_became_peered":"2024-09-17T03:39:55.930814+0000","last_unstale":"2024-09-17T03:39:57.912595+0000","last_undegraded":"2024-09-17T03:39:57.912595+0000","last_fullsized":"2024-09-17T03:39:57.912595+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:47.811911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.949964+0000","last_change":"2024-09-17T03:39:56.933557+0000","last_active":"2024-09-17T03:39:56.949964+0000","last_peered":"2024-09-17T03:39:56.949964+0000","last_clean":"2024-09-17T03:39:56.949964+0000","last_became_active":"2024-09-17T03:39:56.932995+0000","last_became_peered":"2024-09-17T03:39:56.932995+0000","last_unstale":"2024-09-17T03:39:56.949964+0000","last_undegraded":"2024-09-17T03:39:56.949964+0000","last_fullsized":"2024-09-17T03:39:56.949964+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:10.019014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"97'1","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466672+0000","last_change":"2024-09-17T03:39:55.930721+0000","last_active":"2024-09-17T03:39:58.466672+0000","last_peered":"2024-09-17T03:39:58.466672+0000","last_clean":"2024-09-17T03:39:58.466672+0000","last_became_active":"2024-09-17T03:39:55.930396+0000","last_became_peered":"2024-09-17T03:39:55.930396+0000","last_unstale":"2024-09-17T03:39:58.466672+0000","last_undegraded":"2024-09-17T03:39:58.466672+0000","last_fullsized":"2024-09-17T03:39:58.466672+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:10.258321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.913231+0000","last_change":"2024-09-17T03:39:56.939491+0000","last_active":"2024-09-17T03:39:57.913231+0000","last_peered":"2024-09-17T03:39:57.913231+0000","last_clean":"2024-09-17T03:39:57.913231+0000","last_became_active":"2024-09-17T03:39:56.939182+0000","last_became_peered":"2024-09-17T03:39:56.939182+0000","last_unstale":"2024-09-17T03:39:57.913231+0000","last_undegraded":"2024-09-17T03:39:57.913231+0000","last_fullsized":"2024-09-17T03:39:57.913231+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:29.627513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466965+0000","last_change":"2024-09-17T03:39:55.931452+0000","last_active":"2024-09-17T03:39:58.466965+0000","last_peered":"2024-09-17T03:39:58.466965+0000","last_clean":"2024-09-17T03:39:58.466965+0000","last_became_active":"2024-09-17T03:39:55.931131+0000","last_became_peered":"2024-09-17T03:39:55.931131+0000","last_unstale":"2024-09-17T03:39:58.466965+0000","last_undegraded":"2024-09-17T03:39:58.466965+0000","last_fullsized":"2024-09-17T03:39:58.466965+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:53.834049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.951684+0000","last_change":"2024-09-17T03:39:56.942772+0000","last_active":"2024-09-17T03:39:56.951684+0000","last_peered":"2024-09-17T03:39:56.951684+0000","last_clean":"2024-09-17T03:39:56.951684+0000","last_became_active":"2024-09-17T03:39:56.941892+0000","last_became_peered":"2024-09-17T03:39:56.941892+0000","last_unstale":"2024-09-17T03:39:56.951684+0000","last_undegraded":"2024-09-17T03:39:56.951684+0000","last_fullsized":"2024-09-17T03:39:56.951684+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:12.494943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.284389+0000","last_change":"2024-09-17T03:39:55.917275+0000","last_active":"2024-09-17T03:39:58.284389+0000","last_peered":"2024-09-17T03:39:58.284389+0000","last_clean":"2024-09-17T03:39:58.284389+0000","last_became_active":"2024-09-17T03:39:55.916930+0000","last_became_peered":"2024-09-17T03:39:55.916930+0000","last_unstale":"2024-09-17T03:39:58.284389+0000","last_undegraded":"2024-09-17T03:39:58.284389+0000","last_fullsized":"2024-09-17T03:39:58.284389+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:17.838918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.949537+0000","last_change":"2024-09-17T03:39:56.930922+0000","last_active":"2024-09-17T03:39:56.949537+0000","last_peered":"2024-09-17T03:39:56.949537+0000","last_clean":"2024-09-17T03:39:56.949537+0000","last_became_active":"2024-09-17T03:39:56.930581+0000","last_became_peered":"2024-09-17T03:39:56.930581+0000","last_unstale":"2024-09-17T03:39:56.949537+0000","last_undegraded":"2024-09-17T03:39:56.949537+0000","last_fullsized":"2024-09-17T03:39:56.949537+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:28.075400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.468117+0000","last_change":"2024-09-17T03:39:55.927086+0000","last_active":"2024-09-17T03:39:58.468117+0000","last_peered":"2024-09-17T03:39:58.468117+0000","last_clean":"2024-09-17T03:39:58.468117+0000","last_became_active":"2024-09-17T03:39:55.926790+0000","last_became_peered":"2024-09-17T03:39:55.926790+0000","last_unstale":"2024-09-17T03:39:58.468117+0000","last_undegraded":"2024-09-17T03:39:58.468117+0000","last_fullsized":"2024-09-17T03:39:58.468117+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:53.834049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.954412+0000","last_change":"2024-09-17T03:39:56.948173+0000","last_active":"2024-09-17T03:39:56.954412+0000","last_peered":"2024-09-17T03:39:56.954412+0000","last_clean":"2024-09-17T03:39:56.954412+0000","last_became_active":"2024-09-17T03:39:56.947135+0000","last_became_peered":"2024-09-17T03:39:56.947135+0000","last_unstale":"2024-09-17T03:39:56.954412+0000","last_undegraded":"2024-09-17T03:39:56.954412+0000","last_fullsized":"2024-09-17T03:39:56.954412+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:31.221871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.913990+0000","last_change":"2024-09-17T03:39:55.933162+0000","last_active":"2024-09-17T03:39:57.913990+0000","last_peered":"2024-09-17T03:39:57.913990+0000","last_clean":"2024-09-17T03:39:57.913990+0000","last_became_active":"2024-09-17T03:39:55.931934+0000","last_became_peered":"2024-09-17T03:39:55.931934+0000","last_unstale":"2024-09-17T03:39:57.913990+0000","last_undegraded":"2024-09-17T03:39:57.913990+0000","last_fullsized":"2024-09-17T03:39:57.913990+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:17.652354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.914629+0000","last_change":"2024-09-17T03:39:56.952538+0000","last_active":"2024-09-17T03:39:57.914629+0000","last_peered":"2024-09-17T03:39:57.914629+0000","last_clean":"2024-09-17T03:39:57.914629+0000","last_became_active":"2024-09-17T03:39:56.951859+0000","last_became_peered":"2024-09-17T03:39:56.951859+0000","last_unstale":"2024-09-17T03:39:57.914629+0000","last_undegraded":"2024-09-17T03:39:57.914629+0000","last_fullsized":"2024-09-17T03:39:57.914629+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:18.569564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467787+0000","last_change":"2024-09-17T03:39:55.926603+0000","last_active":"2024-09-17T03:39:58.467787+0000","last_peered":"2024-09-17T03:39:58.467787+0000","last_clean":"2024-09-17T03:39:58.467787+0000","last_became_active":"2024-09-17T03:39:55.926307+0000","last_became_peered":"2024-09-17T03:39:55.926307+0000","last_unstale":"2024-09-17T03:39:58.467787+0000","last_undegraded":"2024-09-17T03:39:58.467787+0000","last_fullsized":"2024-09-17T03:39:58.467787+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:17.069489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.284603+0000","last_change":"2024-09-17T03:39:56.934361+0000","last_active":"2024-09-17T03:39:58.284603+0000","last_peered":"2024-09-17T03:39:58.284603+0000","last_clean":"2024-09-17T03:39:58.284603+0000","last_became_active":"2024-09-17T03:39:56.933990+0000","last_became_peered":"2024-09-17T03:39:56.933990+0000","last_unstale":"2024-09-17T03:39:58.284603+0000","last_undegraded":"2024-09-17T03:39:58.284603+0000","last_fullsized":"2024-09-17T03:39:58.284603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:41.439109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":21,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.912860+0000","last_change":"2024-09-17T03:39:55.928647+0000","last_active":"2024-09-17T03:39:57.912860+0000","last_peered":"2024-09-17T03:39:57.912860+0000","last_clean":"2024-09-17T03:39:57.912860+0000","last_became_active":"2024-09-17T03:39:55.928324+0000","last_became_peered":"2024-09-17T03:39:55.928324+0000","last_unstale":"2024-09-17T03:39:57.912860+0000","last_undegraded":"2024-09-17T03:39:57.912860+0000","last_fullsized":"2024-09-17T03:39:57.912860+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:00.606127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466725+0000","last_change":"2024-09-17T03:39:56.935014+0000","last_active":"2024-09-17T03:39:58.466725+0000","last_peered":"2024-09-17T03:39:58.466725+0000","last_clean":"2024-09-17T03:39:58.466725+0000","last_became_active":"2024-09-17T03:39:56.934720+0000","last_became_peered":"2024-09-17T03:39:56.934720+0000","last_unstale":"2024-09-17T03:39:58.466725+0000","last_undegraded":"2024-09-17T03:39:58.466725+0000","last_fullsized":"2024-09-17T03:39:58.466725+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:00.793938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.951806+0000","last_change":"2024-09-17T03:39:55.932184+0000","last_active":"2024-09-17T03:39:56.951806+0000","last_peered":"2024-09-17T03:39:56.951806+0000","last_clean":"2024-09-17T03:39:56.951806+0000","last_became_active":"2024-09-17T03:39:55.931597+0000","last_became_peered":"2024-09-17T03:39:55.931597+0000","last_unstale":"2024-09-17T03:39:56.951806+0000","last_undegraded":"2024-09-17T03:39:56.951806+0000","last_fullsized":"2024-09-17T03:39:56.951806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:13.509683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467266+0000","last_change":"2024-09-17T03:39:56.939408+0000","last_active":"2024-09-17T03:39:58.467266+0000","last_peered":"2024-09-17T03:39:58.467266+0000","last_clean":"2024-09-17T03:39:58.467266+0000","last_became_active":"2024-09-17T03:39:56.939135+0000","last_became_peered":"2024-09-17T03:39:56.939135+0000","last_unstale":"2024-09-17T03:39:58.467266+0000","last_undegraded":"2024-09-17T03:39:58.467266+0000","last_fullsized":"2024-09-17T03:39:58.467266+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:46.883527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.914702+0000","last_change":"2024-09-17T03:39:55.925289+0000","last_active":"2024-09-17T03:39:57.914702+0000","last_peered":"2024-09-17T03:39:57.914702+0000","last_clean":"2024-09-17T03:39:57.914702+0000","last_became_active":"2024-09-17T03:39:55.924906+0000","last_became_peered":"2024-09-17T03:39:55.924906+0000","last_unstale":"2024-09-17T03:39:57.914702+0000","last_undegraded":"2024-09-17T03:39:57.914702+0000","last_fullsized":"2024-09-17T03:39:57.914702+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:11.232505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.284521+0000","last_change":"2024-09-17T03:39:56.932433+0000","last_active":"2024-09-17T03:39:58.284521+0000","last_peered":"2024-09-17T03:39:58.284521+0000","last_clean":"2024-09-17T03:39:58.284521+0000","last_became_active":"2024-09-17T03:39:56.930879+0000","last_became_peered":"2024-09-17T03:39:56.930879+0000","last_unstale":"2024-09-17T03:39:58.284521+0000","last_undegraded":"2024-09-17T03:39:58.284521+0000","last_fullsized":"2024-09-17T03:39:58.284521+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:33.114973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.920934+0000","last_change":"2024-09-17T03:39:55.920645+0000","last_active":"2024-09-17T03:39:56.920934+0000","last_peered":"2024-09-17T03:39:56.920934+0000","last_clean":"2024-09-17T03:39:56.920934+0000","last_became_active":"2024-09-17T03:39:55.920323+0000","last_became_peered":"2024-09-17T03:39:55.920323+0000","last_unstale":"2024-09-17T03:39:56.920934+0000","last_undegraded":"2024-09-17T03:39:56.920934+0000","last_fullsized":"2024-09-17T03:39:56.920934+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:30.476028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467195+0000","last_change":"2024-09-17T03:39:56.937786+0000","last_active":"2024-09-17T03:39:58.467195+0000","last_peered":"2024-09-17T03:39:58.467195+0000","last_clean":"2024-09-17T03:39:58.467195+0000","last_became_active":"2024-09-17T03:39:56.937033+0000","last_became_peered":"2024-09-17T03:39:56.937033+0000","last_unstale":"2024-09-17T03:39:58.467195+0000","last_undegraded":"2024-09-17T03:39:58.467195+0000","last_fullsized":"2024-09-17T03:39:58.467195+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:02.741555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":23,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.912511+0000","last_change":"2024-09-17T03:39:55.927377+0000","last_active":"2024-09-17T03:39:57.912511+0000","last_peered":"2024-09-17T03:39:57.912511+0000","last_clean":"2024-09-17T03:39:57.912511+0000","last_became_active":"2024-09-17T03:39:55.927091+0000","last_became_peered":"2024-09-17T03:39:55.927091+0000","last_unstale":"2024-09-17T03:39:57.912511+0000","last_undegraded":"2024-09-17T03:39:57.912511+0000","last_fullsized":"2024-09-17T03:39:57.912511+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:25.247700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.913870+0000","last_change":"2024-09-17T03:39:56.938853+0000","last_active":"2024-09-17T03:39:57.913870+0000","last_peered":"2024-09-17T03:39:57.913870+0000","last_clean":"2024-09-17T03:39:57.913870+0000","last_became_active":"2024-09-17T03:39:56.938495+0000","last_became_peered":"2024-09-17T03:39:56.938495+0000","last_unstale":"2024-09-17T03:39:57.913870+0000","last_undegraded":"2024-09-17T03:39:57.913870+0000","last_fullsized":"2024-09-17T03:39:57.913870+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:50.143374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.468181+0000","last_change":"2024-09-17T03:39:55.931956+0000","last_active":"2024-09-17T03:39:58.468181+0000","last_peered":"2024-09-17T03:39:58.468181+0000","last_clean":"2024-09-17T03:39:58.468181+0000","last_became_active":"2024-09-17T03:39:55.931572+0000","last_became_peered":"2024-09-17T03:39:55.931572+0000","last_unstale":"2024-09-17T03:39:58.468181+0000","last_undegraded":"2024-09-17T03:39:58.468181+0000","last_fullsized":"2024-09-17T03:39:58.468181+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:14.173537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466596+0000","last_change":"2024-09-17T03:39:56.932704+0000","last_active":"2024-09-17T03:39:58.466596+0000","last_peered":"2024-09-17T03:39:58.466596+0000","last_clean":"2024-09-17T03:39:58.466596+0000","last_became_active":"2024-09-17T03:39:56.932422+0000","last_became_peered":"2024-09-17T03:39:56.932422+0000","last_unstale":"2024-09-17T03:39:58.466596+0000","last_undegraded":"2024-09-17T03:39:58.466596+0000","last_fullsized":"2024-09-17T03:39:58.466596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:22.968169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467616+0000","last_change":"2024-09-17T03:39:55.930049+0000","last_active":"2024-09-17T03:39:58.467616+0000","last_peered":"2024-09-17T03:39:58.467616+0000","last_clean":"2024-09-17T03:39:58.467616+0000","last_became_active":"2024-09-17T03:39:55.929754+0000","last_became_peered":"2024-09-17T03:39:55.929754+0000","last_unstale":"2024-09-17T03:39:58.467616+0000","last_undegraded":"2024-09-17T03:39:58.467616+0000","last_fullsized":"2024-09-17T03:39:58.467616+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:14.173537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.284429+0000","last_change":"2024-09-17T03:39:56.944054+0000","last_active":"2024-09-17T03:39:58.284429+0000","last_peered":"2024-09-17T03:39:58.284429+0000","last_clean":"2024-09-17T03:39:58.284429+0000","last_became_active":"2024-09-17T03:39:56.943738+0000","last_became_peered":"2024-09-17T03:39:56.943738+0000","last_unstale":"2024-09-17T03:39:58.284429+0000","last_undegraded":"2024-09-17T03:39:58.284429+0000","last_fullsized":"2024-09-17T03:39:58.284429+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:46.883527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467704+0000","last_change":"2024-09-17T03:39:55.925635+0000","last_active":"2024-09-17T03:39:58.467704+0000","last_peered":"2024-09-17T03:39:58.467704+0000","last_clean":"2024-09-17T03:39:58.467704+0000","last_became_active":"2024-09-17T03:39:55.925297+0000","last_became_peered":"2024-09-17T03:39:55.925297+0000","last_unstale":"2024-09-17T03:39:58.467704+0000","last_undegraded":"2024-09-17T03:39:58.467704+0000","last_fullsized":"2024-09-17T03:39:58.467704+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:44.418027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.952046+0000","last_change":"2024-09-17T03:39:56.944358+0000","last_active":"2024-09-17T03:39:56.952046+0000","last_peered":"2024-09-17T03:39:56.952046+0000","last_clean":"2024-09-17T03:39:56.952046+0000","last_became_active":"2024-09-17T03:39:56.943968+0000","last_became_peered":"2024-09-17T03:39:56.943968+0000","last_unstale":"2024-09-17T03:39:56.952046+0000","last_undegraded":"2024-09-17T03:39:56.952046+0000","last_fullsized":"2024-09-17T03:39:56.952046+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:11.633345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466987+0000","last_change":"2024-09-17T03:39:55.928488+0000","last_active":"2024-09-17T03:39:58.466987+0000","last_peered":"2024-09-17T03:39:58.466987+0000","last_clean":"2024-09-17T03:39:58.466987+0000","last_became_active":"2024-09-17T03:39:55.928004+0000","last_became_peered":"2024-09-17T03:39:55.928004+0000","last_unstale":"2024-09-17T03:39:58.466987+0000","last_undegraded":"2024-09-17T03:39:58.466987+0000","last_fullsized":"2024-09-17T03:39:58.466987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:28.402497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.284564+0000","last_change":"2024-09-17T03:39:56.938279+0000","last_active":"2024-09-17T03:39:58.284564+0000","last_peered":"2024-09-17T03:39:58.284564+0000","last_clean":"2024-09-17T03:39:58.284564+0000","last_became_active":"2024-09-17T03:39:56.937894+0000","last_became_peered":"2024-09-17T03:39:56.937894+0000","last_unstale":"2024-09-17T03:39:58.284564+0000","last_undegraded":"2024-09-17T03:39:58.284564+0000","last_fullsized":"2024-09-17T03:39:58.284564+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:36.660095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466554+0000","last_change":"2024-09-17T03:39:55.931903+0000","last_active":"2024-09-17T03:39:58.466554+0000","last_peered":"2024-09-17T03:39:58.466554+0000","last_clean":"2024-09-17T03:39:58.466554+0000","last_became_active":"2024-09-17T03:39:55.931573+0000","last_became_peered":"2024-09-17T03:39:55.931573+0000","last_unstale":"2024-09-17T03:39:58.466554+0000","last_undegraded":"2024-09-17T03:39:58.466554+0000","last_fullsized":"2024-09-17T03:39:58.466554+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:35.657602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.284319+0000","last_change":"2024-09-17T03:39:56.936276+0000","last_active":"2024-09-17T03:39:58.284319+0000","last_peered":"2024-09-17T03:39:58.284319+0000","last_clean":"2024-09-17T03:39:58.284319+0000","last_became_active":"2024-09-17T03:39:56.934051+0000","last_became_peered":"2024-09-17T03:39:56.934051+0000","last_unstale":"2024-09-17T03:39:58.284319+0000","last_undegraded":"2024-09-17T03:39:58.284319+0000","last_fullsized":"2024-09-17T03:39:58.284319+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:00.793938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467088+0000","last_change":"2024-09-17T03:39:55.929310+0000","last_active":"2024-09-17T03:39:58.467088+0000","last_peered":"2024-09-17T03:39:58.467088+0000","last_clean":"2024-09-17T03:39:58.467088+0000","last_became_active":"2024-09-17T03:39:55.929046+0000","last_became_peered":"2024-09-17T03:39:55.929046+0000","last_unstale":"2024-09-17T03:39:58.467088+0000","last_undegraded":"2024-09-17T03:39:58.467088+0000","last_fullsized":"2024-09-17T03:39:58.467088+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:10.258321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.951564+0000","last_change":"2024-09-17T03:39:56.943282+0000","last_active":"2024-09-17T03:39:56.951564+0000","last_peered":"2024-09-17T03:39:56.951564+0000","last_clean":"2024-09-17T03:39:56.951564+0000","last_became_active":"2024-09-17T03:39:56.942296+0000","last_became_peered":"2024-09-17T03:39:56.942296+0000","last_unstale":"2024-09-17T03:39:56.951564+0000","last_undegraded":"2024-09-17T03:39:56.951564+0000","last_fullsized":"2024-09-17T03:39:56.951564+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:39.836016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.913960+0000","last_change":"2024-09-17T03:39:55.920767+0000","last_active":"2024-09-17T03:39:57.913960+0000","last_peered":"2024-09-17T03:39:57.913960+0000","last_clean":"2024-09-17T03:39:57.913960+0000","last_became_active":"2024-09-17T03:39:55.920469+0000","last_became_peered":"2024-09-17T03:39:55.920469+0000","last_unstale":"2024-09-17T03:39:57.913960+0000","last_undegraded":"2024-09-17T03:39:57.913960+0000","last_fullsized":"2024-09-17T03:39:57.913960+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:19.070546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.284196+0000","last_change":"2024-09-17T03:39:56.937461+0000","last_active":"2024-09-17T03:39:58.284196+0000","last_peered":"2024-09-17T03:39:58.284196+0000","last_clean":"2024-09-17T03:39:58.284196+0000","last_became_active":"2024-09-17T03:39:56.936524+0000","last_became_peered":"2024-09-17T03:39:56.936524+0000","last_unstale":"2024-09-17T03:39:58.284196+0000","last_undegraded":"2024-09-17T03:39:58.284196+0000","last_fullsized":"2024-09-17T03:39:58.284196+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:39.264006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467275+0000","last_change":"2024-09-17T03:39:55.934914+0000","last_active":"2024-09-17T03:39:58.467275+0000","last_peered":"2024-09-17T03:39:58.467275+0000","last_clean":"2024-09-17T03:39:58.467275+0000","last_became_active":"2024-09-17T03:39:55.934467+0000","last_became_peered":"2024-09-17T03:39:55.934467+0000","last_unstale":"2024-09-17T03:39:58.467275+0000","last_undegraded":"2024-09-17T03:39:58.467275+0000","last_fullsized":"2024-09-17T03:39:58.467275+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:44.819852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.912638+0000","last_change":"2024-09-17T03:39:56.931996+0000","last_active":"2024-09-17T03:39:57.912638+0000","last_peered":"2024-09-17T03:39:57.912638+0000","last_clean":"2024-09-17T03:39:57.912638+0000","last_became_active":"2024-09-17T03:39:56.931685+0000","last_became_peered":"2024-09-17T03:39:56.931685+0000","last_unstale":"2024-09-17T03:39:57.912638+0000","last_undegraded":"2024-09-17T03:39:57.912638+0000","last_fullsized":"2024-09-17T03:39:57.912638+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:22.121898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"98'1","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467118+0000","last_change":"2024-09-17T03:39:55.927245+0000","last_active":"2024-09-17T03:39:58.467118+0000","last_peered":"2024-09-17T03:39:58.467118+0000","last_clean":"2024-09-17T03:39:58.467118+0000","last_became_active":"2024-09-17T03:39:55.926560+0000","last_became_peered":"2024-09-17T03:39:55.926560+0000","last_unstale":"2024-09-17T03:39:58.467118+0000","last_undegraded":"2024-09-17T03:39:58.467118+0000","last_fullsized":"2024-09-17T03:39:58.467118+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:24.710704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.914400+0000","last_change":"2024-09-17T03:39:56.952682+0000","last_active":"2024-09-17T03:39:57.914400+0000","last_peered":"2024-09-17T03:39:57.914400+0000","last_clean":"2024-09-17T03:39:57.914400+0000","last_became_active":"2024-09-17T03:39:56.951797+0000","last_became_peered":"2024-09-17T03:39:56.951797+0000","last_unstale":"2024-09-17T03:39:57.914400+0000","last_undegraded":"2024-09-17T03:39:57.914400+0000","last_fullsized":"2024-09-17T03:39:57.914400+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:56.314196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.913019+0000","last_change":"2024-09-17T03:39:55.926248+0000","last_active":"2024-09-17T03:39:57.913019+0000","last_peered":"2024-09-17T03:39:57.913019+0000","last_clean":"2024-09-17T03:39:57.913019+0000","last_became_active":"2024-09-17T03:39:55.925109+0000","last_became_peered":"2024-09-17T03:39:55.925109+0000","last_unstale":"2024-09-17T03:39:57.913019+0000","last_undegraded":"2024-09-17T03:39:57.913019+0000","last_fullsized":"2024-09-17T03:39:57.913019+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:10.193351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467348+0000","last_change":"2024-09-17T03:39:56.937855+0000","last_active":"2024-09-17T03:39:58.467348+0000","last_peered":"2024-09-17T03:39:58.467348+0000","last_clean":"2024-09-17T03:39:58.467348+0000","last_became_active":"2024-09-17T03:39:56.937545+0000","last_became_peered":"2024-09-17T03:39:56.937545+0000","last_unstale":"2024-09-17T03:39:58.467348+0000","last_undegraded":"2024-09-17T03:39:58.467348+0000","last_fullsized":"2024-09-17T03:39:58.467348+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:16.769488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.921038+0000","last_change":"2024-09-17T03:39:55.930825+0000","last_active":"2024-09-17T03:39:56.921038+0000","last_peered":"2024-09-17T03:39:56.921038+0000","last_clean":"2024-09-17T03:39:56.921038+0000","last_became_active":"2024-09-17T03:39:55.930384+0000","last_became_peered":"2024-09-17T03:39:55.930384+0000","last_unstale":"2024-09-17T03:39:56.921038+0000","last_undegraded":"2024-09-17T03:39:56.921038+0000","last_fullsized":"2024-09-17T03:39:56.921038+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:19.433730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.952075+0000","last_change":"2024-09-17T03:39:56.945252+0000","last_active":"2024-09-17T03:39:56.952075+0000","last_peered":"2024-09-17T03:39:56.952075+0000","last_clean":"2024-09-17T03:39:56.952075+0000","last_became_active":"2024-09-17T03:39:56.944923+0000","last_became_peered":"2024-09-17T03:39:56.944923+0000","last_unstale":"2024-09-17T03:39:56.952075+0000","last_undegraded":"2024-09-17T03:39:56.952075+0000","last_fullsized":"2024-09-17T03:39:56.952075+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:41.053563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:57.912702+0000","last_change":"2024-09-17T03:39:55.926724+0000","last_active":"2024-09-17T03:39:57.912702+0000","last_peered":"2024-09-17T03:39:57.912702+0000","last_clean":"2024-09-17T03:39:57.912702+0000","last_became_active":"2024-09-17T03:39:55.926378+0000","last_became_peered":"2024-09-17T03:39:55.926378+0000","last_unstale":"2024-09-17T03:39:57.912702+0000","last_undegraded":"2024-09-17T03:39:57.912702+0000","last_fullsized":"2024-09-17T03:39:57.912702+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:00.829708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.954346+0000","last_change":"2024-09-17T03:39:56.947693+0000","last_active":"2024-09-17T03:39:56.954346+0000","last_peered":"2024-09-17T03:39:56.954346+0000","last_clean":"2024-09-17T03:39:56.954346+0000","last_became_active":"2024-09-17T03:39:56.947225+0000","last_became_peered":"2024-09-17T03:39:56.947225+0000","last_unstale":"2024-09-17T03:39:56.954346+0000","last_undegraded":"2024-09-17T03:39:56.954346+0000","last_fullsized":"2024-09-17T03:39:56.954346+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:38.938550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466724+0000","last_change":"2024-09-17T03:39:55.934881+0000","last_active":"2024-09-17T03:39:58.466724+0000","last_peered":"2024-09-17T03:39:58.466724+0000","last_clean":"2024-09-17T03:39:58.466724+0000","last_became_active":"2024-09-17T03:39:55.934484+0000","last_became_peered":"2024-09-17T03:39:55.934484+0000","last_unstale":"2024-09-17T03:39:58.466724+0000","last_undegraded":"2024-09-17T03:39:58.466724+0000","last_fullsized":"2024-09-17T03:39:58.466724+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:40.436616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.468281+0000","last_change":"2024-09-17T03:39:56.924436+0000","last_active":"2024-09-17T03:39:58.468281+0000","last_peered":"2024-09-17T03:39:58.468281+0000","last_clean":"2024-09-17T03:39:58.468281+0000","last_became_active":"2024-09-17T03:39:56.924011+0000","last_became_peered":"2024-09-17T03:39:56.924011+0000","last_unstale":"2024-09-17T03:39:58.468281+0000","last_undegraded":"2024-09-17T03:39:58.468281+0000","last_fullsized":"2024-09-17T03:39:58.468281+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:41.311060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466992+0000","last_change":"2024-09-17T03:39:55.934534+0000","last_active":"2024-09-17T03:39:58.466992+0000","last_peered":"2024-09-17T03:39:58.466992+0000","last_clean":"2024-09-17T03:39:58.466992+0000","last_became_active":"2024-09-17T03:39:55.934233+0000","last_became_peered":"2024-09-17T03:39:55.934233+0000","last_unstale":"2024-09-17T03:39:58.466992+0000","last_undegraded":"2024-09-17T03:39:58.466992+0000","last_fullsized":"2024-09-17T03:39:58.466992+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:44.418027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467862+0000","last_change":"2024-09-17T03:39:56.932113+0000","last_active":"2024-09-17T03:39:58.467862+0000","last_peered":"2024-09-17T03:39:58.467862+0000","last_clean":"2024-09-17T03:39:58.467862+0000","last_became_active":"2024-09-17T03:39:56.931848+0000","last_became_peered":"2024-09-17T03:39:56.931848+0000","last_unstale":"2024-09-17T03:39:58.467862+0000","last_undegraded":"2024-09-17T03:39:58.467862+0000","last_fullsized":"2024-09-17T03:39:58.467862+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:29.404990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466654+0000","last_change":"2024-09-17T03:39:55.933169+0000","last_active":"2024-09-17T03:39:58.466654+0000","last_peered":"2024-09-17T03:39:58.466654+0000","last_clean":"2024-09-17T03:39:58.466654+0000","last_became_active":"2024-09-17T03:39:55.932796+0000","last_became_peered":"2024-09-17T03:39:55.932796+0000","last_unstale":"2024-09-17T03:39:58.466654+0000","last_undegraded":"2024-09-17T03:39:58.466654+0000","last_fullsized":"2024-09-17T03:39:58.466654+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:27.294671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.467121+0000","last_change":"2024-09-17T03:39:56.937042+0000","last_active":"2024-09-17T03:39:58.467121+0000","last_peered":"2024-09-17T03:39:58.467121+0000","last_clean":"2024-09-17T03:39:58.467121+0000","last_became_active":"2024-09-17T03:39:56.936748+0000","last_became_peered":"2024-09-17T03:39:56.936748+0000","last_unstale":"2024-09-17T03:39:58.467121+0000","last_undegraded":"2024-09-17T03:39:58.467121+0000","last_fullsized":"2024-09-17T03:39:58.467121+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:55.896949+0000","last_clean_scrub_stamp":"2024-09-17T03:39:55.896949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:21.830927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T03:39:56.949182+0000","last_change":"2024-09-17T03:39:55.926985+0000","last_active":"2024-09-17T03:39:56.949182+0000","last_peered":"2024-09-17T03:39:56.949182+0000","last_clean":"2024-09-17T03:39:56.949182+0000","last_became_active":"2024-09-17T03:39:55.926661+0000","last_became_peered":"2024-09-17T03:39:55.926661+0000","last_unstale":"2024-09-17T03:39:56.949182+0000","last_undegraded":"2024-09-17T03:39:56.949182+0000","last_fullsized":"2024-09-17T03:39:56.949182+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:39:54.894457+0000","last_clean_scrub_stamp":"2024-09-17T03:39:54.894457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:55.867796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":255,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:39:58.466482+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:39:58.466482+0000","last_peered":"2024-09-17T03:39:58.466482+0000","last_clean":"2024-09-17T03:39:58.466482+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:39:58.466482+0000","last_undegraded":"2024-09-17T03:39:58.466482+0000","last_fullsized":"2024-09-17T03:39:58.466482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1216512,"data_stored":553390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1220608,"data_stored":554350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32964,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1810432,"data_stored":1143230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1220608,"data_stored":554350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1216512,"data_stored":552850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1810432,"data_stored":1143198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1212416,"data_stored":553320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1200128,"data_stored":546080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:01.833 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:40:01.833 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:40:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.097+0000 7f325ce00640 1 -- 172.21.15.121:0/2781391550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f323c003cf0 msgr2=0x7f323c004140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.097+0000 7f325ce00640 1 --2- 172.21.15.121:0/2781391550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f323c003cf0 0x7f323c004140 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3248001830 tx=0x7f323c005830 comp rx=0 tx=0).stop 2024-09-17T03:40:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.097+0000 7f3256800640 1 -- 172.21.15.121:0/2781391550 reap_dead start 2024-09-17T03:40:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.097+0000 7f325ce00640 1 -- 172.21.15.121:0/2781391550 shutdown_connections 2024-09-17T03:40:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.097+0000 7f325ce00640 1 -- 172.21.15.121:0/2781391550 >> 172.21.15.121:0/2781391550 conn(0x7f32580b3580 msgr2=0x7f32580b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.097+0000 7f325ce00640 1 -- 172.21.15.121:0/2781391550 shutdown_connections 2024-09-17T03:40:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.097+0000 7f325ce00640 1 -- 172.21.15.121:0/2781391550 wait complete. 2024-09-17T03:40:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.099+0000 7f325ce00640 1 Processor -- start 2024-09-17T03:40:02.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.099+0000 7f325ce00640 1 -- start start 2024-09-17T03:40:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f325ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f323c003cf0 0x7f3258154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f325ce00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3258159900 0x7f32580c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f325ce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32580c9950 0x7f32581f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f325ce00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32580d0940 con 0x7f323c003cf0 2024-09-17T03:40:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f325ce00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f32580d07c0 con 0x7f32580c9950 2024-09-17T03:40:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f325ce00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f325815d320 con 0x7f3258159900 2024-09-17T03:40:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3255e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f323c003cf0 0x7f3258154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3255e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f323c003cf0 0x7f3258154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48526/0 (socket says 172.21.15.121:48526) 2024-09-17T03:40:02.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3255e00640 1 -- 172.21.15.121:0/1710062746 learned_addr learned my addr 172.21.15.121:0/1710062746 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3255400640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3258159900 0x7f32580c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3256800640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32580c9950 0x7f32581f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3255e00640 1 -- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3258159900 msgr2=0x7f32580c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3255e00640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3258159900 0x7f32580c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3255e00640 1 -- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32580c9950 msgr2=0x7f32581f6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3255e00640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32580c9950 0x7f32581f6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3255e00640 1 -- 172.21.15.121:0/1710062746 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32580c9d60 con 0x7f323c003cf0 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.101+0000 7f3256800640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32580c9950 0x7f32581f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.102+0000 7f3255e00640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f323c003cf0 0x7f3258154b20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f3248001950 tx=0x7f3248006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.102+0000 7f324e000640 1 -- 172.21.15.121:0/1710062746 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248043070 con 0x7f323c003cf0 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.102+0000 7f324e000640 1 -- 172.21.15.121:0/1710062746 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32480038e0 con 0x7f323c003cf0 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.102+0000 7f325ce00640 1 -- 172.21.15.121:0/1710062746 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32580c6fc0 con 0x7f323c003cf0 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.102+0000 7f324e000640 1 -- 172.21.15.121:0/1710062746 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248003cd0 con 0x7f323c003cf0 2024-09-17T03:40:02.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.102+0000 7f325ce00640 1 -- 172.21.15.121:0/1710062746 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32580c64e0 con 0x7f323c003cf0 2024-09-17T03:40:02.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.103+0000 7f325ce00640 1 -- 172.21.15.121:0/1710062746 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325815d880 con 0x7f323c003cf0 2024-09-17T03:40:02.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.104+0000 7f324e000640 1 -- 172.21.15.121:0/1710062746 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3248046070 con 0x7f323c003cf0 2024-09-17T03:40:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.106+0000 7f324e000640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3238078bc0 0x7f323807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.106+0000 7f324e000640 1 -- 172.21.15.121:0/1710062746 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f32480bac40 con 0x7f323c003cf0 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.106+0000 7f3255400640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3238078bc0 0x7f323807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.107+0000 7f3255400640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3238078bc0 0x7f323807b0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f32580cd110 tx=0x7f3244005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:02.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.111+0000 7f324e000640 1 -- 172.21.15.121:0/1710062746 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f32580c9d60 con 0x7f323c003cf0 2024-09-17T03:40:02.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.361+0000 7f325ce00640 1 -- 172.21.15.121:0/1710062746 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f32580cd420 con 0x7f323c003cf0 2024-09-17T03:40:02.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.364+0000 7f324e000640 1 -- 172.21.15.121:0/1710062746 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f3248082890 con 0x7f323c003cf0 2024-09-17T03:40:02.365 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-17T03:40:02.365 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw== 2024-09-17T03:40:02.365 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-17T03:40:02.365 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-17T03:40:02.365 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:40:02.365 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-17T03:40:02.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.366+0000 7f325ce00640 1 -- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3238078bc0 msgr2=0x7f323807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.366+0000 7f325ce00640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3238078bc0 0x7f323807b0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f32580cd110 tx=0x7f3244005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:02.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.366+0000 7f325ce00640 1 -- 172.21.15.121:0/1710062746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f323c003cf0 msgr2=0x7f3258154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.366+0000 7f325ce00640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f323c003cf0 0x7f3258154b20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f3248001950 tx=0x7f3248006940 comp rx=0 tx=0).stop 2024-09-17T03:40:02.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.366+0000 7f325ce00640 1 -- 172.21.15.121:0/1710062746 shutdown_connections 2024-09-17T03:40:02.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.366+0000 7f325ce00640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32580c9950 0x7f32581f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.366+0000 7f325ce00640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3258159900 0x7f32580c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.366+0000 7f325ce00640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3238078bc0 0x7f323807b0d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.366+0000 7f325ce00640 1 --2- 172.21.15.121:0/1710062746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f323c003cf0 0x7f3258154b20 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.366+0000 7f325ce00640 1 -- 172.21.15.121:0/1710062746 >> 172.21.15.121:0/1710062746 conn(0x7f32580b3580 msgr2=0x7f32580cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:02.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.367+0000 7f325ce00640 1 -- 172.21.15.121:0/1710062746 shutdown_connections 2024-09-17T03:40:02.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.367+0000 7f325ce00640 1 -- 172.21.15.121:0/1710062746 wait complete. 2024-09-17T03:40:02.389 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:02.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.611+0000 7f46fd200640 1 -- 172.21.15.121:0/3879285256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46dc004d90 msgr2=0x7f46dc005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.611+0000 7f46fd200640 1 --2- 172.21.15.121:0/3879285256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46dc004d90 0x7f46dc005220 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f46f000c780 tx=0x7f46dc005830 comp rx=0 tx=0).stop 2024-09-17T03:40:02.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.611+0000 7f46f6800640 1 -- 172.21.15.121:0/3879285256 reap_dead start 2024-09-17T03:40:02.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.611+0000 7f46fd200640 1 -- 172.21.15.121:0/3879285256 shutdown_connections 2024-09-17T03:40:02.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.611+0000 7f46fd200640 1 -- 172.21.15.121:0/3879285256 >> 172.21.15.121:0/3879285256 conn(0x7f46f80b3580 msgr2=0x7f46f80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:02.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.611+0000 7f46fd200640 1 -- 172.21.15.121:0/3879285256 shutdown_connections 2024-09-17T03:40:02.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.611+0000 7f46fd200640 1 -- 172.21.15.121:0/3879285256 wait complete. 2024-09-17T03:40:02.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.614+0000 7f46fd200640 1 Processor -- start 2024-09-17T03:40:02.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.614+0000 7f46fd200640 1 -- start start 2024-09-17T03:40:02.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.615+0000 7f46fd200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46dc004d90 0x7f46f81f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.615+0000 7f46fd200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46f81f3d40 0x7f46f80c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.615+0000 7f46fd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46f80c9950 0x7f46f81591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.615+0000 7f46fd200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f46f806e3c0 con 0x7f46f80c9950 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.615+0000 7f46fd200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f46f8161190 con 0x7f46f81f3d40 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.615+0000 7f46fd200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46f80d05b0 con 0x7f46dc004d90 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.615+0000 7f46f6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46f80c9950 0x7f46f81591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.615+0000 7f46f6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46f80c9950 0x7f46f81591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48532/0 (socket says 172.21.15.121:48532) 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.615+0000 7f46f6800640 1 -- 172.21.15.121:0/885283225 learned_addr learned my addr 172.21.15.121:0/885283225 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.616+0000 7f46efe00640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46f81f3d40 0x7f46f80c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.616+0000 7f46f5e00640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46dc004d90 0x7f46f81f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.616+0000 7f46f6800640 1 -- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46dc004d90 msgr2=0x7f46f81f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.616+0000 7f46f6800640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46dc004d90 0x7f46f81f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.616+0000 7f46f6800640 1 -- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46f81f3d40 msgr2=0x7f46f80c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.616+0000 7f46f6800640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46f81f3d40 0x7f46f80c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.616+0000 7f46f6800640 1 -- 172.21.15.121:0/885283225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f80c9d60 con 0x7f46f80c9950 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.616+0000 7f46f6800640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46f80c9950 0x7f46f81591f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f46f002b690 tx=0x7f46f0004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:02.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.616+0000 7f46ee000640 1 -- 172.21.15.121:0/885283225 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f000c3a0 con 0x7f46f80c9950 2024-09-17T03:40:02.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.617+0000 7f46ee000640 1 -- 172.21.15.121:0/885283225 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46f0004d40 con 0x7f46f80c9950 2024-09-17T03:40:02.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.617+0000 7f46ee000640 1 -- 172.21.15.121:0/885283225 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f002bc40 con 0x7f46f80c9950 2024-09-17T03:40:02.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.617+0000 7f46fd200640 1 -- 172.21.15.121:0/885283225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f815b880 con 0x7f46f80c9950 2024-09-17T03:40:02.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.617+0000 7f46fd200640 1 -- 172.21.15.121:0/885283225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f8157000 con 0x7f46f80c9950 2024-09-17T03:40:02.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.618+0000 7f46fd200640 1 -- 172.21.15.121:0/885283225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f806d800 con 0x7f46f80c9950 2024-09-17T03:40:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.619+0000 7f46ee000640 1 -- 172.21.15.121:0/885283225 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46f0006030 con 0x7f46f80c9950 2024-09-17T03:40:02.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.620+0000 7f46ee000640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f46d4078bc0 0x7f46d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.620+0000 7f46ee000640 1 -- 172.21.15.121:0/885283225 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f46f003d020 con 0x7f46f80c9950 2024-09-17T03:40:02.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.620+0000 7f46f5e00640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f46d4078bc0 0x7f46d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.621+0000 7f46f5e00640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f46d4078bc0 0x7f46d407b0d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009cd0 tx=0x7f46e8005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.624+0000 7f46ee000640 1 -- 172.21.15.121:0/885283225 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46f80c9d60 con 0x7f46f80c9950 2024-09-17T03:40:02.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.840+0000 7f46fd200640 1 -- 172.21.15.121:0/885283225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46f815fa50 con 0x7f46f80c9950 2024-09-17T03:40:02.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.841+0000 7f46ee000640 1 -- 172.21.15.121:0/885283225 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f46f80d0f00 con 0x7f46f80c9950 2024-09-17T03:40:02.842 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:02.842 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":68,"btime":"2024-09-17T03:39:59:942558+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3550639124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3550639124},{"type":"v1","addr":"172.21.15.176:6836","nonce":3550639124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/479907239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":479907239},{"type":"v1","addr":"172.21.15.121:6833","nonce":479907239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3992738504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3992738504},{"type":"v1","addr":"172.21.15.121:6835","nonce":3992738504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:56.408137+0000","modified":"2024-09-17T03:39:59.424876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/3841878149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3841878149},{"type":"v1","addr":"172.21.15.176:6837","nonce":3841878149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6768,"qdb_cluster":[6768]},"id":7}]} 2024-09-17T03:40:02.842 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 68 2024-09-17T03:40:02.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 -- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f46d4078bc0 msgr2=0x7f46d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f46d4078bc0 0x7f46d407b0d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009cd0 tx=0x7f46e8005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:02.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 -- 172.21.15.121:0/885283225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46f80c9950 msgr2=0x7f46f81591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46f80c9950 0x7f46f81591f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f46f002b690 tx=0x7f46f0004a10 comp rx=0 tx=0).stop 2024-09-17T03:40:02.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 -- 172.21.15.121:0/885283225 shutdown_connections 2024-09-17T03:40:02.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f46d4078bc0 0x7f46d407b0d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46f80c9950 0x7f46f81591f0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46f81f3d40 0x7f46f80c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 --2- 172.21.15.121:0/885283225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46dc004d90 0x7f46f81f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 -- 172.21.15.121:0/885283225 >> 172.21.15.121:0/885283225 conn(0x7f46f80b3580 msgr2=0x7f46f80ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:02.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 -- 172.21.15.121:0/885283225 shutdown_connections 2024-09-17T03:40:02.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:02.843+0000 7f46fd200640 1 -- 172.21.15.121:0/885283225 wait complete. 2024-09-17T03:40:03.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:39:56.408137+0000', 'modified': '2024-09-17T03:39:59.424876+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6768}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6768': {'gid': 6768, 'name': 'b', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6837/3841878149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6835', 'nonce': 3841878149}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 3841878149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6768, 'qdb_cluster': [6768]} 2024-09-17T03:40:03.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:40:03.272 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T03:40:03.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.496+0000 7f8107600640 1 -- 172.21.15.121:0/1157626306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8100073880 msgr2=0x7f8100073c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.496+0000 7f8107600640 1 --2- 172.21.15.121:0/1157626306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8100073880 0x7f8100073c90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f80f8005fd0 tx=0x7f80f802aa10 comp rx=0 tx=0).stop 2024-09-17T03:40:03.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.496+0000 7f8107600640 1 -- 172.21.15.121:0/1157626306 shutdown_connections 2024-09-17T03:40:03.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.496+0000 7f8107600640 1 --2- 172.21.15.121:0/1157626306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8100073880 0x7f8100073c90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.496+0000 7f8107600640 1 --2- 172.21.15.121:0/1157626306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81000d0d90 0x7f8100073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.496+0000 7f8107600640 1 -- 172.21.15.121:0/1157626306 >> 172.21.15.121:0/1157626306 conn(0x7f81000b3580 msgr2=0x7f81000b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:03.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.497+0000 7f8107600640 1 -- 172.21.15.121:0/1157626306 shutdown_connections 2024-09-17T03:40:03.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.497+0000 7f8107600640 1 -- 172.21.15.121:0/1157626306 wait complete. 2024-09-17T03:40:03.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.499+0000 7f8107600640 1 Processor -- start 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.499+0000 7f8107600640 1 -- start start 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.500+0000 7f8107600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8100070100 0x7f8100158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.500+0000 7f8107600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8100073880 0x7f81001e1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.500+0000 7f8107600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81000c7210 0x7f81001e2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.500+0000 7f8107600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f810015ad70 con 0x7f8100073880 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.500+0000 7f8107600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8100070bc0 con 0x7f81000c7210 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.500+0000 7f8107600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8100070fa0 con 0x7f8100070100 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f80f7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8100073880 0x7f81001e1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f80f7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8100073880 0x7f81001e1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48544/0 (socket says 172.21.15.121:48544) 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f80f7e00640 1 -- 172.21.15.121:0/2991324886 learned_addr learned my addr 172.21.15.121:0/2991324886 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f8105600640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81000c7210 0x7f81001e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f8104c00640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8100070100 0x7f8100158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f80f7e00640 1 -- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8100070100 msgr2=0x7f8100158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f80f7e00640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8100070100 0x7f8100158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f80f7e00640 1 -- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81000c7210 msgr2=0x7f81001e2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f80f7e00640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81000c7210 0x7f81001e2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f80f7e00640 1 -- 172.21.15.121:0/2991324886 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81000ccfb0 con 0x7f8100073880 2024-09-17T03:40:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f8105600640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81000c7210 0x7f81001e2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.501+0000 7f8104c00640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8100070100 0x7f8100158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.502+0000 7f80f7e00640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8100073880 0x7f81001e1c20 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009750 tx=0x7f80e8009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.502+0000 7f80fd600640 1 -- 172.21.15.121:0/2991324886 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8018030 con 0x7f8100073880 2024-09-17T03:40:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.502+0000 7f80fd600640 1 -- 172.21.15.121:0/2991324886 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80e8004020 con 0x7f8100073880 2024-09-17T03:40:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.502+0000 7f8107600640 1 -- 172.21.15.121:0/2991324886 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81000cd290 con 0x7f8100073880 2024-09-17T03:40:03.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.502+0000 7f80fd600640 1 -- 172.21.15.121:0/2991324886 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8004450 con 0x7f8100073880 2024-09-17T03:40:03.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.502+0000 7f8107600640 1 -- 172.21.15.121:0/2991324886 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8100158cc0 con 0x7f8100073880 2024-09-17T03:40:03.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.505+0000 7f80fd600640 1 -- 172.21.15.121:0/2991324886 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80e801b070 con 0x7f8100073880 2024-09-17T03:40:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.506+0000 7f80fd600640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80dc078bc0 0x7f80dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.507+0000 7f80fd600640 1 -- 172.21.15.121:0/2991324886 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f80e809ab20 con 0x7f8100073880 2024-09-17T03:40:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.507+0000 7f810e665740 1 Processor -- start 2024-09-17T03:40:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.507+0000 7f810e665740 1 -- start start 2024-09-17T03:40:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.507+0000 7f8104c00640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80dc078bc0 0x7f80dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f8104c00640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80dc078bc0 0x7f80dc07b0d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f80f00016a0 tx=0x7f80f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:03.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f810e665740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f810e665740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c6161f93b0 0x55c6165c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f810e665740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 0x55c6165c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f810e665740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c61654c430 con 0x55c616222270 2024-09-17T03:40:03.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f810e665740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c61653c5d0 con 0x55c616201590 2024-09-17T03:40:03.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f810e665740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55c61652ba00 con 0x55c6161f93b0 2024-09-17T03:40:03.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f8104c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f8104c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48556/0 (socket says 172.21.15.121:48556) 2024-09-17T03:40:03.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f8104c00640 1 -- 172.21.15.121:0/2199892315 learned_addr learned my addr 172.21.15.121:0/2199892315 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:03.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f8105600640 1 --2- 172.21.15.121:0/2199892315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 0x55c6165c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.508+0000 7f80f7e00640 1 --2- 172.21.15.121:0/2199892315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c6161f93b0 0x55c6165c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.509+0000 7f8104c00640 1 -- 172.21.15.121:0/2199892315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c6161f93b0 msgr2=0x55c6165c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:03.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.509+0000 7f8104c00640 1 --2- 172.21.15.121:0/2199892315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c6161f93b0 0x55c6165c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.509+0000 7f8104c00640 1 -- 172.21.15.121:0/2199892315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 msgr2=0x55c6165c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:03.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.509+0000 7f8104c00640 1 --2- 172.21.15.121:0/2199892315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 0x55c6165c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.509+0000 7f8104c00640 1 -- 172.21.15.121:0/2199892315 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6164f4520 con 0x55c616222270 2024-09-17T03:40:03.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.509+0000 7f8104c00640 1 --2- 172.21.15.121:0/2199892315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660da20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f80f000da10 tx=0x7f80f0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344c532eaca18fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:03.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.509+0000 7f80f5200640 1 -- 172.21.15.121:0/2199892315 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0024070 con 0x55c616222270 2024-09-17T03:40:03.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.509+0000 7f80f5200640 1 -- 172.21.15.121:0/2199892315 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80f0014db0 con 0x55c616222270 2024-09-17T03:40:03.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.509+0000 7f80f5200640 1 -- 172.21.15.121:0/2199892315 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f001f620 con 0x55c616222270 2024-09-17T03:40:03.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.510+0000 7f810e665740 1 -- 172.21.15.121:0/2199892315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 msgr2=0x55c61660da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.510+0000 7f810e665740 1 --2- 172.21.15.121:0/2199892315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660da20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f80f000da10 tx=0x7f80f0010000 comp rx=0 tx=0).stop 2024-09-17T03:40:03.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.510+0000 7f810e665740 1 -- 172.21.15.121:0/2199892315 shutdown_connections 2024-09-17T03:40:03.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.510+0000 7f810e665740 1 --2- 172.21.15.121:0/2199892315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 0x55c6165c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.510+0000 7f810e665740 1 --2- 172.21.15.121:0/2199892315 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c6161f93b0 0x55c6165c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.510+0000 7f810e665740 1 --2- 172.21.15.121:0/2199892315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660da20 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.510+0000 7f810e665740 1 -- 172.21.15.121:0/2199892315 >> 172.21.15.121:0/2199892315 conn(0x55c6162163c0 msgr2=0x55c6165c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:03.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.510+0000 7f810e665740 1 -- 172.21.15.121:0/2199892315 shutdown_connections 2024-09-17T03:40:03.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.510+0000 7f810e665740 1 -- 172.21.15.121:0/2199892315 wait complete. 2024-09-17T03:40:03.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.511+0000 7f810e665740 1 -- start start 2024-09-17T03:40:03.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.512+0000 7f810e665740 1 Processor -- start 2024-09-17T03:40:03.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.513+0000 7f810e665740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6161f93b0 0x55c6165e3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.513+0000 7f810e665740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616201590 0x55c61660ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.513+0000 7f810e665740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c616222270 0x55c61660f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.513+0000 7f810e665740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c6164d2330 con 0x55c616201590 2024-09-17T03:40:03.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.513+0000 7f810e665740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c61652f810 con 0x55c6161f93b0 2024-09-17T03:40:03.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.513+0000 7f810e665740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55c61629c620 con 0x55c616222270 2024-09-17T03:40:03.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.513+0000 7f810e665740 10 client.0 _ll_register_callbacks cb 0x55c6164d7420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:03.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.513+0000 7f80f7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616201590 0x55c61660ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.513+0000 7f80f7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616201590 0x55c61660ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48570/0 (socket says 172.21.15.121:48570) 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.513+0000 7f80f7e00640 1 -- 172.21.15.121:0/1914434478 learned_addr learned my addr 172.21.15.121:0/1914434478 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f8104c00640 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6161f93b0 0x55c6165e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f8105600640 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c616222270 0x55c61660f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f80f7e00640 1 -- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c616222270 msgr2=0x55c61660f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f80f7e00640 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c616222270 0x55c61660f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f80f7e00640 1 -- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6161f93b0 msgr2=0x55c6165e3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f80f7e00640 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6161f93b0 0x55c6165e3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f80f7e00640 1 -- 172.21.15.121:0/1914434478 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c61628d850 con 0x55c616201590 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f80f7e00640 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616201590 0x55c61660ead0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f80e8004610 tx=0x7f80e8062440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ae9a04a74ce39e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f80ed600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f80ed600640 1 -- 172.21.15.121:0/1914434478 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e806c180 con 0x55c616201590 2024-09-17T03:40:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f80ed600640 1 -- 172.21.15.121:0/1914434478 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f80e8063b20 con 0x55c616201590 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f810e665740 1 -- 172.21.15.121:0/1914434478 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80f0014db0 con 0x55c616201590 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.514+0000 7f80ed600640 1 -- 172.21.15.121:0/1914434478 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f80e8063d20 con 0x55c616201590 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f810e665740 10 client.6888 fetch_fsmap learned FSMap version 68 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f810e665740 1 -- 172.21.15.121:0/1914434478 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55c6163046b0 con 0x55c616201590 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f80ed600640 1 -- 172.21.15.121:0/1914434478 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80f0014db0 con 0x55c616201590 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f80ed600640 1 -- 172.21.15.121:0/1914434478 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f80e805e140 con 0x55c616201590 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f810e665740 10 client.6888 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f810e665740 10 client.6888 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f810e665740 20 client.6888 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f810e665740 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x55c6161e0e40 0x55c6165f1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f810e665740 4 client.6888 mds_command: new command op to 6768 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f810e665740 1 -- 172.21.15.121:0/1914434478 --> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c61653e520 con 0x55c6161e0e40 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.515+0000 7f8104c00640 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x55c6161e0e40 0x55c6165f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.516+0000 7f8104c00640 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x55c6161e0e40 0x55c6165f1210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b0f3762fbbeff35 server_cookie=77523cea92f35dec in_seq=0 out_seq=0 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.516+0000 7f80ed600640 10 client.6888 ms_handle_connect on v2:172.21.15.176:6835/3841878149 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.517+0000 7f80ed600640 1 -- 172.21.15.121:0/1914434478 <== mds.0 v2:172.21.15.176:6835/3841878149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c61653e520 con 0x55c6161e0e40 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.517+0000 7f80ed600640 10 client.6888 handle_command_reply: tid=0 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.517+0000 7f810e665740 1 client.6888 shutdown 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 1 -- 172.21.15.121:0/1914434478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616201590 msgr2=0x55c61660ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616201590 0x55c61660ead0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f80e8004610 tx=0x7f80e8062440 comp rx=0 tx=0).stop 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 1 -- 172.21.15.121:0/1914434478 shutdown_connections 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c616222270 0x55c61660f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x55c6161e0e40 0x55c6165f1210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616201590 0x55c61660ead0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 1 --2- 172.21.15.121:0/1914434478 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c6161f93b0 0x55c6165e3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f80ed600640 0 client.6888 ms_handle_reset on v2:172.21.15.176:6835/3841878149 2024-09-17T03:40:03.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 1 -- 172.21.15.121:0/1914434478 >> 172.21.15.121:0/1914434478 conn(0x55c6162163c0 msgr2=0x55c61660cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:03.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 1 -- 172.21.15.121:0/1914434478 shutdown_connections 2024-09-17T03:40:03.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 1 -- 172.21.15.121:0/1914434478 wait complete. 2024-09-17T03:40:03.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.518+0000 7f810e665740 20 client.6888 trim_cache size 0 max 16384 2024-09-17T03:40:03.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.537+0000 7f810e665740 1 Processor -- start 2024-09-17T03:40:03.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.537+0000 7f810e665740 1 -- start start 2024-09-17T03:40:03.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.538+0000 7f810e665740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c6161f93b0 0x55c6165f1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.538+0000 7f810e665740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 0x55c61660cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.538+0000 7f810e665740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.538+0000 7f810e665740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81000b1b40 con 0x55c616222270 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.538+0000 7f810e665740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81000b0ea0 con 0x55c616201590 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.538+0000 7f810e665740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81000b14f0 con 0x55c6161f93b0 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.538+0000 7f8105600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.538+0000 7f8105600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48576/0 (socket says 172.21.15.121:48576) 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.538+0000 7f8105600640 1 -- 172.21.15.121:0/2655128205 learned_addr learned my addr 172.21.15.121:0/2655128205 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f80f7e00640 1 --2- 172.21.15.121:0/2655128205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 0x55c61660cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f8104c00640 1 --2- 172.21.15.121:0/2655128205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c6161f93b0 0x55c6165f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f8105600640 1 -- 172.21.15.121:0/2655128205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c6161f93b0 msgr2=0x55c6165f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f8105600640 1 --2- 172.21.15.121:0/2655128205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c6161f93b0 0x55c6165f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f8105600640 1 -- 172.21.15.121:0/2655128205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 msgr2=0x55c61660cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:03.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f8105600640 1 --2- 172.21.15.121:0/2655128205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 0x55c61660cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f8105600640 1 -- 172.21.15.121:0/2655128205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6165f4080 con 0x55c616222270 2024-09-17T03:40:03.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f80f7e00640 1 --2- 172.21.15.121:0/2655128205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 0x55c61660cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:03.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f8105600640 1 --2- 172.21.15.121:0/2655128205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660d060 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f80f802b000 tx=0x7f80f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadb553820060d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:03.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f80efe00640 1 -- 172.21.15.121:0/2655128205 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8048070 con 0x55c616222270 2024-09-17T03:40:03.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f80efe00640 1 -- 172.21.15.121:0/2655128205 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80f802fc00 con 0x55c616222270 2024-09-17T03:40:03.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.539+0000 7f80efe00640 1 -- 172.21.15.121:0/2655128205 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8033040 con 0x55c616222270 2024-09-17T03:40:03.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.540+0000 7f810e665740 1 -- 172.21.15.121:0/2655128205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 msgr2=0x55c61660d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.540+0000 7f810e665740 1 --2- 172.21.15.121:0/2655128205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660d060 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f80f802b000 tx=0x7f80f8004a40 comp rx=0 tx=0).stop 2024-09-17T03:40:03.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.540+0000 7f810e665740 1 -- 172.21.15.121:0/2655128205 shutdown_connections 2024-09-17T03:40:03.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.540+0000 7f810e665740 1 --2- 172.21.15.121:0/2655128205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c616222270 0x55c61660d060 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.540+0000 7f810e665740 1 --2- 172.21.15.121:0/2655128205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616201590 0x55c61660cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.540+0000 7f810e665740 1 --2- 172.21.15.121:0/2655128205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c6161f93b0 0x55c6165f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.540+0000 7f810e665740 1 -- 172.21.15.121:0/2655128205 >> 172.21.15.121:0/2655128205 conn(0x55c6162163c0 msgr2=0x55c6165e9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:03.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.540+0000 7f810e665740 1 -- 172.21.15.121:0/2655128205 shutdown_connections 2024-09-17T03:40:03.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.540+0000 7f810e665740 1 -- 172.21.15.121:0/2655128205 wait complete. 2024-09-17T03:40:03.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.541+0000 7f810e665740 1 -- start start 2024-09-17T03:40:03.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.541+0000 7f810e665740 1 Processor -- start 2024-09-17T03:40:03.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f810e665740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c6161f93b0 0x55c61660cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f810e665740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c616201590 0x55c6165f1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f810e665740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616222270 0x55c6165f1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f810e665740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c6165f0710 con 0x55c6161f93b0 2024-09-17T03:40:03.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f810e665740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c6165e36d0 con 0x55c616222270 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f810e665740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55c616625250 con 0x55c616201590 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f810e665740 10 client.0 _ll_register_callbacks cb 0x7f80e8062300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f8104c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c6161f93b0 0x55c61660cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f8104c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c6161f93b0 0x55c61660cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48590/0 (socket says 172.21.15.121:48590) 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f8104c00640 1 -- 172.21.15.121:0/3623765342 learned_addr learned my addr 172.21.15.121:0/3623765342 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f80f7e00640 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c616201590 0x55c6165f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f8105600640 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616222270 0x55c6165f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f8104c00640 1 -- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c616201590 msgr2=0x55c6165f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f8104c00640 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c616201590 0x55c6165f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f8104c00640 1 -- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616222270 msgr2=0x55c6165f1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f8104c00640 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616222270 0x55c6165f1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.543+0000 7f8104c00640 1 -- 172.21.15.121:0/3623765342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c616695110 con 0x55c6161f93b0 2024-09-17T03:40:03.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.544+0000 7f8104c00640 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c6161f93b0 0x55c61660cb20 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f80f00077e0 tx=0x7f80f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dca205f0b0f03e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.544+0000 7f80ed600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.544+0000 7f80ed600640 1 -- 172.21.15.121:0/3623765342 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0037030 con 0x55c6161f93b0 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.544+0000 7f80ed600640 1 -- 172.21.15.121:0/3623765342 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f80f0014bb0 con 0x55c6161f93b0 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.544+0000 7f810e665740 1 -- 172.21.15.121:0/3623765342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80f802fc00 con 0x55c6161f93b0 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.544+0000 7f80ed600640 1 -- 172.21.15.121:0/3623765342 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f80f0024040 con 0x55c6161f93b0 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.544+0000 7f810e665740 10 client.6894 fetch_fsmap learned FSMap version 68 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.544+0000 7f810e665740 1 -- 172.21.15.121:0/3623765342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55c61660ee60 con 0x55c6161f93b0 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.545+0000 7f80ed600640 1 -- 172.21.15.121:0/3623765342 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80f802fc00 con 0x55c6161f93b0 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.545+0000 7f80ed600640 1 -- 172.21.15.121:0/3623765342 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f80f0033480 con 0x55c6161f93b0 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.545+0000 7f810e665740 10 client.6894 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.545+0000 7f810e665740 10 client.6894 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.545+0000 7f810e665740 20 client.6894 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:03.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.545+0000 7f810e665740 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x55c6166914f0 0x55c616691900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.545+0000 7f810e665740 4 client.6894 mds_command: new command op to 6768 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.545+0000 7f810e665740 1 -- 172.21.15.121:0/3623765342 --> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] -- command(tid 0: {"prefix": "status"}) -- 0x55c616539fd0 con 0x55c6166914f0 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.545+0000 7f80f7e00640 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x55c6166914f0 0x55c616691900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f80f7e00640 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x55c6166914f0 0x55c616691900 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fd7b0b393c79f89 server_cookie=2d38c74a20652b13 in_seq=0 out_seq=0 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f80ed600640 10 client.6894 ms_handle_connect on v2:172.21.15.176:6835/3841878149 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f80ed600640 1 -- 172.21.15.121:0/3623765342 <== mds.0 v2:172.21.15.176:6835/3841878149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c616539fd0 con 0x55c6166914f0 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f80ed600640 10 client.6894 handle_command_reply: tid=0 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 client.6894 shutdown 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 -- 172.21.15.121:0/3623765342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c6161f93b0 msgr2=0x55c61660cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c6161f93b0 0x55c61660cb20 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f80f00077e0 tx=0x7f80f0000ed0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 -- 172.21.15.121:0/3623765342 shutdown_connections 2024-09-17T03:40:03.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c616222270 0x55c6165f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c616201590 0x55c6165f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x55c6166914f0 0x55c616691900 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 --2- 172.21.15.121:0/3623765342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c6161f93b0 0x55c61660cb20 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f80ed600640 0 client.6894 ms_handle_reset on v2:172.21.15.176:6835/3841878149 2024-09-17T03:40:03.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 -- 172.21.15.121:0/3623765342 >> 172.21.15.121:0/3623765342 conn(0x55c6162163c0 msgr2=0x55c616635230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:03.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 -- 172.21.15.121:0/3623765342 shutdown_connections 2024-09-17T03:40:03.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.546+0000 7f810e665740 1 -- 172.21.15.121:0/3623765342 wait complete. 2024-09-17T03:40:03.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f810e665740 20 client.6894 trim_cache size 0 max 16384 2024-09-17T03:40:03.552 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:40:03.552 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:40:03.552 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:40:03.552 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 6768, 2024-09-17T03:40:03.552 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:40:03.552 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:40:03.552 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:40:03.552 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 6.6409796229999998, 2024-09-17T03:40:03.552 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 68, 2024-09-17T03:40:03.553 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 98, 2024-09-17T03:40:03.553 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 98, 2024-09-17T03:40:03.553 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 11.657604731999999 2024-09-17T03:40:03.553 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:40:03.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 -- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80dc078bc0 msgr2=0x7f80dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80dc078bc0 0x7f80dc07b0d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f80f00016a0 tx=0x7f80f0009040 comp rx=0 tx=0).stop 2024-09-17T03:40:03.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 -- 172.21.15.121:0/2991324886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8100073880 msgr2=0x7f81001e1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8100073880 0x7f81001e1c20 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009750 tx=0x7f80e8009c10 comp rx=0 tx=0).stop 2024-09-17T03:40:03.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 -- 172.21.15.121:0/2991324886 shutdown_connections 2024-09-17T03:40:03.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81000c7210 0x7f81001e2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f80dc078bc0 0x7f80dc07b0d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8100073880 0x7f81001e1c20 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 --2- 172.21.15.121:0/2991324886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8100070100 0x7f8100158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 -- 172.21.15.121:0/2991324886 >> 172.21.15.121:0/2991324886 conn(0x7f81000b3580 msgr2=0x7f81000ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:03.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 -- 172.21.15.121:0/2991324886 shutdown_connections 2024-09-17T03:40:03.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.547+0000 7f8107600640 1 -- 172.21.15.121:0/2991324886 wait complete. 2024-09-17T03:40:03.569 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:40:03.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.787+0000 7f0a99a00640 1 -- 172.21.15.121:0/1966171747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a940d0c40 msgr2=0x7f0a9406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.787+0000 7f0a99a00640 1 --2- 172.21.15.121:0/1966171747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a940d0c40 0x7f0a9406d4f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0a94072960 tx=0x7f0a8c02a940 comp rx=0 tx=0).stop 2024-09-17T03:40:03.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.787+0000 7f0a99a00640 1 -- 172.21.15.121:0/1966171747 shutdown_connections 2024-09-17T03:40:03.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.787+0000 7f0a99a00640 1 --2- 172.21.15.121:0/1966171747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a940d0c40 0x7f0a9406d4f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.787+0000 7f0a99a00640 1 --2- 172.21.15.121:0/1966171747 >> v2:172.21.15.176:3300/0 conn(0x7f0a940cc270 0x7f0a940d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.787+0000 7f0a99a00640 1 -- 172.21.15.121:0/1966171747 >> 172.21.15.121:0/1966171747 conn(0x7f0a940b3580 msgr2=0x7f0a940b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:03.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.787+0000 7f0a99a00640 1 -- 172.21.15.121:0/1966171747 shutdown_connections 2024-09-17T03:40:03.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.787+0000 7f0a99a00640 1 -- 172.21.15.121:0/1966171747 wait complete. 2024-09-17T03:40:03.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.790+0000 7f0a99a00640 1 Processor -- start 2024-09-17T03:40:03.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.790+0000 7f0a99a00640 1 -- start start 2024-09-17T03:40:03.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.791+0000 7f0a99a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a940cc270 0x7f0a940b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.791+0000 7f0a99a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a940ce9e0 0x7f0a9415ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.791+0000 7f0a99a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a940d0c40 0x7f0a94156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.791+0000 7f0a99a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0a940705e0 con 0x7f0a940ce9e0 2024-09-17T03:40:03.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.791+0000 7f0a99a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a94070460 con 0x7f0a940d0c40 2024-09-17T03:40:03.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.791+0000 7f0a99a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a940af950 con 0x7f0a940cc270 2024-09-17T03:40:03.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.791+0000 7f0a92000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a940ce9e0 0x7f0a9415ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a92000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a940ce9e0 0x7f0a9415ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48620/0 (socket says 172.21.15.121:48620) 2024-09-17T03:40:03.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a92000640 1 -- 172.21.15.121:0/1823373447 learned_addr learned my addr 172.21.15.121:0/1823373447 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:03.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a92a00640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a940cc270 0x7f0a940b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a93400640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a940d0c40 0x7f0a94156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a92000640 1 -- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a940cc270 msgr2=0x7f0a940b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a92000640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a940cc270 0x7f0a940b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a92000640 1 -- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a940d0c40 msgr2=0x7f0a94156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a92000640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a940d0c40 0x7f0a94156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a92000640 1 -- 172.21.15.121:0/1823373447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9415bdf0 con 0x7f0a940ce9e0 2024-09-17T03:40:03.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a92000640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a940ce9e0 0x7f0a9415ea90 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000c760 tx=0x7f0a8000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:03.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.792+0000 7f0a8aa00640 1 -- 172.21.15.121:0/1823373447 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80016020 con 0x7f0a940ce9e0 2024-09-17T03:40:03.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.793+0000 7f0a8aa00640 1 -- 172.21.15.121:0/1823373447 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a8000a950 con 0x7f0a940ce9e0 2024-09-17T03:40:03.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.793+0000 7f0a8aa00640 1 -- 172.21.15.121:0/1823373447 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8000ada0 con 0x7f0a940ce9e0 2024-09-17T03:40:03.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.793+0000 7f0a99a00640 1 -- 172.21.15.121:0/1823373447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9415c0d0 con 0x7f0a940ce9e0 2024-09-17T03:40:03.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.793+0000 7f0a99a00640 1 -- 172.21.15.121:0/1823373447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9415c690 con 0x7f0a940ce9e0 2024-09-17T03:40:03.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.794+0000 7f0a99a00640 1 -- 172.21.15.121:0/1823373447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9406dba0 con 0x7f0a940ce9e0 2024-09-17T03:40:03.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.795+0000 7f0a8aa00640 1 -- 172.21.15.121:0/1823373447 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a80019020 con 0x7f0a940ce9e0 2024-09-17T03:40:03.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.796+0000 7f0a8aa00640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0a74078b90 0x7f0a7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.796+0000 7f0a8aa00640 1 -- 172.21.15.121:0/1823373447 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f0a8009ad90 con 0x7f0a940ce9e0 2024-09-17T03:40:03.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.796+0000 7f0a92a00640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0a74078b90 0x7f0a7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.797+0000 7f0a92a00640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0a74078b90 0x7f0a7407b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009b30 tx=0x7f0a84005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:03.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:03.800+0000 7f0a8aa00640 1 -- 172.21.15.121:0/1823373447 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a80020020 con 0x7f0a940ce9e0 2024-09-17T03:40:04.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.025+0000 7f0a99a00640 1 -- 172.21.15.121:0/1823373447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0a94155700 con 0x7f0a940ce9e0 2024-09-17T03:40:04.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.025+0000 7f0a8aa00640 1 -- 172.21.15.121:0/1823373447 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f0a940d1050 con 0x7f0a940ce9e0 2024-09-17T03:40:04.026 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:40:04.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 -- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0a74078b90 msgr2=0x7f0a7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:04.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0a74078b90 0x7f0a7407b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009b30 tx=0x7f0a84005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:04.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 -- 172.21.15.121:0/1823373447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a940ce9e0 msgr2=0x7f0a9415ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:04.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a940ce9e0 0x7f0a9415ea90 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000c760 tx=0x7f0a8000cc20 comp rx=0 tx=0).stop 2024-09-17T03:40:04.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 -- 172.21.15.121:0/1823373447 shutdown_connections 2024-09-17T03:40:04.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a940d0c40 0x7f0a94156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0a74078b90 0x7f0a7407b0a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a940ce9e0 0x7f0a9415ea90 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 --2- 172.21.15.121:0/1823373447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a940cc270 0x7f0a940b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 -- 172.21.15.121:0/1823373447 >> 172.21.15.121:0/1823373447 conn(0x7f0a940b3580 msgr2=0x7f0a940cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:04.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 -- 172.21.15.121:0/1823373447 shutdown_connections 2024-09-17T03:40:04.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04.028+0000 7f0a99a00640 1 -- 172.21.15.121:0/1823373447 wait complete. 2024-09-17T03:40:04.053 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:40:04.053 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:40:04.053 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:40:04.053 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:40:04.053 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:04.053 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:40:04.053 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:40:04.053 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:40:04.054 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:04.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:04.054 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:40:04.090 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:40:04.090 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:40:04.091 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:40:04.091 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:04.091 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:40:04.091 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:04.091 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:04.092 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:04.092 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:40:04.092 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:04.092 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:04.092 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:40:04.092 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:04.093 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:04.093 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:40:04.093 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:04.093 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:40:04.093 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42452sec preferred_lft 42452sec 2024-09-17T03:40:04.094 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:40:04.094 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:04.094 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:40:04.094 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:04.094 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:40:04.094 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:04.095 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:40:04.095 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:04.095 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:04.095 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:40:04.095 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:40:04.095 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:04.096 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:04.096 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:40:04.096 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:40:04.096 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:04.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:04.097 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:40:04.184 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:40:04.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:04.187 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:40:04.222 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:40:04.223 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:40:04.223 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:40:04.223 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:40:04.223 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:40:04.223 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:40:04.223 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:40:04.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:40:04.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:40:04.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:40:04.224 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:40:04.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:40:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:04.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:04.418 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:40:04.454 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:40:04.454 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:40:04.454 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:04.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:04.455 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:40:04.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:04.550 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:04.585 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:04.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:04.585 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:04.660 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:40:04.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:04.661 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:04.853 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:04.853 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:04.853 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:40:04.873 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:04.874 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:04.874 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:40:04.874 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:04.874 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:04.909 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:04.909 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:04.909 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:40:04.910 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:04.910 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:04.910 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:40:04.910 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:40:04.910 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:40:04.911 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:40:04.911 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:40:04.911 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:40:04.911 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:40:04.911 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:40:04.914 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:40:04.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:04.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:04.974 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:40:05.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:05.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:05.074 INFO:teuthology.orchestra.run.smithi121.stdout:client6023 2024-09-17T03:40:05.074 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:05.074 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:05.110 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:40:05.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.370+0000 7f559f200640 1 -- 172.21.15.121:0/2857728180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a0070810 msgr2=0x7f55a00b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:05.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.370+0000 7f559f200640 1 --2- 172.21.15.121:0/2857728180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a0070810 0x7f55a00b4c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5590009830 tx=0x7f559002a540 comp rx=0 tx=0).stop 2024-09-17T03:40:05.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.370+0000 7f559f200640 1 -- 172.21.15.121:0/2857728180 shutdown_connections 2024-09-17T03:40:05.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.370+0000 7f559f200640 1 --2- 172.21.15.121:0/2857728180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a0070810 0x7f55a00b4c80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.370+0000 7f559f200640 1 -- 172.21.15.121:0/2857728180 >> 172.21.15.121:0/2857728180 conn(0x7f55a00b2440 msgr2=0x7f55a00d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:05.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.370+0000 7f559f200640 1 -- 172.21.15.121:0/2857728180 shutdown_connections 2024-09-17T03:40:05.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.371+0000 7f559f200640 1 -- 172.21.15.121:0/2857728180 wait complete. 2024-09-17T03:40:05.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.373+0000 7f559f200640 1 Processor -- start 2024-09-17T03:40:05.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.373+0000 7f559f200640 1 -- start start 2024-09-17T03:40:05.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.374+0000 7f559f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55a0070810 0x7f55a01f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.374+0000 7f559f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a00b51c0 0x7f55a01e7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.374+0000 7f559f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00736e0 0x7f55a01f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.374+0000 7f559f200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55a006e0c0 con 0x7f55a0070810 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.374+0000 7f559f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55a006df40 con 0x7f55a00b51c0 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.374+0000 7f559f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55a006e240 con 0x7f55a00736e0 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f559de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55a0070810 0x7f55a01f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f559de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55a0070810 0x7f55a01f86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48630/0 (socket says 172.21.15.121:48630) 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f559de00640 1 -- 172.21.15.121:0/4140155079 learned_addr learned my addr 172.21.15.121:0/4140155079 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f559e800640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00736e0 0x7f55a01f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f5597e00640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a00b51c0 0x7f55a01e7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f559de00640 1 -- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00736e0 msgr2=0x7f55a01f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:05.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f559de00640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00736e0 0x7f55a01f4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f559de00640 1 -- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a00b51c0 msgr2=0x7f55a01e7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:05.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f559de00640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a00b51c0 0x7f55a01e7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f559de00640 1 -- 172.21.15.121:0/4140155079 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a01f9050 con 0x7f55a0070810 2024-09-17T03:40:05.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.375+0000 7f559de00640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55a0070810 0x7f55a01f86e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f559002ab30 tx=0x7f5590030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:05.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.376+0000 7f5596000640 1 -- 172.21.15.121:0/4140155079 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559003f070 con 0x7f55a0070810 2024-09-17T03:40:05.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.376+0000 7f5596000640 1 -- 172.21.15.121:0/4140155079 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5590030d40 con 0x7f55a0070810 2024-09-17T03:40:05.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.376+0000 7f559f200640 1 -- 172.21.15.121:0/4140155079 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a01f9330 con 0x7f55a0070810 2024-09-17T03:40:05.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.376+0000 7f5596000640 1 -- 172.21.15.121:0/4140155079 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590004280 con 0x7f55a0070810 2024-09-17T03:40:05.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.376+0000 7f559f200640 1 -- 172.21.15.121:0/4140155079 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a00731c0 con 0x7f55a0070810 2024-09-17T03:40:05.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.377+0000 7f559f200640 1 -- 172.21.15.121:0/4140155079 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a00b4c80 con 0x7f55a0070810 2024-09-17T03:40:05.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.378+0000 7f5596000640 1 -- 172.21.15.121:0/4140155079 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55900035f0 con 0x7f55a0070810 2024-09-17T03:40:05.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.379+0000 7f5596000640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f557c078b90 0x7f557c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:05.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.379+0000 7f5596000640 1 -- 172.21.15.121:0/4140155079 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f55900bba00 con 0x7f55a0070810 2024-09-17T03:40:05.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.379+0000 7f5597e00640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f557c078b90 0x7f557c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:05.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.380+0000 7f5597e00640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f557c078b90 0x7f557c07b0a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f55a00adf70 tx=0x7f5588009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:05.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.383+0000 7f5596000640 1 -- 172.21.15.121:0/4140155079 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5590083c20 con 0x7f55a0070810 2024-09-17T03:40:05.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.600+0000 7f559f200640 1 -- 172.21.15.121:0/4140155079 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f55a0145350 con 0x7f55a0070810 2024-09-17T03:40:05.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.600+0000 7f5596000640 1 -- 172.21.15.121:0/4140155079 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f5590083520 con 0x7f55a0070810 2024-09-17T03:40:05.601 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:40:05.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.602+0000 7f559f200640 1 -- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f557c078b90 msgr2=0x7f557c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.602+0000 7f559f200640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f557c078b90 0x7f557c07b0a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f55a00adf70 tx=0x7f5588009040 comp rx=0 tx=0).stop 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.602+0000 7f559f200640 1 -- 172.21.15.121:0/4140155079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55a0070810 msgr2=0x7f55a01f86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.603+0000 7f559f200640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55a0070810 0x7f55a01f86e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f559002ab30 tx=0x7f5590030650 comp rx=0 tx=0).stop 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.603+0000 7f559f200640 1 -- 172.21.15.121:0/4140155079 shutdown_connections 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.603+0000 7f559f200640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a00736e0 0x7f55a01f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.603+0000 7f559f200640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a00b51c0 0x7f55a01e7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.603+0000 7f559f200640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f557c078b90 0x7f557c07b0a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.603+0000 7f559f200640 1 --2- 172.21.15.121:0/4140155079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55a0070810 0x7f55a01f86e0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.603+0000 7f559f200640 1 -- 172.21.15.121:0/4140155079 >> 172.21.15.121:0/4140155079 conn(0x7f55a00b2440 msgr2=0x7f55a015f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.603+0000 7f559f200640 1 -- 172.21.15.121:0/4140155079 shutdown_connections 2024-09-17T03:40:05.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:05.603+0000 7f559f200640 1 -- 172.21.15.121:0/4140155079 wait complete. 2024-09-17T03:40:05.625 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:40:05.625 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:40:05.625 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:40:05.625 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:40:05.625 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:05.625 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:40:05.625 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:40:05.625 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:40:05.625 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:40:05.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:05.625 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:40:05.665 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:05.666 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42448sec preferred_lft 42448sec 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::80c9:d6ff:fe9f:5926/64 scope link 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:05.667 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:40:05.668 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d4cd:10ff:feb7:d68f/64 scope link 2024-09-17T03:40:05.668 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:05.668 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:05.668 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether fe:db:9e:03:5a:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:40:05.668 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::fcdb:9eff:fe03:5a3e/64 scope link 2024-09-17T03:40:05.668 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:05.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:05.669 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:40:05.766 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:40:05.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:05.770 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:40:05.808 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:40:05.808 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:40:05.808 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:40:05.808 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:40:05.808 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:40:05.808 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:40:05.809 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:40:05.809 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:40:05.809 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:40:05.809 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:40:05.809 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:40:05.926 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:40:05.998 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:06.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:06.007 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:40:06.042 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:40:06.042 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:40:06.042 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:40:06.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:06.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T03:40:06.139 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:06.139 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:06.186 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:40:06.186 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:06.187 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:06.221 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:40:06.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:06.221 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:06.415 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:06.427 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:40:06.427 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:40:06.435 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:06.435 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:40:06.435 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:40:06.435 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:06.435 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:06.466 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:06.466 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:40:06.466 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:40:06.466 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:06.466 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:06.466 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:40:06.466 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:40:06.466 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:40:06.468 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:40:06.468 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:40:06.468 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:40:06.468 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:40:06.468 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:40:06.471 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:40:06.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:06.471 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:06.526 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:40:06.604 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:06.607 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:06.615 INFO:teuthology.orchestra.run.smithi176.stdout:client6912 2024-09-17T03:40:06.615 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:06.616 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:06.651 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:06.651 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:06.692 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:06.693 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:06.772 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:40:07.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.034+0000 7fdea5c00640 1 -- 172.21.15.121:0/1156935571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde84003c10 msgr2=0x7fde84004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.034+0000 7fdea5c00640 1 --2- 172.21.15.121:0/1156935571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde84003c10 0x7fde84004060 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fde90001850 tx=0x7fde84005830 comp rx=0 tx=0).stop 2024-09-17T03:40:07.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.034+0000 7fdea5200640 1 -- 172.21.15.121:0/1156935571 reap_dead start 2024-09-17T03:40:07.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.034+0000 7fdea5c00640 1 -- 172.21.15.121:0/1156935571 shutdown_connections 2024-09-17T03:40:07.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.034+0000 7fdea5c00640 1 -- 172.21.15.121:0/1156935571 >> 172.21.15.121:0/1156935571 conn(0x7fdea00d07f0 msgr2=0x7fdea00b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:07.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.034+0000 7fdea5c00640 1 -- 172.21.15.121:0/1156935571 shutdown_connections 2024-09-17T03:40:07.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.034+0000 7fdea5c00640 1 -- 172.21.15.121:0/1156935571 wait complete. 2024-09-17T03:40:07.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.036+0000 7fdea5c00640 1 Processor -- start 2024-09-17T03:40:07.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.036+0000 7fdea5c00640 1 -- start start 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fdea5c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde84003c10 0x7fdea00b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fdea5c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdea014bde0 0x7fdea01fd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fdea5c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdea014c1f0 0x7fdea01fd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fdea5c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdea00b30b0 con 0x7fdea014c1f0 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fdea5c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdea00b3230 con 0x7fdea014bde0 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fdea5c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdea0073840 con 0x7fde84003c10 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fdea5200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdea014c1f0 0x7fdea01fd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fdea5200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdea014c1f0 0x7fdea01fd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48644/0 (socket says 172.21.15.121:48644) 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fdea5200640 1 -- 172.21.15.121:0/1181695629 learned_addr learned my addr 172.21.15.121:0/1181695629 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fde9fe00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde84003c10 0x7fdea00b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.038+0000 7fde9f400640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdea014bde0 0x7fdea01fd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fdea5200640 1 -- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde84003c10 msgr2=0x7fdea00b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fdea5200640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde84003c10 0x7fdea00b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fdea5200640 1 -- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdea014bde0 msgr2=0x7fdea01fd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fdea5200640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdea014bde0 0x7fdea01fd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fdea5200640 1 -- 172.21.15.121:0/1181695629 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea01488c0 con 0x7fdea014c1f0 2024-09-17T03:40:07.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fde9fe00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde84003c10 0x7fdea00b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:07.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fdea5200640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdea014c1f0 0x7fdea01fd590 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fdea0072ab0 tx=0x7fde9800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:07.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fde97e00640 1 -- 172.21.15.121:0/1181695629 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98017070 con 0x7fdea014c1f0 2024-09-17T03:40:07.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fde97e00640 1 -- 172.21.15.121:0/1181695629 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde98015070 con 0x7fdea014c1f0 2024-09-17T03:40:07.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fdea5c00640 1 -- 172.21.15.121:0/1181695629 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea0148ba0 con 0x7fdea014c1f0 2024-09-17T03:40:07.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fde97e00640 1 -- 172.21.15.121:0/1181695629 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9800eea0 con 0x7fdea014c1f0 2024-09-17T03:40:07.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.039+0000 7fdea5c00640 1 -- 172.21.15.121:0/1181695629 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea0149160 con 0x7fdea014c1f0 2024-09-17T03:40:07.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.040+0000 7fdea5c00640 1 -- 172.21.15.121:0/1181695629 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea0148630 con 0x7fdea014c1f0 2024-09-17T03:40:07.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.042+0000 7fde97e00640 1 -- 172.21.15.121:0/1181695629 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde98011440 con 0x7fdea014c1f0 2024-09-17T03:40:07.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.043+0000 7fde97e00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde80078b90 0x7fde8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.043+0000 7fde97e00640 1 -- 172.21.15.121:0/1181695629 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fde9809b930 con 0x7fdea014c1f0 2024-09-17T03:40:07.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.043+0000 7fde9fe00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde80078b90 0x7fde8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.044+0000 7fde9fe00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde80078b90 0x7fde8007b0a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdea006ff30 tx=0x7fde900013b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:07.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.047+0000 7fde97e00640 1 -- 172.21.15.121:0/1181695629 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde98063bd0 con 0x7fdea014c1f0 2024-09-17T03:40:07.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.242+0000 7fdea5c00640 1 -- 172.21.15.121:0/1181695629 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdea00cd680 con 0x7fdea014c1f0 2024-09-17T03:40:07.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.242+0000 7fde97e00640 1 -- 172.21.15.121:0/1181695629 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) ==== 80+0+0 (secure 0 0 0) 0x7fdea00cd680 con 0x7fdea014c1f0 2024-09-17T03:40:07.243 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:40:07.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 -- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde80078b90 msgr2=0x7fde8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde80078b90 0x7fde8007b0a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdea006ff30 tx=0x7fde900013b0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 -- 172.21.15.121:0/1181695629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdea014c1f0 msgr2=0x7fdea01fd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdea014c1f0 0x7fdea01fd590 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fdea0072ab0 tx=0x7fde9800e720 comp rx=0 tx=0).stop 2024-09-17T03:40:07.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 -- 172.21.15.121:0/1181695629 shutdown_connections 2024-09-17T03:40:07.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fde80078b90 0x7fde8007b0a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdea014c1f0 0x7fdea01fd590 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdea014bde0 0x7fdea01fd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 --2- 172.21.15.121:0/1181695629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde84003c10 0x7fdea00b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 -- 172.21.15.121:0/1181695629 >> 172.21.15.121:0/1181695629 conn(0x7fdea00d07f0 msgr2=0x7fdea015d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:07.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 -- 172.21.15.121:0/1181695629 shutdown_connections 2024-09-17T03:40:07.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.245+0000 7fdea5c00640 1 -- 172.21.15.121:0/1181695629 wait complete. 2024-09-17T03:40:07.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:40:07.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:07.268 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:07.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:40:07.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:07.332 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:40:07.369 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:07.369 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:07.406 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:07.406 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:07.481 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:40:07.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.701+0000 7fd791e00640 1 -- 172.21.15.121:0/1686411063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78c15a3e0 msgr2=0x7fd78c06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.701+0000 7fd791e00640 1 --2- 172.21.15.121:0/1686411063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78c15a3e0 0x7fd78c06d800 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009830 tx=0x7fd77c02a3f0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.701+0000 7fd791e00640 1 -- 172.21.15.121:0/1686411063 shutdown_connections 2024-09-17T03:40:07.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.701+0000 7fd791e00640 1 --2- 172.21.15.121:0/1686411063 >> v2:172.21.15.176:3300/0 conn(0x7fd78c06ddc0 0x7fd78c0d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.701+0000 7fd791e00640 1 --2- 172.21.15.121:0/1686411063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78c15a3e0 0x7fd78c06d800 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.701+0000 7fd791e00640 1 -- 172.21.15.121:0/1686411063 >> 172.21.15.121:0/1686411063 conn(0x7fd78c0b3580 msgr2=0x7fd78c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:07.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.701+0000 7fd791e00640 1 -- 172.21.15.121:0/1686411063 shutdown_connections 2024-09-17T03:40:07.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.701+0000 7fd791e00640 1 -- 172.21.15.121:0/1686411063 wait complete. 2024-09-17T03:40:07.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.704+0000 7fd791e00640 1 Processor -- start 2024-09-17T03:40:07.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.704+0000 7fd791e00640 1 -- start start 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.705+0000 7fd791e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78c06ddc0 0x7fd78c1f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.705+0000 7fd791e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd78c0d0af0 0x7fd78c1f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.705+0000 7fd791e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd78c15a3e0 0x7fd78c073d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.705+0000 7fd791e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c06f560 con 0x7fd78c0d0af0 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.705+0000 7fd791e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c161190 con 0x7fd78c15a3e0 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.705+0000 7fd791e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd78c06f6e0 con 0x7fd78c06ddc0 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.705+0000 7fd78a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd78c0d0af0 0x7fd78c1f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd78c0d0af0 0x7fd78c1f6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48656/0 (socket says 172.21.15.121:48656) 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78a000640 1 -- 172.21.15.121:0/215119535 learned_addr learned my addr 172.21.15.121:0/215119535 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78aa00640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78c06ddc0 0x7fd78c1f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78b400640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd78c15a3e0 0x7fd78c073d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78a000640 1 -- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78c06ddc0 msgr2=0x7fd78c1f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78a000640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78c06ddc0 0x7fd78c1f7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78a000640 1 -- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd78c15a3e0 msgr2=0x7fd78c073d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78a000640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd78c15a3e0 0x7fd78c073d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78a000640 1 -- 172.21.15.121:0/215119535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c1f8090 con 0x7fd78c0d0af0 2024-09-17T03:40:07.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78b400640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd78c15a3e0 0x7fd78c073d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:07.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.706+0000 7fd78a000640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd78c0d0af0 0x7fd78c1f6900 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fd7780058c0 tx=0x7fd77800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:07.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.707+0000 7fd783400640 1 -- 172.21.15.121:0/215119535 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77800cd00 con 0x7fd78c0d0af0 2024-09-17T03:40:07.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.707+0000 7fd783400640 1 -- 172.21.15.121:0/215119535 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd778004030 con 0x7fd78c0d0af0 2024-09-17T03:40:07.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.707+0000 7fd791e00640 1 -- 172.21.15.121:0/215119535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78c1f4af0 con 0x7fd78c0d0af0 2024-09-17T03:40:07.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.707+0000 7fd783400640 1 -- 172.21.15.121:0/215119535 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778004460 con 0x7fd78c0d0af0 2024-09-17T03:40:07.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.707+0000 7fd791e00640 1 -- 172.21.15.121:0/215119535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78c1f4250 con 0x7fd78c0d0af0 2024-09-17T03:40:07.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.708+0000 7fd791e00640 1 -- 172.21.15.121:0/215119535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78c050f60 con 0x7fd78c0d0af0 2024-09-17T03:40:07.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.709+0000 7fd783400640 1 -- 172.21.15.121:0/215119535 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7780035f0 con 0x7fd78c0d0af0 2024-09-17T03:40:07.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.710+0000 7fd783400640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd76c078b90 0x7fd76c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.710+0000 7fd783400640 1 -- 172.21.15.121:0/215119535 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fd77809b8b0 con 0x7fd78c0d0af0 2024-09-17T03:40:07.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.710+0000 7fd78aa00640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd76c078b90 0x7fd76c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.711+0000 7fd78aa00640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd76c078b90 0x7fd76c07b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd77c034000 tx=0x7fd77c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:07.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.714+0000 7fd783400640 1 -- 172.21.15.121:0/215119535 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd78c050f60 con 0x7fd78c0d0af0 2024-09-17T03:40:07.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.910+0000 7fd791e00640 1 -- 172.21.15.121:0/215119535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd78c06fb90 con 0x7fd78c0d0af0 2024-09-17T03:40:07.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.911+0000 7fd783400640 1 -- 172.21.15.121:0/215119535 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) ==== 80+0+0 (secure 0 0 0) 0x7fd778063a40 con 0x7fd78c0d0af0 2024-09-17T03:40:07.912 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:40:07.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.913+0000 7fd791e00640 1 -- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd76c078b90 msgr2=0x7fd76c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.913+0000 7fd791e00640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd76c078b90 0x7fd76c07b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd77c034000 tx=0x7fd77c004730 comp rx=0 tx=0).stop 2024-09-17T03:40:07.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.913+0000 7fd791e00640 1 -- 172.21.15.121:0/215119535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd78c0d0af0 msgr2=0x7fd78c1f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.913+0000 7fd791e00640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd78c0d0af0 0x7fd78c1f6900 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fd7780058c0 tx=0x7fd77800ee50 comp rx=0 tx=0).stop 2024-09-17T03:40:07.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.913+0000 7fd791e00640 1 -- 172.21.15.121:0/215119535 shutdown_connections 2024-09-17T03:40:07.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.913+0000 7fd791e00640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd78c15a3e0 0x7fd78c073d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.913+0000 7fd791e00640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd76c078b90 0x7fd76c07b0a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.914+0000 7fd791e00640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd78c0d0af0 0x7fd78c1f6900 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.914+0000 7fd791e00640 1 --2- 172.21.15.121:0/215119535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78c06ddc0 0x7fd78c1f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.914+0000 7fd791e00640 1 -- 172.21.15.121:0/215119535 >> 172.21.15.121:0/215119535 conn(0x7fd78c0b3580 msgr2=0x7fd78c15f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:07.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.914+0000 7fd791e00640 1 -- 172.21.15.121:0/215119535 shutdown_connections 2024-09-17T03:40:07.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:07.914+0000 7fd791e00640 1 -- 172.21.15.121:0/215119535 wait complete. 2024-09-17T03:40:07.940 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:40:07.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:07.941 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:08.004 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:40:08.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:08.005 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:40:08.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:08.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.263+0000 7f4f10a00640 1 -- 172.21.15.121:0/1102117592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f0c0d0af0 msgr2=0x7f4f0c15cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.263+0000 7f4f10a00640 1 --2- 172.21.15.121:0/1102117592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f0c0d0af0 0x7f4f0c15cc10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009830 tx=0x7f4f0402a3f0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.263+0000 7f4f10a00640 1 -- 172.21.15.121:0/1102117592 shutdown_connections 2024-09-17T03:40:08.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.263+0000 7f4f10a00640 1 --2- 172.21.15.121:0/1102117592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f0c0d0af0 0x7f4f0c15cc10 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.263+0000 7f4f10a00640 1 --2- 172.21.15.121:0/1102117592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c06d800 0x7f4f0c0d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.263+0000 7f4f10a00640 1 -- 172.21.15.121:0/1102117592 >> 172.21.15.121:0/1102117592 conn(0x7f4f0c0b3580 msgr2=0x7f4f0c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:08.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.263+0000 7f4f10a00640 1 -- 172.21.15.121:0/1102117592 shutdown_connections 2024-09-17T03:40:08.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.263+0000 7f4f10a00640 1 -- 172.21.15.121:0/1102117592 wait complete. 2024-09-17T03:40:08.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.265+0000 7f4f10a00640 1 Processor -- start 2024-09-17T03:40:08.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.266+0000 7f4f10a00640 1 -- start start 2024-09-17T03:40:08.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.267+0000 7f4f10a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f0c06d800 0x7f4f0c154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.267+0000 7f4f10a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0d0af0 0x7f4f0c09cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.267+0000 7f4f10a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f0c15a3e0 0x7f4f0c09d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.267+0000 7f4f10a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0c15d4e0 con 0x7f4f0c06d800 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.267+0000 7f4f10a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0c15d360 con 0x7f4f0c15a3e0 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.267+0000 7f4f10a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0c15d660 con 0x7f4f0c0d0af0 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.267+0000 7f4f09e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f0c06d800 0x7f4f0c154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.267+0000 7f4f09e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f0c06d800 0x7f4f0c154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48684/0 (socket says 172.21.15.121:48684) 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.267+0000 7f4f09e00640 1 -- 172.21.15.121:0/4151425642 learned_addr learned my addr 172.21.15.121:0/4151425642 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.267+0000 7f4f0a800640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f0c15a3e0 0x7f4f0c09d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f01400640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0d0af0 0x7f4f0c09cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f09e00640 1 -- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0d0af0 msgr2=0x7f4f0c09cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f09e00640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0d0af0 0x7f4f0c09cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f09e00640 1 -- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f0c15a3e0 msgr2=0x7f4f0c09d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f09e00640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f0c15a3e0 0x7f4f0c09d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f09e00640 1 -- 172.21.15.121:0/4151425642 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0c154a60 con 0x7f4f0c06d800 2024-09-17T03:40:08.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f01400640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0d0af0 0x7f4f0c09cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:08.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f09e00640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f0c06d800 0x7f4f0c154520 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00cb80 tx=0x7f4efc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:08.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f02a00640 1 -- 172.21.15.121:0/4151425642 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc016020 con 0x7f4f0c06d800 2024-09-17T03:40:08.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f02a00640 1 -- 172.21.15.121:0/4151425642 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4efc00ae50 con 0x7f4f0c06d800 2024-09-17T03:40:08.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f10a00640 1 -- 172.21.15.121:0/4151425642 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0c15bb50 con 0x7f4f0c06d800 2024-09-17T03:40:08.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.268+0000 7f4f02a00640 1 -- 172.21.15.121:0/4151425642 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc012680 con 0x7f4f0c06d800 2024-09-17T03:40:08.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.269+0000 7f4f10a00640 1 -- 172.21.15.121:0/4151425642 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0c09a640 con 0x7f4f0c06d800 2024-09-17T03:40:08.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.270+0000 7f4f10a00640 1 -- 172.21.15.121:0/4151425642 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f0c15db80 con 0x7f4f0c06d800 2024-09-17T03:40:08.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.271+0000 7f4f02a00640 1 -- 172.21.15.121:0/4151425642 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4efc019020 con 0x7f4f0c06d800 2024-09-17T03:40:08.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.272+0000 7f4f02a00640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ee8078bc0 0x7f4ee807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.272+0000 7f4f02a00640 1 -- 172.21.15.121:0/4151425642 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f4efc09b3e0 con 0x7f4f0c06d800 2024-09-17T03:40:08.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.273+0000 7f4f01400640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ee8078bc0 0x7f4ee807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.273+0000 7f4f01400640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ee8078bc0 0x7f4ee807b0d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0ca6b0 tx=0x7f4ef4005f10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:08.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.277+0000 7f4f02a00640 1 -- 172.21.15.121:0/4151425642 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4efc020020 con 0x7f4f0c06d800 2024-09-17T03:40:08.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.493+0000 7f4f10a00640 1 -- 172.21.15.121:0/4151425642 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f0c15f2e0 con 0x7f4f0c06d800 2024-09-17T03:40:08.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.494+0000 7f4f02a00640 1 -- 172.21.15.121:0/4151425642 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f4f0c0d0f00 con 0x7f4f0c06d800 2024-09-17T03:40:08.495 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:08.495 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":68,"btime":"2024-09-17T03:39:59:942558+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3550639124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3550639124},{"type":"v1","addr":"172.21.15.176:6836","nonce":3550639124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/479907239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":479907239},{"type":"v1","addr":"172.21.15.121:6833","nonce":479907239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3992738504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3992738504},{"type":"v1","addr":"172.21.15.121:6835","nonce":3992738504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:56.408137+0000","modified":"2024-09-17T03:39:59.424876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/3841878149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3841878149},{"type":"v1","addr":"172.21.15.176:6837","nonce":3841878149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6768,"qdb_cluster":[6768]},"id":7}]} 2024-09-17T03:40:08.495 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 68 2024-09-17T03:40:08.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 -- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ee8078bc0 msgr2=0x7f4ee807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ee8078bc0 0x7f4ee807b0d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0ca6b0 tx=0x7f4ef4005f10 comp rx=0 tx=0).stop 2024-09-17T03:40:08.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 -- 172.21.15.121:0/4151425642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f0c06d800 msgr2=0x7f4f0c154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f0c06d800 0x7f4f0c154520 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00cb80 tx=0x7f4efc00a430 comp rx=0 tx=0).stop 2024-09-17T03:40:08.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 -- 172.21.15.121:0/4151425642 shutdown_connections 2024-09-17T03:40:08.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f0c15a3e0 0x7f4f0c09d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f0c0d0af0 0x7f4f0c09cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ee8078bc0 0x7f4ee807b0d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 --2- 172.21.15.121:0/4151425642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f0c06d800 0x7f4f0c154520 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 -- 172.21.15.121:0/4151425642 >> 172.21.15.121:0/4151425642 conn(0x7f4f0c0b3580 msgr2=0x7f4f0c15ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:08.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.496+0000 7f4f10a00640 1 -- 172.21.15.121:0/4151425642 shutdown_connections 2024-09-17T03:40:08.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.497+0000 7f4f10a00640 1 -- 172.21.15.121:0/4151425642 wait complete. 2024-09-17T03:40:08.522 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 session ls 2024-09-17T03:40:08.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.743+0000 7ff816200640 1 -- 172.21.15.121:0/574143696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8100b5250 msgr2=0x7ff8100cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.743+0000 7ff816200640 1 --2- 172.21.15.121:0/574143696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8100b5250 0x7ff8100cd180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff800009820 tx=0x7ff80002a510 comp rx=0 tx=0).stop 2024-09-17T03:40:08.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.743+0000 7ff816200640 1 -- 172.21.15.121:0/574143696 shutdown_connections 2024-09-17T03:40:08.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.743+0000 7ff816200640 1 --2- 172.21.15.121:0/574143696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8100b5250 0x7ff8100cd180 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.743+0000 7ff816200640 1 -- 172.21.15.121:0/574143696 >> 172.21.15.121:0/574143696 conn(0x7ff8100d07f0 msgr2=0x7ff8100b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:08.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.743+0000 7ff816200640 1 -- 172.21.15.121:0/574143696 shutdown_connections 2024-09-17T03:40:08.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.743+0000 7ff816200640 1 -- 172.21.15.121:0/574143696 wait complete. 2024-09-17T03:40:08.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.745+0000 7ff816200640 1 Processor -- start 2024-09-17T03:40:08.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.746+0000 7ff816200640 1 -- start start 2024-09-17T03:40:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff816200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8100b5250 0x7ff81013bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff816200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff81015ca70 0x7ff81013e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff816200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff81015d590 0x7ff81013e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff816200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff81006e150 con 0x7ff8100b5250 2024-09-17T03:40:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff816200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff81006dfd0 con 0x7ff81015d590 2024-09-17T03:40:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff816200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff81006e2d0 con 0x7ff81015ca70 2024-09-17T03:40:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff814e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8100b5250 0x7ff81013bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff814e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8100b5250 0x7ff81013bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48686/0 (socket says 172.21.15.121:48686) 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff814e00640 1 -- 172.21.15.121:0/1567658431 learned_addr learned my addr 172.21.15.121:0/1567658431 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff807e00640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff81015ca70 0x7ff81013e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.747+0000 7ff815800640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff81015d590 0x7ff81013e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.748+0000 7ff814e00640 1 -- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff81015ca70 msgr2=0x7ff81013e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.748+0000 7ff814e00640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff81015ca70 0x7ff81013e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.748+0000 7ff814e00640 1 -- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff81015d590 msgr2=0x7ff81013e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.748+0000 7ff814e00640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff81015d590 0x7ff81013e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.748+0000 7ff814e00640 1 -- 172.21.15.121:0/1567658431 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81014fcc0 con 0x7ff8100b5250 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.748+0000 7ff814e00640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8100b5250 0x7ff81013bb20 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff800009910 tx=0x7ff8000052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.748+0000 7ff80d600640 1 -- 172.21.15.121:0/1567658431 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff800005c30 con 0x7ff8100b5250 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.748+0000 7ff80d600640 1 -- 172.21.15.121:0/1567658431 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff800031c40 con 0x7ff8100b5250 2024-09-17T03:40:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.748+0000 7ff816200640 1 -- 172.21.15.121:0/1567658431 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81013c060 con 0x7ff8100b5250 2024-09-17T03:40:08.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.748+0000 7ff80d600640 1 -- 172.21.15.121:0/1567658431 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff800004a00 con 0x7ff8100b5250 2024-09-17T03:40:08.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.749+0000 7ff816200640 1 -- 172.21.15.121:0/1567658431 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8101531e0 con 0x7ff8100b5250 2024-09-17T03:40:08.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.751+0000 7ff80d600640 1 -- 172.21.15.121:0/1567658431 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff800004ba0 con 0x7ff8100b5250 2024-09-17T03:40:08.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.752+0000 7ff80d600640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7ec078bc0 0x7ff7ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.752+0000 7ff80d600640 1 -- 172.21.15.121:0/1567658431 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7ff8000bc3a0 con 0x7ff8100b5250 2024-09-17T03:40:08.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.752+0000 7ff81e7c3740 1 Processor -- start 2024-09-17T03:40:08.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.752+0000 7ff807e00640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7ec078bc0 0x7ff7ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.752+0000 7ff81e7c3740 1 -- start start 2024-09-17T03:40:08.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.753+0000 7ff807e00640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7ec078bc0 0x7ff7ec07b0d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff8100ce010 tx=0x7ff7f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eae95290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaec0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaea1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5651eaded6f0 con 0x5651eaab26b0 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5651eaddcb20 con 0x5651eaaaa4d0 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5651eade0930 con 0x5651eaad3390 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff815800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaea1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff815800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaea1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48698/0 (socket says 172.21.15.121:48698) 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff815800640 1 -- 172.21.15.121:0/2746421380 learned_addr learned my addr 172.21.15.121:0/2746421380 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff807e00640 1 --2- 172.21.15.121:0/2746421380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaec0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.754+0000 7ff814e00640 1 --2- 172.21.15.121:0/2746421380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eae95290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.755+0000 7ff815800640 1 -- 172.21.15.121:0/2746421380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 msgr2=0x5651eae95290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:08.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.755+0000 7ff815800640 1 --2- 172.21.15.121:0/2746421380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eae95290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.755+0000 7ff815800640 1 -- 172.21.15.121:0/2746421380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 msgr2=0x5651eaec0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:08.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.755+0000 7ff815800640 1 --2- 172.21.15.121:0/2746421380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaec0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.755+0000 7ff815800640 1 -- 172.21.15.121:0/2746421380 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651eab3e970 con 0x5651eaab26b0 2024-09-17T03:40:08.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.755+0000 7ff814e00640 1 --2- 172.21.15.121:0/2746421380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eae95290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:08.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.755+0000 7ff815800640 1 --2- 172.21.15.121:0/2746421380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaea1e80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff808001fc0 tx=0x7ff80800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3596018f4064d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:08.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.755+0000 7ff805600640 1 -- 172.21.15.121:0/2746421380 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80800ee50 con 0x5651eaab26b0 2024-09-17T03:40:08.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.755+0000 7ff805600640 1 -- 172.21.15.121:0/2746421380 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff808019070 con 0x5651eaab26b0 2024-09-17T03:40:08.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.755+0000 7ff805600640 1 -- 172.21.15.121:0/2746421380 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8080146c0 con 0x5651eaab26b0 2024-09-17T03:40:08.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.756+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2746421380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 msgr2=0x5651eaea1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.756+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/2746421380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaea1e80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff808001fc0 tx=0x7ff80800e530 comp rx=0 tx=0).stop 2024-09-17T03:40:08.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.756+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2746421380 shutdown_connections 2024-09-17T03:40:08.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.756+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/2746421380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaea1e80 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.756+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/2746421380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaec0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.756+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/2746421380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eae95290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.756+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2746421380 >> 172.21.15.121:0/2746421380 conn(0x5651eaac74e0 msgr2=0x5651eae7b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:08.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.756+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2746421380 shutdown_connections 2024-09-17T03:40:08.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.756+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2746421380 wait complete. 2024-09-17T03:40:08.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.757+0000 7ff81e7c3740 1 -- start start 2024-09-17T03:40:08.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.758+0000 7ff81e7c3740 1 Processor -- start 2024-09-17T03:40:08.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.759+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaed0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.759+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaeb9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.759+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eaed68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.759+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5651eab4d740 con 0x5651eaab26b0 2024-09-17T03:40:08.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.759+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5651ead83290 con 0x5651eaaaa4d0 2024-09-17T03:40:08.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.759+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5651eae94530 con 0x5651eaad3390 2024-09-17T03:40:08.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.759+0000 7ff81e7c3740 10 client.0 _ll_register_callbacks cb 0x5651ead601e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:08.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.759+0000 7ff807e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaeb9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.759+0000 7ff807e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaeb9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48712/0 (socket says 172.21.15.121:48712) 2024-09-17T03:40:08.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.759+0000 7ff807e00640 1 -- 172.21.15.121:0/2495750880 learned_addr learned my addr 172.21.15.121:0/2495750880 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:08.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff814e00640 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaed0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff815800640 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eaed68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff807e00640 1 -- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 msgr2=0x5651eaed68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:08.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff807e00640 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eaed68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff807e00640 1 -- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 msgr2=0x5651eaed0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:08.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff807e00640 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaed0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff807e00640 1 -- 172.21.15.121:0/2495750880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651eabb57d0 con 0x5651eaab26b0 2024-09-17T03:40:08.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff814e00640 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaed0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:08.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff807e00640 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaeb9710 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8003940 tx=0x7ff7f8001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d042d24e650930 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:08.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff7fe000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:08.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff7fe000640 1 -- 172.21.15.121:0/2495750880 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8028060 con 0x5651eaab26b0 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff7fe000640 1 -- 172.21.15.121:0/2495750880 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7ff7f8010040 con 0x5651eaab26b0 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.760+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2495750880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff808019070 con 0x5651eaab26b0 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff7fe000640 1 -- 172.21.15.121:0/2495750880 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7ff7f800ec40 con 0x5651eaab26b0 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff81e7c3740 10 client.6942 fetch_fsmap learned FSMap version 68 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2495750880 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5651eaebcb50 con 0x5651eaab26b0 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff7fe000640 1 -- 172.21.15.121:0/2495750880 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff808019070 con 0x5651eaab26b0 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff7fe000640 1 -- 172.21.15.121:0/2495750880 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7ff7f8013420 con 0x5651eaab26b0 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff81e7c3740 10 client.6942 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff81e7c3740 10 client.6942 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff81e7c3740 20 client.6942 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x5651eaa91f60 0x5651eaebba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff81e7c3740 4 client.6942 mds_command: new command op to 6768 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:08.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.761+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2495750880 --> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651eadef640 con 0x5651eaa91f60 2024-09-17T03:40:08.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.762+0000 7ff814e00640 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x5651eaa91f60 0x5651eaebba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.762+0000 7ff814e00640 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x5651eaa91f60 0x5651eaebba40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45488c50a6c70e6f server_cookie=76be8b83d47aa234 in_seq=0 out_seq=0 2024-09-17T03:40:08.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.762+0000 7ff7fe000640 10 client.6942 ms_handle_connect on v2:172.21.15.176:6835/3841878149 2024-09-17T03:40:08.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff7fe000640 1 -- 172.21.15.121:0/2495750880 <== mds.0 v2:172.21.15.176:6835/3841878149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5651eadef640 con 0x5651eaa91f60 2024-09-17T03:40:08.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff7fe000640 10 client.6942 handle_command_reply: tid=0 2024-09-17T03:40:08.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff81e7c3740 1 client.6942 shutdown 2024-09-17T03:40:08.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2495750880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 msgr2=0x5651eaeb9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaeb9710 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8003940 tx=0x7ff7f8001080 comp rx=0 tx=0).stop 2024-09-17T03:40:08.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2495750880 shutdown_connections 2024-09-17T03:40:08.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eaed68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x5651eaa91f60 0x5651eaebba40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaeb9710 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/2495750880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaed0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2495750880 >> 172.21.15.121:0/2495750880 conn(0x5651eaac74e0 msgr2=0x5651eaea1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:08.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.763+0000 7ff7fe000640 0 client.6942 ms_handle_reset on v2:172.21.15.176:6835/3841878149 2024-09-17T03:40:08.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.764+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2495750880 shutdown_connections 2024-09-17T03:40:08.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.764+0000 7ff81e7c3740 1 -- 172.21.15.121:0/2495750880 wait complete. 2024-09-17T03:40:08.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.764+0000 7ff81e7c3740 20 client.6942 trim_cache size 0 max 16384 2024-09-17T03:40:08.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.783+0000 7ff81e7c3740 1 Processor -- start 2024-09-17T03:40:08.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.783+0000 7ff81e7c3740 1 -- start start 2024-09-17T03:40:08.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.784+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaaaa4d0 0x5651eaec1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.784+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.784+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaad3390 0x5651eaec1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.784+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff8101fe100 con 0x5651eaab26b0 2024-09-17T03:40:08.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.784+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff810074c20 con 0x5651eaad3390 2024-09-17T03:40:08.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.784+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff810073f80 con 0x5651eaaaa4d0 2024-09-17T03:40:08.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff807e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff807e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48718/0 (socket says 172.21.15.121:48718) 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff807e00640 1 -- 172.21.15.121:0/3198202653 learned_addr learned my addr 172.21.15.121:0/3198202653 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff815800640 1 --2- 172.21.15.121:0/3198202653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaad3390 0x5651eaec1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff814e00640 1 --2- 172.21.15.121:0/3198202653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaaaa4d0 0x5651eaec1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff807e00640 1 -- 172.21.15.121:0/3198202653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaaaa4d0 msgr2=0x5651eaec1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff807e00640 1 --2- 172.21.15.121:0/3198202653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaaaa4d0 0x5651eaec1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff807e00640 1 -- 172.21.15.121:0/3198202653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaad3390 msgr2=0x5651eaec1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff807e00640 1 --2- 172.21.15.121:0/3198202653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaad3390 0x5651eaec1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff807e00640 1 -- 172.21.15.121:0/3198202653 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651eae94310 con 0x5651eaab26b0 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff807e00640 1 --2- 172.21.15.121:0/3198202653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8007da0 tx=0x7ff7f8003630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded594e134efe2bf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.785+0000 7ff804c00640 1 -- 172.21.15.121:0/3198202653 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8017020 con 0x5651eaab26b0 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff804c00640 1 -- 172.21.15.121:0/3198202653 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7f8019070 con 0x5651eaab26b0 2024-09-17T03:40:08.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff804c00640 1 -- 172.21.15.121:0/3198202653 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800e880 con 0x5651eaab26b0 2024-09-17T03:40:08.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff81e7c3740 1 -- 172.21.15.121:0/3198202653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 msgr2=0x5651eaec0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/3198202653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8007da0 tx=0x7ff7f8003630 comp rx=0 tx=0).stop 2024-09-17T03:40:08.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff81e7c3740 1 -- 172.21.15.121:0/3198202653 shutdown_connections 2024-09-17T03:40:08.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/3198202653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaad3390 0x5651eaec1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/3198202653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/3198202653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaaaa4d0 0x5651eaec1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff81e7c3740 1 -- 172.21.15.121:0/3198202653 >> 172.21.15.121:0/3198202653 conn(0x5651eaac74e0 msgr2=0x5651eae767f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:08.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff81e7c3740 1 -- 172.21.15.121:0/3198202653 shutdown_connections 2024-09-17T03:40:08.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.786+0000 7ff81e7c3740 1 -- 172.21.15.121:0/3198202653 wait complete. 2024-09-17T03:40:08.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.787+0000 7ff81e7c3740 1 -- start start 2024-09-17T03:40:08.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.787+0000 7ff81e7c3740 1 Processor -- start 2024-09-17T03:40:08.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaf3af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff81e7c3740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eaec1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff8100745d0 con 0x5651eaab26b0 2024-09-17T03:40:08.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5651eae78570 con 0x5651eaaaa4d0 2024-09-17T03:40:08.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff81e7c3740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5651eaecf740 con 0x5651eaad3390 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff81e7c3740 10 client.0 _ll_register_callbacks cb 0x7ff7f80051d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff807e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff807e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48724/0 (socket says 172.21.15.121:48724) 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff807e00640 1 -- 172.21.15.121:0/1189414768 learned_addr learned my addr 172.21.15.121:0/1189414768 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff814e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaf3af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.789+0000 7ff815800640 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eaec1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.790+0000 7ff807e00640 1 -- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 msgr2=0x5651eaec1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.790+0000 7ff807e00640 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eaec1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.790+0000 7ff807e00640 1 -- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 msgr2=0x5651eaf3af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.790+0000 7ff807e00640 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaf3af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.790+0000 7ff807e00640 1 -- 172.21.15.121:0/1189414768 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651eaf3b460 con 0x5651eaab26b0 2024-09-17T03:40:08.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.790+0000 7ff807e00640 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8016040 tx=0x7ff7f8008fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bda4488be2a48d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:08.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.790+0000 7ff7fe000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:08.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.790+0000 7ff7fe000640 1 -- 172.21.15.121:0/1189414768 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f803c060 con 0x5651eaab26b0 2024-09-17T03:40:08.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.790+0000 7ff7fe000640 1 -- 172.21.15.121:0/1189414768 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7ff7f80289b0 con 0x5651eaab26b0 2024-09-17T03:40:08.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.790+0000 7ff81e7c3740 1 -- 172.21.15.121:0/1189414768 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7f8019070 con 0x5651eaab26b0 2024-09-17T03:40:08.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff7fe000640 1 -- 172.21.15.121:0/1189414768 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7ff7f8028020 con 0x5651eaab26b0 2024-09-17T03:40:08.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff81e7c3740 10 client.6948 fetch_fsmap learned FSMap version 68 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff81e7c3740 1 -- 172.21.15.121:0/1189414768 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5651eaed06b0 con 0x5651eaab26b0 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff7fe000640 1 -- 172.21.15.121:0/1189414768 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7f8019070 con 0x5651eaab26b0 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff7fe000640 1 -- 172.21.15.121:0/1189414768 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7ff7f8028bd0 con 0x5651eaab26b0 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff81e7c3740 10 client.6948 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff81e7c3740 10 client.6948 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff81e7c3740 20 client.6948 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x5651eae9c7a0 0x5651eaebb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff81e7c3740 4 client.6948 mds_command: new command op to 6768 tid=0 multi_id=0 [{"prefix": "session ls"}] 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff81e7c3740 1 -- 172.21.15.121:0/1189414768 --> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] -- command(tid 0: {"prefix": "session ls"}) -- 0x5651eadeb0f0 con 0x5651eae9c7a0 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.791+0000 7ff814e00640 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x5651eae9c7a0 0x5651eaebb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff7fe000640 10 client.6948 ms_handle_connect on v2:172.21.15.176:6835/3841878149 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff814e00640 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x5651eae9c7a0 0x5651eaebb950 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6bf57d0bd421e0f server_cookie=74217069ae323a5c in_seq=0 out_seq=0 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff7fe000640 1 -- 172.21.15.121:0/1189414768 <== mds.0 v2:172.21.15.176:6835/3841878149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5651eadeb0f0 con 0x5651eae9c7a0 2024-09-17T03:40:08.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff7fe000640 10 client.6948 handle_command_reply: tid=0 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff81e7c3740 1 client.6948 shutdown 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff81e7c3740 1 -- 172.21.15.121:0/1189414768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 msgr2=0x5651eaec0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8016040 tx=0x7ff7f8008fa0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff81e7c3740 1 -- 172.21.15.121:0/1189414768 shutdown_connections 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5651eaad3390 0x5651eaec1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:6835/3841878149,v1:172.21.15.176:6837/3841878149] conn(0x5651eae9c7a0 0x5651eaebb950 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651eaab26b0 0x5651eaec0f30 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff7fe000640 0 client.6948 ms_handle_reset on v2:172.21.15.176:6835/3841878149 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff81e7c3740 1 --2- 172.21.15.121:0/1189414768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5651eaaaa4d0 0x5651eaf3af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.792+0000 7ff81e7c3740 1 -- 172.21.15.121:0/1189414768 >> 172.21.15.121:0/1189414768 conn(0x5651eaac74e0 msgr2=0x5651eaea1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff81e7c3740 1 -- 172.21.15.121:0/1189414768 shutdown_connections 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff81e7c3740 1 -- 172.21.15.121:0/1189414768 wait complete. 2024-09-17T03:40:08.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff81e7c3740 20 client.6948 trim_cache size 0 max 16384 2024-09-17T03:40:08.797 INFO:teuthology.orchestra.run.smithi121.stdout:[] 2024-09-17T03:40:08.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 -- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7ec078bc0 msgr2=0x7ff7ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7ec078bc0 0x7ff7ec07b0d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff8100ce010 tx=0x7ff7f8009040 comp rx=0 tx=0).stop 2024-09-17T03:40:08.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 -- 172.21.15.121:0/1567658431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8100b5250 msgr2=0x7ff81013bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8100b5250 0x7ff81013bb20 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff800009910 tx=0x7ff8000052f0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 -- 172.21.15.121:0/1567658431 shutdown_connections 2024-09-17T03:40:08.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff81015d590 0x7ff81013e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff81015ca70 0x7ff81013e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff7ec078bc0 0x7ff7ec07b0d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 --2- 172.21.15.121:0/1567658431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8100b5250 0x7ff81013bb20 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 -- 172.21.15.121:0/1567658431 >> 172.21.15.121:0/1567658431 conn(0x7ff8100d07f0 msgr2=0x7ff81015f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:08.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.793+0000 7ff816200640 1 -- 172.21.15.121:0/1567658431 shutdown_connections 2024-09-17T03:40:08.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:08.794+0000 7ff816200640 1 -- 172.21.15.121:0/1567658431 wait complete. 2024-09-17T03:40:08.819 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-17T03:40:09.067 INFO:teuthology.orchestra.run.smithi176.stdout:[] 2024-09-17T03:40:09.068 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-17T03:40:09.068 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:40:09.068 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:09.162 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:09.246 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:40:09.246 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:09.246 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:09.246 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:09.282 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:40:09.282 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:09.282 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:09.282 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:09.318 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:09.318 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:09.318 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:09.318 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:09.358 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:40:09.358 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:09.358 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:09.358 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:09.394 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:09.394 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:09.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.615+0000 7f64e6400640 1 -- 172.21.15.121:0/2611477721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e015a3e0 msgr2=0x7f64e006d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.615+0000 7f64e6400640 1 --2- 172.21.15.121:0/2611477721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e015a3e0 0x7f64e006d800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009830 tx=0x7f64d002a3e0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.615+0000 7f64e6400640 1 -- 172.21.15.121:0/2611477721 shutdown_connections 2024-09-17T03:40:09.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.615+0000 7f64e6400640 1 --2- 172.21.15.121:0/2611477721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e006ddc0 0x7f64e00d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.615+0000 7f64e6400640 1 --2- 172.21.15.121:0/2611477721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e015a3e0 0x7f64e006d800 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.615+0000 7f64e6400640 1 -- 172.21.15.121:0/2611477721 >> 172.21.15.121:0/2611477721 conn(0x7f64e00b3580 msgr2=0x7f64e00b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:09.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.615+0000 7f64e6400640 1 -- 172.21.15.121:0/2611477721 shutdown_connections 2024-09-17T03:40:09.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.615+0000 7f64e6400640 1 -- 172.21.15.121:0/2611477721 wait complete. 2024-09-17T03:40:09.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.618+0000 7f64e6400640 1 Processor -- start 2024-09-17T03:40:09.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.618+0000 7f64e6400640 1 -- start start 2024-09-17T03:40:09.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.619+0000 7f64e6400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e006ddc0 0x7f64e01548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.619+0000 7f64e6400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e00d0af0 0x7f64e01f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.619+0000 7f64e6400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e015a3e0 0x7f64e01f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.619+0000 7f64e6400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f64e006f560 con 0x7f64e00d0af0 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.619+0000 7f64e6400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f64e0161190 con 0x7f64e006ddc0 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.619+0000 7f64e6400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f64e006f6e0 con 0x7f64e015a3e0 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64d6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e00d0af0 0x7f64e01f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64d6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e00d0af0 0x7f64e01f6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48728/0 (socket says 172.21.15.121:48728) 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64d6a00640 1 -- 172.21.15.121:0/2727616575 learned_addr learned my addr 172.21.15.121:0/2727616575 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64df400640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e006ddc0 0x7f64e01548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64dfe00640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e015a3e0 0x7f64e01f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64d6a00640 1 -- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e015a3e0 msgr2=0x7f64e01f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64d6a00640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e015a3e0 0x7f64e01f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64d6a00640 1 -- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e006ddc0 msgr2=0x7f64e01548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64d6a00640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e006ddc0 0x7f64e01548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64d6a00640 1 -- 172.21.15.121:0/2727616575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e0073fa0 con 0x7f64e00d0af0 2024-09-17T03:40:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64dfe00640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e015a3e0 0x7f64e01f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.620+0000 7f64d6a00640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e00d0af0 0x7f64e01f6c40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f64c800eb30 tx=0x7f64c800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.621+0000 7f64d7e00640 1 -- 172.21.15.121:0/2727616575 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c8010430 con 0x7f64e00d0af0 2024-09-17T03:40:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.621+0000 7f64d7e00640 1 -- 172.21.15.121:0/2727616575 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64c80105d0 con 0x7f64e00d0af0 2024-09-17T03:40:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.621+0000 7f64e6400640 1 -- 172.21.15.121:0/2727616575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e0074280 con 0x7f64e00d0af0 2024-09-17T03:40:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.621+0000 7f64d7e00640 1 -- 172.21.15.121:0/2727616575 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c8010a20 con 0x7f64e00d0af0 2024-09-17T03:40:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.621+0000 7f64e6400640 1 -- 172.21.15.121:0/2727616575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e0074840 con 0x7f64e00d0af0 2024-09-17T03:40:09.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.622+0000 7f64e6400640 1 -- 172.21.15.121:0/2727616575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e006fb90 con 0x7f64e00d0af0 2024-09-17T03:40:09.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.623+0000 7f64d7e00640 1 -- 172.21.15.121:0/2727616575 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f64c8010bc0 con 0x7f64e00d0af0 2024-09-17T03:40:09.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.624+0000 7f64d7e00640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f64bc078bc0 0x7f64bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.624+0000 7f64d7e00640 1 -- 172.21.15.121:0/2727616575 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f64c809bbd0 con 0x7f64e00d0af0 2024-09-17T03:40:09.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.625+0000 7f64df400640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f64bc078bc0 0x7f64bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.625+0000 7f64df400640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f64bc078bc0 0x7f64bc07b0d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f64d0034000 tx=0x7f64d0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:09.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.629+0000 7f64d7e00640 1 -- 172.21.15.121:0/2727616575 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f64c8063f20 con 0x7f64e00d0af0 2024-09-17T03:40:09.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.846+0000 7f64e6400640 1 -- 172.21.15.121:0/2727616575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64e0156320 con 0x7f64e00d0af0 2024-09-17T03:40:09.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.846+0000 7f64d7e00640 1 -- 172.21.15.121:0/2727616575 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f64c8063820 con 0x7f64e00d0af0 2024-09-17T03:40:09.847 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:09.847 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":68,"btime":"2024-09-17T03:39:59:942558+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3550639124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3550639124},{"type":"v1","addr":"172.21.15.176:6836","nonce":3550639124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/479907239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":479907239},{"type":"v1","addr":"172.21.15.121:6833","nonce":479907239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3992738504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3992738504},{"type":"v1","addr":"172.21.15.121:6835","nonce":3992738504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:56.408137+0000","modified":"2024-09-17T03:39:59.424876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/3841878149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3841878149},{"type":"v1","addr":"172.21.15.176:6837","nonce":3841878149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6768,"qdb_cluster":[6768]},"id":7}]} 2024-09-17T03:40:09.848 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 68 2024-09-17T03:40:09.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.848+0000 7f64e6400640 1 -- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f64bc078bc0 msgr2=0x7f64bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.848+0000 7f64e6400640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f64bc078bc0 0x7f64bc07b0d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f64d0034000 tx=0x7f64d0004730 comp rx=0 tx=0).stop 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.849+0000 7f64e6400640 1 -- 172.21.15.121:0/2727616575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e00d0af0 msgr2=0x7f64e01f6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.849+0000 7f64e6400640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e00d0af0 0x7f64e01f6c40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f64c800eb30 tx=0x7f64c800c2d0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.849+0000 7f64e6400640 1 -- 172.21.15.121:0/2727616575 shutdown_connections 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.849+0000 7f64e6400640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64e015a3e0 0x7f64e01f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.849+0000 7f64e6400640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f64bc078bc0 0x7f64bc07b0d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.849+0000 7f64e6400640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64e00d0af0 0x7f64e01f6c40 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.849+0000 7f64e6400640 1 --2- 172.21.15.121:0/2727616575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64e006ddc0 0x7f64e01548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.849+0000 7f64e6400640 1 -- 172.21.15.121:0/2727616575 >> 172.21.15.121:0/2727616575 conn(0x7f64e00b3580 msgr2=0x7f64e015edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.849+0000 7f64e6400640 1 -- 172.21.15.121:0/2727616575 shutdown_connections 2024-09-17T03:40:09.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:09.849+0000 7f64e6400640 1 -- 172.21.15.121:0/2727616575 wait complete. 2024-09-17T03:40:09.874 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:10.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.094+0000 7f75f6e00640 1 -- 172.21.15.121:0/2559386368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d40040e0 msgr2=0x7f75d4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.094+0000 7f75f6e00640 1 --2- 172.21.15.121:0/2559386368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d40040e0 0x7f75d4004800 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f75f0072680 tx=0x7f75d4005830 comp rx=0 tx=0).stop 2024-09-17T03:40:10.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.094+0000 7f75f4e00640 1 -- 172.21.15.121:0/2559386368 reap_dead start 2024-09-17T03:40:10.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.094+0000 7f75f6e00640 1 -- 172.21.15.121:0/2559386368 shutdown_connections 2024-09-17T03:40:10.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.094+0000 7f75f6e00640 1 -- 172.21.15.121:0/2559386368 >> 172.21.15.121:0/2559386368 conn(0x7f75f00b3580 msgr2=0x7f75f00b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:10.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.094+0000 7f75f6e00640 1 -- 172.21.15.121:0/2559386368 shutdown_connections 2024-09-17T03:40:10.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.094+0000 7f75f6e00640 1 -- 172.21.15.121:0/2559386368 wait complete. 2024-09-17T03:40:10.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.096+0000 7f75f6e00640 1 Processor -- start 2024-09-17T03:40:10.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.097+0000 7f75f6e00640 1 -- start start 2024-09-17T03:40:10.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75f6e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40040e0 0x7f75f015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75f6e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f01569a0 0x7f75f01599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75f6e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75f01e8910 0x7f75f01e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75f6e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f75f006db90 con 0x7f75f01569a0 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75f6e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75f006da10 con 0x7f75f01e8910 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75f6e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75f015d320 con 0x7f75d40040e0 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75e7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f01569a0 0x7f75f01599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75e7400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f01569a0 0x7f75f01599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48742/0 (socket says 172.21.15.121:48742) 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75e7400640 1 -- 172.21.15.121:0/4182009473 learned_addr learned my addr 172.21.15.121:0/4182009473 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75efe00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40040e0 0x7f75f015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.098+0000 7f75f4e00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75f01e8910 0x7f75f01e8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75e7400640 1 -- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40040e0 msgr2=0x7f75f015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75e7400640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40040e0 0x7f75f015ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75e7400640 1 -- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75f01e8910 msgr2=0x7f75f01e8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75e7400640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75f01e8910 0x7f75f01e8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75e7400640 1 -- 172.21.15.121:0/4182009473 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f01e9260 con 0x7f75f01569a0 2024-09-17T03:40:10.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75e7400640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f01569a0 0x7f75f01599c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c320 tx=0x7f75d8001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:10.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75ecc00640 1 -- 172.21.15.121:0/4182009473 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8032030 con 0x7f75f01569a0 2024-09-17T03:40:10.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75ecc00640 1 -- 172.21.15.121:0/4182009473 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75d80038f0 con 0x7f75f01569a0 2024-09-17T03:40:10.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75f6e00640 1 -- 172.21.15.121:0/4182009473 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f0074f80 con 0x7f75f01569a0 2024-09-17T03:40:10.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75ecc00640 1 -- 172.21.15.121:0/4182009473 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8003d40 con 0x7f75f01569a0 2024-09-17T03:40:10.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.099+0000 7f75f6e00640 1 -- 172.21.15.121:0/4182009473 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f00cf960 con 0x7f75f01569a0 2024-09-17T03:40:10.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.101+0000 7f75f6e00640 1 -- 172.21.15.121:0/4182009473 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f015d880 con 0x7f75f01569a0 2024-09-17T03:40:10.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.101+0000 7f75ecc00640 1 -- 172.21.15.121:0/4182009473 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75d8035020 con 0x7f75f01569a0 2024-09-17T03:40:10.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.103+0000 7f75ecc00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75cc078b90 0x7f75cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.103+0000 7f75ecc00640 1 -- 172.21.15.121:0/4182009473 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f75d80ba7f0 con 0x7f75f01569a0 2024-09-17T03:40:10.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.103+0000 7f75efe00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75cc078b90 0x7f75cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.104+0000 7f75efe00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75cc078b90 0x7f75cc07b0a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009c50 tx=0x7f75e0005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:10.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.108+0000 7f75ecc00640 1 -- 172.21.15.121:0/4182009473 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75f01e9260 con 0x7f75f01569a0 2024-09-17T03:40:10.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.324+0000 7f75f6e00640 1 -- 172.21.15.121:0/4182009473 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75f01f8c40 con 0x7f75f01569a0 2024-09-17T03:40:10.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.324+0000 7f75ecc00640 1 -- 172.21.15.121:0/4182009473 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f75d8082440 con 0x7f75f01569a0 2024-09-17T03:40:10.326 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:10.326 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":68,"btime":"2024-09-17T03:39:59:942558+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3550639124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3550639124},{"type":"v1","addr":"172.21.15.176:6836","nonce":3550639124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/479907239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":479907239},{"type":"v1","addr":"172.21.15.121:6833","nonce":479907239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3992738504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3992738504},{"type":"v1","addr":"172.21.15.121:6835","nonce":3992738504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:56.408137+0000","modified":"2024-09-17T03:39:59.424876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/3841878149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3841878149},{"type":"v1","addr":"172.21.15.176:6837","nonce":3841878149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6768,"qdb_cluster":[6768]},"id":7}]} 2024-09-17T03:40:10.326 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 68 2024-09-17T03:40:10.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 -- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75cc078b90 msgr2=0x7f75cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75cc078b90 0x7f75cc07b0a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009c50 tx=0x7f75e0005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:10.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 -- 172.21.15.121:0/4182009473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f01569a0 msgr2=0x7f75f01599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f01569a0 0x7f75f01599c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c320 tx=0x7f75d8001190 comp rx=0 tx=0).stop 2024-09-17T03:40:10.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 -- 172.21.15.121:0/4182009473 shutdown_connections 2024-09-17T03:40:10.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75f01e8910 0x7f75f01e8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75cc078b90 0x7f75cc07b0a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75f01569a0 0x7f75f01599c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 --2- 172.21.15.121:0/4182009473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d40040e0 0x7f75f015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 -- 172.21.15.121:0/4182009473 >> 172.21.15.121:0/4182009473 conn(0x7f75f00b3580 msgr2=0x7f75f015bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:10.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 -- 172.21.15.121:0/4182009473 shutdown_connections 2024-09-17T03:40:10.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.327+0000 7f75f6e00640 1 -- 172.21.15.121:0/4182009473 wait complete. 2024-09-17T03:40:10.353 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:10.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.571+0000 7f7cd5800640 1 -- 172.21.15.121:0/264431269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cd00cc270 msgr2=0x7f7cd00d0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.571+0000 7f7cd5800640 1 --2- 172.21.15.121:0/264431269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cd00cc270 0x7f7cd00d0700 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7cd015f120 tx=0x7f7cc002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.571+0000 7f7cd5800640 1 -- 172.21.15.121:0/264431269 shutdown_connections 2024-09-17T03:40:10.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.571+0000 7f7cd5800640 1 --2- 172.21.15.121:0/264431269 >> v2:172.21.15.176:3300/0 conn(0x7f7cd00ce9e0 0x7f7cd00d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.571+0000 7f7cd5800640 1 --2- 172.21.15.121:0/264431269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cd00cc270 0x7f7cd00d0700 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.571+0000 7f7cd5800640 1 -- 172.21.15.121:0/264431269 >> 172.21.15.121:0/264431269 conn(0x7f7cd00b3580 msgr2=0x7f7cd00b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:10.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.571+0000 7f7cd5800640 1 -- 172.21.15.121:0/264431269 shutdown_connections 2024-09-17T03:40:10.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.571+0000 7f7cd5800640 1 -- 172.21.15.121:0/264431269 wait complete. 2024-09-17T03:40:10.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.573+0000 7f7cd5800640 1 Processor -- start 2024-09-17T03:40:10.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.574+0000 7f7cd5800640 1 -- start start 2024-09-17T03:40:10.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.575+0000 7f7cd5800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cd006cde0 0x7f7cd00b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.575+0000 7f7cd5800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cd00cc270 0x7f7cd01ed4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.575+0000 7f7cd5800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cd00ce9e0 0x7f7cd01f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.575+0000 7f7cd5800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd00af950 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.575+0000 7f7cd5800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd006f140 con 0x7f7cd00cc270 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.575+0000 7f7cd5800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd00afad0 con 0x7f7cd006cde0 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.575+0000 7f7ccf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cd00ce9e0 0x7f7cd01f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.576+0000 7f7ccf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cd00ce9e0 0x7f7cd01f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48762/0 (socket says 172.21.15.121:48762) 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.576+0000 7f7ccf400640 1 -- 172.21.15.121:0/2452024744 learned_addr learned my addr 172.21.15.121:0/2452024744 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.576+0000 7f7ccea00640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cd006cde0 0x7f7cd00b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.576+0000 7f7cce000640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cd00cc270 0x7f7cd01ed4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.576+0000 7f7ccf400640 1 -- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cd006cde0 msgr2=0x7f7cd00b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.576+0000 7f7ccf400640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cd006cde0 0x7f7cd00b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.576+0000 7f7ccf400640 1 -- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cd00cc270 msgr2=0x7f7cd01ed4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.576+0000 7f7ccf400640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cd00cc270 0x7f7cd01ed4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.576+0000 7f7ccf400640 1 -- 172.21.15.121:0/2452024744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd01eda10 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.576+0000 7f7ccf400640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cd00ce9e0 0x7f7cd01f5170 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800ba10 tx=0x7f7cc800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:10.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.577+0000 7f7cc6a00640 1 -- 172.21.15.121:0/2452024744 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8019070 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.577+0000 7f7cc6a00640 1 -- 172.21.15.121:0/2452024744 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cc800cc30 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.577+0000 7f7cc6a00640 1 -- 172.21.15.121:0/2452024744 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800ce60 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.577+0000 7f7cd5800640 1 -- 172.21.15.121:0/2452024744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd015a0b0 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.577+0000 7f7cd5800640 1 -- 172.21.15.121:0/2452024744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd01f4970 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.578+0000 7f7cd5800640 1 -- 172.21.15.121:0/2452024744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd006db50 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.579+0000 7f7cc6a00640 1 -- 172.21.15.121:0/2452024744 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7cc801c070 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.580+0000 7f7cc6a00640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7cb0078bc0 0x7f7cb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.581+0000 7f7cc6a00640 1 -- 172.21.15.121:0/2452024744 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f7cc809a990 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.581+0000 7f7ccea00640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7cb0078bc0 0x7f7cb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.582+0000 7f7ccea00640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7cb0078bc0 0x7f7cb007b0d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0033000 tx=0x7f7cc0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:10.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.586+0000 7f7cc6a00640 1 -- 172.21.15.121:0/2452024744 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7cc8062680 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.772+0000 7f7cd5800640 1 -- 172.21.15.121:0/2452024744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cd0074b20 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.773+0000 7f7cc6a00640 1 -- 172.21.15.121:0/2452024744 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+17009 (secure 0 0 0) 0x7f7cc80670b0 con 0x7f7cd00ce9e0 2024-09-17T03:40:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:10.774 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":98,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:39:57.906019+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:39:54.312958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-17T03:39:55.372103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 -- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7cb0078bc0 msgr2=0x7f7cb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7cb0078bc0 0x7f7cb007b0d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0033000 tx=0x7f7cc0004730 comp rx=0 tx=0).stop 2024-09-17T03:40:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 -- 172.21.15.121:0/2452024744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cd00ce9e0 msgr2=0x7f7cd01f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cd00ce9e0 0x7f7cd01f5170 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800ba10 tx=0x7f7cc800bed0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 -- 172.21.15.121:0/2452024744 shutdown_connections 2024-09-17T03:40:10.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7cb0078bc0 0x7f7cb007b0d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7cd00ce9e0 0x7f7cd01f5170 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cd00cc270 0x7f7cd01ed4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 --2- 172.21.15.121:0/2452024744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cd006cde0 0x7f7cd00b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 -- 172.21.15.121:0/2452024744 >> 172.21.15.121:0/2452024744 conn(0x7f7cd00b3580 msgr2=0x7f7cd00cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:10.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.775+0000 7f7cd5800640 1 -- 172.21.15.121:0/2452024744 shutdown_connections 2024-09-17T03:40:10.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:10.776+0000 7f7cd5800640 1 -- 172.21.15.121:0/2452024744 wait complete. 2024-09-17T03:40:10.802 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:40:10.802 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:11.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.024+0000 7f7e27e00640 1 -- 172.21.15.121:0/3688520628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e2806d830 msgr2=0x7f7e2806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.024+0000 7f7e27e00640 1 --2- 172.21.15.121:0/3688520628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e2806d830 0x7f7e2806dc40 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f7e280cffe0 tx=0x7f7e2002aac0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.024+0000 7f7e27e00640 1 -- 172.21.15.121:0/3688520628 shutdown_connections 2024-09-17T03:40:11.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.024+0000 7f7e27e00640 1 --2- 172.21.15.121:0/3688520628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e2806d830 0x7f7e2806dc40 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.024+0000 7f7e27e00640 1 --2- 172.21.15.121:0/3688520628 >> v2:172.21.15.176:3300/0 conn(0x7f7e28160180 0x7f7e28160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.024+0000 7f7e27e00640 1 -- 172.21.15.121:0/3688520628 >> 172.21.15.121:0/3688520628 conn(0x7f7e280b2440 msgr2=0x7f7e280d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:11.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.024+0000 7f7e27e00640 1 -- 172.21.15.121:0/3688520628 shutdown_connections 2024-09-17T03:40:11.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.024+0000 7f7e27e00640 1 -- 172.21.15.121:0/3688520628 wait complete. 2024-09-17T03:40:11.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.027+0000 7f7e27e00640 1 Processor -- start 2024-09-17T03:40:11.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.027+0000 7f7e27e00640 1 -- start start 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.028+0000 7f7e27e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2806d830 0x7f7e281440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.028+0000 7f7e27e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e28070810 0x7f7e2806f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.028+0000 7f7e27e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e28160180 0x7f7e2806fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.028+0000 7f7e27e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2806ef70 con 0x7f7e28070810 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.028+0000 7f7e27e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2806edf0 con 0x7f7e2806d830 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.028+0000 7f7e27e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2806e180 con 0x7f7e28160180 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e1fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e28070810 0x7f7e2806f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e1fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e28070810 0x7f7e2806f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48786/0 (socket says 172.21.15.121:48786) 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e1fe00640 1 -- 172.21.15.121:0/333497519 learned_addr learned my addr 172.21.15.121:0/333497519 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e27400640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e28160180 0x7f7e2806fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e26a00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2806d830 0x7f7e281440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e1fe00640 1 -- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e28160180 msgr2=0x7f7e2806fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e1fe00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e28160180 0x7f7e2806fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e1fe00640 1 -- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2806d830 msgr2=0x7f7e281440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e1fe00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2806d830 0x7f7e281440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e1fe00640 1 -- 172.21.15.121:0/333497519 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e281f52c0 con 0x7f7e28070810 2024-09-17T03:40:11.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e1fe00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e28070810 0x7f7e2806f690 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000d6a0 tx=0x7f7e1000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:11.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.029+0000 7f7e1ea00640 1 -- 172.21.15.121:0/333497519 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10017070 con 0x7f7e28070810 2024-09-17T03:40:11.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.030+0000 7f7e1ea00640 1 -- 172.21.15.121:0/333497519 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e10009b10 con 0x7f7e28070810 2024-09-17T03:40:11.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.030+0000 7f7e1ea00640 1 -- 172.21.15.121:0/333497519 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10010460 con 0x7f7e28070810 2024-09-17T03:40:11.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.030+0000 7f7e27e00640 1 -- 172.21.15.121:0/333497519 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e28144610 con 0x7f7e28070810 2024-09-17T03:40:11.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.030+0000 7f7e27e00640 1 -- 172.21.15.121:0/333497519 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e281f8d80 con 0x7f7e28070810 2024-09-17T03:40:11.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.031+0000 7f7e27e00640 1 -- 172.21.15.121:0/333497519 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e281f8af0 con 0x7f7e28070810 2024-09-17T03:40:11.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.032+0000 7f7e1ea00640 1 -- 172.21.15.121:0/333497519 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e1001a070 con 0x7f7e28070810 2024-09-17T03:40:11.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.033+0000 7f7e1ea00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e04078b90 0x7f7e0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.034+0000 7f7e1ea00640 1 -- 172.21.15.121:0/333497519 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f7e1009b110 con 0x7f7e28070810 2024-09-17T03:40:11.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.034+0000 7f7e26a00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e04078b90 0x7f7e0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.035+0000 7f7e26a00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e04078b90 0x7f7e0407b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7e18007fd0 tx=0x7f7e18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:11.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.039+0000 7f7e1ea00640 1 -- 172.21.15.121:0/333497519 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e10063330 con 0x7f7e28070810 2024-09-17T03:40:11.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.255+0000 7f7e27e00640 1 -- 172.21.15.121:0/333497519 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e2806e630 con 0x7f7e28070810 2024-09-17T03:40:11.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.256+0000 7f7e1ea00640 1 -- 172.21.15.121:0/333497519 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f7e10062c30 con 0x7f7e28070810 2024-09-17T03:40:11.257 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:11.257 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":68,"btime":"2024-09-17T03:39:59:942558+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3550639124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3550639124},{"type":"v1","addr":"172.21.15.176:6836","nonce":3550639124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/479907239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":479907239},{"type":"v1","addr":"172.21.15.121:6833","nonce":479907239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3992738504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3992738504},{"type":"v1","addr":"172.21.15.121:6835","nonce":3992738504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:56.408137+0000","modified":"2024-09-17T03:39:59.424876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/3841878149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3841878149},{"type":"v1","addr":"172.21.15.176:6837","nonce":3841878149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6768,"qdb_cluster":[6768]},"id":7}]} 2024-09-17T03:40:11.257 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 68 2024-09-17T03:40:11.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.258+0000 7f7e27e00640 1 -- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e04078b90 msgr2=0x7f7e0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.258+0000 7f7e27e00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e04078b90 0x7f7e0407b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7e18007fd0 tx=0x7f7e18009040 comp rx=0 tx=0).stop 2024-09-17T03:40:11.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.258+0000 7f7e27e00640 1 -- 172.21.15.121:0/333497519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e28070810 msgr2=0x7f7e2806f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.258+0000 7f7e27e00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e28070810 0x7f7e2806f690 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000d6a0 tx=0x7f7e1000db60 comp rx=0 tx=0).stop 2024-09-17T03:40:11.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.258+0000 7f7e27e00640 1 -- 172.21.15.121:0/333497519 shutdown_connections 2024-09-17T03:40:11.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.258+0000 7f7e27e00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e28160180 0x7f7e2806fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.258+0000 7f7e27e00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e04078b90 0x7f7e0407b0a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.258+0000 7f7e27e00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e28070810 0x7f7e2806f690 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.258+0000 7f7e27e00640 1 --2- 172.21.15.121:0/333497519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e2806d830 0x7f7e281440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.258+0000 7f7e27e00640 1 -- 172.21.15.121:0/333497519 >> 172.21.15.121:0/333497519 conn(0x7f7e280b2440 msgr2=0x7f7e2809c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:11.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.259+0000 7f7e27e00640 1 -- 172.21.15.121:0/333497519 shutdown_connections 2024-09-17T03:40:11.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.259+0000 7f7e27e00640 1 -- 172.21.15.121:0/333497519 wait complete. 2024-09-17T03:40:11.285 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:11.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.507+0000 7f2af5800640 1 -- 172.21.15.121:0/60459281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2af0070810 msgr2=0x7f2af00b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.507+0000 7f2af5800640 1 --2- 172.21.15.121:0/60459281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2af0070810 0x7f2af00b4c80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2af00cffe0 tx=0x7f2ae002a560 comp rx=0 tx=0).stop 2024-09-17T03:40:11.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.507+0000 7f2af5800640 1 -- 172.21.15.121:0/60459281 shutdown_connections 2024-09-17T03:40:11.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.507+0000 7f2af5800640 1 --2- 172.21.15.121:0/60459281 >> v2:172.21.15.176:3300/0 conn(0x7f2af00b51c0 0x7f2af0160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.507+0000 7f2af5800640 1 --2- 172.21.15.121:0/60459281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2af0070810 0x7f2af00b4c80 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.507+0000 7f2af5800640 1 -- 172.21.15.121:0/60459281 >> 172.21.15.121:0/60459281 conn(0x7f2af00b2440 msgr2=0x7f2af00d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:11.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.507+0000 7f2af5800640 1 -- 172.21.15.121:0/60459281 shutdown_connections 2024-09-17T03:40:11.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.507+0000 7f2af5800640 1 -- 172.21.15.121:0/60459281 wait complete. 2024-09-17T03:40:11.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.509+0000 7f2af5800640 1 Processor -- start 2024-09-17T03:40:11.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.509+0000 7f2af5800640 1 -- start start 2024-09-17T03:40:11.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2af5800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2af0070810 0x7f2af0143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2af5800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2af00b51c0 0x7f2af01e7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2af5800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af01606c0 0x7f2af01e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2af5800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2af00b30e0 con 0x7f2af0070810 2024-09-17T03:40:11.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2af5800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2af006f000 con 0x7f2af00b51c0 2024-09-17T03:40:11.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2af5800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2af015d2a0 con 0x7f2af01606c0 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aefe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2af0070810 0x7f2af0143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aefe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2af0070810 0x7f2af0143ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48806/0 (socket says 172.21.15.121:48806) 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aefe00640 1 -- 172.21.15.121:0/1597899051 learned_addr learned my addr 172.21.15.121:0/1597899051 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2ae7400640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2af00b51c0 0x7f2af01e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2af4e00640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af01606c0 0x7f2af01e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aefe00640 1 -- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af01606c0 msgr2=0x7f2af01e7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aefe00640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af01606c0 0x7f2af01e7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aefe00640 1 -- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2af00b51c0 msgr2=0x7f2af01e7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aefe00640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2af00b51c0 0x7f2af01e7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aefe00640 1 -- 172.21.15.121:0/1597899051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af01e83a0 con 0x7f2af0070810 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2af4e00640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af01606c0 0x7f2af01e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:11.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aefe00640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2af0070810 0x7f2af0143ca0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0034040 tx=0x7f2ae00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:11.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aecc00640 1 -- 172.21.15.121:0/1597899051 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae003e030 con 0x7f2af0070810 2024-09-17T03:40:11.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aecc00640 1 -- 172.21.15.121:0/1597899051 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ae00047a0 con 0x7f2af0070810 2024-09-17T03:40:11.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2af5800640 1 -- 172.21.15.121:0/1597899051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af0144610 con 0x7f2af0070810 2024-09-17T03:40:11.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2aecc00640 1 -- 172.21.15.121:0/1597899051 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0035040 con 0x7f2af0070810 2024-09-17T03:40:11.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.512+0000 7f2af5800640 1 -- 172.21.15.121:0/1597899051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af00cf9e0 con 0x7f2af0070810 2024-09-17T03:40:11.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.513+0000 7f2af5800640 1 -- 172.21.15.121:0/1597899051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af015d720 con 0x7f2af0070810 2024-09-17T03:40:11.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.514+0000 7f2aecc00640 1 -- 172.21.15.121:0/1597899051 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ae0041030 con 0x7f2af0070810 2024-09-17T03:40:11.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.516+0000 7f2aecc00640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2acc078b90 0x7f2acc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.516+0000 7f2aecc00640 1 -- 172.21.15.121:0/1597899051 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f2ae00bb6b0 con 0x7f2af0070810 2024-09-17T03:40:11.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.516+0000 7f2ae7400640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2acc078b90 0x7f2acc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.517+0000 7f2ae7400640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2acc078b90 0x7f2acc07b0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2af015cc90 tx=0x7f2ad800a250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:11.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.522+0000 7f2aecc00640 1 -- 172.21.15.121:0/1597899051 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2af0160ad0 con 0x7f2af0070810 2024-09-17T03:40:11.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.738+0000 7f2af5800640 1 -- 172.21.15.121:0/1597899051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2af0075b50 con 0x7f2af0070810 2024-09-17T03:40:11.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.739+0000 7f2aecc00640 1 -- 172.21.15.121:0/1597899051 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5234 (secure 0 0 0) 0x7f2ae0083300 con 0x7f2af0070810 2024-09-17T03:40:11.740 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:11.741 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":68,"btime":"2024-09-17T03:39:59:942558+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3550639124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3550639124},{"type":"v1","addr":"172.21.15.176:6836","nonce":3550639124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/479907239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":479907239},{"type":"v1","addr":"172.21.15.121:6833","nonce":479907239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3992738504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3992738504},{"type":"v1","addr":"172.21.15.121:6835","nonce":3992738504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:39:56.408137+0000","modified":"2024-09-17T03:39:59.424876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6768},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6768":{"gid":6768,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/3841878149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3841878149},{"type":"v1","addr":"172.21.15.176:6837","nonce":3841878149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6768,"qdb_cluster":[6768]},"id":7}]} 2024-09-17T03:40:11.741 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 68 2024-09-17T03:40:11.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 -- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2acc078b90 msgr2=0x7f2acc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2acc078b90 0x7f2acc07b0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2af015cc90 tx=0x7f2ad800a250 comp rx=0 tx=0).stop 2024-09-17T03:40:11.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 -- 172.21.15.121:0/1597899051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2af0070810 msgr2=0x7f2af0143ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2af0070810 0x7f2af0143ca0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0034040 tx=0x7f2ae00039e0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 -- 172.21.15.121:0/1597899051 shutdown_connections 2024-09-17T03:40:11.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af01606c0 0x7f2af01e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2af00b51c0 0x7f2af01e7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2acc078b90 0x7f2acc07b0a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 --2- 172.21.15.121:0/1597899051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2af0070810 0x7f2af0143ca0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 -- 172.21.15.121:0/1597899051 >> 172.21.15.121:0/1597899051 conn(0x7f2af00b2440 msgr2=0x7f2af015f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:11.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 -- 172.21.15.121:0/1597899051 shutdown_connections 2024-09-17T03:40:11.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.741+0000 7f2af5800640 1 -- 172.21.15.121:0/1597899051 wait complete. 2024-09-17T03:40:11.765 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:11.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.993+0000 7f7b76c00640 1 -- 172.21.15.121:0/1244208950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b70145de0 msgr2=0x7f7b700d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.993+0000 7f7b76c00640 1 --2- 172.21.15.121:0/1244208950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b70145de0 0x7f7b700d07d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7b7006f950 tx=0x7f7b6802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.993+0000 7f7b76c00640 1 -- 172.21.15.121:0/1244208950 shutdown_connections 2024-09-17T03:40:11.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.993+0000 7f7b76c00640 1 --2- 172.21.15.121:0/1244208950 >> v2:172.21.15.176:3300/0 conn(0x7f7b70070ab0 0x7f7b7015d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.993+0000 7f7b76c00640 1 --2- 172.21.15.121:0/1244208950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b70145de0 0x7f7b700d07d0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.993+0000 7f7b76c00640 1 -- 172.21.15.121:0/1244208950 >> 172.21.15.121:0/1244208950 conn(0x7f7b70073fe0 msgr2=0x7f7b700743f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:11.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.993+0000 7f7b76c00640 1 -- 172.21.15.121:0/1244208950 shutdown_connections 2024-09-17T03:40:11.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.993+0000 7f7b76c00640 1 -- 172.21.15.121:0/1244208950 wait complete. 2024-09-17T03:40:11.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.995+0000 7f7b76c00640 1 Processor -- start 2024-09-17T03:40:11.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.995+0000 7f7b76c00640 1 -- start start 2024-09-17T03:40:11.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.997+0000 7f7b76c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b70070ab0 0x7f7b701e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.997+0000 7f7b76c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b70145de0 0x7f7b701e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.997+0000 7f7b76c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b7015cbf0 0x7f7b701e7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.997+0000 7f7b76c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7015df90 con 0x7f7b7015cbf0 2024-09-17T03:40:11.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.997+0000 7f7b76c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7015de10 con 0x7f7b70070ab0 2024-09-17T03:40:11.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.997+0000 7f7b76c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7015e110 con 0x7f7b70145de0 2024-09-17T03:40:11.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b74c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b7015cbf0 0x7f7b701e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b74c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b7015cbf0 0x7f7b701e7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54406/0 (socket says 172.21.15.121:54406) 2024-09-17T03:40:11.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b74c00640 1 -- 172.21.15.121:0/2565289856 learned_addr learned my addr 172.21.15.121:0/2565289856 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:11.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b6fe00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b70070ab0 0x7f7b701e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b6f400640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b70145de0 0x7f7b701e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b74c00640 1 -- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b70145de0 msgr2=0x7f7b701e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b74c00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b70145de0 0x7f7b701e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b74c00640 1 -- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b70070ab0 msgr2=0x7f7b701e6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b74c00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b70070ab0 0x7f7b701e6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b74c00640 1 -- 172.21.15.121:0/2565289856 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7015c290 con 0x7f7b7015cbf0 2024-09-17T03:40:12.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.998+0000 7f7b74c00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b7015cbf0 0x7f7b701e7700 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000d9a0 tx=0x7f7b6000de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:12.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.999+0000 7f7b67e00640 1 -- 172.21.15.121:0/2565289856 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60017070 con 0x7f7b7015cbf0 2024-09-17T03:40:12.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.999+0000 7f7b67e00640 1 -- 172.21.15.121:0/2565289856 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b6000be00 con 0x7f7b7015cbf0 2024-09-17T03:40:12.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.999+0000 7f7b76c00640 1 -- 172.21.15.121:0/2565289856 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b701e5f00 con 0x7f7b7015cbf0 2024-09-17T03:40:12.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.999+0000 7f7b67e00640 1 -- 172.21.15.121:0/2565289856 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60003bd0 con 0x7f7b7015cbf0 2024-09-17T03:40:12.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:11.999+0000 7f7b76c00640 1 -- 172.21.15.121:0/2565289856 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b701e61a0 con 0x7f7b7015cbf0 2024-09-17T03:40:12.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.000+0000 7f7b76c00640 1 -- 172.21.15.121:0/2565289856 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b700af380 con 0x7f7b7015cbf0 2024-09-17T03:40:12.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.001+0000 7f7b67e00640 1 -- 172.21.15.121:0/2565289856 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b60010460 con 0x7f7b7015cbf0 2024-09-17T03:40:12.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.002+0000 7f7b67e00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b4c078bc0 0x7f7b4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.003+0000 7f7b67e00640 1 -- 172.21.15.121:0/2565289856 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6217+0+0 (secure 0 0 0) 0x7f7b6009b320 con 0x7f7b7015cbf0 2024-09-17T03:40:12.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.003+0000 7f7b6fe00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b4c078bc0 0x7f7b4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.004+0000 7f7b6fe00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b4c078bc0 0x7f7b4c07b0d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7b68033000 tx=0x7f7b68004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:12.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.008+0000 7f7b67e00640 1 -- 172.21.15.121:0/2565289856 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b60062e70 con 0x7f7b7015cbf0 2024-09-17T03:40:12.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.194+0000 7f7b76c00640 1 -- 172.21.15.121:0/2565289856 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b7015f740 con 0x7f7b7015cbf0 2024-09-17T03:40:12.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.196+0000 7f7b67e00640 1 -- 172.21.15.121:0/2565289856 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+17258 (secure 0 0 0) 0x7f7b6009b0e0 con 0x7f7b7015cbf0 2024-09-17T03:40:12.196 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:12.196 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":99,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:40:11.982888+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:39:54.312958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-17T03:39:55.372103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.8","mappings":[{"from":4,"to":6}]},{"pgid":"16.1a","mappings":[{"from":2,"to":3}]},{"pgid":"16.28","mappings":[{"from":4,"to":3}]},{"pgid":"16.37","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 -- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b4c078bc0 msgr2=0x7f7b4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b4c078bc0 0x7f7b4c07b0d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7b68033000 tx=0x7f7b68004730 comp rx=0 tx=0).stop 2024-09-17T03:40:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 -- 172.21.15.121:0/2565289856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b7015cbf0 msgr2=0x7f7b701e7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b7015cbf0 0x7f7b701e7700 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000d9a0 tx=0x7f7b6000de60 comp rx=0 tx=0).stop 2024-09-17T03:40:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 -- 172.21.15.121:0/2565289856 shutdown_connections 2024-09-17T03:40:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7b4c078bc0 0x7f7b4c07b0d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b7015cbf0 0x7f7b701e7700 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b70145de0 0x7f7b701e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 --2- 172.21.15.121:0/2565289856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b70070ab0 0x7f7b701e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 -- 172.21.15.121:0/2565289856 >> 172.21.15.121:0/2565289856 conn(0x7f7b70073fe0 msgr2=0x7f7b70068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:12.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 -- 172.21.15.121:0/2565289856 shutdown_connections 2024-09-17T03:40:12.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.198+0000 7f7b76c00640 1 -- 172.21.15.121:0/2565289856 wait complete. 2024-09-17T03:40:12.222 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:40:12.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.442+0000 7ff6b3400640 1 -- 172.21.15.121:0/2235553120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6ac06d800 msgr2=0x7ff6ac0d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.442+0000 7ff6b3400640 1 --2- 172.21.15.121:0/2235553120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6ac06d800 0x7ff6ac0d05b0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac0c3a00 tx=0x7ff69802a440 comp rx=0 tx=0).stop 2024-09-17T03:40:12.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.442+0000 7ff6b3400640 1 -- 172.21.15.121:0/2235553120 shutdown_connections 2024-09-17T03:40:12.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.442+0000 7ff6b3400640 1 --2- 172.21.15.121:0/2235553120 >> v2:172.21.15.176:3300/0 conn(0x7ff6ac0d0af0 0x7ff6ac15cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.442+0000 7ff6b3400640 1 --2- 172.21.15.121:0/2235553120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6ac06d800 0x7ff6ac0d05b0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.442+0000 7ff6b3400640 1 -- 172.21.15.121:0/2235553120 >> 172.21.15.121:0/2235553120 conn(0x7ff6ac0b3580 msgr2=0x7ff6ac0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:12.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.442+0000 7ff6b3400640 1 -- 172.21.15.121:0/2235553120 shutdown_connections 2024-09-17T03:40:12.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.442+0000 7ff6b3400640 1 -- 172.21.15.121:0/2235553120 wait complete. 2024-09-17T03:40:12.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.444+0000 7ff6b3400640 1 Processor -- start 2024-09-17T03:40:12.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.445+0000 7ff6b3400640 1 -- start start 2024-09-17T03:40:12.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6ac06d800 0x7ff6ac0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0d0af0 0x7ff6ac1f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6b3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6ac15a3e0 0x7ff6ac1f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6b3400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac15d4e0 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6b3400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac15d360 con 0x7ff6ac06d800 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6b3400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ac15d660 con 0x7ff6ac0d0af0 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6b1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6ac15a3e0 0x7ff6ac1f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6b1400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6ac15a3e0 0x7ff6ac1f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54424/0 (socket says 172.21.15.121:54424) 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6b1400640 1 -- 172.21.15.121:0/1361401993 learned_addr learned my addr 172.21.15.121:0/1361401993 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6abe00640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0d0af0 0x7ff6ac1f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.446+0000 7ff6b0a00640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6ac06d800 0x7ff6ac0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.447+0000 7ff6b1400640 1 -- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0d0af0 msgr2=0x7ff6ac1f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.447+0000 7ff6b1400640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0d0af0 0x7ff6ac1f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.447+0000 7ff6b1400640 1 -- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6ac06d800 msgr2=0x7ff6ac0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.447+0000 7ff6b1400640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6ac06d800 0x7ff6ac0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.447+0000 7ff6b1400640 1 -- 172.21.15.121:0/1361401993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac15b5e0 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.447+0000 7ff6b1400640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6ac15a3e0 0x7ff6ac1f55e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400e9c0 tx=0x7ff6a400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:12.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.447+0000 7ff6a8c00640 1 -- 172.21.15.121:0/1361401993 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4004d20 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.447+0000 7ff6a8c00640 1 -- 172.21.15.121:0/1361401993 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6a400cb20 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.447+0000 7ff6b3400640 1 -- 172.21.15.121:0/1361401993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac15ba50 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.447+0000 7ff6a8c00640 1 -- 172.21.15.121:0/1361401993 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4005020 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.448+0000 7ff6b3400640 1 -- 172.21.15.121:0/1361401993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac0c3f90 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.449+0000 7ff6b3400640 1 -- 172.21.15.121:0/1361401993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ac0696c0 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.450+0000 7ff6a8c00640 1 -- 172.21.15.121:0/1361401993 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff6a40051c0 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.451+0000 7ff6a8c00640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff68c078b90 0x7ff68c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.451+0000 7ff6a8c00640 1 -- 172.21.15.121:0/1361401993 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6217+0+0 (secure 0 0 0) 0x7ff6a409b7e0 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.451+0000 7ff6b0a00640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff68c078b90 0x7ff68c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.452+0000 7ff6b0a00640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff68c078b90 0x7ff68c07b0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0006fd0 tx=0x7ff6a0009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:12.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.455+0000 7ff6a8c00640 1 -- 172.21.15.121:0/1361401993 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff6a4016030 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.671+0000 7ff6b3400640 1 -- 172.21.15.121:0/1361401993 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff6ac15b7b0 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.672 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-17T03:40:12.672+0000 7f1def400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:40:12.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.674+0000 7ff6a8c00640 1 -- 172.21.15.121:0/1361401993 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) ==== 161+0+0 (secure 0 0 0) 0x7ff6a40633d0 con 0x7ff6ac15a3e0 2024-09-17T03:40:12.674 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:40:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 -- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff68c078b90 msgr2=0x7ff68c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff68c078b90 0x7ff68c07b0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0006fd0 tx=0x7ff6a0009060 comp rx=0 tx=0).stop 2024-09-17T03:40:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 -- 172.21.15.121:0/1361401993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6ac15a3e0 msgr2=0x7ff6ac1f55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6ac15a3e0 0x7ff6ac1f55e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400e9c0 tx=0x7ff6a400ee80 comp rx=0 tx=0).stop 2024-09-17T03:40:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 -- 172.21.15.121:0/1361401993 shutdown_connections 2024-09-17T03:40:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff68c078b90 0x7ff68c07b0a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6ac15a3e0 0x7ff6ac1f55e0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6ac0d0af0 0x7ff6ac1f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 --2- 172.21.15.121:0/1361401993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6ac06d800 0x7ff6ac0b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 -- 172.21.15.121:0/1361401993 >> 172.21.15.121:0/1361401993 conn(0x7ff6ac0b3580 msgr2=0x7ff6ac15c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 -- 172.21.15.121:0/1361401993 shutdown_connections 2024-09-17T03:40:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.678+0000 7ff6b3400640 1 -- 172.21.15.121:0/1361401993 wait complete. 2024-09-17T03:40:12.685 INFO:tasks.ceph.mds.b.smithi176.stderr: -2339> 2024-09-17T03:39:58.894+0000 7f39c8000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:40:12.705 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:40:12.809 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:40:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.932+0000 7f7e63200640 1 -- 172.21.15.121:0/2477586970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e64155870 msgr2=0x7f7e6415ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.932+0000 7f7e63200640 1 --2- 172.21.15.121:0/2477586970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e64155870 0x7f7e6415ebd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009820 tx=0x7f7e5402a510 comp rx=0 tx=0).stop 2024-09-17T03:40:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.933+0000 7f7e63200640 1 -- 172.21.15.121:0/2477586970 shutdown_connections 2024-09-17T03:40:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.933+0000 7f7e63200640 1 --2- 172.21.15.121:0/2477586970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e6415f110 0x7f7e640b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.933+0000 7f7e63200640 1 --2- 172.21.15.121:0/2477586970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e64155870 0x7f7e6415ebd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.933+0000 7f7e63200640 1 -- 172.21.15.121:0/2477586970 >> 172.21.15.121:0/2477586970 conn(0x7f7e640d07f0 msgr2=0x7f7e640b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.933+0000 7f7e63200640 1 -- 172.21.15.121:0/2477586970 shutdown_connections 2024-09-17T03:40:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.933+0000 7f7e63200640 1 -- 172.21.15.121:0/2477586970 wait complete. 2024-09-17T03:40:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.935+0000 7f7e63200640 1 Processor -- start 2024-09-17T03:40:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.935+0000 7f7e63200640 1 -- start start 2024-09-17T03:40:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e63200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e640b4370 0x7f7e641ec880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e63200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e64155870 0x7f7e641f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e63200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e6415f110 0x7f7e6414f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e63200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7e640ae480 con 0x7f7e64155870 2024-09-17T03:40:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e63200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e640b54d0 con 0x7f7e640b4370 2024-09-17T03:40:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e63200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e640ae600 con 0x7f7e6415f110 2024-09-17T03:40:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e61e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e640b4370 0x7f7e641ec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e61400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e64155870 0x7f7e641f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e61e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e640b4370 0x7f7e641ec880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:54256/0 (socket says 172.21.15.121:54256) 2024-09-17T03:40:12.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e61e00640 1 -- 172.21.15.121:0/2479466620 learned_addr learned my addr 172.21.15.121:0/2479466620 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:12.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.937+0000 7f7e62800640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e6415f110 0x7f7e6414f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.938+0000 7f7e61e00640 1 -- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e6415f110 msgr2=0x7f7e6414f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.938+0000 7f7e61e00640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e6415f110 0x7f7e6414f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.938+0000 7f7e61e00640 1 -- 172.21.15.121:0/2479466620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e64155870 msgr2=0x7f7e641f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.938+0000 7f7e61e00640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e64155870 0x7f7e641f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.938+0000 7f7e61e00640 1 -- 172.21.15.121:0/2479466620 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e64158920 con 0x7f7e640b4370 2024-09-17T03:40:12.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.938+0000 7f7e61e00640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e640b4370 0x7f7e641ec880 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7e54000c00 tx=0x7f7e54005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:12.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.938+0000 7f7e5a000640 1 -- 172.21.15.121:0/2479466620 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5403f070 con 0x7f7e640b4370 2024-09-17T03:40:12.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.938+0000 7f7e5a000640 1 -- 172.21.15.121:0/2479466620 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e54004340 con 0x7f7e640b4370 2024-09-17T03:40:12.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.938+0000 7f7e63200640 1 -- 172.21.15.121:0/2479466620 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e64158c00 con 0x7f7e640b4370 2024-09-17T03:40:12.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.938+0000 7f7e5a000640 1 -- 172.21.15.121:0/2479466620 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54031bb0 con 0x7f7e640b4370 2024-09-17T03:40:12.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.939+0000 7f7e63200640 1 -- 172.21.15.121:0/2479466620 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e641ecdc0 con 0x7f7e640b4370 2024-09-17T03:40:12.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.940+0000 7f7e63200640 1 -- 172.21.15.121:0/2479466620 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e6415ebd0 con 0x7f7e640b4370 2024-09-17T03:40:12.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.941+0000 7f7e5a000640 1 -- 172.21.15.121:0/2479466620 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e54042070 con 0x7f7e640b4370 2024-09-17T03:40:12.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.942+0000 7f7e5a000640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e44078bc0 0x7f7e4407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.942+0000 7f7e5a000640 1 -- 172.21.15.121:0/2479466620 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6303+0+0 (secure 0 0 0) 0x7f7e540bc070 con 0x7f7e640b4370 2024-09-17T03:40:12.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.942+0000 7f7e61400640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e44078bc0 0x7f7e4407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.943+0000 7f7e61400640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e44078bc0 0x7f7e4407b0d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7e64156ea0 tx=0x7f7e50005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:12.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:12.947+0000 7f7e5a000640 1 -- 172.21.15.121:0/2479466620 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e54031770 con 0x7f7e640b4370 2024-09-17T03:40:13.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.165+0000 7f7e63200640 1 -- 172.21.15.121:0/2479466620 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7e641610c0 con 0x7f7e640b4370 2024-09-17T03:40:13.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.680+0000 7f7e5a000640 1 -- 172.21.15.121:0/2479466620 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) ==== 104+0+0 (secure 0 0 0) 0x7f7e54083c90 con 0x7f7e640b4370 2024-09-17T03:40:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.682+0000 7f7e63200640 1 -- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e44078bc0 msgr2=0x7f7e4407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.682+0000 7f7e63200640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e44078bc0 0x7f7e4407b0d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7e64156ea0 tx=0x7f7e50005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.682+0000 7f7e63200640 1 -- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e640b4370 msgr2=0x7f7e641ec880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.682+0000 7f7e63200640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e640b4370 0x7f7e641ec880 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7e54000c00 tx=0x7f7e54005270 comp rx=0 tx=0).stop 2024-09-17T03:40:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.683+0000 7f7e63200640 1 -- 172.21.15.121:0/2479466620 shutdown_connections 2024-09-17T03:40:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.683+0000 7f7e63200640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e6415f110 0x7f7e6414f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.683+0000 7f7e63200640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7e44078bc0 0x7f7e4407b0d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.683+0000 7f7e63200640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e64155870 0x7f7e641f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.683+0000 7f7e63200640 1 --2- 172.21.15.121:0/2479466620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e640b4370 0x7f7e641ec880 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.683+0000 7f7e63200640 1 -- 172.21.15.121:0/2479466620 >> 172.21.15.121:0/2479466620 conn(0x7f7e640d07f0 msgr2=0x7f7e64073050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:13.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.683+0000 7f7e63200640 1 -- 172.21.15.121:0/2479466620 shutdown_connections 2024-09-17T03:40:13.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.683+0000 7f7e63200640 1 -- 172.21.15.121:0/2479466620 wait complete. 2024-09-17T03:40:13.707 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:40:13.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.933+0000 7f0b5a000640 1 -- 172.21.15.121:0/850843750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b5406ece0 msgr2=0x7f0b5406e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:13.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.933+0000 7f0b5a000640 1 --2- 172.21.15.121:0/850843750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b5406ece0 0x7f0b5406e390 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0b5415cb90 tx=0x7f0b4402a580 comp rx=0 tx=0).stop 2024-09-17T03:40:13.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.933+0000 7f0b5a000640 1 -- 172.21.15.121:0/850843750 shutdown_connections 2024-09-17T03:40:13.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.933+0000 7f0b5a000640 1 --2- 172.21.15.121:0/850843750 >> v2:172.21.15.176:3300/0 conn(0x7f0b540ad860 0x7f0b54074b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.933+0000 7f0b5a000640 1 --2- 172.21.15.121:0/850843750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b5406ece0 0x7f0b5406e390 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.933+0000 7f0b5a000640 1 -- 172.21.15.121:0/850843750 >> 172.21.15.121:0/850843750 conn(0x7f0b540d0500 msgr2=0x7f0b540d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:13.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.933+0000 7f0b5a000640 1 -- 172.21.15.121:0/850843750 shutdown_connections 2024-09-17T03:40:13.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.933+0000 7f0b5a000640 1 -- 172.21.15.121:0/850843750 wait complete. 2024-09-17T03:40:13.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.935+0000 7f0b5a000640 1 Processor -- start 2024-09-17T03:40:13.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.936+0000 7f0b5a000640 1 -- start start 2024-09-17T03:40:13.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.937+0000 7f0b5a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b5406ece0 0x7f0b541f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:13.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.937+0000 7f0b5a000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54074760 0x7f0b540cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:13.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.937+0000 7f0b5a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b54156050 0x7f0b5409bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:13.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.937+0000 7f0b5a000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0b54153170 con 0x7f0b54156050 2024-09-17T03:40:13.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.937+0000 7f0b5a000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b54152ff0 con 0x7f0b54074760 2024-09-17T03:40:13.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.937+0000 7f0b5a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b541532f0 con 0x7f0b5406ece0 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.937+0000 7f0b59600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b54156050 0x7f0b5409bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.937+0000 7f0b59600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b54156050 0x7f0b5409bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54462/0 (socket says 172.21.15.121:54462) 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.937+0000 7f0b59600640 1 -- 172.21.15.121:0/2591579015 learned_addr learned my addr 172.21.15.121:0/2591579015 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.938+0000 7f0b58c00640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b5406ece0 0x7f0b541f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.938+0000 7f0b4be00640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54074760 0x7f0b540cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.938+0000 7f0b59600640 1 -- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b5406ece0 msgr2=0x7f0b541f93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.938+0000 7f0b59600640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b5406ece0 0x7f0b541f93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.938+0000 7f0b59600640 1 -- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54074760 msgr2=0x7f0b540cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.938+0000 7f0b59600640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54074760 0x7f0b540cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.938+0000 7f0b59600640 1 -- 172.21.15.121:0/2591579015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b541f8950 con 0x7f0b54156050 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.938+0000 7f0b4be00640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54074760 0x7f0b540cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.938+0000 7f0b59600640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b54156050 0x7f0b5409bf30 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00e960 tx=0x7f0b4c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:13.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.938+0000 7f0b51600640 1 -- 172.21.15.121:0/2591579015 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c004d20 con 0x7f0b54156050 2024-09-17T03:40:13.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.939+0000 7f0b51600640 1 -- 172.21.15.121:0/2591579015 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b4c00cac0 con 0x7f0b54156050 2024-09-17T03:40:13.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.939+0000 7f0b51600640 1 -- 172.21.15.121:0/2591579015 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c005020 con 0x7f0b54156050 2024-09-17T03:40:13.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.939+0000 7f0b5a000640 1 -- 172.21.15.121:0/2591579015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b54156b10 con 0x7f0b54156050 2024-09-17T03:40:13.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.939+0000 7f0b5a000640 1 -- 172.21.15.121:0/2591579015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b541f8ea0 con 0x7f0b54156050 2024-09-17T03:40:13.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.940+0000 7f0b5a000640 1 -- 172.21.15.121:0/2591579015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b54153810 con 0x7f0b54156050 2024-09-17T03:40:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.941+0000 7f0b51600640 1 -- 172.21.15.121:0/2591579015 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b4c0051c0 con 0x7f0b54156050 2024-09-17T03:40:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.942+0000 7f0b51600640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b30078b90 0x7f0b3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.942+0000 7f0b51600640 1 -- 172.21.15.121:0/2591579015 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6303+0+0 (secure 0 0 0) 0x7f0b4c09b730 con 0x7f0b54156050 2024-09-17T03:40:13.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.942+0000 7f0b58c00640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b30078b90 0x7f0b3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:13.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.943+0000 7f0b58c00640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b30078b90 0x7f0b3007b0a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0b44033000 tx=0x7f0b44004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:13.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:13.946+0000 7f0b51600640 1 -- 172.21.15.121:0/2591579015 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b4c016030 con 0x7f0b54156050 2024-09-17T03:40:14.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:14.131+0000 7f0b5a000640 1 -- 172.21.15.121:0/2591579015 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0b541568a0 con 0x7f0b54156050 2024-09-17T03:40:14.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:14.998+0000 7f0b51600640 1 -- 172.21.15.121:0/2591579015 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) ==== 181+0+0 (secure 0 0 0) 0x7f0b4c063340 con 0x7f0b54156050 2024-09-17T03:40:14.998 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:40:15.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 -- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b30078b90 msgr2=0x7f0b3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b30078b90 0x7f0b3007b0a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0b44033000 tx=0x7f0b44004730 comp rx=0 tx=0).stop 2024-09-17T03:40:15.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 -- 172.21.15.121:0/2591579015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b54156050 msgr2=0x7f0b5409bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b54156050 0x7f0b5409bf30 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00e960 tx=0x7f0b4c00ee20 comp rx=0 tx=0).stop 2024-09-17T03:40:15.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 -- 172.21.15.121:0/2591579015 shutdown_connections 2024-09-17T03:40:15.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b30078b90 0x7f0b3007b0a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b54156050 0x7f0b5409bf30 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54074760 0x7f0b540cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 --2- 172.21.15.121:0/2591579015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b5406ece0 0x7f0b541f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 -- 172.21.15.121:0/2591579015 >> 172.21.15.121:0/2591579015 conn(0x7f0b540d0500 msgr2=0x7f0b5415dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:15.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 -- 172.21.15.121:0/2591579015 shutdown_connections 2024-09-17T03:40:15.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.001+0000 7f0b5a000640 1 -- 172.21.15.121:0/2591579015 wait complete. 2024-09-17T03:40:15.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:40:15.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.255+0000 7f71f8400640 1 -- 172.21.15.121:0/934811427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71f00d0d00 msgr2=0x7f71f006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.255+0000 7f71f8400640 1 --2- 172.21.15.121:0/934811427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71f00d0d00 0x7f71f006db60 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f71e8005fd0 tx=0x7f71e802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.255+0000 7f71f8400640 1 -- 172.21.15.121:0/934811427 shutdown_connections 2024-09-17T03:40:15.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.255+0000 7f71f8400640 1 --2- 172.21.15.121:0/934811427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71f00d0d00 0x7f71f006db60 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.255+0000 7f71f8400640 1 --2- 172.21.15.121:0/934811427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f015c830 0x7f71f00ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.255+0000 7f71f8400640 1 -- 172.21.15.121:0/934811427 >> 172.21.15.121:0/934811427 conn(0x7f71f00b3620 msgr2=0x7f71f00b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:15.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.255+0000 7f71f8400640 1 -- 172.21.15.121:0/934811427 shutdown_connections 2024-09-17T03:40:15.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.255+0000 7f71f8400640 1 -- 172.21.15.121:0/934811427 wait complete. 2024-09-17T03:40:15.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.258+0000 7f71f8400640 1 Processor -- start 2024-09-17T03:40:15.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.258+0000 7f71f8400640 1 -- start start 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.259+0000 7f71f8400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71f006d750 0x7f71f009ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.259+0000 7f71f8400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f015c830 0x7f71f0158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.259+0000 7f71f8400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f009a2d0 0x7f71f00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.259+0000 7f71f8400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71f015d420 con 0x7f71f006d750 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.259+0000 7f71f8400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f71f015d2a0 con 0x7f71f009a2d0 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.259+0000 7f71f8400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71f015d5a0 con 0x7f71f015c830 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.259+0000 7f71f5a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71f006d750 0x7f71f009ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71f5a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71f006d750 0x7f71f009ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54480/0 (socket says 172.21.15.121:54480) 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71f5a00640 1 -- 172.21.15.121:0/2005493244 learned_addr learned my addr 172.21.15.121:0/2005493244 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71f6400640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f009a2d0 0x7f71f00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71f5a00640 1 -- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f015c830 msgr2=0x7f71f0158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71f5a00640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f015c830 0x7f71f0158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71f5a00640 1 -- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f009a2d0 msgr2=0x7f71f00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71f5a00640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f009a2d0 0x7f71f00b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71f5a00640 1 -- 172.21.15.121:0/2005493244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f009aab0 con 0x7f71f006d750 2024-09-17T03:40:15.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71f6400640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f009a2d0 0x7f71f00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:15.261 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71f5a00640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71f006d750 0x7f71f009ddc0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f71e400eb30 tx=0x7f71e400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:15.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71ed600640 1 -- 172.21.15.121:0/2005493244 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4004b20 con 0x7f71f006d750 2024-09-17T03:40:15.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.260+0000 7f71ed600640 1 -- 172.21.15.121:0/2005493244 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71e4004ce0 con 0x7f71f006d750 2024-09-17T03:40:15.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.261+0000 7f71f8400640 1 -- 172.21.15.121:0/2005493244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f009ad90 con 0x7f71f006d750 2024-09-17T03:40:15.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.261+0000 7f71ed600640 1 -- 172.21.15.121:0/2005493244 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4005280 con 0x7f71f006d750 2024-09-17T03:40:15.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.261+0000 7f71f8400640 1 -- 172.21.15.121:0/2005493244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f009b350 con 0x7f71f006d750 2024-09-17T03:40:15.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.262+0000 7f71f8400640 1 -- 172.21.15.121:0/2005493244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f015daf0 con 0x7f71f006d750 2024-09-17T03:40:15.262 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.263+0000 7f71ed600640 1 -- 172.21.15.121:0/2005493244 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71e4005420 con 0x7f71f006d750 2024-09-17T03:40:15.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.264+0000 7f71ed600640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71d0078bc0 0x7f71d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.265+0000 7f71ed600640 1 -- 172.21.15.121:0/2005493244 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5865+0+0 (secure 0 0 0) 0x7f71e409bbe0 con 0x7f71f006d750 2024-09-17T03:40:15.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.265+0000 7f71f5000640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71d0078bc0 0x7f71d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.266+0000 7f71f5000640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71d0078bc0 0x7f71d007b0d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f71dc000f60 tx=0x7f71dc0079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:15.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.269+0000 7f71ed600640 1 -- 172.21.15.121:0/2005493244 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f71e4063ef0 con 0x7f71f006d750 2024-09-17T03:40:15.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:15.453+0000 7f71f8400640 1 -- 172.21.15.121:0/2005493244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f71f00ccca0 con 0x7f71f006d750 2024-09-17T03:40:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.015+0000 7f71ed600640 1 -- 172.21.15.121:0/2005493244 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) ==== 169+0+0 (secure 0 0 0) 0x7f71e40637f0 con 0x7f71f006d750 2024-09-17T03:40:16.015 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-17T03:40:16.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 -- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71d0078bc0 msgr2=0x7f71d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71d0078bc0 0x7f71d007b0d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f71dc000f60 tx=0x7f71dc0079b0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 -- 172.21.15.121:0/2005493244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71f006d750 msgr2=0x7f71f009ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71f006d750 0x7f71f009ddc0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f71e400eb30 tx=0x7f71e400c2d0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 -- 172.21.15.121:0/2005493244 shutdown_connections 2024-09-17T03:40:16.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71f009a2d0 0x7f71f00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71f015c830 0x7f71f0158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f71d0078bc0 0x7f71d007b0d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 --2- 172.21.15.121:0/2005493244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71f006d750 0x7f71f009ddc0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 -- 172.21.15.121:0/2005493244 >> 172.21.15.121:0/2005493244 conn(0x7f71f00b3620 msgr2=0x7f71f0159700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:16.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 -- 172.21.15.121:0/2005493244 shutdown_connections 2024-09-17T03:40:16.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.018+0000 7f71f8400640 1 -- 172.21.15.121:0/2005493244 wait complete. 2024-09-17T03:40:16.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:40:16.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.282+0000 7f9ddae00640 1 -- 172.21.15.121:0/4012796857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9db8004800 msgr2=0x7f9db8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.282+0000 7f9ddae00640 1 --2- 172.21.15.121:0/4012796857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9db8004800 0x7f9db8004c10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4070280 tx=0x7f9db8005830 comp rx=0 tx=0).stop 2024-09-17T03:40:16.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.282+0000 7f9dd8e00640 1 -- 172.21.15.121:0/4012796857 reap_dead start 2024-09-17T03:40:16.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.282+0000 7f9ddae00640 1 -- 172.21.15.121:0/4012796857 shutdown_connections 2024-09-17T03:40:16.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.282+0000 7f9ddae00640 1 -- 172.21.15.121:0/4012796857 >> 172.21.15.121:0/4012796857 conn(0x7f9dd40b3580 msgr2=0x7f9dd40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:16.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.283+0000 7f9ddae00640 1 -- 172.21.15.121:0/4012796857 shutdown_connections 2024-09-17T03:40:16.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.283+0000 7f9ddae00640 1 -- 172.21.15.121:0/4012796857 wait complete. 2024-09-17T03:40:16.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.285+0000 7f9ddae00640 1 Processor -- start 2024-09-17T03:40:16.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.285+0000 7f9ddae00640 1 -- start start 2024-09-17T03:40:16.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.286+0000 7f9ddae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db8004800 0x7f9dd4152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.286+0000 7f9ddae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dd414deb0 0x7f9dd415e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.286+0000 7f9ddae00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dd415edd0 0x7f9dd41f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.286+0000 7f9ddae00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd406db90 con 0x7f9dd415edd0 2024-09-17T03:40:16.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.286+0000 7f9ddae00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd406da10 con 0x7f9dd414deb0 2024-09-17T03:40:16.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.286+0000 7f9ddae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd415d150 con 0x7f9db8004800 2024-09-17T03:40:16.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.286+0000 7f9dd8e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dd415edd0 0x7f9dd41f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dd8e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dd415edd0 0x7f9dd41f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54502/0 (socket says 172.21.15.121:54502) 2024-09-17T03:40:16.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dd8e00640 1 -- 172.21.15.121:0/4165443651 learned_addr learned my addr 172.21.15.121:0/4165443651 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:16.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dd3400640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dd414deb0 0x7f9dd415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dd3e00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db8004800 0x7f9dd4152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dd8e00640 1 -- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db8004800 msgr2=0x7f9dd4152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dd8e00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db8004800 0x7f9dd4152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dd8e00640 1 -- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dd414deb0 msgr2=0x7f9dd415e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dd8e00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dd414deb0 0x7f9dd415e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dd8e00640 1 -- 172.21.15.121:0/4165443651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd414e2c0 con 0x7f9dd415edd0 2024-09-17T03:40:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dd8e00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dd415edd0 0x7f9dd41f3a70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40cdbd0 tx=0x7f9dcc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.287+0000 7f9dcbe00640 1 -- 172.21.15.121:0/4165443651 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc003b70 con 0x7f9dd415edd0 2024-09-17T03:40:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.288+0000 7f9dcbe00640 1 -- 172.21.15.121:0/4165443651 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dcc015070 con 0x7f9dd415edd0 2024-09-17T03:40:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.288+0000 7f9dcbe00640 1 -- 172.21.15.121:0/4165443651 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc010e60 con 0x7f9dd415edd0 2024-09-17T03:40:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.288+0000 7f9ddae00640 1 -- 172.21.15.121:0/4165443651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd41f6fa0 con 0x7f9dd415edd0 2024-09-17T03:40:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.288+0000 7f9ddae00640 1 -- 172.21.15.121:0/4165443651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd41f7560 con 0x7f9dd415edd0 2024-09-17T03:40:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.289+0000 7f9ddae00640 1 -- 172.21.15.121:0/4165443651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd415cc10 con 0x7f9dd415edd0 2024-09-17T03:40:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.290+0000 7f9dcbe00640 1 -- 172.21.15.121:0/4165443651 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9dcc004030 con 0x7f9dd415edd0 2024-09-17T03:40:16.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.291+0000 7f9dcbe00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9db4078b90 0x7f9db407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.291+0000 7f9dcbe00640 1 -- 172.21.15.121:0/4165443651 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5335+0+0 (secure 0 0 0) 0x7f9dcc09b830 con 0x7f9dd415edd0 2024-09-17T03:40:16.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.291+0000 7f9dd3e00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9db4078b90 0x7f9db407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.292+0000 7f9dd3e00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9db4078b90 0x7f9db407b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009b20 tx=0x7f9dc4005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:16.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.295+0000 7f9dcbe00640 1 -- 172.21.15.121:0/4165443651 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9dcc0636f0 con 0x7f9dd415edd0 2024-09-17T03:40:16.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.480+0000 7f9ddae00640 1 -- 172.21.15.121:0/4165443651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f9dd4074b10 con 0x7f9dd415edd0 2024-09-17T03:40:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.484+0000 7f9dcbe00640 1 -- 172.21.15.121:0/4165443651 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v46) ==== 71+0+0 (secure 0 0 0) 0x7f9dcc068120 con 0x7f9dd415edd0 2024-09-17T03:40:16.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 -- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9db4078b90 msgr2=0x7f9db407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9db4078b90 0x7f9db407b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009b20 tx=0x7f9dc4005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:16.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 -- 172.21.15.121:0/4165443651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dd415edd0 msgr2=0x7f9dd41f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dd415edd0 0x7f9dd41f3a70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40cdbd0 tx=0x7f9dcc00e720 comp rx=0 tx=0).stop 2024-09-17T03:40:16.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 -- 172.21.15.121:0/4165443651 shutdown_connections 2024-09-17T03:40:16.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f9db4078b90 0x7f9db407b0a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dd415edd0 0x7f9dd41f3a70 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9dd414deb0 0x7f9dd415e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 --2- 172.21.15.121:0/4165443651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9db8004800 0x7f9dd4152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 -- 172.21.15.121:0/4165443651 >> 172.21.15.121:0/4165443651 conn(0x7f9dd40b3580 msgr2=0x7f9dd4072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:16.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 -- 172.21.15.121:0/4165443651 shutdown_connections 2024-09-17T03:40:16.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.487+0000 7f9ddae00640 1 -- 172.21.15.121:0/4165443651 wait complete. 2024-09-17T03:40:16.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop' 2024-09-17T03:40:16.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.729+0000 7f7646000640 1 -- 172.21.15.121:0/836803971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76400ce9e0 msgr2=0x7f76400d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.729+0000 7f7646000640 1 --2- 172.21.15.121:0/836803971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76400ce9e0 0x7f76400d0c40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f762c009830 tx=0x7f762c02a5a0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.730+0000 7f7646000640 1 -- 172.21.15.121:0/836803971 shutdown_connections 2024-09-17T03:40:16.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.730+0000 7f7646000640 1 --2- 172.21.15.121:0/836803971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76400ce9e0 0x7f76400d0c40 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.730+0000 7f7646000640 1 --2- 172.21.15.121:0/836803971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76400cc270 0x7f76400d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.730+0000 7f7646000640 1 -- 172.21.15.121:0/836803971 >> 172.21.15.121:0/836803971 conn(0x7f76400b3580 msgr2=0x7f76400b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:16.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.730+0000 7f7646000640 1 -- 172.21.15.121:0/836803971 shutdown_connections 2024-09-17T03:40:16.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.730+0000 7f7646000640 1 -- 172.21.15.121:0/836803971 wait complete. 2024-09-17T03:40:16.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.732+0000 7f7646000640 1 Processor -- start 2024-09-17T03:40:16.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.732+0000 7f7646000640 1 -- start start 2024-09-17T03:40:16.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.733+0000 7f7646000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f764006cde0 0x7f76400cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f7646000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76400cc270 0x7f7640159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f7646000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76400ce9e0 0x7f76401f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f7646000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f76400afad0 con 0x7f76400ce9e0 2024-09-17T03:40:16.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f7646000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76400af950 con 0x7f76400cc270 2024-09-17T03:40:16.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f7646000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f764006d900 con 0x7f764006cde0 2024-09-17T03:40:16.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f763fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76400ce9e0 0x7f76401f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f763fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76400ce9e0 0x7f76401f92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54522/0 (socket says 172.21.15.121:54522) 2024-09-17T03:40:16.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f763fe00640 1 -- 172.21.15.121:0/3410002845 learned_addr learned my addr 172.21.15.121:0/3410002845 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:16.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f763f400640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f764006cde0 0x7f76400cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f763ea00640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76400cc270 0x7f7640159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f763fe00640 1 -- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f764006cde0 msgr2=0x7f76400cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f763fe00640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f764006cde0 0x7f76400cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f763fe00640 1 -- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76400cc270 msgr2=0x7f7640159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f763fe00640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76400cc270 0x7f7640159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.734+0000 7f763fe00640 1 -- 172.21.15.121:0/3410002845 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764009b7b0 con 0x7f76400ce9e0 2024-09-17T03:40:16.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.735+0000 7f763fe00640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76400ce9e0 0x7f76401f92e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f763800c730 tx=0x7f763800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:16.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.735+0000 7f7637400640 1 -- 172.21.15.121:0/3410002845 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638003b70 con 0x7f76400ce9e0 2024-09-17T03:40:16.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.735+0000 7f7637400640 1 -- 172.21.15.121:0/3410002845 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7638003d30 con 0x7f76400ce9e0 2024-09-17T03:40:16.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.735+0000 7f7637400640 1 -- 172.21.15.121:0/3410002845 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76380052d0 con 0x7f76400ce9e0 2024-09-17T03:40:16.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.735+0000 7f7646000640 1 -- 172.21.15.121:0/3410002845 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76400b1f00 con 0x7f76400ce9e0 2024-09-17T03:40:16.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.735+0000 7f7646000640 1 -- 172.21.15.121:0/3410002845 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76401e8390 con 0x7f76400ce9e0 2024-09-17T03:40:16.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.736+0000 7f7646000640 1 -- 172.21.15.121:0/3410002845 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764009b980 con 0x7f76400ce9e0 2024-09-17T03:40:16.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.737+0000 7f7637400640 1 -- 172.21.15.121:0/3410002845 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7638005680 con 0x7f76400ce9e0 2024-09-17T03:40:16.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.738+0000 7f7637400640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7620078b90 0x7f762007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.738+0000 7f7637400640 1 -- 172.21.15.121:0/3410002845 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5335+0+0 (secure 0 0 0) 0x7f763809a9d0 con 0x7f76400ce9e0 2024-09-17T03:40:16.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.739+0000 7f763f400640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7620078b90 0x7f762007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.740+0000 7f763f400640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7620078b90 0x7f762007b0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f763000bb50 tx=0x7f763000b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:16.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.743+0000 7f7637400640 1 -- 172.21.15.121:0/3410002845 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f76380629b0 con 0x7f76400ce9e0 2024-09-17T03:40:16.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:16.995+0000 7f7646000640 1 -- 172.21.15.121:0/3410002845 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]} v 0) -- 0x7f76401e81b0 con 0x7f76400ce9e0 2024-09-17T03:40:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.017+0000 7f7637400640 1 -- 172.21.15.121:0/3410002845 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_tell_session_drop"]}]=0 v276) ==== 145+0+0 (secure 0 0 0) 0x7f76401e81b0 con 0x7f76400ce9e0 2024-09-17T03:40:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.019+0000 7f7646000640 1 -- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7620078b90 msgr2=0x7f762007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.019+0000 7f7646000640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7620078b90 0x7f762007b0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f763000bb50 tx=0x7f763000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.019+0000 7f7646000640 1 -- 172.21.15.121:0/3410002845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76400ce9e0 msgr2=0x7f76401f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.019+0000 7f7646000640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76400ce9e0 0x7f76401f92e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f763800c730 tx=0x7f763800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.019+0000 7f7646000640 1 -- 172.21.15.121:0/3410002845 shutdown_connections 2024-09-17T03:40:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.019+0000 7f7646000640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7620078b90 0x7f762007b0a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.019+0000 7f7646000640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76400ce9e0 0x7f76401f92e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.019+0000 7f7646000640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76400cc270 0x7f7640159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.019+0000 7f7646000640 1 --2- 172.21.15.121:0/3410002845 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f764006cde0 0x7f76400cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.019+0000 7f7646000640 1 -- 172.21.15.121:0/3410002845 >> 172.21.15.121:0/3410002845 conn(0x7f76400b3580 msgr2=0x7f7640073b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.020+0000 7f7646000640 1 -- 172.21.15.121:0/3410002845 shutdown_connections 2024-09-17T03:40:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.020+0000 7f7646000640 1 -- 172.21.15.121:0/3410002845 wait complete. 2024-09-17T03:40:17.046 INFO:tasks.cephfs_test_runner:That when a `tell` command is sent using the python CLI, ... ok 2024-09-17T03:40:17.046 INFO:tasks.cephfs_test_runner:Starting test: test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) That when many sessions are updated, they are correctly 2024-09-17T03:40:17.047 INFO:tasks.cephfs_test_runner:test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) 2024-09-17T03:40:17.047 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.268+0000 7f0b9da00640 1 -- 172.21.15.121:0/1963788717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b98070810 msgr2=0x7f0b980b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.268+0000 7f0b9da00640 1 --2- 172.21.15.121:0/1963788717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b98070810 0x7f0b980b4c80 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f0b980cffe0 tx=0x7f0b8802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.268+0000 7f0b9da00640 1 -- 172.21.15.121:0/1963788717 shutdown_connections 2024-09-17T03:40:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.268+0000 7f0b9da00640 1 --2- 172.21.15.121:0/1963788717 >> v2:172.21.15.176:3300/0 conn(0x7f0b980b51c0 0x7f0b98160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.268+0000 7f0b9da00640 1 --2- 172.21.15.121:0/1963788717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b98070810 0x7f0b980b4c80 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.268+0000 7f0b9da00640 1 -- 172.21.15.121:0/1963788717 >> 172.21.15.121:0/1963788717 conn(0x7f0b980b2440 msgr2=0x7f0b980d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.268+0000 7f0b9da00640 1 -- 172.21.15.121:0/1963788717 shutdown_connections 2024-09-17T03:40:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.269+0000 7f0b9da00640 1 -- 172.21.15.121:0/1963788717 wait complete. 2024-09-17T03:40:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.271+0000 7f0b9da00640 1 Processor -- start 2024-09-17T03:40:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.271+0000 7f0b9da00640 1 -- start start 2024-09-17T03:40:17.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.272+0000 7f0b9da00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b98070810 0x7f0b980cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.272+0000 7f0b9da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b980b51c0 0x7f0b98137b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.272+0000 7f0b9da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b981606c0 0x7f0b98138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.272+0000 7f0b9da00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0b980b30e0 con 0x7f0b98070810 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.272+0000 7f0b9da00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9806f000 con 0x7f0b981606c0 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.272+0000 7f0b9da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9815d2a0 con 0x7f0b980b51c0 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b97e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b98070810 0x7f0b980cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b97e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b98070810 0x7f0b980cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54538/0 (socket says 172.21.15.121:54538) 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b97e00640 1 -- 172.21.15.121:0/2024043440 learned_addr learned my addr 172.21.15.121:0/2024043440 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b97400640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b980b51c0 0x7f0b98137b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b9d000640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b981606c0 0x7f0b98138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b97e00640 1 -- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b980b51c0 msgr2=0x7f0b98137b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b97e00640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b980b51c0 0x7f0b98137b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b97e00640 1 -- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b981606c0 msgr2=0x7f0b98138040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b97e00640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b981606c0 0x7f0b98138040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b97e00640 1 -- 172.21.15.121:0/2024043440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b981f9830 con 0x7f0b98070810 2024-09-17T03:40:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b9d000640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b981606c0 0x7f0b98138040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.273+0000 7f0b97e00640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b98070810 0x7f0b980cf430 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f0b88034040 tx=0x7f0b88003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.274+0000 7f0b8fe00640 1 -- 172.21.15.121:0/2024043440 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8803e030 con 0x7f0b98070810 2024-09-17T03:40:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.274+0000 7f0b8fe00640 1 -- 172.21.15.121:0/2024043440 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b88003e00 con 0x7f0b98070810 2024-09-17T03:40:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.274+0000 7f0b9da00640 1 -- 172.21.15.121:0/2024043440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b981f9b10 con 0x7f0b98070810 2024-09-17T03:40:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.274+0000 7f0b8fe00640 1 -- 172.21.15.121:0/2024043440 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88035040 con 0x7f0b98070810 2024-09-17T03:40:17.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.274+0000 7f0b9da00640 1 -- 172.21.15.121:0/2024043440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9809c3f0 con 0x7f0b98070810 2024-09-17T03:40:17.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.275+0000 7f0b9da00640 1 -- 172.21.15.121:0/2024043440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b981fa030 con 0x7f0b98070810 2024-09-17T03:40:17.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.276+0000 7f0b8fe00640 1 -- 172.21.15.121:0/2024043440 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b88041030 con 0x7f0b98070810 2024-09-17T03:40:17.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.277+0000 7f0b8fe00640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b78078bc0 0x7f0b7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.277+0000 7f0b8fe00640 1 -- 172.21.15.121:0/2024043440 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5335+0+0 (secure 0 0 0) 0x7f0b880bb440 con 0x7f0b98070810 2024-09-17T03:40:17.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.278+0000 7f0b97400640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b78078bc0 0x7f0b7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.278+0000 7f0b97400640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b78078bc0 0x7f0b7807b0d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005fd0 tx=0x7f0b84005850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.281+0000 7f0b8fe00640 1 -- 172.21.15.121:0/2024043440 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b981fa030 con 0x7f0b98070810 2024-09-17T03:40:17.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.466+0000 7f0b9da00640 1 -- 172.21.15.121:0/2024043440 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b9815d700 con 0x7f0b98070810 2024-09-17T03:40:17.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.467+0000 7f0b8fe00640 1 -- 172.21.15.121:0/2024043440 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+13369 (secure 0 0 0) 0x7f0b88083950 con 0x7f0b98070810 2024-09-17T03:40:17.466 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:17.467 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":102,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:40:16.009210+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6837/3841878149":"2024-09-18T03:40:12.673112+0000","172.21.15.176:6835/3841878149":"2024-09-18T03:40:12.673112+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:17.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 -- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b78078bc0 msgr2=0x7f0b7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b78078bc0 0x7f0b7807b0d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005fd0 tx=0x7f0b84005850 comp rx=0 tx=0).stop 2024-09-17T03:40:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 -- 172.21.15.121:0/2024043440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b98070810 msgr2=0x7f0b980cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b98070810 0x7f0b980cf430 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f0b88034040 tx=0x7f0b88003910 comp rx=0 tx=0).stop 2024-09-17T03:40:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 -- 172.21.15.121:0/2024043440 shutdown_connections 2024-09-17T03:40:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b981606c0 0x7f0b98138040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b980b51c0 0x7f0b98137b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0b78078bc0 0x7f0b7807b0d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 --2- 172.21.15.121:0/2024043440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b98070810 0x7f0b980cf430 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 -- 172.21.15.121:0/2024043440 >> 172.21.15.121:0/2024043440 conn(0x7f0b980b2440 msgr2=0x7f0b9815f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:17.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 -- 172.21.15.121:0/2024043440 shutdown_connections 2024-09-17T03:40:17.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.469+0000 7f0b9da00640 1 -- 172.21.15.121:0/2024043440 wait complete. 2024-09-17T03:40:17.492 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:35:21.303701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:40:17.492 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:40:17.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.717+0000 7fd469000640 1 -- 172.21.15.121:0/2237722054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4640d0af0 msgr2=0x7fd46415cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.717+0000 7fd469000640 1 --2- 172.21.15.121:0/2237722054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4640d0af0 0x7fd46415cc10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd45c005fd0 tx=0x7fd45c02a780 comp rx=0 tx=0).stop 2024-09-17T03:40:17.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.717+0000 7fd469000640 1 -- 172.21.15.121:0/2237722054 shutdown_connections 2024-09-17T03:40:17.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.717+0000 7fd469000640 1 --2- 172.21.15.121:0/2237722054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4640d0af0 0x7fd46415cc10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.717+0000 7fd469000640 1 --2- 172.21.15.121:0/2237722054 >> v2:172.21.15.176:3300/0 conn(0x7fd46406d800 0x7fd4640d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.717+0000 7fd469000640 1 -- 172.21.15.121:0/2237722054 >> 172.21.15.121:0/2237722054 conn(0x7fd4640b3580 msgr2=0x7fd4640b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:17.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.717+0000 7fd469000640 1 -- 172.21.15.121:0/2237722054 shutdown_connections 2024-09-17T03:40:17.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.717+0000 7fd469000640 1 -- 172.21.15.121:0/2237722054 wait complete. 2024-09-17T03:40:17.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.719+0000 7fd469000640 1 Processor -- start 2024-09-17T03:40:17.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.719+0000 7fd469000640 1 -- start start 2024-09-17T03:40:17.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd469000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46406d800 0x7fd46415b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd469000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4640d0af0 0x7fd46415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd469000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46415a3e0 0x7fd4640744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd469000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd46415d4e0 con 0x7fd46415a3e0 2024-09-17T03:40:17.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd469000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd46415d360 con 0x7fd46406d800 2024-09-17T03:40:17.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd469000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd46415d660 con 0x7fd4640d0af0 2024-09-17T03:40:17.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd462800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46415a3e0 0x7fd4640744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd462800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46415a3e0 0x7fd4640744c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54544/0 (socket says 172.21.15.121:54544) 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd462800640 1 -- 172.21.15.121:0/657912298 learned_addr learned my addr 172.21.15.121:0/657912298 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd459400640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4640d0af0 0x7fd46415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd461e00640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46406d800 0x7fd46415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd462800640 1 -- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4640d0af0 msgr2=0x7fd46415bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd462800640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4640d0af0 0x7fd46415bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd462800640 1 -- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46406d800 msgr2=0x7fd46415b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd462800640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46406d800 0x7fd46415b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd462800640 1 -- 172.21.15.121:0/657912298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4641f9130 con 0x7fd46415a3e0 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd461e00640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46406d800 0x7fd46415b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.721+0000 7fd459400640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4640d0af0 0x7fd46415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.722+0000 7fd462800640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46415a3e0 0x7fd4640744c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009cd0 tx=0x7fd45c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.722+0000 7fd45aa00640 1 -- 172.21.15.121:0/657912298 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c040070 con 0x7fd46415a3e0 2024-09-17T03:40:17.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.722+0000 7fd45aa00640 1 -- 172.21.15.121:0/657912298 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd45c004350 con 0x7fd46415a3e0 2024-09-17T03:40:17.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.722+0000 7fd45aa00640 1 -- 172.21.15.121:0/657912298 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0047a0 con 0x7fd46415a3e0 2024-09-17T03:40:17.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.722+0000 7fd469000640 1 -- 172.21.15.121:0/657912298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4641f9410 con 0x7fd46415a3e0 2024-09-17T03:40:17.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.722+0000 7fd469000640 1 -- 172.21.15.121:0/657912298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4641f99d0 con 0x7fd46415a3e0 2024-09-17T03:40:17.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.723+0000 7fd469000640 1 -- 172.21.15.121:0/657912298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46415db80 con 0x7fd46415a3e0 2024-09-17T03:40:17.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.724+0000 7fd45aa00640 1 -- 172.21.15.121:0/657912298 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd45c043070 con 0x7fd46415a3e0 2024-09-17T03:40:17.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.725+0000 7fd45aa00640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd440078b90 0x7fd44007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.725+0000 7fd45aa00640 1 -- 172.21.15.121:0/657912298 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5335+0+0 (secure 0 0 0) 0x7fd45c0bbeb0 con 0x7fd46415a3e0 2024-09-17T03:40:17.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.726+0000 7fd461e00640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd440078b90 0x7fd44007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.727+0000 7fd461e00640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd440078b90 0x7fd44007b0a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd454001620 tx=0x7fd454009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:17.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.730+0000 7fd45aa00640 1 -- 172.21.15.121:0/657912298 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd45c0843c0 con 0x7fd46415a3e0 2024-09-17T03:40:17.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.912+0000 7fd469000640 1 -- 172.21.15.121:0/657912298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd464069690 con 0x7fd46415a3e0 2024-09-17T03:40:17.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.913+0000 7fd45aa00640 1 -- 172.21.15.121:0/657912298 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) ==== 93+0+10 (secure 0 0 0) 0x7fd45c083cc0 con 0x7fd46415a3e0 2024-09-17T03:40:17.913 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-17T03:40:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.915+0000 7fd469000640 1 -- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd440078b90 msgr2=0x7fd44007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.915+0000 7fd469000640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd440078b90 0x7fd44007b0a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd454001620 tx=0x7fd454009040 comp rx=0 tx=0).stop 2024-09-17T03:40:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.915+0000 7fd469000640 1 -- 172.21.15.121:0/657912298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46415a3e0 msgr2=0x7fd4640744c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.915+0000 7fd469000640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46415a3e0 0x7fd4640744c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009cd0 tx=0x7fd45c003ba0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.915+0000 7fd469000640 1 -- 172.21.15.121:0/657912298 shutdown_connections 2024-09-17T03:40:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.915+0000 7fd469000640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd440078b90 0x7fd44007b0a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.915+0000 7fd469000640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd46415a3e0 0x7fd4640744c0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.915+0000 7fd469000640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4640d0af0 0x7fd46415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.915+0000 7fd469000640 1 --2- 172.21.15.121:0/657912298 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46406d800 0x7fd46415b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.915+0000 7fd469000640 1 -- 172.21.15.121:0/657912298 >> 172.21.15.121:0/657912298 conn(0x7fd4640b3580 msgr2=0x7fd4640cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.916+0000 7fd469000640 1 -- 172.21.15.121:0/657912298 shutdown_connections 2024-09-17T03:40:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:17.916+0000 7fd469000640 1 -- 172.21.15.121:0/657912298 wait complete. 2024-09-17T03:40:17.941 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2024-09-17T03:40:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.163+0000 7f34e7e00640 1 -- 172.21.15.121:0/1027424133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34cc004d90 msgr2=0x7f34cc005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.163+0000 7f34e7e00640 1 --2- 172.21.15.121:0/1027424133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34cc004d90 0x7f34cc005220 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009b20 tx=0x7f34cc005830 comp rx=0 tx=0).stop 2024-09-17T03:40:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.163+0000 7f34e7400640 1 -- 172.21.15.121:0/1027424133 reap_dead start 2024-09-17T03:40:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.163+0000 7f34e7e00640 1 -- 172.21.15.121:0/1027424133 shutdown_connections 2024-09-17T03:40:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.163+0000 7f34e7e00640 1 -- 172.21.15.121:0/1027424133 >> 172.21.15.121:0/1027424133 conn(0x7f34e80b2440 msgr2=0x7f34e80d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.163+0000 7f34e7e00640 1 -- 172.21.15.121:0/1027424133 shutdown_connections 2024-09-17T03:40:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.163+0000 7f34e7e00640 1 -- 172.21.15.121:0/1027424133 wait complete. 2024-09-17T03:40:18.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.166+0000 7f34e7e00640 1 Processor -- start 2024-09-17T03:40:18.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.166+0000 7f34e7e00640 1 -- start start 2024-09-17T03:40:18.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.167+0000 7f34e7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34cc004d90 0x7f34e8141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.167+0000 7f34e7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34e813d5d0 0x7f34e815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.167+0000 7f34e7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34e815f280 0x7f34e81f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.167+0000 7f34e7e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f34e806ef70 con 0x7f34cc004d90 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.167+0000 7f34e7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f34e806edf0 con 0x7f34e815f280 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.167+0000 7f34e7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f34e8165700 con 0x7f34e813d5d0 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.167+0000 7f34e6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34cc004d90 0x7f34e8141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.167+0000 7f34e6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34cc004d90 0x7f34e8141ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54574/0 (socket says 172.21.15.121:54574) 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.167+0000 7f34e6a00640 1 -- 172.21.15.121:0/3200533284 learned_addr learned my addr 172.21.15.121:0/3200533284 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34e7400640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34e815f280 0x7f34e81f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34e6000640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34e813d5d0 0x7f34e815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34e6a00640 1 -- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34e813d5d0 msgr2=0x7f34e815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34e6a00640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34e813d5d0 0x7f34e815ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34e6a00640 1 -- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34e815f280 msgr2=0x7f34e81f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34e6a00640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34e815f280 0x7f34e81f6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34e6a00640 1 -- 172.21.15.121:0/3200533284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e815f690 con 0x7f34cc004d90 2024-09-17T03:40:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34e6000640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34e813d5d0 0x7f34e815ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34e6a00640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34cc004d90 0x7f34e8141ba0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f34d8006290 tx=0x7f34d8006690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:18.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34dea00640 1 -- 172.21.15.121:0/3200533284 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8015070 con 0x7f34cc004d90 2024-09-17T03:40:18.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34dea00640 1 -- 172.21.15.121:0/3200533284 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34d800fd60 con 0x7f34cc004d90 2024-09-17T03:40:18.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34dea00640 1 -- 172.21.15.121:0/3200533284 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8011690 con 0x7f34cc004d90 2024-09-17T03:40:18.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.168+0000 7f34e7e00640 1 -- 172.21.15.121:0/3200533284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e8142510 con 0x7f34cc004d90 2024-09-17T03:40:18.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.169+0000 7f34e7e00640 1 -- 172.21.15.121:0/3200533284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e8142ad0 con 0x7f34cc004d90 2024-09-17T03:40:18.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.169+0000 7f34e7e00640 1 -- 172.21.15.121:0/3200533284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e81448f0 con 0x7f34cc004d90 2024-09-17T03:40:18.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.171+0000 7f34dea00640 1 -- 172.21.15.121:0/3200533284 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34d8011830 con 0x7f34cc004d90 2024-09-17T03:40:18.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.172+0000 7f34dea00640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f34c8078b90 0x7f34c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.172+0000 7f34dea00640 1 -- 172.21.15.121:0/3200533284 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5335+0+0 (secure 0 0 0) 0x7f34d809c150 con 0x7f34cc004d90 2024-09-17T03:40:18.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.172+0000 7f34e6000640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f34c8078b90 0x7f34c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.173+0000 7f34e6000640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f34c8078b90 0x7f34c807b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f34e8141700 tx=0x7f34d4006bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:18.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.175+0000 7f34dea00640 1 -- 172.21.15.121:0/3200533284 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f34e815f690 con 0x7f34cc004d90 2024-09-17T03:40:18.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:18.432+0000 7f34e7e00640 1 -- 172.21.15.121:0/3200533284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) -- 0x7f34e8144610 con 0x7f34cc004d90 2024-09-17T03:40:19.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.028+0000 7f34dea00640 1 -- 172.21.15.121:0/3200533284 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v278) ==== 148+0+0 (secure 0 0 0) 0x7f34d8064090 con 0x7f34cc004d90 2024-09-17T03:40:19.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 -- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f34c8078b90 msgr2=0x7f34c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f34c8078b90 0x7f34c807b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f34e8141700 tx=0x7f34d4006bc0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 -- 172.21.15.121:0/3200533284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34cc004d90 msgr2=0x7f34e8141ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34cc004d90 0x7f34e8141ba0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f34d8006290 tx=0x7f34d8006690 comp rx=0 tx=0).stop 2024-09-17T03:40:19.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 -- 172.21.15.121:0/3200533284 shutdown_connections 2024-09-17T03:40:19.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34e815f280 0x7f34e81f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34e813d5d0 0x7f34e815ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f34c8078b90 0x7f34c807b0a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 --2- 172.21.15.121:0/3200533284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34cc004d90 0x7f34e8141ba0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 -- 172.21.15.121:0/3200533284 >> 172.21.15.121:0/3200533284 conn(0x7f34e80b2440 msgr2=0x7f34e806df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:19.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.030+0000 7f34e7e00640 1 -- 172.21.15.121:0/3200533284 shutdown_connections 2024-09-17T03:40:19.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.031+0000 7f34e7e00640 1 -- 172.21.15.121:0/3200533284 wait complete. 2024-09-17T03:40:19.054 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:40:19.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.276+0000 7fb3aa800640 1 -- 172.21.15.121:0/2849005935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb388005150 msgr2=0x7fb38800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.276+0000 7fb3aa800640 1 --2- 172.21.15.121:0/2849005935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb388005150 0x7fb38800b9c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb39c005fd0 tx=0x7fb388005830 comp rx=0 tx=0).stop 2024-09-17T03:40:19.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.276+0000 7fb3a3e00640 1 -- 172.21.15.121:0/2849005935 reap_dead start 2024-09-17T03:40:19.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.276+0000 7fb3aa800640 1 -- 172.21.15.121:0/2849005935 shutdown_connections 2024-09-17T03:40:19.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.276+0000 7fb3aa800640 1 -- 172.21.15.121:0/2849005935 >> 172.21.15.121:0/2849005935 conn(0x7fb3a40b3580 msgr2=0x7fb3a40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:19.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.276+0000 7fb3aa800640 1 -- 172.21.15.121:0/2849005935 shutdown_connections 2024-09-17T03:40:19.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.276+0000 7fb3aa800640 1 -- 172.21.15.121:0/2849005935 wait complete. 2024-09-17T03:40:19.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.278+0000 7fb3aa800640 1 Processor -- start 2024-09-17T03:40:19.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.279+0000 7fb3aa800640 1 -- start start 2024-09-17T03:40:19.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3aa800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb388005150 0x7fb3a40af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3aa800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3a41f9340 0x7fb3a40af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3aa800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3a40c4f70 0x7fb3a40c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3aa800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40d0d40 con 0x7fb388005150 2024-09-17T03:40:19.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3aa800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40cc860 con 0x7fb3a41f9340 2024-09-17T03:40:19.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3aa800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a40d0ec0 con 0x7fb3a40c4f70 2024-09-17T03:40:19.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3a3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb388005150 0x7fb3a40af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3a3400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb388005150 0x7fb3a40af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54594/0 (socket says 172.21.15.121:54594) 2024-09-17T03:40:19.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3a3400640 1 -- 172.21.15.121:0/4021726596 learned_addr learned my addr 172.21.15.121:0/4021726596 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:19.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3a2a00640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3a41f9340 0x7fb3a40af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.280+0000 7fb3a3e00640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3a40c4f70 0x7fb3a40c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb3a3400640 1 -- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3a40c4f70 msgr2=0x7fb3a40c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb3a3400640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3a40c4f70 0x7fb3a40c5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb3a3400640 1 -- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3a41f9340 msgr2=0x7fb3a40af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb3a3400640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3a41f9340 0x7fb3a40af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb3a3400640 1 -- 172.21.15.121:0/4021726596 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a41f5e90 con 0x7fb388005150 2024-09-17T03:40:19.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb3a3400640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb388005150 0x7fb3a40af050 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fb394011ae0 tx=0x7fb394009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:19.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb39b400640 1 -- 172.21.15.121:0/4021726596 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39400fcb0 con 0x7fb388005150 2024-09-17T03:40:19.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb39b400640 1 -- 172.21.15.121:0/4021726596 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb39400fe50 con 0x7fb388005150 2024-09-17T03:40:19.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb3aa800640 1 -- 172.21.15.121:0/4021726596 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a41f8860 con 0x7fb388005150 2024-09-17T03:40:19.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb39b400640 1 -- 172.21.15.121:0/4021726596 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb394004280 con 0x7fb388005150 2024-09-17T03:40:19.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.281+0000 7fb3aa800640 1 -- 172.21.15.121:0/4021726596 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a41f8e20 con 0x7fb388005150 2024-09-17T03:40:19.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.282+0000 7fb3aa800640 1 -- 172.21.15.121:0/4021726596 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a40707c0 con 0x7fb388005150 2024-09-17T03:40:19.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.284+0000 7fb39b400640 1 -- 172.21.15.121:0/4021726596 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3940035f0 con 0x7fb388005150 2024-09-17T03:40:19.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.285+0000 7fb39b400640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb384078bc0 0x7fb38407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.285+0000 7fb39b400640 1 -- 172.21.15.121:0/4021726596 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5335+0+0 (secure 0 0 0) 0x7fb39409b590 con 0x7fb388005150 2024-09-17T03:40:19.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.285+0000 7fb3a2a00640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb384078bc0 0x7fb38407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.286+0000 7fb3a2a00640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb384078bc0 0x7fb38407b0d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4150030 tx=0x7fb3900067a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:19.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.290+0000 7fb39b400640 1 -- 172.21.15.121:0/4021726596 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb394063610 con 0x7fb388005150 2024-09-17T03:40:19.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.480+0000 7fb3aa800640 1 -- 172.21.15.121:0/4021726596 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb3a415e600 con 0x7fb388005150 2024-09-17T03:40:19.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.481+0000 7fb39b400640 1 -- 172.21.15.121:0/4021726596 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v46) ==== 59+0+2294 (secure 0 0 0) 0x7fb394068040 con 0x7fb388005150 2024-09-17T03:40:19.481 INFO:teuthology.orchestra.run.smithi121.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:40:19.481 INFO:teuthology.orchestra.run.smithi121.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:40:19.481 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:40:19.481 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_client 20/20 2024-09-17T03:40:19.481 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:40:19.481 INFO:teuthology.orchestra.run.smithi121.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:40:19.481 INFO:teuthology.orchestra.run.smithi121.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:40:19.481 INFO:teuthology.orchestra.run.smithi121.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3249.879374 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3414.976419 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3347.142673 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3524.210167 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 7230.495988 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4229.547603 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4520.738354 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4185.245448 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds 20/20 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced debug_ms 2/2 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_frag true 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:40:19.483 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:40:19.483 INFO:teuthology.orchestra.run.smithi121.stdout:mds dev mds_verify_scatter true 2024-09-17T03:40:19.483 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:40:19.483 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:40:19.483 INFO:teuthology.orchestra.run.smithi121.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:40:19.483 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced client_mount_timeout 600 2024-09-17T03:40:19.483 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_client 20/20 2024-09-17T03:40:19.483 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced debug_ms 1/1 2024-09-17T03:40:19.483 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:40:19.483 INFO:teuthology.orchestra.run.smithi121.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.483+0000 7fb3aa800640 1 -- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb384078bc0 msgr2=0x7fb38407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.483+0000 7fb3aa800640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb384078bc0 0x7fb38407b0d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4150030 tx=0x7fb3900067a0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.483+0000 7fb3aa800640 1 -- 172.21.15.121:0/4021726596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb388005150 msgr2=0x7fb3a40af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.483+0000 7fb3aa800640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb388005150 0x7fb3a40af050 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fb394011ae0 tx=0x7fb394009f10 comp rx=0 tx=0).stop 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.483+0000 7fb3aa800640 1 -- 172.21.15.121:0/4021726596 shutdown_connections 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.483+0000 7fb3aa800640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb3a40c4f70 0x7fb3a40c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.483+0000 7fb3aa800640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3a41f9340 0x7fb3a40af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.483+0000 7fb3aa800640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fb384078bc0 0x7fb38407b0d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.483+0000 7fb3aa800640 1 --2- 172.21.15.121:0/4021726596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb388005150 0x7fb3a40af050 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.483+0000 7fb3aa800640 1 -- 172.21.15.121:0/4021726596 >> 172.21.15.121:0/4021726596 conn(0x7fb3a40b3580 msgr2=0x7fb3a415db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:19.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.484+0000 7fb3aa800640 1 -- 172.21.15.121:0/4021726596 shutdown_connections 2024-09-17T03:40:19.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.484+0000 7fb3aa800640 1 -- 172.21.15.121:0/4021726596 wait complete. 2024-09-17T03:40:19.508 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:40:19.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.734+0000 7f1d66200640 1 -- 172.21.15.121:0/3199269096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d48004800 msgr2=0x7f1d48004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.734+0000 7f1d66200640 1 --2- 172.21.15.121:0/3199269096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d48004800 0x7f1d48004c10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00c310 tx=0x7f1d48005830 comp rx=0 tx=0).stop 2024-09-17T03:40:19.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.734+0000 7f1d66200640 1 -- 172.21.15.121:0/3199269096 shutdown_connections 2024-09-17T03:40:19.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.734+0000 7f1d66200640 1 --2- 172.21.15.121:0/3199269096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d48004800 0x7f1d48004c10 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.734+0000 7f1d66200640 1 -- 172.21.15.121:0/3199269096 >> 172.21.15.121:0/3199269096 conn(0x7f1d600d07f0 msgr2=0x7f1d600b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:19.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.734+0000 7f1d66200640 1 -- 172.21.15.121:0/3199269096 shutdown_connections 2024-09-17T03:40:19.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.734+0000 7f1d66200640 1 -- 172.21.15.121:0/3199269096 wait complete. 2024-09-17T03:40:19.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.737+0000 7f1d66200640 1 Processor -- start 2024-09-17T03:40:19.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.737+0000 7f1d66200640 1 -- start start 2024-09-17T03:40:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.738+0000 7f1d66200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d48004800 0x7f1d6013e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.738+0000 7f1d66200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d6013b6d0 0x7f1d600aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.738+0000 7f1d66200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6014f190 0x7f1d600ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.738+0000 7f1d66200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1d601605b0 con 0x7f1d6013b6d0 2024-09-17T03:40:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.738+0000 7f1d66200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1d60160430 con 0x7f1d6014f190 2024-09-17T03:40:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.738+0000 7f1d66200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1d60160730 con 0x7f1d48004800 2024-09-17T03:40:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.738+0000 7f1d5fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d6013b6d0 0x7f1d600aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.738+0000 7f1d5fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d6013b6d0 0x7f1d600aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54614/0 (socket says 172.21.15.121:54614) 2024-09-17T03:40:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.738+0000 7f1d5fe00640 1 -- 172.21.15.121:0/2205143824 learned_addr learned my addr 172.21.15.121:0/2205143824 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:19.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.738+0000 7f1d64e00640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d48004800 0x7f1d6013e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d65800640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6014f190 0x7f1d600ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d5fe00640 1 -- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d48004800 msgr2=0x7f1d6013e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d5fe00640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d48004800 0x7f1d6013e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d5fe00640 1 -- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6014f190 msgr2=0x7f1d600ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d5fe00640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6014f190 0x7f1d600ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d5fe00640 1 -- 172.21.15.121:0/2205143824 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d600af290 con 0x7f1d6013b6d0 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d5fe00640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d6013b6d0 0x7f1d600aed50 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c02b130 tx=0x7f1d4c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d5cc00640 1 -- 172.21.15.121:0/2205143824 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c031040 con 0x7f1d6013b6d0 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d5cc00640 1 -- 172.21.15.121:0/2205143824 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d4c0065e0 con 0x7f1d6013b6d0 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d66200640 1 -- 172.21.15.121:0/2205143824 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6014d580 con 0x7f1d6013b6d0 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d5cc00640 1 -- 172.21.15.121:0/2205143824 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c003a60 con 0x7f1d6013b6d0 2024-09-17T03:40:19.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.739+0000 7f1d66200640 1 -- 172.21.15.121:0/2205143824 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d600ad960 con 0x7f1d6013b6d0 2024-09-17T03:40:19.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.741+0000 7f1d66200640 1 -- 172.21.15.121:0/2205143824 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d60160c90 con 0x7f1d6013b6d0 2024-09-17T03:40:19.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.741+0000 7f1d5cc00640 1 -- 172.21.15.121:0/2205143824 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d4c03e030 con 0x7f1d6013b6d0 2024-09-17T03:40:19.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.742+0000 7f1d5cc00640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d40078bc0 0x7f1d4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.743+0000 7f1d5cc00640 1 -- 172.21.15.121:0/2205143824 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5335+0+0 (secure 0 0 0) 0x7f1d4c0ba9c0 con 0x7f1d6013b6d0 2024-09-17T03:40:19.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.743+0000 7f1d64e00640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d40078bc0 0x7f1d4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.744+0000 7f1d64e00640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d40078bc0 0x7f1d4007b0d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1d60052910 tx=0x7f1d54006b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:19.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.747+0000 7f1d5cc00640 1 -- 172.21.15.121:0/2205143824 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1d4c082ed0 con 0x7f1d6013b6d0 2024-09-17T03:40:19.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.932+0000 7f1d66200640 1 -- 172.21.15.121:0/2205143824 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1d60152150 con 0x7f1d6013b6d0 2024-09-17T03:40:19.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.936+0000 7f1d5cc00640 1 -- 172.21.15.121:0/2205143824 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v47)=0 v47) ==== 122+0+0 (secure 0 0 0) 0x7f1d4c0827d0 con 0x7f1d6013b6d0 2024-09-17T03:40:19.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 -- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d40078bc0 msgr2=0x7f1d4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d40078bc0 0x7f1d4007b0d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1d60052910 tx=0x7f1d54006b70 comp rx=0 tx=0).stop 2024-09-17T03:40:19.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 -- 172.21.15.121:0/2205143824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d6013b6d0 msgr2=0x7f1d600aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d6013b6d0 0x7f1d600aed50 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c02b130 tx=0x7f1d4c001d80 comp rx=0 tx=0).stop 2024-09-17T03:40:19.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 -- 172.21.15.121:0/2205143824 shutdown_connections 2024-09-17T03:40:19.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d6014f190 0x7f1d600ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1d40078bc0 0x7f1d4007b0d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1d6013b6d0 0x7f1d600aed50 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 --2- 172.21.15.121:0/2205143824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d48004800 0x7f1d6013e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 -- 172.21.15.121:0/2205143824 >> 172.21.15.121:0/2205143824 conn(0x7f1d600d07f0 msgr2=0x7f1d60150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:19.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 -- 172.21.15.121:0/2205143824 shutdown_connections 2024-09-17T03:40:19.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:19.938+0000 7f1d66200640 1 -- 172.21.15.121:0/2205143824 wait complete. 2024-09-17T03:40:19.960 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:40:19.960 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:20.049 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:20.153 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:40:20.153 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:20.153 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:20.190 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:40:20.190 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:20.190 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:20.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:20.227 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:20.227 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:20.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:40:20.266 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:20.266 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:20.302 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:20.302 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:40:20.303 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:20.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.524+0000 7fbd6ba00640 1 -- 172.21.15.121:0/972693846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd6415a3e0 msgr2=0x7fbd6406d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.524+0000 7fbd6ba00640 1 --2- 172.21.15.121:0/972693846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd6415a3e0 0x7fbd6406d800 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fbd640cdbd0 tx=0x7fbd5402a440 comp rx=0 tx=0).stop 2024-09-17T03:40:20.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.524+0000 7fbd6ba00640 1 -- 172.21.15.121:0/972693846 shutdown_connections 2024-09-17T03:40:20.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.524+0000 7fbd6ba00640 1 --2- 172.21.15.121:0/972693846 >> v2:172.21.15.176:3300/0 conn(0x7fbd640d0af0 0x7fbd6406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.524+0000 7fbd6ba00640 1 --2- 172.21.15.121:0/972693846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd6406ddc0 0x7fbd640d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.524+0000 7fbd6ba00640 1 --2- 172.21.15.121:0/972693846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd6415a3e0 0x7fbd6406d800 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.524+0000 7fbd6ba00640 1 -- 172.21.15.121:0/972693846 >> 172.21.15.121:0/972693846 conn(0x7fbd640b3580 msgr2=0x7fbd640b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:20.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.524+0000 7fbd6ba00640 1 -- 172.21.15.121:0/972693846 shutdown_connections 2024-09-17T03:40:20.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.524+0000 7fbd6ba00640 1 -- 172.21.15.121:0/972693846 wait complete. 2024-09-17T03:40:20.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.527+0000 7fbd6ba00640 1 Processor -- start 2024-09-17T03:40:20.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.527+0000 7fbd6ba00640 1 -- start start 2024-09-17T03:40:20.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.528+0000 7fbd6ba00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd6406ddc0 0x7fbd64155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.528+0000 7fbd6ba00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640d0af0 0x7fbd640c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.528+0000 7fbd6ba00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd6415a3e0 0x7fbd640c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.528+0000 7fbd6ba00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6406f510 con 0x7fbd6406ddc0 2024-09-17T03:40:20.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.528+0000 7fbd6ba00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6406f390 con 0x7fbd6415a3e0 2024-09-17T03:40:20.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.528+0000 7fbd6ba00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6406f690 con 0x7fbd640d0af0 2024-09-17T03:40:20.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.528+0000 7fbd69000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd6406ddc0 0x7fbd64155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.528+0000 7fbd69000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd6406ddc0 0x7fbd64155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54642/0 (socket says 172.21.15.121:54642) 2024-09-17T03:40:20.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.528+0000 7fbd69000640 1 -- 172.21.15.121:0/1368247884 learned_addr learned my addr 172.21.15.121:0/1368247884 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:20.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.528+0000 7fbd5be00640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640d0af0 0x7fbd640c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.529+0000 7fbd69a00640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd6415a3e0 0x7fbd640c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.529+0000 7fbd69000640 1 -- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640d0af0 msgr2=0x7fbd640c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.529+0000 7fbd69000640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640d0af0 0x7fbd640c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.529+0000 7fbd69000640 1 -- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd6415a3e0 msgr2=0x7fbd640c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.529+0000 7fbd69000640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd6415a3e0 0x7fbd640c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.529+0000 7fbd69000640 1 -- 172.21.15.121:0/1368247884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd640cd400 con 0x7fbd6406ddc0 2024-09-17T03:40:20.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.529+0000 7fbd69000640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd6406ddc0 0x7fbd64155900 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fbd54034040 tx=0x7fbd540039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:20.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.530+0000 7fbd61600640 1 -- 172.21.15.121:0/1368247884 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5403e030 con 0x7fbd6406ddc0 2024-09-17T03:40:20.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.530+0000 7fbd61600640 1 -- 172.21.15.121:0/1368247884 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd540047a0 con 0x7fbd6406ddc0 2024-09-17T03:40:20.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.530+0000 7fbd6ba00640 1 -- 172.21.15.121:0/1368247884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd640cd6e0 con 0x7fbd6406ddc0 2024-09-17T03:40:20.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.530+0000 7fbd61600640 1 -- 172.21.15.121:0/1368247884 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54035040 con 0x7fbd6406ddc0 2024-09-17T03:40:20.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.530+0000 7fbd6ba00640 1 -- 172.21.15.121:0/1368247884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd641f91b0 con 0x7fbd6406ddc0 2024-09-17T03:40:20.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.531+0000 7fbd6ba00640 1 -- 172.21.15.121:0/1368247884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6406fb80 con 0x7fbd6406ddc0 2024-09-17T03:40:20.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.532+0000 7fbd61600640 1 -- 172.21.15.121:0/1368247884 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd54041030 con 0x7fbd6406ddc0 2024-09-17T03:40:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.533+0000 7fbd61600640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbd40078b90 0x7fbd4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.533+0000 7fbd61600640 1 -- 172.21.15.121:0/1368247884 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5335+0+0 (secure 0 0 0) 0x7fbd540bb3c0 con 0x7fbd6406ddc0 2024-09-17T03:40:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.533+0000 7fbd5be00640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbd40078b90 0x7fbd4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.534+0000 7fbd5be00640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbd40078b90 0x7fbd4007b0a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00a4d0 tx=0x7fbd4c00a460 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:20.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.537+0000 7fbd61600640 1 -- 172.21.15.121:0/1368247884 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd540833a0 con 0x7fbd6406ddc0 2024-09-17T03:40:20.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.753+0000 7fbd6ba00640 1 -- 172.21.15.121:0/1368247884 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd640cf630 con 0x7fbd6406ddc0 2024-09-17T03:40:20.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.754+0000 7fbd61600640 1 -- 172.21.15.121:0/1368247884 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+3920 (secure 0 0 0) 0x7fbd54087dd0 con 0x7fbd6406ddc0 2024-09-17T03:40:20.753 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:20.754 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":70,"btime":"2024-09-17T03:40:13:675614+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6086,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2225841438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2225841438},{"type":"v1","addr":"172.21.15.176:6837","nonce":2225841438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":6457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3550639124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3550639124},{"type":"v1","addr":"172.21.15.176:6836","nonce":3550639124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6753,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/479907239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":479907239},{"type":"v1","addr":"172.21.15.121:6833","nonce":479907239}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/3992738504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3992738504},{"type":"v1","addr":"172.21.15.121:6835","nonce":3992738504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[]} 2024-09-17T03:40:20.754 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 70 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 -- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbd40078b90 msgr2=0x7fbd4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbd40078b90 0x7fbd4007b0a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00a4d0 tx=0x7fbd4c00a460 comp rx=0 tx=0).stop 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 -- 172.21.15.121:0/1368247884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd6406ddc0 msgr2=0x7fbd64155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd6406ddc0 0x7fbd64155900 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fbd54034040 tx=0x7fbd540039e0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 -- 172.21.15.121:0/1368247884 shutdown_connections 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbd6415a3e0 0x7fbd640c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbd640d0af0 0x7fbd640c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbd40078b90 0x7fbd4007b0a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 --2- 172.21.15.121:0/1368247884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd6406ddc0 0x7fbd64155900 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 -- 172.21.15.121:0/1368247884 >> 172.21.15.121:0/1368247884 conn(0x7fbd640b3580 msgr2=0x7fbd64068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:20.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 -- 172.21.15.121:0/1368247884 shutdown_connections 2024-09-17T03:40:20.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:20.756+0000 7fbd6ba00640 1 -- 172.21.15.121:0/1368247884 wait complete. 2024-09-17T03:40:20.780 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:40:20.781 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:40:20.781 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:40:20.781 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:20.781 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:40:20.781 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:40:20.782 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:40:20.782 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:20.782 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:40:20.782 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:40:20.782 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:40:20.782 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:20.782 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:40:20.782 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:40:20.783 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:40:20.783 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:20.802 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:40:20.802 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:40:20.805 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:40:20.805 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:40:20.810 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:40:20.810 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:40:20.811 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:40:20.811 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:40:20.848 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:40:20.849 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:20.851 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:40:20.852 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:20.854 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:40:20.854 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:20.856 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:40:20.856 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:20.857 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:40:21.041 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:40:21.048 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:40:21.052 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:40:21.052 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T03:40:21.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.094+0000 7f47e0400640 1 -- 172.21.15.121:0/175005669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d80ce9e0 msgr2=0x7f47d80caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:21.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.094+0000 7f47e0400640 1 --2- 172.21.15.121:0/175005669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d80ce9e0 0x7f47d80caef0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f47d0005fd0 tx=0x7f47d002a9d0 comp rx=0 tx=0).stop 2024-09-17T03:40:21.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.094+0000 7f47e0400640 1 -- 172.21.15.121:0/175005669 shutdown_connections 2024-09-17T03:40:21.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.094+0000 7f47e0400640 1 --2- 172.21.15.121:0/175005669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d80ce9e0 0x7f47d80caef0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:21.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.094+0000 7f47e0400640 1 -- 172.21.15.121:0/175005669 >> 172.21.15.121:0/175005669 conn(0x7f47d80b3580 msgr2=0x7f47d80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:21.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.094+0000 7f47e0400640 1 -- 172.21.15.121:0/175005669 shutdown_connections 2024-09-17T03:40:21.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.094+0000 7f47e0400640 1 -- 172.21.15.121:0/175005669 wait complete. 2024-09-17T03:40:21.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.096+0000 7f47e0400640 1 Processor -- start 2024-09-17T03:40:21.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.097+0000 7f47e0400640 1 -- start start 2024-09-17T03:40:21.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.098+0000 7f47e0400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47d80cc270 0x7f47d81f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.098+0000 7f47e0400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47d80ce9e0 0x7f47d80b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.098+0000 7f47e0400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d80c8510 0x7f47d80c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.098+0000 7f47e0400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f47d80cb5b0 con 0x7f47d80ce9e0 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.098+0000 7f47e0400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f47d80cb430 con 0x7f47d80c8510 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.098+0000 7f47e0400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f47d80cb730 con 0x7f47d80cc270 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.098+0000 7f47dd000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47d80ce9e0 0x7f47d80b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.098+0000 7f47dd000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47d80ce9e0 0x7f47d80b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54676/0 (socket says 172.21.15.121:54676) 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.098+0000 7f47dd000640 1 -- 172.21.15.121:0/1334586116 learned_addr learned my addr 172.21.15.121:0/1334586116 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47dda00640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47d80cc270 0x7f47d81f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47de400640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d80c8510 0x7f47d80c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47dd000640 1 -- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47d80cc270 msgr2=0x7f47d81f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:21.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47dd000640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47d80cc270 0x7f47d81f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:21.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47dd000640 1 -- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d80c8510 msgr2=0x7f47d80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:21.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47dd000640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d80c8510 0x7f47d80c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:21.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47dd000640 1 -- 172.21.15.121:0/1334586116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d8156880 con 0x7f47d80ce9e0 2024-09-17T03:40:21.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47dd000640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47d80ce9e0 0x7f47d80b00c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f47c400c400 tx=0x7f47c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:21.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47d5600640 1 -- 172.21.15.121:0/1334586116 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4017070 con 0x7f47d80ce9e0 2024-09-17T03:40:21.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47d5600640 1 -- 172.21.15.121:0/1334586116 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47c40053c0 con 0x7f47d80ce9e0 2024-09-17T03:40:21.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47e0400640 1 -- 172.21.15.121:0/1334586116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d81f78f0 con 0x7f47d80ce9e0 2024-09-17T03:40:21.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47d5600640 1 -- 172.21.15.121:0/1334586116 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4003850 con 0x7f47d80ce9e0 2024-09-17T03:40:21.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.099+0000 7f47e0400640 1 -- 172.21.15.121:0/1334586116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d80c7a30 con 0x7f47d80ce9e0 2024-09-17T03:40:21.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.100+0000 7f47e0400640 1 -- 172.21.15.121:0/1334586116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d815d7c0 con 0x7f47d80ce9e0 2024-09-17T03:40:21.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.102+0000 7f47d5600640 1 -- 172.21.15.121:0/1334586116 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f47c401a070 con 0x7f47d80ce9e0 2024-09-17T03:40:21.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.102+0000 7f47d5600640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f47b8078bc0 0x7f47b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:21.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.103+0000 7f47d5600640 1 -- 172.21.15.121:0/1334586116 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5335+0+0 (secure 0 0 0) 0x7f47c4099fe0 con 0x7f47d80ce9e0 2024-09-17T03:40:21.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.103+0000 7f47dda00640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f47b8078bc0 0x7f47b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:21.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.104+0000 7f47dda00640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f47b8078bc0 0x7f47b807b0d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0046b0 tx=0x7f47cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:21.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.107+0000 7f47d5600640 1 -- 172.21.15.121:0/1334586116 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f47d815d7c0 con 0x7f47d80ce9e0 2024-09-17T03:40:21.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:21.300+0000 7f47e0400640 1 -- 172.21.15.121:0/1334586116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f47d81e8650 con 0x7f47d80ce9e0 2024-09-17T03:40:21.796 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:40:21.801 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:40:22.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.049+0000 7f47d5600640 1 -- 172.21.15.121:0/1334586116 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v104) ==== 97+0+0 (secure 0 0 0) 0x7f47c4062530 con 0x7f47d80ce9e0 2024-09-17T03:40:22.049 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-17T03:40:22.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.052+0000 7f47e0400640 1 -- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f47b8078bc0 msgr2=0x7f47b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.052+0000 7f47e0400640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f47b8078bc0 0x7f47b807b0d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0046b0 tx=0x7f47cc009040 comp rx=0 tx=0).stop 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.052+0000 7f47e0400640 1 -- 172.21.15.121:0/1334586116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47d80ce9e0 msgr2=0x7f47d80b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.052+0000 7f47e0400640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47d80ce9e0 0x7f47d80b00c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f47c400c400 tx=0x7f47c400c8c0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.052+0000 7f47e0400640 1 -- 172.21.15.121:0/1334586116 shutdown_connections 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.052+0000 7f47e0400640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47d80c8510 0x7f47d80c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.052+0000 7f47e0400640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f47b8078bc0 0x7f47b807b0d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.052+0000 7f47e0400640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47d80ce9e0 0x7f47d80b00c0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.052+0000 7f47e0400640 1 --2- 172.21.15.121:0/1334586116 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47d80cc270 0x7f47d81f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.052+0000 7f47e0400640 1 -- 172.21.15.121:0/1334586116 >> 172.21.15.121:0/1334586116 conn(0x7f47d80b3580 msgr2=0x7f47d815c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.053+0000 7f47e0400640 1 -- 172.21.15.121:0/1334586116 shutdown_connections 2024-09-17T03:40:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.053+0000 7f47e0400640 1 -- 172.21.15.121:0/1334586116 wait complete. 2024-09-17T03:40:22.077 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:40:22.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.297+0000 7f4f6d600640 1 -- 172.21.15.121:0/1175460609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f68160890 msgr2=0x7f4f6806d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:22.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.297+0000 7f4f6d600640 1 --2- 172.21.15.121:0/1175460609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f68160890 0x7f4f6806d830 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f4f60005fd0 tx=0x7f4f6002aa90 comp rx=0 tx=0).stop 2024-09-17T03:40:22.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.297+0000 7f4f6d600640 1 -- 172.21.15.121:0/1175460609 shutdown_connections 2024-09-17T03:40:22.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.297+0000 7f4f6d600640 1 --2- 172.21.15.121:0/1175460609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f68160890 0x7f4f6806d830 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.297+0000 7f4f6d600640 1 --2- 172.21.15.121:0/1175460609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f68070810 0x7f4f680b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.297+0000 7f4f6d600640 1 -- 172.21.15.121:0/1175460609 >> 172.21.15.121:0/1175460609 conn(0x7f4f680b2440 msgr2=0x7f4f680d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:22.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.298+0000 7f4f6d600640 1 -- 172.21.15.121:0/1175460609 shutdown_connections 2024-09-17T03:40:22.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.298+0000 7f4f6d600640 1 -- 172.21.15.121:0/1175460609 wait complete. 2024-09-17T03:40:22.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.300+0000 7f4f6d600640 1 Processor -- start 2024-09-17T03:40:22.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.300+0000 7f4f6d600640 1 -- start start 2024-09-17T03:40:22.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.301+0000 7f4f6d600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f68070810 0x7f4f6815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.301+0000 7f4f6d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f680b51c0 0x7f4f6809c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.301+0000 7f4f6d600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f6815bd80 0x7f4f68074470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.301+0000 7f4f6d600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6806dd70 con 0x7f4f6815bd80 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.301+0000 7f4f6d600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6806def0 con 0x7f4f680b51c0 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.301+0000 7f4f6d600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6806e070 con 0x7f4f68070810 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f6cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f6815bd80 0x7f4f68074470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f6cc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f6815bd80 0x7f4f68074470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34144/0 (socket says 172.21.15.121:34144) 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f6cc00640 1 -- 172.21.15.121:0/2463491445 learned_addr learned my addr 172.21.15.121:0/2463491445 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f67e00640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f68070810 0x7f4f6815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f67400640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f680b51c0 0x7f4f6809c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f6cc00640 1 -- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f68070810 msgr2=0x7f4f6815b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:22.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f6cc00640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f68070810 0x7f4f6815b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f6cc00640 1 -- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f680b51c0 msgr2=0x7f4f6809c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:22.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f6cc00640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f680b51c0 0x7f4f6809c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f6cc00640 1 -- 172.21.15.121:0/2463491445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f681f4ef0 con 0x7f4f6815bd80 2024-09-17T03:40:22.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.302+0000 7f4f6cc00640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f6815bd80 0x7f4f68074470 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009bf0 tx=0x7f4f60003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:22.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.303+0000 7f4f5fe00640 1 -- 172.21.15.121:0/2463491445 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60044070 con 0x7f4f6815bd80 2024-09-17T03:40:22.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.303+0000 7f4f5fe00640 1 -- 172.21.15.121:0/2463491445 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f60003e00 con 0x7f4f6815bd80 2024-09-17T03:40:22.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.303+0000 7f4f5fe00640 1 -- 172.21.15.121:0/2463491445 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600044b0 con 0x7f4f6815bd80 2024-09-17T03:40:22.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.303+0000 7f4f6d600640 1 -- 172.21.15.121:0/2463491445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f681f5420 con 0x7f4f6815bd80 2024-09-17T03:40:22.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.303+0000 7f4f6d600640 1 -- 172.21.15.121:0/2463491445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f681f59e0 con 0x7f4f6815bd80 2024-09-17T03:40:22.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.304+0000 7f4f6d600640 1 -- 172.21.15.121:0/2463491445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f681f5190 con 0x7f4f6815bd80 2024-09-17T03:40:22.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.305+0000 7f4f5fe00640 1 -- 172.21.15.121:0/2463491445 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f60047070 con 0x7f4f6815bd80 2024-09-17T03:40:22.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.306+0000 7f4f5fe00640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4f48078b90 0x7f4f4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:22.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.306+0000 7f4f5fe00640 1 -- 172.21.15.121:0/2463491445 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5249+0+0 (secure 0 0 0) 0x7f4f600bba90 con 0x7f4f6815bd80 2024-09-17T03:40:22.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.306+0000 7f4f67e00640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4f48078b90 0x7f4f4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:22.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.307+0000 7f4f67e00640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4f48078b90 0x7f4f4807b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009b30 tx=0x7f4f58005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:22.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.310+0000 7f4f5fe00640 1 -- 172.21.15.121:0/2463491445 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f60032030 con 0x7f4f6815bd80 2024-09-17T03:40:22.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.562+0000 7f4f6d600640 1 -- 172.21.15.121:0/2463491445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4f6806e540 con 0x7f4f6815bd80 2024-09-17T03:40:22.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.563+0000 7f4f5fe00640 1 -- 172.21.15.121:0/2463491445 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f4f600098b0 con 0x7f4f6815bd80 2024-09-17T03:40:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:22.563 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:40:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-17T03:40:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohm64sFGhAAJDdFwMDkudwacQaLfvbAdg==", 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmIGvPNRAAvE+tovzn5WadGa9C/P/A3A==", 2024-09-17T03:40:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:40:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:40:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:40:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.c", 2024-09-17T03:40:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmV/btJxAAmhL4jXk0LVdzCPaNi9Hzhg==", 2024-09-17T03:40:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.d", 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmeQccCBAAtTfeUysbtoqrKjwaKRWyvg==", 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:40:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDE+OhmBxJKNRAAGxPaH7R2JtcFVO5kR/Qh2A==", 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDI+OhmRtvFCBAAOG/1XD75Atl6ztUGPw3PKA==", 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDL+OhmwzDzIxAA9Z/IIRphtZK1jbS2sIXeJQ==", 2024-09-17T03:40:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.3", 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDO+Ohm94g0NBAAmxtHPev4OOM0YfOQt7N5Jg==", 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.4", 2024-09-17T03:40:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDV+Ohmj7OoCBAA/Hrj9dHVT98lURPWJE3r/g==", 2024-09-17T03:40:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:40:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.5", 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDY+Ohmc29QFxAAGsMy0+9MviYohok8JpL+ZA==", 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.6", 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDb+OhmDO8tKRAAq6bn/I54WKTdN6XiviHNsQ==", 2024-09-17T03:40:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.7", 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDe+OhmUuFwNxAAgAeDJiL/TIGDuDAC+dXCyA==", 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-17T03:40:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw==", 2024-09-17T03:40:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:40:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2024-09-17T03:40:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohmec7LKRAAl5nAqPEncglNL2FbRlD0oA==", 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.2", 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+Ohme/hCHxAAdP8DjxaXWMGi/Fw+85zUFA==", 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.3", 2024-09-17T03:40:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDB+OhmivFTNBAA5f47Lq5CE+iXt3i+5fUJGA==", 2024-09-17T03:40:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-17T03:40:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-17T03:40:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-17T03:40:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-17T03:40:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC/+OhmXWj6GBAAh/FBw0ElmHixSBXm8PPeAg==", 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+Ohmsn9CDxAAzjtaZG1qe4XTnBge+t3vlA==", 2024-09-17T03:40:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.y", 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDA+OhmQfYJAxAA6Mc5PiIb5VDamVU5Vhx3aQ==", 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-17T03:40:22.579 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:40:22.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 -- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4f48078b90 msgr2=0x7f4f4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4f48078b90 0x7f4f4807b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009b30 tx=0x7f4f58005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 -- 172.21.15.121:0/2463491445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f6815bd80 msgr2=0x7f4f68074470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f6815bd80 0x7f4f68074470 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009bf0 tx=0x7f4f60003c10 comp rx=0 tx=0).stop 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 -- 172.21.15.121:0/2463491445 shutdown_connections 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4f48078b90 0x7f4f4807b0a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f6815bd80 0x7f4f68074470 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f680b51c0 0x7f4f6809c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 --2- 172.21.15.121:0/2463491445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f68070810 0x7f4f6815b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 -- 172.21.15.121:0/2463491445 >> 172.21.15.121:0/2463491445 conn(0x7f4f680b2440 msgr2=0x7f4f68156330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 -- 172.21.15.121:0/2463491445 shutdown_connections 2024-09-17T03:40:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.566+0000 7f4f6d600640 1 -- 172.21.15.121:0/2463491445 wait complete. 2024-09-17T03:40:22.594 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:40:22.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.815+0000 7f438b200640 1 -- 172.21.15.121:0/2460186042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43840d0cc0 msgr2=0x7f438415cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:22.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.815+0000 7f438b200640 1 --2- 172.21.15.121:0/2460186042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43840d0cc0 0x7f438415cc10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f437c005fd0 tx=0x7f437c02a780 comp rx=0 tx=0).stop 2024-09-17T03:40:22.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.815+0000 7f438b200640 1 -- 172.21.15.121:0/2460186042 shutdown_connections 2024-09-17T03:40:22.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.815+0000 7f438b200640 1 --2- 172.21.15.121:0/2460186042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43840d0cc0 0x7f438415cc10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.815+0000 7f438b200640 1 --2- 172.21.15.121:0/2460186042 >> v2:172.21.15.176:3300/0 conn(0x7f438415a3e0 0x7f438406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.815+0000 7f438b200640 1 -- 172.21.15.121:0/2460186042 >> 172.21.15.121:0/2460186042 conn(0x7f43840b3580 msgr2=0x7f43840b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:22.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.815+0000 7f438b200640 1 -- 172.21.15.121:0/2460186042 shutdown_connections 2024-09-17T03:40:22.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.815+0000 7f438b200640 1 -- 172.21.15.121:0/2460186042 wait complete. 2024-09-17T03:40:22.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.817+0000 7f438b200640 1 Processor -- start 2024-09-17T03:40:22.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.817+0000 7f438b200640 1 -- start start 2024-09-17T03:40:22.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f438b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438406ddc0 0x7f43841f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:22.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f438b200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438415a3e0 0x7f4384155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:22.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f438b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43840c9a80 0x7f43840cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:22.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f438b200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f438415d4e0 con 0x7f438415a3e0 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f438b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f438415d360 con 0x7f43840c9a80 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f438b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f438415d660 con 0x7f438406ddc0 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f4383400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438415a3e0 0x7f4384155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f4383400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438415a3e0 0x7f4384155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34152/0 (socket says 172.21.15.121:34152) 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f4383400640 1 -- 172.21.15.121:0/3416761849 learned_addr learned my addr 172.21.15.121:0/3416761849 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f4383e00640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438406ddc0 0x7f43841f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f4389200640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43840c9a80 0x7f43840cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f4383400640 1 -- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438406ddc0 msgr2=0x7f43841f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f4383400640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438406ddc0 0x7f43841f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f4383400640 1 -- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43840c9a80 msgr2=0x7f43840cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f4383400640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43840c9a80 0x7f43840cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.819+0000 7f4383400640 1 -- 172.21.15.121:0/3416761849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4384156270 con 0x7f438415a3e0 2024-09-17T03:40:22.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.820+0000 7f4383400640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438415a3e0 0x7f4384155d30 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f437000c460 tx=0x7f437000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:22.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.820+0000 7f437be00640 1 -- 172.21.15.121:0/3416761849 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370016020 con 0x7f438415a3e0 2024-09-17T03:40:22.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.820+0000 7f437be00640 1 -- 172.21.15.121:0/3416761849 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4370012920 con 0x7f438415a3e0 2024-09-17T03:40:22.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.820+0000 7f437be00640 1 -- 172.21.15.121:0/3416761849 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370012d70 con 0x7f438415a3e0 2024-09-17T03:40:22.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.820+0000 7f438b200640 1 -- 172.21.15.121:0/3416761849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438415fc20 con 0x7f438415a3e0 2024-09-17T03:40:22.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.820+0000 7f438b200640 1 -- 172.21.15.121:0/3416761849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43841f55e0 con 0x7f438415a3e0 2024-09-17T03:40:22.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.821+0000 7f438b200640 1 -- 172.21.15.121:0/3416761849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438415db10 con 0x7f438415a3e0 2024-09-17T03:40:22.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.822+0000 7f437be00640 1 -- 172.21.15.121:0/3416761849 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4370019020 con 0x7f438415a3e0 2024-09-17T03:40:22.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.824+0000 7f437be00640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4364078bc0 0x7f436407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:22.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.824+0000 7f437be00640 1 -- 172.21.15.121:0/3416761849 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5249+0+0 (secure 0 0 0) 0x7f437009a9d0 con 0x7f438415a3e0 2024-09-17T03:40:22.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.824+0000 7f4383e00640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4364078bc0 0x7f436407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:22.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.825+0000 7f4383e00640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4364078bc0 0x7f436407b0d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4374009b30 tx=0x7f4374005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:22.828+0000 7f437be00640 1 -- 172.21.15.121:0/3416761849 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4370020020 con 0x7f438415a3e0 2024-09-17T03:40:23.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.014+0000 7f438b200640 1 -- 172.21.15.121:0/3416761849 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f438415c490 con 0x7f438415a3e0 2024-09-17T03:40:23.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.015+0000 7f437be00640 1 -- 172.21.15.121:0/3416761849 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v106) ==== 84+0+65 (secure 0 0 0) 0x7f4370062a30 con 0x7f438415a3e0 2024-09-17T03:40:23.015 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:23.015 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-17T03:40:23.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:23.015 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-17T03:40:23.015 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-17T03:40:23.015 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:23.015 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-17T03:40:23.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.017+0000 7f438b200640 1 -- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4364078bc0 msgr2=0x7f436407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:23.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.017+0000 7f438b200640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4364078bc0 0x7f436407b0d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4374009b30 tx=0x7f4374005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:23.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.017+0000 7f438b200640 1 -- 172.21.15.121:0/3416761849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438415a3e0 msgr2=0x7f4384155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:23.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.017+0000 7f438b200640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438415a3e0 0x7f4384155d30 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f437000c460 tx=0x7f437000c920 comp rx=0 tx=0).stop 2024-09-17T03:40:23.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.018+0000 7f438b200640 1 -- 172.21.15.121:0/3416761849 shutdown_connections 2024-09-17T03:40:23.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.018+0000 7f438b200640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43840c9a80 0x7f43840cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:23.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.018+0000 7f438b200640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4364078bc0 0x7f436407b0d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:23.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.018+0000 7f438b200640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438415a3e0 0x7f4384155d30 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:23.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.018+0000 7f438b200640 1 --2- 172.21.15.121:0/3416761849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438406ddc0 0x7f43841f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:23.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.018+0000 7f438b200640 1 -- 172.21.15.121:0/3416761849 >> 172.21.15.121:0/3416761849 conn(0x7f43840b3580 msgr2=0x7f4384156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:23.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.018+0000 7f438b200640 1 -- 172.21.15.121:0/3416761849 shutdown_connections 2024-09-17T03:40:23.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.018+0000 7f438b200640 1 -- 172.21.15.121:0/3416761849 wait complete. 2024-09-17T03:40:23.044 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:40:23.044 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:40:23.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.270+0000 7f8f3be00640 1 -- 172.21.15.121:0/2351710820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3c1601d0 msgr2=0x7f8f3c0cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:23.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.270+0000 7f8f3be00640 1 --2- 172.21.15.121:0/2351710820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3c1601d0 0x7f8f3c0cde20 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c153cd0 tx=0x7f8f2c02a560 comp rx=0 tx=0).stop 2024-09-17T03:40:23.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.270+0000 7f8f3be00640 1 -- 172.21.15.121:0/2351710820 shutdown_connections 2024-09-17T03:40:23.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.270+0000 7f8f3be00640 1 --2- 172.21.15.121:0/2351710820 >> v2:172.21.15.176:3300/0 conn(0x7f8f3c0afd30 0x7f8f3c15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:23.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.270+0000 7f8f3be00640 1 --2- 172.21.15.121:0/2351710820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3c1601d0 0x7f8f3c0cde20 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:23.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.270+0000 7f8f3be00640 1 -- 172.21.15.121:0/2351710820 >> 172.21.15.121:0/2351710820 conn(0x7f8f3c0d1350 msgr2=0x7f8f3c073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:23.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.270+0000 7f8f3be00640 1 -- 172.21.15.121:0/2351710820 shutdown_connections 2024-09-17T03:40:23.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.270+0000 7f8f3be00640 1 -- 172.21.15.121:0/2351710820 wait complete. 2024-09-17T03:40:23.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.273+0000 7f8f3be00640 1 Processor -- start 2024-09-17T03:40:23.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.273+0000 7f8f3be00640 1 -- start start 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.274+0000 7f8f3be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f3c0afd30 0x7f8f3c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.274+0000 7f8f3be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3c15e2e0 0x7f8f3c1f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.274+0000 7f8f3be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f3c1601d0 0x7f8f3c1465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.274+0000 7f8f3be00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c073d70 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.274+0000 7f8f3be00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c073ef0 con 0x7f8f3c1601d0 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.274+0000 7f8f3be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c074070 con 0x7f8f3c0afd30 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.274+0000 7f8f32000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3c15e2e0 0x7f8f3c1f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f32000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3c15e2e0 0x7f8f3c1f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34172/0 (socket says 172.21.15.121:34172) 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f32000640 1 -- 172.21.15.121:0/3411986073 learned_addr learned my addr 172.21.15.121:0/3411986073 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f3aa00640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f3c0afd30 0x7f8f3c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:23.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f3b400640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f3c1601d0 0x7f8f3c1465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:23.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f32000640 1 -- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f3c0afd30 msgr2=0x7f8f3c0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:23.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f32000640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f3c0afd30 0x7f8f3c0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:23.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f32000640 1 -- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f3c1601d0 msgr2=0x7f8f3c1465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:23.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f32000640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f3c1601d0 0x7f8f3c1465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:23.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f32000640 1 -- 172.21.15.121:0/3411986073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c1f4d80 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f32000640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3c15e2e0 0x7f8f3c1f4840 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400d6d0 tx=0x7f8f2400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:23.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.275+0000 7f8f33400640 1 -- 172.21.15.121:0/3411986073 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24017070 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.276+0000 7f8f33400640 1 -- 172.21.15.121:0/3411986073 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f24005330 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.276+0000 7f8f33400640 1 -- 172.21.15.121:0/3411986073 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24009820 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.276+0000 7f8f3be00640 1 -- 172.21.15.121:0/3411986073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3c146b20 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.276+0000 7f8f3be00640 1 -- 172.21.15.121:0/3411986073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3c1f7470 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.277+0000 7f8f3be00640 1 -- 172.21.15.121:0/3411986073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3c1f71e0 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.278+0000 7f8f33400640 1 -- 172.21.15.121:0/3411986073 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f240099c0 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.279+0000 7f8f33400640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f18078b90 0x7f8f1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:23.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.280+0000 7f8f33400640 1 -- 172.21.15.121:0/3411986073 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5249+0+0 (secure 0 0 0) 0x7f8f2409ab70 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.280+0000 7f8f3aa00640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f18078b90 0x7f8f1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:23.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.281+0000 7f8f3aa00640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f18078b90 0x7f8f1807b0a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c033000 tx=0x7f8f2c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:23.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.284+0000 7f8f33400640 1 -- 172.21.15.121:0/3411986073 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f2409e030 con 0x7f8f3c15e2e0 2024-09-17T03:40:23.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:23.469+0000 7f8f3be00640 1 -- 172.21.15.121:0/3411986073 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8f3c074590 con 0x7f8f3c15e2e0 2024-09-17T03:40:24.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.055+0000 7f8f33400640 1 -- 172.21.15.121:0/3411986073 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v107) ==== 138+0+0 (secure 0 0 0) 0x7f8f24062b90 con 0x7f8f3c15e2e0 2024-09-17T03:40:24.055 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-17T03:40:24.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 -- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f18078b90 msgr2=0x7f8f1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f18078b90 0x7f8f1807b0a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c033000 tx=0x7f8f2c004730 comp rx=0 tx=0).stop 2024-09-17T03:40:24.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 -- 172.21.15.121:0/3411986073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3c15e2e0 msgr2=0x7f8f3c1f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3c15e2e0 0x7f8f3c1f4840 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400d6d0 tx=0x7f8f2400db90 comp rx=0 tx=0).stop 2024-09-17T03:40:24.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 -- 172.21.15.121:0/3411986073 shutdown_connections 2024-09-17T03:40:24.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f3c1601d0 0x7f8f3c1465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f18078b90 0x7f8f1807b0a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3c15e2e0 0x7f8f3c1f4840 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 --2- 172.21.15.121:0/3411986073 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f3c0afd30 0x7f8f3c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 -- 172.21.15.121:0/3411986073 >> 172.21.15.121:0/3411986073 conn(0x7f8f3c0d1350 msgr2=0x7f8f3c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:24.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 -- 172.21.15.121:0/3411986073 shutdown_connections 2024-09-17T03:40:24.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.058+0000 7f8f3be00640 1 -- 172.21.15.121:0/3411986073 wait complete. 2024-09-17T03:40:24.085 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:40:24.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.318+0000 7f124f200640 1 -- 172.21.15.121:0/1251324430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12480b3b30 msgr2=0x7f12480b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.318+0000 7f124f200640 1 --2- 172.21.15.121:0/1251324430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12480b3b30 0x7f12480b5290 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1240005fd0 tx=0x7f124002aa10 comp rx=0 tx=0).stop 2024-09-17T03:40:24.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.318+0000 7f124f200640 1 -- 172.21.15.121:0/1251324430 shutdown_connections 2024-09-17T03:40:24.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.318+0000 7f124f200640 1 --2- 172.21.15.121:0/1251324430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12480b3b30 0x7f12480b5290 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.318+0000 7f124f200640 1 --2- 172.21.15.121:0/1251324430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1248160e40 0x7f1248153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.318+0000 7f124f200640 1 -- 172.21.15.121:0/1251324430 >> 172.21.15.121:0/1251324430 conn(0x7f12480cd5c0 msgr2=0x7f12480cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:24.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.318+0000 7f124f200640 1 -- 172.21.15.121:0/1251324430 shutdown_connections 2024-09-17T03:40:24.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.318+0000 7f124f200640 1 -- 172.21.15.121:0/1251324430 wait complete. 2024-09-17T03:40:24.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.320+0000 7f124f200640 1 Processor -- start 2024-09-17T03:40:24.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.320+0000 7f124f200640 1 -- start start 2024-09-17T03:40:24.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f124f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12480b3b30 0x7f12481f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f124f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12480ce510 0x7f12481f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f124f200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1248141770 0x7f12481f7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f124f200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f124815d710 con 0x7f1248141770 2024-09-17T03:40:24.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f124f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f124815d590 con 0x7f12480b3b30 2024-09-17T03:40:24.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f124f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f124815d890 con 0x7f12480ce510 2024-09-17T03:40:24.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f124d200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1248141770 0x7f12481f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f124d200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1248141770 0x7f12481f7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34198/0 (socket says 172.21.15.121:34198) 2024-09-17T03:40:24.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f124d200640 1 -- 172.21.15.121:0/3365180688 learned_addr learned my addr 172.21.15.121:0/3365180688 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:24.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f1247400640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12480ce510 0x7f12481f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.322+0000 7f1247e00640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12480b3b30 0x7f12481f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.323+0000 7f124d200640 1 -- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12480ce510 msgr2=0x7f12481f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.323+0000 7f124d200640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12480ce510 0x7f12481f72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.323+0000 7f124d200640 1 -- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12480b3b30 msgr2=0x7f12481f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.323+0000 7f124d200640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12480b3b30 0x7f12481f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.323+0000 7f124d200640 1 -- 172.21.15.121:0/3365180688 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12481579c0 con 0x7f1248141770 2024-09-17T03:40:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.323+0000 7f124d200640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1248141770 0x7f12481f7810 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1240006010 tx=0x7f1240009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.323+0000 7f123fe00640 1 -- 172.21.15.121:0/3365180688 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240046070 con 0x7f1248141770 2024-09-17T03:40:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.323+0000 7f123fe00640 1 -- 172.21.15.121:0/3365180688 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1240004540 con 0x7f1248141770 2024-09-17T03:40:24.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.323+0000 7f124f200640 1 -- 172.21.15.121:0/3365180688 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1248157ca0 con 0x7f1248141770 2024-09-17T03:40:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.323+0000 7f123fe00640 1 -- 172.21.15.121:0/3365180688 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240033070 con 0x7f1248141770 2024-09-17T03:40:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.324+0000 7f124f200640 1 -- 172.21.15.121:0/3365180688 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12481f5010 con 0x7f1248141770 2024-09-17T03:40:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.325+0000 7f124f200640 1 -- 172.21.15.121:0/3365180688 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1248071d50 con 0x7f1248141770 2024-09-17T03:40:24.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.326+0000 7f123fe00640 1 -- 172.21.15.121:0/3365180688 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1240049070 con 0x7f1248141770 2024-09-17T03:40:24.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.327+0000 7f123fe00640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1228078bc0 0x7f122807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.327+0000 7f123fe00640 1 -- 172.21.15.121:0/3365180688 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5619+0+0 (secure 0 0 0) 0x7f12400bbd40 con 0x7f1248141770 2024-09-17T03:40:24.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.327+0000 7f1247e00640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1228078bc0 0x7f122807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.328+0000 7f1247e00640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1228078bc0 0x7f122807b0d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1238009b30 tx=0x7f1238005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:24.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.332+0000 7f123fe00640 1 -- 172.21.15.121:0/3365180688 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1248071d50 con 0x7f1248141770 2024-09-17T03:40:24.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:24.518+0000 7f124f200640 1 -- 172.21.15.121:0/3365180688 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f12480ce0e0 con 0x7f1248141770 2024-09-17T03:40:25.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.064+0000 7f123fe00640 1 -- 172.21.15.121:0/3365180688 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v108) ==== 170+0+0 (secure 0 0 0) 0x7f124003e070 con 0x7f1248141770 2024-09-17T03:40:25.064 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-17T03:40:25.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.066+0000 7f124f200640 1 -- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1228078bc0 msgr2=0x7f122807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.066+0000 7f124f200640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1228078bc0 0x7f122807b0d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1238009b30 tx=0x7f1238005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.066+0000 7f124f200640 1 -- 172.21.15.121:0/3365180688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1248141770 msgr2=0x7f12481f7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.066+0000 7f124f200640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1248141770 0x7f12481f7810 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1240006010 tx=0x7f1240009360 comp rx=0 tx=0).stop 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.067+0000 7f124f200640 1 -- 172.21.15.121:0/3365180688 shutdown_connections 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.067+0000 7f124f200640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1228078bc0 0x7f122807b0d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.067+0000 7f124f200640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1248141770 0x7f12481f7810 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.067+0000 7f124f200640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12480ce510 0x7f12481f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.067+0000 7f124f200640 1 --2- 172.21.15.121:0/3365180688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12480b3b30 0x7f12481f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.067+0000 7f124f200640 1 -- 172.21.15.121:0/3365180688 >> 172.21.15.121:0/3365180688 conn(0x7f12480cd5c0 msgr2=0x7f12480cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.067+0000 7f124f200640 1 -- 172.21.15.121:0/3365180688 shutdown_connections 2024-09-17T03:40:25.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.067+0000 7f124f200640 1 -- 172.21.15.121:0/3365180688 wait complete. 2024-09-17T03:40:25.105 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:40:25.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.330+0000 7fe35e000640 1 -- 172.21.15.121:0/3355366023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe35815a3e0 msgr2=0x7fe35806d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.330+0000 7fe35e000640 1 --2- 172.21.15.121:0/3355366023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe35815a3e0 0x7fe35806d800 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe348009830 tx=0x7fe34802a3f0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.331+0000 7fe35e000640 1 -- 172.21.15.121:0/3355366023 shutdown_connections 2024-09-17T03:40:25.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.331+0000 7fe35e000640 1 --2- 172.21.15.121:0/3355366023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3580d0cc0 0x7fe35815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.331+0000 7fe35e000640 1 --2- 172.21.15.121:0/3355366023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe35815a3e0 0x7fe35806d800 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.331+0000 7fe35e000640 1 -- 172.21.15.121:0/3355366023 >> 172.21.15.121:0/3355366023 conn(0x7fe3580b3580 msgr2=0x7fe3580b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.331+0000 7fe35e000640 1 -- 172.21.15.121:0/3355366023 shutdown_connections 2024-09-17T03:40:25.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.331+0000 7fe35e000640 1 -- 172.21.15.121:0/3355366023 wait complete. 2024-09-17T03:40:25.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.333+0000 7fe35e000640 1 Processor -- start 2024-09-17T03:40:25.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.333+0000 7fe35e000640 1 -- start start 2024-09-17T03:40:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.334+0000 7fe35e000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe35806ddc0 0x7fe358098c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.334+0000 7fe35e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe35815a3e0 0x7fe358158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.334+0000 7fe35e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe358099a50 0x7fe358158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.334+0000 7fe35e000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe35815d4e0 con 0x7fe358099a50 2024-09-17T03:40:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.334+0000 7fe35e000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe35815d360 con 0x7fe35815a3e0 2024-09-17T03:40:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.334+0000 7fe35e000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe35815d660 con 0x7fe35806ddc0 2024-09-17T03:40:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe357e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe358099a50 0x7fe358158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe357e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe358099a50 0x7fe358158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34212/0 (socket says 172.21.15.121:34212) 2024-09-17T03:40:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe357e00640 1 -- 172.21.15.121:0/1196368387 learned_addr learned my addr 172.21.15.121:0/1196368387 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:25.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe357400640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe35806ddc0 0x7fe358098c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe34ea00640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe35815a3e0 0x7fe358158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe357e00640 1 -- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe35806ddc0 msgr2=0x7fe358098c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe357e00640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe35806ddc0 0x7fe358098c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe357e00640 1 -- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe35815a3e0 msgr2=0x7fe358158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe357e00640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe35815a3e0 0x7fe358158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe357e00640 1 -- 172.21.15.121:0/1196368387 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3580cd410 con 0x7fe358099a50 2024-09-17T03:40:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.335+0000 7fe357e00640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe358099a50 0x7fe358158ff0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe35000ea40 tx=0x7fe35000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.336+0000 7fe34fe00640 1 -- 172.21.15.121:0/1196368387 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35000ce40 con 0x7fe358099a50 2024-09-17T03:40:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.336+0000 7fe34fe00640 1 -- 172.21.15.121:0/1196368387 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe350004c10 con 0x7fe358099a50 2024-09-17T03:40:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.336+0000 7fe35e000640 1 -- 172.21.15.121:0/1196368387 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe358154c70 con 0x7fe358099a50 2024-09-17T03:40:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.336+0000 7fe34fe00640 1 -- 172.21.15.121:0/1196368387 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350005020 con 0x7fe358099a50 2024-09-17T03:40:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.336+0000 7fe35e000640 1 -- 172.21.15.121:0/1196368387 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3580c3ff0 con 0x7fe358099a50 2024-09-17T03:40:25.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.337+0000 7fe35e000640 1 -- 172.21.15.121:0/1196368387 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe35815db30 con 0x7fe358099a50 2024-09-17T03:40:25.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.339+0000 7fe34fe00640 1 -- 172.21.15.121:0/1196368387 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3500051c0 con 0x7fe358099a50 2024-09-17T03:40:25.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.340+0000 7fe34fe00640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe334078b90 0x7fe33407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.340+0000 7fe34fe00640 1 -- 172.21.15.121:0/1196368387 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6001+0+0 (secure 0 0 0) 0x7fe35009c1a0 con 0x7fe358099a50 2024-09-17T03:40:25.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.341+0000 7fe357400640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe334078b90 0x7fe33407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.342+0000 7fe357400640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe334078b90 0x7fe33407b0a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe348034000 tx=0x7fe348004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:25.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.344+0000 7fe34fe00640 1 -- 172.21.15.121:0/1196368387 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe350026020 con 0x7fe358099a50 2024-09-17T03:40:25.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:25.563+0000 7fe35e000640 1 -- 172.21.15.121:0/1196368387 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe358073d60 con 0x7fe358099a50 2024-09-17T03:40:26.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.077+0000 7fe34fe00640 1 -- 172.21.15.121:0/1196368387 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v73) ==== 174+0+0 (secure 0 0 0) 0x7fe350063ed0 con 0x7fe358099a50 2024-09-17T03:40:26.077 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 17 and data pool 18 2024-09-17T03:40:26.081 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.082+0000 7fe35e000640 1 -- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe334078b90 msgr2=0x7fe33407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.082+0000 7fe35e000640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe334078b90 0x7fe33407b0a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe348034000 tx=0x7fe348004730 comp rx=0 tx=0).stop 2024-09-17T03:40:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.082+0000 7fe35e000640 1 -- 172.21.15.121:0/1196368387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe358099a50 msgr2=0x7fe358158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.082+0000 7fe35e000640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe358099a50 0x7fe358158ff0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe35000ea40 tx=0x7fe35000ef00 comp rx=0 tx=0).stop 2024-09-17T03:40:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.082+0000 7fe35e000640 1 -- 172.21.15.121:0/1196368387 shutdown_connections 2024-09-17T03:40:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.082+0000 7fe35e000640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe334078b90 0x7fe33407b0a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.082+0000 7fe35e000640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe358099a50 0x7fe358158ff0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.082+0000 7fe35e000640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe35815a3e0 0x7fe358158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.082+0000 7fe35e000640 1 --2- 172.21.15.121:0/1196368387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe35806ddc0 0x7fe358098c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.082+0000 7fe35e000640 1 -- 172.21.15.121:0/1196368387 >> 172.21.15.121:0/1196368387 conn(0x7fe3580b3580 msgr2=0x7fe35815dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:26.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.084+0000 7fe35e000640 1 -- 172.21.15.121:0/1196368387 shutdown_connections 2024-09-17T03:40:26.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.084+0000 7fe35e000640 1 -- 172.21.15.121:0/1196368387 wait complete. 2024-09-17T03:40:26.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:26.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.346+0000 7f3460a00640 1 -- 172.21.15.121:0/1030851140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3440004800 msgr2=0x7f3440004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.346+0000 7f3460a00640 1 --2- 172.21.15.121:0/1030851140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3440004800 0x7f3440004c10 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f3444001710 tx=0x7f3440005830 comp rx=0 tx=0).stop 2024-09-17T03:40:26.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.346+0000 7f345a800640 1 -- 172.21.15.121:0/1030851140 reap_dead start 2024-09-17T03:40:26.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.346+0000 7f3460a00640 1 -- 172.21.15.121:0/1030851140 shutdown_connections 2024-09-17T03:40:26.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.346+0000 7f3460a00640 1 -- 172.21.15.121:0/1030851140 >> 172.21.15.121:0/1030851140 conn(0x7f345c0b3580 msgr2=0x7f345c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:26.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.347+0000 7f3460a00640 1 -- 172.21.15.121:0/1030851140 shutdown_connections 2024-09-17T03:40:26.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.347+0000 7f3460a00640 1 -- 172.21.15.121:0/1030851140 wait complete. 2024-09-17T03:40:26.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.349+0000 7f3460a00640 1 Processor -- start 2024-09-17T03:40:26.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.349+0000 7f3460a00640 1 -- start start 2024-09-17T03:40:26.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.350+0000 7f3460a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3440004800 0x7f345c1e6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.350+0000 7f3460a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f345c15e630 0x7f345c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.350+0000 7f3460a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f345c0c98e0 0x7f345c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.350+0000 7f3460a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0705e0 con 0x7f345c0c98e0 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.350+0000 7f3460a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f345c070460 con 0x7f3440004800 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.350+0000 7f3460a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f345c0af950 con 0x7f345c15e630 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f3459e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3440004800 0x7f345c1e6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f345a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f345c0c98e0 0x7f345c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f3453e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f345c15e630 0x7f345c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f3459e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3440004800 0x7f345c1e6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.121:51090/0 (socket says 172.21.15.121:51090) 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f3459e00640 1 -- 172.21.15.121:0/2665425290 learned_addr learned my addr 172.21.15.121:0/2665425290 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:26.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f345a800640 1 -- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f345c15e630 msgr2=0x7f345c15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f345a800640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f345c15e630 0x7f345c15b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f345a800640 1 -- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3440004800 msgr2=0x7f345c1e6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f345a800640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3440004800 0x7f345c1e6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f345a800640 1 -- 172.21.15.121:0/2665425290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345c15b610 con 0x7f345c0c98e0 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.351+0000 7f3459e00640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3440004800 0x7f345c1e6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.352+0000 7f345a800640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f345c0c98e0 0x7f345c0c9cf0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f345c0b40f0 tx=0x7f3454006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.352+0000 7f3452000640 1 -- 172.21.15.121:0/2665425290 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345400fa80 con 0x7f345c0c98e0 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.352+0000 7f3452000640 1 -- 172.21.15.121:0/2665425290 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f345400fc60 con 0x7f345c0c98e0 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.352+0000 7f3460a00640 1 -- 172.21.15.121:0/2665425290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345c1e5ea0 con 0x7f345c0c98e0 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.352+0000 7f3452000640 1 -- 172.21.15.121:0/2665425290 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454011690 con 0x7f345c0c98e0 2024-09-17T03:40:26.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.352+0000 7f3460a00640 1 -- 172.21.15.121:0/2665425290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345c1e6460 con 0x7f345c0c98e0 2024-09-17T03:40:26.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.353+0000 7f3460a00640 1 -- 172.21.15.121:0/2665425290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f345c0d07e0 con 0x7f345c0c98e0 2024-09-17T03:40:26.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.354+0000 7f3452000640 1 -- 172.21.15.121:0/2665425290 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3454011830 con 0x7f345c0c98e0 2024-09-17T03:40:26.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.355+0000 7f3452000640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3438078b90 0x7f343807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:26.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.355+0000 7f3452000640 1 -- 172.21.15.121:0/2665425290 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6101+0+0 (secure 0 0 0) 0x7f345409b3d0 con 0x7f345c0c98e0 2024-09-17T03:40:26.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.355+0000 7f3459e00640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3438078b90 0x7f343807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:26.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.356+0000 7f3459e00640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3438078b90 0x7f343807b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f344c005bc0 tx=0x7f344c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:26.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.360+0000 7f3452000640 1 -- 172.21.15.121:0/2665425290 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f345c15b610 con 0x7f345c0c98e0 2024-09-17T03:40:26.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.542+0000 7f3460a00640 1 -- 172.21.15.121:0/2665425290 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f345c0ad320 con 0x7f345c0c98e0 2024-09-17T03:40:26.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.544+0000 7f3452000640 1 -- 172.21.15.121:0/2665425290 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+17089 (secure 0 0 0) 0x7f345c0d1050 con 0x7f345c0c98e0 2024-09-17T03:40:26.544 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:26.544 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":109,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:40:25.564936+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:40:23.482553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-17T03:40:24.531215+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 -- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3438078b90 msgr2=0x7f343807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3438078b90 0x7f343807b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f344c005bc0 tx=0x7f344c005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 -- 172.21.15.121:0/2665425290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f345c0c98e0 msgr2=0x7f345c0c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f345c0c98e0 0x7f345c0c9cf0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f345c0b40f0 tx=0x7f3454006660 comp rx=0 tx=0).stop 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 -- 172.21.15.121:0/2665425290 shutdown_connections 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3438078b90 0x7f343807b0a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f345c0c98e0 0x7f345c0c9cf0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f345c15e630 0x7f345c15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 --2- 172.21.15.121:0/2665425290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3440004800 0x7f345c1e6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 -- 172.21.15.121:0/2665425290 >> 172.21.15.121:0/2665425290 conn(0x7f345c0b3580 msgr2=0x7f345c0ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 -- 172.21.15.121:0/2665425290 shutdown_connections 2024-09-17T03:40:26.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.546+0000 7f3460a00640 1 -- 172.21.15.121:0/2665425290 wait complete. 2024-09-17T03:40:26.572 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:26.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.792+0000 7f6836a00640 1 -- 172.21.15.121:0/4091531347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68300d0af0 msgr2=0x7f683015cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.792+0000 7f6836a00640 1 --2- 172.21.15.121:0/4091531347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68300d0af0 0x7f683015cc10 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f6830072680 tx=0x7f682802a9a0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.792+0000 7f6836a00640 1 -- 172.21.15.121:0/4091531347 shutdown_connections 2024-09-17T03:40:26.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.792+0000 7f6836a00640 1 --2- 172.21.15.121:0/4091531347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68300d0af0 0x7f683015cc10 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.792+0000 7f6836a00640 1 --2- 172.21.15.121:0/4091531347 >> v2:172.21.15.176:3300/0 conn(0x7f683006d800 0x7f68300d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.792+0000 7f6836a00640 1 -- 172.21.15.121:0/4091531347 >> 172.21.15.121:0/4091531347 conn(0x7f68300b3580 msgr2=0x7f68300b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:26.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.792+0000 7f6836a00640 1 -- 172.21.15.121:0/4091531347 shutdown_connections 2024-09-17T03:40:26.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.792+0000 7f6836a00640 1 -- 172.21.15.121:0/4091531347 wait complete. 2024-09-17T03:40:26.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.794+0000 7f6836a00640 1 Processor -- start 2024-09-17T03:40:26.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.794+0000 7f6836a00640 1 -- start start 2024-09-17T03:40:26.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f6836a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f683006d800 0x7f683015c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:26.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f6836a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68300d0af0 0x7f6830155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:26.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f6836a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f683015a3e0 0x7f68300ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:26.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f6836a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f683015d4e0 con 0x7f68300d0af0 2024-09-17T03:40:26.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f6836a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f683015d360 con 0x7f683015a3e0 2024-09-17T03:40:26.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f6836a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f683015d660 con 0x7f683006d800 2024-09-17T03:40:26.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f682f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68300d0af0 0x7f6830155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:26.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f682f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68300d0af0 0x7f6830155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34262/0 (socket says 172.21.15.121:34262) 2024-09-17T03:40:26.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f682f400640 1 -- 172.21.15.121:0/2978416949 learned_addr learned my addr 172.21.15.121:0/2978416949 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:26.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f6834a00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f683015a3e0 0x7f68300ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:26.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.796+0000 7f682fe00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f683006d800 0x7f683015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:26.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f682f400640 1 -- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f683006d800 msgr2=0x7f683015c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f682f400640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f683006d800 0x7f683015c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f682f400640 1 -- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f683015a3e0 msgr2=0x7f68300ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f682f400640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f683015a3e0 0x7f68300ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f682f400640 1 -- 172.21.15.121:0/2978416949 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6830074dc0 con 0x7f68300d0af0 2024-09-17T03:40:26.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f682f400640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68300d0af0 0x7f6830155200 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c9a0 tx=0x7f681c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:26.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f6827e00640 1 -- 172.21.15.121:0/2978416949 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681c007bb0 con 0x7f68300d0af0 2024-09-17T03:40:26.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f6827e00640 1 -- 172.21.15.121:0/2978416949 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f681c007e40 con 0x7f68300d0af0 2024-09-17T03:40:26.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f6827e00640 1 -- 172.21.15.121:0/2978416949 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681c00f6b0 con 0x7f68300d0af0 2024-09-17T03:40:26.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f6836a00640 1 -- 172.21.15.121:0/2978416949 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68300c7350 con 0x7f68300d0af0 2024-09-17T03:40:26.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.797+0000 7f6836a00640 1 -- 172.21.15.121:0/2978416949 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68300c7910 con 0x7f68300d0af0 2024-09-17T03:40:26.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.798+0000 7f6836a00640 1 -- 172.21.15.121:0/2978416949 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6830074b30 con 0x7f68300d0af0 2024-09-17T03:40:26.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.801+0000 7f6827e00640 1 -- 172.21.15.121:0/2978416949 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f681c004020 con 0x7f68300d0af0 2024-09-17T03:40:26.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.802+0000 7f6827e00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6810078bf0 0x7f681007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:26.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.802+0000 7f6827e00640 1 -- 172.21.15.121:0/2978416949 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6101+0+0 (secure 0 0 0) 0x7f681c09b500 con 0x7f68300d0af0 2024-09-17T03:40:26.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.802+0000 7f682fe00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6810078bf0 0x7f681007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:26.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.803+0000 7f682fe00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6810078bf0 0x7f681007b100 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6820001720 tx=0x7f6820009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:26.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.805+0000 7f6827e00640 1 -- 172.21.15.121:0/2978416949 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f681c014030 con 0x7f68300d0af0 2024-09-17T03:40:26.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.990+0000 7f6836a00640 1 -- 172.21.15.121:0/2978416949 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f683015db80 con 0x7f68300d0af0 2024-09-17T03:40:26.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.991+0000 7f6827e00640 1 -- 172.21.15.121:0/2978416949 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+17089 (secure 0 0 0) 0x7f681c063360 con 0x7f68300d0af0 2024-09-17T03:40:26.991 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:26.991 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":109,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:40:25.564936+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:40:23.482553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-17T03:40:24.531215+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.993+0000 7f6836a00640 1 -- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6810078bf0 msgr2=0x7f681007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.993+0000 7f6836a00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6810078bf0 0x7f681007b100 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6820001720 tx=0x7f6820009040 comp rx=0 tx=0).stop 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.993+0000 7f6836a00640 1 -- 172.21.15.121:0/2978416949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68300d0af0 msgr2=0x7f6830155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.993+0000 7f6836a00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68300d0af0 0x7f6830155200 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c9a0 tx=0x7f681c00ce60 comp rx=0 tx=0).stop 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.993+0000 7f6836a00640 1 -- 172.21.15.121:0/2978416949 shutdown_connections 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.993+0000 7f6836a00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f683015a3e0 0x7f68300ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.993+0000 7f6836a00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6810078bf0 0x7f681007b100 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.993+0000 7f6836a00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68300d0af0 0x7f6830155200 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.993+0000 7f6836a00640 1 --2- 172.21.15.121:0/2978416949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f683006d800 0x7f683015c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.993+0000 7f6836a00640 1 -- 172.21.15.121:0/2978416949 >> 172.21.15.121:0/2978416949 conn(0x7f68300b3580 msgr2=0x7f6830157260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:26.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.994+0000 7f6836a00640 1 -- 172.21.15.121:0/2978416949 shutdown_connections 2024-09-17T03:40:26.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:26.994+0000 7f6836a00640 1 -- 172.21.15.121:0/2978416949 wait complete. 2024-09-17T03:40:27.016 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:40:27.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.241+0000 7f249e800640 1 -- 172.21.15.121:0/172311244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f249806ddc0 msgr2=0x7f24980d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:27.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.241+0000 7f249e800640 1 --2- 172.21.15.121:0/172311244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f249806ddc0 0x7f24980d05b0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f2484005fd0 tx=0x7f248402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:40:27.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.241+0000 7f249e800640 1 -- 172.21.15.121:0/172311244 shutdown_connections 2024-09-17T03:40:27.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.241+0000 7f249e800640 1 --2- 172.21.15.121:0/172311244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f249806ddc0 0x7f24980d05b0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:27.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.241+0000 7f249e800640 1 --2- 172.21.15.121:0/172311244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f249815a3e0 0x7f249806d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:27.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.241+0000 7f249e800640 1 -- 172.21.15.121:0/172311244 >> 172.21.15.121:0/172311244 conn(0x7f24980b3580 msgr2=0x7f24980b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:27.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.241+0000 7f249e800640 1 -- 172.21.15.121:0/172311244 shutdown_connections 2024-09-17T03:40:27.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.241+0000 7f249e800640 1 -- 172.21.15.121:0/172311244 wait complete. 2024-09-17T03:40:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.243+0000 7f249e800640 1 Processor -- start 2024-09-17T03:40:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.244+0000 7f249e800640 1 -- start start 2024-09-17T03:40:27.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.245+0000 7f249e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249806ddc0 0x7f24980ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:27.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.245+0000 7f249e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24980d0af0 0x7f24980cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:27.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.245+0000 7f249e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f249815a3e0 0x7f24980ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:27.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.245+0000 7f249e800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f249806f560 con 0x7f249815a3e0 2024-09-17T03:40:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.245+0000 7f249e800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2498161190 con 0x7f249806ddc0 2024-09-17T03:40:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.245+0000 7f249e800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f249806f6e0 con 0x7f24980d0af0 2024-09-17T03:40:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.245+0000 7f2497e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f249815a3e0 0x7f24980ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.245+0000 7f2497e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f249815a3e0 0x7f24980ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34282/0 (socket says 172.21.15.121:34282) 2024-09-17T03:40:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.245+0000 7f2497e00640 1 -- 172.21.15.121:0/992078342 learned_addr learned my addr 172.21.15.121:0/992078342 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f2497400640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249806ddc0 0x7f24980ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f2496a00640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24980d0af0 0x7f24980cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f2497e00640 1 -- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24980d0af0 msgr2=0x7f24980cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f2497e00640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24980d0af0 0x7f24980cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:27.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f2497e00640 1 -- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249806ddc0 msgr2=0x7f24980ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:27.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f2497e00640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249806ddc0 0x7f24980ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:27.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f2497e00640 1 -- 172.21.15.121:0/992078342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24980ae390 con 0x7f249815a3e0 2024-09-17T03:40:27.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f2497e00640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f249815a3e0 0x7f24980ccc70 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f249000c6e0 tx=0x7f249000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:27.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f248f400640 1 -- 172.21.15.121:0/992078342 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490003b70 con 0x7f249815a3e0 2024-09-17T03:40:27.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f248f400640 1 -- 172.21.15.121:0/992078342 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2490003d30 con 0x7f249815a3e0 2024-09-17T03:40:27.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f249e800640 1 -- 172.21.15.121:0/992078342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24980ae670 con 0x7f249815a3e0 2024-09-17T03:40:27.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.246+0000 7f248f400640 1 -- 172.21.15.121:0/992078342 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490005330 con 0x7f249815a3e0 2024-09-17T03:40:27.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.247+0000 7f249e800640 1 -- 172.21.15.121:0/992078342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24980aec30 con 0x7f249815a3e0 2024-09-17T03:40:27.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.248+0000 7f249e800640 1 -- 172.21.15.121:0/992078342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249806fb90 con 0x7f249815a3e0 2024-09-17T03:40:27.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.249+0000 7f248f400640 1 -- 172.21.15.121:0/992078342 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24900054d0 con 0x7f249815a3e0 2024-09-17T03:40:27.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.250+0000 7f248f400640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2478078b90 0x7f247807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:27.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.250+0000 7f248f400640 1 -- 172.21.15.121:0/992078342 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f249009ac50 con 0x7f249815a3e0 2024-09-17T03:40:27.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.250+0000 7f2497400640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2478078b90 0x7f247807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:27.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.251+0000 7f2497400640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2478078b90 0x7f247807b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f248800bb00 tx=0x7f2488005e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:27.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.254+0000 7f248f400640 1 -- 172.21.15.121:0/992078342 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f24980d0f00 con 0x7f249815a3e0 2024-09-17T03:40:27.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:27.475+0000 7f249e800640 1 -- 172.21.15.121:0/992078342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f24980b2410 con 0x7f249815a3e0 2024-09-17T03:40:28.053 INFO:tasks.ceph.mds.c.smithi121.stderr:2024-09-17T03:40:28.053+0000 7fa8e6a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:40:28.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.089+0000 7f248f400640 1 -- 172.21.15.121:0/992078342 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v76) ==== 118+0+0 (secure 0 0 0) 0x7f2490062ef0 con 0x7f249815a3e0 2024-09-17T03:40:28.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 -- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2478078b90 msgr2=0x7f247807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:28.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2478078b90 0x7f247807b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f248800bb00 tx=0x7f2488005e30 comp rx=0 tx=0).stop 2024-09-17T03:40:28.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 -- 172.21.15.121:0/992078342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f249815a3e0 msgr2=0x7f24980ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:28.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f249815a3e0 0x7f24980ccc70 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f249000c6e0 tx=0x7f249000cba0 comp rx=0 tx=0).stop 2024-09-17T03:40:28.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 -- 172.21.15.121:0/992078342 shutdown_connections 2024-09-17T03:40:28.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2478078b90 0x7f247807b0a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:28.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f249815a3e0 0x7f24980ccc70 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:28.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f24980d0af0 0x7f24980cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:28.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 --2- 172.21.15.121:0/992078342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249806ddc0 0x7f24980ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:28.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 -- 172.21.15.121:0/992078342 >> 172.21.15.121:0/992078342 conn(0x7f24980b3580 msgr2=0x7f2498156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:28.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.092+0000 7f249e800640 1 -- 172.21.15.121:0/992078342 shutdown_connections 2024-09-17T03:40:28.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.093+0000 7f249e800640 1 -- 172.21.15.121:0/992078342 wait complete. 2024-09-17T03:40:28.115 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:40:28.116 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:40:28.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.339+0000 7f4502c00640 1 -- 172.21.15.121:0/2010211222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc155870 msgr2=0x7f44fc15ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:28.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.339+0000 7f4502c00640 1 --2- 172.21.15.121:0/2010211222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc155870 0x7f44fc15ebd0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f44fc15f520 tx=0x7f44f002a540 comp rx=0 tx=0).stop 2024-09-17T03:40:28.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.339+0000 7f4502c00640 1 -- 172.21.15.121:0/2010211222 shutdown_connections 2024-09-17T03:40:28.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.339+0000 7f4502c00640 1 --2- 172.21.15.121:0/2010211222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44fc0b4370 0x7f44fc0b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:28.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.339+0000 7f4502c00640 1 --2- 172.21.15.121:0/2010211222 >> v2:172.21.15.176:3300/0 conn(0x7f44fc15f110 0x7f44fc0b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:28.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.339+0000 7f4502c00640 1 --2- 172.21.15.121:0/2010211222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc155870 0x7f44fc15ebd0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:28.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.339+0000 7f4502c00640 1 -- 172.21.15.121:0/2010211222 >> 172.21.15.121:0/2010211222 conn(0x7f44fc0d07f0 msgr2=0x7f44fc0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:28.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.339+0000 7f4502c00640 1 -- 172.21.15.121:0/2010211222 shutdown_connections 2024-09-17T03:40:28.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.339+0000 7f4502c00640 1 -- 172.21.15.121:0/2010211222 wait complete. 2024-09-17T03:40:28.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.341+0000 7f4502c00640 1 Processor -- start 2024-09-17T03:40:28.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.342+0000 7f4502c00640 1 -- start start 2024-09-17T03:40:28.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4502c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc0b4370 0x7f44fc142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:28.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4502c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44fc155870 0x7f44fc0b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:28.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4502c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44fc15f110 0x7f44fc150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:28.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4502c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc0b5440 con 0x7f44fc0b4370 2024-09-17T03:40:28.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4502c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc0b52c0 con 0x7f44fc155870 2024-09-17T03:40:28.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4502c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44fc162170 con 0x7f44fc15f110 2024-09-17T03:40:28.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4501800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc0b4370 0x7f44fc142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:28.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4501800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc0b4370 0x7f44fc142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34302/0 (socket says 172.21.15.121:34302) 2024-09-17T03:40:28.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4501800640 1 -- 172.21.15.121:0/3367621201 learned_addr learned my addr 172.21.15.121:0/3367621201 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:28.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4500e00640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44fc155870 0x7f44fc0b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:28.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.343+0000 7f4502200640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44fc15f110 0x7f44fc150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:28.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.344+0000 7f4501800640 1 -- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44fc15f110 msgr2=0x7f44fc150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:28.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.344+0000 7f4501800640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44fc15f110 0x7f44fc150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:28.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.344+0000 7f4501800640 1 -- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44fc155870 msgr2=0x7f44fc0b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:28.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.344+0000 7f4501800640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44fc155870 0x7f44fc0b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:28.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.344+0000 7f4501800640 1 -- 172.21.15.121:0/3367621201 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc0b10b0 con 0x7f44fc0b4370 2024-09-17T03:40:28.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.344+0000 7f4502200640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44fc15f110 0x7f44fc150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:28.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.344+0000 7f4501800640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc0b4370 0x7f44fc142b90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f44f00099d0 tx=0x7f44f00052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:28.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.344+0000 7f44f9600640 1 -- 172.21.15.121:0/3367621201 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0005cf0 con 0x7f44fc0b4370 2024-09-17T03:40:28.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.344+0000 7f44f9600640 1 -- 172.21.15.121:0/3367621201 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44f0031c40 con 0x7f44fc0b4370 2024-09-17T03:40:28.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.344+0000 7f4502c00640 1 -- 172.21.15.121:0/3367621201 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44fc0b1390 con 0x7f44fc0b4370 2024-09-17T03:40:28.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.345+0000 7f44f9600640 1 -- 172.21.15.121:0/3367621201 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0033330 con 0x7f44fc0b4370 2024-09-17T03:40:28.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.345+0000 7f4502c00640 1 -- 172.21.15.121:0/3367621201 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44fc0b1950 con 0x7f44fc0b4370 2024-09-17T03:40:28.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.346+0000 7f4502c00640 1 -- 172.21.15.121:0/3367621201 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44fc15ebd0 con 0x7f44fc0b4370 2024-09-17T03:40:28.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.347+0000 7f44f9600640 1 -- 172.21.15.121:0/3367621201 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44f00334d0 con 0x7f44fc0b4370 2024-09-17T03:40:28.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.348+0000 7f44f9600640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f44dc078b90 0x7f44dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:28.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.348+0000 7f44f9600640 1 -- 172.21.15.121:0/3367621201 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f44f00bc310 con 0x7f44fc0b4370 2024-09-17T03:40:28.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.348+0000 7f4500e00640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f44dc078b90 0x7f44dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:28.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.349+0000 7f4500e00640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f44dc078b90 0x7f44dc07b0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f44fc161d20 tx=0x7f44e800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:28.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.352+0000 7f44f9600640 1 -- 172.21.15.121:0/3367621201 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f44f003f030 con 0x7f44fc0b4370 2024-09-17T03:40:28.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:28.566+0000 7f4502c00640 1 -- 172.21.15.121:0/3367621201 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f44fc073980 con 0x7f44fc0b4370 2024-09-17T03:40:29.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.097+0000 7f44f9600640 1 -- 172.21.15.121:0/3367621201 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v77) ==== 122+0+0 (secure 0 0 0) 0x7f44f0084520 con 0x7f44fc0b4370 2024-09-17T03:40:29.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 -- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f44dc078b90 msgr2=0x7f44dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:29.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f44dc078b90 0x7f44dc07b0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f44fc161d20 tx=0x7f44e800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 -- 172.21.15.121:0/3367621201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc0b4370 msgr2=0x7f44fc142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:29.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc0b4370 0x7f44fc142b90 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f44f00099d0 tx=0x7f44f00052f0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 -- 172.21.15.121:0/3367621201 shutdown_connections 2024-09-17T03:40:29.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44fc15f110 0x7f44fc150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44fc155870 0x7f44fc0b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f44dc078b90 0x7f44dc07b0a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 --2- 172.21.15.121:0/3367621201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc0b4370 0x7f44fc142b90 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 -- 172.21.15.121:0/3367621201 >> 172.21.15.121:0/3367621201 conn(0x7f44fc0d07f0 msgr2=0x7f44fc160190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:29.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 -- 172.21.15.121:0/3367621201 shutdown_connections 2024-09-17T03:40:29.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.099+0000 7f4502c00640 1 -- 172.21.15.121:0/3367621201 wait complete. 2024-09-17T03:40:29.125 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:40:29.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:29.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.345+0000 7febcca00640 1 -- 172.21.15.121:0/2970627293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc80d0af0 msgr2=0x7febc815cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:29.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.345+0000 7febcca00640 1 --2- 172.21.15.121:0/2970627293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc80d0af0 0x7febc815cc10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7febc0005fd0 tx=0x7febc002a980 comp rx=0 tx=0).stop 2024-09-17T03:40:29.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.345+0000 7febcca00640 1 -- 172.21.15.121:0/2970627293 shutdown_connections 2024-09-17T03:40:29.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.345+0000 7febcca00640 1 --2- 172.21.15.121:0/2970627293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc80d0af0 0x7febc815cc10 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.345+0000 7febcca00640 1 --2- 172.21.15.121:0/2970627293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febc806d800 0x7febc80d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.345+0000 7febcca00640 1 -- 172.21.15.121:0/2970627293 >> 172.21.15.121:0/2970627293 conn(0x7febc80b3580 msgr2=0x7febc80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:29.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.345+0000 7febcca00640 1 -- 172.21.15.121:0/2970627293 shutdown_connections 2024-09-17T03:40:29.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.345+0000 7febcca00640 1 -- 172.21.15.121:0/2970627293 wait complete. 2024-09-17T03:40:29.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.347+0000 7febcca00640 1 Processor -- start 2024-09-17T03:40:29.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.348+0000 7febcca00640 1 -- start start 2024-09-17T03:40:29.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febcca00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc806d800 0x7febc80cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:29.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febcca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febc80d0af0 0x7febc81f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febcca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febc815a3e0 0x7febc80b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febcca00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7febc815d4e0 con 0x7febc806d800 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febcca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7febc815d360 con 0x7febc80d0af0 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febcca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7febc815d660 con 0x7febc815a3e0 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febc5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc806d800 0x7febc80cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febc5e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc806d800 0x7febc80cf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34306/0 (socket says 172.21.15.121:34306) 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febc5e00640 1 -- 172.21.15.121:0/3396907694 learned_addr learned my addr 172.21.15.121:0/3396907694 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febc5400640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febc80d0af0 0x7febc81f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.349+0000 7febc6800640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febc815a3e0 0x7febc80b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febc5e00640 1 -- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febc815a3e0 msgr2=0x7febc80b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febc5e00640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febc815a3e0 0x7febc80b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febc5e00640 1 -- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febc80d0af0 msgr2=0x7febc81f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:29.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febc5e00640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febc80d0af0 0x7febc81f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febc5e00640 1 -- 172.21.15.121:0/3396907694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc81f69a0 con 0x7febc806d800 2024-09-17T03:40:29.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febc5e00640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc806d800 0x7febc80cf4c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7febb800c3a0 tx=0x7febb800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:29.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febbe000640 1 -- 172.21.15.121:0/3396907694 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8017070 con 0x7febc806d800 2024-09-17T03:40:29.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febbe000640 1 -- 172.21.15.121:0/3396907694 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febb80053c0 con 0x7febc806d800 2024-09-17T03:40:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febbe000640 1 -- 172.21.15.121:0/3396907694 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8003850 con 0x7febc806d800 2024-09-17T03:40:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febcca00640 1 -- 172.21.15.121:0/3396907694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc809a600 con 0x7febc806d800 2024-09-17T03:40:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.350+0000 7febcca00640 1 -- 172.21.15.121:0/3396907694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc809abc0 con 0x7febc806d800 2024-09-17T03:40:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.352+0000 7febcca00640 1 -- 172.21.15.121:0/3396907694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc815db80 con 0x7febc806d800 2024-09-17T03:40:29.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.353+0000 7febbe000640 1 -- 172.21.15.121:0/3396907694 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7febb801a070 con 0x7febc806d800 2024-09-17T03:40:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.354+0000 7febbe000640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feba8078bc0 0x7feba807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.354+0000 7febbe000640 1 -- 172.21.15.121:0/3396907694 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7febb809a1d0 con 0x7febc806d800 2024-09-17T03:40:29.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.354+0000 7febc5400640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feba8078bc0 0x7feba807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:29.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.355+0000 7febc5400640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feba8078bc0 0x7feba807b0d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7febc815c2e0 tx=0x7febb400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:29.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.358+0000 7febbe000640 1 -- 172.21.15.121:0/3396907694 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7febc80d0f00 con 0x7febc806d800 2024-09-17T03:40:29.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.577+0000 7febcca00640 1 -- 172.21.15.121:0/3396907694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febc80d0760 con 0x7febc806d800 2024-09-17T03:40:29.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.578+0000 7febbe000640 1 -- 172.21.15.121:0/3396907694 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5234 (secure 0 0 0) 0x7febb8061e20 con 0x7febc806d800 2024-09-17T03:40:29.578 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:29.578 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":77,"btime":"2024-09-17T03:40:29:090893+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2166412005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2166412005},{"type":"v1","addr":"172.21.15.176:6836","nonce":2166412005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4240071061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4240071061},{"type":"v1","addr":"172.21.15.176:6837","nonce":4240071061}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/1319588889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1319588889},{"type":"v1","addr":"172.21.15.121:6833","nonce":1319588889}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:28.568125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7095},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7095":{"gid":7095,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/697305237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":697305237},{"type":"v1","addr":"172.21.15.121:6835","nonce":697305237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7095,"qdb_cluster":[7095]},"id":8}]} 2024-09-17T03:40:29.578 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 77 2024-09-17T03:40:29.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 -- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feba8078bc0 msgr2=0x7feba807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feba8078bc0 0x7feba807b0d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7febc815c2e0 tx=0x7febb400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 -- 172.21.15.121:0/3396907694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc806d800 msgr2=0x7febc80cf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc806d800 0x7febc80cf4c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7febb800c3a0 tx=0x7febb800c860 comp rx=0 tx=0).stop 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 -- 172.21.15.121:0/3396907694 shutdown_connections 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7febc815a3e0 0x7febc80b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febc80d0af0 0x7febc81f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feba8078bc0 0x7feba807b0d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 --2- 172.21.15.121:0/3396907694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc806d800 0x7febc80cf4c0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 -- 172.21.15.121:0/3396907694 >> 172.21.15.121:0/3396907694 conn(0x7febc80b3580 msgr2=0x7febc80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 -- 172.21.15.121:0/3396907694 shutdown_connections 2024-09-17T03:40:29.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.580+0000 7febcca00640 1 -- 172.21.15.121:0/3396907694 wait complete. 2024-09-17T03:40:29.602 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:29.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.820+0000 7f123aa00640 1 -- 172.21.15.121:0/235033158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f123415a3e0 msgr2=0x7f123406d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:29.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.820+0000 7f123aa00640 1 --2- 172.21.15.121:0/235033158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f123415a3e0 0x7f123406d800 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f12340c3a00 tx=0x7f122402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.821+0000 7f123aa00640 1 -- 172.21.15.121:0/235033158 shutdown_connections 2024-09-17T03:40:29.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.821+0000 7f123aa00640 1 --2- 172.21.15.121:0/235033158 >> v2:172.21.15.176:3300/0 conn(0x7f12340d0cc0 0x7f123415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.821+0000 7f123aa00640 1 --2- 172.21.15.121:0/235033158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f123415a3e0 0x7f123406d800 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.821+0000 7f123aa00640 1 -- 172.21.15.121:0/235033158 >> 172.21.15.121:0/235033158 conn(0x7f12340b3580 msgr2=0x7f12340b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:29.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.821+0000 7f123aa00640 1 -- 172.21.15.121:0/235033158 shutdown_connections 2024-09-17T03:40:29.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.821+0000 7f123aa00640 1 -- 172.21.15.121:0/235033158 wait complete. 2024-09-17T03:40:29.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.823+0000 7f123aa00640 1 Processor -- start 2024-09-17T03:40:29.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.823+0000 7f123aa00640 1 -- start start 2024-09-17T03:40:29.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.824+0000 7f123aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f123406ddc0 0x7f1234158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:29.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.824+0000 7f123aa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f123415a3e0 0x7f1234158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:29.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.824+0000 7f123aa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12340b2930 0x7f12340b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:29.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.824+0000 7f123aa00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f123415d4e0 con 0x7f12340b2930 2024-09-17T03:40:29.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.824+0000 7f123aa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f123415d360 con 0x7f123406ddc0 2024-09-17T03:40:29.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.824+0000 7f123aa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f123415d660 con 0x7f123415a3e0 2024-09-17T03:40:29.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1238a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12340b2930 0x7f12340b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:29.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1238a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12340b2930 0x7f12340b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34324/0 (socket says 172.21.15.121:34324) 2024-09-17T03:40:29.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1238a00640 1 -- 172.21.15.121:0/2741602721 learned_addr learned my addr 172.21.15.121:0/2741602721 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:29.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1238a00640 1 -- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f123415a3e0 msgr2=0x7f1234158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:29.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1238a00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f123415a3e0 0x7f1234158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1238a00640 1 -- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f123406ddc0 msgr2=0x7f1234158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:29.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1233e00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f123406ddc0 0x7f1234158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:29.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1238a00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f123406ddc0 0x7f1234158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:29.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1238a00640 1 -- 172.21.15.121:0/2741602721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12340cdd60 con 0x7f12340b2930 2024-09-17T03:40:29.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1233e00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f123406ddc0 0x7f1234158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:29.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.825+0000 7f1238a00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12340b2930 0x7f12340b1450 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f122c00e990 tx=0x7f122c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:29.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.826+0000 7f122be00640 1 -- 172.21.15.121:0/2741602721 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c004d20 con 0x7f12340b2930 2024-09-17T03:40:29.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.826+0000 7f122be00640 1 -- 172.21.15.121:0/2741602721 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f122c00caa0 con 0x7f12340b2930 2024-09-17T03:40:29.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.826+0000 7f122be00640 1 -- 172.21.15.121:0/2741602721 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c005020 con 0x7f12340b2930 2024-09-17T03:40:29.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.826+0000 7f123aa00640 1 -- 172.21.15.121:0/2741602721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12340993e0 con 0x7f12340b2930 2024-09-17T03:40:29.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.826+0000 7f123aa00640 1 -- 172.21.15.121:0/2741602721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12340ce2e0 con 0x7f12340b2930 2024-09-17T03:40:29.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.827+0000 7f123aa00640 1 -- 172.21.15.121:0/2741602721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123415db10 con 0x7f12340b2930 2024-09-17T03:40:29.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.828+0000 7f122be00640 1 -- 172.21.15.121:0/2741602721 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f122c0051c0 con 0x7f12340b2930 2024-09-17T03:40:29.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.829+0000 7f122be00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1214078b90 0x7f121407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:29.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.829+0000 7f122be00640 1 -- 172.21.15.121:0/2741602721 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f122c09b890 con 0x7f12340b2930 2024-09-17T03:40:29.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.830+0000 7f1233e00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1214078b90 0x7f121407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:29.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.830+0000 7f1233e00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1214078b90 0x7f121407b0a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1224033000 tx=0x7f1224004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:29.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:29.834+0000 7f122be00640 1 -- 172.21.15.121:0/2741602721 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f122c016030 con 0x7f12340b2930 2024-09-17T03:40:30.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.017+0000 7f123aa00640 1 -- 172.21.15.121:0/2741602721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12340b2710 con 0x7f12340b2930 2024-09-17T03:40:30.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.018+0000 7f122be00640 1 -- 172.21.15.121:0/2741602721 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+17076 (secure 0 0 0) 0x7f122c063aa0 con 0x7f12340b2930 2024-09-17T03:40:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:30.019 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":110,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:40:27.076143+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:40:23.482553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-17T03:40:24.531215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 -- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1214078b90 msgr2=0x7f121407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1214078b90 0x7f121407b0a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1224033000 tx=0x7f1224004730 comp rx=0 tx=0).stop 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 -- 172.21.15.121:0/2741602721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12340b2930 msgr2=0x7f12340b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12340b2930 0x7f12340b1450 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f122c00e990 tx=0x7f122c00ee50 comp rx=0 tx=0).stop 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 -- 172.21.15.121:0/2741602721 shutdown_connections 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1214078b90 0x7f121407b0a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12340b2930 0x7f12340b1450 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f123415a3e0 0x7f1234158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 --2- 172.21.15.121:0/2741602721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f123406ddc0 0x7f1234158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 -- 172.21.15.121:0/2741602721 >> 172.21.15.121:0/2741602721 conn(0x7f12340b3580 msgr2=0x7f12340cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:30.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 -- 172.21.15.121:0/2741602721 shutdown_connections 2024-09-17T03:40:30.022 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.021+0000 7f123aa00640 1 -- 172.21.15.121:0/2741602721 wait complete. 2024-09-17T03:40:30.046 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:40:30.046 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:30.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.267+0000 7f2757e00640 1 -- 172.21.15.121:0/2391816796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27580742a0 msgr2=0x7f27580b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.267+0000 7f2757e00640 1 --2- 172.21.15.121:0/2391816796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27580742a0 0x7f27580b4480 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f2750005fd0 tx=0x7f275002a980 comp rx=0 tx=0).stop 2024-09-17T03:40:30.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.267+0000 7f2757e00640 1 -- 172.21.15.121:0/2391816796 shutdown_connections 2024-09-17T03:40:30.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.267+0000 7f2757e00640 1 --2- 172.21.15.121:0/2391816796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27580742a0 0x7f27580b4480 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.267+0000 7f2757e00640 1 -- 172.21.15.121:0/2391816796 >> 172.21.15.121:0/2391816796 conn(0x7f27580b2440 msgr2=0x7f27580d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:30.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.267+0000 7f2757e00640 1 -- 172.21.15.121:0/2391816796 shutdown_connections 2024-09-17T03:40:30.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.267+0000 7f2757e00640 1 -- 172.21.15.121:0/2391816796 wait complete. 2024-09-17T03:40:30.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.269+0000 7f2757e00640 1 Processor -- start 2024-09-17T03:40:30.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.269+0000 7f2757e00640 1 -- start start 2024-09-17T03:40:30.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2757e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27580742a0 0x7f275809d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:30.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2757e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2758159170 0x7f275809da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:30.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2757e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27580cdd60 0x7f27581f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:30.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2757e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2758166810 con 0x7f27580742a0 2024-09-17T03:40:30.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2757e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2758166690 con 0x7f2758159170 2024-09-17T03:40:30.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2757e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2758166990 con 0x7f27580cdd60 2024-09-17T03:40:30.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2756a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27580742a0 0x7f275809d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:30.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2756a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27580742a0 0x7f275809d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34338/0 (socket says 172.21.15.121:34338) 2024-09-17T03:40:30.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2756a00640 1 -- 172.21.15.121:0/3090212279 learned_addr learned my addr 172.21.15.121:0/3090212279 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:30.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2757400640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27580cdd60 0x7f27581f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:30.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2756000640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2758159170 0x7f275809da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:30.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2756a00640 1 -- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27580cdd60 msgr2=0x7f27581f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2756a00640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27580cdd60 0x7f27581f5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2756a00640 1 -- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2758159170 msgr2=0x7f275809da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2756a00640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2758159170 0x7f275809da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2756a00640 1 -- 172.21.15.121:0/3090212279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275809b690 con 0x7f27580742a0 2024-09-17T03:40:30.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.271+0000 7f2756000640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2758159170 0x7f275809da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:30.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.272+0000 7f2756a00640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27580742a0 0x7f275809d500 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f274800c3f0 tx=0x7f274800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:30.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.272+0000 7f274f400640 1 -- 172.21.15.121:0/3090212279 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748017070 con 0x7f27580742a0 2024-09-17T03:40:30.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.272+0000 7f274f400640 1 -- 172.21.15.121:0/3090212279 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27480035f0 con 0x7f27580742a0 2024-09-17T03:40:30.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.272+0000 7f274f400640 1 -- 172.21.15.121:0/3090212279 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748003a40 con 0x7f27580742a0 2024-09-17T03:40:30.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.272+0000 7f2757e00640 1 -- 172.21.15.121:0/3090212279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275809b970 con 0x7f27580742a0 2024-09-17T03:40:30.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.272+0000 7f2757e00640 1 -- 172.21.15.121:0/3090212279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27581f8790 con 0x7f27580742a0 2024-09-17T03:40:30.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.273+0000 7f2757e00640 1 -- 172.21.15.121:0/3090212279 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27581f8a10 con 0x7f27580742a0 2024-09-17T03:40:30.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.274+0000 7f274f400640 1 -- 172.21.15.121:0/3090212279 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f274801a070 con 0x7f27580742a0 2024-09-17T03:40:30.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.275+0000 7f274f400640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2738078b90 0x7f273807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:30.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.275+0000 7f274f400640 1 -- 172.21.15.121:0/3090212279 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f274809a1f0 con 0x7f27580742a0 2024-09-17T03:40:30.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.276+0000 7f2756000640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2738078b90 0x7f273807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:30.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.277+0000 7f2756000640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2738078b90 0x7f273807b0a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f27580cafd0 tx=0x7f2744008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:30.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.280+0000 7f274f400640 1 -- 172.21.15.121:0/3090212279 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2748062490 con 0x7f27580742a0 2024-09-17T03:40:30.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.460+0000 7f2757e00640 1 -- 172.21.15.121:0/3090212279 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f275809b440 con 0x7f2738078b90 2024-09-17T03:40:30.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.465+0000 7f274f400640 1 -- 172.21.15.121:0/3090212279 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247627 (secure 0 0 0) 0x7f275809b440 con 0x7f2738078b90 2024-09-17T03:40:30.470 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:30.472 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:40:30.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 -- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2738078b90 msgr2=0x7f273807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2738078b90 0x7f273807b0a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f27580cafd0 tx=0x7f2744008040 comp rx=0 tx=0).stop 2024-09-17T03:40:30.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 -- 172.21.15.121:0/3090212279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27580742a0 msgr2=0x7f275809d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27580742a0 0x7f275809d500 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f274800c3f0 tx=0x7f274800c8b0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 -- 172.21.15.121:0/3090212279 shutdown_connections 2024-09-17T03:40:30.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27580cdd60 0x7f27581f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2758159170 0x7f275809da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2738078b90 0x7f273807b0a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 --2- 172.21.15.121:0/3090212279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27580742a0 0x7f275809d500 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 -- 172.21.15.121:0/3090212279 >> 172.21.15.121:0/3090212279 conn(0x7f27580b2440 msgr2=0x7f275806d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:30.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 -- 172.21.15.121:0/3090212279 shutdown_connections 2024-09-17T03:40:30.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.469+0000 7f2757e00640 1 -- 172.21.15.121:0/3090212279 wait complete. 2024-09-17T03:40:30.493 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-09-17T03:40:29.354511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261148,"kb_used_data":11608,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713572,"statfs":{"total":773094113280,"available":772826697728,"internally_reserved":0,"allocated":11886592,"data_stored":6073903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.297496"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074923+0000","last_change":"2024-09-17T03:40:25.074923+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074923+0000","last_undegraded":"2024-09-17T03:40:25.074923+0000","last_fullsized":"2024-09-17T03:40:25.074923+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076336+0000","last_change":"2024-09-17T03:40:25.076336+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076336+0000","last_undegraded":"2024-09-17T03:40:25.076336+0000","last_fullsized":"2024-09-17T03:40:25.076336+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.078223+0000","last_change":"2024-09-17T03:40:25.078223+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.078223+0000","last_undegraded":"2024-09-17T03:40:25.078223+0000","last_fullsized":"2024-09-17T03:40:25.078223+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076385+0000","last_change":"2024-09-17T03:40:25.076385+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076385+0000","last_undegraded":"2024-09-17T03:40:25.076385+0000","last_fullsized":"2024-09-17T03:40:25.076385+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.086200+0000","last_change":"2024-09-17T03:40:25.086200+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.086200+0000","last_undegraded":"2024-09-17T03:40:25.086200+0000","last_fullsized":"2024-09-17T03:40:25.086200+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074786+0000","last_change":"2024-09-17T03:40:25.074786+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074786+0000","last_undegraded":"2024-09-17T03:40:25.074786+0000","last_fullsized":"2024-09-17T03:40:25.074786+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.079481+0000","last_change":"2024-09-17T03:40:25.079481+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.079481+0000","last_undegraded":"2024-09-17T03:40:25.079481+0000","last_fullsized":"2024-09-17T03:40:25.079481+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088282+0000","last_change":"2024-09-17T03:40:26.082958+0000","last_active":"2024-09-17T03:40:27.088282+0000","last_peered":"2024-09-17T03:40:27.088282+0000","last_clean":"2024-09-17T03:40:27.088282+0000","last_became_active":"2024-09-17T03:40:26.082410+0000","last_became_peered":"2024-09-17T03:40:26.082410+0000","last_unstale":"2024-09-17T03:40:27.088282+0000","last_undegraded":"2024-09-17T03:40:27.088282+0000","last_fullsized":"2024-09-17T03:40:27.088282+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:01.976092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076649+0000","last_change":"2024-09-17T03:40:25.076649+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076649+0000","last_undegraded":"2024-09-17T03:40:25.076649+0000","last_fullsized":"2024-09-17T03:40:25.076649+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077289+0000","last_change":"2024-09-17T03:40:25.077289+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077289+0000","last_undegraded":"2024-09-17T03:40:25.077289+0000","last_fullsized":"2024-09-17T03:40:25.077289+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077137+0000","last_change":"2024-09-17T03:40:25.077137+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077137+0000","last_undegraded":"2024-09-17T03:40:25.077137+0000","last_fullsized":"2024-09-17T03:40:25.077137+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074438+0000","last_change":"2024-09-17T03:40:25.074438+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074438+0000","last_undegraded":"2024-09-17T03:40:25.074438+0000","last_fullsized":"2024-09-17T03:40:25.074438+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074973+0000","last_change":"2024-09-17T03:40:25.074973+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074973+0000","last_undegraded":"2024-09-17T03:40:25.074973+0000","last_fullsized":"2024-09-17T03:40:25.074973+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.072736+0000","last_change":"2024-09-17T03:40:25.072736+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.072736+0000","last_undegraded":"2024-09-17T03:40:25.072736+0000","last_fullsized":"2024-09-17T03:40:25.072736+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.080542+0000","last_change":"2024-09-17T03:40:25.080542+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.080542+0000","last_undegraded":"2024-09-17T03:40:25.080542+0000","last_fullsized":"2024-09-17T03:40:25.080542+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.071241+0000","last_change":"2024-09-17T03:40:25.071241+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.071241+0000","last_undegraded":"2024-09-17T03:40:25.071241+0000","last_fullsized":"2024-09-17T03:40:25.071241+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.072397+0000","last_change":"2024-09-17T03:40:25.072397+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.072397+0000","last_undegraded":"2024-09-17T03:40:25.072397+0000","last_fullsized":"2024-09-17T03:40:25.072397+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074917+0000","last_change":"2024-09-17T03:40:25.074917+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074917+0000","last_undegraded":"2024-09-17T03:40:25.074917+0000","last_fullsized":"2024-09-17T03:40:25.074917+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.087669+0000","last_change":"2024-09-17T03:40:25.087669+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.087669+0000","last_undegraded":"2024-09-17T03:40:25.087669+0000","last_fullsized":"2024-09-17T03:40:25.087669+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.075471+0000","last_change":"2024-09-17T03:40:25.075471+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.075471+0000","last_undegraded":"2024-09-17T03:40:25.075471+0000","last_fullsized":"2024-09-17T03:40:25.075471+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.085725+0000","last_change":"2024-09-17T03:40:25.085725+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.085725+0000","last_undegraded":"2024-09-17T03:40:25.085725+0000","last_fullsized":"2024-09-17T03:40:25.085725+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.079266+0000","last_change":"2024-09-17T03:40:25.079266+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.079266+0000","last_undegraded":"2024-09-17T03:40:25.079266+0000","last_fullsized":"2024-09-17T03:40:25.079266+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.080075+0000","last_change":"2024-09-17T03:40:25.080075+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.080075+0000","last_undegraded":"2024-09-17T03:40:25.080075+0000","last_fullsized":"2024-09-17T03:40:25.080075+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.075520+0000","last_change":"2024-09-17T03:40:25.075520+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.075520+0000","last_undegraded":"2024-09-17T03:40:25.075520+0000","last_fullsized":"2024-09-17T03:40:25.075520+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074372+0000","last_change":"2024-09-17T03:40:25.074372+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074372+0000","last_undegraded":"2024-09-17T03:40:25.074372+0000","last_fullsized":"2024-09-17T03:40:25.074372+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090544+0000","last_change":"2024-09-17T03:40:26.098599+0000","last_active":"2024-09-17T03:40:27.090544+0000","last_peered":"2024-09-17T03:40:27.090544+0000","last_clean":"2024-09-17T03:40:27.090544+0000","last_became_active":"2024-09-17T03:40:26.098250+0000","last_became_peered":"2024-09-17T03:40:26.098250+0000","last_unstale":"2024-09-17T03:40:27.090544+0000","last_undegraded":"2024-09-17T03:40:27.090544+0000","last_fullsized":"2024-09-17T03:40:27.090544+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:31.185943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.087224+0000","last_change":"2024-09-17T03:40:25.087224+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.087224+0000","last_undegraded":"2024-09-17T03:40:25.087224+0000","last_fullsized":"2024-09-17T03:40:25.087224+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.072947+0000","last_change":"2024-09-17T03:40:25.072947+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.072947+0000","last_undegraded":"2024-09-17T03:40:25.072947+0000","last_fullsized":"2024-09-17T03:40:25.072947+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.081175+0000","last_change":"2024-09-17T03:40:25.081175+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.081175+0000","last_undegraded":"2024-09-17T03:40:25.081175+0000","last_fullsized":"2024-09-17T03:40:25.081175+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.078513+0000","last_change":"2024-09-17T03:40:25.078513+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.078513+0000","last_undegraded":"2024-09-17T03:40:25.078513+0000","last_fullsized":"2024-09-17T03:40:25.078513+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077656+0000","last_change":"2024-09-17T03:40:25.077656+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077656+0000","last_undegraded":"2024-09-17T03:40:25.077656+0000","last_fullsized":"2024-09-17T03:40:25.077656+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076294+0000","last_change":"2024-09-17T03:40:25.076294+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076294+0000","last_undegraded":"2024-09-17T03:40:25.076294+0000","last_fullsized":"2024-09-17T03:40:25.076294+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090750+0000","last_change":"2024-09-17T03:40:26.094424+0000","last_active":"2024-09-17T03:40:27.090750+0000","last_peered":"2024-09-17T03:40:27.090750+0000","last_clean":"2024-09-17T03:40:27.090750+0000","last_became_active":"2024-09-17T03:40:26.094061+0000","last_became_peered":"2024-09-17T03:40:26.094061+0000","last_unstale":"2024-09-17T03:40:27.090750+0000","last_undegraded":"2024-09-17T03:40:27.090750+0000","last_fullsized":"2024-09-17T03:40:27.090750+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:56.894039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.093383+0000","last_change":"2024-09-17T03:40:25.086790+0000","last_active":"2024-09-17T03:40:25.093383+0000","last_peered":"2024-09-17T03:40:25.093383+0000","last_clean":"2024-09-17T03:40:25.093383+0000","last_became_active":"2024-09-17T03:40:25.086123+0000","last_became_peered":"2024-09-17T03:40:25.086123+0000","last_unstale":"2024-09-17T03:40:25.093383+0000","last_undegraded":"2024-09-17T03:40:25.093383+0000","last_fullsized":"2024-09-17T03:40:25.093383+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:22.987400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.075799+0000","last_change":"2024-09-17T03:40:25.075799+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.075799+0000","last_undegraded":"2024-09-17T03:40:25.075799+0000","last_fullsized":"2024-09-17T03:40:25.075799+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.093813+0000","last_change":"2024-09-17T03:40:25.091077+0000","last_active":"2024-09-17T03:40:25.093813+0000","last_peered":"2024-09-17T03:40:25.093813+0000","last_clean":"2024-09-17T03:40:25.093813+0000","last_became_active":"2024-09-17T03:40:25.090715+0000","last_became_peered":"2024-09-17T03:40:25.090715+0000","last_unstale":"2024-09-17T03:40:25.093813+0000","last_undegraded":"2024-09-17T03:40:25.093813+0000","last_fullsized":"2024-09-17T03:40:25.093813+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:39.487655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074472+0000","last_change":"2024-09-17T03:40:25.074472+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074472+0000","last_undegraded":"2024-09-17T03:40:25.074472+0000","last_fullsized":"2024-09-17T03:40:25.074472+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.096091+0000","last_change":"2024-09-17T03:40:25.091127+0000","last_active":"2024-09-17T03:40:25.096091+0000","last_peered":"2024-09-17T03:40:25.096091+0000","last_clean":"2024-09-17T03:40:25.096091+0000","last_became_active":"2024-09-17T03:40:25.090828+0000","last_became_peered":"2024-09-17T03:40:25.090828+0000","last_unstale":"2024-09-17T03:40:25.096091+0000","last_undegraded":"2024-09-17T03:40:25.096091+0000","last_fullsized":"2024-09-17T03:40:25.096091+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:59.194206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076197+0000","last_change":"2024-09-17T03:40:25.076197+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076197+0000","last_undegraded":"2024-09-17T03:40:25.076197+0000","last_fullsized":"2024-09-17T03:40:25.076197+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.090589+0000","last_change":"2024-09-17T03:40:25.088001+0000","last_active":"2024-09-17T03:40:25.090589+0000","last_peered":"2024-09-17T03:40:25.090589+0000","last_clean":"2024-09-17T03:40:25.090589+0000","last_became_active":"2024-09-17T03:40:25.087631+0000","last_became_peered":"2024-09-17T03:40:25.087631+0000","last_unstale":"2024-09-17T03:40:25.090589+0000","last_undegraded":"2024-09-17T03:40:25.090589+0000","last_fullsized":"2024-09-17T03:40:25.090589+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:20.935254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088541+0000","last_change":"2024-09-17T03:40:26.102071+0000","last_active":"2024-09-17T03:40:27.088541+0000","last_peered":"2024-09-17T03:40:27.088541+0000","last_clean":"2024-09-17T03:40:27.088541+0000","last_became_active":"2024-09-17T03:40:26.101645+0000","last_became_peered":"2024-09-17T03:40:26.101645+0000","last_unstale":"2024-09-17T03:40:27.088541+0000","last_undegraded":"2024-09-17T03:40:27.088541+0000","last_fullsized":"2024-09-17T03:40:27.088541+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:39.422894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098413+0000","last_change":"2024-09-17T03:40:25.092407+0000","last_active":"2024-09-17T03:40:25.098413+0000","last_peered":"2024-09-17T03:40:25.098413+0000","last_clean":"2024-09-17T03:40:25.098413+0000","last_became_active":"2024-09-17T03:40:25.092121+0000","last_became_peered":"2024-09-17T03:40:25.092121+0000","last_unstale":"2024-09-17T03:40:25.098413+0000","last_undegraded":"2024-09-17T03:40:25.098413+0000","last_fullsized":"2024-09-17T03:40:25.098413+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:47.006934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.075461+0000","last_change":"2024-09-17T03:40:25.075461+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.075461+0000","last_undegraded":"2024-09-17T03:40:25.075461+0000","last_fullsized":"2024-09-17T03:40:25.075461+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089451+0000","last_change":"2024-09-17T03:40:25.082851+0000","last_active":"2024-09-17T03:40:27.089451+0000","last_peered":"2024-09-17T03:40:27.089451+0000","last_clean":"2024-09-17T03:40:27.089451+0000","last_became_active":"2024-09-17T03:40:25.082524+0000","last_became_peered":"2024-09-17T03:40:25.082524+0000","last_unstale":"2024-09-17T03:40:27.089451+0000","last_undegraded":"2024-09-17T03:40:27.089451+0000","last_fullsized":"2024-09-17T03:40:27.089451+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:09.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.078011+0000","last_change":"2024-09-17T03:40:25.078011+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.078011+0000","last_undegraded":"2024-09-17T03:40:25.078011+0000","last_fullsized":"2024-09-17T03:40:25.078011+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.089024+0000","last_change":"2024-09-17T03:40:25.085262+0000","last_active":"2024-09-17T03:40:25.089024+0000","last_peered":"2024-09-17T03:40:25.089024+0000","last_clean":"2024-09-17T03:40:25.089024+0000","last_became_active":"2024-09-17T03:40:25.084924+0000","last_became_peered":"2024-09-17T03:40:25.084924+0000","last_unstale":"2024-09-17T03:40:25.089024+0000","last_undegraded":"2024-09-17T03:40:25.089024+0000","last_fullsized":"2024-09-17T03:40:25.089024+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:54.911525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089299+0000","last_change":"2024-09-17T03:40:26.091093+0000","last_active":"2024-09-17T03:40:27.089299+0000","last_peered":"2024-09-17T03:40:27.089299+0000","last_clean":"2024-09-17T03:40:27.089299+0000","last_became_active":"2024-09-17T03:40:26.089624+0000","last_became_peered":"2024-09-17T03:40:26.089624+0000","last_unstale":"2024-09-17T03:40:27.089299+0000","last_undegraded":"2024-09-17T03:40:27.089299+0000","last_fullsized":"2024-09-17T03:40:27.089299+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:40.051808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.093642+0000","last_change":"2024-09-17T03:40:25.091182+0000","last_active":"2024-09-17T03:40:25.093642+0000","last_peered":"2024-09-17T03:40:25.093642+0000","last_clean":"2024-09-17T03:40:25.093642+0000","last_became_active":"2024-09-17T03:40:25.090160+0000","last_became_peered":"2024-09-17T03:40:25.090160+0000","last_unstale":"2024-09-17T03:40:25.093642+0000","last_undegraded":"2024-09-17T03:40:25.093642+0000","last_fullsized":"2024-09-17T03:40:25.093642+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:13.973203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076754+0000","last_change":"2024-09-17T03:40:25.076754+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076754+0000","last_undegraded":"2024-09-17T03:40:25.076754+0000","last_fullsized":"2024-09-17T03:40:25.076754+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.096039+0000","last_change":"2024-09-17T03:40:25.090872+0000","last_active":"2024-09-17T03:40:25.096039+0000","last_peered":"2024-09-17T03:40:25.096039+0000","last_clean":"2024-09-17T03:40:25.096039+0000","last_became_active":"2024-09-17T03:40:25.090576+0000","last_became_peered":"2024-09-17T03:40:25.090576+0000","last_unstale":"2024-09-17T03:40:25.096039+0000","last_undegraded":"2024-09-17T03:40:25.096039+0000","last_fullsized":"2024-09-17T03:40:25.096039+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:51.070669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074193+0000","last_change":"2024-09-17T03:40:25.074193+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074193+0000","last_undegraded":"2024-09-17T03:40:25.074193+0000","last_fullsized":"2024-09-17T03:40:25.074193+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.087312+0000","last_change":"2024-09-17T03:40:25.083953+0000","last_active":"2024-09-17T03:40:25.087312+0000","last_peered":"2024-09-17T03:40:25.087312+0000","last_clean":"2024-09-17T03:40:25.087312+0000","last_became_active":"2024-09-17T03:40:25.082074+0000","last_became_peered":"2024-09-17T03:40:25.082074+0000","last_unstale":"2024-09-17T03:40:25.087312+0000","last_undegraded":"2024-09-17T03:40:25.087312+0000","last_fullsized":"2024-09-17T03:40:25.087312+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:01.380358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077595+0000","last_change":"2024-09-17T03:40:25.077595+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077595+0000","last_undegraded":"2024-09-17T03:40:25.077595+0000","last_fullsized":"2024-09-17T03:40:25.077595+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.094249+0000","last_change":"2024-09-17T03:40:25.089863+0000","last_active":"2024-09-17T03:40:25.094249+0000","last_peered":"2024-09-17T03:40:25.094249+0000","last_clean":"2024-09-17T03:40:25.094249+0000","last_became_active":"2024-09-17T03:40:25.089511+0000","last_became_peered":"2024-09-17T03:40:25.089511+0000","last_unstale":"2024-09-17T03:40:25.094249+0000","last_undegraded":"2024-09-17T03:40:25.094249+0000","last_fullsized":"2024-09-17T03:40:25.094249+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:20.235409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.084823+0000","last_change":"2024-09-17T03:40:25.084823+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.084823+0000","last_undegraded":"2024-09-17T03:40:25.084823+0000","last_fullsized":"2024-09-17T03:40:25.084823+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.087137+0000","last_change":"2024-09-17T03:40:25.084751+0000","last_active":"2024-09-17T03:40:25.087137+0000","last_peered":"2024-09-17T03:40:25.087137+0000","last_clean":"2024-09-17T03:40:25.087137+0000","last_became_active":"2024-09-17T03:40:25.084419+0000","last_became_peered":"2024-09-17T03:40:25.084419+0000","last_unstale":"2024-09-17T03:40:25.087137+0000","last_undegraded":"2024-09-17T03:40:25.087137+0000","last_fullsized":"2024-09-17T03:40:25.087137+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:29.069882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.081481+0000","last_change":"2024-09-17T03:40:25.081481+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.081481+0000","last_undegraded":"2024-09-17T03:40:25.081481+0000","last_fullsized":"2024-09-17T03:40:25.081481+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089602+0000","last_change":"2024-09-17T03:40:25.080989+0000","last_active":"2024-09-17T03:40:27.089602+0000","last_peered":"2024-09-17T03:40:27.089602+0000","last_clean":"2024-09-17T03:40:27.089602+0000","last_became_active":"2024-09-17T03:40:25.080667+0000","last_became_peered":"2024-09-17T03:40:25.080667+0000","last_unstale":"2024-09-17T03:40:27.089602+0000","last_undegraded":"2024-09-17T03:40:27.089602+0000","last_fullsized":"2024-09-17T03:40:27.089602+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:57.430299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.078377+0000","last_change":"2024-09-17T03:40:25.078377+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.078377+0000","last_undegraded":"2024-09-17T03:40:25.078377+0000","last_fullsized":"2024-09-17T03:40:25.078377+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.096978+0000","last_change":"2024-09-17T03:40:25.095537+0000","last_active":"2024-09-17T03:40:25.096978+0000","last_peered":"2024-09-17T03:40:25.096978+0000","last_clean":"2024-09-17T03:40:25.096978+0000","last_became_active":"2024-09-17T03:40:25.094852+0000","last_became_peered":"2024-09-17T03:40:25.094852+0000","last_unstale":"2024-09-17T03:40:25.096978+0000","last_undegraded":"2024-09-17T03:40:25.096978+0000","last_fullsized":"2024-09-17T03:40:25.096978+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:46.222840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.072168+0000","last_change":"2024-09-17T03:40:25.072168+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.072168+0000","last_undegraded":"2024-09-17T03:40:25.072168+0000","last_fullsized":"2024-09-17T03:40:25.072168+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089045+0000","last_change":"2024-09-17T03:40:25.076755+0000","last_active":"2024-09-17T03:40:27.089045+0000","last_peered":"2024-09-17T03:40:27.089045+0000","last_clean":"2024-09-17T03:40:27.089045+0000","last_became_active":"2024-09-17T03:40:25.076451+0000","last_became_peered":"2024-09-17T03:40:25.076451+0000","last_unstale":"2024-09-17T03:40:27.089045+0000","last_undegraded":"2024-09-17T03:40:27.089045+0000","last_fullsized":"2024-09-17T03:40:27.089045+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:05.715292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.073870+0000","last_change":"2024-09-17T03:40:25.073870+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.073870+0000","last_undegraded":"2024-09-17T03:40:25.073870+0000","last_fullsized":"2024-09-17T03:40:25.073870+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.093965+0000","last_change":"2024-09-17T03:40:25.089035+0000","last_active":"2024-09-17T03:40:25.093965+0000","last_peered":"2024-09-17T03:40:25.093965+0000","last_clean":"2024-09-17T03:40:25.093965+0000","last_became_active":"2024-09-17T03:40:25.088719+0000","last_became_peered":"2024-09-17T03:40:25.088719+0000","last_unstale":"2024-09-17T03:40:25.093965+0000","last_undegraded":"2024-09-17T03:40:25.093965+0000","last_fullsized":"2024-09-17T03:40:25.093965+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:40.837867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074241+0000","last_change":"2024-09-17T03:40:25.074241+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074241+0000","last_undegraded":"2024-09-17T03:40:25.074241+0000","last_fullsized":"2024-09-17T03:40:25.074241+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.096861+0000","last_change":"2024-09-17T03:40:25.095020+0000","last_active":"2024-09-17T03:40:25.096861+0000","last_peered":"2024-09-17T03:40:25.096861+0000","last_clean":"2024-09-17T03:40:25.096861+0000","last_became_active":"2024-09-17T03:40:25.094243+0000","last_became_peered":"2024-09-17T03:40:25.094243+0000","last_unstale":"2024-09-17T03:40:25.096861+0000","last_undegraded":"2024-09-17T03:40:25.096861+0000","last_fullsized":"2024-09-17T03:40:25.096861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:50.272756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076822+0000","last_change":"2024-09-17T03:40:25.076822+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076822+0000","last_undegraded":"2024-09-17T03:40:25.076822+0000","last_fullsized":"2024-09-17T03:40:25.076822+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098686+0000","last_change":"2024-09-17T03:40:25.093528+0000","last_active":"2024-09-17T03:40:25.098686+0000","last_peered":"2024-09-17T03:40:25.098686+0000","last_clean":"2024-09-17T03:40:25.098686+0000","last_became_active":"2024-09-17T03:40:25.092930+0000","last_became_peered":"2024-09-17T03:40:25.092930+0000","last_unstale":"2024-09-17T03:40:25.098686+0000","last_undegraded":"2024-09-17T03:40:25.098686+0000","last_fullsized":"2024-09-17T03:40:25.098686+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:03.167813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.081162+0000","last_change":"2024-09-17T03:40:25.081162+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.081162+0000","last_undegraded":"2024-09-17T03:40:25.081162+0000","last_fullsized":"2024-09-17T03:40:25.081162+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.099021+0000","last_change":"2024-09-17T03:40:25.094560+0000","last_active":"2024-09-17T03:40:25.099021+0000","last_peered":"2024-09-17T03:40:25.099021+0000","last_clean":"2024-09-17T03:40:25.099021+0000","last_became_active":"2024-09-17T03:40:25.094224+0000","last_became_peered":"2024-09-17T03:40:25.094224+0000","last_unstale":"2024-09-17T03:40:25.099021+0000","last_undegraded":"2024-09-17T03:40:25.099021+0000","last_fullsized":"2024-09-17T03:40:25.099021+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:57.400273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074188+0000","last_change":"2024-09-17T03:40:25.074188+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074188+0000","last_undegraded":"2024-09-17T03:40:25.074188+0000","last_fullsized":"2024-09-17T03:40:25.074188+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.085440+0000","last_change":"2024-09-17T03:40:25.081602+0000","last_active":"2024-09-17T03:40:25.085440+0000","last_peered":"2024-09-17T03:40:25.085440+0000","last_clean":"2024-09-17T03:40:25.085440+0000","last_became_active":"2024-09-17T03:40:25.081289+0000","last_became_peered":"2024-09-17T03:40:25.081289+0000","last_unstale":"2024-09-17T03:40:25.085440+0000","last_undegraded":"2024-09-17T03:40:25.085440+0000","last_fullsized":"2024-09-17T03:40:25.085440+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:58.332554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.070719+0000","last_change":"2024-09-17T03:40:25.070719+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.070719+0000","last_undegraded":"2024-09-17T03:40:25.070719+0000","last_fullsized":"2024-09-17T03:40:25.070719+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.088865+0000","last_change":"2024-09-17T03:40:25.085590+0000","last_active":"2024-09-17T03:40:25.088865+0000","last_peered":"2024-09-17T03:40:25.088865+0000","last_clean":"2024-09-17T03:40:25.088865+0000","last_became_active":"2024-09-17T03:40:25.085288+0000","last_became_peered":"2024-09-17T03:40:25.085288+0000","last_unstale":"2024-09-17T03:40:25.088865+0000","last_undegraded":"2024-09-17T03:40:25.088865+0000","last_fullsized":"2024-09-17T03:40:25.088865+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:47.222952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077408+0000","last_change":"2024-09-17T03:40:25.077408+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077408+0000","last_undegraded":"2024-09-17T03:40:25.077408+0000","last_fullsized":"2024-09-17T03:40:25.077408+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.094983+0000","last_change":"2024-09-17T03:40:25.092780+0000","last_active":"2024-09-17T03:40:25.094983+0000","last_peered":"2024-09-17T03:40:25.094983+0000","last_clean":"2024-09-17T03:40:25.094983+0000","last_became_active":"2024-09-17T03:40:25.092232+0000","last_became_peered":"2024-09-17T03:40:25.092232+0000","last_unstale":"2024-09-17T03:40:25.094983+0000","last_undegraded":"2024-09-17T03:40:25.094983+0000","last_fullsized":"2024-09-17T03:40:25.094983+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:53.864055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.075886+0000","last_change":"2024-09-17T03:40:25.075886+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.075886+0000","last_undegraded":"2024-09-17T03:40:25.075886+0000","last_fullsized":"2024-09-17T03:40:25.075886+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098475+0000","last_change":"2024-09-17T03:40:25.090999+0000","last_active":"2024-09-17T03:40:25.098475+0000","last_peered":"2024-09-17T03:40:25.098475+0000","last_clean":"2024-09-17T03:40:25.098475+0000","last_became_active":"2024-09-17T03:40:25.090560+0000","last_became_peered":"2024-09-17T03:40:25.090560+0000","last_unstale":"2024-09-17T03:40:25.098475+0000","last_undegraded":"2024-09-17T03:40:25.098475+0000","last_fullsized":"2024-09-17T03:40:25.098475+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:43.326888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.072492+0000","last_change":"2024-09-17T03:40:25.072492+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.072492+0000","last_undegraded":"2024-09-17T03:40:25.072492+0000","last_fullsized":"2024-09-17T03:40:25.072492+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.090551+0000","last_change":"2024-09-17T03:40:25.088715+0000","last_active":"2024-09-17T03:40:25.090551+0000","last_peered":"2024-09-17T03:40:25.090551+0000","last_clean":"2024-09-17T03:40:25.090551+0000","last_became_active":"2024-09-17T03:40:25.088075+0000","last_became_peered":"2024-09-17T03:40:25.088075+0000","last_unstale":"2024-09-17T03:40:25.090551+0000","last_undegraded":"2024-09-17T03:40:25.090551+0000","last_fullsized":"2024-09-17T03:40:25.090551+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:49.981785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077447+0000","last_change":"2024-09-17T03:40:25.077447+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077447+0000","last_undegraded":"2024-09-17T03:40:25.077447+0000","last_fullsized":"2024-09-17T03:40:25.077447+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098636+0000","last_change":"2024-09-17T03:40:25.092408+0000","last_active":"2024-09-17T03:40:25.098636+0000","last_peered":"2024-09-17T03:40:25.098636+0000","last_clean":"2024-09-17T03:40:25.098636+0000","last_became_active":"2024-09-17T03:40:25.092023+0000","last_became_peered":"2024-09-17T03:40:25.092023+0000","last_unstale":"2024-09-17T03:40:25.098636+0000","last_undegraded":"2024-09-17T03:40:25.098636+0000","last_fullsized":"2024-09-17T03:40:25.098636+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:43.388149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074639+0000","last_change":"2024-09-17T03:40:25.074639+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074639+0000","last_undegraded":"2024-09-17T03:40:25.074639+0000","last_fullsized":"2024-09-17T03:40:25.074639+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.094847+0000","last_change":"2024-09-17T03:40:25.088614+0000","last_active":"2024-09-17T03:40:25.094847+0000","last_peered":"2024-09-17T03:40:25.094847+0000","last_clean":"2024-09-17T03:40:25.094847+0000","last_became_active":"2024-09-17T03:40:25.088063+0000","last_became_peered":"2024-09-17T03:40:25.088063+0000","last_unstale":"2024-09-17T03:40:25.094847+0000","last_undegraded":"2024-09-17T03:40:25.094847+0000","last_fullsized":"2024-09-17T03:40:25.094847+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.083148+0000","last_change":"2024-09-17T03:40:25.083148+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.083148+0000","last_undegraded":"2024-09-17T03:40:25.083148+0000","last_fullsized":"2024-09-17T03:40:25.083148+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.093464+0000","last_change":"2024-09-17T03:40:25.090603+0000","last_active":"2024-09-17T03:40:25.093464+0000","last_peered":"2024-09-17T03:40:25.093464+0000","last_clean":"2024-09-17T03:40:25.093464+0000","last_became_active":"2024-09-17T03:40:25.089547+0000","last_became_peered":"2024-09-17T03:40:25.089547+0000","last_unstale":"2024-09-17T03:40:25.093464+0000","last_undegraded":"2024-09-17T03:40:25.093464+0000","last_fullsized":"2024-09-17T03:40:25.093464+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:17.152862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.070611+0000","last_change":"2024-09-17T03:40:25.070611+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.070611+0000","last_undegraded":"2024-09-17T03:40:25.070611+0000","last_fullsized":"2024-09-17T03:40:25.070611+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098807+0000","last_change":"2024-09-17T03:40:25.094592+0000","last_active":"2024-09-17T03:40:25.098807+0000","last_peered":"2024-09-17T03:40:25.098807+0000","last_clean":"2024-09-17T03:40:25.098807+0000","last_became_active":"2024-09-17T03:40:25.094042+0000","last_became_peered":"2024-09-17T03:40:25.094042+0000","last_unstale":"2024-09-17T03:40:25.098807+0000","last_undegraded":"2024-09-17T03:40:25.098807+0000","last_fullsized":"2024-09-17T03:40:25.098807+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:06.042560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.078952+0000","last_change":"2024-09-17T03:40:25.078952+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.078952+0000","last_undegraded":"2024-09-17T03:40:25.078952+0000","last_fullsized":"2024-09-17T03:40:25.078952+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098726+0000","last_change":"2024-09-17T03:40:25.091754+0000","last_active":"2024-09-17T03:40:25.098726+0000","last_peered":"2024-09-17T03:40:25.098726+0000","last_clean":"2024-09-17T03:40:25.098726+0000","last_became_active":"2024-09-17T03:40:25.091404+0000","last_became_peered":"2024-09-17T03:40:25.091404+0000","last_unstale":"2024-09-17T03:40:25.098726+0000","last_undegraded":"2024-09-17T03:40:25.098726+0000","last_fullsized":"2024-09-17T03:40:25.098726+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:35.973990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.082740+0000","last_change":"2024-09-17T03:40:25.082740+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.082740+0000","last_undegraded":"2024-09-17T03:40:25.082740+0000","last_fullsized":"2024-09-17T03:40:25.082740+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.097118+0000","last_change":"2024-09-17T03:40:25.094752+0000","last_active":"2024-09-17T03:40:25.097118+0000","last_peered":"2024-09-17T03:40:25.097118+0000","last_clean":"2024-09-17T03:40:25.097118+0000","last_became_active":"2024-09-17T03:40:25.094409+0000","last_became_peered":"2024-09-17T03:40:25.094409+0000","last_unstale":"2024-09-17T03:40:25.097118+0000","last_undegraded":"2024-09-17T03:40:25.097118+0000","last_fullsized":"2024-09-17T03:40:25.097118+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:00.284210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089551+0000","last_change":"2024-09-17T03:40:26.081960+0000","last_active":"2024-09-17T03:40:27.089551+0000","last_peered":"2024-09-17T03:40:27.089551+0000","last_clean":"2024-09-17T03:40:27.089551+0000","last_became_active":"2024-09-17T03:40:26.081649+0000","last_became_peered":"2024-09-17T03:40:26.081649+0000","last_unstale":"2024-09-17T03:40:27.089551+0000","last_undegraded":"2024-09-17T03:40:27.089551+0000","last_fullsized":"2024-09-17T03:40:27.089551+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.491879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.091211+0000","last_change":"2024-09-17T03:40:25.082332+0000","last_active":"2024-09-17T03:40:25.091211+0000","last_peered":"2024-09-17T03:40:25.091211+0000","last_clean":"2024-09-17T03:40:25.091211+0000","last_became_active":"2024-09-17T03:40:25.082030+0000","last_became_peered":"2024-09-17T03:40:25.082030+0000","last_unstale":"2024-09-17T03:40:25.091211+0000","last_undegraded":"2024-09-17T03:40:25.091211+0000","last_fullsized":"2024-09-17T03:40:25.091211+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:39.411672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.083346+0000","last_change":"2024-09-17T03:40:25.083346+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.083346+0000","last_undegraded":"2024-09-17T03:40:25.083346+0000","last_fullsized":"2024-09-17T03:40:25.083346+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"109'8","reported_seq":23,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088699+0000","last_change":"2024-09-17T03:40:25.084933+0000","last_active":"2024-09-17T03:40:27.088699+0000","last_peered":"2024-09-17T03:40:27.088699+0000","last_clean":"2024-09-17T03:40:27.088699+0000","last_became_active":"2024-09-17T03:40:25.084571+0000","last_became_peered":"2024-09-17T03:40:25.084571+0000","last_unstale":"2024-09-17T03:40:27.088699+0000","last_undegraded":"2024-09-17T03:40:27.088699+0000","last_fullsized":"2024-09-17T03:40:27.088699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:55.687864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":272,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.075155+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:40:25.075155+0000","last_peered":"2024-09-17T03:40:25.075155+0000","last_clean":"2024-09-17T03:40:25.075155+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:40:25.075155+0000","last_undegraded":"2024-09-17T03:40:25.075155+0000","last_fullsized":"2024-09-17T03:40:25.075155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1327104,"data_stored":606573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1327104,"data_stored":606573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1921024,"data_stored":1196941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1339392,"data_stored":613240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1339392,"data_stored":613240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1921024,"data_stored":1196941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1339392,"data_stored":613240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1372160,"data_stored":627155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:30.498 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:30.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.756+0000 7f8fa6200640 1 -- 172.21.15.121:0/1505921149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa00742a0 msgr2=0x7f8fa00b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.756+0000 7f8fa6200640 1 --2- 172.21.15.121:0/1505921149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa00742a0 0x7f8fa00b4480 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8f98005fd0 tx=0x7f8f9802a7c0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.756+0000 7f8fa6200640 1 -- 172.21.15.121:0/1505921149 shutdown_connections 2024-09-17T03:40:30.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.756+0000 7f8fa6200640 1 --2- 172.21.15.121:0/1505921149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa00742a0 0x7f8fa00b4480 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.756+0000 7f8fa6200640 1 -- 172.21.15.121:0/1505921149 >> 172.21.15.121:0/1505921149 conn(0x7f8fa00b2440 msgr2=0x7f8fa00d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:30.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.756+0000 7f8fa6200640 1 -- 172.21.15.121:0/1505921149 shutdown_connections 2024-09-17T03:40:30.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.756+0000 7f8fa6200640 1 -- 172.21.15.121:0/1505921149 wait complete. 2024-09-17T03:40:30.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.759+0000 7f8fa6200640 1 Processor -- start 2024-09-17T03:40:30.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.759+0000 7f8fa6200640 1 -- start start 2024-09-17T03:40:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8fa6200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fa00742a0 0x7f8fa00cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8fa6200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa0159170 0x7f8fa00c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8fa6200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa00cbbf0 0x7f8fa00ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8fa6200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01667d0 con 0x7f8fa0159170 2024-09-17T03:40:30.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8fa6200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa0166650 con 0x7f8fa00cbbf0 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8fa6200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa0166950 con 0x7f8fa00742a0 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8f9fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa0159170 0x7f8fa00c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8f9fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa0159170 0x7f8fa00c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34344/0 (socket says 172.21.15.121:34344) 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8f9fe00640 1 -- 172.21.15.121:0/3128513682 learned_addr learned my addr 172.21.15.121:0/3128513682 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8fa5800640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa00cbbf0 0x7f8fa00ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.761+0000 7f8fa4e00640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fa00742a0 0x7f8fa00cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8f9fe00640 1 -- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fa00742a0 msgr2=0x7f8fa00cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8f9fe00640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fa00742a0 0x7f8fa00cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8f9fe00640 1 -- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa00cbbf0 msgr2=0x7f8fa00ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8f9fe00640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa00cbbf0 0x7f8fa00ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8f9fe00640 1 -- 172.21.15.121:0/3128513682 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa0158000 con 0x7f8fa0159170 2024-09-17T03:40:30.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8fa5800640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa00cbbf0 0x7f8fa00ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:30.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8f9fe00640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa0159170 0x7f8fa00c9d80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c400 tx=0x7f8f8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:30.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8f9cc00640 1 -- 172.21.15.121:0/3128513682 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c017070 con 0x7f8fa0159170 2024-09-17T03:40:30.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8f9cc00640 1 -- 172.21.15.121:0/3128513682 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f8c0053c0 con 0x7f8fa0159170 2024-09-17T03:40:30.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8fa6200640 1 -- 172.21.15.121:0/3128513682 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa00b0010 con 0x7f8fa0159170 2024-09-17T03:40:30.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8f9cc00640 1 -- 172.21.15.121:0/3128513682 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c003850 con 0x7f8fa0159170 2024-09-17T03:40:30.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.762+0000 7f8fa6200640 1 -- 172.21.15.121:0/3128513682 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa015d580 con 0x7f8fa0159170 2024-09-17T03:40:30.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.764+0000 7f8fa6200640 1 -- 172.21.15.121:0/3128513682 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa006def0 con 0x7f8fa0159170 2024-09-17T03:40:30.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.765+0000 7f8f9cc00640 1 -- 172.21.15.121:0/3128513682 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f8c01a070 con 0x7f8fa0159170 2024-09-17T03:40:30.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.766+0000 7f8f9cc00640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f80078b90 0x7f8f8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:30.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.766+0000 7f8f9cc00640 1 -- 172.21.15.121:0/3128513682 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f8f8c09a2e0 con 0x7f8fa0159170 2024-09-17T03:40:30.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.766+0000 7f8fa4e00640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f80078b90 0x7f8f8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:30.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.768+0000 7f8fa4e00640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f80078b90 0x7f8f8007b0a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8f94001220 tx=0x7f8f94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:30.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.771+0000 7f8f9cc00640 1 -- 172.21.15.121:0/3128513682 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f8c0625a0 con 0x7f8fa0159170 2024-09-17T03:40:30.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.950+0000 7f8fa6200640 1 -- 172.21.15.121:0/3128513682 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fa0158260 con 0x7f8f80078b90 2024-09-17T03:40:30.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.955+0000 7f8f9cc00640 1 -- 172.21.15.121:0/3128513682 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247627 (secure 0 0 0) 0x7f8fa0158260 con 0x7f8f80078b90 2024-09-17T03:40:30.958 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:30.959 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 -- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f80078b90 msgr2=0x7f8f8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f80078b90 0x7f8f8007b0a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8f94001220 tx=0x7f8f94009040 comp rx=0 tx=0).stop 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 -- 172.21.15.121:0/3128513682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa0159170 msgr2=0x7f8fa00c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa0159170 0x7f8fa00c9d80 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c400 tx=0x7f8f8c00c8c0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 -- 172.21.15.121:0/3128513682 shutdown_connections 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa00cbbf0 0x7f8fa00ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8f80078b90 0x7f8f8007b0a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa0159170 0x7f8fa00c9d80 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 --2- 172.21.15.121:0/3128513682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fa00742a0 0x7f8fa00cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 -- 172.21.15.121:0/3128513682 >> 172.21.15.121:0/3128513682 conn(0x7f8fa00b2440 msgr2=0x7f8fa0142390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:30.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 -- 172.21.15.121:0/3128513682 shutdown_connections 2024-09-17T03:40:30.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:30.959+0000 7f8fa6200640 1 -- 172.21.15.121:0/3128513682 wait complete. 2024-09-17T03:40:30.981 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-09-17T03:40:29.354511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261148,"kb_used_data":11608,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713572,"statfs":{"total":773094113280,"available":772826697728,"internally_reserved":0,"allocated":11886592,"data_stored":6073903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.297496"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074923+0000","last_change":"2024-09-17T03:40:25.074923+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074923+0000","last_undegraded":"2024-09-17T03:40:25.074923+0000","last_fullsized":"2024-09-17T03:40:25.074923+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076336+0000","last_change":"2024-09-17T03:40:25.076336+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076336+0000","last_undegraded":"2024-09-17T03:40:25.076336+0000","last_fullsized":"2024-09-17T03:40:25.076336+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.078223+0000","last_change":"2024-09-17T03:40:25.078223+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.078223+0000","last_undegraded":"2024-09-17T03:40:25.078223+0000","last_fullsized":"2024-09-17T03:40:25.078223+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076385+0000","last_change":"2024-09-17T03:40:25.076385+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076385+0000","last_undegraded":"2024-09-17T03:40:25.076385+0000","last_fullsized":"2024-09-17T03:40:25.076385+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.086200+0000","last_change":"2024-09-17T03:40:25.086200+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.086200+0000","last_undegraded":"2024-09-17T03:40:25.086200+0000","last_fullsized":"2024-09-17T03:40:25.086200+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074786+0000","last_change":"2024-09-17T03:40:25.074786+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074786+0000","last_undegraded":"2024-09-17T03:40:25.074786+0000","last_fullsized":"2024-09-17T03:40:25.074786+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.079481+0000","last_change":"2024-09-17T03:40:25.079481+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.079481+0000","last_undegraded":"2024-09-17T03:40:25.079481+0000","last_fullsized":"2024-09-17T03:40:25.079481+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088282+0000","last_change":"2024-09-17T03:40:26.082958+0000","last_active":"2024-09-17T03:40:27.088282+0000","last_peered":"2024-09-17T03:40:27.088282+0000","last_clean":"2024-09-17T03:40:27.088282+0000","last_became_active":"2024-09-17T03:40:26.082410+0000","last_became_peered":"2024-09-17T03:40:26.082410+0000","last_unstale":"2024-09-17T03:40:27.088282+0000","last_undegraded":"2024-09-17T03:40:27.088282+0000","last_fullsized":"2024-09-17T03:40:27.088282+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:01.976092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076649+0000","last_change":"2024-09-17T03:40:25.076649+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076649+0000","last_undegraded":"2024-09-17T03:40:25.076649+0000","last_fullsized":"2024-09-17T03:40:25.076649+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077289+0000","last_change":"2024-09-17T03:40:25.077289+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077289+0000","last_undegraded":"2024-09-17T03:40:25.077289+0000","last_fullsized":"2024-09-17T03:40:25.077289+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077137+0000","last_change":"2024-09-17T03:40:25.077137+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077137+0000","last_undegraded":"2024-09-17T03:40:25.077137+0000","last_fullsized":"2024-09-17T03:40:25.077137+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074438+0000","last_change":"2024-09-17T03:40:25.074438+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074438+0000","last_undegraded":"2024-09-17T03:40:25.074438+0000","last_fullsized":"2024-09-17T03:40:25.074438+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074973+0000","last_change":"2024-09-17T03:40:25.074973+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074973+0000","last_undegraded":"2024-09-17T03:40:25.074973+0000","last_fullsized":"2024-09-17T03:40:25.074973+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.072736+0000","last_change":"2024-09-17T03:40:25.072736+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.072736+0000","last_undegraded":"2024-09-17T03:40:25.072736+0000","last_fullsized":"2024-09-17T03:40:25.072736+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.080542+0000","last_change":"2024-09-17T03:40:25.080542+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.080542+0000","last_undegraded":"2024-09-17T03:40:25.080542+0000","last_fullsized":"2024-09-17T03:40:25.080542+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.071241+0000","last_change":"2024-09-17T03:40:25.071241+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.071241+0000","last_undegraded":"2024-09-17T03:40:25.071241+0000","last_fullsized":"2024-09-17T03:40:25.071241+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.072397+0000","last_change":"2024-09-17T03:40:25.072397+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.072397+0000","last_undegraded":"2024-09-17T03:40:25.072397+0000","last_fullsized":"2024-09-17T03:40:25.072397+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074917+0000","last_change":"2024-09-17T03:40:25.074917+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074917+0000","last_undegraded":"2024-09-17T03:40:25.074917+0000","last_fullsized":"2024-09-17T03:40:25.074917+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.087669+0000","last_change":"2024-09-17T03:40:25.087669+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.087669+0000","last_undegraded":"2024-09-17T03:40:25.087669+0000","last_fullsized":"2024-09-17T03:40:25.087669+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.075471+0000","last_change":"2024-09-17T03:40:25.075471+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.075471+0000","last_undegraded":"2024-09-17T03:40:25.075471+0000","last_fullsized":"2024-09-17T03:40:25.075471+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.085725+0000","last_change":"2024-09-17T03:40:25.085725+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.085725+0000","last_undegraded":"2024-09-17T03:40:25.085725+0000","last_fullsized":"2024-09-17T03:40:25.085725+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.079266+0000","last_change":"2024-09-17T03:40:25.079266+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.079266+0000","last_undegraded":"2024-09-17T03:40:25.079266+0000","last_fullsized":"2024-09-17T03:40:25.079266+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.080075+0000","last_change":"2024-09-17T03:40:25.080075+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.080075+0000","last_undegraded":"2024-09-17T03:40:25.080075+0000","last_fullsized":"2024-09-17T03:40:25.080075+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.075520+0000","last_change":"2024-09-17T03:40:25.075520+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.075520+0000","last_undegraded":"2024-09-17T03:40:25.075520+0000","last_fullsized":"2024-09-17T03:40:25.075520+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074372+0000","last_change":"2024-09-17T03:40:25.074372+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074372+0000","last_undegraded":"2024-09-17T03:40:25.074372+0000","last_fullsized":"2024-09-17T03:40:25.074372+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090544+0000","last_change":"2024-09-17T03:40:26.098599+0000","last_active":"2024-09-17T03:40:27.090544+0000","last_peered":"2024-09-17T03:40:27.090544+0000","last_clean":"2024-09-17T03:40:27.090544+0000","last_became_active":"2024-09-17T03:40:26.098250+0000","last_became_peered":"2024-09-17T03:40:26.098250+0000","last_unstale":"2024-09-17T03:40:27.090544+0000","last_undegraded":"2024-09-17T03:40:27.090544+0000","last_fullsized":"2024-09-17T03:40:27.090544+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:31.185943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.087224+0000","last_change":"2024-09-17T03:40:25.087224+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.087224+0000","last_undegraded":"2024-09-17T03:40:25.087224+0000","last_fullsized":"2024-09-17T03:40:25.087224+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.072947+0000","last_change":"2024-09-17T03:40:25.072947+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.072947+0000","last_undegraded":"2024-09-17T03:40:25.072947+0000","last_fullsized":"2024-09-17T03:40:25.072947+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.081175+0000","last_change":"2024-09-17T03:40:25.081175+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.081175+0000","last_undegraded":"2024-09-17T03:40:25.081175+0000","last_fullsized":"2024-09-17T03:40:25.081175+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.078513+0000","last_change":"2024-09-17T03:40:25.078513+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.078513+0000","last_undegraded":"2024-09-17T03:40:25.078513+0000","last_fullsized":"2024-09-17T03:40:25.078513+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077656+0000","last_change":"2024-09-17T03:40:25.077656+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077656+0000","last_undegraded":"2024-09-17T03:40:25.077656+0000","last_fullsized":"2024-09-17T03:40:25.077656+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076294+0000","last_change":"2024-09-17T03:40:25.076294+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076294+0000","last_undegraded":"2024-09-17T03:40:25.076294+0000","last_fullsized":"2024-09-17T03:40:25.076294+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090750+0000","last_change":"2024-09-17T03:40:26.094424+0000","last_active":"2024-09-17T03:40:27.090750+0000","last_peered":"2024-09-17T03:40:27.090750+0000","last_clean":"2024-09-17T03:40:27.090750+0000","last_became_active":"2024-09-17T03:40:26.094061+0000","last_became_peered":"2024-09-17T03:40:26.094061+0000","last_unstale":"2024-09-17T03:40:27.090750+0000","last_undegraded":"2024-09-17T03:40:27.090750+0000","last_fullsized":"2024-09-17T03:40:27.090750+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:56.894039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.093383+0000","last_change":"2024-09-17T03:40:25.086790+0000","last_active":"2024-09-17T03:40:25.093383+0000","last_peered":"2024-09-17T03:40:25.093383+0000","last_clean":"2024-09-17T03:40:25.093383+0000","last_became_active":"2024-09-17T03:40:25.086123+0000","last_became_peered":"2024-09-17T03:40:25.086123+0000","last_unstale":"2024-09-17T03:40:25.093383+0000","last_undegraded":"2024-09-17T03:40:25.093383+0000","last_fullsized":"2024-09-17T03:40:25.093383+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:22.987400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.075799+0000","last_change":"2024-09-17T03:40:25.075799+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.075799+0000","last_undegraded":"2024-09-17T03:40:25.075799+0000","last_fullsized":"2024-09-17T03:40:25.075799+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.093813+0000","last_change":"2024-09-17T03:40:25.091077+0000","last_active":"2024-09-17T03:40:25.093813+0000","last_peered":"2024-09-17T03:40:25.093813+0000","last_clean":"2024-09-17T03:40:25.093813+0000","last_became_active":"2024-09-17T03:40:25.090715+0000","last_became_peered":"2024-09-17T03:40:25.090715+0000","last_unstale":"2024-09-17T03:40:25.093813+0000","last_undegraded":"2024-09-17T03:40:25.093813+0000","last_fullsized":"2024-09-17T03:40:25.093813+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:39.487655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074472+0000","last_change":"2024-09-17T03:40:25.074472+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074472+0000","last_undegraded":"2024-09-17T03:40:25.074472+0000","last_fullsized":"2024-09-17T03:40:25.074472+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.096091+0000","last_change":"2024-09-17T03:40:25.091127+0000","last_active":"2024-09-17T03:40:25.096091+0000","last_peered":"2024-09-17T03:40:25.096091+0000","last_clean":"2024-09-17T03:40:25.096091+0000","last_became_active":"2024-09-17T03:40:25.090828+0000","last_became_peered":"2024-09-17T03:40:25.090828+0000","last_unstale":"2024-09-17T03:40:25.096091+0000","last_undegraded":"2024-09-17T03:40:25.096091+0000","last_fullsized":"2024-09-17T03:40:25.096091+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:59.194206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076197+0000","last_change":"2024-09-17T03:40:25.076197+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076197+0000","last_undegraded":"2024-09-17T03:40:25.076197+0000","last_fullsized":"2024-09-17T03:40:25.076197+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.090589+0000","last_change":"2024-09-17T03:40:25.088001+0000","last_active":"2024-09-17T03:40:25.090589+0000","last_peered":"2024-09-17T03:40:25.090589+0000","last_clean":"2024-09-17T03:40:25.090589+0000","last_became_active":"2024-09-17T03:40:25.087631+0000","last_became_peered":"2024-09-17T03:40:25.087631+0000","last_unstale":"2024-09-17T03:40:25.090589+0000","last_undegraded":"2024-09-17T03:40:25.090589+0000","last_fullsized":"2024-09-17T03:40:25.090589+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:20.935254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088541+0000","last_change":"2024-09-17T03:40:26.102071+0000","last_active":"2024-09-17T03:40:27.088541+0000","last_peered":"2024-09-17T03:40:27.088541+0000","last_clean":"2024-09-17T03:40:27.088541+0000","last_became_active":"2024-09-17T03:40:26.101645+0000","last_became_peered":"2024-09-17T03:40:26.101645+0000","last_unstale":"2024-09-17T03:40:27.088541+0000","last_undegraded":"2024-09-17T03:40:27.088541+0000","last_fullsized":"2024-09-17T03:40:27.088541+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:39.422894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098413+0000","last_change":"2024-09-17T03:40:25.092407+0000","last_active":"2024-09-17T03:40:25.098413+0000","last_peered":"2024-09-17T03:40:25.098413+0000","last_clean":"2024-09-17T03:40:25.098413+0000","last_became_active":"2024-09-17T03:40:25.092121+0000","last_became_peered":"2024-09-17T03:40:25.092121+0000","last_unstale":"2024-09-17T03:40:25.098413+0000","last_undegraded":"2024-09-17T03:40:25.098413+0000","last_fullsized":"2024-09-17T03:40:25.098413+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:47.006934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.075461+0000","last_change":"2024-09-17T03:40:25.075461+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.075461+0000","last_undegraded":"2024-09-17T03:40:25.075461+0000","last_fullsized":"2024-09-17T03:40:25.075461+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089451+0000","last_change":"2024-09-17T03:40:25.082851+0000","last_active":"2024-09-17T03:40:27.089451+0000","last_peered":"2024-09-17T03:40:27.089451+0000","last_clean":"2024-09-17T03:40:27.089451+0000","last_became_active":"2024-09-17T03:40:25.082524+0000","last_became_peered":"2024-09-17T03:40:25.082524+0000","last_unstale":"2024-09-17T03:40:27.089451+0000","last_undegraded":"2024-09-17T03:40:27.089451+0000","last_fullsized":"2024-09-17T03:40:27.089451+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:09.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.078011+0000","last_change":"2024-09-17T03:40:25.078011+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.078011+0000","last_undegraded":"2024-09-17T03:40:25.078011+0000","last_fullsized":"2024-09-17T03:40:25.078011+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.089024+0000","last_change":"2024-09-17T03:40:25.085262+0000","last_active":"2024-09-17T03:40:25.089024+0000","last_peered":"2024-09-17T03:40:25.089024+0000","last_clean":"2024-09-17T03:40:25.089024+0000","last_became_active":"2024-09-17T03:40:25.084924+0000","last_became_peered":"2024-09-17T03:40:25.084924+0000","last_unstale":"2024-09-17T03:40:25.089024+0000","last_undegraded":"2024-09-17T03:40:25.089024+0000","last_fullsized":"2024-09-17T03:40:25.089024+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:54.911525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089299+0000","last_change":"2024-09-17T03:40:26.091093+0000","last_active":"2024-09-17T03:40:27.089299+0000","last_peered":"2024-09-17T03:40:27.089299+0000","last_clean":"2024-09-17T03:40:27.089299+0000","last_became_active":"2024-09-17T03:40:26.089624+0000","last_became_peered":"2024-09-17T03:40:26.089624+0000","last_unstale":"2024-09-17T03:40:27.089299+0000","last_undegraded":"2024-09-17T03:40:27.089299+0000","last_fullsized":"2024-09-17T03:40:27.089299+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:40.051808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.093642+0000","last_change":"2024-09-17T03:40:25.091182+0000","last_active":"2024-09-17T03:40:25.093642+0000","last_peered":"2024-09-17T03:40:25.093642+0000","last_clean":"2024-09-17T03:40:25.093642+0000","last_became_active":"2024-09-17T03:40:25.090160+0000","last_became_peered":"2024-09-17T03:40:25.090160+0000","last_unstale":"2024-09-17T03:40:25.093642+0000","last_undegraded":"2024-09-17T03:40:25.093642+0000","last_fullsized":"2024-09-17T03:40:25.093642+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:13.973203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076754+0000","last_change":"2024-09-17T03:40:25.076754+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076754+0000","last_undegraded":"2024-09-17T03:40:25.076754+0000","last_fullsized":"2024-09-17T03:40:25.076754+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.096039+0000","last_change":"2024-09-17T03:40:25.090872+0000","last_active":"2024-09-17T03:40:25.096039+0000","last_peered":"2024-09-17T03:40:25.096039+0000","last_clean":"2024-09-17T03:40:25.096039+0000","last_became_active":"2024-09-17T03:40:25.090576+0000","last_became_peered":"2024-09-17T03:40:25.090576+0000","last_unstale":"2024-09-17T03:40:25.096039+0000","last_undegraded":"2024-09-17T03:40:25.096039+0000","last_fullsized":"2024-09-17T03:40:25.096039+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:51.070669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074193+0000","last_change":"2024-09-17T03:40:25.074193+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074193+0000","last_undegraded":"2024-09-17T03:40:25.074193+0000","last_fullsized":"2024-09-17T03:40:25.074193+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.087312+0000","last_change":"2024-09-17T03:40:25.083953+0000","last_active":"2024-09-17T03:40:25.087312+0000","last_peered":"2024-09-17T03:40:25.087312+0000","last_clean":"2024-09-17T03:40:25.087312+0000","last_became_active":"2024-09-17T03:40:25.082074+0000","last_became_peered":"2024-09-17T03:40:25.082074+0000","last_unstale":"2024-09-17T03:40:25.087312+0000","last_undegraded":"2024-09-17T03:40:25.087312+0000","last_fullsized":"2024-09-17T03:40:25.087312+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:01.380358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077595+0000","last_change":"2024-09-17T03:40:25.077595+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077595+0000","last_undegraded":"2024-09-17T03:40:25.077595+0000","last_fullsized":"2024-09-17T03:40:25.077595+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.094249+0000","last_change":"2024-09-17T03:40:25.089863+0000","last_active":"2024-09-17T03:40:25.094249+0000","last_peered":"2024-09-17T03:40:25.094249+0000","last_clean":"2024-09-17T03:40:25.094249+0000","last_became_active":"2024-09-17T03:40:25.089511+0000","last_became_peered":"2024-09-17T03:40:25.089511+0000","last_unstale":"2024-09-17T03:40:25.094249+0000","last_undegraded":"2024-09-17T03:40:25.094249+0000","last_fullsized":"2024-09-17T03:40:25.094249+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:20.235409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.084823+0000","last_change":"2024-09-17T03:40:25.084823+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.084823+0000","last_undegraded":"2024-09-17T03:40:25.084823+0000","last_fullsized":"2024-09-17T03:40:25.084823+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.087137+0000","last_change":"2024-09-17T03:40:25.084751+0000","last_active":"2024-09-17T03:40:25.087137+0000","last_peered":"2024-09-17T03:40:25.087137+0000","last_clean":"2024-09-17T03:40:25.087137+0000","last_became_active":"2024-09-17T03:40:25.084419+0000","last_became_peered":"2024-09-17T03:40:25.084419+0000","last_unstale":"2024-09-17T03:40:25.087137+0000","last_undegraded":"2024-09-17T03:40:25.087137+0000","last_fullsized":"2024-09-17T03:40:25.087137+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:29.069882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.081481+0000","last_change":"2024-09-17T03:40:25.081481+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.081481+0000","last_undegraded":"2024-09-17T03:40:25.081481+0000","last_fullsized":"2024-09-17T03:40:25.081481+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089602+0000","last_change":"2024-09-17T03:40:25.080989+0000","last_active":"2024-09-17T03:40:27.089602+0000","last_peered":"2024-09-17T03:40:27.089602+0000","last_clean":"2024-09-17T03:40:27.089602+0000","last_became_active":"2024-09-17T03:40:25.080667+0000","last_became_peered":"2024-09-17T03:40:25.080667+0000","last_unstale":"2024-09-17T03:40:27.089602+0000","last_undegraded":"2024-09-17T03:40:27.089602+0000","last_fullsized":"2024-09-17T03:40:27.089602+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:57.430299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.078377+0000","last_change":"2024-09-17T03:40:25.078377+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.078377+0000","last_undegraded":"2024-09-17T03:40:25.078377+0000","last_fullsized":"2024-09-17T03:40:25.078377+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.096978+0000","last_change":"2024-09-17T03:40:25.095537+0000","last_active":"2024-09-17T03:40:25.096978+0000","last_peered":"2024-09-17T03:40:25.096978+0000","last_clean":"2024-09-17T03:40:25.096978+0000","last_became_active":"2024-09-17T03:40:25.094852+0000","last_became_peered":"2024-09-17T03:40:25.094852+0000","last_unstale":"2024-09-17T03:40:25.096978+0000","last_undegraded":"2024-09-17T03:40:25.096978+0000","last_fullsized":"2024-09-17T03:40:25.096978+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:46.222840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.072168+0000","last_change":"2024-09-17T03:40:25.072168+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.072168+0000","last_undegraded":"2024-09-17T03:40:25.072168+0000","last_fullsized":"2024-09-17T03:40:25.072168+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089045+0000","last_change":"2024-09-17T03:40:25.076755+0000","last_active":"2024-09-17T03:40:27.089045+0000","last_peered":"2024-09-17T03:40:27.089045+0000","last_clean":"2024-09-17T03:40:27.089045+0000","last_became_active":"2024-09-17T03:40:25.076451+0000","last_became_peered":"2024-09-17T03:40:25.076451+0000","last_unstale":"2024-09-17T03:40:27.089045+0000","last_undegraded":"2024-09-17T03:40:27.089045+0000","last_fullsized":"2024-09-17T03:40:27.089045+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:05.715292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.073870+0000","last_change":"2024-09-17T03:40:25.073870+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.073870+0000","last_undegraded":"2024-09-17T03:40:25.073870+0000","last_fullsized":"2024-09-17T03:40:25.073870+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.093965+0000","last_change":"2024-09-17T03:40:25.089035+0000","last_active":"2024-09-17T03:40:25.093965+0000","last_peered":"2024-09-17T03:40:25.093965+0000","last_clean":"2024-09-17T03:40:25.093965+0000","last_became_active":"2024-09-17T03:40:25.088719+0000","last_became_peered":"2024-09-17T03:40:25.088719+0000","last_unstale":"2024-09-17T03:40:25.093965+0000","last_undegraded":"2024-09-17T03:40:25.093965+0000","last_fullsized":"2024-09-17T03:40:25.093965+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:40.837867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074241+0000","last_change":"2024-09-17T03:40:25.074241+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074241+0000","last_undegraded":"2024-09-17T03:40:25.074241+0000","last_fullsized":"2024-09-17T03:40:25.074241+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.096861+0000","last_change":"2024-09-17T03:40:25.095020+0000","last_active":"2024-09-17T03:40:25.096861+0000","last_peered":"2024-09-17T03:40:25.096861+0000","last_clean":"2024-09-17T03:40:25.096861+0000","last_became_active":"2024-09-17T03:40:25.094243+0000","last_became_peered":"2024-09-17T03:40:25.094243+0000","last_unstale":"2024-09-17T03:40:25.096861+0000","last_undegraded":"2024-09-17T03:40:25.096861+0000","last_fullsized":"2024-09-17T03:40:25.096861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:50.272756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.076822+0000","last_change":"2024-09-17T03:40:25.076822+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.076822+0000","last_undegraded":"2024-09-17T03:40:25.076822+0000","last_fullsized":"2024-09-17T03:40:25.076822+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098686+0000","last_change":"2024-09-17T03:40:25.093528+0000","last_active":"2024-09-17T03:40:25.098686+0000","last_peered":"2024-09-17T03:40:25.098686+0000","last_clean":"2024-09-17T03:40:25.098686+0000","last_became_active":"2024-09-17T03:40:25.092930+0000","last_became_peered":"2024-09-17T03:40:25.092930+0000","last_unstale":"2024-09-17T03:40:25.098686+0000","last_undegraded":"2024-09-17T03:40:25.098686+0000","last_fullsized":"2024-09-17T03:40:25.098686+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:03.167813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.081162+0000","last_change":"2024-09-17T03:40:25.081162+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.081162+0000","last_undegraded":"2024-09-17T03:40:25.081162+0000","last_fullsized":"2024-09-17T03:40:25.081162+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.099021+0000","last_change":"2024-09-17T03:40:25.094560+0000","last_active":"2024-09-17T03:40:25.099021+0000","last_peered":"2024-09-17T03:40:25.099021+0000","last_clean":"2024-09-17T03:40:25.099021+0000","last_became_active":"2024-09-17T03:40:25.094224+0000","last_became_peered":"2024-09-17T03:40:25.094224+0000","last_unstale":"2024-09-17T03:40:25.099021+0000","last_undegraded":"2024-09-17T03:40:25.099021+0000","last_fullsized":"2024-09-17T03:40:25.099021+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:57.400273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074188+0000","last_change":"2024-09-17T03:40:25.074188+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074188+0000","last_undegraded":"2024-09-17T03:40:25.074188+0000","last_fullsized":"2024-09-17T03:40:25.074188+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.085440+0000","last_change":"2024-09-17T03:40:25.081602+0000","last_active":"2024-09-17T03:40:25.085440+0000","last_peered":"2024-09-17T03:40:25.085440+0000","last_clean":"2024-09-17T03:40:25.085440+0000","last_became_active":"2024-09-17T03:40:25.081289+0000","last_became_peered":"2024-09-17T03:40:25.081289+0000","last_unstale":"2024-09-17T03:40:25.085440+0000","last_undegraded":"2024-09-17T03:40:25.085440+0000","last_fullsized":"2024-09-17T03:40:25.085440+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:58.332554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.070719+0000","last_change":"2024-09-17T03:40:25.070719+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.070719+0000","last_undegraded":"2024-09-17T03:40:25.070719+0000","last_fullsized":"2024-09-17T03:40:25.070719+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.088865+0000","last_change":"2024-09-17T03:40:25.085590+0000","last_active":"2024-09-17T03:40:25.088865+0000","last_peered":"2024-09-17T03:40:25.088865+0000","last_clean":"2024-09-17T03:40:25.088865+0000","last_became_active":"2024-09-17T03:40:25.085288+0000","last_became_peered":"2024-09-17T03:40:25.085288+0000","last_unstale":"2024-09-17T03:40:25.088865+0000","last_undegraded":"2024-09-17T03:40:25.088865+0000","last_fullsized":"2024-09-17T03:40:25.088865+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:47.222952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077408+0000","last_change":"2024-09-17T03:40:25.077408+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077408+0000","last_undegraded":"2024-09-17T03:40:25.077408+0000","last_fullsized":"2024-09-17T03:40:25.077408+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.094983+0000","last_change":"2024-09-17T03:40:25.092780+0000","last_active":"2024-09-17T03:40:25.094983+0000","last_peered":"2024-09-17T03:40:25.094983+0000","last_clean":"2024-09-17T03:40:25.094983+0000","last_became_active":"2024-09-17T03:40:25.092232+0000","last_became_peered":"2024-09-17T03:40:25.092232+0000","last_unstale":"2024-09-17T03:40:25.094983+0000","last_undegraded":"2024-09-17T03:40:25.094983+0000","last_fullsized":"2024-09-17T03:40:25.094983+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:53.864055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.075886+0000","last_change":"2024-09-17T03:40:25.075886+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.075886+0000","last_undegraded":"2024-09-17T03:40:25.075886+0000","last_fullsized":"2024-09-17T03:40:25.075886+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098475+0000","last_change":"2024-09-17T03:40:25.090999+0000","last_active":"2024-09-17T03:40:25.098475+0000","last_peered":"2024-09-17T03:40:25.098475+0000","last_clean":"2024-09-17T03:40:25.098475+0000","last_became_active":"2024-09-17T03:40:25.090560+0000","last_became_peered":"2024-09-17T03:40:25.090560+0000","last_unstale":"2024-09-17T03:40:25.098475+0000","last_undegraded":"2024-09-17T03:40:25.098475+0000","last_fullsized":"2024-09-17T03:40:25.098475+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:43.326888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.072492+0000","last_change":"2024-09-17T03:40:25.072492+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.072492+0000","last_undegraded":"2024-09-17T03:40:25.072492+0000","last_fullsized":"2024-09-17T03:40:25.072492+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.090551+0000","last_change":"2024-09-17T03:40:25.088715+0000","last_active":"2024-09-17T03:40:25.090551+0000","last_peered":"2024-09-17T03:40:25.090551+0000","last_clean":"2024-09-17T03:40:25.090551+0000","last_became_active":"2024-09-17T03:40:25.088075+0000","last_became_peered":"2024-09-17T03:40:25.088075+0000","last_unstale":"2024-09-17T03:40:25.090551+0000","last_undegraded":"2024-09-17T03:40:25.090551+0000","last_fullsized":"2024-09-17T03:40:25.090551+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:49.981785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.077447+0000","last_change":"2024-09-17T03:40:25.077447+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.077447+0000","last_undegraded":"2024-09-17T03:40:25.077447+0000","last_fullsized":"2024-09-17T03:40:25.077447+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098636+0000","last_change":"2024-09-17T03:40:25.092408+0000","last_active":"2024-09-17T03:40:25.098636+0000","last_peered":"2024-09-17T03:40:25.098636+0000","last_clean":"2024-09-17T03:40:25.098636+0000","last_became_active":"2024-09-17T03:40:25.092023+0000","last_became_peered":"2024-09-17T03:40:25.092023+0000","last_unstale":"2024-09-17T03:40:25.098636+0000","last_undegraded":"2024-09-17T03:40:25.098636+0000","last_fullsized":"2024-09-17T03:40:25.098636+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:43.388149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.074639+0000","last_change":"2024-09-17T03:40:25.074639+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.074639+0000","last_undegraded":"2024-09-17T03:40:25.074639+0000","last_fullsized":"2024-09-17T03:40:25.074639+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.094847+0000","last_change":"2024-09-17T03:40:25.088614+0000","last_active":"2024-09-17T03:40:25.094847+0000","last_peered":"2024-09-17T03:40:25.094847+0000","last_clean":"2024-09-17T03:40:25.094847+0000","last_became_active":"2024-09-17T03:40:25.088063+0000","last_became_peered":"2024-09-17T03:40:25.088063+0000","last_unstale":"2024-09-17T03:40:25.094847+0000","last_undegraded":"2024-09-17T03:40:25.094847+0000","last_fullsized":"2024-09-17T03:40:25.094847+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:13.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.083148+0000","last_change":"2024-09-17T03:40:25.083148+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.083148+0000","last_undegraded":"2024-09-17T03:40:25.083148+0000","last_fullsized":"2024-09-17T03:40:25.083148+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.093464+0000","last_change":"2024-09-17T03:40:25.090603+0000","last_active":"2024-09-17T03:40:25.093464+0000","last_peered":"2024-09-17T03:40:25.093464+0000","last_clean":"2024-09-17T03:40:25.093464+0000","last_became_active":"2024-09-17T03:40:25.089547+0000","last_became_peered":"2024-09-17T03:40:25.089547+0000","last_unstale":"2024-09-17T03:40:25.093464+0000","last_undegraded":"2024-09-17T03:40:25.093464+0000","last_fullsized":"2024-09-17T03:40:25.093464+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:17.152862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.070611+0000","last_change":"2024-09-17T03:40:25.070611+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.070611+0000","last_undegraded":"2024-09-17T03:40:25.070611+0000","last_fullsized":"2024-09-17T03:40:25.070611+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098807+0000","last_change":"2024-09-17T03:40:25.094592+0000","last_active":"2024-09-17T03:40:25.098807+0000","last_peered":"2024-09-17T03:40:25.098807+0000","last_clean":"2024-09-17T03:40:25.098807+0000","last_became_active":"2024-09-17T03:40:25.094042+0000","last_became_peered":"2024-09-17T03:40:25.094042+0000","last_unstale":"2024-09-17T03:40:25.098807+0000","last_undegraded":"2024-09-17T03:40:25.098807+0000","last_fullsized":"2024-09-17T03:40:25.098807+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:06.042560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.078952+0000","last_change":"2024-09-17T03:40:25.078952+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.078952+0000","last_undegraded":"2024-09-17T03:40:25.078952+0000","last_fullsized":"2024-09-17T03:40:25.078952+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.098726+0000","last_change":"2024-09-17T03:40:25.091754+0000","last_active":"2024-09-17T03:40:25.098726+0000","last_peered":"2024-09-17T03:40:25.098726+0000","last_clean":"2024-09-17T03:40:25.098726+0000","last_became_active":"2024-09-17T03:40:25.091404+0000","last_became_peered":"2024-09-17T03:40:25.091404+0000","last_unstale":"2024-09-17T03:40:25.098726+0000","last_undegraded":"2024-09-17T03:40:25.098726+0000","last_fullsized":"2024-09-17T03:40:25.098726+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:35.973990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.082740+0000","last_change":"2024-09-17T03:40:25.082740+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.082740+0000","last_undegraded":"2024-09-17T03:40:25.082740+0000","last_fullsized":"2024-09-17T03:40:25.082740+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.097118+0000","last_change":"2024-09-17T03:40:25.094752+0000","last_active":"2024-09-17T03:40:25.097118+0000","last_peered":"2024-09-17T03:40:25.097118+0000","last_clean":"2024-09-17T03:40:25.097118+0000","last_became_active":"2024-09-17T03:40:25.094409+0000","last_became_peered":"2024-09-17T03:40:25.094409+0000","last_unstale":"2024-09-17T03:40:25.097118+0000","last_undegraded":"2024-09-17T03:40:25.097118+0000","last_fullsized":"2024-09-17T03:40:25.097118+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:00.284210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089551+0000","last_change":"2024-09-17T03:40:26.081960+0000","last_active":"2024-09-17T03:40:27.089551+0000","last_peered":"2024-09-17T03:40:27.089551+0000","last_clean":"2024-09-17T03:40:27.089551+0000","last_became_active":"2024-09-17T03:40:26.081649+0000","last_became_peered":"2024-09-17T03:40:26.081649+0000","last_unstale":"2024-09-17T03:40:27.089551+0000","last_undegraded":"2024-09-17T03:40:27.089551+0000","last_fullsized":"2024-09-17T03:40:27.089551+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.491879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.091211+0000","last_change":"2024-09-17T03:40:25.082332+0000","last_active":"2024-09-17T03:40:25.091211+0000","last_peered":"2024-09-17T03:40:25.091211+0000","last_clean":"2024-09-17T03:40:25.091211+0000","last_became_active":"2024-09-17T03:40:25.082030+0000","last_became_peered":"2024-09-17T03:40:25.082030+0000","last_unstale":"2024-09-17T03:40:25.091211+0000","last_undegraded":"2024-09-17T03:40:25.091211+0000","last_fullsized":"2024-09-17T03:40:25.091211+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:39.411672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":108,"state":"creating+peering","last_fresh":"2024-09-17T03:40:25.083346+0000","last_change":"2024-09-17T03:40:25.083346+0000","last_active":"2024-09-17T03:40:25.056302+0000","last_peered":"2024-09-17T03:40:25.056302+0000","last_clean":"2024-09-17T03:40:25.056302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:25.083346+0000","last_undegraded":"2024-09-17T03:40:25.083346+0000","last_fullsized":"2024-09-17T03:40:25.083346+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"109'8","reported_seq":23,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088699+0000","last_change":"2024-09-17T03:40:25.084933+0000","last_active":"2024-09-17T03:40:27.088699+0000","last_peered":"2024-09-17T03:40:27.088699+0000","last_clean":"2024-09-17T03:40:27.088699+0000","last_became_active":"2024-09-17T03:40:25.084571+0000","last_became_peered":"2024-09-17T03:40:25.084571+0000","last_unstale":"2024-09-17T03:40:27.088699+0000","last_undegraded":"2024-09-17T03:40:27.088699+0000","last_fullsized":"2024-09-17T03:40:27.088699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:55.687864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":272,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T03:40:25.075155+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:40:25.075155+0000","last_peered":"2024-09-17T03:40:25.075155+0000","last_clean":"2024-09-17T03:40:25.075155+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:40:25.075155+0000","last_undegraded":"2024-09-17T03:40:25.075155+0000","last_fullsized":"2024-09-17T03:40:25.075155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1327104,"data_stored":606573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1327104,"data_stored":606573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1921024,"data_stored":1196941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1339392,"data_stored":613240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1339392,"data_stored":613240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1921024,"data_stored":1196941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1339392,"data_stored":613240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1372160,"data_stored":627155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:30.990 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:31.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.245+0000 7efefd800640 1 -- 172.21.15.121:0/611263615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efedc0099b0 msgr2=0x7efedc00bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:31.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.245+0000 7efefd800640 1 --2- 172.21.15.121:0/611263615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efedc0099b0 0x7efedc00bdd0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7efef000c770 tx=0x7efedc005830 comp rx=0 tx=0).stop 2024-09-17T03:40:31.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.245+0000 7efefd800640 1 -- 172.21.15.121:0/611263615 shutdown_connections 2024-09-17T03:40:31.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.245+0000 7efefd800640 1 --2- 172.21.15.121:0/611263615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efedc0099b0 0x7efedc00bdd0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.245+0000 7efefd800640 1 -- 172.21.15.121:0/611263615 >> 172.21.15.121:0/611263615 conn(0x7efef80b3580 msgr2=0x7efef80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:31.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.246+0000 7efefd800640 1 -- 172.21.15.121:0/611263615 shutdown_connections 2024-09-17T03:40:31.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.246+0000 7efefd800640 1 -- 172.21.15.121:0/611263615 wait complete. 2024-09-17T03:40:31.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.248+0000 7efefd800640 1 Processor -- start 2024-09-17T03:40:31.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.248+0000 7efefd800640 1 -- start start 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.249+0000 7efefd800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efedc0099b0 0x7efef809dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.249+0000 7efefd800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efef80c9e20 0x7efef80ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.249+0000 7efefd800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efef81590a0 0x7efef81594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.249+0000 7efefd800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efef80d0940 con 0x7efedc0099b0 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.249+0000 7efefd800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efef80d07c0 con 0x7efef81590a0 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.249+0000 7efefd800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efef806ddc0 con 0x7efef80c9e20 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.250+0000 7efef6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efedc0099b0 0x7efef809dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.250+0000 7efef6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efedc0099b0 0x7efef809dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34362/0 (socket says 172.21.15.121:34362) 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.250+0000 7efef6a00640 1 -- 172.21.15.121:0/1007037740 learned_addr learned my addr 172.21.15.121:0/1007037740 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.250+0000 7efef6a00640 1 -- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efef80c9e20 msgr2=0x7efef80ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:31.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.250+0000 7efef6a00640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efef80c9e20 0x7efef80ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.250+0000 7efef6a00640 1 -- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efef81590a0 msgr2=0x7efef81594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:31.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.250+0000 7efef6a00640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efef81590a0 0x7efef81594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.250+0000 7efef6a00640 1 -- 172.21.15.121:0/1007037740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef81599f0 con 0x7efedc0099b0 2024-09-17T03:40:31.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.250+0000 7efef6a00640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efedc0099b0 0x7efef809dc00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7efee8003f00 tx=0x7efee8001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:31.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.250+0000 7efeef400640 1 -- 172.21.15.121:0/1007037740 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8011640 con 0x7efedc0099b0 2024-09-17T03:40:31.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.251+0000 7efeef400640 1 -- 172.21.15.121:0/1007037740 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efee8016020 con 0x7efedc0099b0 2024-09-17T03:40:31.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.251+0000 7efefd800640 1 -- 172.21.15.121:0/1007037740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef80c75a0 con 0x7efedc0099b0 2024-09-17T03:40:31.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.251+0000 7efeef400640 1 -- 172.21.15.121:0/1007037740 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8011a80 con 0x7efedc0099b0 2024-09-17T03:40:31.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.251+0000 7efefd800640 1 -- 172.21.15.121:0/1007037740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef80c7860 con 0x7efedc0099b0 2024-09-17T03:40:31.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.252+0000 7efefd800640 1 -- 172.21.15.121:0/1007037740 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef806e320 con 0x7efedc0099b0 2024-09-17T03:40:31.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.253+0000 7efeef400640 1 -- 172.21.15.121:0/1007037740 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efee8011c20 con 0x7efedc0099b0 2024-09-17T03:40:31.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.254+0000 7efeef400640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efed4078bc0 0x7efed407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:31.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.254+0000 7efeef400640 1 -- 172.21.15.121:0/1007037740 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7efee809bb40 con 0x7efedc0099b0 2024-09-17T03:40:31.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.254+0000 7efeee000640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efed4078bc0 0x7efed407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:31.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.255+0000 7efeee000640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efed4078bc0 0x7efed407b0d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efef815aaa0 tx=0x7efee00093b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:31.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.258+0000 7efeef400640 1 -- 172.21.15.121:0/1007037740 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efee8020020 con 0x7efedc0099b0 2024-09-17T03:40:31.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.440+0000 7efefd800640 1 -- 172.21.15.121:0/1007037740 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efef815aad0 con 0x7efed4078bc0 2024-09-17T03:40:31.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.445+0000 7efeef400640 1 -- 172.21.15.121:0/1007037740 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252476 (secure 0 0 0) 0x7efef815aad0 con 0x7efed4078bc0 2024-09-17T03:40:31.448 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:31.450 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:40:31.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 -- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efed4078bc0 msgr2=0x7efed407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:31.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efed4078bc0 0x7efed407b0d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efef815aaa0 tx=0x7efee00093b0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 -- 172.21.15.121:0/1007037740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efedc0099b0 msgr2=0x7efef809dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efedc0099b0 0x7efef809dc00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7efee8003f00 tx=0x7efee8001630 comp rx=0 tx=0).stop 2024-09-17T03:40:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 -- 172.21.15.121:0/1007037740 shutdown_connections 2024-09-17T03:40:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efef81590a0 0x7efef81594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efef80c9e20 0x7efef80ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efed4078bc0 0x7efed407b0d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 --2- 172.21.15.121:0/1007037740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efedc0099b0 0x7efef809dc00 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 -- 172.21.15.121:0/1007037740 >> 172.21.15.121:0/1007037740 conn(0x7efef80b3580 msgr2=0x7efef80738b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 -- 172.21.15.121:0/1007037740 shutdown_connections 2024-09-17T03:40:31.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.449+0000 7efefd800640 1 -- 172.21.15.121:0/1007037740 wait complete. 2024-09-17T03:40:31.472 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-09-17T03:40:31.355024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261428,"kb_used_data":11880,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713292,"statfs":{"total":773094113280,"available":772826411008,"internally_reserved":0,"allocated":12165120,"data_stored":6202348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.288854"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650729+0000","last_change":"2024-09-17T03:40:26.104394+0000","last_active":"2024-09-17T03:40:27.650729+0000","last_peered":"2024-09-17T03:40:27.650729+0000","last_clean":"2024-09-17T03:40:27.650729+0000","last_became_active":"2024-09-17T03:40:26.104103+0000","last_became_peered":"2024-09-17T03:40:26.104103+0000","last_unstale":"2024-09-17T03:40:27.650729+0000","last_undegraded":"2024-09-17T03:40:27.650729+0000","last_fullsized":"2024-09-17T03:40:27.650729+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:22.257905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651768+0000","last_change":"2024-09-17T03:40:26.094096+0000","last_active":"2024-09-17T03:40:27.651768+0000","last_peered":"2024-09-17T03:40:27.651768+0000","last_clean":"2024-09-17T03:40:27.651768+0000","last_became_active":"2024-09-17T03:40:26.093659+0000","last_became_peered":"2024-09-17T03:40:26.093659+0000","last_unstale":"2024-09-17T03:40:27.651768+0000","last_undegraded":"2024-09-17T03:40:27.651768+0000","last_fullsized":"2024-09-17T03:40:27.651768+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:42.242012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088321+0000","last_change":"2024-09-17T03:40:26.091185+0000","last_active":"2024-09-17T03:40:27.088321+0000","last_peered":"2024-09-17T03:40:27.088321+0000","last_clean":"2024-09-17T03:40:27.088321+0000","last_became_active":"2024-09-17T03:40:26.089487+0000","last_became_peered":"2024-09-17T03:40:26.089487+0000","last_unstale":"2024-09-17T03:40:27.088321+0000","last_undegraded":"2024-09-17T03:40:27.088321+0000","last_fullsized":"2024-09-17T03:40:27.088321+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:30.078377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651499+0000","last_change":"2024-09-17T03:40:26.099256+0000","last_active":"2024-09-17T03:40:27.651499+0000","last_peered":"2024-09-17T03:40:27.651499+0000","last_clean":"2024-09-17T03:40:27.651499+0000","last_became_active":"2024-09-17T03:40:26.098909+0000","last_became_peered":"2024-09-17T03:40:26.098909+0000","last_unstale":"2024-09-17T03:40:27.651499+0000","last_undegraded":"2024-09-17T03:40:27.651499+0000","last_fullsized":"2024-09-17T03:40:27.651499+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:41.846363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092866+0000","last_change":"2024-09-17T03:40:26.097812+0000","last_active":"2024-09-17T03:40:27.092866+0000","last_peered":"2024-09-17T03:40:27.092866+0000","last_clean":"2024-09-17T03:40:27.092866+0000","last_became_active":"2024-09-17T03:40:26.097069+0000","last_became_peered":"2024-09-17T03:40:26.097069+0000","last_unstale":"2024-09-17T03:40:27.092866+0000","last_undegraded":"2024-09-17T03:40:27.092866+0000","last_fullsized":"2024-09-17T03:40:27.092866+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:36.982485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650962+0000","last_change":"2024-09-17T03:40:26.095825+0000","last_active":"2024-09-17T03:40:27.650962+0000","last_peered":"2024-09-17T03:40:27.650962+0000","last_clean":"2024-09-17T03:40:27.650962+0000","last_became_active":"2024-09-17T03:40:26.095423+0000","last_became_peered":"2024-09-17T03:40:26.095423+0000","last_unstale":"2024-09-17T03:40:27.650962+0000","last_undegraded":"2024-09-17T03:40:27.650962+0000","last_fullsized":"2024-09-17T03:40:27.650962+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:59.341049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651145+0000","last_change":"2024-09-17T03:40:26.105189+0000","last_active":"2024-09-17T03:40:27.651145+0000","last_peered":"2024-09-17T03:40:27.651145+0000","last_clean":"2024-09-17T03:40:27.651145+0000","last_became_active":"2024-09-17T03:40:26.104891+0000","last_became_peered":"2024-09-17T03:40:26.104891+0000","last_unstale":"2024-09-17T03:40:27.651145+0000","last_undegraded":"2024-09-17T03:40:27.651145+0000","last_fullsized":"2024-09-17T03:40:27.651145+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:15.647694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088282+0000","last_change":"2024-09-17T03:40:26.082958+0000","last_active":"2024-09-17T03:40:27.088282+0000","last_peered":"2024-09-17T03:40:27.088282+0000","last_clean":"2024-09-17T03:40:27.088282+0000","last_became_active":"2024-09-17T03:40:26.082410+0000","last_became_peered":"2024-09-17T03:40:26.082410+0000","last_unstale":"2024-09-17T03:40:27.088282+0000","last_undegraded":"2024-09-17T03:40:27.088282+0000","last_fullsized":"2024-09-17T03:40:27.088282+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:01.976092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651700+0000","last_change":"2024-09-17T03:40:26.083248+0000","last_active":"2024-09-17T03:40:27.651700+0000","last_peered":"2024-09-17T03:40:27.651700+0000","last_clean":"2024-09-17T03:40:27.651700+0000","last_became_active":"2024-09-17T03:40:26.082949+0000","last_became_peered":"2024-09-17T03:40:26.082949+0000","last_unstale":"2024-09-17T03:40:27.651700+0000","last_undegraded":"2024-09-17T03:40:27.651700+0000","last_fullsized":"2024-09-17T03:40:27.651700+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:05.438754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651477+0000","last_change":"2024-09-17T03:40:26.098420+0000","last_active":"2024-09-17T03:40:27.651477+0000","last_peered":"2024-09-17T03:40:27.651477+0000","last_clean":"2024-09-17T03:40:27.651477+0000","last_became_active":"2024-09-17T03:40:26.097511+0000","last_became_peered":"2024-09-17T03:40:26.097511+0000","last_unstale":"2024-09-17T03:40:27.651477+0000","last_undegraded":"2024-09-17T03:40:27.651477+0000","last_fullsized":"2024-09-17T03:40:27.651477+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:05.438754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650427+0000","last_change":"2024-09-17T03:40:26.098502+0000","last_active":"2024-09-17T03:40:27.650427+0000","last_peered":"2024-09-17T03:40:27.650427+0000","last_clean":"2024-09-17T03:40:27.650427+0000","last_became_active":"2024-09-17T03:40:26.096026+0000","last_became_peered":"2024-09-17T03:40:26.096026+0000","last_unstale":"2024-09-17T03:40:27.650427+0000","last_undegraded":"2024-09-17T03:40:27.650427+0000","last_fullsized":"2024-09-17T03:40:27.650427+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:40.307739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088437+0000","last_change":"2024-09-17T03:40:26.097670+0000","last_active":"2024-09-17T03:40:27.088437+0000","last_peered":"2024-09-17T03:40:27.088437+0000","last_clean":"2024-09-17T03:40:27.088437+0000","last_became_active":"2024-09-17T03:40:26.097275+0000","last_became_peered":"2024-09-17T03:40:26.097275+0000","last_unstale":"2024-09-17T03:40:27.088437+0000","last_undegraded":"2024-09-17T03:40:27.088437+0000","last_fullsized":"2024-09-17T03:40:27.088437+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:12.630071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651101+0000","last_change":"2024-09-17T03:40:26.110554+0000","last_active":"2024-09-17T03:40:27.651101+0000","last_peered":"2024-09-17T03:40:27.651101+0000","last_clean":"2024-09-17T03:40:27.651101+0000","last_became_active":"2024-09-17T03:40:26.110220+0000","last_became_peered":"2024-09-17T03:40:26.110220+0000","last_unstale":"2024-09-17T03:40:27.651101+0000","last_undegraded":"2024-09-17T03:40:27.651101+0000","last_fullsized":"2024-09-17T03:40:27.651101+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:18.161357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088079+0000","last_change":"2024-09-17T03:40:26.092267+0000","last_active":"2024-09-17T03:40:27.088079+0000","last_peered":"2024-09-17T03:40:27.088079+0000","last_clean":"2024-09-17T03:40:27.088079+0000","last_became_active":"2024-09-17T03:40:26.091626+0000","last_became_peered":"2024-09-17T03:40:26.091626+0000","last_unstale":"2024-09-17T03:40:27.088079+0000","last_undegraded":"2024-09-17T03:40:27.088079+0000","last_fullsized":"2024-09-17T03:40:27.088079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:08.779819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650063+0000","last_change":"2024-09-17T03:40:26.093069+0000","last_active":"2024-09-17T03:40:27.650063+0000","last_peered":"2024-09-17T03:40:27.650063+0000","last_clean":"2024-09-17T03:40:27.650063+0000","last_became_active":"2024-09-17T03:40:26.092786+0000","last_became_peered":"2024-09-17T03:40:26.092786+0000","last_unstale":"2024-09-17T03:40:27.650063+0000","last_undegraded":"2024-09-17T03:40:27.650063+0000","last_fullsized":"2024-09-17T03:40:27.650063+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:18.161357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088077+0000","last_change":"2024-09-17T03:40:26.078819+0000","last_active":"2024-09-17T03:40:27.088077+0000","last_peered":"2024-09-17T03:40:27.088077+0000","last_clean":"2024-09-17T03:40:27.088077+0000","last_became_active":"2024-09-17T03:40:26.078101+0000","last_became_peered":"2024-09-17T03:40:26.078101+0000","last_unstale":"2024-09-17T03:40:27.088077+0000","last_undegraded":"2024-09-17T03:40:27.088077+0000","last_fullsized":"2024-09-17T03:40:27.088077+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:00.305840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089278+0000","last_change":"2024-09-17T03:40:26.092932+0000","last_active":"2024-09-17T03:40:27.089278+0000","last_peered":"2024-09-17T03:40:27.089278+0000","last_clean":"2024-09-17T03:40:27.089278+0000","last_became_active":"2024-09-17T03:40:26.092577+0000","last_became_peered":"2024-09-17T03:40:26.092577+0000","last_unstale":"2024-09-17T03:40:27.089278+0000","last_undegraded":"2024-09-17T03:40:27.089278+0000","last_fullsized":"2024-09-17T03:40:27.089278+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:03.614338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089666+0000","last_change":"2024-09-17T03:40:26.092395+0000","last_active":"2024-09-17T03:40:27.089666+0000","last_peered":"2024-09-17T03:40:27.089666+0000","last_clean":"2024-09-17T03:40:27.089666+0000","last_became_active":"2024-09-17T03:40:26.091948+0000","last_became_peered":"2024-09-17T03:40:26.091948+0000","last_unstale":"2024-09-17T03:40:27.089666+0000","last_undegraded":"2024-09-17T03:40:27.089666+0000","last_fullsized":"2024-09-17T03:40:27.089666+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:51.069412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092961+0000","last_change":"2024-09-17T03:40:26.099508+0000","last_active":"2024-09-17T03:40:27.092961+0000","last_peered":"2024-09-17T03:40:27.092961+0000","last_clean":"2024-09-17T03:40:27.092961+0000","last_became_active":"2024-09-17T03:40:26.099176+0000","last_became_peered":"2024-09-17T03:40:26.099176+0000","last_unstale":"2024-09-17T03:40:27.092961+0000","last_undegraded":"2024-09-17T03:40:27.092961+0000","last_fullsized":"2024-09-17T03:40:27.092961+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.696754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651138+0000","last_change":"2024-09-17T03:40:26.098607+0000","last_active":"2024-09-17T03:40:27.651138+0000","last_peered":"2024-09-17T03:40:27.651138+0000","last_clean":"2024-09-17T03:40:27.651138+0000","last_became_active":"2024-09-17T03:40:26.097785+0000","last_became_peered":"2024-09-17T03:40:26.097785+0000","last_unstale":"2024-09-17T03:40:27.651138+0000","last_undegraded":"2024-09-17T03:40:27.651138+0000","last_fullsized":"2024-09-17T03:40:27.651138+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:41.846363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093254+0000","last_change":"2024-09-17T03:40:26.100454+0000","last_active":"2024-09-17T03:40:27.093254+0000","last_peered":"2024-09-17T03:40:27.093254+0000","last_clean":"2024-09-17T03:40:27.093254+0000","last_became_active":"2024-09-17T03:40:26.100168+0000","last_became_peered":"2024-09-17T03:40:26.100168+0000","last_unstale":"2024-09-17T03:40:27.093254+0000","last_undegraded":"2024-09-17T03:40:27.093254+0000","last_fullsized":"2024-09-17T03:40:27.093254+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:54.210140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650704+0000","last_change":"2024-09-17T03:40:26.087836+0000","last_active":"2024-09-17T03:40:27.650704+0000","last_peered":"2024-09-17T03:40:27.650704+0000","last_clean":"2024-09-17T03:40:27.650704+0000","last_became_active":"2024-09-17T03:40:26.087513+0000","last_became_peered":"2024-09-17T03:40:26.087513+0000","last_unstale":"2024-09-17T03:40:27.650704+0000","last_undegraded":"2024-09-17T03:40:27.650704+0000","last_fullsized":"2024-09-17T03:40:27.650704+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:51.281251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650095+0000","last_change":"2024-09-17T03:40:26.092289+0000","last_active":"2024-09-17T03:40:27.650095+0000","last_peered":"2024-09-17T03:40:27.650095+0000","last_clean":"2024-09-17T03:40:27.650095+0000","last_became_active":"2024-09-17T03:40:26.091963+0000","last_became_peered":"2024-09-17T03:40:26.091963+0000","last_unstale":"2024-09-17T03:40:27.650095+0000","last_undegraded":"2024-09-17T03:40:27.650095+0000","last_fullsized":"2024-09-17T03:40:27.650095+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:41.846363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650115+0000","last_change":"2024-09-17T03:40:26.088606+0000","last_active":"2024-09-17T03:40:27.650115+0000","last_peered":"2024-09-17T03:40:27.650115+0000","last_clean":"2024-09-17T03:40:27.650115+0000","last_became_active":"2024-09-17T03:40:26.088322+0000","last_became_peered":"2024-09-17T03:40:26.088322+0000","last_unstale":"2024-09-17T03:40:27.650115+0000","last_undegraded":"2024-09-17T03:40:27.650115+0000","last_fullsized":"2024-09-17T03:40:27.650115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:40.496150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650885+0000","last_change":"2024-09-17T03:40:26.097257+0000","last_active":"2024-09-17T03:40:27.650885+0000","last_peered":"2024-09-17T03:40:27.650885+0000","last_clean":"2024-09-17T03:40:27.650885+0000","last_became_active":"2024-09-17T03:40:26.096887+0000","last_became_peered":"2024-09-17T03:40:26.096887+0000","last_unstale":"2024-09-17T03:40:27.650885+0000","last_undegraded":"2024-09-17T03:40:27.650885+0000","last_fullsized":"2024-09-17T03:40:27.650885+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:10.862380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090544+0000","last_change":"2024-09-17T03:40:26.098599+0000","last_active":"2024-09-17T03:40:27.090544+0000","last_peered":"2024-09-17T03:40:27.090544+0000","last_clean":"2024-09-17T03:40:27.090544+0000","last_became_active":"2024-09-17T03:40:26.098250+0000","last_became_peered":"2024-09-17T03:40:26.098250+0000","last_unstale":"2024-09-17T03:40:27.090544+0000","last_undegraded":"2024-09-17T03:40:27.090544+0000","last_fullsized":"2024-09-17T03:40:27.090544+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:31.185943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093083+0000","last_change":"2024-09-17T03:40:26.109226+0000","last_active":"2024-09-17T03:40:27.093083+0000","last_peered":"2024-09-17T03:40:27.093083+0000","last_clean":"2024-09-17T03:40:27.093083+0000","last_became_active":"2024-09-17T03:40:26.108900+0000","last_became_peered":"2024-09-17T03:40:26.108900+0000","last_unstale":"2024-09-17T03:40:27.093083+0000","last_undegraded":"2024-09-17T03:40:27.093083+0000","last_fullsized":"2024-09-17T03:40:27.093083+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:57.101219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088711+0000","last_change":"2024-09-17T03:40:26.097245+0000","last_active":"2024-09-17T03:40:27.088711+0000","last_peered":"2024-09-17T03:40:27.088711+0000","last_clean":"2024-09-17T03:40:27.088711+0000","last_became_active":"2024-09-17T03:40:26.096639+0000","last_became_peered":"2024-09-17T03:40:26.096639+0000","last_unstale":"2024-09-17T03:40:27.088711+0000","last_undegraded":"2024-09-17T03:40:27.088711+0000","last_fullsized":"2024-09-17T03:40:27.088711+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:53.112032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090143+0000","last_change":"2024-09-17T03:40:26.092527+0000","last_active":"2024-09-17T03:40:27.090143+0000","last_peered":"2024-09-17T03:40:27.090143+0000","last_clean":"2024-09-17T03:40:27.090143+0000","last_became_active":"2024-09-17T03:40:26.092128+0000","last_became_peered":"2024-09-17T03:40:26.092128+0000","last_unstale":"2024-09-17T03:40:27.090143+0000","last_undegraded":"2024-09-17T03:40:27.090143+0000","last_fullsized":"2024-09-17T03:40:27.090143+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:33.591545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088328+0000","last_change":"2024-09-17T03:40:26.092968+0000","last_active":"2024-09-17T03:40:27.088328+0000","last_peered":"2024-09-17T03:40:27.088328+0000","last_clean":"2024-09-17T03:40:27.088328+0000","last_became_active":"2024-09-17T03:40:26.092596+0000","last_became_peered":"2024-09-17T03:40:26.092596+0000","last_unstale":"2024-09-17T03:40:27.088328+0000","last_undegraded":"2024-09-17T03:40:27.088328+0000","last_fullsized":"2024-09-17T03:40:27.088328+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:21.943749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.649958+0000","last_change":"2024-09-17T03:40:26.090339+0000","last_active":"2024-09-17T03:40:27.649958+0000","last_peered":"2024-09-17T03:40:27.649958+0000","last_clean":"2024-09-17T03:40:27.649958+0000","last_became_active":"2024-09-17T03:40:26.090056+0000","last_became_peered":"2024-09-17T03:40:26.090056+0000","last_unstale":"2024-09-17T03:40:27.649958+0000","last_undegraded":"2024-09-17T03:40:27.649958+0000","last_fullsized":"2024-09-17T03:40:27.649958+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:23.264966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.649990+0000","last_change":"2024-09-17T03:40:26.082442+0000","last_active":"2024-09-17T03:40:27.649990+0000","last_peered":"2024-09-17T03:40:27.649990+0000","last_clean":"2024-09-17T03:40:27.649990+0000","last_became_active":"2024-09-17T03:40:26.082083+0000","last_became_peered":"2024-09-17T03:40:26.082083+0000","last_unstale":"2024-09-17T03:40:27.649990+0000","last_undegraded":"2024-09-17T03:40:27.649990+0000","last_fullsized":"2024-09-17T03:40:27.649990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:42.815401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090750+0000","last_change":"2024-09-17T03:40:26.094424+0000","last_active":"2024-09-17T03:40:27.090750+0000","last_peered":"2024-09-17T03:40:27.090750+0000","last_clean":"2024-09-17T03:40:27.090750+0000","last_became_active":"2024-09-17T03:40:26.094061+0000","last_became_peered":"2024-09-17T03:40:26.094061+0000","last_unstale":"2024-09-17T03:40:27.090750+0000","last_undegraded":"2024-09-17T03:40:27.090750+0000","last_fullsized":"2024-09-17T03:40:27.090750+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:56.894039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"109'4","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093454+0000","last_change":"2024-09-17T03:40:25.086790+0000","last_active":"2024-09-17T03:40:27.093454+0000","last_peered":"2024-09-17T03:40:27.093454+0000","last_clean":"2024-09-17T03:40:27.093454+0000","last_became_active":"2024-09-17T03:40:25.086123+0000","last_became_peered":"2024-09-17T03:40:25.086123+0000","last_unstale":"2024-09-17T03:40:27.093454+0000","last_undegraded":"2024-09-17T03:40:27.093454+0000","last_fullsized":"2024-09-17T03:40:27.093454+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:44.920346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651421+0000","last_change":"2024-09-17T03:40:26.097809+0000","last_active":"2024-09-17T03:40:27.651421+0000","last_peered":"2024-09-17T03:40:27.651421+0000","last_clean":"2024-09-17T03:40:27.651421+0000","last_became_active":"2024-09-17T03:40:26.095484+0000","last_became_peered":"2024-09-17T03:40:26.095484+0000","last_unstale":"2024-09-17T03:40:27.651421+0000","last_undegraded":"2024-09-17T03:40:27.651421+0000","last_fullsized":"2024-09-17T03:40:27.651421+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:51.281251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089707+0000","last_change":"2024-09-17T03:40:25.091077+0000","last_active":"2024-09-17T03:40:27.089707+0000","last_peered":"2024-09-17T03:40:27.089707+0000","last_clean":"2024-09-17T03:40:27.089707+0000","last_became_active":"2024-09-17T03:40:25.090715+0000","last_became_peered":"2024-09-17T03:40:25.090715+0000","last_unstale":"2024-09-17T03:40:27.089707+0000","last_undegraded":"2024-09-17T03:40:27.089707+0000","last_fullsized":"2024-09-17T03:40:27.089707+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:32.840233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650306+0000","last_change":"2024-09-17T03:40:26.091084+0000","last_active":"2024-09-17T03:40:27.650306+0000","last_peered":"2024-09-17T03:40:27.650306+0000","last_clean":"2024-09-17T03:40:27.650306+0000","last_became_active":"2024-09-17T03:40:26.090796+0000","last_became_peered":"2024-09-17T03:40:26.090796+0000","last_unstale":"2024-09-17T03:40:27.650306+0000","last_undegraded":"2024-09-17T03:40:27.650306+0000","last_fullsized":"2024-09-17T03:40:27.650306+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650796+0000","last_change":"2024-09-17T03:40:25.091127+0000","last_active":"2024-09-17T03:40:27.650796+0000","last_peered":"2024-09-17T03:40:27.650796+0000","last_clean":"2024-09-17T03:40:27.650796+0000","last_became_active":"2024-09-17T03:40:25.090828+0000","last_became_peered":"2024-09-17T03:40:25.090828+0000","last_unstale":"2024-09-17T03:40:27.650796+0000","last_undegraded":"2024-09-17T03:40:27.650796+0000","last_fullsized":"2024-09-17T03:40:27.650796+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:29.759478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651713+0000","last_change":"2024-09-17T03:40:26.099318+0000","last_active":"2024-09-17T03:40:27.651713+0000","last_peered":"2024-09-17T03:40:27.651713+0000","last_clean":"2024-09-17T03:40:27.651713+0000","last_became_active":"2024-09-17T03:40:26.098982+0000","last_became_peered":"2024-09-17T03:40:26.098982+0000","last_unstale":"2024-09-17T03:40:27.651713+0000","last_undegraded":"2024-09-17T03:40:27.651713+0000","last_fullsized":"2024-09-17T03:40:27.651713+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:38.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651030+0000","last_change":"2024-09-17T03:40:25.088001+0000","last_active":"2024-09-17T03:40:27.651030+0000","last_peered":"2024-09-17T03:40:27.651030+0000","last_clean":"2024-09-17T03:40:27.651030+0000","last_became_active":"2024-09-17T03:40:25.087631+0000","last_became_peered":"2024-09-17T03:40:25.087631+0000","last_unstale":"2024-09-17T03:40:27.651030+0000","last_undegraded":"2024-09-17T03:40:27.651030+0000","last_fullsized":"2024-09-17T03:40:27.651030+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:50.121556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088541+0000","last_change":"2024-09-17T03:40:26.102071+0000","last_active":"2024-09-17T03:40:27.088541+0000","last_peered":"2024-09-17T03:40:27.088541+0000","last_clean":"2024-09-17T03:40:27.088541+0000","last_became_active":"2024-09-17T03:40:26.101645+0000","last_became_peered":"2024-09-17T03:40:26.101645+0000","last_unstale":"2024-09-17T03:40:27.088541+0000","last_undegraded":"2024-09-17T03:40:27.088541+0000","last_fullsized":"2024-09-17T03:40:27.088541+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:39.422894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651058+0000","last_change":"2024-09-17T03:40:25.092407+0000","last_active":"2024-09-17T03:40:27.651058+0000","last_peered":"2024-09-17T03:40:27.651058+0000","last_clean":"2024-09-17T03:40:27.651058+0000","last_became_active":"2024-09-17T03:40:25.092121+0000","last_became_peered":"2024-09-17T03:40:25.092121+0000","last_unstale":"2024-09-17T03:40:27.651058+0000","last_undegraded":"2024-09-17T03:40:27.651058+0000","last_fullsized":"2024-09-17T03:40:27.651058+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:05.631360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650031+0000","last_change":"2024-09-17T03:40:26.103208+0000","last_active":"2024-09-17T03:40:27.650031+0000","last_peered":"2024-09-17T03:40:27.650031+0000","last_clean":"2024-09-17T03:40:27.650031+0000","last_became_active":"2024-09-17T03:40:26.102798+0000","last_became_peered":"2024-09-17T03:40:26.102798+0000","last_unstale":"2024-09-17T03:40:27.650031+0000","last_undegraded":"2024-09-17T03:40:27.650031+0000","last_fullsized":"2024-09-17T03:40:27.650031+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:07.900548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089451+0000","last_change":"2024-09-17T03:40:25.082851+0000","last_active":"2024-09-17T03:40:27.089451+0000","last_peered":"2024-09-17T03:40:27.089451+0000","last_clean":"2024-09-17T03:40:27.089451+0000","last_became_active":"2024-09-17T03:40:25.082524+0000","last_became_peered":"2024-09-17T03:40:25.082524+0000","last_unstale":"2024-09-17T03:40:27.089451+0000","last_undegraded":"2024-09-17T03:40:27.089451+0000","last_fullsized":"2024-09-17T03:40:27.089451+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:09.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088644+0000","last_change":"2024-09-17T03:40:26.082980+0000","last_active":"2024-09-17T03:40:27.088644+0000","last_peered":"2024-09-17T03:40:27.088644+0000","last_clean":"2024-09-17T03:40:27.088644+0000","last_became_active":"2024-09-17T03:40:26.082675+0000","last_became_peered":"2024-09-17T03:40:26.082675+0000","last_unstale":"2024-09-17T03:40:27.088644+0000","last_undegraded":"2024-09-17T03:40:27.088644+0000","last_fullsized":"2024-09-17T03:40:27.088644+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:01.292705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650151+0000","last_change":"2024-09-17T03:40:25.085262+0000","last_active":"2024-09-17T03:40:27.650151+0000","last_peered":"2024-09-17T03:40:27.650151+0000","last_clean":"2024-09-17T03:40:27.650151+0000","last_became_active":"2024-09-17T03:40:25.084924+0000","last_became_peered":"2024-09-17T03:40:25.084924+0000","last_unstale":"2024-09-17T03:40:27.650151+0000","last_undegraded":"2024-09-17T03:40:27.650151+0000","last_fullsized":"2024-09-17T03:40:27.650151+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:31.397640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089299+0000","last_change":"2024-09-17T03:40:26.091093+0000","last_active":"2024-09-17T03:40:27.089299+0000","last_peered":"2024-09-17T03:40:27.089299+0000","last_clean":"2024-09-17T03:40:27.089299+0000","last_became_active":"2024-09-17T03:40:26.089624+0000","last_became_peered":"2024-09-17T03:40:26.089624+0000","last_unstale":"2024-09-17T03:40:27.089299+0000","last_undegraded":"2024-09-17T03:40:27.089299+0000","last_fullsized":"2024-09-17T03:40:27.089299+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:40.051808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089659+0000","last_change":"2024-09-17T03:40:25.091182+0000","last_active":"2024-09-17T03:40:27.089659+0000","last_peered":"2024-09-17T03:40:27.089659+0000","last_clean":"2024-09-17T03:40:27.089659+0000","last_became_active":"2024-09-17T03:40:25.090160+0000","last_became_peered":"2024-09-17T03:40:25.090160+0000","last_unstale":"2024-09-17T03:40:27.089659+0000","last_undegraded":"2024-09-17T03:40:27.089659+0000","last_fullsized":"2024-09-17T03:40:27.089659+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:17.125522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651035+0000","last_change":"2024-09-17T03:40:26.100410+0000","last_active":"2024-09-17T03:40:27.651035+0000","last_peered":"2024-09-17T03:40:27.651035+0000","last_clean":"2024-09-17T03:40:27.651035+0000","last_became_active":"2024-09-17T03:40:26.100098+0000","last_became_peered":"2024-09-17T03:40:26.100098+0000","last_unstale":"2024-09-17T03:40:27.651035+0000","last_undegraded":"2024-09-17T03:40:27.651035+0000","last_fullsized":"2024-09-17T03:40:27.651035+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:05.438754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651831+0000","last_change":"2024-09-17T03:40:25.090872+0000","last_active":"2024-09-17T03:40:27.651831+0000","last_peered":"2024-09-17T03:40:27.651831+0000","last_clean":"2024-09-17T03:40:27.651831+0000","last_became_active":"2024-09-17T03:40:25.090576+0000","last_became_peered":"2024-09-17T03:40:25.090576+0000","last_unstale":"2024-09-17T03:40:27.651831+0000","last_undegraded":"2024-09-17T03:40:27.651831+0000","last_fullsized":"2024-09-17T03:40:27.651831+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:54.401051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651807+0000","last_change":"2024-09-17T03:40:26.100267+0000","last_active":"2024-09-17T03:40:27.651807+0000","last_peered":"2024-09-17T03:40:27.651807+0000","last_clean":"2024-09-17T03:40:27.651807+0000","last_became_active":"2024-09-17T03:40:26.099941+0000","last_became_peered":"2024-09-17T03:40:26.099941+0000","last_unstale":"2024-09-17T03:40:27.651807+0000","last_undegraded":"2024-09-17T03:40:27.651807+0000","last_fullsized":"2024-09-17T03:40:27.651807+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:34.780970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651520+0000","last_change":"2024-09-17T03:40:25.083953+0000","last_active":"2024-09-17T03:40:27.651520+0000","last_peered":"2024-09-17T03:40:27.651520+0000","last_clean":"2024-09-17T03:40:27.651520+0000","last_became_active":"2024-09-17T03:40:25.082074+0000","last_became_peered":"2024-09-17T03:40:25.082074+0000","last_unstale":"2024-09-17T03:40:27.651520+0000","last_undegraded":"2024-09-17T03:40:27.651520+0000","last_fullsized":"2024-09-17T03:40:27.651520+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:29.759478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088137+0000","last_change":"2024-09-17T03:40:26.094680+0000","last_active":"2024-09-17T03:40:27.088137+0000","last_peered":"2024-09-17T03:40:27.088137+0000","last_clean":"2024-09-17T03:40:27.088137+0000","last_became_active":"2024-09-17T03:40:26.093903+0000","last_became_peered":"2024-09-17T03:40:26.093903+0000","last_unstale":"2024-09-17T03:40:27.088137+0000","last_undegraded":"2024-09-17T03:40:27.088137+0000","last_fullsized":"2024-09-17T03:40:27.088137+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:14.318070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"109'3","reported_seq":18,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650607+0000","last_change":"2024-09-17T03:40:25.089863+0000","last_active":"2024-09-17T03:40:27.650607+0000","last_peered":"2024-09-17T03:40:27.650607+0000","last_clean":"2024-09-17T03:40:27.650607+0000","last_became_active":"2024-09-17T03:40:25.089511+0000","last_became_peered":"2024-09-17T03:40:25.089511+0000","last_unstale":"2024-09-17T03:40:27.650607+0000","last_undegraded":"2024-09-17T03:40:27.650607+0000","last_fullsized":"2024-09-17T03:40:27.650607+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:41.607946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093184+0000","last_change":"2024-09-17T03:40:26.101714+0000","last_active":"2024-09-17T03:40:27.093184+0000","last_peered":"2024-09-17T03:40:27.093184+0000","last_clean":"2024-09-17T03:40:27.093184+0000","last_became_active":"2024-09-17T03:40:26.101174+0000","last_became_peered":"2024-09-17T03:40:26.101174+0000","last_unstale":"2024-09-17T03:40:27.093184+0000","last_undegraded":"2024-09-17T03:40:27.093184+0000","last_fullsized":"2024-09-17T03:40:27.093184+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:17.973757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"109'6","reported_seq":21,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651221+0000","last_change":"2024-09-17T03:40:25.084751+0000","last_active":"2024-09-17T03:40:27.651221+0000","last_peered":"2024-09-17T03:40:27.651221+0000","last_clean":"2024-09-17T03:40:27.651221+0000","last_became_active":"2024-09-17T03:40:25.084419+0000","last_became_peered":"2024-09-17T03:40:25.084419+0000","last_unstale":"2024-09-17T03:40:27.651221+0000","last_undegraded":"2024-09-17T03:40:27.651221+0000","last_fullsized":"2024-09-17T03:40:27.651221+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:42.470301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092680+0000","last_change":"2024-09-17T03:40:26.086208+0000","last_active":"2024-09-17T03:40:27.092680+0000","last_peered":"2024-09-17T03:40:27.092680+0000","last_clean":"2024-09-17T03:40:27.092680+0000","last_became_active":"2024-09-17T03:40:26.085919+0000","last_became_peered":"2024-09-17T03:40:26.085919+0000","last_unstale":"2024-09-17T03:40:27.092680+0000","last_undegraded":"2024-09-17T03:40:27.092680+0000","last_fullsized":"2024-09-17T03:40:27.092680+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:48.231447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089602+0000","last_change":"2024-09-17T03:40:25.080989+0000","last_active":"2024-09-17T03:40:27.089602+0000","last_peered":"2024-09-17T03:40:27.089602+0000","last_clean":"2024-09-17T03:40:27.089602+0000","last_became_active":"2024-09-17T03:40:25.080667+0000","last_became_peered":"2024-09-17T03:40:25.080667+0000","last_unstale":"2024-09-17T03:40:27.089602+0000","last_undegraded":"2024-09-17T03:40:27.089602+0000","last_fullsized":"2024-09-17T03:40:27.089602+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:57.430299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651507+0000","last_change":"2024-09-17T03:40:26.107467+0000","last_active":"2024-09-17T03:40:27.651507+0000","last_peered":"2024-09-17T03:40:27.651507+0000","last_clean":"2024-09-17T03:40:27.651507+0000","last_became_active":"2024-09-17T03:40:26.107118+0000","last_became_peered":"2024-09-17T03:40:26.107118+0000","last_unstale":"2024-09-17T03:40:27.651507+0000","last_undegraded":"2024-09-17T03:40:27.651507+0000","last_fullsized":"2024-09-17T03:40:27.651507+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:38.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089194+0000","last_change":"2024-09-17T03:40:25.095537+0000","last_active":"2024-09-17T03:40:27.089194+0000","last_peered":"2024-09-17T03:40:27.089194+0000","last_clean":"2024-09-17T03:40:27.089194+0000","last_became_active":"2024-09-17T03:40:25.094852+0000","last_became_peered":"2024-09-17T03:40:25.094852+0000","last_unstale":"2024-09-17T03:40:27.089194+0000","last_undegraded":"2024-09-17T03:40:27.089194+0000","last_fullsized":"2024-09-17T03:40:27.089194+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:47.845830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088407+0000","last_change":"2024-09-17T03:40:26.081760+0000","last_active":"2024-09-17T03:40:27.088407+0000","last_peered":"2024-09-17T03:40:27.088407+0000","last_clean":"2024-09-17T03:40:27.088407+0000","last_became_active":"2024-09-17T03:40:26.081443+0000","last_became_peered":"2024-09-17T03:40:26.081443+0000","last_unstale":"2024-09-17T03:40:27.088407+0000","last_undegraded":"2024-09-17T03:40:27.088407+0000","last_fullsized":"2024-09-17T03:40:27.088407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:07.878699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089045+0000","last_change":"2024-09-17T03:40:25.076755+0000","last_active":"2024-09-17T03:40:27.089045+0000","last_peered":"2024-09-17T03:40:27.089045+0000","last_clean":"2024-09-17T03:40:27.089045+0000","last_became_active":"2024-09-17T03:40:25.076451+0000","last_became_peered":"2024-09-17T03:40:25.076451+0000","last_unstale":"2024-09-17T03:40:27.089045+0000","last_undegraded":"2024-09-17T03:40:27.089045+0000","last_fullsized":"2024-09-17T03:40:27.089045+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:05.715292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651554+0000","last_change":"2024-09-17T03:40:26.086421+0000","last_active":"2024-09-17T03:40:27.651554+0000","last_peered":"2024-09-17T03:40:27.651554+0000","last_clean":"2024-09-17T03:40:27.651554+0000","last_became_active":"2024-09-17T03:40:26.083374+0000","last_became_peered":"2024-09-17T03:40:26.083374+0000","last_unstale":"2024-09-17T03:40:27.651554+0000","last_undegraded":"2024-09-17T03:40:27.651554+0000","last_fullsized":"2024-09-17T03:40:27.651554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:40.496150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089461+0000","last_change":"2024-09-17T03:40:25.089035+0000","last_active":"2024-09-17T03:40:27.089461+0000","last_peered":"2024-09-17T03:40:27.089461+0000","last_clean":"2024-09-17T03:40:27.089461+0000","last_became_active":"2024-09-17T03:40:25.088719+0000","last_became_peered":"2024-09-17T03:40:25.088719+0000","last_unstale":"2024-09-17T03:40:27.089461+0000","last_undegraded":"2024-09-17T03:40:27.089461+0000","last_fullsized":"2024-09-17T03:40:27.089461+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:04.430259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650448+0000","last_change":"2024-09-17T03:40:26.103860+0000","last_active":"2024-09-17T03:40:27.650448+0000","last_peered":"2024-09-17T03:40:27.650448+0000","last_clean":"2024-09-17T03:40:27.650448+0000","last_became_active":"2024-09-17T03:40:26.101932+0000","last_became_peered":"2024-09-17T03:40:26.101932+0000","last_unstale":"2024-09-17T03:40:27.650448+0000","last_undegraded":"2024-09-17T03:40:27.650448+0000","last_fullsized":"2024-09-17T03:40:27.650448+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:57.235098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089864+0000","last_change":"2024-09-17T03:40:25.095020+0000","last_active":"2024-09-17T03:40:27.089864+0000","last_peered":"2024-09-17T03:40:27.089864+0000","last_clean":"2024-09-17T03:40:27.089864+0000","last_became_active":"2024-09-17T03:40:25.094243+0000","last_became_peered":"2024-09-17T03:40:25.094243+0000","last_unstale":"2024-09-17T03:40:27.089864+0000","last_undegraded":"2024-09-17T03:40:27.089864+0000","last_fullsized":"2024-09-17T03:40:27.089864+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:57.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651579+0000","last_change":"2024-09-17T03:40:26.105799+0000","last_active":"2024-09-17T03:40:27.651579+0000","last_peered":"2024-09-17T03:40:27.651579+0000","last_clean":"2024-09-17T03:40:27.651579+0000","last_became_active":"2024-09-17T03:40:26.105418+0000","last_became_peered":"2024-09-17T03:40:26.105418+0000","last_unstale":"2024-09-17T03:40:27.651579+0000","last_undegraded":"2024-09-17T03:40:27.651579+0000","last_fullsized":"2024-09-17T03:40:27.651579+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:34.780970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093162+0000","last_change":"2024-09-17T03:40:25.093528+0000","last_active":"2024-09-17T03:40:27.093162+0000","last_peered":"2024-09-17T03:40:27.093162+0000","last_clean":"2024-09-17T03:40:27.093162+0000","last_became_active":"2024-09-17T03:40:25.092930+0000","last_became_peered":"2024-09-17T03:40:25.092930+0000","last_unstale":"2024-09-17T03:40:27.093162+0000","last_undegraded":"2024-09-17T03:40:27.093162+0000","last_fullsized":"2024-09-17T03:40:27.093162+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.119027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093184+0000","last_change":"2024-09-17T03:40:26.095248+0000","last_active":"2024-09-17T03:40:27.093184+0000","last_peered":"2024-09-17T03:40:27.093184+0000","last_clean":"2024-09-17T03:40:27.093184+0000","last_became_active":"2024-09-17T03:40:26.094665+0000","last_became_peered":"2024-09-17T03:40:26.094665+0000","last_unstale":"2024-09-17T03:40:27.093184+0000","last_undegraded":"2024-09-17T03:40:27.093184+0000","last_fullsized":"2024-09-17T03:40:27.093184+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:27.655400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650275+0000","last_change":"2024-09-17T03:40:25.094560+0000","last_active":"2024-09-17T03:40:27.650275+0000","last_peered":"2024-09-17T03:40:27.650275+0000","last_clean":"2024-09-17T03:40:27.650275+0000","last_became_active":"2024-09-17T03:40:25.094224+0000","last_became_peered":"2024-09-17T03:40:25.094224+0000","last_unstale":"2024-09-17T03:40:27.650275+0000","last_undegraded":"2024-09-17T03:40:27.650275+0000","last_fullsized":"2024-09-17T03:40:27.650275+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:14.218993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650787+0000","last_change":"2024-09-17T03:40:26.110536+0000","last_active":"2024-09-17T03:40:27.650787+0000","last_peered":"2024-09-17T03:40:27.650787+0000","last_clean":"2024-09-17T03:40:27.650787+0000","last_became_active":"2024-09-17T03:40:26.110225+0000","last_became_peered":"2024-09-17T03:40:26.110225+0000","last_unstale":"2024-09-17T03:40:27.650787+0000","last_undegraded":"2024-09-17T03:40:27.650787+0000","last_fullsized":"2024-09-17T03:40:27.650787+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:29.177484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088744+0000","last_change":"2024-09-17T03:40:25.081602+0000","last_active":"2024-09-17T03:40:27.088744+0000","last_peered":"2024-09-17T03:40:27.088744+0000","last_clean":"2024-09-17T03:40:27.088744+0000","last_became_active":"2024-09-17T03:40:25.081289+0000","last_became_peered":"2024-09-17T03:40:25.081289+0000","last_unstale":"2024-09-17T03:40:27.088744+0000","last_undegraded":"2024-09-17T03:40:27.088744+0000","last_fullsized":"2024-09-17T03:40:27.088744+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:37.306668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088329+0000","last_change":"2024-09-17T03:40:26.091947+0000","last_active":"2024-09-17T03:40:27.088329+0000","last_peered":"2024-09-17T03:40:27.088329+0000","last_clean":"2024-09-17T03:40:27.088329+0000","last_became_active":"2024-09-17T03:40:26.091584+0000","last_became_peered":"2024-09-17T03:40:26.091584+0000","last_unstale":"2024-09-17T03:40:27.088329+0000","last_undegraded":"2024-09-17T03:40:27.088329+0000","last_fullsized":"2024-09-17T03:40:27.088329+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:06.639855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651045+0000","last_change":"2024-09-17T03:40:25.085590+0000","last_active":"2024-09-17T03:40:27.651045+0000","last_peered":"2024-09-17T03:40:27.651045+0000","last_clean":"2024-09-17T03:40:27.651045+0000","last_became_active":"2024-09-17T03:40:25.085288+0000","last_became_peered":"2024-09-17T03:40:25.085288+0000","last_unstale":"2024-09-17T03:40:27.651045+0000","last_undegraded":"2024-09-17T03:40:27.651045+0000","last_fullsized":"2024-09-17T03:40:27.651045+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:51.070669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088908+0000","last_change":"2024-09-17T03:40:26.102801+0000","last_active":"2024-09-17T03:40:27.088908+0000","last_peered":"2024-09-17T03:40:27.088908+0000","last_clean":"2024-09-17T03:40:27.088908+0000","last_became_active":"2024-09-17T03:40:26.102488+0000","last_became_peered":"2024-09-17T03:40:26.102488+0000","last_unstale":"2024-09-17T03:40:27.088908+0000","last_undegraded":"2024-09-17T03:40:27.088908+0000","last_fullsized":"2024-09-17T03:40:27.088908+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:27.332049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088923+0000","last_change":"2024-09-17T03:40:25.092780+0000","last_active":"2024-09-17T03:40:27.088923+0000","last_peered":"2024-09-17T03:40:27.088923+0000","last_clean":"2024-09-17T03:40:27.088923+0000","last_became_active":"2024-09-17T03:40:25.092232+0000","last_became_peered":"2024-09-17T03:40:25.092232+0000","last_unstale":"2024-09-17T03:40:27.088923+0000","last_undegraded":"2024-09-17T03:40:27.088923+0000","last_fullsized":"2024-09-17T03:40:27.088923+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:22.778728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651203+0000","last_change":"2024-09-17T03:40:26.100233+0000","last_active":"2024-09-17T03:40:27.651203+0000","last_peered":"2024-09-17T03:40:27.651203+0000","last_clean":"2024-09-17T03:40:27.651203+0000","last_became_active":"2024-09-17T03:40:26.099953+0000","last_became_peered":"2024-09-17T03:40:26.099953+0000","last_unstale":"2024-09-17T03:40:27.651203+0000","last_undegraded":"2024-09-17T03:40:27.651203+0000","last_fullsized":"2024-09-17T03:40:27.651203+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:41.791243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092591+0000","last_change":"2024-09-17T03:40:25.090999+0000","last_active":"2024-09-17T03:40:27.092591+0000","last_peered":"2024-09-17T03:40:27.092591+0000","last_clean":"2024-09-17T03:40:27.092591+0000","last_became_active":"2024-09-17T03:40:25.090560+0000","last_became_peered":"2024-09-17T03:40:25.090560+0000","last_unstale":"2024-09-17T03:40:27.092591+0000","last_undegraded":"2024-09-17T03:40:27.092591+0000","last_fullsized":"2024-09-17T03:40:27.092591+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:15.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088983+0000","last_change":"2024-09-17T03:40:26.090039+0000","last_active":"2024-09-17T03:40:27.088983+0000","last_peered":"2024-09-17T03:40:27.088983+0000","last_clean":"2024-09-17T03:40:27.088983+0000","last_became_active":"2024-09-17T03:40:26.088910+0000","last_became_peered":"2024-09-17T03:40:26.088910+0000","last_unstale":"2024-09-17T03:40:27.088983+0000","last_undegraded":"2024-09-17T03:40:27.088983+0000","last_fullsized":"2024-09-17T03:40:27.088983+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:17.354715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651485+0000","last_change":"2024-09-17T03:40:25.088715+0000","last_active":"2024-09-17T03:40:27.651485+0000","last_peered":"2024-09-17T03:40:27.651485+0000","last_clean":"2024-09-17T03:40:27.651485+0000","last_became_active":"2024-09-17T03:40:25.088075+0000","last_became_peered":"2024-09-17T03:40:25.088075+0000","last_unstale":"2024-09-17T03:40:27.651485+0000","last_undegraded":"2024-09-17T03:40:27.651485+0000","last_fullsized":"2024-09-17T03:40:27.651485+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:53.318725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088606+0000","last_change":"2024-09-17T03:40:26.113739+0000","last_active":"2024-09-17T03:40:27.088606+0000","last_peered":"2024-09-17T03:40:27.088606+0000","last_clean":"2024-09-17T03:40:27.088606+0000","last_became_active":"2024-09-17T03:40:26.113370+0000","last_became_peered":"2024-09-17T03:40:26.113370+0000","last_unstale":"2024-09-17T03:40:27.088606+0000","last_undegraded":"2024-09-17T03:40:27.088606+0000","last_fullsized":"2024-09-17T03:40:27.088606+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:50.990280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"110'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093089+0000","last_change":"2024-09-17T03:40:25.092408+0000","last_active":"2024-09-17T03:40:27.093089+0000","last_peered":"2024-09-17T03:40:27.093089+0000","last_clean":"2024-09-17T03:40:27.093089+0000","last_became_active":"2024-09-17T03:40:25.092023+0000","last_became_peered":"2024-09-17T03:40:25.092023+0000","last_unstale":"2024-09-17T03:40:27.093089+0000","last_undegraded":"2024-09-17T03:40:27.093089+0000","last_fullsized":"2024-09-17T03:40:27.093089+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:39.144487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651583+0000","last_change":"2024-09-17T03:40:26.088167+0000","last_active":"2024-09-17T03:40:27.651583+0000","last_peered":"2024-09-17T03:40:27.651583+0000","last_clean":"2024-09-17T03:40:27.651583+0000","last_became_active":"2024-09-17T03:40:26.087880+0000","last_became_peered":"2024-09-17T03:40:26.087880+0000","last_unstale":"2024-09-17T03:40:27.651583+0000","last_undegraded":"2024-09-17T03:40:27.651583+0000","last_fullsized":"2024-09-17T03:40:27.651583+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:51.281251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093271+0000","last_change":"2024-09-17T03:40:25.088614+0000","last_active":"2024-09-17T03:40:27.093271+0000","last_peered":"2024-09-17T03:40:27.093271+0000","last_clean":"2024-09-17T03:40:27.093271+0000","last_became_active":"2024-09-17T03:40:25.088063+0000","last_became_peered":"2024-09-17T03:40:25.088063+0000","last_unstale":"2024-09-17T03:40:27.093271+0000","last_undegraded":"2024-09-17T03:40:27.093271+0000","last_fullsized":"2024-09-17T03:40:27.093271+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:27.806753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090554+0000","last_change":"2024-09-17T03:40:26.102432+0000","last_active":"2024-09-17T03:40:27.090554+0000","last_peered":"2024-09-17T03:40:27.090554+0000","last_clean":"2024-09-17T03:40:27.090554+0000","last_became_active":"2024-09-17T03:40:26.102112+0000","last_became_peered":"2024-09-17T03:40:26.102112+0000","last_unstale":"2024-09-17T03:40:27.090554+0000","last_undegraded":"2024-09-17T03:40:27.090554+0000","last_fullsized":"2024-09-17T03:40:27.090554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:19.302727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089175+0000","last_change":"2024-09-17T03:40:25.090603+0000","last_active":"2024-09-17T03:40:27.089175+0000","last_peered":"2024-09-17T03:40:27.089175+0000","last_clean":"2024-09-17T03:40:27.089175+0000","last_became_active":"2024-09-17T03:40:25.089547+0000","last_became_peered":"2024-09-17T03:40:25.089547+0000","last_unstale":"2024-09-17T03:40:27.089175+0000","last_undegraded":"2024-09-17T03:40:27.089175+0000","last_fullsized":"2024-09-17T03:40:27.089175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:33.772475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088899+0000","last_change":"2024-09-17T03:40:26.081819+0000","last_active":"2024-09-17T03:40:27.088899+0000","last_peered":"2024-09-17T03:40:27.088899+0000","last_clean":"2024-09-17T03:40:27.088899+0000","last_became_active":"2024-09-17T03:40:26.081449+0000","last_became_peered":"2024-09-17T03:40:26.081449+0000","last_unstale":"2024-09-17T03:40:27.088899+0000","last_undegraded":"2024-09-17T03:40:27.088899+0000","last_fullsized":"2024-09-17T03:40:27.088899+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:21.051497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093261+0000","last_change":"2024-09-17T03:40:25.094592+0000","last_active":"2024-09-17T03:40:27.093261+0000","last_peered":"2024-09-17T03:40:27.093261+0000","last_clean":"2024-09-17T03:40:27.093261+0000","last_became_active":"2024-09-17T03:40:25.094042+0000","last_became_peered":"2024-09-17T03:40:25.094042+0000","last_unstale":"2024-09-17T03:40:27.093261+0000","last_undegraded":"2024-09-17T03:40:27.093261+0000","last_fullsized":"2024-09-17T03:40:27.093261+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:30.892412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650978+0000","last_change":"2024-09-17T03:40:26.105066+0000","last_active":"2024-09-17T03:40:27.650978+0000","last_peered":"2024-09-17T03:40:27.650978+0000","last_clean":"2024-09-17T03:40:27.650978+0000","last_became_active":"2024-09-17T03:40:26.104744+0000","last_became_peered":"2024-09-17T03:40:26.104744+0000","last_unstale":"2024-09-17T03:40:27.650978+0000","last_undegraded":"2024-09-17T03:40:27.650978+0000","last_fullsized":"2024-09-17T03:40:27.650978+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:26.552280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650999+0000","last_change":"2024-09-17T03:40:25.091754+0000","last_active":"2024-09-17T03:40:27.650999+0000","last_peered":"2024-09-17T03:40:27.650999+0000","last_clean":"2024-09-17T03:40:27.650999+0000","last_became_active":"2024-09-17T03:40:25.091404+0000","last_became_peered":"2024-09-17T03:40:25.091404+0000","last_unstale":"2024-09-17T03:40:27.650999+0000","last_undegraded":"2024-09-17T03:40:27.650999+0000","last_fullsized":"2024-09-17T03:40:27.650999+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:54.401051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092686+0000","last_change":"2024-09-17T03:40:26.095493+0000","last_active":"2024-09-17T03:40:27.092686+0000","last_peered":"2024-09-17T03:40:27.092686+0000","last_clean":"2024-09-17T03:40:27.092686+0000","last_became_active":"2024-09-17T03:40:26.095167+0000","last_became_peered":"2024-09-17T03:40:26.095167+0000","last_unstale":"2024-09-17T03:40:27.092686+0000","last_undegraded":"2024-09-17T03:40:27.092686+0000","last_fullsized":"2024-09-17T03:40:27.092686+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:00.202701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651724+0000","last_change":"2024-09-17T03:40:25.094752+0000","last_active":"2024-09-17T03:40:27.651724+0000","last_peered":"2024-09-17T03:40:27.651724+0000","last_clean":"2024-09-17T03:40:27.651724+0000","last_became_active":"2024-09-17T03:40:25.094409+0000","last_became_peered":"2024-09-17T03:40:25.094409+0000","last_unstale":"2024-09-17T03:40:27.651724+0000","last_undegraded":"2024-09-17T03:40:27.651724+0000","last_fullsized":"2024-09-17T03:40:27.651724+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:59.015131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089551+0000","last_change":"2024-09-17T03:40:26.081960+0000","last_active":"2024-09-17T03:40:27.089551+0000","last_peered":"2024-09-17T03:40:27.089551+0000","last_clean":"2024-09-17T03:40:27.089551+0000","last_became_active":"2024-09-17T03:40:26.081649+0000","last_became_peered":"2024-09-17T03:40:26.081649+0000","last_unstale":"2024-09-17T03:40:27.089551+0000","last_undegraded":"2024-09-17T03:40:27.089551+0000","last_fullsized":"2024-09-17T03:40:27.089551+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.491879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092726+0000","last_change":"2024-09-17T03:40:25.082332+0000","last_active":"2024-09-17T03:40:27.092726+0000","last_peered":"2024-09-17T03:40:27.092726+0000","last_clean":"2024-09-17T03:40:27.092726+0000","last_became_active":"2024-09-17T03:40:25.082030+0000","last_became_peered":"2024-09-17T03:40:25.082030+0000","last_unstale":"2024-09-17T03:40:27.092726+0000","last_undegraded":"2024-09-17T03:40:27.092726+0000","last_fullsized":"2024-09-17T03:40:27.092726+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:26.233960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092728+0000","last_change":"2024-09-17T03:40:26.097480+0000","last_active":"2024-09-17T03:40:27.092728+0000","last_peered":"2024-09-17T03:40:27.092728+0000","last_clean":"2024-09-17T03:40:27.092728+0000","last_became_active":"2024-09-17T03:40:26.096671+0000","last_became_peered":"2024-09-17T03:40:26.096671+0000","last_unstale":"2024-09-17T03:40:27.092728+0000","last_undegraded":"2024-09-17T03:40:27.092728+0000","last_fullsized":"2024-09-17T03:40:27.092728+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:51.650601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"109'8","reported_seq":23,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088699+0000","last_change":"2024-09-17T03:40:25.084933+0000","last_active":"2024-09-17T03:40:27.088699+0000","last_peered":"2024-09-17T03:40:27.088699+0000","last_clean":"2024-09-17T03:40:27.088699+0000","last_became_active":"2024-09-17T03:40:25.084571+0000","last_became_peered":"2024-09-17T03:40:25.084571+0000","last_unstale":"2024-09-17T03:40:27.088699+0000","last_undegraded":"2024-09-17T03:40:27.088699+0000","last_fullsized":"2024-09-17T03:40:27.088699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:55.687864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":276,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650288+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:40:27.650288+0000","last_peered":"2024-09-17T03:40:27.650288+0000","last_clean":"2024-09-17T03:40:27.650288+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:40:27.650288+0000","last_undegraded":"2024-09-17T03:40:27.650288+0000","last_fullsized":"2024-09-17T03:40:27.650288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":627099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1368064,"data_stored":627121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509504,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33116,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338724,"statfs":{"total":96636764160,"available":96602853376,"internally_reserved":0,"allocated":1970176,"data_stored":1219079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509506,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1368064,"data_stored":627189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":629293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509505,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33116,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338724,"statfs":{"total":96636764160,"available":96602853376,"internally_reserved":0,"allocated":1966080,"data_stored":1217627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1376256,"data_stored":627785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1372160,"data_stored":627155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:31.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:40:31.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.732+0000 7f6787200640 1 -- 172.21.15.121:0/526992094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f678815e5e0 msgr2=0x7f67880ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:31.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.732+0000 7f6787200640 1 --2- 172.21.15.121:0/526992094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f678815e5e0 0x7f67880ceed0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f67880cfb10 tx=0x7f677002a540 comp rx=0 tx=0).stop 2024-09-17T03:40:31.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.732+0000 7f6787200640 1 -- 172.21.15.121:0/526992094 shutdown_connections 2024-09-17T03:40:31.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.732+0000 7f6787200640 1 --2- 172.21.15.121:0/526992094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f678815e5e0 0x7f67880ceed0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.732+0000 7f6787200640 1 --2- 172.21.15.121:0/526992094 >> v2:172.21.15.176:3300/0 conn(0x7f67880d07e0 0x7f678815f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.732+0000 7f6787200640 1 -- 172.21.15.121:0/526992094 >> 172.21.15.121:0/526992094 conn(0x7f67880b4130 msgr2=0x7f67880b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:31.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.732+0000 7f6787200640 1 -- 172.21.15.121:0/526992094 shutdown_connections 2024-09-17T03:40:31.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.732+0000 7f6787200640 1 -- 172.21.15.121:0/526992094 wait complete. 2024-09-17T03:40:31.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.734+0000 7f6787200640 1 Processor -- start 2024-09-17T03:40:31.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.734+0000 7f6787200640 1 -- start start 2024-09-17T03:40:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.735+0000 7f6787200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67880cf410 0x7f678815c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:31.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.735+0000 7f6787200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67880d07e0 0x7f67880b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.735+0000 7f6787200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f678815e5e0 0x7f67880b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.735+0000 7f6787200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f67881629a0 con 0x7f678815e5e0 2024-09-17T03:40:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.735+0000 7f6787200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f678806fa30 con 0x7f67880cf410 2024-09-17T03:40:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.735+0000 7f6787200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6788162b20 con 0x7f67880d07e0 2024-09-17T03:40:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.736+0000 7f6786800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f678815e5e0 0x7f67880b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.736+0000 7f6786800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f678815e5e0 0x7f67880b65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34374/0 (socket says 172.21.15.121:34374) 2024-09-17T03:40:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.736+0000 7f6786800640 1 -- 172.21.15.121:0/864642902 learned_addr learned my addr 172.21.15.121:0/864642902 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.736+0000 7f6785e00640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67880cf410 0x7f678815c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:31.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.736+0000 7f677d400640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67880d07e0 0x7f67880b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:31.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.736+0000 7f6786800640 1 -- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67880d07e0 msgr2=0x7f67880b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:31.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.736+0000 7f6786800640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67880d07e0 0x7f67880b79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.736+0000 7f6786800640 1 -- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67880cf410 msgr2=0x7f678815c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:31.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.736+0000 7f6786800640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67880cf410 0x7f678815c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.736+0000 7f6786800640 1 -- 172.21.15.121:0/864642902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67880cbb30 con 0x7f678815e5e0 2024-09-17T03:40:31.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.737+0000 7f6786800640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f678815e5e0 0x7f67880b65d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f678000c6c0 tx=0x7f678000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:31.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.737+0000 7f677ea00640 1 -- 172.21.15.121:0/864642902 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780017070 con 0x7f678815e5e0 2024-09-17T03:40:31.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.737+0000 7f677ea00640 1 -- 172.21.15.121:0/864642902 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6780003c60 con 0x7f678815e5e0 2024-09-17T03:40:31.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.737+0000 7f6787200640 1 -- 172.21.15.121:0/864642902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f678815c960 con 0x7f678815e5e0 2024-09-17T03:40:31.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.737+0000 7f677ea00640 1 -- 172.21.15.121:0/864642902 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67800052d0 con 0x7f678815e5e0 2024-09-17T03:40:31.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.737+0000 7f6787200640 1 -- 172.21.15.121:0/864642902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67880cc0c0 con 0x7f678815e5e0 2024-09-17T03:40:31.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.738+0000 7f6787200640 1 -- 172.21.15.121:0/864642902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6788162fd0 con 0x7f678815e5e0 2024-09-17T03:40:31.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.739+0000 7f677ea00640 1 -- 172.21.15.121:0/864642902 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f678001a070 con 0x7f678815e5e0 2024-09-17T03:40:31.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.741+0000 7f677ea00640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6764078bc0 0x7f676407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:31.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.741+0000 7f677ea00640 1 -- 172.21.15.121:0/864642902 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f678009a470 con 0x7f678815e5e0 2024-09-17T03:40:31.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.741+0000 7f6785e00640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6764078bc0 0x7f676407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:31.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.742+0000 7f6785e00640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6764078bc0 0x7f676407b0d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f677800bb50 tx=0x7f677800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:31.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.746+0000 7f677ea00640 1 -- 172.21.15.121:0/864642902 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f678815fc60 con 0x7f678815e5e0 2024-09-17T03:40:31.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.996+0000 7f6787200640 1 -- 172.21.15.121:0/864642902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f678806fdc0 con 0x7f678815e5e0 2024-09-17T03:40:31.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.997+0000 7f677ea00640 1 -- 172.21.15.121:0/864642902 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1560 (secure 0 0 0) 0x7f67800620d0 con 0x7f678815e5e0 2024-09-17T03:40:31.997 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:31.997 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":327,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":110,"num_osds":8,"num_up_osds":8,"osd_up_since":1726544120,"num_in_osds":8,"osd_in_since":1726544109,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":58},{"state_name":"active+clean","count":39}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":590402,"bytes_used":267415552,"bytes_avail":772826697728,"bytes_total":773094113280,"inactive_pgs_ratio":0.59793812036514282,"write_bytes_sec":1353,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":77,"btime":"2024-09-17T03:40:29:090893+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":7095}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-17T03:40:13.351110+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:40:31.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 -- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6764078bc0 msgr2=0x7f676407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:31.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6764078bc0 0x7f676407b0d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f677800bb50 tx=0x7f677800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:40:31.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 -- 172.21.15.121:0/864642902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f678815e5e0 msgr2=0x7f67880b65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:31.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f678815e5e0 0x7f67880b65d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f678000c6c0 tx=0x7f678000cb80 comp rx=0 tx=0).stop 2024-09-17T03:40:32.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 -- 172.21.15.121:0/864642902 shutdown_connections 2024-09-17T03:40:32.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6764078bc0 0x7f676407b0d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f678815e5e0 0x7f67880b65d0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67880d07e0 0x7f67880b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 --2- 172.21.15.121:0/864642902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67880cf410 0x7f678815c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 -- 172.21.15.121:0/864642902 >> 172.21.15.121:0/864642902 conn(0x7f67880b4130 msgr2=0x7f67880712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:32.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 -- 172.21.15.121:0/864642902 shutdown_connections 2024-09-17T03:40:32.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:31.999+0000 7f6787200640 1 -- 172.21.15.121:0/864642902 wait complete. 2024-09-17T03:40:32.025 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:40:32.026 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:32.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.250+0000 7fccf5a00640 1 -- 172.21.15.121:0/2429532206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccf0070810 msgr2=0x7fccf00b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:32.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.250+0000 7fccf5a00640 1 --2- 172.21.15.121:0/2429532206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccf0070810 0x7fccf00b4c80 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fccf0146350 tx=0x7fcce002a560 comp rx=0 tx=0).stop 2024-09-17T03:40:32.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.250+0000 7fccf5a00640 1 -- 172.21.15.121:0/2429532206 shutdown_connections 2024-09-17T03:40:32.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.250+0000 7fccf5a00640 1 --2- 172.21.15.121:0/2429532206 >> v2:172.21.15.176:3300/0 conn(0x7fccf01606c0 0x7fccf015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.250+0000 7fccf5a00640 1 --2- 172.21.15.121:0/2429532206 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccf00b51c0 0x7fccf0160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.250+0000 7fccf5a00640 1 --2- 172.21.15.121:0/2429532206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccf0070810 0x7fccf00b4c80 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.250+0000 7fccf5a00640 1 -- 172.21.15.121:0/2429532206 >> 172.21.15.121:0/2429532206 conn(0x7fccf00b2440 msgr2=0x7fccf00d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:32.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.250+0000 7fccf5a00640 1 -- 172.21.15.121:0/2429532206 shutdown_connections 2024-09-17T03:40:32.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.250+0000 7fccf5a00640 1 -- 172.21.15.121:0/2429532206 wait complete. 2024-09-17T03:40:32.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.252+0000 7fccf5a00640 1 Processor -- start 2024-09-17T03:40:32.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.253+0000 7fccf5a00640 1 -- start start 2024-09-17T03:40:32.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.254+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccf0070810 0x7fccf009cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:32.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.254+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccf00b51c0 0x7fccf01f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:32.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.254+0000 7fccf5a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccf01606c0 0x7fccf00ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:32.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.254+0000 7fccf5a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fccf00b30b0 con 0x7fccf00b51c0 2024-09-17T03:40:32.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.254+0000 7fccf5a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fccf006f000 con 0x7fccf01606c0 2024-09-17T03:40:32.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.254+0000 7fccf5a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fccf015d0d0 con 0x7fccf0070810 2024-09-17T03:40:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.254+0000 7fccef400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccf00b51c0 0x7fccf01f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccef400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccf00b51c0 0x7fccf01f8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38776/0 (socket says 172.21.15.121:38776) 2024-09-17T03:40:32.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccef400640 1 -- 172.21.15.121:0/3836756986 learned_addr learned my addr 172.21.15.121:0/3836756986 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:32.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccefe00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccf0070810 0x7fccf009cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:32.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccf5000640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccf01606c0 0x7fccf00ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:32.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccef400640 1 -- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccf0070810 msgr2=0x7fccf009cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:32.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccef400640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccf0070810 0x7fccf009cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccef400640 1 -- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccf01606c0 msgr2=0x7fccf00ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:32.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccef400640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccf01606c0 0x7fccf00ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccef400640 1 -- 172.21.15.121:0/3836756986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf009be40 con 0x7fccf00b51c0 2024-09-17T03:40:32.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccefe00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccf0070810 0x7fccf009cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:32.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccf5000640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccf01606c0 0x7fccf00ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:32.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fccef400640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccf00b51c0 0x7fccf01f8e30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00e7c0 tx=0x7fccdc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:32.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fcce7e00640 1 -- 172.21.15.121:0/3836756986 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00ccc0 con 0x7fccf00b51c0 2024-09-17T03:40:32.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fcce7e00640 1 -- 172.21.15.121:0/3836756986 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccdc00ce60 con 0x7fccf00b51c0 2024-09-17T03:40:32.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.255+0000 7fcce7e00640 1 -- 172.21.15.121:0/3836756986 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc005280 con 0x7fccf00b51c0 2024-09-17T03:40:32.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.256+0000 7fccf5a00640 1 -- 172.21.15.121:0/3836756986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf009c120 con 0x7fccf00b51c0 2024-09-17T03:40:32.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.256+0000 7fccf5a00640 1 -- 172.21.15.121:0/3836756986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf009c6e0 con 0x7fccf00b51c0 2024-09-17T03:40:32.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.257+0000 7fccf5a00640 1 -- 172.21.15.121:0/3836756986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf0160180 con 0x7fccf00b51c0 2024-09-17T03:40:32.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.258+0000 7fcce7e00640 1 -- 172.21.15.121:0/3836756986 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fccdc005420 con 0x7fccf00b51c0 2024-09-17T03:40:32.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.259+0000 7fcce7e00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccd0078b90 0x7fccd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:32.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.259+0000 7fcce7e00640 1 -- 172.21.15.121:0/3836756986 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7fccdc09b990 con 0x7fccf00b51c0 2024-09-17T03:40:32.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.259+0000 7fccefe00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccd0078b90 0x7fccd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:32.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.260+0000 7fccefe00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccd0078b90 0x7fccd007b0a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcce0033000 tx=0x7fcce0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:32.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.263+0000 7fcce7e00640 1 -- 172.21.15.121:0/3836756986 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fccdc063ba0 con 0x7fccf00b51c0 2024-09-17T03:40:32.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.443+0000 7fccf5a00640 1 -- 172.21.15.121:0/3836756986 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fccf00b1160 con 0x7fccd0078b90 2024-09-17T03:40:32.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.448+0000 7fcce7e00640 1 -- 172.21.15.121:0/3836756986 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252476 (secure 0 0 0) 0x7fccf00b1160 con 0x7fccd0078b90 2024-09-17T03:40:32.451 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:32.453 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:40:32.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.452+0000 7fccf5a00640 1 -- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccd0078b90 msgr2=0x7fccd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:32.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.452+0000 7fccf5a00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccd0078b90 0x7fccd007b0a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcce0033000 tx=0x7fcce0004730 comp rx=0 tx=0).stop 2024-09-17T03:40:32.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.452+0000 7fccf5a00640 1 -- 172.21.15.121:0/3836756986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccf00b51c0 msgr2=0x7fccf01f8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:32.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.452+0000 7fccf5a00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccf00b51c0 0x7fccf01f8e30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00e7c0 tx=0x7fccdc00ec80 comp rx=0 tx=0).stop 2024-09-17T03:40:32.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.453+0000 7fccf5a00640 1 -- 172.21.15.121:0/3836756986 shutdown_connections 2024-09-17T03:40:32.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.453+0000 7fccf5a00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccf01606c0 0x7fccf00ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.453+0000 7fccf5a00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fccd0078b90 0x7fccd007b0a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.453+0000 7fccf5a00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccf00b51c0 0x7fccf01f8e30 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.453+0000 7fccf5a00640 1 --2- 172.21.15.121:0/3836756986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccf0070810 0x7fccf009cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:32.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.453+0000 7fccf5a00640 1 -- 172.21.15.121:0/3836756986 >> 172.21.15.121:0/3836756986 conn(0x7fccf00b2440 msgr2=0x7fccf00acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:32.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.453+0000 7fccf5a00640 1 -- 172.21.15.121:0/3836756986 shutdown_connections 2024-09-17T03:40:32.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:32.453+0000 7fccf5a00640 1 -- 172.21.15.121:0/3836756986 wait complete. 2024-09-17T03:40:32.474 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-09-17T03:40:31.355024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261428,"kb_used_data":11880,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713292,"statfs":{"total":773094113280,"available":772826411008,"internally_reserved":0,"allocated":12165120,"data_stored":6202348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.288854"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650729+0000","last_change":"2024-09-17T03:40:26.104394+0000","last_active":"2024-09-17T03:40:27.650729+0000","last_peered":"2024-09-17T03:40:27.650729+0000","last_clean":"2024-09-17T03:40:27.650729+0000","last_became_active":"2024-09-17T03:40:26.104103+0000","last_became_peered":"2024-09-17T03:40:26.104103+0000","last_unstale":"2024-09-17T03:40:27.650729+0000","last_undegraded":"2024-09-17T03:40:27.650729+0000","last_fullsized":"2024-09-17T03:40:27.650729+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:22.257905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651768+0000","last_change":"2024-09-17T03:40:26.094096+0000","last_active":"2024-09-17T03:40:27.651768+0000","last_peered":"2024-09-17T03:40:27.651768+0000","last_clean":"2024-09-17T03:40:27.651768+0000","last_became_active":"2024-09-17T03:40:26.093659+0000","last_became_peered":"2024-09-17T03:40:26.093659+0000","last_unstale":"2024-09-17T03:40:27.651768+0000","last_undegraded":"2024-09-17T03:40:27.651768+0000","last_fullsized":"2024-09-17T03:40:27.651768+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:42.242012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088321+0000","last_change":"2024-09-17T03:40:26.091185+0000","last_active":"2024-09-17T03:40:27.088321+0000","last_peered":"2024-09-17T03:40:27.088321+0000","last_clean":"2024-09-17T03:40:27.088321+0000","last_became_active":"2024-09-17T03:40:26.089487+0000","last_became_peered":"2024-09-17T03:40:26.089487+0000","last_unstale":"2024-09-17T03:40:27.088321+0000","last_undegraded":"2024-09-17T03:40:27.088321+0000","last_fullsized":"2024-09-17T03:40:27.088321+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:30.078377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651499+0000","last_change":"2024-09-17T03:40:26.099256+0000","last_active":"2024-09-17T03:40:27.651499+0000","last_peered":"2024-09-17T03:40:27.651499+0000","last_clean":"2024-09-17T03:40:27.651499+0000","last_became_active":"2024-09-17T03:40:26.098909+0000","last_became_peered":"2024-09-17T03:40:26.098909+0000","last_unstale":"2024-09-17T03:40:27.651499+0000","last_undegraded":"2024-09-17T03:40:27.651499+0000","last_fullsized":"2024-09-17T03:40:27.651499+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:41.846363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092866+0000","last_change":"2024-09-17T03:40:26.097812+0000","last_active":"2024-09-17T03:40:27.092866+0000","last_peered":"2024-09-17T03:40:27.092866+0000","last_clean":"2024-09-17T03:40:27.092866+0000","last_became_active":"2024-09-17T03:40:26.097069+0000","last_became_peered":"2024-09-17T03:40:26.097069+0000","last_unstale":"2024-09-17T03:40:27.092866+0000","last_undegraded":"2024-09-17T03:40:27.092866+0000","last_fullsized":"2024-09-17T03:40:27.092866+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:36.982485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650962+0000","last_change":"2024-09-17T03:40:26.095825+0000","last_active":"2024-09-17T03:40:27.650962+0000","last_peered":"2024-09-17T03:40:27.650962+0000","last_clean":"2024-09-17T03:40:27.650962+0000","last_became_active":"2024-09-17T03:40:26.095423+0000","last_became_peered":"2024-09-17T03:40:26.095423+0000","last_unstale":"2024-09-17T03:40:27.650962+0000","last_undegraded":"2024-09-17T03:40:27.650962+0000","last_fullsized":"2024-09-17T03:40:27.650962+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:59.341049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651145+0000","last_change":"2024-09-17T03:40:26.105189+0000","last_active":"2024-09-17T03:40:27.651145+0000","last_peered":"2024-09-17T03:40:27.651145+0000","last_clean":"2024-09-17T03:40:27.651145+0000","last_became_active":"2024-09-17T03:40:26.104891+0000","last_became_peered":"2024-09-17T03:40:26.104891+0000","last_unstale":"2024-09-17T03:40:27.651145+0000","last_undegraded":"2024-09-17T03:40:27.651145+0000","last_fullsized":"2024-09-17T03:40:27.651145+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:15.647694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088282+0000","last_change":"2024-09-17T03:40:26.082958+0000","last_active":"2024-09-17T03:40:27.088282+0000","last_peered":"2024-09-17T03:40:27.088282+0000","last_clean":"2024-09-17T03:40:27.088282+0000","last_became_active":"2024-09-17T03:40:26.082410+0000","last_became_peered":"2024-09-17T03:40:26.082410+0000","last_unstale":"2024-09-17T03:40:27.088282+0000","last_undegraded":"2024-09-17T03:40:27.088282+0000","last_fullsized":"2024-09-17T03:40:27.088282+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:01.976092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651700+0000","last_change":"2024-09-17T03:40:26.083248+0000","last_active":"2024-09-17T03:40:27.651700+0000","last_peered":"2024-09-17T03:40:27.651700+0000","last_clean":"2024-09-17T03:40:27.651700+0000","last_became_active":"2024-09-17T03:40:26.082949+0000","last_became_peered":"2024-09-17T03:40:26.082949+0000","last_unstale":"2024-09-17T03:40:27.651700+0000","last_undegraded":"2024-09-17T03:40:27.651700+0000","last_fullsized":"2024-09-17T03:40:27.651700+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:05.438754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651477+0000","last_change":"2024-09-17T03:40:26.098420+0000","last_active":"2024-09-17T03:40:27.651477+0000","last_peered":"2024-09-17T03:40:27.651477+0000","last_clean":"2024-09-17T03:40:27.651477+0000","last_became_active":"2024-09-17T03:40:26.097511+0000","last_became_peered":"2024-09-17T03:40:26.097511+0000","last_unstale":"2024-09-17T03:40:27.651477+0000","last_undegraded":"2024-09-17T03:40:27.651477+0000","last_fullsized":"2024-09-17T03:40:27.651477+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:05.438754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650427+0000","last_change":"2024-09-17T03:40:26.098502+0000","last_active":"2024-09-17T03:40:27.650427+0000","last_peered":"2024-09-17T03:40:27.650427+0000","last_clean":"2024-09-17T03:40:27.650427+0000","last_became_active":"2024-09-17T03:40:26.096026+0000","last_became_peered":"2024-09-17T03:40:26.096026+0000","last_unstale":"2024-09-17T03:40:27.650427+0000","last_undegraded":"2024-09-17T03:40:27.650427+0000","last_fullsized":"2024-09-17T03:40:27.650427+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:40.307739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088437+0000","last_change":"2024-09-17T03:40:26.097670+0000","last_active":"2024-09-17T03:40:27.088437+0000","last_peered":"2024-09-17T03:40:27.088437+0000","last_clean":"2024-09-17T03:40:27.088437+0000","last_became_active":"2024-09-17T03:40:26.097275+0000","last_became_peered":"2024-09-17T03:40:26.097275+0000","last_unstale":"2024-09-17T03:40:27.088437+0000","last_undegraded":"2024-09-17T03:40:27.088437+0000","last_fullsized":"2024-09-17T03:40:27.088437+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:12.630071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651101+0000","last_change":"2024-09-17T03:40:26.110554+0000","last_active":"2024-09-17T03:40:27.651101+0000","last_peered":"2024-09-17T03:40:27.651101+0000","last_clean":"2024-09-17T03:40:27.651101+0000","last_became_active":"2024-09-17T03:40:26.110220+0000","last_became_peered":"2024-09-17T03:40:26.110220+0000","last_unstale":"2024-09-17T03:40:27.651101+0000","last_undegraded":"2024-09-17T03:40:27.651101+0000","last_fullsized":"2024-09-17T03:40:27.651101+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:18.161357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088079+0000","last_change":"2024-09-17T03:40:26.092267+0000","last_active":"2024-09-17T03:40:27.088079+0000","last_peered":"2024-09-17T03:40:27.088079+0000","last_clean":"2024-09-17T03:40:27.088079+0000","last_became_active":"2024-09-17T03:40:26.091626+0000","last_became_peered":"2024-09-17T03:40:26.091626+0000","last_unstale":"2024-09-17T03:40:27.088079+0000","last_undegraded":"2024-09-17T03:40:27.088079+0000","last_fullsized":"2024-09-17T03:40:27.088079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:08.779819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650063+0000","last_change":"2024-09-17T03:40:26.093069+0000","last_active":"2024-09-17T03:40:27.650063+0000","last_peered":"2024-09-17T03:40:27.650063+0000","last_clean":"2024-09-17T03:40:27.650063+0000","last_became_active":"2024-09-17T03:40:26.092786+0000","last_became_peered":"2024-09-17T03:40:26.092786+0000","last_unstale":"2024-09-17T03:40:27.650063+0000","last_undegraded":"2024-09-17T03:40:27.650063+0000","last_fullsized":"2024-09-17T03:40:27.650063+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:18.161357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088077+0000","last_change":"2024-09-17T03:40:26.078819+0000","last_active":"2024-09-17T03:40:27.088077+0000","last_peered":"2024-09-17T03:40:27.088077+0000","last_clean":"2024-09-17T03:40:27.088077+0000","last_became_active":"2024-09-17T03:40:26.078101+0000","last_became_peered":"2024-09-17T03:40:26.078101+0000","last_unstale":"2024-09-17T03:40:27.088077+0000","last_undegraded":"2024-09-17T03:40:27.088077+0000","last_fullsized":"2024-09-17T03:40:27.088077+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:00.305840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089278+0000","last_change":"2024-09-17T03:40:26.092932+0000","last_active":"2024-09-17T03:40:27.089278+0000","last_peered":"2024-09-17T03:40:27.089278+0000","last_clean":"2024-09-17T03:40:27.089278+0000","last_became_active":"2024-09-17T03:40:26.092577+0000","last_became_peered":"2024-09-17T03:40:26.092577+0000","last_unstale":"2024-09-17T03:40:27.089278+0000","last_undegraded":"2024-09-17T03:40:27.089278+0000","last_fullsized":"2024-09-17T03:40:27.089278+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:03.614338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089666+0000","last_change":"2024-09-17T03:40:26.092395+0000","last_active":"2024-09-17T03:40:27.089666+0000","last_peered":"2024-09-17T03:40:27.089666+0000","last_clean":"2024-09-17T03:40:27.089666+0000","last_became_active":"2024-09-17T03:40:26.091948+0000","last_became_peered":"2024-09-17T03:40:26.091948+0000","last_unstale":"2024-09-17T03:40:27.089666+0000","last_undegraded":"2024-09-17T03:40:27.089666+0000","last_fullsized":"2024-09-17T03:40:27.089666+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:51.069412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092961+0000","last_change":"2024-09-17T03:40:26.099508+0000","last_active":"2024-09-17T03:40:27.092961+0000","last_peered":"2024-09-17T03:40:27.092961+0000","last_clean":"2024-09-17T03:40:27.092961+0000","last_became_active":"2024-09-17T03:40:26.099176+0000","last_became_peered":"2024-09-17T03:40:26.099176+0000","last_unstale":"2024-09-17T03:40:27.092961+0000","last_undegraded":"2024-09-17T03:40:27.092961+0000","last_fullsized":"2024-09-17T03:40:27.092961+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.696754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651138+0000","last_change":"2024-09-17T03:40:26.098607+0000","last_active":"2024-09-17T03:40:27.651138+0000","last_peered":"2024-09-17T03:40:27.651138+0000","last_clean":"2024-09-17T03:40:27.651138+0000","last_became_active":"2024-09-17T03:40:26.097785+0000","last_became_peered":"2024-09-17T03:40:26.097785+0000","last_unstale":"2024-09-17T03:40:27.651138+0000","last_undegraded":"2024-09-17T03:40:27.651138+0000","last_fullsized":"2024-09-17T03:40:27.651138+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:41.846363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093254+0000","last_change":"2024-09-17T03:40:26.100454+0000","last_active":"2024-09-17T03:40:27.093254+0000","last_peered":"2024-09-17T03:40:27.093254+0000","last_clean":"2024-09-17T03:40:27.093254+0000","last_became_active":"2024-09-17T03:40:26.100168+0000","last_became_peered":"2024-09-17T03:40:26.100168+0000","last_unstale":"2024-09-17T03:40:27.093254+0000","last_undegraded":"2024-09-17T03:40:27.093254+0000","last_fullsized":"2024-09-17T03:40:27.093254+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:54.210140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650704+0000","last_change":"2024-09-17T03:40:26.087836+0000","last_active":"2024-09-17T03:40:27.650704+0000","last_peered":"2024-09-17T03:40:27.650704+0000","last_clean":"2024-09-17T03:40:27.650704+0000","last_became_active":"2024-09-17T03:40:26.087513+0000","last_became_peered":"2024-09-17T03:40:26.087513+0000","last_unstale":"2024-09-17T03:40:27.650704+0000","last_undegraded":"2024-09-17T03:40:27.650704+0000","last_fullsized":"2024-09-17T03:40:27.650704+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:51.281251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650095+0000","last_change":"2024-09-17T03:40:26.092289+0000","last_active":"2024-09-17T03:40:27.650095+0000","last_peered":"2024-09-17T03:40:27.650095+0000","last_clean":"2024-09-17T03:40:27.650095+0000","last_became_active":"2024-09-17T03:40:26.091963+0000","last_became_peered":"2024-09-17T03:40:26.091963+0000","last_unstale":"2024-09-17T03:40:27.650095+0000","last_undegraded":"2024-09-17T03:40:27.650095+0000","last_fullsized":"2024-09-17T03:40:27.650095+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:41.846363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650115+0000","last_change":"2024-09-17T03:40:26.088606+0000","last_active":"2024-09-17T03:40:27.650115+0000","last_peered":"2024-09-17T03:40:27.650115+0000","last_clean":"2024-09-17T03:40:27.650115+0000","last_became_active":"2024-09-17T03:40:26.088322+0000","last_became_peered":"2024-09-17T03:40:26.088322+0000","last_unstale":"2024-09-17T03:40:27.650115+0000","last_undegraded":"2024-09-17T03:40:27.650115+0000","last_fullsized":"2024-09-17T03:40:27.650115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:40.496150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650885+0000","last_change":"2024-09-17T03:40:26.097257+0000","last_active":"2024-09-17T03:40:27.650885+0000","last_peered":"2024-09-17T03:40:27.650885+0000","last_clean":"2024-09-17T03:40:27.650885+0000","last_became_active":"2024-09-17T03:40:26.096887+0000","last_became_peered":"2024-09-17T03:40:26.096887+0000","last_unstale":"2024-09-17T03:40:27.650885+0000","last_undegraded":"2024-09-17T03:40:27.650885+0000","last_fullsized":"2024-09-17T03:40:27.650885+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:10.862380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090544+0000","last_change":"2024-09-17T03:40:26.098599+0000","last_active":"2024-09-17T03:40:27.090544+0000","last_peered":"2024-09-17T03:40:27.090544+0000","last_clean":"2024-09-17T03:40:27.090544+0000","last_became_active":"2024-09-17T03:40:26.098250+0000","last_became_peered":"2024-09-17T03:40:26.098250+0000","last_unstale":"2024-09-17T03:40:27.090544+0000","last_undegraded":"2024-09-17T03:40:27.090544+0000","last_fullsized":"2024-09-17T03:40:27.090544+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:31.185943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093083+0000","last_change":"2024-09-17T03:40:26.109226+0000","last_active":"2024-09-17T03:40:27.093083+0000","last_peered":"2024-09-17T03:40:27.093083+0000","last_clean":"2024-09-17T03:40:27.093083+0000","last_became_active":"2024-09-17T03:40:26.108900+0000","last_became_peered":"2024-09-17T03:40:26.108900+0000","last_unstale":"2024-09-17T03:40:27.093083+0000","last_undegraded":"2024-09-17T03:40:27.093083+0000","last_fullsized":"2024-09-17T03:40:27.093083+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:57.101219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088711+0000","last_change":"2024-09-17T03:40:26.097245+0000","last_active":"2024-09-17T03:40:27.088711+0000","last_peered":"2024-09-17T03:40:27.088711+0000","last_clean":"2024-09-17T03:40:27.088711+0000","last_became_active":"2024-09-17T03:40:26.096639+0000","last_became_peered":"2024-09-17T03:40:26.096639+0000","last_unstale":"2024-09-17T03:40:27.088711+0000","last_undegraded":"2024-09-17T03:40:27.088711+0000","last_fullsized":"2024-09-17T03:40:27.088711+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:53.112032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090143+0000","last_change":"2024-09-17T03:40:26.092527+0000","last_active":"2024-09-17T03:40:27.090143+0000","last_peered":"2024-09-17T03:40:27.090143+0000","last_clean":"2024-09-17T03:40:27.090143+0000","last_became_active":"2024-09-17T03:40:26.092128+0000","last_became_peered":"2024-09-17T03:40:26.092128+0000","last_unstale":"2024-09-17T03:40:27.090143+0000","last_undegraded":"2024-09-17T03:40:27.090143+0000","last_fullsized":"2024-09-17T03:40:27.090143+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:33.591545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088328+0000","last_change":"2024-09-17T03:40:26.092968+0000","last_active":"2024-09-17T03:40:27.088328+0000","last_peered":"2024-09-17T03:40:27.088328+0000","last_clean":"2024-09-17T03:40:27.088328+0000","last_became_active":"2024-09-17T03:40:26.092596+0000","last_became_peered":"2024-09-17T03:40:26.092596+0000","last_unstale":"2024-09-17T03:40:27.088328+0000","last_undegraded":"2024-09-17T03:40:27.088328+0000","last_fullsized":"2024-09-17T03:40:27.088328+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:21.943749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.649958+0000","last_change":"2024-09-17T03:40:26.090339+0000","last_active":"2024-09-17T03:40:27.649958+0000","last_peered":"2024-09-17T03:40:27.649958+0000","last_clean":"2024-09-17T03:40:27.649958+0000","last_became_active":"2024-09-17T03:40:26.090056+0000","last_became_peered":"2024-09-17T03:40:26.090056+0000","last_unstale":"2024-09-17T03:40:27.649958+0000","last_undegraded":"2024-09-17T03:40:27.649958+0000","last_fullsized":"2024-09-17T03:40:27.649958+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:23.264966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.649990+0000","last_change":"2024-09-17T03:40:26.082442+0000","last_active":"2024-09-17T03:40:27.649990+0000","last_peered":"2024-09-17T03:40:27.649990+0000","last_clean":"2024-09-17T03:40:27.649990+0000","last_became_active":"2024-09-17T03:40:26.082083+0000","last_became_peered":"2024-09-17T03:40:26.082083+0000","last_unstale":"2024-09-17T03:40:27.649990+0000","last_undegraded":"2024-09-17T03:40:27.649990+0000","last_fullsized":"2024-09-17T03:40:27.649990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:42.815401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090750+0000","last_change":"2024-09-17T03:40:26.094424+0000","last_active":"2024-09-17T03:40:27.090750+0000","last_peered":"2024-09-17T03:40:27.090750+0000","last_clean":"2024-09-17T03:40:27.090750+0000","last_became_active":"2024-09-17T03:40:26.094061+0000","last_became_peered":"2024-09-17T03:40:26.094061+0000","last_unstale":"2024-09-17T03:40:27.090750+0000","last_undegraded":"2024-09-17T03:40:27.090750+0000","last_fullsized":"2024-09-17T03:40:27.090750+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:56.894039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"109'4","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093454+0000","last_change":"2024-09-17T03:40:25.086790+0000","last_active":"2024-09-17T03:40:27.093454+0000","last_peered":"2024-09-17T03:40:27.093454+0000","last_clean":"2024-09-17T03:40:27.093454+0000","last_became_active":"2024-09-17T03:40:25.086123+0000","last_became_peered":"2024-09-17T03:40:25.086123+0000","last_unstale":"2024-09-17T03:40:27.093454+0000","last_undegraded":"2024-09-17T03:40:27.093454+0000","last_fullsized":"2024-09-17T03:40:27.093454+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:44.920346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651421+0000","last_change":"2024-09-17T03:40:26.097809+0000","last_active":"2024-09-17T03:40:27.651421+0000","last_peered":"2024-09-17T03:40:27.651421+0000","last_clean":"2024-09-17T03:40:27.651421+0000","last_became_active":"2024-09-17T03:40:26.095484+0000","last_became_peered":"2024-09-17T03:40:26.095484+0000","last_unstale":"2024-09-17T03:40:27.651421+0000","last_undegraded":"2024-09-17T03:40:27.651421+0000","last_fullsized":"2024-09-17T03:40:27.651421+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:51.281251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089707+0000","last_change":"2024-09-17T03:40:25.091077+0000","last_active":"2024-09-17T03:40:27.089707+0000","last_peered":"2024-09-17T03:40:27.089707+0000","last_clean":"2024-09-17T03:40:27.089707+0000","last_became_active":"2024-09-17T03:40:25.090715+0000","last_became_peered":"2024-09-17T03:40:25.090715+0000","last_unstale":"2024-09-17T03:40:27.089707+0000","last_undegraded":"2024-09-17T03:40:27.089707+0000","last_fullsized":"2024-09-17T03:40:27.089707+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:32.840233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650306+0000","last_change":"2024-09-17T03:40:26.091084+0000","last_active":"2024-09-17T03:40:27.650306+0000","last_peered":"2024-09-17T03:40:27.650306+0000","last_clean":"2024-09-17T03:40:27.650306+0000","last_became_active":"2024-09-17T03:40:26.090796+0000","last_became_peered":"2024-09-17T03:40:26.090796+0000","last_unstale":"2024-09-17T03:40:27.650306+0000","last_undegraded":"2024-09-17T03:40:27.650306+0000","last_fullsized":"2024-09-17T03:40:27.650306+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650796+0000","last_change":"2024-09-17T03:40:25.091127+0000","last_active":"2024-09-17T03:40:27.650796+0000","last_peered":"2024-09-17T03:40:27.650796+0000","last_clean":"2024-09-17T03:40:27.650796+0000","last_became_active":"2024-09-17T03:40:25.090828+0000","last_became_peered":"2024-09-17T03:40:25.090828+0000","last_unstale":"2024-09-17T03:40:27.650796+0000","last_undegraded":"2024-09-17T03:40:27.650796+0000","last_fullsized":"2024-09-17T03:40:27.650796+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:29.759478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651713+0000","last_change":"2024-09-17T03:40:26.099318+0000","last_active":"2024-09-17T03:40:27.651713+0000","last_peered":"2024-09-17T03:40:27.651713+0000","last_clean":"2024-09-17T03:40:27.651713+0000","last_became_active":"2024-09-17T03:40:26.098982+0000","last_became_peered":"2024-09-17T03:40:26.098982+0000","last_unstale":"2024-09-17T03:40:27.651713+0000","last_undegraded":"2024-09-17T03:40:27.651713+0000","last_fullsized":"2024-09-17T03:40:27.651713+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:38.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651030+0000","last_change":"2024-09-17T03:40:25.088001+0000","last_active":"2024-09-17T03:40:27.651030+0000","last_peered":"2024-09-17T03:40:27.651030+0000","last_clean":"2024-09-17T03:40:27.651030+0000","last_became_active":"2024-09-17T03:40:25.087631+0000","last_became_peered":"2024-09-17T03:40:25.087631+0000","last_unstale":"2024-09-17T03:40:27.651030+0000","last_undegraded":"2024-09-17T03:40:27.651030+0000","last_fullsized":"2024-09-17T03:40:27.651030+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:50.121556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088541+0000","last_change":"2024-09-17T03:40:26.102071+0000","last_active":"2024-09-17T03:40:27.088541+0000","last_peered":"2024-09-17T03:40:27.088541+0000","last_clean":"2024-09-17T03:40:27.088541+0000","last_became_active":"2024-09-17T03:40:26.101645+0000","last_became_peered":"2024-09-17T03:40:26.101645+0000","last_unstale":"2024-09-17T03:40:27.088541+0000","last_undegraded":"2024-09-17T03:40:27.088541+0000","last_fullsized":"2024-09-17T03:40:27.088541+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:39.422894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651058+0000","last_change":"2024-09-17T03:40:25.092407+0000","last_active":"2024-09-17T03:40:27.651058+0000","last_peered":"2024-09-17T03:40:27.651058+0000","last_clean":"2024-09-17T03:40:27.651058+0000","last_became_active":"2024-09-17T03:40:25.092121+0000","last_became_peered":"2024-09-17T03:40:25.092121+0000","last_unstale":"2024-09-17T03:40:27.651058+0000","last_undegraded":"2024-09-17T03:40:27.651058+0000","last_fullsized":"2024-09-17T03:40:27.651058+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:05.631360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650031+0000","last_change":"2024-09-17T03:40:26.103208+0000","last_active":"2024-09-17T03:40:27.650031+0000","last_peered":"2024-09-17T03:40:27.650031+0000","last_clean":"2024-09-17T03:40:27.650031+0000","last_became_active":"2024-09-17T03:40:26.102798+0000","last_became_peered":"2024-09-17T03:40:26.102798+0000","last_unstale":"2024-09-17T03:40:27.650031+0000","last_undegraded":"2024-09-17T03:40:27.650031+0000","last_fullsized":"2024-09-17T03:40:27.650031+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:07.900548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089451+0000","last_change":"2024-09-17T03:40:25.082851+0000","last_active":"2024-09-17T03:40:27.089451+0000","last_peered":"2024-09-17T03:40:27.089451+0000","last_clean":"2024-09-17T03:40:27.089451+0000","last_became_active":"2024-09-17T03:40:25.082524+0000","last_became_peered":"2024-09-17T03:40:25.082524+0000","last_unstale":"2024-09-17T03:40:27.089451+0000","last_undegraded":"2024-09-17T03:40:27.089451+0000","last_fullsized":"2024-09-17T03:40:27.089451+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:09.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088644+0000","last_change":"2024-09-17T03:40:26.082980+0000","last_active":"2024-09-17T03:40:27.088644+0000","last_peered":"2024-09-17T03:40:27.088644+0000","last_clean":"2024-09-17T03:40:27.088644+0000","last_became_active":"2024-09-17T03:40:26.082675+0000","last_became_peered":"2024-09-17T03:40:26.082675+0000","last_unstale":"2024-09-17T03:40:27.088644+0000","last_undegraded":"2024-09-17T03:40:27.088644+0000","last_fullsized":"2024-09-17T03:40:27.088644+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:01.292705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650151+0000","last_change":"2024-09-17T03:40:25.085262+0000","last_active":"2024-09-17T03:40:27.650151+0000","last_peered":"2024-09-17T03:40:27.650151+0000","last_clean":"2024-09-17T03:40:27.650151+0000","last_became_active":"2024-09-17T03:40:25.084924+0000","last_became_peered":"2024-09-17T03:40:25.084924+0000","last_unstale":"2024-09-17T03:40:27.650151+0000","last_undegraded":"2024-09-17T03:40:27.650151+0000","last_fullsized":"2024-09-17T03:40:27.650151+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:31.397640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089299+0000","last_change":"2024-09-17T03:40:26.091093+0000","last_active":"2024-09-17T03:40:27.089299+0000","last_peered":"2024-09-17T03:40:27.089299+0000","last_clean":"2024-09-17T03:40:27.089299+0000","last_became_active":"2024-09-17T03:40:26.089624+0000","last_became_peered":"2024-09-17T03:40:26.089624+0000","last_unstale":"2024-09-17T03:40:27.089299+0000","last_undegraded":"2024-09-17T03:40:27.089299+0000","last_fullsized":"2024-09-17T03:40:27.089299+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:40.051808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089659+0000","last_change":"2024-09-17T03:40:25.091182+0000","last_active":"2024-09-17T03:40:27.089659+0000","last_peered":"2024-09-17T03:40:27.089659+0000","last_clean":"2024-09-17T03:40:27.089659+0000","last_became_active":"2024-09-17T03:40:25.090160+0000","last_became_peered":"2024-09-17T03:40:25.090160+0000","last_unstale":"2024-09-17T03:40:27.089659+0000","last_undegraded":"2024-09-17T03:40:27.089659+0000","last_fullsized":"2024-09-17T03:40:27.089659+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:17.125522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651035+0000","last_change":"2024-09-17T03:40:26.100410+0000","last_active":"2024-09-17T03:40:27.651035+0000","last_peered":"2024-09-17T03:40:27.651035+0000","last_clean":"2024-09-17T03:40:27.651035+0000","last_became_active":"2024-09-17T03:40:26.100098+0000","last_became_peered":"2024-09-17T03:40:26.100098+0000","last_unstale":"2024-09-17T03:40:27.651035+0000","last_undegraded":"2024-09-17T03:40:27.651035+0000","last_fullsized":"2024-09-17T03:40:27.651035+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:05.438754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651831+0000","last_change":"2024-09-17T03:40:25.090872+0000","last_active":"2024-09-17T03:40:27.651831+0000","last_peered":"2024-09-17T03:40:27.651831+0000","last_clean":"2024-09-17T03:40:27.651831+0000","last_became_active":"2024-09-17T03:40:25.090576+0000","last_became_peered":"2024-09-17T03:40:25.090576+0000","last_unstale":"2024-09-17T03:40:27.651831+0000","last_undegraded":"2024-09-17T03:40:27.651831+0000","last_fullsized":"2024-09-17T03:40:27.651831+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:54.401051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651807+0000","last_change":"2024-09-17T03:40:26.100267+0000","last_active":"2024-09-17T03:40:27.651807+0000","last_peered":"2024-09-17T03:40:27.651807+0000","last_clean":"2024-09-17T03:40:27.651807+0000","last_became_active":"2024-09-17T03:40:26.099941+0000","last_became_peered":"2024-09-17T03:40:26.099941+0000","last_unstale":"2024-09-17T03:40:27.651807+0000","last_undegraded":"2024-09-17T03:40:27.651807+0000","last_fullsized":"2024-09-17T03:40:27.651807+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:34.780970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651520+0000","last_change":"2024-09-17T03:40:25.083953+0000","last_active":"2024-09-17T03:40:27.651520+0000","last_peered":"2024-09-17T03:40:27.651520+0000","last_clean":"2024-09-17T03:40:27.651520+0000","last_became_active":"2024-09-17T03:40:25.082074+0000","last_became_peered":"2024-09-17T03:40:25.082074+0000","last_unstale":"2024-09-17T03:40:27.651520+0000","last_undegraded":"2024-09-17T03:40:27.651520+0000","last_fullsized":"2024-09-17T03:40:27.651520+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:29.759478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088137+0000","last_change":"2024-09-17T03:40:26.094680+0000","last_active":"2024-09-17T03:40:27.088137+0000","last_peered":"2024-09-17T03:40:27.088137+0000","last_clean":"2024-09-17T03:40:27.088137+0000","last_became_active":"2024-09-17T03:40:26.093903+0000","last_became_peered":"2024-09-17T03:40:26.093903+0000","last_unstale":"2024-09-17T03:40:27.088137+0000","last_undegraded":"2024-09-17T03:40:27.088137+0000","last_fullsized":"2024-09-17T03:40:27.088137+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:14.318070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"109'3","reported_seq":18,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650607+0000","last_change":"2024-09-17T03:40:25.089863+0000","last_active":"2024-09-17T03:40:27.650607+0000","last_peered":"2024-09-17T03:40:27.650607+0000","last_clean":"2024-09-17T03:40:27.650607+0000","last_became_active":"2024-09-17T03:40:25.089511+0000","last_became_peered":"2024-09-17T03:40:25.089511+0000","last_unstale":"2024-09-17T03:40:27.650607+0000","last_undegraded":"2024-09-17T03:40:27.650607+0000","last_fullsized":"2024-09-17T03:40:27.650607+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:41.607946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093184+0000","last_change":"2024-09-17T03:40:26.101714+0000","last_active":"2024-09-17T03:40:27.093184+0000","last_peered":"2024-09-17T03:40:27.093184+0000","last_clean":"2024-09-17T03:40:27.093184+0000","last_became_active":"2024-09-17T03:40:26.101174+0000","last_became_peered":"2024-09-17T03:40:26.101174+0000","last_unstale":"2024-09-17T03:40:27.093184+0000","last_undegraded":"2024-09-17T03:40:27.093184+0000","last_fullsized":"2024-09-17T03:40:27.093184+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:17.973757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"109'6","reported_seq":21,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651221+0000","last_change":"2024-09-17T03:40:25.084751+0000","last_active":"2024-09-17T03:40:27.651221+0000","last_peered":"2024-09-17T03:40:27.651221+0000","last_clean":"2024-09-17T03:40:27.651221+0000","last_became_active":"2024-09-17T03:40:25.084419+0000","last_became_peered":"2024-09-17T03:40:25.084419+0000","last_unstale":"2024-09-17T03:40:27.651221+0000","last_undegraded":"2024-09-17T03:40:27.651221+0000","last_fullsized":"2024-09-17T03:40:27.651221+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:42.470301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092680+0000","last_change":"2024-09-17T03:40:26.086208+0000","last_active":"2024-09-17T03:40:27.092680+0000","last_peered":"2024-09-17T03:40:27.092680+0000","last_clean":"2024-09-17T03:40:27.092680+0000","last_became_active":"2024-09-17T03:40:26.085919+0000","last_became_peered":"2024-09-17T03:40:26.085919+0000","last_unstale":"2024-09-17T03:40:27.092680+0000","last_undegraded":"2024-09-17T03:40:27.092680+0000","last_fullsized":"2024-09-17T03:40:27.092680+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:48.231447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089602+0000","last_change":"2024-09-17T03:40:25.080989+0000","last_active":"2024-09-17T03:40:27.089602+0000","last_peered":"2024-09-17T03:40:27.089602+0000","last_clean":"2024-09-17T03:40:27.089602+0000","last_became_active":"2024-09-17T03:40:25.080667+0000","last_became_peered":"2024-09-17T03:40:25.080667+0000","last_unstale":"2024-09-17T03:40:27.089602+0000","last_undegraded":"2024-09-17T03:40:27.089602+0000","last_fullsized":"2024-09-17T03:40:27.089602+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:57.430299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651507+0000","last_change":"2024-09-17T03:40:26.107467+0000","last_active":"2024-09-17T03:40:27.651507+0000","last_peered":"2024-09-17T03:40:27.651507+0000","last_clean":"2024-09-17T03:40:27.651507+0000","last_became_active":"2024-09-17T03:40:26.107118+0000","last_became_peered":"2024-09-17T03:40:26.107118+0000","last_unstale":"2024-09-17T03:40:27.651507+0000","last_undegraded":"2024-09-17T03:40:27.651507+0000","last_fullsized":"2024-09-17T03:40:27.651507+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:38.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089194+0000","last_change":"2024-09-17T03:40:25.095537+0000","last_active":"2024-09-17T03:40:27.089194+0000","last_peered":"2024-09-17T03:40:27.089194+0000","last_clean":"2024-09-17T03:40:27.089194+0000","last_became_active":"2024-09-17T03:40:25.094852+0000","last_became_peered":"2024-09-17T03:40:25.094852+0000","last_unstale":"2024-09-17T03:40:27.089194+0000","last_undegraded":"2024-09-17T03:40:27.089194+0000","last_fullsized":"2024-09-17T03:40:27.089194+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:47.845830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088407+0000","last_change":"2024-09-17T03:40:26.081760+0000","last_active":"2024-09-17T03:40:27.088407+0000","last_peered":"2024-09-17T03:40:27.088407+0000","last_clean":"2024-09-17T03:40:27.088407+0000","last_became_active":"2024-09-17T03:40:26.081443+0000","last_became_peered":"2024-09-17T03:40:26.081443+0000","last_unstale":"2024-09-17T03:40:27.088407+0000","last_undegraded":"2024-09-17T03:40:27.088407+0000","last_fullsized":"2024-09-17T03:40:27.088407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:07.878699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089045+0000","last_change":"2024-09-17T03:40:25.076755+0000","last_active":"2024-09-17T03:40:27.089045+0000","last_peered":"2024-09-17T03:40:27.089045+0000","last_clean":"2024-09-17T03:40:27.089045+0000","last_became_active":"2024-09-17T03:40:25.076451+0000","last_became_peered":"2024-09-17T03:40:25.076451+0000","last_unstale":"2024-09-17T03:40:27.089045+0000","last_undegraded":"2024-09-17T03:40:27.089045+0000","last_fullsized":"2024-09-17T03:40:27.089045+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:05.715292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651554+0000","last_change":"2024-09-17T03:40:26.086421+0000","last_active":"2024-09-17T03:40:27.651554+0000","last_peered":"2024-09-17T03:40:27.651554+0000","last_clean":"2024-09-17T03:40:27.651554+0000","last_became_active":"2024-09-17T03:40:26.083374+0000","last_became_peered":"2024-09-17T03:40:26.083374+0000","last_unstale":"2024-09-17T03:40:27.651554+0000","last_undegraded":"2024-09-17T03:40:27.651554+0000","last_fullsized":"2024-09-17T03:40:27.651554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:40.496150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089461+0000","last_change":"2024-09-17T03:40:25.089035+0000","last_active":"2024-09-17T03:40:27.089461+0000","last_peered":"2024-09-17T03:40:27.089461+0000","last_clean":"2024-09-17T03:40:27.089461+0000","last_became_active":"2024-09-17T03:40:25.088719+0000","last_became_peered":"2024-09-17T03:40:25.088719+0000","last_unstale":"2024-09-17T03:40:27.089461+0000","last_undegraded":"2024-09-17T03:40:27.089461+0000","last_fullsized":"2024-09-17T03:40:27.089461+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:04.430259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650448+0000","last_change":"2024-09-17T03:40:26.103860+0000","last_active":"2024-09-17T03:40:27.650448+0000","last_peered":"2024-09-17T03:40:27.650448+0000","last_clean":"2024-09-17T03:40:27.650448+0000","last_became_active":"2024-09-17T03:40:26.101932+0000","last_became_peered":"2024-09-17T03:40:26.101932+0000","last_unstale":"2024-09-17T03:40:27.650448+0000","last_undegraded":"2024-09-17T03:40:27.650448+0000","last_fullsized":"2024-09-17T03:40:27.650448+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:57.235098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089864+0000","last_change":"2024-09-17T03:40:25.095020+0000","last_active":"2024-09-17T03:40:27.089864+0000","last_peered":"2024-09-17T03:40:27.089864+0000","last_clean":"2024-09-17T03:40:27.089864+0000","last_became_active":"2024-09-17T03:40:25.094243+0000","last_became_peered":"2024-09-17T03:40:25.094243+0000","last_unstale":"2024-09-17T03:40:27.089864+0000","last_undegraded":"2024-09-17T03:40:27.089864+0000","last_fullsized":"2024-09-17T03:40:27.089864+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:57.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651579+0000","last_change":"2024-09-17T03:40:26.105799+0000","last_active":"2024-09-17T03:40:27.651579+0000","last_peered":"2024-09-17T03:40:27.651579+0000","last_clean":"2024-09-17T03:40:27.651579+0000","last_became_active":"2024-09-17T03:40:26.105418+0000","last_became_peered":"2024-09-17T03:40:26.105418+0000","last_unstale":"2024-09-17T03:40:27.651579+0000","last_undegraded":"2024-09-17T03:40:27.651579+0000","last_fullsized":"2024-09-17T03:40:27.651579+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:34.780970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093162+0000","last_change":"2024-09-17T03:40:25.093528+0000","last_active":"2024-09-17T03:40:27.093162+0000","last_peered":"2024-09-17T03:40:27.093162+0000","last_clean":"2024-09-17T03:40:27.093162+0000","last_became_active":"2024-09-17T03:40:25.092930+0000","last_became_peered":"2024-09-17T03:40:25.092930+0000","last_unstale":"2024-09-17T03:40:27.093162+0000","last_undegraded":"2024-09-17T03:40:27.093162+0000","last_fullsized":"2024-09-17T03:40:27.093162+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.119027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093184+0000","last_change":"2024-09-17T03:40:26.095248+0000","last_active":"2024-09-17T03:40:27.093184+0000","last_peered":"2024-09-17T03:40:27.093184+0000","last_clean":"2024-09-17T03:40:27.093184+0000","last_became_active":"2024-09-17T03:40:26.094665+0000","last_became_peered":"2024-09-17T03:40:26.094665+0000","last_unstale":"2024-09-17T03:40:27.093184+0000","last_undegraded":"2024-09-17T03:40:27.093184+0000","last_fullsized":"2024-09-17T03:40:27.093184+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:27.655400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650275+0000","last_change":"2024-09-17T03:40:25.094560+0000","last_active":"2024-09-17T03:40:27.650275+0000","last_peered":"2024-09-17T03:40:27.650275+0000","last_clean":"2024-09-17T03:40:27.650275+0000","last_became_active":"2024-09-17T03:40:25.094224+0000","last_became_peered":"2024-09-17T03:40:25.094224+0000","last_unstale":"2024-09-17T03:40:27.650275+0000","last_undegraded":"2024-09-17T03:40:27.650275+0000","last_fullsized":"2024-09-17T03:40:27.650275+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:14.218993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650787+0000","last_change":"2024-09-17T03:40:26.110536+0000","last_active":"2024-09-17T03:40:27.650787+0000","last_peered":"2024-09-17T03:40:27.650787+0000","last_clean":"2024-09-17T03:40:27.650787+0000","last_became_active":"2024-09-17T03:40:26.110225+0000","last_became_peered":"2024-09-17T03:40:26.110225+0000","last_unstale":"2024-09-17T03:40:27.650787+0000","last_undegraded":"2024-09-17T03:40:27.650787+0000","last_fullsized":"2024-09-17T03:40:27.650787+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:29.177484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088744+0000","last_change":"2024-09-17T03:40:25.081602+0000","last_active":"2024-09-17T03:40:27.088744+0000","last_peered":"2024-09-17T03:40:27.088744+0000","last_clean":"2024-09-17T03:40:27.088744+0000","last_became_active":"2024-09-17T03:40:25.081289+0000","last_became_peered":"2024-09-17T03:40:25.081289+0000","last_unstale":"2024-09-17T03:40:27.088744+0000","last_undegraded":"2024-09-17T03:40:27.088744+0000","last_fullsized":"2024-09-17T03:40:27.088744+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:37.306668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088329+0000","last_change":"2024-09-17T03:40:26.091947+0000","last_active":"2024-09-17T03:40:27.088329+0000","last_peered":"2024-09-17T03:40:27.088329+0000","last_clean":"2024-09-17T03:40:27.088329+0000","last_became_active":"2024-09-17T03:40:26.091584+0000","last_became_peered":"2024-09-17T03:40:26.091584+0000","last_unstale":"2024-09-17T03:40:27.088329+0000","last_undegraded":"2024-09-17T03:40:27.088329+0000","last_fullsized":"2024-09-17T03:40:27.088329+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:06.639855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651045+0000","last_change":"2024-09-17T03:40:25.085590+0000","last_active":"2024-09-17T03:40:27.651045+0000","last_peered":"2024-09-17T03:40:27.651045+0000","last_clean":"2024-09-17T03:40:27.651045+0000","last_became_active":"2024-09-17T03:40:25.085288+0000","last_became_peered":"2024-09-17T03:40:25.085288+0000","last_unstale":"2024-09-17T03:40:27.651045+0000","last_undegraded":"2024-09-17T03:40:27.651045+0000","last_fullsized":"2024-09-17T03:40:27.651045+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:51.070669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088908+0000","last_change":"2024-09-17T03:40:26.102801+0000","last_active":"2024-09-17T03:40:27.088908+0000","last_peered":"2024-09-17T03:40:27.088908+0000","last_clean":"2024-09-17T03:40:27.088908+0000","last_became_active":"2024-09-17T03:40:26.102488+0000","last_became_peered":"2024-09-17T03:40:26.102488+0000","last_unstale":"2024-09-17T03:40:27.088908+0000","last_undegraded":"2024-09-17T03:40:27.088908+0000","last_fullsized":"2024-09-17T03:40:27.088908+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:27.332049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088923+0000","last_change":"2024-09-17T03:40:25.092780+0000","last_active":"2024-09-17T03:40:27.088923+0000","last_peered":"2024-09-17T03:40:27.088923+0000","last_clean":"2024-09-17T03:40:27.088923+0000","last_became_active":"2024-09-17T03:40:25.092232+0000","last_became_peered":"2024-09-17T03:40:25.092232+0000","last_unstale":"2024-09-17T03:40:27.088923+0000","last_undegraded":"2024-09-17T03:40:27.088923+0000","last_fullsized":"2024-09-17T03:40:27.088923+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:22.778728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651203+0000","last_change":"2024-09-17T03:40:26.100233+0000","last_active":"2024-09-17T03:40:27.651203+0000","last_peered":"2024-09-17T03:40:27.651203+0000","last_clean":"2024-09-17T03:40:27.651203+0000","last_became_active":"2024-09-17T03:40:26.099953+0000","last_became_peered":"2024-09-17T03:40:26.099953+0000","last_unstale":"2024-09-17T03:40:27.651203+0000","last_undegraded":"2024-09-17T03:40:27.651203+0000","last_fullsized":"2024-09-17T03:40:27.651203+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:41.791243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092591+0000","last_change":"2024-09-17T03:40:25.090999+0000","last_active":"2024-09-17T03:40:27.092591+0000","last_peered":"2024-09-17T03:40:27.092591+0000","last_clean":"2024-09-17T03:40:27.092591+0000","last_became_active":"2024-09-17T03:40:25.090560+0000","last_became_peered":"2024-09-17T03:40:25.090560+0000","last_unstale":"2024-09-17T03:40:27.092591+0000","last_undegraded":"2024-09-17T03:40:27.092591+0000","last_fullsized":"2024-09-17T03:40:27.092591+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:15.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088983+0000","last_change":"2024-09-17T03:40:26.090039+0000","last_active":"2024-09-17T03:40:27.088983+0000","last_peered":"2024-09-17T03:40:27.088983+0000","last_clean":"2024-09-17T03:40:27.088983+0000","last_became_active":"2024-09-17T03:40:26.088910+0000","last_became_peered":"2024-09-17T03:40:26.088910+0000","last_unstale":"2024-09-17T03:40:27.088983+0000","last_undegraded":"2024-09-17T03:40:27.088983+0000","last_fullsized":"2024-09-17T03:40:27.088983+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:17.354715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651485+0000","last_change":"2024-09-17T03:40:25.088715+0000","last_active":"2024-09-17T03:40:27.651485+0000","last_peered":"2024-09-17T03:40:27.651485+0000","last_clean":"2024-09-17T03:40:27.651485+0000","last_became_active":"2024-09-17T03:40:25.088075+0000","last_became_peered":"2024-09-17T03:40:25.088075+0000","last_unstale":"2024-09-17T03:40:27.651485+0000","last_undegraded":"2024-09-17T03:40:27.651485+0000","last_fullsized":"2024-09-17T03:40:27.651485+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:53.318725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088606+0000","last_change":"2024-09-17T03:40:26.113739+0000","last_active":"2024-09-17T03:40:27.088606+0000","last_peered":"2024-09-17T03:40:27.088606+0000","last_clean":"2024-09-17T03:40:27.088606+0000","last_became_active":"2024-09-17T03:40:26.113370+0000","last_became_peered":"2024-09-17T03:40:26.113370+0000","last_unstale":"2024-09-17T03:40:27.088606+0000","last_undegraded":"2024-09-17T03:40:27.088606+0000","last_fullsized":"2024-09-17T03:40:27.088606+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:50.990280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"110'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093089+0000","last_change":"2024-09-17T03:40:25.092408+0000","last_active":"2024-09-17T03:40:27.093089+0000","last_peered":"2024-09-17T03:40:27.093089+0000","last_clean":"2024-09-17T03:40:27.093089+0000","last_became_active":"2024-09-17T03:40:25.092023+0000","last_became_peered":"2024-09-17T03:40:25.092023+0000","last_unstale":"2024-09-17T03:40:27.093089+0000","last_undegraded":"2024-09-17T03:40:27.093089+0000","last_fullsized":"2024-09-17T03:40:27.093089+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:39.144487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651583+0000","last_change":"2024-09-17T03:40:26.088167+0000","last_active":"2024-09-17T03:40:27.651583+0000","last_peered":"2024-09-17T03:40:27.651583+0000","last_clean":"2024-09-17T03:40:27.651583+0000","last_became_active":"2024-09-17T03:40:26.087880+0000","last_became_peered":"2024-09-17T03:40:26.087880+0000","last_unstale":"2024-09-17T03:40:27.651583+0000","last_undegraded":"2024-09-17T03:40:27.651583+0000","last_fullsized":"2024-09-17T03:40:27.651583+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:51.281251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093271+0000","last_change":"2024-09-17T03:40:25.088614+0000","last_active":"2024-09-17T03:40:27.093271+0000","last_peered":"2024-09-17T03:40:27.093271+0000","last_clean":"2024-09-17T03:40:27.093271+0000","last_became_active":"2024-09-17T03:40:25.088063+0000","last_became_peered":"2024-09-17T03:40:25.088063+0000","last_unstale":"2024-09-17T03:40:27.093271+0000","last_undegraded":"2024-09-17T03:40:27.093271+0000","last_fullsized":"2024-09-17T03:40:27.093271+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:27.806753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090554+0000","last_change":"2024-09-17T03:40:26.102432+0000","last_active":"2024-09-17T03:40:27.090554+0000","last_peered":"2024-09-17T03:40:27.090554+0000","last_clean":"2024-09-17T03:40:27.090554+0000","last_became_active":"2024-09-17T03:40:26.102112+0000","last_became_peered":"2024-09-17T03:40:26.102112+0000","last_unstale":"2024-09-17T03:40:27.090554+0000","last_undegraded":"2024-09-17T03:40:27.090554+0000","last_fullsized":"2024-09-17T03:40:27.090554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:19.302727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089175+0000","last_change":"2024-09-17T03:40:25.090603+0000","last_active":"2024-09-17T03:40:27.089175+0000","last_peered":"2024-09-17T03:40:27.089175+0000","last_clean":"2024-09-17T03:40:27.089175+0000","last_became_active":"2024-09-17T03:40:25.089547+0000","last_became_peered":"2024-09-17T03:40:25.089547+0000","last_unstale":"2024-09-17T03:40:27.089175+0000","last_undegraded":"2024-09-17T03:40:27.089175+0000","last_fullsized":"2024-09-17T03:40:27.089175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:33.772475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088899+0000","last_change":"2024-09-17T03:40:26.081819+0000","last_active":"2024-09-17T03:40:27.088899+0000","last_peered":"2024-09-17T03:40:27.088899+0000","last_clean":"2024-09-17T03:40:27.088899+0000","last_became_active":"2024-09-17T03:40:26.081449+0000","last_became_peered":"2024-09-17T03:40:26.081449+0000","last_unstale":"2024-09-17T03:40:27.088899+0000","last_undegraded":"2024-09-17T03:40:27.088899+0000","last_fullsized":"2024-09-17T03:40:27.088899+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:21.051497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093261+0000","last_change":"2024-09-17T03:40:25.094592+0000","last_active":"2024-09-17T03:40:27.093261+0000","last_peered":"2024-09-17T03:40:27.093261+0000","last_clean":"2024-09-17T03:40:27.093261+0000","last_became_active":"2024-09-17T03:40:25.094042+0000","last_became_peered":"2024-09-17T03:40:25.094042+0000","last_unstale":"2024-09-17T03:40:27.093261+0000","last_undegraded":"2024-09-17T03:40:27.093261+0000","last_fullsized":"2024-09-17T03:40:27.093261+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:30.892412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650978+0000","last_change":"2024-09-17T03:40:26.105066+0000","last_active":"2024-09-17T03:40:27.650978+0000","last_peered":"2024-09-17T03:40:27.650978+0000","last_clean":"2024-09-17T03:40:27.650978+0000","last_became_active":"2024-09-17T03:40:26.104744+0000","last_became_peered":"2024-09-17T03:40:26.104744+0000","last_unstale":"2024-09-17T03:40:27.650978+0000","last_undegraded":"2024-09-17T03:40:27.650978+0000","last_fullsized":"2024-09-17T03:40:27.650978+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:26.552280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650999+0000","last_change":"2024-09-17T03:40:25.091754+0000","last_active":"2024-09-17T03:40:27.650999+0000","last_peered":"2024-09-17T03:40:27.650999+0000","last_clean":"2024-09-17T03:40:27.650999+0000","last_became_active":"2024-09-17T03:40:25.091404+0000","last_became_peered":"2024-09-17T03:40:25.091404+0000","last_unstale":"2024-09-17T03:40:27.650999+0000","last_undegraded":"2024-09-17T03:40:27.650999+0000","last_fullsized":"2024-09-17T03:40:27.650999+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:54.401051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092686+0000","last_change":"2024-09-17T03:40:26.095493+0000","last_active":"2024-09-17T03:40:27.092686+0000","last_peered":"2024-09-17T03:40:27.092686+0000","last_clean":"2024-09-17T03:40:27.092686+0000","last_became_active":"2024-09-17T03:40:26.095167+0000","last_became_peered":"2024-09-17T03:40:26.095167+0000","last_unstale":"2024-09-17T03:40:27.092686+0000","last_undegraded":"2024-09-17T03:40:27.092686+0000","last_fullsized":"2024-09-17T03:40:27.092686+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:00.202701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651724+0000","last_change":"2024-09-17T03:40:25.094752+0000","last_active":"2024-09-17T03:40:27.651724+0000","last_peered":"2024-09-17T03:40:27.651724+0000","last_clean":"2024-09-17T03:40:27.651724+0000","last_became_active":"2024-09-17T03:40:25.094409+0000","last_became_peered":"2024-09-17T03:40:25.094409+0000","last_unstale":"2024-09-17T03:40:27.651724+0000","last_undegraded":"2024-09-17T03:40:27.651724+0000","last_fullsized":"2024-09-17T03:40:27.651724+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:59.015131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089551+0000","last_change":"2024-09-17T03:40:26.081960+0000","last_active":"2024-09-17T03:40:27.089551+0000","last_peered":"2024-09-17T03:40:27.089551+0000","last_clean":"2024-09-17T03:40:27.089551+0000","last_became_active":"2024-09-17T03:40:26.081649+0000","last_became_peered":"2024-09-17T03:40:26.081649+0000","last_unstale":"2024-09-17T03:40:27.089551+0000","last_undegraded":"2024-09-17T03:40:27.089551+0000","last_fullsized":"2024-09-17T03:40:27.089551+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.491879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092726+0000","last_change":"2024-09-17T03:40:25.082332+0000","last_active":"2024-09-17T03:40:27.092726+0000","last_peered":"2024-09-17T03:40:27.092726+0000","last_clean":"2024-09-17T03:40:27.092726+0000","last_became_active":"2024-09-17T03:40:25.082030+0000","last_became_peered":"2024-09-17T03:40:25.082030+0000","last_unstale":"2024-09-17T03:40:27.092726+0000","last_undegraded":"2024-09-17T03:40:27.092726+0000","last_fullsized":"2024-09-17T03:40:27.092726+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:26.233960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092728+0000","last_change":"2024-09-17T03:40:26.097480+0000","last_active":"2024-09-17T03:40:27.092728+0000","last_peered":"2024-09-17T03:40:27.092728+0000","last_clean":"2024-09-17T03:40:27.092728+0000","last_became_active":"2024-09-17T03:40:26.096671+0000","last_became_peered":"2024-09-17T03:40:26.096671+0000","last_unstale":"2024-09-17T03:40:27.092728+0000","last_undegraded":"2024-09-17T03:40:27.092728+0000","last_fullsized":"2024-09-17T03:40:27.092728+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:51.650601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"109'8","reported_seq":23,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088699+0000","last_change":"2024-09-17T03:40:25.084933+0000","last_active":"2024-09-17T03:40:27.088699+0000","last_peered":"2024-09-17T03:40:27.088699+0000","last_clean":"2024-09-17T03:40:27.088699+0000","last_became_active":"2024-09-17T03:40:25.084571+0000","last_became_peered":"2024-09-17T03:40:25.084571+0000","last_unstale":"2024-09-17T03:40:27.088699+0000","last_undegraded":"2024-09-17T03:40:27.088699+0000","last_fullsized":"2024-09-17T03:40:27.088699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:55.687864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":276,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650288+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:40:27.650288+0000","last_peered":"2024-09-17T03:40:27.650288+0000","last_clean":"2024-09-17T03:40:27.650288+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:40:27.650288+0000","last_undegraded":"2024-09-17T03:40:27.650288+0000","last_fullsized":"2024-09-17T03:40:27.650288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":627099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1368064,"data_stored":627121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509504,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33116,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338724,"statfs":{"total":96636764160,"available":96602853376,"internally_reserved":0,"allocated":1970176,"data_stored":1219079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509506,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1368064,"data_stored":627189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":629293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509505,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33116,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338724,"statfs":{"total":96636764160,"available":96602853376,"internally_reserved":0,"allocated":1966080,"data_stored":1217627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1376256,"data_stored":627785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1372160,"data_stored":627155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:35.479 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:35.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.709+0000 7fc43ce00640 1 -- 172.21.15.121:0/1562484737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc438073a50 msgr2=0x7fc438073e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:35.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.709+0000 7fc43ce00640 1 --2- 172.21.15.121:0/1562484737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc438073a50 0x7fc438073e60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fc430005fd0 tx=0x7fc43002b9a0 comp rx=0 tx=0).stop 2024-09-17T03:40:35.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.709+0000 7fc43ce00640 1 -- 172.21.15.121:0/1562484737 shutdown_connections 2024-09-17T03:40:35.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.709+0000 7fc43ce00640 1 --2- 172.21.15.121:0/1562484737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc438073a50 0x7fc438073e60 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:35.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.709+0000 7fc43ce00640 1 -- 172.21.15.121:0/1562484737 >> 172.21.15.121:0/1562484737 conn(0x7fc4380b3580 msgr2=0x7fc4380b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:35.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.709+0000 7fc43ce00640 1 -- 172.21.15.121:0/1562484737 shutdown_connections 2024-09-17T03:40:35.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.709+0000 7fc43ce00640 1 -- 172.21.15.121:0/1562484737 wait complete. 2024-09-17T03:40:35.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.712+0000 7fc43ce00640 1 Processor -- start 2024-09-17T03:40:35.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.712+0000 7fc43ce00640 1 -- start start 2024-09-17T03:40:35.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.713+0000 7fc43ce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc438070100 0x7fc4381f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.713+0000 7fc43ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc438073a50 0x7fc4380cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.713+0000 7fc43ce00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4381e8750 0x7fc4381e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.713+0000 7fc43ce00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc43815ad40 con 0x7fc438073a50 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.713+0000 7fc43ce00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc438070bc0 con 0x7fc438070100 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.713+0000 7fc43ce00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc438070fa0 con 0x7fc4381e8750 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc435400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc438073a50 0x7fc4380cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc435400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc438073a50 0x7fc4380cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38794/0 (socket says 172.21.15.121:38794) 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc435400640 1 -- 172.21.15.121:0/2082479696 learned_addr learned my addr 172.21.15.121:0/2082479696 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc435e00640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc438070100 0x7fc4381f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc436800640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4381e8750 0x7fc4381e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc435400640 1 -- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4381e8750 msgr2=0x7fc4381e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc435400640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4381e8750 0x7fc4381e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:35.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc435400640 1 -- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc438070100 msgr2=0x7fc4381f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:35.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc435400640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc438070100 0x7fc4381f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:35.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc435400640 1 -- 172.21.15.121:0/2082479696 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4380bd260 con 0x7fc438073a50 2024-09-17T03:40:35.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc436800640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4381e8750 0x7fc4381e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:35.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.714+0000 7fc435400640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc438073a50 0x7fc4380cc910 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc42400c400 tx=0x7fc42400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:35.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.715+0000 7fc42e000640 1 -- 172.21.15.121:0/2082479696 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424017070 con 0x7fc438073a50 2024-09-17T03:40:35.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.715+0000 7fc42e000640 1 -- 172.21.15.121:0/2082479696 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4240053c0 con 0x7fc438073a50 2024-09-17T03:40:35.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.715+0000 7fc43ce00640 1 -- 172.21.15.121:0/2082479696 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4381e90a0 con 0x7fc438073a50 2024-09-17T03:40:35.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.715+0000 7fc42e000640 1 -- 172.21.15.121:0/2082479696 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424003850 con 0x7fc438073a50 2024-09-17T03:40:35.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.715+0000 7fc43ce00640 1 -- 172.21.15.121:0/2082479696 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4380cb2d0 con 0x7fc438073a50 2024-09-17T03:40:35.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.716+0000 7fc43ce00640 1 -- 172.21.15.121:0/2082479696 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc438073340 con 0x7fc438073a50 2024-09-17T03:40:35.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.717+0000 7fc42e000640 1 -- 172.21.15.121:0/2082479696 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc42401a070 con 0x7fc438073a50 2024-09-17T03:40:35.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.718+0000 7fc42e000640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc418078b90 0x7fc41807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:35.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.718+0000 7fc42e000640 1 -- 172.21.15.121:0/2082479696 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7fc42409a320 con 0x7fc438073a50 2024-09-17T03:40:35.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.719+0000 7fc435e00640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc418078b90 0x7fc41807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:35.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.719+0000 7fc435e00640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc418078b90 0x7fc41807b0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc428001720 tx=0x7fc428009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:35.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.723+0000 7fc42e000640 1 -- 172.21.15.121:0/2082479696 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc4381e90a0 con 0x7fc438073a50 2024-09-17T03:40:35.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.902+0000 7fc43ce00640 1 -- 172.21.15.121:0/2082479696 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4380cda30 con 0x7fc418078b90 2024-09-17T03:40:35.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.908+0000 7fc42e000640 1 -- 172.21.15.121:0/2082479696 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252464 (secure 0 0 0) 0x7fc4380cda30 con 0x7fc418078b90 2024-09-17T03:40:35.910 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:35.912 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:40:35.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 -- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc418078b90 msgr2=0x7fc41807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:35.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc418078b90 0x7fc41807b0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc428001720 tx=0x7fc428009040 comp rx=0 tx=0).stop 2024-09-17T03:40:35.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 -- 172.21.15.121:0/2082479696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc438073a50 msgr2=0x7fc4380cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:35.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc438073a50 0x7fc4380cc910 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc42400c400 tx=0x7fc42400c8c0 comp rx=0 tx=0).stop 2024-09-17T03:40:35.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 -- 172.21.15.121:0/2082479696 shutdown_connections 2024-09-17T03:40:35.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4381e8750 0x7fc4381e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:35.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fc418078b90 0x7fc41807b0a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:35.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc438073a50 0x7fc4380cc910 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:35.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 --2- 172.21.15.121:0/2082479696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc438070100 0x7fc4381f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:35.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 -- 172.21.15.121:0/2082479696 >> 172.21.15.121:0/2082479696 conn(0x7fc4380b3580 msgr2=0x7fc43815a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:35.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 -- 172.21.15.121:0/2082479696 shutdown_connections 2024-09-17T03:40:35.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:35.912+0000 7fc43ce00640 1 -- 172.21.15.121:0/2082479696 wait complete. 2024-09-17T03:40:35.935 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-17T03:40:35.356406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261428,"kb_used_data":11880,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713292,"statfs":{"total":773094113280,"available":772826411008,"internally_reserved":0,"allocated":12165120,"data_stored":6202348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.287501"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650729+0000","last_change":"2024-09-17T03:40:26.104394+0000","last_active":"2024-09-17T03:40:27.650729+0000","last_peered":"2024-09-17T03:40:27.650729+0000","last_clean":"2024-09-17T03:40:27.650729+0000","last_became_active":"2024-09-17T03:40:26.104103+0000","last_became_peered":"2024-09-17T03:40:26.104103+0000","last_unstale":"2024-09-17T03:40:27.650729+0000","last_undegraded":"2024-09-17T03:40:27.650729+0000","last_fullsized":"2024-09-17T03:40:27.650729+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:22.257905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651768+0000","last_change":"2024-09-17T03:40:26.094096+0000","last_active":"2024-09-17T03:40:27.651768+0000","last_peered":"2024-09-17T03:40:27.651768+0000","last_clean":"2024-09-17T03:40:27.651768+0000","last_became_active":"2024-09-17T03:40:26.093659+0000","last_became_peered":"2024-09-17T03:40:26.093659+0000","last_unstale":"2024-09-17T03:40:27.651768+0000","last_undegraded":"2024-09-17T03:40:27.651768+0000","last_fullsized":"2024-09-17T03:40:27.651768+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:42.242012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088321+0000","last_change":"2024-09-17T03:40:26.091185+0000","last_active":"2024-09-17T03:40:27.088321+0000","last_peered":"2024-09-17T03:40:27.088321+0000","last_clean":"2024-09-17T03:40:27.088321+0000","last_became_active":"2024-09-17T03:40:26.089487+0000","last_became_peered":"2024-09-17T03:40:26.089487+0000","last_unstale":"2024-09-17T03:40:27.088321+0000","last_undegraded":"2024-09-17T03:40:27.088321+0000","last_fullsized":"2024-09-17T03:40:27.088321+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:30.078377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651499+0000","last_change":"2024-09-17T03:40:26.099256+0000","last_active":"2024-09-17T03:40:27.651499+0000","last_peered":"2024-09-17T03:40:27.651499+0000","last_clean":"2024-09-17T03:40:27.651499+0000","last_became_active":"2024-09-17T03:40:26.098909+0000","last_became_peered":"2024-09-17T03:40:26.098909+0000","last_unstale":"2024-09-17T03:40:27.651499+0000","last_undegraded":"2024-09-17T03:40:27.651499+0000","last_fullsized":"2024-09-17T03:40:27.651499+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:41.846363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092866+0000","last_change":"2024-09-17T03:40:26.097812+0000","last_active":"2024-09-17T03:40:27.092866+0000","last_peered":"2024-09-17T03:40:27.092866+0000","last_clean":"2024-09-17T03:40:27.092866+0000","last_became_active":"2024-09-17T03:40:26.097069+0000","last_became_peered":"2024-09-17T03:40:26.097069+0000","last_unstale":"2024-09-17T03:40:27.092866+0000","last_undegraded":"2024-09-17T03:40:27.092866+0000","last_fullsized":"2024-09-17T03:40:27.092866+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:36.982485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650962+0000","last_change":"2024-09-17T03:40:26.095825+0000","last_active":"2024-09-17T03:40:27.650962+0000","last_peered":"2024-09-17T03:40:27.650962+0000","last_clean":"2024-09-17T03:40:27.650962+0000","last_became_active":"2024-09-17T03:40:26.095423+0000","last_became_peered":"2024-09-17T03:40:26.095423+0000","last_unstale":"2024-09-17T03:40:27.650962+0000","last_undegraded":"2024-09-17T03:40:27.650962+0000","last_fullsized":"2024-09-17T03:40:27.650962+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:59.341049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651145+0000","last_change":"2024-09-17T03:40:26.105189+0000","last_active":"2024-09-17T03:40:27.651145+0000","last_peered":"2024-09-17T03:40:27.651145+0000","last_clean":"2024-09-17T03:40:27.651145+0000","last_became_active":"2024-09-17T03:40:26.104891+0000","last_became_peered":"2024-09-17T03:40:26.104891+0000","last_unstale":"2024-09-17T03:40:27.651145+0000","last_undegraded":"2024-09-17T03:40:27.651145+0000","last_fullsized":"2024-09-17T03:40:27.651145+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:15.647694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088282+0000","last_change":"2024-09-17T03:40:26.082958+0000","last_active":"2024-09-17T03:40:27.088282+0000","last_peered":"2024-09-17T03:40:27.088282+0000","last_clean":"2024-09-17T03:40:27.088282+0000","last_became_active":"2024-09-17T03:40:26.082410+0000","last_became_peered":"2024-09-17T03:40:26.082410+0000","last_unstale":"2024-09-17T03:40:27.088282+0000","last_undegraded":"2024-09-17T03:40:27.088282+0000","last_fullsized":"2024-09-17T03:40:27.088282+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:01.976092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651700+0000","last_change":"2024-09-17T03:40:26.083248+0000","last_active":"2024-09-17T03:40:27.651700+0000","last_peered":"2024-09-17T03:40:27.651700+0000","last_clean":"2024-09-17T03:40:27.651700+0000","last_became_active":"2024-09-17T03:40:26.082949+0000","last_became_peered":"2024-09-17T03:40:26.082949+0000","last_unstale":"2024-09-17T03:40:27.651700+0000","last_undegraded":"2024-09-17T03:40:27.651700+0000","last_fullsized":"2024-09-17T03:40:27.651700+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:05.438754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651477+0000","last_change":"2024-09-17T03:40:26.098420+0000","last_active":"2024-09-17T03:40:27.651477+0000","last_peered":"2024-09-17T03:40:27.651477+0000","last_clean":"2024-09-17T03:40:27.651477+0000","last_became_active":"2024-09-17T03:40:26.097511+0000","last_became_peered":"2024-09-17T03:40:26.097511+0000","last_unstale":"2024-09-17T03:40:27.651477+0000","last_undegraded":"2024-09-17T03:40:27.651477+0000","last_fullsized":"2024-09-17T03:40:27.651477+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:05.438754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650427+0000","last_change":"2024-09-17T03:40:26.098502+0000","last_active":"2024-09-17T03:40:27.650427+0000","last_peered":"2024-09-17T03:40:27.650427+0000","last_clean":"2024-09-17T03:40:27.650427+0000","last_became_active":"2024-09-17T03:40:26.096026+0000","last_became_peered":"2024-09-17T03:40:26.096026+0000","last_unstale":"2024-09-17T03:40:27.650427+0000","last_undegraded":"2024-09-17T03:40:27.650427+0000","last_fullsized":"2024-09-17T03:40:27.650427+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:40.307739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088437+0000","last_change":"2024-09-17T03:40:26.097670+0000","last_active":"2024-09-17T03:40:27.088437+0000","last_peered":"2024-09-17T03:40:27.088437+0000","last_clean":"2024-09-17T03:40:27.088437+0000","last_became_active":"2024-09-17T03:40:26.097275+0000","last_became_peered":"2024-09-17T03:40:26.097275+0000","last_unstale":"2024-09-17T03:40:27.088437+0000","last_undegraded":"2024-09-17T03:40:27.088437+0000","last_fullsized":"2024-09-17T03:40:27.088437+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:12.630071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651101+0000","last_change":"2024-09-17T03:40:26.110554+0000","last_active":"2024-09-17T03:40:27.651101+0000","last_peered":"2024-09-17T03:40:27.651101+0000","last_clean":"2024-09-17T03:40:27.651101+0000","last_became_active":"2024-09-17T03:40:26.110220+0000","last_became_peered":"2024-09-17T03:40:26.110220+0000","last_unstale":"2024-09-17T03:40:27.651101+0000","last_undegraded":"2024-09-17T03:40:27.651101+0000","last_fullsized":"2024-09-17T03:40:27.651101+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:18.161357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088079+0000","last_change":"2024-09-17T03:40:26.092267+0000","last_active":"2024-09-17T03:40:27.088079+0000","last_peered":"2024-09-17T03:40:27.088079+0000","last_clean":"2024-09-17T03:40:27.088079+0000","last_became_active":"2024-09-17T03:40:26.091626+0000","last_became_peered":"2024-09-17T03:40:26.091626+0000","last_unstale":"2024-09-17T03:40:27.088079+0000","last_undegraded":"2024-09-17T03:40:27.088079+0000","last_fullsized":"2024-09-17T03:40:27.088079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:08.779819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650063+0000","last_change":"2024-09-17T03:40:26.093069+0000","last_active":"2024-09-17T03:40:27.650063+0000","last_peered":"2024-09-17T03:40:27.650063+0000","last_clean":"2024-09-17T03:40:27.650063+0000","last_became_active":"2024-09-17T03:40:26.092786+0000","last_became_peered":"2024-09-17T03:40:26.092786+0000","last_unstale":"2024-09-17T03:40:27.650063+0000","last_undegraded":"2024-09-17T03:40:27.650063+0000","last_fullsized":"2024-09-17T03:40:27.650063+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:18.161357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088077+0000","last_change":"2024-09-17T03:40:26.078819+0000","last_active":"2024-09-17T03:40:27.088077+0000","last_peered":"2024-09-17T03:40:27.088077+0000","last_clean":"2024-09-17T03:40:27.088077+0000","last_became_active":"2024-09-17T03:40:26.078101+0000","last_became_peered":"2024-09-17T03:40:26.078101+0000","last_unstale":"2024-09-17T03:40:27.088077+0000","last_undegraded":"2024-09-17T03:40:27.088077+0000","last_fullsized":"2024-09-17T03:40:27.088077+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:00.305840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089278+0000","last_change":"2024-09-17T03:40:26.092932+0000","last_active":"2024-09-17T03:40:27.089278+0000","last_peered":"2024-09-17T03:40:27.089278+0000","last_clean":"2024-09-17T03:40:27.089278+0000","last_became_active":"2024-09-17T03:40:26.092577+0000","last_became_peered":"2024-09-17T03:40:26.092577+0000","last_unstale":"2024-09-17T03:40:27.089278+0000","last_undegraded":"2024-09-17T03:40:27.089278+0000","last_fullsized":"2024-09-17T03:40:27.089278+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:03.614338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089666+0000","last_change":"2024-09-17T03:40:26.092395+0000","last_active":"2024-09-17T03:40:27.089666+0000","last_peered":"2024-09-17T03:40:27.089666+0000","last_clean":"2024-09-17T03:40:27.089666+0000","last_became_active":"2024-09-17T03:40:26.091948+0000","last_became_peered":"2024-09-17T03:40:26.091948+0000","last_unstale":"2024-09-17T03:40:27.089666+0000","last_undegraded":"2024-09-17T03:40:27.089666+0000","last_fullsized":"2024-09-17T03:40:27.089666+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:51.069412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092961+0000","last_change":"2024-09-17T03:40:26.099508+0000","last_active":"2024-09-17T03:40:27.092961+0000","last_peered":"2024-09-17T03:40:27.092961+0000","last_clean":"2024-09-17T03:40:27.092961+0000","last_became_active":"2024-09-17T03:40:26.099176+0000","last_became_peered":"2024-09-17T03:40:26.099176+0000","last_unstale":"2024-09-17T03:40:27.092961+0000","last_undegraded":"2024-09-17T03:40:27.092961+0000","last_fullsized":"2024-09-17T03:40:27.092961+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:03.696754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651138+0000","last_change":"2024-09-17T03:40:26.098607+0000","last_active":"2024-09-17T03:40:27.651138+0000","last_peered":"2024-09-17T03:40:27.651138+0000","last_clean":"2024-09-17T03:40:27.651138+0000","last_became_active":"2024-09-17T03:40:26.097785+0000","last_became_peered":"2024-09-17T03:40:26.097785+0000","last_unstale":"2024-09-17T03:40:27.651138+0000","last_undegraded":"2024-09-17T03:40:27.651138+0000","last_fullsized":"2024-09-17T03:40:27.651138+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:41.846363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093254+0000","last_change":"2024-09-17T03:40:26.100454+0000","last_active":"2024-09-17T03:40:27.093254+0000","last_peered":"2024-09-17T03:40:27.093254+0000","last_clean":"2024-09-17T03:40:27.093254+0000","last_became_active":"2024-09-17T03:40:26.100168+0000","last_became_peered":"2024-09-17T03:40:26.100168+0000","last_unstale":"2024-09-17T03:40:27.093254+0000","last_undegraded":"2024-09-17T03:40:27.093254+0000","last_fullsized":"2024-09-17T03:40:27.093254+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:54.210140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650704+0000","last_change":"2024-09-17T03:40:26.087836+0000","last_active":"2024-09-17T03:40:27.650704+0000","last_peered":"2024-09-17T03:40:27.650704+0000","last_clean":"2024-09-17T03:40:27.650704+0000","last_became_active":"2024-09-17T03:40:26.087513+0000","last_became_peered":"2024-09-17T03:40:26.087513+0000","last_unstale":"2024-09-17T03:40:27.650704+0000","last_undegraded":"2024-09-17T03:40:27.650704+0000","last_fullsized":"2024-09-17T03:40:27.650704+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:51.281251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650095+0000","last_change":"2024-09-17T03:40:26.092289+0000","last_active":"2024-09-17T03:40:27.650095+0000","last_peered":"2024-09-17T03:40:27.650095+0000","last_clean":"2024-09-17T03:40:27.650095+0000","last_became_active":"2024-09-17T03:40:26.091963+0000","last_became_peered":"2024-09-17T03:40:26.091963+0000","last_unstale":"2024-09-17T03:40:27.650095+0000","last_undegraded":"2024-09-17T03:40:27.650095+0000","last_fullsized":"2024-09-17T03:40:27.650095+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:41.846363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650115+0000","last_change":"2024-09-17T03:40:26.088606+0000","last_active":"2024-09-17T03:40:27.650115+0000","last_peered":"2024-09-17T03:40:27.650115+0000","last_clean":"2024-09-17T03:40:27.650115+0000","last_became_active":"2024-09-17T03:40:26.088322+0000","last_became_peered":"2024-09-17T03:40:26.088322+0000","last_unstale":"2024-09-17T03:40:27.650115+0000","last_undegraded":"2024-09-17T03:40:27.650115+0000","last_fullsized":"2024-09-17T03:40:27.650115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:40.496150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650885+0000","last_change":"2024-09-17T03:40:26.097257+0000","last_active":"2024-09-17T03:40:27.650885+0000","last_peered":"2024-09-17T03:40:27.650885+0000","last_clean":"2024-09-17T03:40:27.650885+0000","last_became_active":"2024-09-17T03:40:26.096887+0000","last_became_peered":"2024-09-17T03:40:26.096887+0000","last_unstale":"2024-09-17T03:40:27.650885+0000","last_undegraded":"2024-09-17T03:40:27.650885+0000","last_fullsized":"2024-09-17T03:40:27.650885+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:10.862380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090544+0000","last_change":"2024-09-17T03:40:26.098599+0000","last_active":"2024-09-17T03:40:27.090544+0000","last_peered":"2024-09-17T03:40:27.090544+0000","last_clean":"2024-09-17T03:40:27.090544+0000","last_became_active":"2024-09-17T03:40:26.098250+0000","last_became_peered":"2024-09-17T03:40:26.098250+0000","last_unstale":"2024-09-17T03:40:27.090544+0000","last_undegraded":"2024-09-17T03:40:27.090544+0000","last_fullsized":"2024-09-17T03:40:27.090544+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:31.185943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093083+0000","last_change":"2024-09-17T03:40:26.109226+0000","last_active":"2024-09-17T03:40:27.093083+0000","last_peered":"2024-09-17T03:40:27.093083+0000","last_clean":"2024-09-17T03:40:27.093083+0000","last_became_active":"2024-09-17T03:40:26.108900+0000","last_became_peered":"2024-09-17T03:40:26.108900+0000","last_unstale":"2024-09-17T03:40:27.093083+0000","last_undegraded":"2024-09-17T03:40:27.093083+0000","last_fullsized":"2024-09-17T03:40:27.093083+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:57.101219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088711+0000","last_change":"2024-09-17T03:40:26.097245+0000","last_active":"2024-09-17T03:40:27.088711+0000","last_peered":"2024-09-17T03:40:27.088711+0000","last_clean":"2024-09-17T03:40:27.088711+0000","last_became_active":"2024-09-17T03:40:26.096639+0000","last_became_peered":"2024-09-17T03:40:26.096639+0000","last_unstale":"2024-09-17T03:40:27.088711+0000","last_undegraded":"2024-09-17T03:40:27.088711+0000","last_fullsized":"2024-09-17T03:40:27.088711+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:53.112032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090143+0000","last_change":"2024-09-17T03:40:26.092527+0000","last_active":"2024-09-17T03:40:27.090143+0000","last_peered":"2024-09-17T03:40:27.090143+0000","last_clean":"2024-09-17T03:40:27.090143+0000","last_became_active":"2024-09-17T03:40:26.092128+0000","last_became_peered":"2024-09-17T03:40:26.092128+0000","last_unstale":"2024-09-17T03:40:27.090143+0000","last_undegraded":"2024-09-17T03:40:27.090143+0000","last_fullsized":"2024-09-17T03:40:27.090143+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:33.591545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088328+0000","last_change":"2024-09-17T03:40:26.092968+0000","last_active":"2024-09-17T03:40:27.088328+0000","last_peered":"2024-09-17T03:40:27.088328+0000","last_clean":"2024-09-17T03:40:27.088328+0000","last_became_active":"2024-09-17T03:40:26.092596+0000","last_became_peered":"2024-09-17T03:40:26.092596+0000","last_unstale":"2024-09-17T03:40:27.088328+0000","last_undegraded":"2024-09-17T03:40:27.088328+0000","last_fullsized":"2024-09-17T03:40:27.088328+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:21.943749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.649958+0000","last_change":"2024-09-17T03:40:26.090339+0000","last_active":"2024-09-17T03:40:27.649958+0000","last_peered":"2024-09-17T03:40:27.649958+0000","last_clean":"2024-09-17T03:40:27.649958+0000","last_became_active":"2024-09-17T03:40:26.090056+0000","last_became_peered":"2024-09-17T03:40:26.090056+0000","last_unstale":"2024-09-17T03:40:27.649958+0000","last_undegraded":"2024-09-17T03:40:27.649958+0000","last_fullsized":"2024-09-17T03:40:27.649958+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:23.264966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.649990+0000","last_change":"2024-09-17T03:40:26.082442+0000","last_active":"2024-09-17T03:40:27.649990+0000","last_peered":"2024-09-17T03:40:27.649990+0000","last_clean":"2024-09-17T03:40:27.649990+0000","last_became_active":"2024-09-17T03:40:26.082083+0000","last_became_peered":"2024-09-17T03:40:26.082083+0000","last_unstale":"2024-09-17T03:40:27.649990+0000","last_undegraded":"2024-09-17T03:40:27.649990+0000","last_fullsized":"2024-09-17T03:40:27.649990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:42.815401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090750+0000","last_change":"2024-09-17T03:40:26.094424+0000","last_active":"2024-09-17T03:40:27.090750+0000","last_peered":"2024-09-17T03:40:27.090750+0000","last_clean":"2024-09-17T03:40:27.090750+0000","last_became_active":"2024-09-17T03:40:26.094061+0000","last_became_peered":"2024-09-17T03:40:26.094061+0000","last_unstale":"2024-09-17T03:40:27.090750+0000","last_undegraded":"2024-09-17T03:40:27.090750+0000","last_fullsized":"2024-09-17T03:40:27.090750+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:56.894039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"109'4","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093454+0000","last_change":"2024-09-17T03:40:25.086790+0000","last_active":"2024-09-17T03:40:27.093454+0000","last_peered":"2024-09-17T03:40:27.093454+0000","last_clean":"2024-09-17T03:40:27.093454+0000","last_became_active":"2024-09-17T03:40:25.086123+0000","last_became_peered":"2024-09-17T03:40:25.086123+0000","last_unstale":"2024-09-17T03:40:27.093454+0000","last_undegraded":"2024-09-17T03:40:27.093454+0000","last_fullsized":"2024-09-17T03:40:27.093454+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:44.920346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651421+0000","last_change":"2024-09-17T03:40:26.097809+0000","last_active":"2024-09-17T03:40:27.651421+0000","last_peered":"2024-09-17T03:40:27.651421+0000","last_clean":"2024-09-17T03:40:27.651421+0000","last_became_active":"2024-09-17T03:40:26.095484+0000","last_became_peered":"2024-09-17T03:40:26.095484+0000","last_unstale":"2024-09-17T03:40:27.651421+0000","last_undegraded":"2024-09-17T03:40:27.651421+0000","last_fullsized":"2024-09-17T03:40:27.651421+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:51.281251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089707+0000","last_change":"2024-09-17T03:40:25.091077+0000","last_active":"2024-09-17T03:40:27.089707+0000","last_peered":"2024-09-17T03:40:27.089707+0000","last_clean":"2024-09-17T03:40:27.089707+0000","last_became_active":"2024-09-17T03:40:25.090715+0000","last_became_peered":"2024-09-17T03:40:25.090715+0000","last_unstale":"2024-09-17T03:40:27.089707+0000","last_undegraded":"2024-09-17T03:40:27.089707+0000","last_fullsized":"2024-09-17T03:40:27.089707+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:32.840233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650306+0000","last_change":"2024-09-17T03:40:26.091084+0000","last_active":"2024-09-17T03:40:27.650306+0000","last_peered":"2024-09-17T03:40:27.650306+0000","last_clean":"2024-09-17T03:40:27.650306+0000","last_became_active":"2024-09-17T03:40:26.090796+0000","last_became_peered":"2024-09-17T03:40:26.090796+0000","last_unstale":"2024-09-17T03:40:27.650306+0000","last_undegraded":"2024-09-17T03:40:27.650306+0000","last_fullsized":"2024-09-17T03:40:27.650306+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:56.889266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650796+0000","last_change":"2024-09-17T03:40:25.091127+0000","last_active":"2024-09-17T03:40:27.650796+0000","last_peered":"2024-09-17T03:40:27.650796+0000","last_clean":"2024-09-17T03:40:27.650796+0000","last_became_active":"2024-09-17T03:40:25.090828+0000","last_became_peered":"2024-09-17T03:40:25.090828+0000","last_unstale":"2024-09-17T03:40:27.650796+0000","last_undegraded":"2024-09-17T03:40:27.650796+0000","last_fullsized":"2024-09-17T03:40:27.650796+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:29.759478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651713+0000","last_change":"2024-09-17T03:40:26.099318+0000","last_active":"2024-09-17T03:40:27.651713+0000","last_peered":"2024-09-17T03:40:27.651713+0000","last_clean":"2024-09-17T03:40:27.651713+0000","last_became_active":"2024-09-17T03:40:26.098982+0000","last_became_peered":"2024-09-17T03:40:26.098982+0000","last_unstale":"2024-09-17T03:40:27.651713+0000","last_undegraded":"2024-09-17T03:40:27.651713+0000","last_fullsized":"2024-09-17T03:40:27.651713+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:38.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651030+0000","last_change":"2024-09-17T03:40:25.088001+0000","last_active":"2024-09-17T03:40:27.651030+0000","last_peered":"2024-09-17T03:40:27.651030+0000","last_clean":"2024-09-17T03:40:27.651030+0000","last_became_active":"2024-09-17T03:40:25.087631+0000","last_became_peered":"2024-09-17T03:40:25.087631+0000","last_unstale":"2024-09-17T03:40:27.651030+0000","last_undegraded":"2024-09-17T03:40:27.651030+0000","last_fullsized":"2024-09-17T03:40:27.651030+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:50.121556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088541+0000","last_change":"2024-09-17T03:40:26.102071+0000","last_active":"2024-09-17T03:40:27.088541+0000","last_peered":"2024-09-17T03:40:27.088541+0000","last_clean":"2024-09-17T03:40:27.088541+0000","last_became_active":"2024-09-17T03:40:26.101645+0000","last_became_peered":"2024-09-17T03:40:26.101645+0000","last_unstale":"2024-09-17T03:40:27.088541+0000","last_undegraded":"2024-09-17T03:40:27.088541+0000","last_fullsized":"2024-09-17T03:40:27.088541+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:39.422894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651058+0000","last_change":"2024-09-17T03:40:25.092407+0000","last_active":"2024-09-17T03:40:27.651058+0000","last_peered":"2024-09-17T03:40:27.651058+0000","last_clean":"2024-09-17T03:40:27.651058+0000","last_became_active":"2024-09-17T03:40:25.092121+0000","last_became_peered":"2024-09-17T03:40:25.092121+0000","last_unstale":"2024-09-17T03:40:27.651058+0000","last_undegraded":"2024-09-17T03:40:27.651058+0000","last_fullsized":"2024-09-17T03:40:27.651058+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:05.631360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650031+0000","last_change":"2024-09-17T03:40:26.103208+0000","last_active":"2024-09-17T03:40:27.650031+0000","last_peered":"2024-09-17T03:40:27.650031+0000","last_clean":"2024-09-17T03:40:27.650031+0000","last_became_active":"2024-09-17T03:40:26.102798+0000","last_became_peered":"2024-09-17T03:40:26.102798+0000","last_unstale":"2024-09-17T03:40:27.650031+0000","last_undegraded":"2024-09-17T03:40:27.650031+0000","last_fullsized":"2024-09-17T03:40:27.650031+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:07.900548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089451+0000","last_change":"2024-09-17T03:40:25.082851+0000","last_active":"2024-09-17T03:40:27.089451+0000","last_peered":"2024-09-17T03:40:27.089451+0000","last_clean":"2024-09-17T03:40:27.089451+0000","last_became_active":"2024-09-17T03:40:25.082524+0000","last_became_peered":"2024-09-17T03:40:25.082524+0000","last_unstale":"2024-09-17T03:40:27.089451+0000","last_undegraded":"2024-09-17T03:40:27.089451+0000","last_fullsized":"2024-09-17T03:40:27.089451+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:09.947706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088644+0000","last_change":"2024-09-17T03:40:26.082980+0000","last_active":"2024-09-17T03:40:27.088644+0000","last_peered":"2024-09-17T03:40:27.088644+0000","last_clean":"2024-09-17T03:40:27.088644+0000","last_became_active":"2024-09-17T03:40:26.082675+0000","last_became_peered":"2024-09-17T03:40:26.082675+0000","last_unstale":"2024-09-17T03:40:27.088644+0000","last_undegraded":"2024-09-17T03:40:27.088644+0000","last_fullsized":"2024-09-17T03:40:27.088644+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:01.292705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650151+0000","last_change":"2024-09-17T03:40:25.085262+0000","last_active":"2024-09-17T03:40:27.650151+0000","last_peered":"2024-09-17T03:40:27.650151+0000","last_clean":"2024-09-17T03:40:27.650151+0000","last_became_active":"2024-09-17T03:40:25.084924+0000","last_became_peered":"2024-09-17T03:40:25.084924+0000","last_unstale":"2024-09-17T03:40:27.650151+0000","last_undegraded":"2024-09-17T03:40:27.650151+0000","last_fullsized":"2024-09-17T03:40:27.650151+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:31.397640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089299+0000","last_change":"2024-09-17T03:40:26.091093+0000","last_active":"2024-09-17T03:40:27.089299+0000","last_peered":"2024-09-17T03:40:27.089299+0000","last_clean":"2024-09-17T03:40:27.089299+0000","last_became_active":"2024-09-17T03:40:26.089624+0000","last_became_peered":"2024-09-17T03:40:26.089624+0000","last_unstale":"2024-09-17T03:40:27.089299+0000","last_undegraded":"2024-09-17T03:40:27.089299+0000","last_fullsized":"2024-09-17T03:40:27.089299+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:40.051808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089659+0000","last_change":"2024-09-17T03:40:25.091182+0000","last_active":"2024-09-17T03:40:27.089659+0000","last_peered":"2024-09-17T03:40:27.089659+0000","last_clean":"2024-09-17T03:40:27.089659+0000","last_became_active":"2024-09-17T03:40:25.090160+0000","last_became_peered":"2024-09-17T03:40:25.090160+0000","last_unstale":"2024-09-17T03:40:27.089659+0000","last_undegraded":"2024-09-17T03:40:27.089659+0000","last_fullsized":"2024-09-17T03:40:27.089659+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:17.125522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651035+0000","last_change":"2024-09-17T03:40:26.100410+0000","last_active":"2024-09-17T03:40:27.651035+0000","last_peered":"2024-09-17T03:40:27.651035+0000","last_clean":"2024-09-17T03:40:27.651035+0000","last_became_active":"2024-09-17T03:40:26.100098+0000","last_became_peered":"2024-09-17T03:40:26.100098+0000","last_unstale":"2024-09-17T03:40:27.651035+0000","last_undegraded":"2024-09-17T03:40:27.651035+0000","last_fullsized":"2024-09-17T03:40:27.651035+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:05.438754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651831+0000","last_change":"2024-09-17T03:40:25.090872+0000","last_active":"2024-09-17T03:40:27.651831+0000","last_peered":"2024-09-17T03:40:27.651831+0000","last_clean":"2024-09-17T03:40:27.651831+0000","last_became_active":"2024-09-17T03:40:25.090576+0000","last_became_peered":"2024-09-17T03:40:25.090576+0000","last_unstale":"2024-09-17T03:40:27.651831+0000","last_undegraded":"2024-09-17T03:40:27.651831+0000","last_fullsized":"2024-09-17T03:40:27.651831+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:54.401051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651807+0000","last_change":"2024-09-17T03:40:26.100267+0000","last_active":"2024-09-17T03:40:27.651807+0000","last_peered":"2024-09-17T03:40:27.651807+0000","last_clean":"2024-09-17T03:40:27.651807+0000","last_became_active":"2024-09-17T03:40:26.099941+0000","last_became_peered":"2024-09-17T03:40:26.099941+0000","last_unstale":"2024-09-17T03:40:27.651807+0000","last_undegraded":"2024-09-17T03:40:27.651807+0000","last_fullsized":"2024-09-17T03:40:27.651807+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:34.780970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651520+0000","last_change":"2024-09-17T03:40:25.083953+0000","last_active":"2024-09-17T03:40:27.651520+0000","last_peered":"2024-09-17T03:40:27.651520+0000","last_clean":"2024-09-17T03:40:27.651520+0000","last_became_active":"2024-09-17T03:40:25.082074+0000","last_became_peered":"2024-09-17T03:40:25.082074+0000","last_unstale":"2024-09-17T03:40:27.651520+0000","last_undegraded":"2024-09-17T03:40:27.651520+0000","last_fullsized":"2024-09-17T03:40:27.651520+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:29.759478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088137+0000","last_change":"2024-09-17T03:40:26.094680+0000","last_active":"2024-09-17T03:40:27.088137+0000","last_peered":"2024-09-17T03:40:27.088137+0000","last_clean":"2024-09-17T03:40:27.088137+0000","last_became_active":"2024-09-17T03:40:26.093903+0000","last_became_peered":"2024-09-17T03:40:26.093903+0000","last_unstale":"2024-09-17T03:40:27.088137+0000","last_undegraded":"2024-09-17T03:40:27.088137+0000","last_fullsized":"2024-09-17T03:40:27.088137+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:14.318070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"109'3","reported_seq":18,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650607+0000","last_change":"2024-09-17T03:40:25.089863+0000","last_active":"2024-09-17T03:40:27.650607+0000","last_peered":"2024-09-17T03:40:27.650607+0000","last_clean":"2024-09-17T03:40:27.650607+0000","last_became_active":"2024-09-17T03:40:25.089511+0000","last_became_peered":"2024-09-17T03:40:25.089511+0000","last_unstale":"2024-09-17T03:40:27.650607+0000","last_undegraded":"2024-09-17T03:40:27.650607+0000","last_fullsized":"2024-09-17T03:40:27.650607+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:41.607946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093184+0000","last_change":"2024-09-17T03:40:26.101714+0000","last_active":"2024-09-17T03:40:27.093184+0000","last_peered":"2024-09-17T03:40:27.093184+0000","last_clean":"2024-09-17T03:40:27.093184+0000","last_became_active":"2024-09-17T03:40:26.101174+0000","last_became_peered":"2024-09-17T03:40:26.101174+0000","last_unstale":"2024-09-17T03:40:27.093184+0000","last_undegraded":"2024-09-17T03:40:27.093184+0000","last_fullsized":"2024-09-17T03:40:27.093184+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:17.973757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"109'6","reported_seq":21,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651221+0000","last_change":"2024-09-17T03:40:25.084751+0000","last_active":"2024-09-17T03:40:27.651221+0000","last_peered":"2024-09-17T03:40:27.651221+0000","last_clean":"2024-09-17T03:40:27.651221+0000","last_became_active":"2024-09-17T03:40:25.084419+0000","last_became_peered":"2024-09-17T03:40:25.084419+0000","last_unstale":"2024-09-17T03:40:27.651221+0000","last_undegraded":"2024-09-17T03:40:27.651221+0000","last_fullsized":"2024-09-17T03:40:27.651221+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:42.470301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092680+0000","last_change":"2024-09-17T03:40:26.086208+0000","last_active":"2024-09-17T03:40:27.092680+0000","last_peered":"2024-09-17T03:40:27.092680+0000","last_clean":"2024-09-17T03:40:27.092680+0000","last_became_active":"2024-09-17T03:40:26.085919+0000","last_became_peered":"2024-09-17T03:40:26.085919+0000","last_unstale":"2024-09-17T03:40:27.092680+0000","last_undegraded":"2024-09-17T03:40:27.092680+0000","last_fullsized":"2024-09-17T03:40:27.092680+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:48.231447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089602+0000","last_change":"2024-09-17T03:40:25.080989+0000","last_active":"2024-09-17T03:40:27.089602+0000","last_peered":"2024-09-17T03:40:27.089602+0000","last_clean":"2024-09-17T03:40:27.089602+0000","last_became_active":"2024-09-17T03:40:25.080667+0000","last_became_peered":"2024-09-17T03:40:25.080667+0000","last_unstale":"2024-09-17T03:40:27.089602+0000","last_undegraded":"2024-09-17T03:40:27.089602+0000","last_fullsized":"2024-09-17T03:40:27.089602+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:57.430299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651507+0000","last_change":"2024-09-17T03:40:26.107467+0000","last_active":"2024-09-17T03:40:27.651507+0000","last_peered":"2024-09-17T03:40:27.651507+0000","last_clean":"2024-09-17T03:40:27.651507+0000","last_became_active":"2024-09-17T03:40:26.107118+0000","last_became_peered":"2024-09-17T03:40:26.107118+0000","last_unstale":"2024-09-17T03:40:27.651507+0000","last_undegraded":"2024-09-17T03:40:27.651507+0000","last_fullsized":"2024-09-17T03:40:27.651507+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:38.315163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089194+0000","last_change":"2024-09-17T03:40:25.095537+0000","last_active":"2024-09-17T03:40:27.089194+0000","last_peered":"2024-09-17T03:40:27.089194+0000","last_clean":"2024-09-17T03:40:27.089194+0000","last_became_active":"2024-09-17T03:40:25.094852+0000","last_became_peered":"2024-09-17T03:40:25.094852+0000","last_unstale":"2024-09-17T03:40:27.089194+0000","last_undegraded":"2024-09-17T03:40:27.089194+0000","last_fullsized":"2024-09-17T03:40:27.089194+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:47.845830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088407+0000","last_change":"2024-09-17T03:40:26.081760+0000","last_active":"2024-09-17T03:40:27.088407+0000","last_peered":"2024-09-17T03:40:27.088407+0000","last_clean":"2024-09-17T03:40:27.088407+0000","last_became_active":"2024-09-17T03:40:26.081443+0000","last_became_peered":"2024-09-17T03:40:26.081443+0000","last_unstale":"2024-09-17T03:40:27.088407+0000","last_undegraded":"2024-09-17T03:40:27.088407+0000","last_fullsized":"2024-09-17T03:40:27.088407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:07.878699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089045+0000","last_change":"2024-09-17T03:40:25.076755+0000","last_active":"2024-09-17T03:40:27.089045+0000","last_peered":"2024-09-17T03:40:27.089045+0000","last_clean":"2024-09-17T03:40:27.089045+0000","last_became_active":"2024-09-17T03:40:25.076451+0000","last_became_peered":"2024-09-17T03:40:25.076451+0000","last_unstale":"2024-09-17T03:40:27.089045+0000","last_undegraded":"2024-09-17T03:40:27.089045+0000","last_fullsized":"2024-09-17T03:40:27.089045+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:05.715292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651554+0000","last_change":"2024-09-17T03:40:26.086421+0000","last_active":"2024-09-17T03:40:27.651554+0000","last_peered":"2024-09-17T03:40:27.651554+0000","last_clean":"2024-09-17T03:40:27.651554+0000","last_became_active":"2024-09-17T03:40:26.083374+0000","last_became_peered":"2024-09-17T03:40:26.083374+0000","last_unstale":"2024-09-17T03:40:27.651554+0000","last_undegraded":"2024-09-17T03:40:27.651554+0000","last_fullsized":"2024-09-17T03:40:27.651554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:40.496150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089461+0000","last_change":"2024-09-17T03:40:25.089035+0000","last_active":"2024-09-17T03:40:27.089461+0000","last_peered":"2024-09-17T03:40:27.089461+0000","last_clean":"2024-09-17T03:40:27.089461+0000","last_became_active":"2024-09-17T03:40:25.088719+0000","last_became_peered":"2024-09-17T03:40:25.088719+0000","last_unstale":"2024-09-17T03:40:27.089461+0000","last_undegraded":"2024-09-17T03:40:27.089461+0000","last_fullsized":"2024-09-17T03:40:27.089461+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:04.430259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650448+0000","last_change":"2024-09-17T03:40:26.103860+0000","last_active":"2024-09-17T03:40:27.650448+0000","last_peered":"2024-09-17T03:40:27.650448+0000","last_clean":"2024-09-17T03:40:27.650448+0000","last_became_active":"2024-09-17T03:40:26.101932+0000","last_became_peered":"2024-09-17T03:40:26.101932+0000","last_unstale":"2024-09-17T03:40:27.650448+0000","last_undegraded":"2024-09-17T03:40:27.650448+0000","last_fullsized":"2024-09-17T03:40:27.650448+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:57.235098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089864+0000","last_change":"2024-09-17T03:40:25.095020+0000","last_active":"2024-09-17T03:40:27.089864+0000","last_peered":"2024-09-17T03:40:27.089864+0000","last_clean":"2024-09-17T03:40:27.089864+0000","last_became_active":"2024-09-17T03:40:25.094243+0000","last_became_peered":"2024-09-17T03:40:25.094243+0000","last_unstale":"2024-09-17T03:40:27.089864+0000","last_undegraded":"2024-09-17T03:40:27.089864+0000","last_fullsized":"2024-09-17T03:40:27.089864+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:57.778371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651579+0000","last_change":"2024-09-17T03:40:26.105799+0000","last_active":"2024-09-17T03:40:27.651579+0000","last_peered":"2024-09-17T03:40:27.651579+0000","last_clean":"2024-09-17T03:40:27.651579+0000","last_became_active":"2024-09-17T03:40:26.105418+0000","last_became_peered":"2024-09-17T03:40:26.105418+0000","last_unstale":"2024-09-17T03:40:27.651579+0000","last_undegraded":"2024-09-17T03:40:27.651579+0000","last_fullsized":"2024-09-17T03:40:27.651579+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:34.780970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"109'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093162+0000","last_change":"2024-09-17T03:40:25.093528+0000","last_active":"2024-09-17T03:40:27.093162+0000","last_peered":"2024-09-17T03:40:27.093162+0000","last_clean":"2024-09-17T03:40:27.093162+0000","last_became_active":"2024-09-17T03:40:25.092930+0000","last_became_peered":"2024-09-17T03:40:25.092930+0000","last_unstale":"2024-09-17T03:40:27.093162+0000","last_undegraded":"2024-09-17T03:40:27.093162+0000","last_fullsized":"2024-09-17T03:40:27.093162+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:51.119027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093184+0000","last_change":"2024-09-17T03:40:26.095248+0000","last_active":"2024-09-17T03:40:27.093184+0000","last_peered":"2024-09-17T03:40:27.093184+0000","last_clean":"2024-09-17T03:40:27.093184+0000","last_became_active":"2024-09-17T03:40:26.094665+0000","last_became_peered":"2024-09-17T03:40:26.094665+0000","last_unstale":"2024-09-17T03:40:27.093184+0000","last_undegraded":"2024-09-17T03:40:27.093184+0000","last_fullsized":"2024-09-17T03:40:27.093184+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:27.655400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650275+0000","last_change":"2024-09-17T03:40:25.094560+0000","last_active":"2024-09-17T03:40:27.650275+0000","last_peered":"2024-09-17T03:40:27.650275+0000","last_clean":"2024-09-17T03:40:27.650275+0000","last_became_active":"2024-09-17T03:40:25.094224+0000","last_became_peered":"2024-09-17T03:40:25.094224+0000","last_unstale":"2024-09-17T03:40:27.650275+0000","last_undegraded":"2024-09-17T03:40:27.650275+0000","last_fullsized":"2024-09-17T03:40:27.650275+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:14.218993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650787+0000","last_change":"2024-09-17T03:40:26.110536+0000","last_active":"2024-09-17T03:40:27.650787+0000","last_peered":"2024-09-17T03:40:27.650787+0000","last_clean":"2024-09-17T03:40:27.650787+0000","last_became_active":"2024-09-17T03:40:26.110225+0000","last_became_peered":"2024-09-17T03:40:26.110225+0000","last_unstale":"2024-09-17T03:40:27.650787+0000","last_undegraded":"2024-09-17T03:40:27.650787+0000","last_fullsized":"2024-09-17T03:40:27.650787+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:29.177484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088744+0000","last_change":"2024-09-17T03:40:25.081602+0000","last_active":"2024-09-17T03:40:27.088744+0000","last_peered":"2024-09-17T03:40:27.088744+0000","last_clean":"2024-09-17T03:40:27.088744+0000","last_became_active":"2024-09-17T03:40:25.081289+0000","last_became_peered":"2024-09-17T03:40:25.081289+0000","last_unstale":"2024-09-17T03:40:27.088744+0000","last_undegraded":"2024-09-17T03:40:27.088744+0000","last_fullsized":"2024-09-17T03:40:27.088744+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:37.306668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088329+0000","last_change":"2024-09-17T03:40:26.091947+0000","last_active":"2024-09-17T03:40:27.088329+0000","last_peered":"2024-09-17T03:40:27.088329+0000","last_clean":"2024-09-17T03:40:27.088329+0000","last_became_active":"2024-09-17T03:40:26.091584+0000","last_became_peered":"2024-09-17T03:40:26.091584+0000","last_unstale":"2024-09-17T03:40:27.088329+0000","last_undegraded":"2024-09-17T03:40:27.088329+0000","last_fullsized":"2024-09-17T03:40:27.088329+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:06.639855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651045+0000","last_change":"2024-09-17T03:40:25.085590+0000","last_active":"2024-09-17T03:40:27.651045+0000","last_peered":"2024-09-17T03:40:27.651045+0000","last_clean":"2024-09-17T03:40:27.651045+0000","last_became_active":"2024-09-17T03:40:25.085288+0000","last_became_peered":"2024-09-17T03:40:25.085288+0000","last_unstale":"2024-09-17T03:40:27.651045+0000","last_undegraded":"2024-09-17T03:40:27.651045+0000","last_fullsized":"2024-09-17T03:40:27.651045+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:51.070669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088908+0000","last_change":"2024-09-17T03:40:26.102801+0000","last_active":"2024-09-17T03:40:27.088908+0000","last_peered":"2024-09-17T03:40:27.088908+0000","last_clean":"2024-09-17T03:40:27.088908+0000","last_became_active":"2024-09-17T03:40:26.102488+0000","last_became_peered":"2024-09-17T03:40:26.102488+0000","last_unstale":"2024-09-17T03:40:27.088908+0000","last_undegraded":"2024-09-17T03:40:27.088908+0000","last_fullsized":"2024-09-17T03:40:27.088908+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:27.332049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088923+0000","last_change":"2024-09-17T03:40:25.092780+0000","last_active":"2024-09-17T03:40:27.088923+0000","last_peered":"2024-09-17T03:40:27.088923+0000","last_clean":"2024-09-17T03:40:27.088923+0000","last_became_active":"2024-09-17T03:40:25.092232+0000","last_became_peered":"2024-09-17T03:40:25.092232+0000","last_unstale":"2024-09-17T03:40:27.088923+0000","last_undegraded":"2024-09-17T03:40:27.088923+0000","last_fullsized":"2024-09-17T03:40:27.088923+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:22.778728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651203+0000","last_change":"2024-09-17T03:40:26.100233+0000","last_active":"2024-09-17T03:40:27.651203+0000","last_peered":"2024-09-17T03:40:27.651203+0000","last_clean":"2024-09-17T03:40:27.651203+0000","last_became_active":"2024-09-17T03:40:26.099953+0000","last_became_peered":"2024-09-17T03:40:26.099953+0000","last_unstale":"2024-09-17T03:40:27.651203+0000","last_undegraded":"2024-09-17T03:40:27.651203+0000","last_fullsized":"2024-09-17T03:40:27.651203+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:41.791243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092591+0000","last_change":"2024-09-17T03:40:25.090999+0000","last_active":"2024-09-17T03:40:27.092591+0000","last_peered":"2024-09-17T03:40:27.092591+0000","last_clean":"2024-09-17T03:40:27.092591+0000","last_became_active":"2024-09-17T03:40:25.090560+0000","last_became_peered":"2024-09-17T03:40:25.090560+0000","last_unstale":"2024-09-17T03:40:27.092591+0000","last_undegraded":"2024-09-17T03:40:27.092591+0000","last_fullsized":"2024-09-17T03:40:27.092591+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:15.580364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088983+0000","last_change":"2024-09-17T03:40:26.090039+0000","last_active":"2024-09-17T03:40:27.088983+0000","last_peered":"2024-09-17T03:40:27.088983+0000","last_clean":"2024-09-17T03:40:27.088983+0000","last_became_active":"2024-09-17T03:40:26.088910+0000","last_became_peered":"2024-09-17T03:40:26.088910+0000","last_unstale":"2024-09-17T03:40:27.088983+0000","last_undegraded":"2024-09-17T03:40:27.088983+0000","last_fullsized":"2024-09-17T03:40:27.088983+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:17.354715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"109'2","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651485+0000","last_change":"2024-09-17T03:40:25.088715+0000","last_active":"2024-09-17T03:40:27.651485+0000","last_peered":"2024-09-17T03:40:27.651485+0000","last_clean":"2024-09-17T03:40:27.651485+0000","last_became_active":"2024-09-17T03:40:25.088075+0000","last_became_peered":"2024-09-17T03:40:25.088075+0000","last_unstale":"2024-09-17T03:40:27.651485+0000","last_undegraded":"2024-09-17T03:40:27.651485+0000","last_fullsized":"2024-09-17T03:40:27.651485+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:53.318725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088606+0000","last_change":"2024-09-17T03:40:26.113739+0000","last_active":"2024-09-17T03:40:27.088606+0000","last_peered":"2024-09-17T03:40:27.088606+0000","last_clean":"2024-09-17T03:40:27.088606+0000","last_became_active":"2024-09-17T03:40:26.113370+0000","last_became_peered":"2024-09-17T03:40:26.113370+0000","last_unstale":"2024-09-17T03:40:27.088606+0000","last_undegraded":"2024-09-17T03:40:27.088606+0000","last_fullsized":"2024-09-17T03:40:27.088606+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:50.990280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"110'1","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093089+0000","last_change":"2024-09-17T03:40:25.092408+0000","last_active":"2024-09-17T03:40:27.093089+0000","last_peered":"2024-09-17T03:40:27.093089+0000","last_clean":"2024-09-17T03:40:27.093089+0000","last_became_active":"2024-09-17T03:40:25.092023+0000","last_became_peered":"2024-09-17T03:40:25.092023+0000","last_unstale":"2024-09-17T03:40:27.093089+0000","last_undegraded":"2024-09-17T03:40:27.093089+0000","last_fullsized":"2024-09-17T03:40:27.093089+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:39.144487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651583+0000","last_change":"2024-09-17T03:40:26.088167+0000","last_active":"2024-09-17T03:40:27.651583+0000","last_peered":"2024-09-17T03:40:27.651583+0000","last_clean":"2024-09-17T03:40:27.651583+0000","last_became_active":"2024-09-17T03:40:26.087880+0000","last_became_peered":"2024-09-17T03:40:26.087880+0000","last_unstale":"2024-09-17T03:40:27.651583+0000","last_undegraded":"2024-09-17T03:40:27.651583+0000","last_fullsized":"2024-09-17T03:40:27.651583+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:51.281251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093271+0000","last_change":"2024-09-17T03:40:25.088614+0000","last_active":"2024-09-17T03:40:27.093271+0000","last_peered":"2024-09-17T03:40:27.093271+0000","last_clean":"2024-09-17T03:40:27.093271+0000","last_became_active":"2024-09-17T03:40:25.088063+0000","last_became_peered":"2024-09-17T03:40:25.088063+0000","last_unstale":"2024-09-17T03:40:27.093271+0000","last_undegraded":"2024-09-17T03:40:27.093271+0000","last_fullsized":"2024-09-17T03:40:27.093271+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:27.806753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.090554+0000","last_change":"2024-09-17T03:40:26.102432+0000","last_active":"2024-09-17T03:40:27.090554+0000","last_peered":"2024-09-17T03:40:27.090554+0000","last_clean":"2024-09-17T03:40:27.090554+0000","last_became_active":"2024-09-17T03:40:26.102112+0000","last_became_peered":"2024-09-17T03:40:26.102112+0000","last_unstale":"2024-09-17T03:40:27.090554+0000","last_undegraded":"2024-09-17T03:40:27.090554+0000","last_fullsized":"2024-09-17T03:40:27.090554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:19.302727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089175+0000","last_change":"2024-09-17T03:40:25.090603+0000","last_active":"2024-09-17T03:40:27.089175+0000","last_peered":"2024-09-17T03:40:27.089175+0000","last_clean":"2024-09-17T03:40:27.089175+0000","last_became_active":"2024-09-17T03:40:25.089547+0000","last_became_peered":"2024-09-17T03:40:25.089547+0000","last_unstale":"2024-09-17T03:40:27.089175+0000","last_undegraded":"2024-09-17T03:40:27.089175+0000","last_fullsized":"2024-09-17T03:40:27.089175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:33.772475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088899+0000","last_change":"2024-09-17T03:40:26.081819+0000","last_active":"2024-09-17T03:40:27.088899+0000","last_peered":"2024-09-17T03:40:27.088899+0000","last_clean":"2024-09-17T03:40:27.088899+0000","last_became_active":"2024-09-17T03:40:26.081449+0000","last_became_peered":"2024-09-17T03:40:26.081449+0000","last_unstale":"2024-09-17T03:40:27.088899+0000","last_undegraded":"2024-09-17T03:40:27.088899+0000","last_fullsized":"2024-09-17T03:40:27.088899+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:21.051497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.093261+0000","last_change":"2024-09-17T03:40:25.094592+0000","last_active":"2024-09-17T03:40:27.093261+0000","last_peered":"2024-09-17T03:40:27.093261+0000","last_clean":"2024-09-17T03:40:27.093261+0000","last_became_active":"2024-09-17T03:40:25.094042+0000","last_became_peered":"2024-09-17T03:40:25.094042+0000","last_unstale":"2024-09-17T03:40:27.093261+0000","last_undegraded":"2024-09-17T03:40:27.093261+0000","last_fullsized":"2024-09-17T03:40:27.093261+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:30.892412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650978+0000","last_change":"2024-09-17T03:40:26.105066+0000","last_active":"2024-09-17T03:40:27.650978+0000","last_peered":"2024-09-17T03:40:27.650978+0000","last_clean":"2024-09-17T03:40:27.650978+0000","last_became_active":"2024-09-17T03:40:26.104744+0000","last_became_peered":"2024-09-17T03:40:26.104744+0000","last_unstale":"2024-09-17T03:40:27.650978+0000","last_undegraded":"2024-09-17T03:40:27.650978+0000","last_fullsized":"2024-09-17T03:40:27.650978+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:26.552280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650999+0000","last_change":"2024-09-17T03:40:25.091754+0000","last_active":"2024-09-17T03:40:27.650999+0000","last_peered":"2024-09-17T03:40:27.650999+0000","last_clean":"2024-09-17T03:40:27.650999+0000","last_became_active":"2024-09-17T03:40:25.091404+0000","last_became_peered":"2024-09-17T03:40:25.091404+0000","last_unstale":"2024-09-17T03:40:27.650999+0000","last_undegraded":"2024-09-17T03:40:27.650999+0000","last_fullsized":"2024-09-17T03:40:27.650999+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:54.401051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092686+0000","last_change":"2024-09-17T03:40:26.095493+0000","last_active":"2024-09-17T03:40:27.092686+0000","last_peered":"2024-09-17T03:40:27.092686+0000","last_clean":"2024-09-17T03:40:27.092686+0000","last_became_active":"2024-09-17T03:40:26.095167+0000","last_became_peered":"2024-09-17T03:40:26.095167+0000","last_unstale":"2024-09-17T03:40:27.092686+0000","last_undegraded":"2024-09-17T03:40:27.092686+0000","last_fullsized":"2024-09-17T03:40:27.092686+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:00.202701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.651724+0000","last_change":"2024-09-17T03:40:25.094752+0000","last_active":"2024-09-17T03:40:27.651724+0000","last_peered":"2024-09-17T03:40:27.651724+0000","last_clean":"2024-09-17T03:40:27.651724+0000","last_became_active":"2024-09-17T03:40:25.094409+0000","last_became_peered":"2024-09-17T03:40:25.094409+0000","last_unstale":"2024-09-17T03:40:27.651724+0000","last_undegraded":"2024-09-17T03:40:27.651724+0000","last_fullsized":"2024-09-17T03:40:27.651724+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:59.015131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.089551+0000","last_change":"2024-09-17T03:40:26.081960+0000","last_active":"2024-09-17T03:40:27.089551+0000","last_peered":"2024-09-17T03:40:27.089551+0000","last_clean":"2024-09-17T03:40:27.089551+0000","last_became_active":"2024-09-17T03:40:26.081649+0000","last_became_peered":"2024-09-17T03:40:26.081649+0000","last_unstale":"2024-09-17T03:40:27.089551+0000","last_undegraded":"2024-09-17T03:40:27.089551+0000","last_fullsized":"2024-09-17T03:40:27.089551+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:15.491879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092726+0000","last_change":"2024-09-17T03:40:25.082332+0000","last_active":"2024-09-17T03:40:27.092726+0000","last_peered":"2024-09-17T03:40:27.092726+0000","last_clean":"2024-09-17T03:40:27.092726+0000","last_became_active":"2024-09-17T03:40:25.082030+0000","last_became_peered":"2024-09-17T03:40:25.082030+0000","last_unstale":"2024-09-17T03:40:27.092726+0000","last_undegraded":"2024-09-17T03:40:27.092726+0000","last_fullsized":"2024-09-17T03:40:27.092726+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:26.233960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.092728+0000","last_change":"2024-09-17T03:40:26.097480+0000","last_active":"2024-09-17T03:40:27.092728+0000","last_peered":"2024-09-17T03:40:27.092728+0000","last_clean":"2024-09-17T03:40:27.092728+0000","last_became_active":"2024-09-17T03:40:26.096671+0000","last_became_peered":"2024-09-17T03:40:26.096671+0000","last_unstale":"2024-09-17T03:40:27.092728+0000","last_undegraded":"2024-09-17T03:40:27.092728+0000","last_fullsized":"2024-09-17T03:40:27.092728+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:25.056302+0000","last_clean_scrub_stamp":"2024-09-17T03:40:25.056302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:51.650601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"109'8","reported_seq":23,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.088699+0000","last_change":"2024-09-17T03:40:25.084933+0000","last_active":"2024-09-17T03:40:27.088699+0000","last_peered":"2024-09-17T03:40:27.088699+0000","last_clean":"2024-09-17T03:40:27.088699+0000","last_became_active":"2024-09-17T03:40:25.084571+0000","last_became_peered":"2024-09-17T03:40:25.084571+0000","last_unstale":"2024-09-17T03:40:27.088699+0000","last_undegraded":"2024-09-17T03:40:27.088699+0000","last_fullsized":"2024-09-17T03:40:27.088699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:24.047807+0000","last_clean_scrub_stamp":"2024-09-17T03:40:24.047807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:55.687864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":276,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-17T03:40:27.650288+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:40:27.650288+0000","last_peered":"2024-09-17T03:40:27.650288+0000","last_clean":"2024-09-17T03:40:27.650288+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:40:27.650288+0000","last_undegraded":"2024-09-17T03:40:27.650288+0000","last_fullsized":"2024-09-17T03:40:27.650288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":627099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1368064,"data_stored":627121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509504,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33116,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338724,"statfs":{"total":96636764160,"available":96602853376,"internally_reserved":0,"allocated":1970176,"data_stored":1219079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509506,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1368064,"data_stored":627189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":629293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509505,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33116,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338724,"statfs":{"total":96636764160,"available":96602853376,"internally_reserved":0,"allocated":1966080,"data_stored":1217627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1376256,"data_stored":627785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1372160,"data_stored":627155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:35.939 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:40:35.939 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:40:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.205+0000 7f7507400640 1 -- 172.21.15.121:0/334449929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f750015a3e0 msgr2=0x7f750006d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.205+0000 7f7507400640 1 --2- 172.21.15.121:0/334449929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f750015a3e0 0x7f750006d800 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f7500072680 tx=0x7f74f002a410 comp rx=0 tx=0).stop 2024-09-17T03:40:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.205+0000 7f7507400640 1 -- 172.21.15.121:0/334449929 shutdown_connections 2024-09-17T03:40:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.205+0000 7f7507400640 1 --2- 172.21.15.121:0/334449929 >> v2:172.21.15.176:3300/0 conn(0x7f750006ddc0 0x7f75000d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.205+0000 7f7507400640 1 --2- 172.21.15.121:0/334449929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f750015a3e0 0x7f750006d800 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.205+0000 7f7507400640 1 -- 172.21.15.121:0/334449929 >> 172.21.15.121:0/334449929 conn(0x7f75000b3580 msgr2=0x7f75000b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.205+0000 7f7507400640 1 -- 172.21.15.121:0/334449929 shutdown_connections 2024-09-17T03:40:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.205+0000 7f7507400640 1 -- 172.21.15.121:0/334449929 wait complete. 2024-09-17T03:40:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.207+0000 7f7507400640 1 Processor -- start 2024-09-17T03:40:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.208+0000 7f7507400640 1 -- start start 2024-09-17T03:40:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.209+0000 7f7507400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750006ddc0 0x7f75000c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.209+0000 7f7507400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75000d0af0 0x7f7500074920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.209+0000 7f7507400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750015a3e0 0x7f75000b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.209+0000 7f7507400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f750006e3d0 con 0x7f75000d0af0 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.209+0000 7f7507400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7500161190 con 0x7f750006ddc0 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.209+0000 7f7507400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f750006f560 con 0x7f750015a3e0 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.209+0000 7f74f7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75000d0af0 0x7f7500074920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.209+0000 7f74f7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75000d0af0 0x7f7500074920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38818/0 (socket says 172.21.15.121:38818) 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.209+0000 7f74f7e00640 1 -- 172.21.15.121:0/415020345 learned_addr learned my addr 172.21.15.121:0/415020345 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f7504a00640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750006ddc0 0x7f75000c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f7505400640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750015a3e0 0x7f75000b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f74f7e00640 1 -- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750015a3e0 msgr2=0x7f75000b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f74f7e00640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750015a3e0 0x7f75000b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f74f7e00640 1 -- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750006ddc0 msgr2=0x7f75000c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f74f7e00640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750006ddc0 0x7f75000c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f74f7e00640 1 -- 172.21.15.121:0/415020345 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75000c72c0 con 0x7f75000d0af0 2024-09-17T03:40:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f7505400640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750015a3e0 0x7f75000b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f74f7e00640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75000d0af0 0x7f7500074920 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009fd0 tx=0x7f74e800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f74fd600640 1 -- 172.21.15.121:0/415020345 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e800ccc0 con 0x7f75000d0af0 2024-09-17T03:40:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f74fd600640 1 -- 172.21.15.121:0/415020345 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74e800ee70 con 0x7f75000d0af0 2024-09-17T03:40:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f7507400640 1 -- 172.21.15.121:0/415020345 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75000c75a0 con 0x7f75000d0af0 2024-09-17T03:40:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.210+0000 7f74fd600640 1 -- 172.21.15.121:0/415020345 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e800ce60 con 0x7f75000d0af0 2024-09-17T03:40:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.211+0000 7f7507400640 1 -- 172.21.15.121:0/415020345 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7500074e60 con 0x7f75000d0af0 2024-09-17T03:40:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.212+0000 7f7507400640 1 -- 172.21.15.121:0/415020345 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75000c81b0 con 0x7f75000d0af0 2024-09-17T03:40:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.213+0000 7f74fd600640 1 -- 172.21.15.121:0/415020345 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74e8004280 con 0x7f75000d0af0 2024-09-17T03:40:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.214+0000 7f74fd600640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f74dc078bc0 0x7f74dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.215+0000 7f74fd600640 1 -- 172.21.15.121:0/415020345 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f74e809b7f0 con 0x7f75000d0af0 2024-09-17T03:40:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.215+0000 7f7504a00640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f74dc078bc0 0x7f74dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.216+0000 7f7504a00640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f74dc078bc0 0x7f74dc07b0d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f74f0034000 tx=0x7f74f0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:36.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.219+0000 7f74fd600640 1 -- 172.21.15.121:0/415020345 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74e8063a00 con 0x7f75000d0af0 2024-09-17T03:40:36.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.475+0000 7f7507400640 1 -- 172.21.15.121:0/415020345 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f750006fa10 con 0x7f75000d0af0 2024-09-17T03:40:36.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.478+0000 7f74fd600640 1 -- 172.21.15.121:0/415020345 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f74e8063300 con 0x7f75000d0af0 2024-09-17T03:40:36.478 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-17T03:40:36.478 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDB+OhmZgC+FBAAuH0Xms998y6JvCnlZJpjEw== 2024-09-17T03:40:36.479 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-17T03:40:36.479 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-17T03:40:36.479 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:40:36.479 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-17T03:40:36.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 -- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f74dc078bc0 msgr2=0x7f74dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:36.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f74dc078bc0 0x7f74dc07b0d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f74f0034000 tx=0x7f74f0004730 comp rx=0 tx=0).stop 2024-09-17T03:40:36.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 -- 172.21.15.121:0/415020345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75000d0af0 msgr2=0x7f7500074920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:36.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75000d0af0 0x7f7500074920 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009fd0 tx=0x7f74e800ec20 comp rx=0 tx=0).stop 2024-09-17T03:40:36.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 -- 172.21.15.121:0/415020345 shutdown_connections 2024-09-17T03:40:36.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f750015a3e0 0x7f75000b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f74dc078bc0 0x7f74dc07b0d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75000d0af0 0x7f7500074920 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 --2- 172.21.15.121:0/415020345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f750006ddc0 0x7f75000c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 -- 172.21.15.121:0/415020345 >> 172.21.15.121:0/415020345 conn(0x7f75000b3580 msgr2=0x7f7500156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:36.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 -- 172.21.15.121:0/415020345 shutdown_connections 2024-09-17T03:40:36.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.481+0000 7f7507400640 1 -- 172.21.15.121:0/415020345 wait complete. 2024-09-17T03:40:36.506 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.726+0000 7ffaeec00640 1 -- 172.21.15.121:0/2667935234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffacc0099b0 msgr2=0x7ffacc00bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.726+0000 7ffaeec00640 1 --2- 172.21.15.121:0/2667935234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffacc0099b0 0x7ffacc00bdd0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009b20 tx=0x7ffacc005830 comp rx=0 tx=0).stop 2024-09-17T03:40:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.726+0000 7ffaeec00640 1 -- 172.21.15.121:0/2667935234 shutdown_connections 2024-09-17T03:40:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.726+0000 7ffaeec00640 1 --2- 172.21.15.121:0/2667935234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffacc0099b0 0x7ffacc00bdd0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.726+0000 7ffaeec00640 1 -- 172.21.15.121:0/2667935234 >> 172.21.15.121:0/2667935234 conn(0x7ffae80b3580 msgr2=0x7ffae80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.726+0000 7ffaeec00640 1 -- 172.21.15.121:0/2667935234 shutdown_connections 2024-09-17T03:40:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.726+0000 7ffaeec00640 1 -- 172.21.15.121:0/2667935234 wait complete. 2024-09-17T03:40:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.728+0000 7ffaeec00640 1 Processor -- start 2024-09-17T03:40:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.728+0000 7ffaeec00640 1 -- start start 2024-09-17T03:40:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffaeec00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffacc0099b0 0x7ffae80b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffaeec00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae80cfad0 0x7ffae8099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffaeec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffae80b1450 0x7ffae80b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffaeec00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffae806e150 con 0x7ffacc0099b0 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffaeec00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffae806dfd0 con 0x7ffae80cfad0 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffaeec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffae806e2d0 con 0x7ffae80b1450 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffae7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffacc0099b0 0x7ffae80b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffae7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffacc0099b0 0x7ffae80b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38828/0 (socket says 172.21.15.121:38828) 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffae7e00640 1 -- 172.21.15.121:0/2463667908 learned_addr learned my addr 172.21.15.121:0/2463667908 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffae7400640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae80cfad0 0x7ffae8099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffaecc00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffae80b1450 0x7ffae80b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffae7e00640 1 -- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffae80b1450 msgr2=0x7ffae80b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffae7e00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffae80b1450 0x7ffae80b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffae7e00640 1 -- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae80cfad0 msgr2=0x7ffae8099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffae7e00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae80cfad0 0x7ffae8099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffae7e00640 1 -- 172.21.15.121:0/2463667908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae80b1da0 con 0x7ffacc0099b0 2024-09-17T03:40:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.730+0000 7ffae7400640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae80cfad0 0x7ffae8099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.731+0000 7ffae7e00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffacc0099b0 0x7ffae80b2650 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ffad8006090 tx=0x7ffad8006550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.731+0000 7ffadfe00640 1 -- 172.21.15.121:0/2463667908 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad800f9e0 con 0x7ffacc0099b0 2024-09-17T03:40:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.731+0000 7ffadfe00640 1 -- 172.21.15.121:0/2463667908 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffad800fb80 con 0x7ffacc0099b0 2024-09-17T03:40:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.731+0000 7ffaeec00640 1 -- 172.21.15.121:0/2463667908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae81f6390 con 0x7ffacc0099b0 2024-09-17T03:40:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.731+0000 7ffadfe00640 1 -- 172.21.15.121:0/2463667908 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8011430 con 0x7ffacc0099b0 2024-09-17T03:40:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.731+0000 7ffaeec00640 1 -- 172.21.15.121:0/2463667908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae81f6070 con 0x7ffacc0099b0 2024-09-17T03:40:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.732+0000 7ffaeec00640 1 -- 172.21.15.121:0/2463667908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffae80d0770 con 0x7ffacc0099b0 2024-09-17T03:40:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.733+0000 7ffadfe00640 1 -- 172.21.15.121:0/2463667908 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffad80115d0 con 0x7ffacc0099b0 2024-09-17T03:40:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.734+0000 7ffadfe00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffac8078b90 0x7ffac807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.734+0000 7ffadfe00640 1 -- 172.21.15.121:0/2463667908 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7ffad809b630 con 0x7ffacc0099b0 2024-09-17T03:40:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.735+0000 7ffae7400640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffac8078b90 0x7ffac807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:36.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.736+0000 7ffae7400640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffac8078b90 0x7ffac807b0a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffad4000c00 tx=0x7ffad4006b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:36.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.739+0000 7ffadfe00640 1 -- 172.21.15.121:0/2463667908 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffae80b1da0 con 0x7ffacc0099b0 2024-09-17T03:40:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.955+0000 7ffaeec00640 1 -- 172.21.15.121:0/2463667908 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffae81f6560 con 0x7ffacc0099b0 2024-09-17T03:40:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.956+0000 7ffadfe00640 1 -- 172.21.15.121:0/2463667908 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5234 (secure 0 0 0) 0x7ffad8015030 con 0x7ffacc0099b0 2024-09-17T03:40:36.956 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:36.956 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":77,"btime":"2024-09-17T03:40:29:090893+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6745,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2166412005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2166412005},{"type":"v1","addr":"172.21.15.176:6836","nonce":2166412005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4240071061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":4240071061},{"type":"v1","addr":"172.21.15.176:6837","nonce":4240071061}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":7086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/1319588889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1319588889},{"type":"v1","addr":"172.21.15.121:6833","nonce":1319588889}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:28.568125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7095},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7095":{"gid":7095,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/697305237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":697305237},{"type":"v1","addr":"172.21.15.121:6835","nonce":697305237}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7095,"qdb_cluster":[7095]},"id":8}]} 2024-09-17T03:40:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 77 2024-09-17T03:40:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.958+0000 7ffaeec00640 1 -- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffac8078b90 msgr2=0x7ffac807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.958+0000 7ffaeec00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffac8078b90 0x7ffac807b0a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffad4000c00 tx=0x7ffad4006b70 comp rx=0 tx=0).stop 2024-09-17T03:40:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.958+0000 7ffaeec00640 1 -- 172.21.15.121:0/2463667908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffacc0099b0 msgr2=0x7ffae80b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.958+0000 7ffaeec00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffacc0099b0 0x7ffae80b2650 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ffad8006090 tx=0x7ffad8006550 comp rx=0 tx=0).stop 2024-09-17T03:40:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.958+0000 7ffaeec00640 1 -- 172.21.15.121:0/2463667908 shutdown_connections 2024-09-17T03:40:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.958+0000 7ffaeec00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffae80b1450 0x7ffae80b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.958+0000 7ffaeec00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffae80cfad0 0x7ffae8099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.958+0000 7ffaeec00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ffac8078b90 0x7ffac807b0a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.958+0000 7ffaeec00640 1 --2- 172.21.15.121:0/2463667908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffacc0099b0 0x7ffae80b2650 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.958+0000 7ffaeec00640 1 -- 172.21.15.121:0/2463667908 >> 172.21.15.121:0/2463667908 conn(0x7ffae80b3580 msgr2=0x7ffae81560c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.959+0000 7ffaeec00640 1 -- 172.21.15.121:0/2463667908 shutdown_connections 2024-09-17T03:40:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:36.959+0000 7ffaeec00640 1 -- 172.21.15.121:0/2463667908 wait complete. 2024-09-17T03:40:37.385 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:40:25.564895+0000', 'modified': '2024-09-17T03:40:28.568125+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7095}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7095': {'gid': 7095, 'name': 'c', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6835/697305237', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 697305237}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 697305237}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7095, 'qdb_cluster': [7095]} 2024-09-17T03:40:37.385 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:40:37.386 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:40:37.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.610+0000 7f8641000640 1 -- 172.21.15.121:0/3755087903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f863c0d0cc0 msgr2=0x7f863c15cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.610+0000 7f8641000640 1 --2- 172.21.15.121:0/3755087903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f863c0d0cc0 0x7f863c15cc10 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f863c0cdc20 tx=0x7f863402a9a0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.610+0000 7f8641000640 1 -- 172.21.15.121:0/3755087903 shutdown_connections 2024-09-17T03:40:37.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.610+0000 7f8641000640 1 --2- 172.21.15.121:0/3755087903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f863c0d0cc0 0x7f863c15cc10 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.610+0000 7f8641000640 1 --2- 172.21.15.121:0/3755087903 >> v2:172.21.15.176:3300/0 conn(0x7f863c15a3e0 0x7f863c06d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.610+0000 7f8641000640 1 -- 172.21.15.121:0/3755087903 >> 172.21.15.121:0/3755087903 conn(0x7f863c0b3580 msgr2=0x7f863c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.610+0000 7f8641000640 1 -- 172.21.15.121:0/3755087903 shutdown_connections 2024-09-17T03:40:37.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.610+0000 7f8641000640 1 -- 172.21.15.121:0/3755087903 wait complete. 2024-09-17T03:40:37.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.613+0000 7f8641000640 1 Processor -- start 2024-09-17T03:40:37.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.613+0000 7f8641000640 1 -- start start 2024-09-17T03:40:37.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.614+0000 7f8641000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f863c06ddc0 0x7f863c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.614+0000 7f8641000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f863c15a3e0 0x7f863c0c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.614+0000 7f8641000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f863c154280 0x7f863c154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.614+0000 7f8641000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f863c15d4e0 con 0x7f863c06ddc0 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.614+0000 7f8641000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f863c15d360 con 0x7f863c15a3e0 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.614+0000 7f8641000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f863c15d660 con 0x7f863c154280 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.614+0000 7f8639e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f863c06ddc0 0x7f863c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f8639e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f863c06ddc0 0x7f863c0ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38834/0 (socket says 172.21.15.121:38834) 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f8639e00640 1 -- 172.21.15.121:0/3184518207 learned_addr learned my addr 172.21.15.121:0/3184518207 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f8639400640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f863c15a3e0 0x7f863c0c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f863a800640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f863c154280 0x7f863c154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f8639e00640 1 -- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f863c154280 msgr2=0x7f863c154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f8639e00640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f863c154280 0x7f863c154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f8639e00640 1 -- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f863c15a3e0 msgr2=0x7f863c0c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f8639e00640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f863c15a3e0 0x7f863c0c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f8639e00640 1 -- 172.21.15.121:0/3184518207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c154bd0 con 0x7f863c06ddc0 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f8639e00640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f863c06ddc0 0x7f863c0ccbd0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f862c00e790 tx=0x7f862c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.615+0000 7f8632000640 1 -- 172.21.15.121:0/3184518207 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c00eea0 con 0x7f863c06ddc0 2024-09-17T03:40:37.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.616+0000 7f8632000640 1 -- 172.21.15.121:0/3184518207 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f862c00cdb0 con 0x7f863c06ddc0 2024-09-17T03:40:37.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.616+0000 7f8632000640 1 -- 172.21.15.121:0/3184518207 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c010690 con 0x7f863c06ddc0 2024-09-17T03:40:37.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.616+0000 7f8641000640 1 -- 172.21.15.121:0/3184518207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863c0cc9a0 con 0x7f863c06ddc0 2024-09-17T03:40:37.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.616+0000 7f8641000640 1 -- 172.21.15.121:0/3184518207 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863c153120 con 0x7f863c06ddc0 2024-09-17T03:40:37.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.618+0000 7f8632000640 1 -- 172.21.15.121:0/3184518207 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f862c010830 con 0x7f863c06ddc0 2024-09-17T03:40:37.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.619+0000 7f8632000640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f861c078bc0 0x7f861c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.619+0000 7f8632000640 1 -- 172.21.15.121:0/3184518207 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f862c09b880 con 0x7f863c06ddc0 2024-09-17T03:40:37.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.620+0000 7f864801d740 1 Processor -- start 2024-09-17T03:40:37.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.620+0000 7f8639400640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f861c078bc0 0x7f861c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.620+0000 7f864801d740 1 -- start start 2024-09-17T03:40:37.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.620+0000 7f8639400640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f861c078bc0 0x7f861c07b0d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f863c1567f0 tx=0x7f8628009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f864801d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681de7270 0x5556821b7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f864801d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 0x5556821b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f864801d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dc6590 0x555682187f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f864801d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555682111430 con 0x555681dc6590 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f864801d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5556821015d0 con 0x555681dbe3b0 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f864801d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5556820f0a00 con 0x555681de7270 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f863a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dc6590 0x555682187f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f863a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dc6590 0x555682187f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38846/0 (socket says 172.21.15.121:38846) 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f863a800640 1 -- 172.21.15.121:0/311167709 learned_addr learned my addr 172.21.15.121:0/311167709 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f8639400640 1 --2- 172.21.15.121:0/311167709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 0x5556821b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.621+0000 7f8639e00640 1 --2- 172.21.15.121:0/311167709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681de7270 0x5556821b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.622+0000 7f863a800640 1 -- 172.21.15.121:0/311167709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681de7270 msgr2=0x5556821b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.622+0000 7f863a800640 1 --2- 172.21.15.121:0/311167709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681de7270 0x5556821b7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.622+0000 7f863a800640 1 -- 172.21.15.121:0/311167709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 msgr2=0x5556821b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.622+0000 7f863a800640 1 --2- 172.21.15.121:0/311167709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 0x5556821b7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.622+0000 7f863a800640 1 -- 172.21.15.121:0/311167709 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556820b9520 con 0x555681dc6590 2024-09-17T03:40:37.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.622+0000 7f8639400640 1 --2- 172.21.15.121:0/311167709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 0x5556821b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:37.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.622+0000 7f863a800640 1 --2- 172.21.15.121:0/311167709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dc6590 0x555682187f60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f8634009d60 tx=0x7f8634004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbeda004ebabac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.622+0000 7f8626a00640 1 -- 172.21.15.121:0/311167709 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634033070 con 0x555681dc6590 2024-09-17T03:40:37.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f8626a00640 1 -- 172.21.15.121:0/311167709 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8634003970 con 0x555681dc6590 2024-09-17T03:40:37.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f8626a00640 1 -- 172.21.15.121:0/311167709 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634003d20 con 0x555681dc6590 2024-09-17T03:40:37.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f864801d740 1 -- 172.21.15.121:0/311167709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dc6590 msgr2=0x555682187f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f864801d740 1 --2- 172.21.15.121:0/311167709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dc6590 0x555682187f60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f8634009d60 tx=0x7f8634004a40 comp rx=0 tx=0).stop 2024-09-17T03:40:37.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f864801d740 1 -- 172.21.15.121:0/311167709 shutdown_connections 2024-09-17T03:40:37.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f864801d740 1 --2- 172.21.15.121:0/311167709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dc6590 0x555682187f60 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f864801d740 1 --2- 172.21.15.121:0/311167709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 0x5556821b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f864801d740 1 --2- 172.21.15.121:0/311167709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681de7270 0x5556821b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f864801d740 1 -- 172.21.15.121:0/311167709 >> 172.21.15.121:0/311167709 conn(0x555681ddb3c0 msgr2=0x55568218d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f864801d740 1 -- 172.21.15.121:0/311167709 shutdown_connections 2024-09-17T03:40:37.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.623+0000 7f864801d740 1 -- 172.21.15.121:0/311167709 wait complete. 2024-09-17T03:40:37.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.624+0000 7f864801d740 1 -- start start 2024-09-17T03:40:37.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.625+0000 7f864801d740 1 Processor -- start 2024-09-17T03:40:37.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.626+0000 7f864801d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dbe3b0 0x5556821ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.626+0000 7f864801d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dc6590 0x5556821cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.626+0000 7f864801d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681de7270 0x5556821cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.626+0000 7f864801d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555682097330 con 0x555681dbe3b0 2024-09-17T03:40:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.626+0000 7f864801d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5556820f4810 con 0x555681dc6590 2024-09-17T03:40:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.626+0000 7f864801d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555681e61620 con 0x555681de7270 2024-09-17T03:40:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.626+0000 7f864801d740 10 client.0 _ll_register_callbacks cb 0x55568209c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.626+0000 7f8639e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dbe3b0 0x5556821ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.626+0000 7f8639e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dbe3b0 0x5556821ad400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38850/0 (socket says 172.21.15.121:38850) 2024-09-17T03:40:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.626+0000 7f8639e00640 1 -- 172.21.15.121:0/3134428743 learned_addr learned my addr 172.21.15.121:0/3134428743 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:37.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.627+0000 7f8639e00640 1 -- 172.21.15.121:0/3134428743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681de7270 msgr2=0x5556821cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.627+0000 7f8639e00640 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681de7270 0x5556821cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.627+0000 7f8639e00640 1 -- 172.21.15.121:0/3134428743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dc6590 msgr2=0x5556821cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.627+0000 7f8639e00640 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dc6590 0x5556821cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.627+0000 7f8639e00640 1 -- 172.21.15.121:0/3134428743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555681e52850 con 0x555681dbe3b0 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.627+0000 7f8639e00640 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dbe3b0 0x5556821ad400 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f862c0631c0 tx=0x7f862c063a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3699b4827183f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.627+0000 7f861b400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.627+0000 7f861b400640 1 -- 172.21.15.121:0/3134428743 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0634c0 con 0x555681dbe3b0 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.627+0000 7f861b400640 1 -- 172.21.15.121:0/3134428743 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f862c07ae20 con 0x555681dbe3b0 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.627+0000 7f864801d740 1 -- 172.21.15.121:0/3134428743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8634003970 con 0x555681dbe3b0 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f861b400640 1 -- 172.21.15.121:0/3134428743 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f862c067fa0 con 0x555681dbe3b0 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f864801d740 10 client.7257 fetch_fsmap learned FSMap version 77 2024-09-17T03:40:37.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f864801d740 1 -- 172.21.15.121:0/3134428743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x555681ec96b0 con 0x555681dbe3b0 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f861b400640 1 -- 172.21.15.121:0/3134428743 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8634003970 con 0x555681dbe3b0 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f861b400640 1 -- 172.21.15.121:0/3134428743 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7f862c06a1b0 con 0x555681dbe3b0 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f864801d740 10 client.7257 fetch_fsmap finished waiting for FSMap version 77 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f864801d740 10 client.7257 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f864801d740 20 client.7257 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f864801d740 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.121:6834/697305237,v1:172.21.15.121:6835/697305237] conn(0x555681da5e40 0x5556821e5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f864801d740 4 client.7257 mds_command: new command op to 7095 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f864801d740 1 -- 172.21.15.121:0/3134428743 --> [v2:172.21.15.121:6834/697305237,v1:172.21.15.121:6835/697305237] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555682103520 con 0x555681da5e40 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.628+0000 7f8639400640 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.121:6834/697305237,v1:172.21.15.121:6835/697305237] conn(0x555681da5e40 0x5556821e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.629+0000 7f8639400640 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.121:6834/697305237,v1:172.21.15.121:6835/697305237] conn(0x555681da5e40 0x5556821e5850 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad968dcfb818ebba server_cookie=2e68e3fe16fd9453 in_seq=0 out_seq=0 2024-09-17T03:40:37.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.629+0000 7f861b400640 10 client.7257 ms_handle_connect on v2:172.21.15.121:6834/697305237 2024-09-17T03:40:37.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f861b400640 1 -- 172.21.15.121:0/3134428743 <== mds.0 v2:172.21.15.121:6834/697305237 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555682103520 con 0x555681da5e40 2024-09-17T03:40:37.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f861b400640 10 client.7257 handle_command_reply: tid=0 2024-09-17T03:40:37.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 client.7257 shutdown 2024-09-17T03:40:37.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 -- 172.21.15.121:0/3134428743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dbe3b0 msgr2=0x5556821ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dbe3b0 0x5556821ad400 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f862c0631c0 tx=0x7f862c063a60 comp rx=0 tx=0).stop 2024-09-17T03:40:37.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 -- 172.21.15.121:0/3134428743 shutdown_connections 2024-09-17T03:40:37.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.121:6834/697305237,v1:172.21.15.121:6835/697305237] conn(0x555681da5e40 0x5556821e5850 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681de7270 0x5556821cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dc6590 0x5556821cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f861b400640 0 client.7257 ms_handle_reset on v2:172.21.15.121:6834/697305237 2024-09-17T03:40:37.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 --2- 172.21.15.121:0/3134428743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681dbe3b0 0x5556821ad400 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 -- 172.21.15.121:0/3134428743 >> 172.21.15.121:0/3134428743 conn(0x555681ddb3c0 msgr2=0x5556821d53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 -- 172.21.15.121:0/3134428743 shutdown_connections 2024-09-17T03:40:37.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 1 -- 172.21.15.121:0/3134428743 wait complete. 2024-09-17T03:40:37.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.630+0000 7f864801d740 20 client.7257 trim_cache size 0 max 16384 2024-09-17T03:40:37.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.650+0000 7f864801d740 1 Processor -- start 2024-09-17T03:40:37.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.650+0000 7f864801d740 1 -- start start 2024-09-17T03:40:37.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.651+0000 7f864801d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dbe3b0 0x555682188f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.651+0000 7f864801d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dc6590 0x5556821894d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.651+0000 7f864801d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.651+0000 7f864801d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f863c2018d0 con 0x555681de7270 2024-09-17T03:40:37.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.651+0000 7f864801d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f863c1f6480 con 0x555681dc6590 2024-09-17T03:40:37.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.651+0000 7f864801d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f863c2014d0 con 0x555681dbe3b0 2024-09-17T03:40:37.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.651+0000 7f863a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.651+0000 7f863a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38862/0 (socket says 172.21.15.121:38862) 2024-09-17T03:40:37.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.651+0000 7f863a800640 1 -- 172.21.15.121:0/4037701539 learned_addr learned my addr 172.21.15.121:0/4037701539 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:37.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f8639e00640 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dbe3b0 0x555682188f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f8639400640 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dc6590 0x5556821894d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f863a800640 1 -- 172.21.15.121:0/4037701539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dbe3b0 msgr2=0x555682188f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f863a800640 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dbe3b0 0x555682188f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f863a800640 1 -- 172.21.15.121:0/4037701539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dc6590 msgr2=0x5556821894d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f863a800640 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dc6590 0x5556821894d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f863a800640 1 -- 172.21.15.121:0/4037701539 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55568218e650 con 0x555681de7270 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f8639e00640 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dbe3b0 0x555682188f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f8639400640 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dc6590 0x5556821894d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f863a800640 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821f5d50 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f8634000f80 tx=0x7f863402f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c66f7bf068b0b0e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f8626000640 1 -- 172.21.15.121:0/4037701539 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634033070 con 0x555681de7270 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f8626000640 1 -- 172.21.15.121:0/4037701539 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8634048070 con 0x555681de7270 2024-09-17T03:40:37.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.652+0000 7f8626000640 1 -- 172.21.15.121:0/4037701539 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634003bb0 con 0x555681de7270 2024-09-17T03:40:37.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.653+0000 7f864801d740 1 -- 172.21.15.121:0/4037701539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 msgr2=0x5556821f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.653+0000 7f864801d740 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821f5d50 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f8634000f80 tx=0x7f863402f600 comp rx=0 tx=0).stop 2024-09-17T03:40:37.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.653+0000 7f864801d740 1 -- 172.21.15.121:0/4037701539 shutdown_connections 2024-09-17T03:40:37.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.653+0000 7f864801d740 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821f5d50 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.653+0000 7f864801d740 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dc6590 0x5556821894d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.653+0000 7f864801d740 1 --2- 172.21.15.121:0/4037701539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dbe3b0 0x555682188f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.653+0000 7f864801d740 1 -- 172.21.15.121:0/4037701539 >> 172.21.15.121:0/4037701539 conn(0x555681ddb3c0 msgr2=0x5556821acdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.653+0000 7f864801d740 1 -- 172.21.15.121:0/4037701539 shutdown_connections 2024-09-17T03:40:37.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.653+0000 7f864801d740 1 -- 172.21.15.121:0/4037701539 wait complete. 2024-09-17T03:40:37.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.654+0000 7f864801d740 1 -- start start 2024-09-17T03:40:37.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.654+0000 7f864801d740 1 Processor -- start 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f864801d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 0x55568224c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f864801d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dc6590 0x5556821b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f864801d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f864801d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5556821b4430 con 0x555681de7270 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f864801d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5556821b1b60 con 0x555681dbe3b0 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f864801d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5556821b3840 con 0x555681dc6590 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f864801d740 10 client.0 _ll_register_callbacks cb 0x7f862c062cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f863a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f863a800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38874/0 (socket says 172.21.15.121:38874) 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f863a800640 1 -- 172.21.15.121:0/3878330264 learned_addr learned my addr 172.21.15.121:0/3878330264 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:37.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f8639e00640 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 0x55568224c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.656+0000 7f8639400640 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dc6590 0x5556821b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f863a800640 1 -- 172.21.15.121:0/3878330264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dc6590 msgr2=0x5556821b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f863a800640 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dc6590 0x5556821b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f863a800640 1 -- 172.21.15.121:0/3878330264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 msgr2=0x55568224c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f863a800640 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 0x55568224c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f863a800640 1 -- 172.21.15.121:0/3878330264 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556821b2b40 con 0x555681de7270 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f8639400640 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dc6590 0x5556821b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f863a800640 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821b4b40 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f8634009bf0 tx=0x7f863402fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a3f4e2fbb8c2c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f861b400640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f861b400640 1 -- 172.21.15.121:0/3878330264 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634051070 con 0x555681de7270 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f861b400640 1 -- 172.21.15.121:0/3878330264 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f863404d460 con 0x555681de7270 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f864801d740 1 -- 172.21.15.121:0/3878330264 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8634048070 con 0x555681de7270 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f861b400640 1 -- 172.21.15.121:0/3878330264 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f863405c050 con 0x555681de7270 2024-09-17T03:40:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f864801d740 10 client.7263 fetch_fsmap learned FSMap version 77 2024-09-17T03:40:37.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.657+0000 7f864801d740 1 -- 172.21.15.121:0/3878330264 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5556821b7bb0 con 0x555681de7270 2024-09-17T03:40:37.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.658+0000 7f861b400640 1 -- 172.21.15.121:0/3878330264 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8634048070 con 0x555681de7270 2024-09-17T03:40:37.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.658+0000 7f861b400640 1 -- 172.21.15.121:0/3878330264 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7f863405f020 con 0x555681de7270 2024-09-17T03:40:37.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.658+0000 7f864801d740 10 client.7263 fetch_fsmap finished waiting for FSMap version 77 2024-09-17T03:40:37.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.658+0000 7f864801d740 10 client.7263 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:40:37.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.658+0000 7f864801d740 20 client.7263 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:37.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.658+0000 7f864801d740 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.121:6834/697305237,v1:172.21.15.121:6835/697305237] conn(0x5556821a9f80 0x555682255bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.658+0000 7f864801d740 4 client.7263 mds_command: new command op to 7095 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:40:37.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.658+0000 7f864801d740 1 -- 172.21.15.121:0/3878330264 --> [v2:172.21.15.121:6834/697305237,v1:172.21.15.121:6835/697305237] -- command(tid 0: {"prefix": "status"}) -- 0x5556820fefd0 con 0x5556821a9f80 2024-09-17T03:40:37.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.658+0000 7f8639e00640 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.121:6834/697305237,v1:172.21.15.121:6835/697305237] conn(0x5556821a9f80 0x555682255bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f861b400640 10 client.7263 ms_handle_connect on v2:172.21.15.121:6834/697305237 2024-09-17T03:40:37.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f8639e00640 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.121:6834/697305237,v1:172.21.15.121:6835/697305237] conn(0x5556821a9f80 0x555682255bf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2423cc93440903dc server_cookie=e72dac77327a4a4 in_seq=0 out_seq=0 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f861b400640 1 -- 172.21.15.121:0/3878330264 <== mds.0 v2:172.21.15.121:6834/697305237 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5556820fefd0 con 0x5556821a9f80 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f861b400640 10 client.7263 handle_command_reply: tid=0 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 client.7263 shutdown 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 -- 172.21.15.121:0/3878330264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 msgr2=0x5556821b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821b4b40 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f8634009bf0 tx=0x7f863402fb20 comp rx=0 tx=0).stop 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 -- 172.21.15.121:0/3878330264 shutdown_connections 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.121:6834/697305237,v1:172.21.15.121:6835/697305237] conn(0x5556821a9f80 0x555682255bf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555681de7270 0x5556821b4b40 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555681dc6590 0x5556821b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 --2- 172.21.15.121:0/3878330264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555681dbe3b0 0x55568224c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f861b400640 0 client.7263 ms_handle_reset on v2:172.21.15.121:6834/697305237 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 -- 172.21.15.121:0/3878330264 >> 172.21.15.121:0/3878330264 conn(0x555681ddb3c0 msgr2=0x5556821893e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 -- 172.21.15.121:0/3878330264 shutdown_connections 2024-09-17T03:40:37.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.659+0000 7f864801d740 1 -- 172.21.15.121:0/3878330264 wait complete. 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f864801d740 20 client.7263 trim_cache size 0 max 16384 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 7095, 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 11.581582234000001, 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 77, 2024-09-17T03:40:37.663 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 110, 2024-09-17T03:40:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 110, 2024-09-17T03:40:37.664 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 16.606519832 2024-09-17T03:40:37.664 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:40:37.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 -- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f861c078bc0 msgr2=0x7f861c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f861c078bc0 0x7f861c07b0d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f863c1567f0 tx=0x7f8628009040 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 -- 172.21.15.121:0/3184518207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f863c06ddc0 msgr2=0x7f863c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f863c06ddc0 0x7f863c0ccbd0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f862c00e790 tx=0x7f862c00ec50 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 -- 172.21.15.121:0/3184518207 shutdown_connections 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f863c154280 0x7f863c154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f863c15a3e0 0x7f863c0c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f861c078bc0 0x7f861c07b0d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 --2- 172.21.15.121:0/3184518207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f863c06ddc0 0x7f863c0ccbd0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 -- 172.21.15.121:0/3184518207 >> 172.21.15.121:0/3184518207 conn(0x7f863c0b3580 msgr2=0x7f863c1eaa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 -- 172.21.15.121:0/3184518207 shutdown_connections 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.660+0000 7f8641000640 1 -- 172.21.15.121:0/3184518207 wait complete. 2024-09-17T03:40:37.685 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:40:37.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.905+0000 7efc32e00640 1 -- 172.21.15.121:0/1524143916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc2c15a3e0 msgr2=0x7efc2c06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.905+0000 7efc32e00640 1 --2- 172.21.15.121:0/1524143916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc2c15a3e0 0x7efc2c06d800 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7efc1c009830 tx=0x7efc1c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.905+0000 7efc32e00640 1 -- 172.21.15.121:0/1524143916 shutdown_connections 2024-09-17T03:40:37.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.905+0000 7efc32e00640 1 --2- 172.21.15.121:0/1524143916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc2c15a3e0 0x7efc2c06d800 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.905+0000 7efc32e00640 1 -- 172.21.15.121:0/1524143916 >> 172.21.15.121:0/1524143916 conn(0x7efc2c0b3580 msgr2=0x7efc2c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.905+0000 7efc32e00640 1 -- 172.21.15.121:0/1524143916 shutdown_connections 2024-09-17T03:40:37.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.905+0000 7efc32e00640 1 -- 172.21.15.121:0/1524143916 wait complete. 2024-09-17T03:40:37.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.908+0000 7efc32e00640 1 Processor -- start 2024-09-17T03:40:37.907 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.908+0000 7efc32e00640 1 -- start start 2024-09-17T03:40:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.909+0000 7efc32e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc2c06ddc0 0x7efc2c074930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.909+0000 7efc32e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc2c15a3e0 0x7efc2c1f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.909+0000 7efc32e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc2c072d00 0x7efc2c073110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.909+0000 7efc32e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c15d6b0 con 0x7efc2c15a3e0 2024-09-17T03:40:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.909+0000 7efc32e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c15d530 con 0x7efc2c072d00 2024-09-17T03:40:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.909+0000 7efc32e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c15d830 con 0x7efc2c06ddc0 2024-09-17T03:40:37.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.909+0000 7efc2b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc2c15a3e0 0x7efc2c1f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.909+0000 7efc2b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc2c15a3e0 0x7efc2c1f8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38892/0 (socket says 172.21.15.121:38892) 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc2b400640 1 -- 172.21.15.121:0/2024546759 learned_addr learned my addr 172.21.15.121:0/2024546759 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc2be00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc2c06ddc0 0x7efc2c074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc30e00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc2c072d00 0x7efc2c073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc2b400640 1 -- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc2c06ddc0 msgr2=0x7efc2c074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc2b400640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc2c06ddc0 0x7efc2c074930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc2b400640 1 -- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc2c072d00 msgr2=0x7efc2c073110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc2b400640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc2c072d00 0x7efc2c073110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc2b400640 1 -- 172.21.15.121:0/2024546759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c073650 con 0x7efc2c15a3e0 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc30e00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc2c072d00 0x7efc2c073110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc2b400640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc2c15a3e0 0x7efc2c1f8450 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7efc1800c390 tx=0x7efc1800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.910+0000 7efc23e00640 1 -- 172.21.15.121:0/2024546759 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18017070 con 0x7efc2c15a3e0 2024-09-17T03:40:37.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.911+0000 7efc23e00640 1 -- 172.21.15.121:0/2024546759 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc180035f0 con 0x7efc2c15a3e0 2024-09-17T03:40:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.911+0000 7efc23e00640 1 -- 172.21.15.121:0/2024546759 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18003a20 con 0x7efc2c15a3e0 2024-09-17T03:40:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.911+0000 7efc32e00640 1 -- 172.21.15.121:0/2024546759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2c15f5a0 con 0x7efc2c15a3e0 2024-09-17T03:40:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.911+0000 7efc32e00640 1 -- 172.21.15.121:0/2024546759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc2c0c54a0 con 0x7efc2c15a3e0 2024-09-17T03:40:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.912+0000 7efc32e00640 1 -- 172.21.15.121:0/2024546759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc2c15f2f0 con 0x7efc2c15a3e0 2024-09-17T03:40:37.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.913+0000 7efc23e00640 1 -- 172.21.15.121:0/2024546759 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efc1801a070 con 0x7efc2c15a3e0 2024-09-17T03:40:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.914+0000 7efc23e00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc0c078b90 0x7efc0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.914+0000 7efc23e00640 1 -- 172.21.15.121:0/2024546759 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7efc1809a260 con 0x7efc2c15a3e0 2024-09-17T03:40:37.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.914+0000 7efc2be00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc0c078b90 0x7efc0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.915+0000 7efc2be00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc0c078b90 0x7efc0c07b0a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efc1c034000 tx=0x7efc1c004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:37.918+0000 7efc23e00640 1 -- 172.21.15.121:0/2024546759 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efc2c073650 con 0x7efc2c15a3e0 2024-09-17T03:40:38.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.137+0000 7efc32e00640 1 -- 172.21.15.121:0/2024546759 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efc2c06d800 con 0x7efc2c15a3e0 2024-09-17T03:40:38.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.138+0000 7efc23e00640 1 -- 172.21.15.121:0/2024546759 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v77) ==== 53+0+73 (secure 0 0 0) 0x7efc18062470 con 0x7efc2c15a3e0 2024-09-17T03:40:38.137 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:40:38.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 -- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc0c078b90 msgr2=0x7efc0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:38.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc0c078b90 0x7efc0c07b0a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efc1c034000 tx=0x7efc1c004730 comp rx=0 tx=0).stop 2024-09-17T03:40:38.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 -- 172.21.15.121:0/2024546759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc2c15a3e0 msgr2=0x7efc2c1f8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:38.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc2c15a3e0 0x7efc2c1f8450 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7efc1800c390 tx=0x7efc1800c850 comp rx=0 tx=0).stop 2024-09-17T03:40:38.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 -- 172.21.15.121:0/2024546759 shutdown_connections 2024-09-17T03:40:38.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc2c072d00 0x7efc2c073110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:38.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efc0c078b90 0x7efc0c07b0a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:38.140 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc2c15a3e0 0x7efc2c1f8450 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:38.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 --2- 172.21.15.121:0/2024546759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc2c06ddc0 0x7efc2c074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:38.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 -- 172.21.15.121:0/2024546759 >> 172.21.15.121:0/2024546759 conn(0x7efc2c0b3580 msgr2=0x7efc2c156050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:38.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 -- 172.21.15.121:0/2024546759 shutdown_connections 2024-09-17T03:40:38.141 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38.140+0000 7efc32e00640 1 -- 172.21.15.121:0/2024546759 wait complete. 2024-09-17T03:40:38.165 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:40:38.165 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:40:38.165 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:40:38.166 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:40:38.166 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:38.166 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:40:38.166 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:40:38.166 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:40:38.166 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:38.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:38.166 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:40:38.202 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:40:38.202 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:40:38.202 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:40:38.202 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:38.202 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:40:38.202 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:38.202 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:38.203 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:38.203 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:40:38.203 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:38.203 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:38.203 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:40:38.203 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:38.203 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:38.203 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:40:38.203 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:38.203 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42418sec preferred_lft 42418sec 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:40:38.204 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:38.205 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:38.205 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:40:38.205 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:40:38.205 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:38.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:38.205 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:40:38.296 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:40:38.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:38.299 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:40:38.335 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:40:38.335 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:40:38.335 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:40:38.335 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:40:38.336 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:40:38.336 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:40:38.336 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:40:38.336 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:40:38.336 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:40:38.336 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:40:38.336 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:40:38.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:40:38.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:38.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:38.534 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:40:38.568 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:40:38.569 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:40:38.569 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:38.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:38.569 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:40:38.664 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:38.664 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:38.699 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:38.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:38.700 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:38.774 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:40:38.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:38.774 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:38.969 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:38.970 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:38.970 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:40:38.990 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:38.990 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:38.990 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:40:38.990 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:38.990 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:39.022 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:39.022 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:39.022 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:40:39.022 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:39.022 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:39.022 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:40:39.022 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:40:39.022 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:40:39.023 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:40:39.023 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:40:39.024 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:40:39.024 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:40:39.024 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:40:39.026 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:40:39.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:39.027 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:39.082 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:40:39.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:39.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:39.177 INFO:teuthology.orchestra.run.smithi121.stdout:client6239 2024-09-17T03:40:39.177 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:39.178 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:39.213 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:40:39.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.476+0000 7f87e8e00640 1 -- 172.21.15.121:0/2337499470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e40b4480 msgr2=0x7f87e4073290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:39.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.476+0000 7f87e8e00640 1 --2- 172.21.15.121:0/2337499470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e40b4480 0x7f87e4073290 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f87dc005fd0 tx=0x7f87dc02aa10 comp rx=0 tx=0).stop 2024-09-17T03:40:39.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.476+0000 7f87e8e00640 1 -- 172.21.15.121:0/2337499470 shutdown_connections 2024-09-17T03:40:39.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.476+0000 7f87e8e00640 1 --2- 172.21.15.121:0/2337499470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e40b4480 0x7f87e4073290 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:39.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.476+0000 7f87e8e00640 1 --2- 172.21.15.121:0/2337499470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87e4159170 0x7f87e406def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:39.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.476+0000 7f87e8e00640 1 -- 172.21.15.121:0/2337499470 >> 172.21.15.121:0/2337499470 conn(0x7f87e40b2440 msgr2=0x7f87e40d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:39.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.476+0000 7f87e8e00640 1 -- 172.21.15.121:0/2337499470 shutdown_connections 2024-09-17T03:40:39.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.476+0000 7f87e8e00640 1 -- 172.21.15.121:0/2337499470 wait complete. 2024-09-17T03:40:39.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.478+0000 7f87e8e00640 1 Processor -- start 2024-09-17T03:40:39.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.478+0000 7f87e8e00640 1 -- start start 2024-09-17T03:40:39.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e8e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87e406e430 0x7f87e40cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:39.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e8e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87e40b4480 0x7f87e4157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:39.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e8e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e4159170 0x7f87e41e3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:39.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e8e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87e4073d00 con 0x7f87e4159170 2024-09-17T03:40:39.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e8e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f87e4073b80 con 0x7f87e40b4480 2024-09-17T03:40:39.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e8e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f87e4073e80 con 0x7f87e406e430 2024-09-17T03:40:39.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e4159170 0x7f87e41e3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:39.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e3e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e4159170 0x7f87e41e3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38916/0 (socket says 172.21.15.121:38916) 2024-09-17T03:40:39.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e3e00640 1 -- 172.21.15.121:0/1297114887 learned_addr learned my addr 172.21.15.121:0/1297114887 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:39.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e3400640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87e406e430 0x7f87e40cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:39.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.480+0000 7f87e2a00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87e40b4480 0x7f87e4157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:39.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87e3e00640 1 -- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87e406e430 msgr2=0x7f87e40cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:39.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87e3e00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87e406e430 0x7f87e40cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:39.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87e3e00640 1 -- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87e40b4480 msgr2=0x7f87e4157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:39.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87e3e00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87e40b4480 0x7f87e4157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:39.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87e3e00640 1 -- 172.21.15.121:0/1297114887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e40cdaf0 con 0x7f87e4159170 2024-09-17T03:40:39.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87e2a00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87e40b4480 0x7f87e4157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:39.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87e3e00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e4159170 0x7f87e41e3a90 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f87dc006010 tx=0x7f87dc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:39.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87db400640 1 -- 172.21.15.121:0/1297114887 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc046070 con 0x7f87e4159170 2024-09-17T03:40:39.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87db400640 1 -- 172.21.15.121:0/1297114887 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87dc004540 con 0x7f87e4159170 2024-09-17T03:40:39.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87e8e00640 1 -- 172.21.15.121:0/1297114887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e41e46a0 con 0x7f87e4159170 2024-09-17T03:40:39.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87db400640 1 -- 172.21.15.121:0/1297114887 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc033070 con 0x7f87e4159170 2024-09-17T03:40:39.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.481+0000 7f87e8e00640 1 -- 172.21.15.121:0/1297114887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e40ccad0 con 0x7f87e4159170 2024-09-17T03:40:39.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.482+0000 7f87e8e00640 1 -- 172.21.15.121:0/1297114887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e41e4410 con 0x7f87e4159170 2024-09-17T03:40:39.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.484+0000 7f87db400640 1 -- 172.21.15.121:0/1297114887 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f87dc049070 con 0x7f87e4159170 2024-09-17T03:40:39.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.485+0000 7f87db400640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f87c4078bc0 0x7f87c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:39.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.485+0000 7f87db400640 1 -- 172.21.15.121:0/1297114887 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f87dc0bbf50 con 0x7f87e4159170 2024-09-17T03:40:39.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.485+0000 7f87e3400640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f87c4078bc0 0x7f87c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:39.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.486+0000 7f87e3400640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f87c4078bc0 0x7f87c407b0d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009b30 tx=0x7f87d4005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:39.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.491+0000 7f87db400640 1 -- 172.21.15.121:0/1297114887 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f87dc03e070 con 0x7f87e4159170 2024-09-17T03:40:39.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.711+0000 7f87e8e00640 1 -- 172.21.15.121:0/1297114887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f87e4074410 con 0x7f87e4159170 2024-09-17T03:40:39.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.712+0000 7f87db400640 1 -- 172.21.15.121:0/1297114887 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v77) ==== 53+0+73 (secure 0 0 0) 0x7f87dc083ba0 con 0x7f87e4159170 2024-09-17T03:40:39.712 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:40:39.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 -- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f87c4078bc0 msgr2=0x7f87c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:39.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f87c4078bc0 0x7f87c407b0d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009b30 tx=0x7f87d4005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 -- 172.21.15.121:0/1297114887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e4159170 msgr2=0x7f87e41e3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e4159170 0x7f87e41e3a90 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f87dc006010 tx=0x7f87dc003f10 comp rx=0 tx=0).stop 2024-09-17T03:40:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 -- 172.21.15.121:0/1297114887 shutdown_connections 2024-09-17T03:40:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f87c4078bc0 0x7f87c407b0d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e4159170 0x7f87e41e3a90 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87e40b4480 0x7f87e4157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 --2- 172.21.15.121:0/1297114887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87e406e430 0x7f87e40cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 -- 172.21.15.121:0/1297114887 >> 172.21.15.121:0/1297114887 conn(0x7f87e40b2440 msgr2=0x7f87e41595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.714+0000 7f87e8e00640 1 -- 172.21.15.121:0/1297114887 shutdown_connections 2024-09-17T03:40:39.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:39.715+0000 7f87e8e00640 1 -- 172.21.15.121:0/1297114887 wait complete. 2024-09-17T03:40:39.736 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:40:39.736 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:40:39.736 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:40:39.736 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:40:39.736 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:39.736 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:40:39.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:40:39.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:40:39.737 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:40:39.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:39.737 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:40:39.777 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:40:39.777 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:40:39.777 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:40:39.777 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:40:39.778 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42414sec preferred_lft 42414sec 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::80c9:d6ff:fe9f:5926/64 scope link 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:40:39.779 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d4cd:10ff:feb7:d68f/64 scope link 2024-09-17T03:40:39.780 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:39.780 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:39.780 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether fe:db:9e:03:5a:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:40:39.780 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::fcdb:9eff:fe03:5a3e/64 scope link 2024-09-17T03:40:39.780 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:39.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:39.780 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:40:39.874 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:40:39.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:39.878 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:40:39.915 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:40:39.915 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:40:39.915 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:40:39.915 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:40:39.915 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:40:39.917 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:40:39.917 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:40:39.917 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:40:39.917 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:40:39.917 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:40:39.918 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:40:40.032 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:40:40.103 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:40.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:40.111 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:40:40.146 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:40:40.147 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:40:40.147 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:40:40.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:40.147 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T03:40:40.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:40.243 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:40.279 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:40:40.279 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:40.279 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:40.353 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:40:40.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:40.354 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:40.549 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:40.550 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:40:40.550 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:40:40.569 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:40.569 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:40:40.569 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:40:40.570 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:40.570 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:40.599 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:40.600 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:40:40.600 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:40:40.600 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:40.600 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:40.600 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:40:40.600 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:40:40.600 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:40:40.601 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:40:40.601 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:40:40.601 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:40:40.601 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:40:40.601 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:40:40.604 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:40:40.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:40.604 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:40.659 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:40:40.738 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:40.741 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:40.749 INFO:teuthology.orchestra.run.smithi176.stdout:client6880 2024-09-17T03:40:40.752 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:40.752 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:40.787 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:40.788 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:40.828 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:40.828 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:40.906 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:40:41.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.173+0000 7fcdafe00640 1 -- 172.21.15.121:0/3852792747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdb00b5250 msgr2=0x7fcdb00cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:41.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.173+0000 7fcdafe00640 1 --2- 172.21.15.121:0/3852792747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdb00b5250 0x7fcdb00cd180 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009850 tx=0x7fcda002a4f0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.173+0000 7fcdafe00640 1 -- 172.21.15.121:0/3852792747 shutdown_connections 2024-09-17T03:40:41.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.173+0000 7fcdafe00640 1 --2- 172.21.15.121:0/3852792747 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdb00b5250 0x7fcdb00cd180 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.173+0000 7fcdafe00640 1 -- 172.21.15.121:0/3852792747 >> 172.21.15.121:0/3852792747 conn(0x7fcdb00d07f0 msgr2=0x7fcdb00b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:41.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.173+0000 7fcdafe00640 1 -- 172.21.15.121:0/3852792747 shutdown_connections 2024-09-17T03:40:41.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.173+0000 7fcdafe00640 1 -- 172.21.15.121:0/3852792747 wait complete. 2024-09-17T03:40:41.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.175+0000 7fcdafe00640 1 Processor -- start 2024-09-17T03:40:41.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.176+0000 7fcdafe00640 1 -- start start 2024-09-17T03:40:41.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.177+0000 7fcdafe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdb00b5250 0x7fcdb00aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:41.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.177+0000 7fcdafe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdb015ca70 0x7fcdb0144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:41.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.177+0000 7fcdafe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdb015d590 0x7fcdb01470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:41.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.177+0000 7fcdafe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb006e1c0 con 0x7fcdb00b5250 2024-09-17T03:40:41.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.177+0000 7fcdafe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb006e040 con 0x7fcdb015ca70 2024-09-17T03:40:41.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.177+0000 7fcdafe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb006e340 con 0x7fcdb015d590 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.177+0000 7fcdaea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdb00b5250 0x7fcdb00aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.177+0000 7fcdaea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdb00b5250 0x7fcdb00aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38922/0 (socket says 172.21.15.121:38922) 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.177+0000 7fcdaea00640 1 -- 172.21.15.121:0/792738498 learned_addr learned my addr 172.21.15.121:0/792738498 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcdaf400640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdb015d590 0x7fcdb01470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcda6000640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdb015ca70 0x7fcdb0144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcdaea00640 1 -- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdb015d590 msgr2=0x7fcdb01470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcdaea00640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdb015d590 0x7fcdb01470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcdaea00640 1 -- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdb015ca70 msgr2=0x7fcdb0144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcdaea00640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdb015ca70 0x7fcdb0144880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcdaea00640 1 -- 172.21.15.121:0/792738498 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb0072dc0 con 0x7fcdb00b5250 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcda6000640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdb015ca70 0x7fcdb0144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcdaea00640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdb00b5250 0x7fcdb00aeaa0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009970 tx=0x7fcda0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:41.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcda7400640 1 -- 172.21.15.121:0/792738498 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda003f070 con 0x7fcdb00b5250 2024-09-17T03:40:41.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcdafe00640 1 -- 172.21.15.121:0/792738498 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb0144dc0 con 0x7fcdb00b5250 2024-09-17T03:40:41.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcda7400640 1 -- 172.21.15.121:0/792738498 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcda0033e10 con 0x7fcdb00b5250 2024-09-17T03:40:41.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.178+0000 7fcda7400640 1 -- 172.21.15.121:0/792738498 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda0005c30 con 0x7fcdb00b5250 2024-09-17T03:40:41.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.179+0000 7fcdafe00640 1 -- 172.21.15.121:0/792738498 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb0073310 con 0x7fcdb00b5250 2024-09-17T03:40:41.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.179+0000 7fcdafe00640 1 -- 172.21.15.121:0/792738498 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb00cd180 con 0x7fcdb00b5250 2024-09-17T03:40:41.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.181+0000 7fcda7400640 1 -- 172.21.15.121:0/792738498 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcda0042070 con 0x7fcdb00b5250 2024-09-17T03:40:41.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.182+0000 7fcda7400640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcd8c078b90 0x7fcd8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:41.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.182+0000 7fcda7400640 1 -- 172.21.15.121:0/792738498 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7fcda00bbe00 con 0x7fcdb00b5250 2024-09-17T03:40:41.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.182+0000 7fcda6000640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcd8c078b90 0x7fcd8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:41.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.183+0000 7fcda6000640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcd8c078b90 0x7fcd8c07b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0152750 tx=0x7fcd98009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:41.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.186+0000 7fcda7400640 1 -- 172.21.15.121:0/792738498 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcda00840c0 con 0x7fcdb00b5250 2024-09-17T03:40:41.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.382+0000 7fcdafe00640 1 -- 172.21.15.121:0/792738498 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcdb006ad90 con 0x7fcdb00b5250 2024-09-17T03:40:41.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.382+0000 7fcda7400640 1 -- 172.21.15.121:0/792738498 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v110) ==== 80+0+0 (secure 0 0 0) 0x7fcda00839c0 con 0x7fcdb00b5250 2024-09-17T03:40:41.382 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:40:41.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.384+0000 7fcdafe00640 1 -- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcd8c078b90 msgr2=0x7fcd8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.384+0000 7fcdafe00640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcd8c078b90 0x7fcd8c07b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0152750 tx=0x7fcd98009040 comp rx=0 tx=0).stop 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.384+0000 7fcdafe00640 1 -- 172.21.15.121:0/792738498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdb00b5250 msgr2=0x7fcdb00aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.384+0000 7fcdafe00640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdb00b5250 0x7fcdb00aeaa0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009970 tx=0x7fcda0033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.385+0000 7fcdafe00640 1 -- 172.21.15.121:0/792738498 shutdown_connections 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.385+0000 7fcdafe00640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcdb015d590 0x7fcdb01470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.385+0000 7fcdafe00640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdb015ca70 0x7fcdb0144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.385+0000 7fcdafe00640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fcd8c078b90 0x7fcd8c07b0a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.385+0000 7fcdafe00640 1 --2- 172.21.15.121:0/792738498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdb00b5250 0x7fcdb00aeaa0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.385+0000 7fcdafe00640 1 -- 172.21.15.121:0/792738498 >> 172.21.15.121:0/792738498 conn(0x7fcdb00d07f0 msgr2=0x7fcdb00b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.385+0000 7fcdafe00640 1 -- 172.21.15.121:0/792738498 shutdown_connections 2024-09-17T03:40:41.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.385+0000 7fcdafe00640 1 -- 172.21.15.121:0/792738498 wait complete. 2024-09-17T03:40:41.406 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:40:41.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:41.406 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:41.469 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:40:41.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:41.469 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:40:41.505 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:41.505 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:41.542 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:41.542 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:41.619 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:40:41.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.839+0000 7fbe55600640 1 -- 172.21.15.121:0/4213496636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe500d0af0 msgr2=0x7fbe5006ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.839+0000 7fbe55600640 1 --2- 172.21.15.121:0/4213496636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe500d0af0 0x7fbe5006ee50 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fbe500cdc20 tx=0x7fbe4802a8f0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.839+0000 7fbe55600640 1 -- 172.21.15.121:0/4213496636 shutdown_connections 2024-09-17T03:40:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.839+0000 7fbe55600640 1 --2- 172.21.15.121:0/4213496636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe500d0af0 0x7fbe5006ee50 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.839+0000 7fbe55600640 1 --2- 172.21.15.121:0/4213496636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe5006ddc0 0x7fbe500d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.839+0000 7fbe55600640 1 --2- 172.21.15.121:0/4213496636 >> v2:172.21.15.176:3300/0 conn(0x7fbe5015a3e0 0x7fbe5006d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.839+0000 7fbe55600640 1 -- 172.21.15.121:0/4213496636 >> 172.21.15.121:0/4213496636 conn(0x7fbe500b3580 msgr2=0x7fbe500b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.839+0000 7fbe55600640 1 -- 172.21.15.121:0/4213496636 shutdown_connections 2024-09-17T03:40:41.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.839+0000 7fbe55600640 1 -- 172.21.15.121:0/4213496636 wait complete. 2024-09-17T03:40:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.842+0000 7fbe55600640 1 Processor -- start 2024-09-17T03:40:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.842+0000 7fbe55600640 1 -- start start 2024-09-17T03:40:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.843+0000 7fbe55600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe5006ddc0 0x7fbe501f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.843+0000 7fbe55600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe500d0af0 0x7fbe500b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.843+0000 7fbe55600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe5015a3e0 0x7fbe5015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.843+0000 7fbe55600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5006f510 con 0x7fbe500d0af0 2024-09-17T03:40:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.843+0000 7fbe55600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5006f390 con 0x7fbe5006ddc0 2024-09-17T03:40:41.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.843+0000 7fbe55600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5006f690 con 0x7fbe5015a3e0 2024-09-17T03:40:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.843+0000 7fbe4e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe500d0af0 0x7fbe500b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.844+0000 7fbe4e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe500d0af0 0x7fbe500b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60280/0 (socket says 172.21.15.121:60280) 2024-09-17T03:40:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.844+0000 7fbe4e000640 1 -- 172.21.15.121:0/2411159173 learned_addr learned my addr 172.21.15.121:0/2411159173 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.844+0000 7fbe4f400640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe5015a3e0 0x7fbe5015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:41.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.844+0000 7fbe4ea00640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe5006ddc0 0x7fbe501f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.844+0000 7fbe4e000640 1 -- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe5015a3e0 msgr2=0x7fbe5015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.844+0000 7fbe4e000640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe5015a3e0 0x7fbe5015edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.844+0000 7fbe4e000640 1 -- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe5006ddc0 msgr2=0x7fbe501f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.844+0000 7fbe4e000640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe5006ddc0 0x7fbe501f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.844+0000 7fbe4e000640 1 -- 172.21.15.121:0/2411159173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe501f4c90 con 0x7fbe500d0af0 2024-09-17T03:40:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.844+0000 7fbe4e000640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe500d0af0 0x7fbe500b1750 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00e7f0 tx=0x7fbe3c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.845+0000 7fbe46a00640 1 -- 172.21.15.121:0/2411159173 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00eea0 con 0x7fbe500d0af0 2024-09-17T03:40:41.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.845+0000 7fbe46a00640 1 -- 172.21.15.121:0/2411159173 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe3c00ccc0 con 0x7fbe500d0af0 2024-09-17T03:40:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.845+0000 7fbe46a00640 1 -- 172.21.15.121:0/2411159173 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c005280 con 0x7fbe500d0af0 2024-09-17T03:40:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.845+0000 7fbe55600640 1 -- 172.21.15.121:0/2411159173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5009d4c0 con 0x7fbe500d0af0 2024-09-17T03:40:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.845+0000 7fbe55600640 1 -- 172.21.15.121:0/2411159173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe5009da80 con 0x7fbe500d0af0 2024-09-17T03:40:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.846+0000 7fbe55600640 1 -- 172.21.15.121:0/2411159173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5009d230 con 0x7fbe500d0af0 2024-09-17T03:40:41.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.847+0000 7fbe46a00640 1 -- 172.21.15.121:0/2411159173 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe3c005420 con 0x7fbe500d0af0 2024-09-17T03:40:41.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.848+0000 7fbe46a00640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbe30078b90 0x7fbe3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:41.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.848+0000 7fbe46a00640 1 -- 172.21.15.121:0/2411159173 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7fbe3c09b770 con 0x7fbe500d0af0 2024-09-17T03:40:41.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.848+0000 7fbe4ea00640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbe30078b90 0x7fbe3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:41.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.849+0000 7fbe4ea00640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbe30078b90 0x7fbe3007b0a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009b30 tx=0x7fbe40005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:41.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:41.852+0000 7fbe46a00640 1 -- 172.21.15.121:0/2411159173 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbe501f4c90 con 0x7fbe500d0af0 2024-09-17T03:40:42.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.046+0000 7fbe55600640 1 -- 172.21.15.121:0/2411159173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbe5015a020 con 0x7fbe500d0af0 2024-09-17T03:40:42.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.046+0000 7fbe46a00640 1 -- 172.21.15.121:0/2411159173 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v110) ==== 80+0+0 (secure 0 0 0) 0x7fbe5015a020 con 0x7fbe500d0af0 2024-09-17T03:40:42.046 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 -- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbe30078b90 msgr2=0x7fbe3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbe30078b90 0x7fbe3007b0a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009b30 tx=0x7fbe40005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 -- 172.21.15.121:0/2411159173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe500d0af0 msgr2=0x7fbe500b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe500d0af0 0x7fbe500b1750 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00e7f0 tx=0x7fbe3c00ecb0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 -- 172.21.15.121:0/2411159173 shutdown_connections 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe5015a3e0 0x7fbe5015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fbe30078b90 0x7fbe3007b0a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe500d0af0 0x7fbe500b1750 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 --2- 172.21.15.121:0/2411159173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe5006ddc0 0x7fbe501f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 -- 172.21.15.121:0/2411159173 >> 172.21.15.121:0/2411159173 conn(0x7fbe500b3580 msgr2=0x7fbe50157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 -- 172.21.15.121:0/2411159173 shutdown_connections 2024-09-17T03:40:42.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.049+0000 7fbe55600640 1 -- 172.21.15.121:0/2411159173 wait complete. 2024-09-17T03:40:42.072 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:40:42.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:42.072 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:42.139 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:40:42.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:42.140 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:40:42.177 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:40:42.185 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:40:42.276 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-09-17T03:40:42.276 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-09-17T03:40:42.276 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:40:42.276 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-09-17T03:40:42.276 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.276 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-09-17T03:40:42.276 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.276 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:40:42.277 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-09-17T03:40:42.278 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.121,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on skipped message = False 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = f24b1682-8755-41b1-8124-cbd8f88939a2 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.279 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-09-17T03:40:42.280 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-09-17T03:40:42.281 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-09-17T03:40:42.281 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2024-09-17T03:40:42.281 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.281 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-09-17T03:40:42.281 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-09-17T03:40:42.281 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.281 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:40:42.281 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.281 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-09-17T03:40:42.281 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 20 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 20 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:40:42.282 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 10 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:40:42.283 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-09-17T03:40:42.284 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.284 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-09-17T03:40:42.284 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:40:42.284 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-17T03:40:42.284 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-09-17T03:40:42.284 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-17T03:40:42.284 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-09-17T03:40:42.284 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-09-17T03:40:42.284 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:40:42.285 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.286 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-09-17T03:40:42.286 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:40:42.286 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.286 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:40:42.286 INFO:teuthology.orchestra.run.smithi121.stdout: mon down mkfs grace = 300 2024-09-17T03:40:42.286 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:42.286 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-09-17T03:40:42.286 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-09-17T03:40:42.286 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = "" 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout: client reconnect stale = True 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-09-17T03:40:42.287 INFO:teuthology.orchestra.run.smithi121.stdout:[mds] 2024-09-17T03:40:42.288 INFO:teuthology.orchestra.run.smithi121.stdout: mds_sessionmap_keys_per_op = 1 2024-09-17T03:40:42.314 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-17T03:40:42.315 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-17T03:40:42.315 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:40:42.315 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-17T03:40:42.315 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.315 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-17T03:40:42.315 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.315 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-17T03:40:42.315 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.315 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-17T03:40:42.315 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.317 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.121,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = f24b1682-8755-41b1-8124-cbd8f88939a2 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-17T03:40:42.318 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.319 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-17T03:40:42.319 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-17T03:40:42.319 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:40:42.319 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.319 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-17T03:40:42.319 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-17T03:40:42.319 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.319 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-17T03:40:42.319 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-17T03:40:42.319 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-17T03:40:42.320 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 20 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 20 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 10 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:40:42.321 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:40:42.322 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:40:42.323 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: mon down mkfs grace = 300 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-17T03:40:42.324 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout: client reconnect stale = True 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2024-09-17T03:40:42.325 INFO:teuthology.orchestra.run.smithi176.stdout: mds_sessionmap_keys_per_op = 1 2024-09-17T03:40:42.341 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:40:42.341 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:42.341 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:40:42.341 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:42.342 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:40:42.342 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:42.342 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:40:42.342 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:42.365 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:40:42.365 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-17T03:40:42.366 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:40:42.366 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-17T03:40:42.367 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:40:42.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-17T03:40:42.369 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:40:42.369 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-17T03:40:42.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7f3d39800640 1 -- 172.21.15.121:0/824011457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d340d4f90 msgr2=0x7f3d3406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7f3d39800640 1 --2- 172.21.15.121:0/824011457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d340d4f90 0x7f3d3406dea0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009830 tx=0x7f3d2002a5b0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7fa29c600640 1 -- 172.21.15.121:0/4480652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa29406dee0 msgr2=0x7fa2940b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7fa29c600640 1 --2- 172.21.15.121:0/4480652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa29406dee0 0x7fa2940b35f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa288009820 tx=0x7fa28802a3f0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7f3d39800640 1 -- 172.21.15.121:0/824011457 shutdown_connections 2024-09-17T03:40:42.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7f3d39800640 1 --2- 172.21.15.121:0/824011457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d340d4f90 0x7f3d3406dea0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7f3d39800640 1 -- 172.21.15.121:0/824011457 >> 172.21.15.121:0/824011457 conn(0x7f3d340d4470 msgr2=0x7f3d340d4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:42.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7fa29c600640 1 -- 172.21.15.121:0/4480652 shutdown_connections 2024-09-17T03:40:42.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7fa29c600640 1 --2- 172.21.15.121:0/4480652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa294162ed0 0x7fa2940d2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7fa29c600640 1 --2- 172.21.15.121:0/4480652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa29406dee0 0x7fa2940b35f0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7fa29c600640 1 -- 172.21.15.121:0/4480652 >> 172.21.15.121:0/4480652 conn(0x7fa2940d45f0 msgr2=0x7fa2940d4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:42.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7f3d39800640 1 -- 172.21.15.121:0/824011457 shutdown_connections 2024-09-17T03:40:42.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.642+0000 7f3d39800640 1 -- 172.21.15.121:0/824011457 wait complete. 2024-09-17T03:40:42.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.643+0000 7fa29c600640 1 -- 172.21.15.121:0/4480652 shutdown_connections 2024-09-17T03:40:42.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.643+0000 7fa29c600640 1 -- 172.21.15.121:0/4480652 wait complete. 2024-09-17T03:40:42.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.645+0000 7f3d39800640 1 Processor -- start 2024-09-17T03:40:42.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.645+0000 7f3d39800640 1 -- start start 2024-09-17T03:40:42.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.645+0000 7fa29c600640 1 Processor -- start 2024-09-17T03:40:42.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.645+0000 7fa29c600640 1 -- start start 2024-09-17T03:40:42.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.646+0000 7f3d39800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d340b3410 0x7f3d3415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.646+0000 7f3d39800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d340d0ce0 0x7f3d3415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.646+0000 7f3d39800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d340d4f90 0x7f3d340b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.646+0000 7f3d39800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d340cfcc0 con 0x7f3d340b3410 2024-09-17T03:40:42.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.646+0000 7f3d39800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d340cfb40 con 0x7f3d340d4f90 2024-09-17T03:40:42.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.646+0000 7f3d39800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3d340cfe40 con 0x7f3d340d0ce0 2024-09-17T03:40:42.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7f3d33e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d340b3410 0x7f3d3415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7fa29c600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa29406dee0 0x7fa29414e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7f3d33e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d340b3410 0x7f3d3415e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60306/0 (socket says 172.21.15.121:60306) 2024-09-17T03:40:42.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7f3d33e00640 1 -- 172.21.15.121:0/4134446838 learned_addr learned my addr 172.21.15.121:0/4134446838 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:42.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7f3d33400640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d340d0ce0 0x7f3d3415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7fa29c600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2940b9b20 0x7fa2941f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7fa29c600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294162ed0 0x7fa2941f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7fa29c600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2940d3040 con 0x7fa29406dee0 2024-09-17T03:40:42.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7fa29c600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa294163600 con 0x7fa294162ed0 2024-09-17T03:40:42.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7fa29c600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa2940d31c0 con 0x7fa2940b9b20 2024-09-17T03:40:42.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7f3d38e00640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d340d4f90 0x7f3d340b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7fa299200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2940b9b20 0x7fa2941f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7fa29a600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294162ed0 0x7fa2941f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7fa299200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2940b9b20 0x7fa2941f91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.121:43476/0 (socket says 172.21.15.121:43476) 2024-09-17T03:40:42.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7fa299200640 1 -- 172.21.15.121:0/1498204694 learned_addr learned my addr 172.21.15.121:0/1498204694 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:42.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.647+0000 7f3d33e00640 1 -- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d340d0ce0 msgr2=0x7f3d3415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7f3d33e00640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d340d0ce0 0x7f3d3415c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7f3d33e00640 1 -- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d340d4f90 msgr2=0x7f3d340b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7f3d33e00640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d340d4f90 0x7f3d340b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7fa299c00640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa29406dee0 0x7fa29414e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7f3d33e00640 1 -- 172.21.15.121:0/4134446838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d34158280 con 0x7f3d340b3410 2024-09-17T03:40:42.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7f3d38e00640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d340d4f90 0x7f3d340b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:42.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7f3d33400640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d340d0ce0 0x7f3d3415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:42.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7fa29a600640 1 -- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2940b9b20 msgr2=0x7fa2941f91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7fa29a600640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2940b9b20 0x7fa2941f91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7fa29a600640 1 -- 172.21.15.121:0/1498204694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa29406dee0 msgr2=0x7fa29414e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7fa29a600640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa29406dee0 0x7fa29414e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7fa29a600640 1 -- 172.21.15.121:0/1498204694 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29409e290 con 0x7fa294162ed0 2024-09-17T03:40:42.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7fa299c00640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa29406dee0 0x7fa29414e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:42.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7f3d33e00640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d340b3410 0x7f3d3415e4f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3d2400c390 tx=0x7f3d2400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7fa29a600640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294162ed0 0x7fa2941f96f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa28c005fd0 tx=0x7fa28c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.648+0000 7f3d2be00640 1 -- 172.21.15.121:0/4134446838 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d24017070 con 0x7f3d340b3410 2024-09-17T03:40:42.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.649+0000 7f3d39800640 1 -- 172.21.15.121:0/4134446838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d341587b0 con 0x7f3d340b3410 2024-09-17T03:40:42.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.649+0000 7fa291600640 1 -- 172.21.15.121:0/1498204694 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c010630 con 0x7fa294162ed0 2024-09-17T03:40:42.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.649+0000 7fa291600640 1 -- 172.21.15.121:0/1498204694 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa28c00ce50 con 0x7fa294162ed0 2024-09-17T03:40:42.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.649+0000 7fa291600640 1 -- 172.21.15.121:0/1498204694 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c010a50 con 0x7fa294162ed0 2024-09-17T03:40:42.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.649+0000 7f3d39800640 1 -- 172.21.15.121:0/4134446838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d34158d70 con 0x7f3d340b3410 2024-09-17T03:40:42.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.649+0000 7f3d2be00640 1 -- 172.21.15.121:0/4134446838 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d240035f0 con 0x7f3d340b3410 2024-09-17T03:40:42.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.649+0000 7f3d2be00640 1 -- 172.21.15.121:0/4134446838 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d24003a20 con 0x7f3d340b3410 2024-09-17T03:40:42.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.649+0000 7fa29c600640 1 -- 172.21.15.121:0/1498204694 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29409e570 con 0x7fa294162ed0 2024-09-17T03:40:42.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.649+0000 7fa29c600640 1 -- 172.21.15.121:0/1498204694 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29414e680 con 0x7fa294162ed0 2024-09-17T03:40:42.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.650+0000 7fa29c600640 1 -- 172.21.15.121:0/1498204694 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2941f9fc0 con 0x7fa294162ed0 2024-09-17T03:40:42.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.650+0000 7f3d39800640 1 -- 172.21.15.121:0/4134446838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d0c005290 con 0x7f3d340b3410 2024-09-17T03:40:42.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.652+0000 7fa291600640 1 -- 172.21.15.121:0/1498204694 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa28c010bf0 con 0x7fa294162ed0 2024-09-17T03:40:42.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.653+0000 7fa291600640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa274078b90 0x7fa27407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.653+0000 7fa291600640 1 -- 172.21.15.121:0/1498204694 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7fa28c09bea0 con 0x7fa294162ed0 2024-09-17T03:40:42.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.653+0000 7f3d2be00640 1 -- 172.21.15.121:0/4134446838 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d2401a070 con 0x7f3d340b3410 2024-09-17T03:40:42.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.653+0000 7fa299c00640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa274078b90 0x7fa27407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.654+0000 7fa299c00640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa274078b90 0x7fa27407b0a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa288034000 tx=0x7fa288004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.654+0000 7f3d2be00640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d14078b90 0x7f3d1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.654+0000 7f3d2be00640 1 -- 172.21.15.121:0/4134446838 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f3d2409a510 con 0x7f3d340b3410 2024-09-17T03:40:42.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.655+0000 7f3d33400640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d14078b90 0x7f3d1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.655+0000 7f3d33400640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d14078b90 0x7f3d1407b0a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3d20034000 tx=0x7f3d20004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.658+0000 7fa291600640 1 -- 172.21.15.121:0/1498204694 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa28c064140 con 0x7fa294162ed0 2024-09-17T03:40:42.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.661+0000 7f3d2be00640 1 -- 172.21.15.121:0/4134446838 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3d24021020 con 0x7f3d340b3410 2024-09-17T03:40:42.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.662+0000 7f8868e00640 1 -- 172.21.15.121:0/3586382053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88640d1370 msgr2=0x7f886415c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.662+0000 7f8868e00640 1 --2- 172.21.15.121:0/3586382053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88640d1370 0x7f886415c280 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f885c005fd0 tx=0x7f885c02a740 comp rx=0 tx=0).stop 2024-09-17T03:40:42.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.662+0000 7f8868e00640 1 -- 172.21.15.121:0/3586382053 shutdown_connections 2024-09-17T03:40:42.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.662+0000 7f8868e00640 1 --2- 172.21.15.121:0/3586382053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88640d1370 0x7f886415c280 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.662+0000 7f8868e00640 1 -- 172.21.15.121:0/3586382053 >> 172.21.15.121:0/3586382053 conn(0x7f886406ddc0 msgr2=0x7f886406e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:42.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.662+0000 7f8868e00640 1 -- 172.21.15.121:0/3586382053 shutdown_connections 2024-09-17T03:40:42.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.662+0000 7f8868e00640 1 -- 172.21.15.121:0/3586382053 wait complete. 2024-09-17T03:40:42.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.665+0000 7f8868e00640 1 Processor -- start 2024-09-17T03:40:42.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.665+0000 7f8868e00640 1 -- start start 2024-09-17T03:40:42.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.666+0000 7f8868e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88640d1370 0x7f88640c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.666+0000 7f8868e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f886415ed10 0x7f8864156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.666+0000 7f8868e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8864162300 0x7f8864159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.666+0000 7f8868e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f88640d37f0 con 0x7f88640d1370 2024-09-17T03:40:42.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.666+0000 7f8868e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88640d3670 con 0x7f8864162300 2024-09-17T03:40:42.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.666+0000 7f8868e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88640d3970 con 0x7f886415ed10 2024-09-17T03:40:42.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.666+0000 7f8863400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88640d1370 0x7f88640c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8863400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88640d1370 0x7f88640c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60344/0 (socket says 172.21.15.121:60344) 2024-09-17T03:40:42.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8863400640 1 -- 172.21.15.121:0/3445177676 learned_addr learned my addr 172.21.15.121:0/3445177676 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:42.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8863e00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8864162300 0x7f8864159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8862a00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f886415ed10 0x7f8864156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8863400640 1 -- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f886415ed10 msgr2=0x7f8864156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8863400640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f886415ed10 0x7f8864156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8863400640 1 -- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8864162300 msgr2=0x7f8864159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8863400640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8864162300 0x7f8864159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8863400640 1 -- 172.21.15.121:0/3445177676 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88640c8e60 con 0x7f88640d1370 2024-09-17T03:40:42.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8863e00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8864162300 0x7f8864159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:42.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.667+0000 7f8863400640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88640d1370 0x7f88640c8920 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f885400c3d0 tx=0x7f885400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.668+0000 7f885b400640 1 -- 172.21.15.121:0/3445177676 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854017070 con 0x7f88640d1370 2024-09-17T03:40:42.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.668+0000 7f885b400640 1 -- 172.21.15.121:0/3445177676 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88540053c0 con 0x7f88640d1370 2024-09-17T03:40:42.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.668+0000 7f8868e00640 1 -- 172.21.15.121:0/3445177676 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8864156990 con 0x7f88640d1370 2024-09-17T03:40:42.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.668+0000 7f885b400640 1 -- 172.21.15.121:0/3445177676 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854003850 con 0x7f88640d1370 2024-09-17T03:40:42.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.668+0000 7f8868e00640 1 -- 172.21.15.121:0/3445177676 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88640cab20 con 0x7f88640d1370 2024-09-17T03:40:42.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.669+0000 7f8868e00640 1 -- 172.21.15.121:0/3445177676 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88640d3e20 con 0x7f88640d1370 2024-09-17T03:40:42.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.671+0000 7f885b400640 1 -- 172.21.15.121:0/3445177676 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f885401a070 con 0x7f88640d1370 2024-09-17T03:40:42.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.672+0000 7f885b400640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8844078b90 0x7f884407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.672+0000 7f885b400640 1 -- 172.21.15.121:0/3445177676 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f885409a930 con 0x7f88640d1370 2024-09-17T03:40:42.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.672+0000 7f8862a00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8844078b90 0x7f884407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.673+0000 7f8862a00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8844078b90 0x7f884407b0a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8864161eb0 tx=0x7f8850009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.680+0000 7f885b400640 1 -- 172.21.15.121:0/3445177676 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8854021070 con 0x7f88640d1370 2024-09-17T03:40:42.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.708+0000 7f75e1c00640 1 -- 172.21.15.121:0/951498683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75dc160730 msgr2=0x7f75dc160b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.708+0000 7f75e1c00640 1 --2- 172.21.15.121:0/951498683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75dc160730 0x7f75dc160b40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f75d4005fd0 tx=0x7f75d402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.708+0000 7f75e1c00640 1 -- 172.21.15.121:0/951498683 shutdown_connections 2024-09-17T03:40:42.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.708+0000 7f75e1c00640 1 --2- 172.21.15.121:0/951498683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75dc160730 0x7f75dc160b40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.708+0000 7f75e1c00640 1 --2- 172.21.15.121:0/951498683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75dc070190 0x7f75dc0ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.708+0000 7f75e1c00640 1 -- 172.21.15.121:0/951498683 >> 172.21.15.121:0/951498683 conn(0x7f75dc06d4a0 msgr2=0x7f75dc0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:42.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.708+0000 7f75e1c00640 1 -- 172.21.15.121:0/951498683 shutdown_connections 2024-09-17T03:40:42.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.708+0000 7f75e1c00640 1 -- 172.21.15.121:0/951498683 wait complete. 2024-09-17T03:40:42.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.710+0000 7f75e1c00640 1 Processor -- start 2024-09-17T03:40:42.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.711+0000 7f75e1c00640 1 -- start start 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.712+0000 7f75e1c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75dc070190 0x7f75dc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.712+0000 7f75e1c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75dc15c420 0x7f75dc1f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.712+0000 7f75e1c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75dc160730 0x7f75dc1f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.712+0000 7f75e1c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc0ccc00 con 0x7f75dc070190 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.712+0000 7f75e1c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc0cca80 con 0x7f75dc160730 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.712+0000 7f75e1c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75dc0ccd80 con 0x7f75dc15c420 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.712+0000 7f75dbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75dc070190 0x7f75dc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75dbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75dc070190 0x7f75dc15f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60358/0 (socket says 172.21.15.121:60358) 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75dbe00640 1 -- 172.21.15.121:0/291879302 learned_addr learned my addr 172.21.15.121:0/291879302 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75e1200640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75dc160730 0x7f75dc1f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75d3400640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75dc15c420 0x7f75dc1f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75dbe00640 1 -- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75dc15c420 msgr2=0x7f75dc1f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75dbe00640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75dc15c420 0x7f75dc1f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75dbe00640 1 -- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75dc160730 msgr2=0x7f75dc1f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75dbe00640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75dc160730 0x7f75dc1f98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75dbe00640 1 -- 172.21.15.121:0/291879302 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc15cdd0 con 0x7f75dc070190 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75d3400640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75dc15c420 0x7f75dc1f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.713+0000 7f75dbe00640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75dc070190 0x7f75dc15f100 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00e9f0 tx=0x7f75cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.714+0000 7f75d8c00640 1 -- 172.21.15.121:0/291879302 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00cd20 con 0x7f75dc070190 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.714+0000 7f75d8c00640 1 -- 172.21.15.121:0/291879302 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75cc004020 con 0x7f75dc070190 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.714+0000 7f75e1c00640 1 -- 172.21.15.121:0/291879302 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75dc15d0b0 con 0x7f75dc070190 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.714+0000 7f75d8c00640 1 -- 172.21.15.121:0/291879302 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc004450 con 0x7f75dc070190 2024-09-17T03:40:42.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.714+0000 7f75e1c00640 1 -- 172.21.15.121:0/291879302 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75dc15d670 con 0x7f75dc070190 2024-09-17T03:40:42.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.715+0000 7f75e1c00640 1 -- 172.21.15.121:0/291879302 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75dc0cd230 con 0x7f75dc070190 2024-09-17T03:40:42.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.716+0000 7f75d8c00640 1 -- 172.21.15.121:0/291879302 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75cc0035f0 con 0x7f75dc070190 2024-09-17T03:40:42.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.717+0000 7f75d8c00640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 0x7f75b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.717+0000 7f75d8c00640 1 -- 172.21.15.121:0/291879302 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 6101+0+0 (secure 0 0 0) 0x7f75cc09b830 con 0x7f75dc070190 2024-09-17T03:40:42.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.718+0000 7f75d3400640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 0x7f75b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.718+0000 7f75d3400640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 0x7f75b807b0d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0cd930 tx=0x7f75c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.721+0000 7f75d8c00640 1 -- 172.21.15.121:0/291879302 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75cc0639c0 con 0x7f75dc070190 2024-09-17T03:40:42.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.946+0000 7f8868e00640 1 -- 172.21.15.121:0/3445177676 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f8864161a00 con 0x7f88640d1370 2024-09-17T03:40:42.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.989+0000 7f75e1c00640 1 -- 172.21.15.121:0/291879302 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f75dc074f80 con 0x7f75dc070190 2024-09-17T03:40:42.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.990+0000 7f3d39800640 1 -- 172.21.15.121:0/4134446838 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f3d0c005850 con 0x7f3d340b3410 2024-09-17T03:40:42.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:42.991+0000 7fa29c600640 1 -- 172.21.15.121:0/1498204694 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fa294151460 con 0x7fa294162ed0 2024-09-17T03:40:43.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.502+0000 7f885b400640 1 -- 172.21.15.121:0/3445177676 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6748 v78) ==== 95+0+0 (secure 0 0 0) 0x7f8854062600 con 0x7f88640d1370 2024-09-17T03:40:43.502 INFO:teuthology.orchestra.run.smithi121.stderr:failed mds gid 6748 2024-09-17T03:40:43.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 -- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8844078b90 msgr2=0x7f884407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8844078b90 0x7f884407b0a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8864161eb0 tx=0x7f8850009040 comp rx=0 tx=0).stop 2024-09-17T03:40:43.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 -- 172.21.15.121:0/3445177676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88640d1370 msgr2=0x7f88640c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88640d1370 0x7f88640c8920 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f885400c3d0 tx=0x7f885400c890 comp rx=0 tx=0).stop 2024-09-17T03:40:43.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 -- 172.21.15.121:0/3445177676 shutdown_connections 2024-09-17T03:40:43.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8864162300 0x7f8864159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f886415ed10 0x7f8864156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8844078b90 0x7f884407b0a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 --2- 172.21.15.121:0/3445177676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88640d1370 0x7f88640c8920 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 -- 172.21.15.121:0/3445177676 >> 172.21.15.121:0/3445177676 conn(0x7f886406ddc0 msgr2=0x7f886406e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:43.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 -- 172.21.15.121:0/3445177676 shutdown_connections 2024-09-17T03:40:43.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.505+0000 7f8868e00640 1 -- 172.21.15.121:0/3445177676 wait complete. 2024-09-17T03:40:43.506 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-17T03:40:43.506+0000 7f1dec200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:40:43.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.507+0000 7f75d8c00640 1 -- 172.21.15.121:0/291879302 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7095 v79) ==== 95+0+0 (secure 0 0 0) 0x7f75cc0632c0 con 0x7f75dc070190 2024-09-17T03:40:43.507 INFO:teuthology.orchestra.run.smithi121.stderr:failed mds gid 7095 2024-09-17T03:40:43.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 -- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 msgr2=0x7f75b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 0x7f75b807b0d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0cd930 tx=0x7f75c4009040 comp rx=0 tx=0).stop 2024-09-17T03:40:43.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 -- 172.21.15.121:0/291879302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75dc070190 msgr2=0x7f75dc15f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75dc070190 0x7f75dc15f100 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00e9f0 tx=0x7f75cc00eeb0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 -- 172.21.15.121:0/291879302 shutdown_connections 2024-09-17T03:40:43.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75dc160730 0x7f75dc1f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75dc15c420 0x7f75dc1f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 0x7f75b807b0d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.512 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 --2- 172.21.15.121:0/291879302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75dc070190 0x7f75dc15f100 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 -- 172.21.15.121:0/291879302 >> 172.21.15.121:0/291879302 conn(0x7f75dc06d4a0 msgr2=0x7f75dc068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:43.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 -- 172.21.15.121:0/291879302 shutdown_connections 2024-09-17T03:40:43.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.512+0000 7f75e1c00640 1 -- 172.21.15.121:0/291879302 wait complete. 2024-09-17T03:40:43.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.513+0000 7f3d2be00640 1 -- 172.21.15.121:0/4134446838 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7086 v80) ==== 95+0+0 (secure 0 0 0) 0x7f3d24062150 con 0x7f3d340b3410 2024-09-17T03:40:43.513 INFO:teuthology.orchestra.run.smithi121.stderr:failed mds gid 7086 2024-09-17T03:40:43.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 -- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d14078b90 msgr2=0x7f3d1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d14078b90 0x7f3d1407b0a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3d20034000 tx=0x7f3d20004730 comp rx=0 tx=0).stop 2024-09-17T03:40:43.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 -- 172.21.15.121:0/4134446838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d340b3410 msgr2=0x7f3d3415e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d340b3410 0x7f3d3415e4f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3d2400c390 tx=0x7f3d2400c850 comp rx=0 tx=0).stop 2024-09-17T03:40:43.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 -- 172.21.15.121:0/4134446838 shutdown_connections 2024-09-17T03:40:43.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d340d4f90 0x7f3d340b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d340d0ce0 0x7f3d3415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d14078b90 0x7f3d1407b0a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 --2- 172.21.15.121:0/4134446838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d340b3410 0x7f3d3415e4f0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 -- 172.21.15.121:0/4134446838 >> 172.21.15.121:0/4134446838 conn(0x7f3d340d4470 msgr2=0x7f3d34161840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:43.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 -- 172.21.15.121:0/4134446838 shutdown_connections 2024-09-17T03:40:43.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:43.517+0000 7f3d39800640 1 -- 172.21.15.121:0/4134446838 wait complete. 2024-09-17T03:40:43.542 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:40:43.542 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:40:43.543 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:40:43.544 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:40:43.547 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:40:43.548 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:43.549 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:40:43.549 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:40:43.592 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:40:43.592 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:43.595 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:40:43.596 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:43.737 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-17T03:40:43.786 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:40:43.787 INFO:tasks.ceph.mds.c.smithi121.stdout:starting mds.c at 2024-09-17T03:40:44.508 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-17T03:40:44.508+0000 7f1dec200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:40:44.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.517+0000 7fa291600640 1 -- 172.21.15.121:0/1498204694 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6745 v81) ==== 95+0+0 (secure 0 0 0) 0x7fa28c063a40 con 0x7fa294162ed0 2024-09-17T03:40:44.517 INFO:teuthology.orchestra.run.smithi121.stderr:failed mds gid 6745 2024-09-17T03:40:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 -- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa274078b90 msgr2=0x7fa27407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa274078b90 0x7fa27407b0a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa288034000 tx=0x7fa288004730 comp rx=0 tx=0).stop 2024-09-17T03:40:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 -- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294162ed0 msgr2=0x7fa2941f96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294162ed0 0x7fa2941f96f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa28c005fd0 tx=0x7fa28c00c6a0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 -- 172.21.15.121:0/1498204694 shutdown_connections 2024-09-17T03:40:44.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa294162ed0 0x7fa2941f96f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2940b9b20 0x7fa2941f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa274078b90 0x7fa27407b0a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 --2- 172.21.15.121:0/1498204694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa29406dee0 0x7fa29414e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 -- 172.21.15.121:0/1498204694 >> 172.21.15.121:0/1498204694 conn(0x7fa2940d45f0 msgr2=0x7fa29406e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:44.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 -- 172.21.15.121:0/1498204694 shutdown_connections 2024-09-17T03:40:44.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.521+0000 7fa29c600640 1 -- 172.21.15.121:0/1498204694 wait complete. 2024-09-17T03:40:44.555 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:40:44.555 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:40:44.559 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:40:44.560 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:44.560 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:44.753 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:40:44.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.819+0000 7f4439c00640 1 -- 172.21.15.121:0/4003546966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44340cac00 msgr2=0x7f4434160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:44.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.819+0000 7f4439c00640 1 --2- 172.21.15.121:0/4003546966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44340cac00 0x7f4434160730 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f442c005fd0 tx=0x7f442c02a870 comp rx=0 tx=0).stop 2024-09-17T03:40:44.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.819+0000 7f4439c00640 1 -- 172.21.15.121:0/4003546966 shutdown_connections 2024-09-17T03:40:44.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.819+0000 7f4439c00640 1 --2- 172.21.15.121:0/4003546966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44340cac00 0x7f4434160730 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.819+0000 7f4439c00640 1 --2- 172.21.15.121:0/4003546966 >> v2:172.21.15.176:3300/0 conn(0x7f44340ceee0 0x7f44340ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.819+0000 7f4439c00640 1 -- 172.21.15.121:0/4003546966 >> 172.21.15.121:0/4003546966 conn(0x7f443406d4a0 msgr2=0x7f44340b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:44.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.819+0000 7f4439c00640 1 -- 172.21.15.121:0/4003546966 shutdown_connections 2024-09-17T03:40:44.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.819+0000 7f4439c00640 1 -- 172.21.15.121:0/4003546966 wait complete. 2024-09-17T03:40:44.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.821+0000 7f4439c00640 1 Processor -- start 2024-09-17T03:40:44.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.822+0000 7f4439c00640 1 -- start start 2024-09-17T03:40:44.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f4439c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4434070190 0x7f44341f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:44.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f4439c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44340cac00 0x7f443415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:44.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f4439c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44340ceee0 0x7f443415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f4439c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44340ccc00 con 0x7f4434070190 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f4439c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44340cca80 con 0x7f44340cac00 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f4439c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44340ccd80 con 0x7f44340ceee0 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f4433e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4434070190 0x7f44341f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f4433e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4434070190 0x7f44341f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60408/0 (socket says 172.21.15.121:60408) 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f4433e00640 1 -- 172.21.15.121:0/291592644 learned_addr learned my addr 172.21.15.121:0/291592644 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f442b400640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44340cac00 0x7f443415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.823+0000 7f4439200640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44340ceee0 0x7f443415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4433e00640 1 -- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44340ceee0 msgr2=0x7f443415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4433e00640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44340ceee0 0x7f443415cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4433e00640 1 -- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44340cac00 msgr2=0x7f443415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4433e00640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44340cac00 0x7f443415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4433e00640 1 -- 172.21.15.121:0/291592644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44340c8750 con 0x7f4434070190 2024-09-17T03:40:44.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f442b400640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44340cac00 0x7f443415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:44.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4433e00640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4434070190 0x7f44341f2ff0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f442400c3a0 tx=0x7f442400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:44.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4430c00640 1 -- 172.21.15.121:0/291592644 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424011790 con 0x7f4434070190 2024-09-17T03:40:44.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4430c00640 1 -- 172.21.15.121:0/291592644 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4424017070 con 0x7f4434070190 2024-09-17T03:40:44.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4430c00640 1 -- 172.21.15.121:0/291592644 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424011d20 con 0x7f4434070190 2024-09-17T03:40:44.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4439c00640 1 -- 172.21.15.121:0/291592644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44340c8a30 con 0x7f4434070190 2024-09-17T03:40:44.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.824+0000 7f4439c00640 1 -- 172.21.15.121:0/291592644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44340c8ff0 con 0x7f4434070190 2024-09-17T03:40:44.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.826+0000 7f4439c00640 1 -- 172.21.15.121:0/291592644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44340cd2c0 con 0x7f4434070190 2024-09-17T03:40:44.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.827+0000 7f4430c00640 1 -- 172.21.15.121:0/291592644 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f442401c460 con 0x7f4434070190 2024-09-17T03:40:44.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.828+0000 7f4430c00640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4410078b90 0x7f441007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:44.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.828+0000 7f4430c00640 1 -- 172.21.15.121:0/291592644 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f442409acc0 con 0x7f4434070190 2024-09-17T03:40:44.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.828+0000 7f442b400640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4410078b90 0x7f441007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:44.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.829+0000 7f442b400640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4410078b90 0x7f441007b0a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f44340d0ca0 tx=0x7f441c00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:44.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:44.832+0000 7f4430c00640 1 -- 172.21.15.121:0/291592644 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f44240a1080 con 0x7f4434070190 2024-09-17T03:40:45.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.051+0000 7f4439c00640 1 -- 172.21.15.121:0/291592644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44340b4b60 con 0x7f4434070190 2024-09-17T03:40:45.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.052+0000 7f4430c00640 1 -- 172.21.15.121:0/291592644 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+4404 (secure 0 0 0) 0x7f4424062860 con 0x7f4434070190 2024-09-17T03:40:45.052 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:45.052 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":82,"btime":"2024-09-17T03:40:44:516052+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2875035597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2875035597},{"type":"v1","addr":"172.21.15.121:6835","nonce":2875035597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2294887057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2294887057},{"type":"v1","addr":"172.21.15.176:6835","nonce":2294887057}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:44.516028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7332},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7332":{"gid":7332,"name":"a","rank":0,"incarnation":82,"state":"up:replay","state_seq":1,"addr":"172.21.15.121:6834/1935597076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1935597076},{"type":"v1","addr":"172.21.15.121:6834","nonce":1935597076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-09-17T03:40:45.052 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 82 2024-09-17T03:40:45.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.054+0000 7f4439c00640 1 -- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4410078b90 msgr2=0x7f441007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:45.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.054+0000 7f4439c00640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4410078b90 0x7f441007b0a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f44340d0ca0 tx=0x7f441c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.054+0000 7f4439c00640 1 -- 172.21.15.121:0/291592644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4434070190 msgr2=0x7f44341f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:45.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.054+0000 7f4439c00640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4434070190 0x7f44341f2ff0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f442400c3a0 tx=0x7f442400c860 comp rx=0 tx=0).stop 2024-09-17T03:40:45.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.054+0000 7f4439c00640 1 -- 172.21.15.121:0/291592644 shutdown_connections 2024-09-17T03:40:45.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.054+0000 7f4439c00640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44340ceee0 0x7f443415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.054+0000 7f4439c00640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44340cac00 0x7f443415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.054+0000 7f4439c00640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4410078b90 0x7f441007b0a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.054+0000 7f4439c00640 1 --2- 172.21.15.121:0/291592644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4434070190 0x7f44341f2ff0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.054+0000 7f4439c00640 1 -- 172.21.15.121:0/291592644 >> 172.21.15.121:0/291592644 conn(0x7f443406d4a0 msgr2=0x7f4434073fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:45.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.055+0000 7f4439c00640 1 -- 172.21.15.121:0/291592644 shutdown_connections 2024-09-17T03:40:45.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:45.055+0000 7f4439c00640 1 -- 172.21.15.121:0/291592644 wait complete. 2024-09-17T03:40:45.481 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:40:25.564895+0000', 'modified': '2024-09-17T03:40:44.516028+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7332}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7332': {'gid': 7332, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.121:6834/1935597076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 1935597076}, {'type': 'v1', 'addr': '172.21.15.121:6834', 'nonce': 1935597076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:40:45.482 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7332:up:replay 2024-09-17T03:40:46.483 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:46.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.713+0000 7fe0f8800640 1 -- 172.21.15.121:0/979484582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0f00af560 msgr2=0x7fe0f015ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.713+0000 7fe0f8800640 1 --2- 172.21.15.121:0/979484582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0f00af560 0x7fe0f015ae50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009830 tx=0x7fe0e402a3e0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.713+0000 7fe0f8800640 1 -- 172.21.15.121:0/979484582 shutdown_connections 2024-09-17T03:40:46.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.713+0000 7fe0f8800640 1 --2- 172.21.15.121:0/979484582 >> v2:172.21.15.176:3300/0 conn(0x7fe0f006f050 0x7fe0f006f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.713+0000 7fe0f8800640 1 --2- 172.21.15.121:0/979484582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0f00af560 0x7fe0f015ae50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.713+0000 7fe0f8800640 1 -- 172.21.15.121:0/979484582 >> 172.21.15.121:0/979484582 conn(0x7fe0f006d4c0 msgr2=0x7fe0f00d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:46.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.713+0000 7fe0f8800640 1 -- 172.21.15.121:0/979484582 shutdown_connections 2024-09-17T03:40:46.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.713+0000 7fe0f8800640 1 -- 172.21.15.121:0/979484582 wait complete. 2024-09-17T03:40:46.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.716+0000 7fe0f8800640 1 Processor -- start 2024-09-17T03:40:46.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.716+0000 7fe0f8800640 1 -- start start 2024-09-17T03:40:46.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.717+0000 7fe0f8800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0f006f050 0x7fe0f01543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.717+0000 7fe0f8800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f00af560 0x7fe0f01573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.717+0000 7fe0f8800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0f015ed20 0x7fe0f0157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.717+0000 7fe0f8800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f00cfc70 con 0x7fe0f00af560 2024-09-17T03:40:46.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.717+0000 7fe0f8800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f00cfaf0 con 0x7fe0f006f050 2024-09-17T03:40:46.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.717+0000 7fe0f8800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f00710e0 con 0x7fe0f015ed20 2024-09-17T03:40:46.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f00af560 0x7fe0f01573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0f006f050 0x7fe0f01543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f00af560 0x7fe0f01573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60420/0 (socket says 172.21.15.121:60420) 2024-09-17T03:40:46.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5400640 1 -- 172.21.15.121:0/835695051 learned_addr learned my addr 172.21.15.121:0/835695051 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:46.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f6800640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0f015ed20 0x7fe0f0157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5400640 1 -- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0f015ed20 msgr2=0x7fe0f0157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5400640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0f015ed20 0x7fe0f0157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5400640 1 -- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0f006f050 msgr2=0x7fe0f01543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5400640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0f006f050 0x7fe0f01543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5400640 1 -- 172.21.15.121:0/835695051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f00cb060 con 0x7fe0f00af560 2024-09-17T03:40:46.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5e00640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0f006f050 0x7fe0f01543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:46.719 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.718+0000 7fe0f5400640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f00af560 0x7fe0f01573c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000e9f0 tx=0x7fe0e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:46.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.719+0000 7fe0ea000640 1 -- 172.21.15.121:0/835695051 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000cd80 con 0x7fe0f00af560 2024-09-17T03:40:46.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.719+0000 7fe0ea000640 1 -- 172.21.15.121:0/835695051 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0e0004020 con 0x7fe0f00af560 2024-09-17T03:40:46.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.719+0000 7fe0ea000640 1 -- 172.21.15.121:0/835695051 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0004450 con 0x7fe0f00af560 2024-09-17T03:40:46.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.719+0000 7fe0f8800640 1 -- 172.21.15.121:0/835695051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f00cb340 con 0x7fe0f00af560 2024-09-17T03:40:46.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.719+0000 7fe0f8800640 1 -- 172.21.15.121:0/835695051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f00cb900 con 0x7fe0f00af560 2024-09-17T03:40:46.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.720+0000 7fe0f8800640 1 -- 172.21.15.121:0/835695051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f00ae200 con 0x7fe0f00af560 2024-09-17T03:40:46.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.721+0000 7fe0ea000640 1 -- 172.21.15.121:0/835695051 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe0e00035f0 con 0x7fe0f00af560 2024-09-17T03:40:46.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.723+0000 7fe0ea000640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe0d4078b90 0x7fe0d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.723+0000 7fe0ea000640 1 -- 172.21.15.121:0/835695051 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7fe0e009b850 con 0x7fe0f00af560 2024-09-17T03:40:46.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.723+0000 7fe0f5e00640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe0d4078b90 0x7fe0d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.724+0000 7fe0f5e00640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe0d4078b90 0x7fe0d407b0a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4034000 tx=0x7fe0e4004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:46.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.727+0000 7fe0ea000640 1 -- 172.21.15.121:0/835695051 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe0f00ae200 con 0x7fe0f00af560 2024-09-17T03:40:46.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.948+0000 7fe0f8800640 1 -- 172.21.15.121:0/835695051 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0f006f460 con 0x7fe0f00af560 2024-09-17T03:40:46.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.949+0000 7fe0ea000640 1 -- 172.21.15.121:0/835695051 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5229 (secure 0 0 0) 0x7fe0e0063360 con 0x7fe0f00af560 2024-09-17T03:40:46.949 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:46.949 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":84,"btime":"2024-09-17T03:40:46:526949+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2875035597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2875035597},{"type":"v1","addr":"172.21.15.121:6835","nonce":2875035597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2294887057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2294887057},{"type":"v1","addr":"172.21.15.176:6835","nonce":2294887057}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6946,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/762503506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":762503506},{"type":"v1","addr":"172.21.15.176:6837","nonce":762503506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:45.528527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7332},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7332":{"gid":7332,"name":"a","rank":0,"incarnation":82,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.121:6834/1935597076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1935597076},{"type":"v1","addr":"172.21.15.121:6834","nonce":1935597076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-09-17T03:40:46.949 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 84 2024-09-17T03:40:46.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 -- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe0d4078b90 msgr2=0x7fe0d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe0d4078b90 0x7fe0d407b0a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4034000 tx=0x7fe0e4004730 comp rx=0 tx=0).stop 2024-09-17T03:40:46.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 -- 172.21.15.121:0/835695051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f00af560 msgr2=0x7fe0f01573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f00af560 0x7fe0f01573c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000e9f0 tx=0x7fe0e000eeb0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 -- 172.21.15.121:0/835695051 shutdown_connections 2024-09-17T03:40:46.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0f015ed20 0x7fe0f0157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe0d4078b90 0x7fe0d407b0a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0f00af560 0x7fe0f01573c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 --2- 172.21.15.121:0/835695051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0f006f050 0x7fe0f01543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 -- 172.21.15.121:0/835695051 >> 172.21.15.121:0/835695051 conn(0x7fe0f006d4c0 msgr2=0x7fe0f00b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:46.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 -- 172.21.15.121:0/835695051 shutdown_connections 2024-09-17T03:40:46.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:46.951+0000 7fe0f8800640 1 -- 172.21.15.121:0/835695051 wait complete. 2024-09-17T03:40:47.382 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:40:25.564895+0000', 'modified': '2024-09-17T03:40:45.528527+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7332}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7332': {'gid': 7332, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.121:6834/1935597076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 1935597076}, {'type': 'v1', 'addr': '172.21.15.121:6834', 'nonce': 1935597076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:40:47.382 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7332:up:rejoin 2024-09-17T03:40:48.384 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:48.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.615+0000 7f8e15000640 1 -- 172.21.15.121:0/1405482108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e10074180 msgr2=0x7f8e10159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.615+0000 7f8e15000640 1 --2- 172.21.15.121:0/1405482108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e10074180 0x7f8e10159340 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f8e10074080 tx=0x7f8e0002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.615+0000 7f8e15000640 1 -- 172.21.15.121:0/1405482108 shutdown_connections 2024-09-17T03:40:48.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.615+0000 7f8e15000640 1 --2- 172.21.15.121:0/1405482108 >> v2:172.21.15.176:3300/0 conn(0x7f8e100733d0 0x7f8e100737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.615+0000 7f8e15000640 1 --2- 172.21.15.121:0/1405482108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e1006fd90 0x7f8e1015f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.615+0000 7f8e15000640 1 --2- 172.21.15.121:0/1405482108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e10074180 0x7f8e10159340 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.615+0000 7f8e15000640 1 -- 172.21.15.121:0/1405482108 >> 172.21.15.121:0/1405482108 conn(0x7f8e1006d630 msgr2=0x7f8e100cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:48.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.615+0000 7f8e15000640 1 -- 172.21.15.121:0/1405482108 shutdown_connections 2024-09-17T03:40:48.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.615+0000 7f8e15000640 1 -- 172.21.15.121:0/1405482108 wait complete. 2024-09-17T03:40:48.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.618+0000 7f8e15000640 1 Processor -- start 2024-09-17T03:40:48.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.618+0000 7f8e15000640 1 -- start start 2024-09-17T03:40:48.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.619+0000 7f8e15000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e1006fd90 0x7f8e10141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.619+0000 7f8e15000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e100733d0 0x7f8e101f9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.619+0000 7f8e15000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e10074180 0x7f8e101f9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.619+0000 7f8e15000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8e100b1170 con 0x7f8e10074180 2024-09-17T03:40:48.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.619+0000 7f8e15000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e100b0ff0 con 0x7f8e100733d0 2024-09-17T03:40:48.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.619+0000 7f8e15000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8e100b12f0 con 0x7f8e1006fd90 2024-09-17T03:40:48.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e0e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e10074180 0x7f8e101f9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:48.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e0de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e1006fd90 0x7f8e10141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:48.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e0e800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e10074180 0x7f8e101f9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60430/0 (socket says 172.21.15.121:60430) 2024-09-17T03:40:48.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e0e800640 1 -- 172.21.15.121:0/3963948984 learned_addr learned my addr 172.21.15.121:0/3963948984 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:48.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e05400640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e100733d0 0x7f8e101f9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:48.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e0e800640 1 -- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e1006fd90 msgr2=0x7f8e10141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e0e800640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e1006fd90 0x7f8e10141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e0e800640 1 -- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e100733d0 msgr2=0x7f8e101f9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e0e800640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e100733d0 0x7f8e101f9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e0e800640 1 -- 172.21.15.121:0/3963948984 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e10159b80 con 0x7f8e10074180 2024-09-17T03:40:48.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.620+0000 7f8e0e800640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e10074180 0x7f8e101f9940 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800e990 tx=0x7f8e0800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:48.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.621+0000 7f8e06a00640 1 -- 172.21.15.121:0/3963948984 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08004d20 con 0x7f8e10074180 2024-09-17T03:40:48.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.621+0000 7f8e06a00640 1 -- 172.21.15.121:0/3963948984 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e0800cb00 con 0x7f8e10074180 2024-09-17T03:40:48.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.621+0000 7f8e15000640 1 -- 172.21.15.121:0/3963948984 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1015cb60 con 0x7f8e10074180 2024-09-17T03:40:48.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.621+0000 7f8e06a00640 1 -- 172.21.15.121:0/3963948984 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08005020 con 0x7f8e10074180 2024-09-17T03:40:48.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.621+0000 7f8e15000640 1 -- 172.21.15.121:0/3963948984 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e101e78c0 con 0x7f8e10074180 2024-09-17T03:40:48.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.622+0000 7f8e15000640 1 -- 172.21.15.121:0/3963948984 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e100737e0 con 0x7f8e10074180 2024-09-17T03:40:48.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.623+0000 7f8e06a00640 1 -- 172.21.15.121:0/3963948984 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e080051c0 con 0x7f8e10074180 2024-09-17T03:40:48.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.624+0000 7f8e06a00640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8dec078bc0 0x7f8dec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.624+0000 7f8e06a00640 1 -- 172.21.15.121:0/3963948984 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f8e0809b8e0 con 0x7f8e10074180 2024-09-17T03:40:48.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.625+0000 7f8e0de00640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8dec078bc0 0x7f8dec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:48.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.625+0000 7f8e0de00640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8dec078bc0 0x7f8dec07b0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8e00033000 tx=0x7f8e00004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:48.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.628+0000 7f8e06a00640 1 -- 172.21.15.121:0/3963948984 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e08016030 con 0x7f8e10074180 2024-09-17T03:40:48.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.847+0000 7f8e15000640 1 -- 172.21.15.121:0/3963948984 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e101fa230 con 0x7f8e10074180 2024-09-17T03:40:48.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.848+0000 7f8e06a00640 1 -- 172.21.15.121:0/3963948984 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5236 (secure 0 0 0) 0x7f8e080633f0 con 0x7f8e10074180 2024-09-17T03:40:48.848 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:48.848 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":85,"btime":"2024-09-17T03:40:47:534183+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2875035597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2875035597},{"type":"v1","addr":"172.21.15.121:6835","nonce":2875035597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2294887057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2294887057},{"type":"v1","addr":"172.21.15.176:6835","nonce":2294887057}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6946,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/762503506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":762503506},{"type":"v1","addr":"172.21.15.176:6837","nonce":762503506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:47.534173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7332},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7332":{"gid":7332,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6834/1935597076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1935597076},{"type":"v1","addr":"172.21.15.121:6834","nonce":1935597076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7332,"qdb_cluster":[7332]},"id":8}]} 2024-09-17T03:40:48.848 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 85 2024-09-17T03:40:48.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.850+0000 7f8e15000640 1 -- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8dec078bc0 msgr2=0x7f8dec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.850+0000 7f8e15000640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8dec078bc0 0x7f8dec07b0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8e00033000 tx=0x7f8e00004730 comp rx=0 tx=0).stop 2024-09-17T03:40:48.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.850+0000 7f8e15000640 1 -- 172.21.15.121:0/3963948984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e10074180 msgr2=0x7f8e101f9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.850+0000 7f8e15000640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e10074180 0x7f8e101f9940 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800e990 tx=0x7f8e0800ee50 comp rx=0 tx=0).stop 2024-09-17T03:40:48.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.850+0000 7f8e15000640 1 -- 172.21.15.121:0/3963948984 shutdown_connections 2024-09-17T03:40:48.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.851+0000 7f8e15000640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8dec078bc0 0x7f8dec07b0d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.851+0000 7f8e15000640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e10074180 0x7f8e101f9940 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.851+0000 7f8e15000640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e100733d0 0x7f8e101f9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.851+0000 7f8e15000640 1 --2- 172.21.15.121:0/3963948984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e1006fd90 0x7f8e10141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.851+0000 7f8e15000640 1 -- 172.21.15.121:0/3963948984 >> 172.21.15.121:0/3963948984 conn(0x7f8e1006d630 msgr2=0x7f8e100b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:48.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.851+0000 7f8e15000640 1 -- 172.21.15.121:0/3963948984 shutdown_connections 2024-09-17T03:40:48.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:48.851+0000 7f8e15000640 1 -- 172.21.15.121:0/3963948984 wait complete. 2024-09-17T03:40:49.276 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:40:25.564895+0000', 'modified': '2024-09-17T03:40:47.534173+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7332}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7332': {'gid': 7332, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.121:6834/1935597076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 1935597076}, {'type': 'v1', 'addr': '172.21.15.121:6834', 'nonce': 1935597076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7332, 'qdb_cluster': [7332]} 2024-09-17T03:40:49.276 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:40:49.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:40:49.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.496+0000 7fa6fbe00640 1 -- 172.21.15.121:0/2915829987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6fc15f0d0 msgr2=0x7fa6fc15f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.496+0000 7fa6fbe00640 1 --2- 172.21.15.121:0/2915829987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6fc15f0d0 0x7fa6fc15f4e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009860 tx=0x7fa6e402a670 comp rx=0 tx=0).stop 2024-09-17T03:40:49.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.496+0000 7fa6fbe00640 1 -- 172.21.15.121:0/2915829987 shutdown_connections 2024-09-17T03:40:49.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.496+0000 7fa6fbe00640 1 --2- 172.21.15.121:0/2915829987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6fc15f0d0 0x7fa6fc15f4e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.496+0000 7fa6fbe00640 1 -- 172.21.15.121:0/2915829987 >> 172.21.15.121:0/2915829987 conn(0x7fa6fc06d4a0 msgr2=0x7fa6fc0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:49.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.496+0000 7fa6fbe00640 1 -- 172.21.15.121:0/2915829987 shutdown_connections 2024-09-17T03:40:49.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.497+0000 7fa6fbe00640 1 -- 172.21.15.121:0/2915829987 wait complete. 2024-09-17T03:40:49.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.499+0000 7fa6fbe00640 1 Processor -- start 2024-09-17T03:40:49.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.499+0000 7fa6fbe00640 1 -- start start 2024-09-17T03:40:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.500+0000 7fa6fbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6fc06f880 0x7fa6fc158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.500+0000 7fa6fbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc15b680 0x7fa6fc143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.500+0000 7fa6fbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6fc15f0d0 0x7fa6fc1442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.500+0000 7fa6fbe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc070520 con 0x7fa6fc15b680 2024-09-17T03:40:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.500+0000 7fa6fbe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc0703a0 con 0x7fa6fc15f0d0 2024-09-17T03:40:49.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.500+0000 7fa6fbe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa6fc0706a0 con 0x7fa6fc06f880 2024-09-17T03:40:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.500+0000 7fa6f2000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc15b680 0x7fa6fc143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.500+0000 7fa6f2000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc15b680 0x7fa6fc143db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60440/0 (socket says 172.21.15.121:60440) 2024-09-17T03:40:49.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.500+0000 7fa6f2000640 1 -- 172.21.15.121:0/1130131708 learned_addr learned my addr 172.21.15.121:0/1130131708 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.501+0000 7fa6fb400640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6fc15f0d0 0x7fa6fc1442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.501+0000 7fa6faa00640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6fc06f880 0x7fa6fc158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.501+0000 7fa6f2000640 1 -- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6fc06f880 msgr2=0x7fa6fc158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.501+0000 7fa6f2000640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6fc06f880 0x7fa6fc158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.501+0000 7fa6f2000640 1 -- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6fc15f0d0 msgr2=0x7fa6fc1442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.501+0000 7fa6f2000640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6fc15f0d0 0x7fa6fc1442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.501+0000 7fa6f2000640 1 -- 172.21.15.121:0/1130131708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc15dfa0 con 0x7fa6fc15b680 2024-09-17T03:40:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.501+0000 7fa6faa00640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6fc06f880 0x7fa6fc158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.501+0000 7fa6f2000640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc15b680 0x7fa6fc143db0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009980 tx=0x7fa6e4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.501+0000 7fa6f3400640 1 -- 172.21.15.121:0/1130131708 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4005220 con 0x7fa6fc15b680 2024-09-17T03:40:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.502+0000 7fa6f3400640 1 -- 172.21.15.121:0/1130131708 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6e40054b0 con 0x7fa6fc15b680 2024-09-17T03:40:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.502+0000 7fa6f3400640 1 -- 172.21.15.121:0/1130131708 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4004a00 con 0x7fa6fc15b680 2024-09-17T03:40:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.502+0000 7fa6fbe00640 1 -- 172.21.15.121:0/1130131708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6fc15e280 con 0x7fa6fc15b680 2024-09-17T03:40:49.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.502+0000 7fa6fbe00640 1 -- 172.21.15.121:0/1130131708 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6fc144e30 con 0x7fa6fc15b680 2024-09-17T03:40:49.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.504+0000 7fa6f3400640 1 -- 172.21.15.121:0/1130131708 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6e4004ba0 con 0x7fa6fc15b680 2024-09-17T03:40:49.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.505+0000 7fa6f3400640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d8078b90 0x7fa6d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.505+0000 7fa6f3400640 1 -- 172.21.15.121:0/1130131708 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7fa6e40bc0b0 con 0x7fa6fc15b680 2024-09-17T03:40:49.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.505+0000 7fa6faa00640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d8078b90 0x7fa6d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.505+0000 7fa708a68740 1 Processor -- start 2024-09-17T03:40:49.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.506+0000 7fa708a68740 1 -- start start 2024-09-17T03:40:49.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.506+0000 7fa6faa00640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d8078b90 0x7fa6d807b0a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec007fd0 tx=0x7fa6ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:49.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.507+0000 7fa708a68740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907183b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.507+0000 7fa708a68740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x5609071840a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.507+0000 7fa708a68740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x560907154150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.507+0000 7fa708a68740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5609070dd430 con 0x560906db3270 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.507+0000 7fa708a68740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5609070cd5d0 con 0x560906d92590 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.507+0000 7fa708a68740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5609070bca00 con 0x560906d8a3b0 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.507+0000 7fa6faa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907183b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.507+0000 7fa6faa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907183b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60450/0 (socket says 172.21.15.121:60450) 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.507+0000 7fa6faa00640 1 -- 172.21.15.121:0/143959692 learned_addr learned my addr 172.21.15.121:0/143959692 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6f2000640 1 --2- 172.21.15.121:0/143959692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x5609071840a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6fb400640 1 --2- 172.21.15.121:0/143959692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x560907154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6faa00640 1 -- 172.21.15.121:0/143959692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 msgr2=0x5609071840a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:49.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6faa00640 1 --2- 172.21.15.121:0/143959692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x5609071840a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6faa00640 1 -- 172.21.15.121:0/143959692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 msgr2=0x560907154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:49.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6faa00640 1 --2- 172.21.15.121:0/143959692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x560907154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6faa00640 1 -- 172.21.15.121:0/143959692 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560907085520 con 0x560906db3270 2024-09-17T03:40:49.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6faa00640 1 --2- 172.21.15.121:0/143959692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907183b60 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00da10 tx=0x7fa6ec010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c5f633f8392263 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:49.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6eb400640 1 -- 172.21.15.121:0/143959692 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec024070 con 0x560906db3270 2024-09-17T03:40:49.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6eb400640 1 -- 172.21.15.121:0/143959692 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6ec014ba0 con 0x560906db3270 2024-09-17T03:40:49.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.508+0000 7fa6eb400640 1 -- 172.21.15.121:0/143959692 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec01f400 con 0x560906db3270 2024-09-17T03:40:49.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.509+0000 7fa708a68740 1 -- 172.21.15.121:0/143959692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 msgr2=0x560907183b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.509+0000 7fa708a68740 1 --2- 172.21.15.121:0/143959692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907183b60 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00da10 tx=0x7fa6ec010000 comp rx=0 tx=0).stop 2024-09-17T03:40:49.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.509+0000 7fa708a68740 1 -- 172.21.15.121:0/143959692 shutdown_connections 2024-09-17T03:40:49.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.509+0000 7fa708a68740 1 --2- 172.21.15.121:0/143959692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x560907154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.509+0000 7fa708a68740 1 --2- 172.21.15.121:0/143959692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x5609071840a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.509+0000 7fa708a68740 1 --2- 172.21.15.121:0/143959692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907183b60 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.509+0000 7fa708a68740 1 -- 172.21.15.121:0/143959692 >> 172.21.15.121:0/143959692 conn(0x560906da73c0 msgr2=0x560907159b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:49.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.509+0000 7fa708a68740 1 -- 172.21.15.121:0/143959692 shutdown_connections 2024-09-17T03:40:49.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.509+0000 7fa708a68740 1 -- 172.21.15.121:0/143959692 wait complete. 2024-09-17T03:40:49.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.510+0000 7fa708a68740 1 -- start start 2024-09-17T03:40:49.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.511+0000 7fa708a68740 1 Processor -- start 2024-09-17T03:40:49.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa708a68740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x5609071ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa708a68740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x56090717caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa708a68740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x5609071810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa708a68740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560907063330 con 0x560906db3270 2024-09-17T03:40:49.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa708a68740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5609070c0810 con 0x560906d92590 2024-09-17T03:40:49.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa708a68740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x560906e2d620 con 0x560906d8a3b0 2024-09-17T03:40:49.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa708a68740 10 client.0 _ll_register_callbacks cb 0x560907068420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa6fb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x5609071810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa6fb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x5609071810c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60456/0 (socket says 172.21.15.121:60456) 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa6fb400640 1 -- 172.21.15.121:0/4081731894 learned_addr learned my addr 172.21.15.121:0/4081731894 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa6faa00640 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x5609071ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.512+0000 7fa6f2000640 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x56090717caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.513+0000 7fa6fb400640 1 -- 172.21.15.121:0/4081731894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 msgr2=0x5609071ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.513+0000 7fa6fb400640 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x5609071ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.513+0000 7fa6fb400640 1 -- 172.21.15.121:0/4081731894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 msgr2=0x56090717caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.513+0000 7fa6fb400640 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x56090717caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.513+0000 7fa6fb400640 1 -- 172.21.15.121:0/4081731894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560906e1e850 con 0x560906db3270 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.513+0000 7fa6fb400640 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x5609071810c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4010690 tx=0x7fa6f4010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c21f4bea245cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:49.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.513+0000 7fa6dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:49.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.513+0000 7fa6dfe00640 1 -- 172.21.15.121:0/4081731894 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f401a030 con 0x560906db3270 2024-09-17T03:40:49.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.513+0000 7fa708a68740 1 -- 172.21.15.121:0/4081731894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6ec014ba0 con 0x560906db3270 2024-09-17T03:40:49.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.513+0000 7fa6dfe00640 1 -- 172.21.15.121:0/4081731894 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7fa6f4004a40 con 0x560906db3270 2024-09-17T03:40:49.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa6dfe00640 1 -- 172.21.15.121:0/4081731894 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fa6f4023050 con 0x560906db3270 2024-09-17T03:40:49.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa708a68740 10 client.7374 fetch_fsmap learned FSMap version 85 2024-09-17T03:40:49.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa708a68740 1 -- 172.21.15.121:0/4081731894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x560906e956b0 con 0x560906db3270 2024-09-17T03:40:49.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa6dfe00640 1 -- 172.21.15.121:0/4081731894 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6ec014ba0 con 0x560906db3270 2024-09-17T03:40:49.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa6dfe00640 1 -- 172.21.15.121:0/4081731894 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7fa6f4026020 con 0x560906db3270 2024-09-17T03:40:49.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa708a68740 10 client.7374 fetch_fsmap finished waiting for FSMap version 85 2024-09-17T03:40:49.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa708a68740 10 client.7374 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:40:49.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa708a68740 20 client.7374 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:49.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa708a68740 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x560906d71e40 0x560907179bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa708a68740 4 client.7374 mds_command: new command op to 7332 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa708a68740 1 -- 172.21.15.121:0/4081731894 --> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609070cf520 con 0x560906d71e40 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.514+0000 7fa6faa00640 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x560906d71e40 0x560907179bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.515+0000 7fa6faa00640 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x560906d71e40 0x560907179bc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82f8cbb22c294957 server_cookie=9a19f08bd1999615 in_seq=0 out_seq=0 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.515+0000 7fa6dfe00640 10 client.7374 ms_handle_connect on v2:172.21.15.121:6832/1935597076 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa6dfe00640 1 -- 172.21.15.121:0/4081731894 <== mds.0 v2:172.21.15.121:6832/1935597076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609070cf520 con 0x560906d71e40 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa6dfe00640 10 client.7374 handle_command_reply: tid=0 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 client.7374 shutdown 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 -- 172.21.15.121:0/4081731894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 msgr2=0x5609071810c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x5609071810c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4010690 tx=0x7fa6f4010b50 comp rx=0 tx=0).stop 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 -- 172.21.15.121:0/4081731894 shutdown_connections 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x5609071810c0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x560906d71e40 0x560907179bc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x56090717caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 --2- 172.21.15.121:0/4081731894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x5609071ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa6dfe00640 0 client.7374 ms_handle_reset on v2:172.21.15.121:6832/1935597076 2024-09-17T03:40:49.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 -- 172.21.15.121:0/4081731894 >> 172.21.15.121:0/4081731894 conn(0x560906da73c0 msgr2=0x560907195140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:49.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 -- 172.21.15.121:0/4081731894 shutdown_connections 2024-09-17T03:40:49.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.516+0000 7fa708a68740 1 -- 172.21.15.121:0/4081731894 wait complete. 2024-09-17T03:40:49.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.517+0000 7fa708a68740 20 client.7374 trim_cache size 0 max 16384 2024-09-17T03:40:49.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.535+0000 7fa708a68740 1 Processor -- start 2024-09-17T03:40:49.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.536+0000 7fa708a68740 1 -- start start 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa708a68740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x56090717a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa708a68740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x56090717c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa708a68740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x56090717cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa708a68740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc1ff820 con 0x560906db3270 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa708a68740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc1febd0 con 0x560906d92590 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa708a68740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa6fc1ff1d0 con 0x560906d8a3b0 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa6fb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x56090717cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa6fb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x56090717cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60470/0 (socket says 172.21.15.121:60470) 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa6fb400640 1 -- 172.21.15.121:0/3940139941 learned_addr learned my addr 172.21.15.121:0/3940139941 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa6f2000640 1 --2- 172.21.15.121:0/3940139941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x56090717c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.537+0000 7fa6faa00640 1 --2- 172.21.15.121:0/3940139941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x56090717a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.538+0000 7fa6fb400640 1 -- 172.21.15.121:0/3940139941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 msgr2=0x56090717a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.538+0000 7fa6fb400640 1 --2- 172.21.15.121:0/3940139941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x56090717a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.538+0000 7fa6fb400640 1 -- 172.21.15.121:0/3940139941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 msgr2=0x56090717c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.538+0000 7fa6fb400640 1 --2- 172.21.15.121:0/3940139941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x56090717c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.538+0000 7fa6fb400640 1 -- 172.21.15.121:0/3940139941 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56090715a840 con 0x560906db3270 2024-09-17T03:40:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.538+0000 7fa6fb400640 1 --2- 172.21.15.121:0/3940139941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x56090717cdf0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4001640 tx=0x7fa6f40049a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3f684ce6b3ece9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.538+0000 7fa6eaa00640 1 -- 172.21.15.121:0/3940139941 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f401a070 con 0x560906db3270 2024-09-17T03:40:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.538+0000 7fa6eaa00640 1 -- 172.21.15.121:0/3940139941 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6f401e590 con 0x560906db3270 2024-09-17T03:40:49.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.538+0000 7fa6eaa00640 1 -- 172.21.15.121:0/3940139941 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f401e9a0 con 0x560906db3270 2024-09-17T03:40:49.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.539+0000 7fa708a68740 1 -- 172.21.15.121:0/3940139941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 msgr2=0x56090717cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.539+0000 7fa708a68740 1 --2- 172.21.15.121:0/3940139941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x56090717cdf0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4001640 tx=0x7fa6f40049a0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.539+0000 7fa708a68740 1 -- 172.21.15.121:0/3940139941 shutdown_connections 2024-09-17T03:40:49.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.539+0000 7fa708a68740 1 --2- 172.21.15.121:0/3940139941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x56090717cdf0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.539+0000 7fa708a68740 1 --2- 172.21.15.121:0/3940139941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x56090717c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.539+0000 7fa708a68740 1 --2- 172.21.15.121:0/3940139941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x56090717a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.539+0000 7fa708a68740 1 -- 172.21.15.121:0/3940139941 >> 172.21.15.121:0/3940139941 conn(0x560906da73c0 msgr2=0x560907180ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:49.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.539+0000 7fa708a68740 1 -- 172.21.15.121:0/3940139941 shutdown_connections 2024-09-17T03:40:49.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.539+0000 7fa708a68740 1 -- 172.21.15.121:0/3940139941 wait complete. 2024-09-17T03:40:49.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.540+0000 7fa708a68740 1 -- start start 2024-09-17T03:40:49.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.540+0000 7fa708a68740 1 Processor -- start 2024-09-17T03:40:49.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa708a68740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x56090721f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa708a68740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x5609071ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa708a68740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907196a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa708a68740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56090717e790 con 0x560906db3270 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa708a68740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56090717c2f0 con 0x560906d92590 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa708a68740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x560907198cf0 con 0x560906d8a3b0 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa708a68740 10 client.0 _ll_register_callbacks cb 0x7fa6f4010270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa6fb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa6fb400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60472/0 (socket says 172.21.15.121:60472) 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa6fb400640 1 -- 172.21.15.121:0/3367214926 learned_addr learned my addr 172.21.15.121:0/3367214926 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa6faa00640 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x56090721f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa6f2000640 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x5609071ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa6fb400640 1 -- 172.21.15.121:0/3367214926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 msgr2=0x56090721f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa6fb400640 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x56090721f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.542+0000 7fa6fb400640 1 -- 172.21.15.121:0/3367214926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 msgr2=0x5609071ddff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa6fb400640 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x5609071ddff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa6fb400640 1 -- 172.21.15.121:0/3367214926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609071dd8b0 con 0x560906db3270 2024-09-17T03:40:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa6f2000640 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x5609071ddff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa6fb400640 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907196a40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4020010 tx=0x7fa6f4004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93eb53402dcb7e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa6dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa6dfe00640 1 -- 172.21.15.121:0/3367214926 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4034020 con 0x560906db3270 2024-09-17T03:40:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa708a68740 1 -- 172.21.15.121:0/3367214926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6f401e590 con 0x560906db3270 2024-09-17T03:40:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa6dfe00640 1 -- 172.21.15.121:0/3367214926 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7fa6f400e940 con 0x560906db3270 2024-09-17T03:40:49.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa6dfe00640 1 -- 172.21.15.121:0/3367214926 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fa6f403e050 con 0x560906db3270 2024-09-17T03:40:49.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa708a68740 10 client.7380 fetch_fsmap learned FSMap version 85 2024-09-17T03:40:49.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.543+0000 7fa708a68740 1 -- 172.21.15.121:0/3367214926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x56090721fc90 con 0x560906db3270 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.544+0000 7fa6dfe00640 1 -- 172.21.15.121:0/3367214926 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6f401e590 con 0x560906db3270 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.544+0000 7fa6dfe00640 1 -- 172.21.15.121:0/3367214926 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x7fa6f4041020 con 0x560906db3270 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.544+0000 7fa708a68740 10 client.7380 fetch_fsmap finished waiting for FSMap version 85 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.544+0000 7fa708a68740 10 client.7380 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.544+0000 7fa708a68740 20 client.7380 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.544+0000 7fa708a68740 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x560907196f80 0x5609071ada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.544+0000 7fa708a68740 4 client.7380 mds_command: new command op to 7332 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.544+0000 7fa708a68740 1 -- 172.21.15.121:0/3367214926 --> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] -- command(tid 0: {"prefix": "status"}) -- 0x5609071591a0 con 0x560907196f80 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.544+0000 7fa6faa00640 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x560907196f80 0x5609071ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa6dfe00640 10 client.7380 ms_handle_connect on v2:172.21.15.121:6832/1935597076 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa6faa00640 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x560907196f80 0x5609071ada80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc624de56263ba3 server_cookie=48a2693b9acd2ecd in_seq=0 out_seq=0 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa6dfe00640 1 -- 172.21.15.121:0/3367214926 <== mds.0 v2:172.21.15.121:6832/1935597076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5609071591a0 con 0x560907196f80 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa6dfe00640 10 client.7380 handle_command_reply: tid=0 2024-09-17T03:40:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa708a68740 1 client.7380 shutdown 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa708a68740 1 -- 172.21.15.121:0/3367214926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 msgr2=0x560907196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa708a68740 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907196a40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4020010 tx=0x7fa6f4004c70 comp rx=0 tx=0).stop 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa708a68740 1 -- 172.21.15.121:0/3367214926 shutdown_connections 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa708a68740 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560906db3270 0x560907196a40 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa708a68740 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x560907196f80 0x5609071ada80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa708a68740 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560906d92590 0x5609071ddff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa708a68740 1 --2- 172.21.15.121:0/3367214926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560906d8a3b0 0x56090721f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa6dfe00640 0 client.7380 ms_handle_reset on v2:172.21.15.121:6832/1935597076 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.545+0000 7fa708a68740 1 -- 172.21.15.121:0/3367214926 >> 172.21.15.121:0/3367214926 conn(0x560906da73c0 msgr2=0x56090717a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa708a68740 1 -- 172.21.15.121:0/3367214926 shutdown_connections 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa708a68740 1 -- 172.21.15.121:0/3367214926 wait complete. 2024-09-17T03:40:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa708a68740 20 client.7380 trim_cache size 0 max 16384 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 7332, 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 5.0238781489999997, 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 85, 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 114, 2024-09-17T03:40:49.549 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 114, 2024-09-17T03:40:49.550 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 5.7542302669999996 2024-09-17T03:40:49.550 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:40:49.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa6fbe00640 1 -- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d8078b90 msgr2=0x7fa6d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa6fbe00640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d8078b90 0x7fa6d807b0a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec007fd0 tx=0x7fa6ec009040 comp rx=0 tx=0).stop 2024-09-17T03:40:49.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa6fbe00640 1 -- 172.21.15.121:0/1130131708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc15b680 msgr2=0x7fa6fc143db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa6fbe00640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc15b680 0x7fa6fc143db0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009980 tx=0x7fa6e4003b90 comp rx=0 tx=0).stop 2024-09-17T03:40:49.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa6fbe00640 1 -- 172.21.15.121:0/1130131708 shutdown_connections 2024-09-17T03:40:49.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa6fbe00640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6fc15f0d0 0x7fa6fc1442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa6fbe00640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa6d8078b90 0x7fa6d807b0a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa6fbe00640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc15b680 0x7fa6fc143db0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa6fbe00640 1 --2- 172.21.15.121:0/1130131708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6fc06f880 0x7fa6fc158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.546+0000 7fa6fbe00640 1 -- 172.21.15.121:0/1130131708 >> 172.21.15.121:0/1130131708 conn(0x7fa6fc06d4a0 msgr2=0x7fa6fc1593e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:49.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.547+0000 7fa6fbe00640 1 -- 172.21.15.121:0/1130131708 shutdown_connections 2024-09-17T03:40:49.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.547+0000 7fa6fbe00640 1 -- 172.21.15.121:0/1130131708 wait complete. 2024-09-17T03:40:49.571 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:40:49.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.792+0000 7efddc600640 1 -- 172.21.15.121:0/2934270678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdd4073530 msgr2=0x7efdd41627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.792+0000 7efddc600640 1 --2- 172.21.15.121:0/2934270678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdd4073530 0x7efdd41627a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7efdd4072aa0 tx=0x7efdc002a530 comp rx=0 tx=0).stop 2024-09-17T03:40:49.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.792+0000 7efddc600640 1 -- 172.21.15.121:0/2934270678 shutdown_connections 2024-09-17T03:40:49.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.792+0000 7efddc600640 1 --2- 172.21.15.121:0/2934270678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdd4073530 0x7efdd41627a0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.793+0000 7efddc600640 1 --2- 172.21.15.121:0/2934270678 >> v2:172.21.15.176:3300/0 conn(0x7efdd415ec60 0x7efdd4072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.793+0000 7efddc600640 1 -- 172.21.15.121:0/2934270678 >> 172.21.15.121:0/2934270678 conn(0x7efdd406d4c0 msgr2=0x7efdd40d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:49.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.793+0000 7efddc600640 1 -- 172.21.15.121:0/2934270678 shutdown_connections 2024-09-17T03:40:49.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.793+0000 7efddc600640 1 -- 172.21.15.121:0/2934270678 wait complete. 2024-09-17T03:40:49.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.795+0000 7efddc600640 1 Processor -- start 2024-09-17T03:40:49.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.795+0000 7efddc600640 1 -- start start 2024-09-17T03:40:49.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.796+0000 7efddc600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdd4073530 0x7efdd409a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.796+0000 7efddc600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd415ec60 0x7efdd40b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.796+0000 7efddc600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd4162ce0 0x7efdd415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.796+0000 7efddc600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efdd40cf470 con 0x7efdd4073530 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.796+0000 7efddc600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4070310 con 0x7efdd415ec60 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.796+0000 7efddc600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efdd40cf5f0 con 0x7efdd4162ce0 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdd9c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdd4073530 0x7efdd409a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdd9c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdd4073530 0x7efdd409a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60490/0 (socket says 172.21.15.121:60490) 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdd9c00640 1 -- 172.21.15.121:0/1731996666 learned_addr learned my addr 172.21.15.121:0/1731996666 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdd9200640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd415ec60 0x7efdd40b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdda600640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd4162ce0 0x7efdd415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdd9c00640 1 -- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd4162ce0 msgr2=0x7efdd415c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdd9c00640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd4162ce0 0x7efdd415c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdd9c00640 1 -- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd415ec60 msgr2=0x7efdd40b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdd9c00640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd415ec60 0x7efdd40b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdd9c00640 1 -- 172.21.15.121:0/1731996666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd415f2d0 con 0x7efdd4073530 2024-09-17T03:40:49.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.797+0000 7efdd9c00640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdd4073530 0x7efdd409a860 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7efdc800e7c0 tx=0x7efdc800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:49.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.798+0000 7efdd1600640 1 -- 172.21.15.121:0/1731996666 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc800ccc0 con 0x7efdd4073530 2024-09-17T03:40:49.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.798+0000 7efdd1600640 1 -- 172.21.15.121:0/1731996666 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdc8010430 con 0x7efdd4073530 2024-09-17T03:40:49.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.798+0000 7efddc600640 1 -- 172.21.15.121:0/1731996666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd415f7d0 con 0x7efdd4073530 2024-09-17T03:40:49.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.798+0000 7efdd1600640 1 -- 172.21.15.121:0/1731996666 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8010860 con 0x7efdd4073530 2024-09-17T03:40:49.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.798+0000 7efddc600640 1 -- 172.21.15.121:0/1731996666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd415fd90 con 0x7efdd4073530 2024-09-17T03:40:49.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.799+0000 7efddc600640 1 -- 172.21.15.121:0/1731996666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd40b4ce0 con 0x7efdd4073530 2024-09-17T03:40:49.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.800+0000 7efdd1600640 1 -- 172.21.15.121:0/1731996666 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efdc8010a00 con 0x7efdd4073530 2024-09-17T03:40:49.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.801+0000 7efdd1600640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdb4078b90 0x7efdb407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.801+0000 7efdd1600640 1 -- 172.21.15.121:0/1731996666 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7efdc809ba30 con 0x7efdd4073530 2024-09-17T03:40:49.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.801+0000 7efdd9200640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdb4078b90 0x7efdb407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.802+0000 7efdd9200640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdb4078b90 0x7efdb407b0a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efdc0034000 tx=0x7efdc0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:49.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:49.805+0000 7efdd1600640 1 -- 172.21.15.121:0/1731996666 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efdd40b4ce0 con 0x7efdd4073530 2024-09-17T03:40:50.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.025+0000 7efddc600640 1 -- 172.21.15.121:0/1731996666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efdd4074690 con 0x7efdd4073530 2024-09-17T03:40:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.026+0000 7efdd1600640 1 -- 172.21.15.121:0/1731996666 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) ==== 53+0+73 (secure 0 0 0) 0x7efdc8063b90 con 0x7efdd4073530 2024-09-17T03:40:50.026 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:40:50.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 -- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdb4078b90 msgr2=0x7efdb407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdb4078b90 0x7efdb407b0a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efdc0034000 tx=0x7efdc0004730 comp rx=0 tx=0).stop 2024-09-17T03:40:50.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 -- 172.21.15.121:0/1731996666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdd4073530 msgr2=0x7efdd409a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdd4073530 0x7efdd409a860 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7efdc800e7c0 tx=0x7efdc800ec80 comp rx=0 tx=0).stop 2024-09-17T03:40:50.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 -- 172.21.15.121:0/1731996666 shutdown_connections 2024-09-17T03:40:50.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd4162ce0 0x7efdd415c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd415ec60 0x7efdd40b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7efdb4078b90 0x7efdb407b0a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 --2- 172.21.15.121:0/1731996666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdd4073530 0x7efdd409a860 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 -- 172.21.15.121:0/1731996666 >> 172.21.15.121:0/1731996666 conn(0x7efdd406d4c0 msgr2=0x7efdd4068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 -- 172.21.15.121:0/1731996666 shutdown_connections 2024-09-17T03:40:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50.028+0000 7efddc600640 1 -- 172.21.15.121:0/1731996666 wait complete. 2024-09-17T03:40:50.051 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:40:50.051 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:40:50.051 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-17T03:40:50.051 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:40:50.051 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:50.051 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:40:50.051 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:40:50.051 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:40:50.051 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:50.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:50.052 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-17T03:40:50.088 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:40:50.088 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:40:50.088 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:40:50.088 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:50.088 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:40:50.089 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42406sec preferred_lft 42406sec 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::14d6:c1ff:fed3:fab4/64 scope link 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:50.090 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether ea:14:3f:0b:9c:a9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:40:50.091 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::e814:3fff:fe0b:9ca9/64 scope link 2024-09-17T03:40:50.091 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:50.091 INFO:teuthology.orchestra.run.smithi121.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:50.091 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether f6:7c:f7:2c:79:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:40:50.091 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f47c:f7ff:fe2c:79ce/64 scope link 2024-09-17T03:40:50.091 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:50.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:50.091 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:40:50.182 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-17T03:40:50.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:50.185 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-17T03:40:50.221 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-17T03:40:50.221 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:40:50.221 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:40:50.222 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:40:50.222 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:40:50.222 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:40:50.222 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-17T03:40:50.222 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:40:50.222 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:40:50.222 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:40:50.222 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-17T03:40:50.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:40:50.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:50.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:50.417 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:40:50.453 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:40:50.453 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:40:50.454 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:50.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:50.454 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-17T03:40:50.521 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-17T03:40:50.522+0000 7f9c7d800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:40:50.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:50.550 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:50.625 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:50.625 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:50.625 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:50.700 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:40:50.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:50.700 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:50.895 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:50.895 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:50.895 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:40:50.915 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:50.915 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:50.916 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:40:50.916 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:50.916 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:50.948 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:50.949 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:50.949 INFO:teuthology.orchestra.run.smithi121.stdout:invalid new device string format 2024-09-17T03:40:50.949 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:50.949 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:50.949 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:40:50.949 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:40:50.949 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:40:50.950 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:40:50.950 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:40:50.950 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:40:50.950 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:40:50.950 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:40:50.953 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:40:50.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:50.953 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:51.009 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:40:51.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:51.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:51.097 INFO:teuthology.orchestra.run.smithi121.stdout:client7392 2024-09-17T03:40:51.098 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:40:51.098 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:51.136 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:40:51.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.400+0000 7fd752200640 1 -- 172.21.15.121:0/1339729030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c0ceee0 msgr2=0x7fd74c0ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.400+0000 7fd752200640 1 --2- 172.21.15.121:0/1339729030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c0ceee0 0x7fd74c0ca6c0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fd734005fd0 tx=0x7fd73402a5a0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.400+0000 7fd752200640 1 -- 172.21.15.121:0/1339729030 shutdown_connections 2024-09-17T03:40:51.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.400+0000 7fd752200640 1 --2- 172.21.15.121:0/1339729030 >> v2:172.21.15.176:3300/0 conn(0x7fd74c0cac00 0x7fd74c160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.400+0000 7fd752200640 1 --2- 172.21.15.121:0/1339729030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c0ceee0 0x7fd74c0ca6c0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.400+0000 7fd752200640 1 -- 172.21.15.121:0/1339729030 >> 172.21.15.121:0/1339729030 conn(0x7fd74c06d4a0 msgr2=0x7fd74c0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:51.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.400+0000 7fd752200640 1 -- 172.21.15.121:0/1339729030 shutdown_connections 2024-09-17T03:40:51.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.400+0000 7fd752200640 1 -- 172.21.15.121:0/1339729030 wait complete. 2024-09-17T03:40:51.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.402+0000 7fd752200640 1 Processor -- start 2024-09-17T03:40:51.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.403+0000 7fd752200640 1 -- start start 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.404+0000 7fd752200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c070190 0x7fd74c153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.404+0000 7fd752200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74c0cac00 0x7fd74c15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.404+0000 7fd752200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74c0ceee0 0x7fd74c0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.404+0000 7fd752200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c0ccc00 con 0x7fd74c070190 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.404+0000 7fd752200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c0cca80 con 0x7fd74c0cac00 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.404+0000 7fd752200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd74c0ccd80 con 0x7fd74c0ceee0 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.404+0000 7fd750e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c070190 0x7fd74c153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.404+0000 7fd750e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c070190 0x7fd74c153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60506/0 (socket says 172.21.15.121:60506) 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.404+0000 7fd750e00640 1 -- 172.21.15.121:0/4007876246 learned_addr learned my addr 172.21.15.121:0/4007876246 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.405+0000 7fd743e00640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74c0cac00 0x7fd74c15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.405+0000 7fd751800640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74c0ceee0 0x7fd74c0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.405+0000 7fd750e00640 1 -- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74c0ceee0 msgr2=0x7fd74c0b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.405+0000 7fd750e00640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74c0ceee0 0x7fd74c0b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.405+0000 7fd750e00640 1 -- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74c0cac00 msgr2=0x7fd74c15cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.405+0000 7fd750e00640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74c0cac00 0x7fd74c15cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.405+0000 7fd750e00640 1 -- 172.21.15.121:0/4007876246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c1f6970 con 0x7fd74c070190 2024-09-17T03:40:51.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.405+0000 7fd750e00640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c070190 0x7fd74c153790 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00c3a0 tx=0x7fd73c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:51.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.405+0000 7fd749600640 1 -- 172.21.15.121:0/4007876246 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0052d0 con 0x7fd74c070190 2024-09-17T03:40:51.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.406+0000 7fd749600640 1 -- 172.21.15.121:0/4007876246 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd73c007020 con 0x7fd74c070190 2024-09-17T03:40:51.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.406+0000 7fd752200640 1 -- 172.21.15.121:0/4007876246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c0afe30 con 0x7fd74c070190 2024-09-17T03:40:51.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.406+0000 7fd749600640 1 -- 172.21.15.121:0/4007876246 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c007470 con 0x7fd74c070190 2024-09-17T03:40:51.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.406+0000 7fd752200640 1 -- 172.21.15.121:0/4007876246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c15af90 con 0x7fd74c070190 2024-09-17T03:40:51.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.407+0000 7fd752200640 1 -- 172.21.15.121:0/4007876246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74c0cd2a0 con 0x7fd74c070190 2024-09-17T03:40:51.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.408+0000 7fd749600640 1 -- 172.21.15.121:0/4007876246 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd73c0067d0 con 0x7fd74c070190 2024-09-17T03:40:51.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.409+0000 7fd749600640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd728078b90 0x7fd72807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.409+0000 7fd749600640 1 -- 172.21.15.121:0/4007876246 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7fd73c09a320 con 0x7fd74c070190 2024-09-17T03:40:51.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.410+0000 7fd743e00640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd728078b90 0x7fd72807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.410+0000 7fd743e00640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd728078b90 0x7fd72807b0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd734033000 tx=0x7fd734004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:51.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.413+0000 7fd749600640 1 -- 172.21.15.121:0/4007876246 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd73c061f60 con 0x7fd74c070190 2024-09-17T03:40:51.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.636+0000 7fd752200640 1 -- 172.21.15.121:0/4007876246 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd74c0d0f60 con 0x7fd74c070190 2024-09-17T03:40:51.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.637+0000 7fd749600640 1 -- 172.21.15.121:0/4007876246 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) ==== 53+0+73 (secure 0 0 0) 0x7fd73c066990 con 0x7fd74c070190 2024-09-17T03:40:51.637 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.639+0000 7fd752200640 1 -- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd728078b90 msgr2=0x7fd72807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.639+0000 7fd752200640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd728078b90 0x7fd72807b0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd734033000 tx=0x7fd734004730 comp rx=0 tx=0).stop 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.639+0000 7fd752200640 1 -- 172.21.15.121:0/4007876246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c070190 msgr2=0x7fd74c153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.639+0000 7fd752200640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c070190 0x7fd74c153790 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00c3a0 tx=0x7fd73c00c860 comp rx=0 tx=0).stop 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.640+0000 7fd752200640 1 -- 172.21.15.121:0/4007876246 shutdown_connections 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.640+0000 7fd752200640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd74c0ceee0 0x7fd74c0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.640+0000 7fd752200640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd74c0cac00 0x7fd74c15cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.640+0000 7fd752200640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fd728078b90 0x7fd72807b0a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.640+0000 7fd752200640 1 --2- 172.21.15.121:0/4007876246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74c070190 0x7fd74c153790 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.640+0000 7fd752200640 1 -- 172.21.15.121:0/4007876246 >> 172.21.15.121:0/4007876246 conn(0x7fd74c06d4a0 msgr2=0x7fd74c15c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.640+0000 7fd752200640 1 -- 172.21.15.121:0/4007876246 shutdown_connections 2024-09-17T03:40:51.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:51.640+0000 7fd752200640 1 -- 172.21.15.121:0/4007876246 wait complete. 2024-09-17T03:40:51.661 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:40:51.661 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:40:51.661 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-17T03:40:51.661 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:40:51.661 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:51.661 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:40:51.661 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:40:51.662 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:40:51.662 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:40:51.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:51.662 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-17T03:40:51.703 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:40:51.703 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:40:51.703 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:40:51.703 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:51.703 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-17T03:40:51.703 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:51.703 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42402sec preferred_lft 42402sec 2024-09-17T03:40:51.704 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::80c9:d6ff:fe9f:5926/64 scope link 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether d6:cd:10:b7:d6:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::d4cd:10ff:feb7:d68f/64 scope link 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether fe:db:9e:03:5a:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:40:51.705 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::fcdb:9eff:fe03:5a3e/64 scope link 2024-09-17T03:40:51.706 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:51.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:51.706 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:40:51.800 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-17T03:40:51.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:51.804 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-17T03:40:51.841 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-17T03:40:51.841 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:40:51.841 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:40:51.841 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:40:51.841 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:40:51.841 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:40:51.841 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-17T03:40:51.841 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:40:51.842 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:40:51.842 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:40:51.842 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-17T03:40:51.908 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:40:51.912 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:40:51.960 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:40:52.029 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:52.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:52.038 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:40:52.115 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:40:52.115 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:40:52.116 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:40:52.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:52.116 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-17T03:40:52.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:52.211 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:52.246 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:40:52.247 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:52.247 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:52.322 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:40:52.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:52.322 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:52.515 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:52.516 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:40:52.516 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:40:52.536 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:52.536 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:40:52.536 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:40:52.536 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:52.536 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:52.567 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:40:52.568 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:40:52.568 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2024-09-17T03:40:52.568 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-17T03:40:52.568 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:52.568 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790" 2024-09-17T03:40:52.568 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.121:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2024-09-17T03:40:52.568 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f24b1682-8755-41b1-8124-cbd8f88939a2" will pass to kernel 2024-09-17T03:40:52.570 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:40:52.570 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:40:52.570 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:40:52.570 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:40:52.570 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:40:52.573 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:40:52.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:52.573 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:40:52.628 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:40:52.710 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:52.713 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-17T03:40:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:52.721 INFO:teuthology.orchestra.run.smithi176.stdout:client7003 2024-09-17T03:40:52.721 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:40:52.721 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:52.756 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T03:40:53.006 INFO:teuthology.orchestra.run.smithi121.stdout:[{"id":7003,"entity":{"name":{"type":"client","num":7003},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":1269621926}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":0.43299441300000002,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99900699521568037,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7003 v1:192.168.0.1:0/1269621926","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi176","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}},{"id":7392,"entity":{"name":{"type":"client","num":7392},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":111148936}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.052973513,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99527475464163273,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7392 v1:192.168.0.1:0/111148936","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000037fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi121","kernel_version":"6.11.0-rc5-g2ca44a2f35ca","root":"/"}}] 2024-09-17T03:40:53.006 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "1", "hostname": "smithi176", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 1269621926, "type": "v1" }, "name": { "num": 7003, "type": "client" } }, "id": 7003, "inst": "client.7003 v1:192.168.0.1:0/1269621926", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9990069952156804 }, "state": "open", "uptime": 0.432994413 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "entity_id": "0", "hostname": "smithi121", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 111148936, "type": "v1" }, "name": { "num": 7392, "type": "client" } }, "id": 7392, "inst": "client.7392 v1:192.168.0.1:0/111148936", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9952747546416327 }, "state": "open", "uptime": 2.052973513 } ] 2024-09-17T03:40:53.007 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-17T03:40:53.256 INFO:teuthology.orchestra.run.smithi121.stdout:{"message":"","return_code":0} 2024-09-17T03:40:53.257 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T03:40:53.257 DEBUG:teuthology.orchestra.run.smithi121:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2024-09-17T03:40:53.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.395+0000 7f1c91fcd280 1 -- start start 2024-09-17T03:40:53.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.395+0000 7f1c91fcd280 1 Processor -- start 2024-09-17T03:40:53.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.396+0000 7f1c91fcd280 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078d531a80 0x56078e16c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.396+0000 7f1c91fcd280 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078d531180 0x56078e16c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.396+0000 7f1c91fcd280 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270000 0x56078e16cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.396+0000 7f1c91fcd280 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56078e17a180 con 0x56078d531180 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.396+0000 7f1c91fcd280 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56078e17a300 con 0x56078d531a80 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.396+0000 7f1c91fcd280 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56078e17a480 con 0x56078e270000 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.396+0000 7f1c8f600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078d531180 0x56078e16c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.396+0000 7f1c8f600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078d531180 0x56078e16c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38222/0 (socket says 172.21.15.121:38222) 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.396+0000 7f1c8f600640 1 -- 172.21.15.121:0/3064021939 learned_addr learned my addr 172.21.15.121:0/3064021939 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c90000640 1 --2- 172.21.15.121:0/3064021939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078d531a80 0x56078e16c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c90a00640 1 --2- 172.21.15.121:0/3064021939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270000 0x56078e16cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c8f600640 1 -- 172.21.15.121:0/3064021939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270000 msgr2=0x56078e16cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:53.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c8f600640 1 --2- 172.21.15.121:0/3064021939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270000 0x56078e16cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c8f600640 1 -- 172.21.15.121:0/3064021939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078d531a80 msgr2=0x56078e16c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:53.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c8f600640 1 --2- 172.21.15.121:0/3064021939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078d531a80 0x56078e16c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c8f600640 1 -- 172.21.15.121:0/3064021939 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607893a6780 con 0x56078d531180 2024-09-17T03:40:53.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c8f600640 1 --2- 172.21.15.121:0/3064021939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078d531180 0x56078e16c580 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x56078e1d18c0 tx=0x56078d49aa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a8ae5e53fe83c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:53.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c8ce00640 1 -- 172.21.15.121:0/3064021939 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560789394ea0 con 0x56078d531180 2024-09-17T03:40:53.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c8ce00640 1 -- 172.21.15.121:0/3064021939 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56078939a380 con 0x56078d531180 2024-09-17T03:40:53.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c91fcd280 1 -- 172.21.15.121:0/3064021939 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607893a63c0 con 0x56078d531180 2024-09-17T03:40:53.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c91fcd280 1 -- 172.21.15.121:0/3064021939 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5607893a7680 con 0x56078d531180 2024-09-17T03:40:53.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.397+0000 7f1c91fcd280 4 waiting for MDS map... 2024-09-17T03:40:53.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.398+0000 7f1c8ce00640 1 -- 172.21.15.121:0/3064021939 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560789395380 con 0x56078d531180 2024-09-17T03:40:53.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.398+0000 7f1c8ce00640 1 -- 172.21.15.121:0/3064021939 <== mon.0 v2:172.21.15.121:3300/0 4 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x56078e28c600 con 0x56078d531180 2024-09-17T03:40:53.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.398+0000 7f1c8ce00640 1 -- 172.21.15.121:0/3064021939 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 85) ==== 3502+0+0 (secure 0 0 0) 0x56078d3f9180 con 0x56078d531180 2024-09-17T03:40:53.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.398+0000 7f1c91fcd280 4 Got MDS map 85 2024-09-17T03:40:53.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.398+0000 7f1c91fcd280 10 main: main 2024-09-17T03:40:53.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.398+0000 7f1c91fcd280 4 main: connecting to RADOS... 2024-09-17T03:40:53.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.399+0000 7f1c91fcd280 1 Processor -- start 2024-09-17T03:40:53.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.399+0000 7f1c91fcd280 1 -- start start 2024-09-17T03:40:53.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c91fcd280 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078e270900 0x56078e16d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c91fcd280 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270d80 0x56078e16d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c91fcd280 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c91fcd280 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56078e17a600 con 0x56078e271200 2024-09-17T03:40:53.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c91fcd280 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56078e17a780 con 0x56078e270900 2024-09-17T03:40:53.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c91fcd280 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56078e17a900 con 0x56078e270d80 2024-09-17T03:40:53.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c8f600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c8f600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38226/0 (socket says 172.21.15.121:38226) 2024-09-17T03:40:53.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c8f600640 1 -- 172.21.15.121:0/2499519536 learned_addr learned my addr 172.21.15.121:0/2499519536 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:53.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c90000640 1 --2- 172.21.15.121:0/2499519536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270d80 0x56078e16d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c90a00640 1 --2- 172.21.15.121:0/2499519536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078e270900 0x56078e16d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c8f600640 1 -- 172.21.15.121:0/2499519536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270d80 msgr2=0x56078e16d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c8f600640 1 --2- 172.21.15.121:0/2499519536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270d80 0x56078e16d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c8f600640 1 -- 172.21.15.121:0/2499519536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078e270900 msgr2=0x56078e16d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c8f600640 1 --2- 172.21.15.121:0/2499519536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078e270900 0x56078e16d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.401+0000 7f1c8f600640 1 -- 172.21.15.121:0/2499519536 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607893a74a0 con 0x56078e271200 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c8f600640 1 --2- 172.21.15.121:0/2499519536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x56078e280d20 tx=0x56078d49c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e234b5ea5c574f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c8a600640 1 -- 172.21.15.121:0/2499519536 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5607893951e0 con 0x56078e271200 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c8a600640 1 -- 172.21.15.121:0/2499519536 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56078939b180 con 0x56078e271200 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c8a600640 1 -- 172.21.15.121:0/2499519536 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560789394ea0 con 0x56078e271200 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2499519536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 msgr2=0x56078e16db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/2499519536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x56078e280d20 tx=0x56078d49c9c0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2499519536 shutdown_connections 2024-09-17T03:40:53.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/2499519536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/2499519536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270d80 0x56078e16d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/2499519536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078e270900 0x56078e16d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.402+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2499519536 >> 172.21.15.121:0/2499519536 conn(0x56078e270480 msgr2=0x56078d489800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:53.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.403+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2499519536 shutdown_connections 2024-09-17T03:40:53.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.403+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2499519536 wait complete. 2024-09-17T03:40:53.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.403+0000 7f1c91fcd280 1 Processor -- start 2024-09-17T03:40:53.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.404+0000 7f1c91fcd280 1 -- start start 2024-09-17T03:40:53.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c91fcd280 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078e270900 0x56078e16d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c91fcd280 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270d80 0x56078e16d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c91fcd280 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c91fcd280 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56078e17bc80 con 0x56078e271200 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c91fcd280 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56078e17aa80 con 0x56078e270900 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c91fcd280 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56078e17bb00 con 0x56078e270d80 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c8f600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c8f600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38236/0 (socket says 172.21.15.121:38236) 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c8f600640 1 -- 172.21.15.121:0/2278391009 learned_addr learned my addr 172.21.15.121:0/2278391009 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c90000640 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270d80 0x56078e16d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c8f600640 1 -- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270d80 msgr2=0x56078e16d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c8f600640 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270d80 0x56078e16d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c8f600640 1 -- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078e270900 msgr2=0x56078e16d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c8f600640 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078e270900 0x56078e16d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.405+0000 7f1c8f600640 1 -- 172.21.15.121:0/2278391009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607893a6780 con 0x56078e271200 2024-09-17T03:40:53.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.406+0000 7f1c8f600640 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x56078e280f90 tx=0x56078e2a8cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:53.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.406+0000 7f1c88800640 1 -- 172.21.15.121:0/2278391009 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560789395380 con 0x56078e271200 2024-09-17T03:40:53.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.406+0000 7f1c88800640 1 -- 172.21.15.121:0/2278391009 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56078939b180 con 0x56078e271200 2024-09-17T03:40:53.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.406+0000 7f1c88800640 1 -- 172.21.15.121:0/2278391009 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560789395040 con 0x56078e271200 2024-09-17T03:40:53.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.406+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607893a63c0 con 0x56078e271200 2024-09-17T03:40:53.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.406+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607893a7680 con 0x56078e271200 2024-09-17T03:40:53.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.406+0000 7f1c91fcd280 4 main: resolving pool 17 2024-09-17T03:40:53.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.408+0000 7f1c88800640 1 -- 172.21.15.121:0/2278391009 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x56078e282c00 con 0x56078e271200 2024-09-17T03:40:53.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.408+0000 7f1c88800640 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x56078e273a80 0x56078e16e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.408+0000 7f1c88800640 1 -- 172.21.15.121:0/2278391009 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x56078e1a8600 con 0x56078e271200 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.409+0000 7f1c91fcd280 4 main: creating IoCtx.. 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.409+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x56078e271680 0x56078e16e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.409+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 --> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] -- osd_op(unknown.0.0:1 17.b 17:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) -- 0x56078d7b0000 con 0x56078e271680 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.409+0000 7f1c90a00640 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x56078e273a80 0x56078e16e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.409+0000 7f1c90000640 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x56078e271680 0x56078e16e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.409+0000 7f1c90a00640 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x56078e273a80 0x56078e16e100 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x56078d48a3c0 tx=0x56078d7723c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.410+0000 7f1c90000640 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x56078e271680 0x56078e16e680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.410+0000 7f1c90000640 1 -- 172.21.15.121:0/2278391009 <== osd.6 v2:172.21.15.176:6810/1810611479 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv5 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x56078d458000 con 0x56078e271680 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.410+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 --> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] -- osd_op(unknown.0.0:2 17.b 17:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) -- 0x56078d7b0400 con 0x56078e271680 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.411+0000 7f1c90000640 1 -- 172.21.15.121:0/2278391009 <== osd.6 v2:172.21.15.176:6810/1810611479 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=477b] v0'0 uv5 ondisk = 0) ==== 159+0+477 (crc 0 0 0) 0x56078d458000 con 0x56078e271680 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.411+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 --> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] -- osd_op(unknown.0.0:3 17.b 17:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) -- 0x56078d7b0000 con 0x56078e271680 2024-09-17T03:40:53.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.411+0000 7f1c90000640 1 -- 172.21.15.121:0/2278391009 <== osd.6 v2:172.21.15.176:6810/1810611479 3 ==== osd_op_reply(3 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x56078d458000 con 0x56078e271680 2024-09-17T03:40:53.415 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:40:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "0": { 2024-09-17T03:40:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "data": { 2024-09-17T03:40:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-17T03:40:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:53.415 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 7392, 2024-09-17T03:40:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": { 2024-09-17T03:40:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-17T03:40:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-17T03:40:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 7392 2024-09-17T03:40:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.416 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 111148936 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open", 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "num_leases": 0, 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 0, 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "request_load_avg": 0, 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 0, 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "requests_in_flight": 0, 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "num_completed_requests": 0, 2024-09-17T03:40:53.417 INFO:teuthology.orchestra.run.smithi121.stdout: "num_completed_flushes": 0, 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "reconnecting": false, 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "recall_caps": { 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 60 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "release_caps": { 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 60 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "recall_caps_throttle": { 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 1.5 2024-09-17T03:40:53.418 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "recall_caps_throttle2o": { 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 0.5 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "session_cache_liveness": { 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 300 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition": { 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 30 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "last_trim_completed_requests_tid": 0, 2024-09-17T03:40:53.419 INFO:teuthology.orchestra.run.smithi121.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: "delegated_inos": [], 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": "client.7392 v1:192.168.0.1:0/111148936", 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: "completed_requests": [], 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: "prealloc_inos": [], 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: "client_metadata": { 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: "client_features": { 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: "feature_bits": "0x000000000037fbff" 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: "metric_spec": { 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: "metric_flags": { 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: "feature_bits": "0x000000000080ffff" 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:53.420 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "0", 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 7003, 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": { 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 7003 2024-09-17T03:40:53.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1269621926 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open", 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "num_leases": 0, 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 0, 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "request_load_avg": 0, 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 0, 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "requests_in_flight": 0, 2024-09-17T03:40:53.422 INFO:teuthology.orchestra.run.smithi121.stdout: "num_completed_requests": 0, 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "num_completed_flushes": 0, 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "reconnecting": false, 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "recall_caps": { 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 60 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "release_caps": { 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 60 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "recall_caps_throttle": { 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 1.5 2024-09-17T03:40:53.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: "recall_caps_throttle2o": { 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 0.5 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: "session_cache_liveness": { 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 300 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition": { 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: "value": 0, 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: "halflife": 30 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.424 INFO:teuthology.orchestra.run.smithi121.stdout: "last_trim_completed_requests_tid": 0, 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "last_trim_completed_flushes_tid": 0, 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "delegated_inos": [], 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": "client.7003 v1:192.168.0.1:0/1269621926", 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "completed_requests": [], 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "prealloc_inos": [], 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "client_metadata": { 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "client_features": { 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "feature_bits": "0x000000000037fbff" 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "metric_spec": { 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "metric_flags": { 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: "feature_bits": "0x000000000080ffff" 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:53.425 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.426 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "1", 2024-09-17T03:40:53.426 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi176", 2024-09-17T03:40:53.426 INFO:teuthology.orchestra.run.smithi121.stdout: "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", 2024-09-17T03:40:53.426 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-17T03:40:53.426 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:53.426 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:53.426 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-17T03:40:53.426 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:40:53.426 INFO:teuthology.orchestra.run.smithi121.stdout: "result": 0 2024-09-17T03:40:53.427 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:40:53.427 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:40:53.427 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:53.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x56078e271680 msgr2=0x56078e16e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x56078e271680 0x56078e16e680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x56078e273a80 msgr2=0x56078e16e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x56078e273a80 0x56078e16e100 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x56078d48a3c0 tx=0x56078d7723c0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 msgr2=0x56078e16db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/2278391009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078e271200 0x56078e16db80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x56078e280f90 tx=0x56078e2a8cc0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c90000640 1 -- 172.21.15.121:0/2278391009 reap_dead start 2024-09-17T03:40:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 shutdown_connections 2024-09-17T03:40:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 >> 172.21.15.121:0/2278391009 conn(0x56078e270480 msgr2=0x56078d489800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 shutdown_connections 2024-09-17T03:40:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/2278391009 wait complete. 2024-09-17T03:40:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/3064021939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078d531180 msgr2=0x56078e16c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/3064021939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078d531180 0x56078e16c580 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x56078e1d18c0 tx=0x56078d49aa20 comp rx=0 tx=0).stop 2024-09-17T03:40:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/3064021939 shutdown_connections 2024-09-17T03:40:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/3064021939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56078e270000 0x56078e16cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/3064021939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56078d531180 0x56078e16c580 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 --2- 172.21.15.121:0/3064021939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56078d531a80 0x56078e16c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/3064021939 >> 172.21.15.121:0/3064021939 conn(0x56078d531600 msgr2=0x56078d489000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:53.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/3064021939 shutdown_connections 2024-09-17T03:40:53.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.412+0000 7f1c91fcd280 1 -- 172.21.15.121:0/3064021939 wait complete. 2024-09-17T03:40:53.431 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.174340, result: { "0": { "data": { "sessions": [ { "id": 7392, "entity": { "name": { "type": "client", "num": 7392 }, "addr": { "type": "v1", "addr": "192.168.0.1:0", "nonce": 111148936 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7392 v1:192.168.0.1:0/111148936", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi121", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "root": "/" } }, { "id": 7003, "entity": { "name": { "type": "client", "num": 7003 }, "addr": { "type": "v1", "addr": "192.168.0.1:0", "nonce": 1269621926 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7003 v1:192.168.0.1:0/1269621926", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "1", "hostname": "smithi176", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "root": "/" } } ] }, "result": 0 } } 2024-09-17T03:40:53.432 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [ { "id": 7392, "entity": { "name": { "type": "client", "num": 7392 }, "addr": { "type": "v1", "addr": "192.168.0.1:0", "nonce": 111148936 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7392 v1:192.168.0.1:0/111148936", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "0", "hostname": "smithi121", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "root": "/" } }, { "id": 7003, "entity": { "name": { "type": "client", "num": 7003 }, "addr": { "type": "v1", "addr": "192.168.0.1:0", "nonce": 1269621926 } }, "state": "open", "num_leases": 0, "num_caps": 0, "request_load_avg": 0, "uptime": 0, "requests_in_flight": 0, "num_completed_requests": 0, "num_completed_flushes": 0, "reconnecting": false, "recall_caps": { "value": 0, "halflife": 60 }, "release_caps": { "value": 0, "halflife": 60 }, "recall_caps_throttle": { "value": 0, "halflife": 1.5 }, "recall_caps_throttle2o": { "value": 0, "halflife": 0.5 }, "session_cache_liveness": { "value": 0, "halflife": 300 }, "cap_acquisition": { "value": 0, "halflife": 30 }, "last_trim_completed_requests_tid": 0, "last_trim_completed_flushes_tid": 0, "delegated_inos": [], "inst": "client.7003 v1:192.168.0.1:0/1269621926", "completed_requests": [], "prealloc_inos": [], "client_metadata": { "client_features": { "feature_bits": "0x000000000037fbff" }, "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "entity_id": "1", "hostname": "smithi176", "kernel_version": "6.11.0-rc5-g2ca44a2f35ca", "root": "/" } } ] }, "result": 0 } } 2024-09-17T03:40:53.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:53.432 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir bravo) 2024-09-17T03:40:53.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:53.473 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch bravo/file_a) 2024-09-17T03:40:53.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:53.550 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec touch bravo/file_b) 2024-09-17T03:40:53.594 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-09-17T03:40:53.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.819+0000 7fee9ec00640 1 -- 172.21.15.121:0/962343514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee98160730 msgr2=0x7fee98160b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.819+0000 7fee9ec00640 1 --2- 172.21.15.121:0/962343514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee98160730 0x7fee98160b40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fee90005fd0 tx=0x7fee9002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.819+0000 7fee9ec00640 1 -- 172.21.15.121:0/962343514 shutdown_connections 2024-09-17T03:40:53.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.819+0000 7fee9ec00640 1 --2- 172.21.15.121:0/962343514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee98160730 0x7fee98160b40 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.819+0000 7fee9ec00640 1 --2- 172.21.15.121:0/962343514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee98070190 0x7fee980ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.819+0000 7fee9ec00640 1 -- 172.21.15.121:0/962343514 >> 172.21.15.121:0/962343514 conn(0x7fee9806d4a0 msgr2=0x7fee980b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:53.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.819+0000 7fee9ec00640 1 -- 172.21.15.121:0/962343514 shutdown_connections 2024-09-17T03:40:53.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.819+0000 7fee9ec00640 1 -- 172.21.15.121:0/962343514 wait complete. 2024-09-17T03:40:53.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.821+0000 7fee9ec00640 1 Processor -- start 2024-09-17T03:40:53.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.822+0000 7fee9ec00640 1 -- start start 2024-09-17T03:40:53.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.823+0000 7fee9ec00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee98070190 0x7fee98150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.823+0000 7fee9ec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815c420 0x7fee9815f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.823+0000 7fee9ec00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee98160730 0x7fee9815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.823+0000 7fee9ec00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee980ccc00 con 0x7fee98070190 2024-09-17T03:40:53.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.823+0000 7fee9ec00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee980cca80 con 0x7fee98160730 2024-09-17T03:40:53.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.823+0000 7fee9ec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee980ccd80 con 0x7fee9815c420 2024-09-17T03:40:53.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.823+0000 7fee9d800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee98070190 0x7fee98150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.823+0000 7fee9d800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee98070190 0x7fee98150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38258/0 (socket says 172.21.15.121:38258) 2024-09-17T03:40:53.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.823+0000 7fee9d800640 1 -- 172.21.15.121:0/960053674 learned_addr learned my addr 172.21.15.121:0/960053674 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:53.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9ce00640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815c420 0x7fee9815f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9d800640 1 -- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815c420 msgr2=0x7fee9815f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9e200640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee98160730 0x7fee9815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9d800640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815c420 0x7fee9815f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9d800640 1 -- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee98160730 msgr2=0x7fee9815d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9d800640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee98160730 0x7fee9815d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9d800640 1 -- 172.21.15.121:0/960053674 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee980c63a0 con 0x7fee98070190 2024-09-17T03:40:53.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9e200640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee98160730 0x7fee9815d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:53.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9ce00640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815c420 0x7fee9815f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:53.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9d800640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee98070190 0x7fee98150760 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00e7c0 tx=0x7fee8c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:53.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee95600640 1 -- 172.21.15.121:0/960053674 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00ccc0 con 0x7fee98070190 2024-09-17T03:40:53.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee95600640 1 -- 172.21.15.121:0/960053674 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee8c010430 con 0x7fee98070190 2024-09-17T03:40:53.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9ec00640 1 -- 172.21.15.121:0/960053674 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee980c6680 con 0x7fee98070190 2024-09-17T03:40:53.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee95600640 1 -- 172.21.15.121:0/960053674 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c010860 con 0x7fee98070190 2024-09-17T03:40:53.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.824+0000 7fee9ec00640 1 -- 172.21.15.121:0/960053674 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee980c6c40 con 0x7fee98070190 2024-09-17T03:40:53.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.826+0000 7fee9ec00640 1 -- 172.21.15.121:0/960053674 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee980cd230 con 0x7fee98070190 2024-09-17T03:40:53.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.827+0000 7fee95600640 1 -- 172.21.15.121:0/960053674 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee8c010a00 con 0x7fee98070190 2024-09-17T03:40:53.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.828+0000 7fee95600640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee78078bc0 0x7fee7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.828+0000 7fee95600640 1 -- 172.21.15.121:0/960053674 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7fee8c09b9a0 con 0x7fee98070190 2024-09-17T03:40:53.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.829+0000 7fee9ce00640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee78078bc0 0x7fee7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.830+0000 7fee9ce00640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee78078bc0 0x7fee7807b0d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fee9815f520 tx=0x7fee84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:53.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:53.833+0000 7fee95600640 1 -- 172.21.15.121:0/960053674 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fee8c063b90 con 0x7fee98070190 2024-09-17T03:40:54.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.053+0000 7fee9ec00640 1 -- 172.21.15.121:0/960053674 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7fee980d0de0 con 0x7fee98070190 2024-09-17T03:40:54.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.169+0000 7fee95600640 1 -- 172.21.15.121:0/960053674 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v86) ==== 105+0+0 (secure 0 0 0) 0x7fee8c063490 con 0x7fee98070190 2024-09-17T03:40:54.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 -- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee78078bc0 msgr2=0x7fee7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee78078bc0 0x7fee7807b0d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fee9815f520 tx=0x7fee84009040 comp rx=0 tx=0).stop 2024-09-17T03:40:54.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 -- 172.21.15.121:0/960053674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee98070190 msgr2=0x7fee98150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee98070190 0x7fee98150760 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00e7c0 tx=0x7fee8c00ec80 comp rx=0 tx=0).stop 2024-09-17T03:40:54.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 -- 172.21.15.121:0/960053674 shutdown_connections 2024-09-17T03:40:54.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee98160730 0x7fee9815d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee9815c420 0x7fee9815f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fee78078bc0 0x7fee7807b0d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 --2- 172.21.15.121:0/960053674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee98070190 0x7fee98150760 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 -- 172.21.15.121:0/960053674 >> 172.21.15.121:0/960053674 conn(0x7fee9806d4a0 msgr2=0x7fee98073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:54.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 -- 172.21.15.121:0/960053674 shutdown_connections 2024-09-17T03:40:54.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.172+0000 7fee9ec00640 1 -- 172.21.15.121:0/960053674 wait complete. 2024-09-17T03:40:54.196 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.418+0000 7f8477200640 1 -- 172.21.15.121:0/1618791134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f845c004800 msgr2=0x7f845c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.418+0000 7f8477200640 1 --2- 172.21.15.121:0/1618791134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f845c004800 0x7f845c004c10 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f84780afbe0 tx=0x7f845c005830 comp rx=0 tx=0).stop 2024-09-17T03:40:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.418+0000 7f8477200640 1 -- 172.21.15.121:0/1618791134 shutdown_connections 2024-09-17T03:40:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.418+0000 7f8477200640 1 --2- 172.21.15.121:0/1618791134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f845c004800 0x7f845c004c10 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.418+0000 7f8477200640 1 -- 172.21.15.121:0/1618791134 >> 172.21.15.121:0/1618791134 conn(0x7f847806d4a0 msgr2=0x7f84780b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.418+0000 7f8477200640 1 -- 172.21.15.121:0/1618791134 shutdown_connections 2024-09-17T03:40:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.418+0000 7f8477200640 1 -- 172.21.15.121:0/1618791134 wait complete. 2024-09-17T03:40:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.420+0000 7f8477200640 1 Processor -- start 2024-09-17T03:40:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.420+0000 7f8477200640 1 -- start start 2024-09-17T03:40:54.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.421+0000 7f8477200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f845c004800 0x7f84781f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:54.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.421+0000 7f8477200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f847815faa0 0x7f847814a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:54.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8477200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84780b1390 0x7f84780b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:54.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8477200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8478160b40 con 0x7f84780b1390 2024-09-17T03:40:54.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8477200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84780cf1a0 con 0x7f847815faa0 2024-09-17T03:40:54.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8477200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8478160cc0 con 0x7f845c004800 2024-09-17T03:40:54.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8476800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84780b1390 0x7f84780b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:54.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8476800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84780b1390 0x7f84780b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38278/0 (socket says 172.21.15.121:38278) 2024-09-17T03:40:54.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8476800640 1 -- 172.21.15.121:0/2326360344 learned_addr learned my addr 172.21.15.121:0/2326360344 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:54.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8475e00640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f845c004800 0x7f84781f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:54.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f846d400640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f847815faa0 0x7f847814a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:54.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8476800640 1 -- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f845c004800 msgr2=0x7f84781f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8476800640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f845c004800 0x7f84781f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8476800640 1 -- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f847815faa0 msgr2=0x7f847814a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8476800640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f847815faa0 0x7f847814a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f8476800640 1 -- 172.21.15.121:0/2326360344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84780b1ce0 con 0x7f84780b1390 2024-09-17T03:40:54.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.422+0000 7f846d400640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f847815faa0 0x7f847814a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:54.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.423+0000 7f8476800640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84780b1390 0x7f84780b17a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f84780ce4d0 tx=0x7f8470001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:54.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.423+0000 7f846ea00640 1 -- 172.21.15.121:0/2326360344 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84700107d0 con 0x7f84780b1390 2024-09-17T03:40:54.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.423+0000 7f846ea00640 1 -- 172.21.15.121:0/2326360344 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8470016070 con 0x7f84780b1390 2024-09-17T03:40:54.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.423+0000 7f846ea00640 1 -- 172.21.15.121:0/2326360344 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8470010ce0 con 0x7f84780b1390 2024-09-17T03:40:54.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.423+0000 7f8477200640 1 -- 172.21.15.121:0/2326360344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847814ab20 con 0x7f84780b1390 2024-09-17T03:40:54.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.423+0000 7f8477200640 1 -- 172.21.15.121:0/2326360344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84780c9bd0 con 0x7f84780b1390 2024-09-17T03:40:54.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.424+0000 7f8477200640 1 -- 172.21.15.121:0/2326360344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f847815feb0 con 0x7f84780b1390 2024-09-17T03:40:54.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.425+0000 7f846ea00640 1 -- 172.21.15.121:0/2326360344 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f847001b460 con 0x7f84780b1390 2024-09-17T03:40:54.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.426+0000 7f846ea00640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8454078bc0 0x7f845407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:54.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.426+0000 7f846ea00640 1 -- 172.21.15.121:0/2326360344 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f847009b8a0 con 0x7f84780b1390 2024-09-17T03:40:54.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.427+0000 7f8475e00640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8454078bc0 0x7f845407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:54.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.428+0000 7f8475e00640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8454078bc0 0x7f845407b0d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8468005eb0 tx=0x7f8468005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:54.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.431+0000 7f846ea00640 1 -- 172.21.15.121:0/2326360344 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84780b1ce0 con 0x7f84780b1390 2024-09-17T03:40:54.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.651+0000 7f8477200640 1 -- 172.21.15.121:0/2326360344 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84780c99c0 con 0x7f84780b1390 2024-09-17T03:40:54.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.651+0000 7f846ea00640 1 -- 172.21.15.121:0/2326360344 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5252 (secure 0 0 0) 0x7f8470063a00 con 0x7f84780b1390 2024-09-17T03:40:54.651 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:54.652 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":86,"btime":"2024-09-17T03:40:54:168615+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2875035597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2875035597},{"type":"v1","addr":"172.21.15.121:6835","nonce":2875035597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2294887057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2294887057},{"type":"v1","addr":"172.21.15.176:6835","nonce":2294887057}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:54.168580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7332,"mds_1":6946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6946":{"gid":6946,"name":"b","rank":1,"incarnation":86,"state":"up:creating","state_seq":1,"addr":"172.21.15.176:6837/762503506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":762503506},{"type":"v1","addr":"172.21.15.176:6837","nonce":762503506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7332":{"gid":7332,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6834/1935597076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1935597076},{"type":"v1","addr":"172.21.15.121:6834","nonce":1935597076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7332,"qdb_cluster":[7332]},"id":8}]} 2024-09-17T03:40:54.652 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 86 2024-09-17T03:40:54.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 -- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8454078bc0 msgr2=0x7f845407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8454078bc0 0x7f845407b0d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8468005eb0 tx=0x7f8468005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:54.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 -- 172.21.15.121:0/2326360344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84780b1390 msgr2=0x7f84780b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84780b1390 0x7f84780b17a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f84780ce4d0 tx=0x7f8470001b80 comp rx=0 tx=0).stop 2024-09-17T03:40:54.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 -- 172.21.15.121:0/2326360344 shutdown_connections 2024-09-17T03:40:54.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8454078bc0 0x7f845407b0d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84780b1390 0x7f84780b17a0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f847815faa0 0x7f847814a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 --2- 172.21.15.121:0/2326360344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f845c004800 0x7f84781f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 -- 172.21.15.121:0/2326360344 >> 172.21.15.121:0/2326360344 conn(0x7f847806d4a0 msgr2=0x7f847815b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:54.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 -- 172.21.15.121:0/2326360344 shutdown_connections 2024-09-17T03:40:54.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:54.654+0000 7f8477200640 1 -- 172.21.15.121:0/2326360344 wait complete. 2024-09-17T03:40:55.081 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:40:25.564895+0000', 'modified': '2024-09-17T03:40:54.168580+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7332, 'mds_1': 6946}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6946': {'gid': 6946, 'name': 'b', 'rank': 1, 'incarnation': 86, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.176:6837/762503506', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6836', 'nonce': 762503506}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 762503506}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7332': {'gid': 7332, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.121:6834/1935597076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 1935597076}, {'type': 'v1', 'addr': '172.21.15.121:6834', 'nonce': 1935597076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7332, 'qdb_cluster': [7332]} 2024-09-17T03:40:55.081 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6946:up:creating 2024-09-17T03:40:55.522 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-17T03:40:55.522+0000 7f9c7d800640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-17T03:40:56.082 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:56.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.311+0000 7f3ad6800640 1 -- 172.21.15.121:0/620892151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ad00af6d0 msgr2=0x7f3ad00b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.311+0000 7f3ad6800640 1 --2- 172.21.15.121:0/620892151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ad00af6d0 0x7f3ad00b41b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3ad015e000 tx=0x7f3ac802aac0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.311+0000 7f3ad6800640 1 -- 172.21.15.121:0/620892151 shutdown_connections 2024-09-17T03:40:56.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.311+0000 7f3ad6800640 1 --2- 172.21.15.121:0/620892151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ad00af6d0 0x7f3ad00b41b0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.311+0000 7f3ad6800640 1 --2- 172.21.15.121:0/620892151 >> v2:172.21.15.176:3300/0 conn(0x7f3ad00cd3e0 0x7f3ad00cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.311+0000 7f3ad6800640 1 -- 172.21.15.121:0/620892151 >> 172.21.15.121:0/620892151 conn(0x7f3ad006d4c0 msgr2=0x7f3ad00d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:56.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.311+0000 7f3ad6800640 1 -- 172.21.15.121:0/620892151 shutdown_connections 2024-09-17T03:40:56.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.311+0000 7f3ad6800640 1 -- 172.21.15.121:0/620892151 wait complete. 2024-09-17T03:40:56.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.313+0000 7f3ad6800640 1 Processor -- start 2024-09-17T03:40:56.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.313+0000 7f3ad6800640 1 -- start start 2024-09-17T03:40:56.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ad6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ad00af6d0 0x7f3ad0098c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ad6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ad015dbf0 0x7f3ad0158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ad6800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ad015a300 0x7f3ad0159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ad6800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00b4e90 con 0x7f3ad015dbf0 2024-09-17T03:40:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ad6800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00b4d10 con 0x7f3ad00af6d0 2024-09-17T03:40:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ad6800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad00b5010 con 0x7f3ad015a300 2024-09-17T03:40:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ac6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ad015dbf0 0x7f3ad0158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ac6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ad015dbf0 0x7f3ad0158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38304/0 (socket says 172.21.15.121:38304) 2024-09-17T03:40:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ac6a00640 1 -- 172.21.15.121:0/2204812038 learned_addr learned my addr 172.21.15.121:0/2204812038 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3acf400640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ad00af6d0 0x7f3ad0098c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3acfe00640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ad015a300 0x7f3ad0159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ac6a00640 1 -- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ad015a300 msgr2=0x7f3ad0159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ac6a00640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ad015a300 0x7f3ad0159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ac6a00640 1 -- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ad00af6d0 msgr2=0x7f3ad0098c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ac6a00640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ad00af6d0 0x7f3ad0098c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.315+0000 7f3ac6a00640 1 -- 172.21.15.121:0/2204812038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad0153cf0 con 0x7f3ad015dbf0 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.316+0000 7f3ac6a00640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ad015dbf0 0x7f3ad0158b20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800d770 tx=0x7f3ab800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.316+0000 7f3ac7e00640 1 -- 172.21.15.121:0/2204812038 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8017070 con 0x7f3ad015dbf0 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.316+0000 7f3ac7e00640 1 -- 172.21.15.121:0/2204812038 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ab8009cc0 con 0x7f3ad015dbf0 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.316+0000 7f3ad6800640 1 -- 172.21.15.121:0/2204812038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad01559b0 con 0x7f3ad015dbf0 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.316+0000 7f3ac7e00640 1 -- 172.21.15.121:0/2204812038 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab80106c0 con 0x7f3ad015dbf0 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.316+0000 7f3ad6800640 1 -- 172.21.15.121:0/2204812038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad0155f70 con 0x7f3ad015dbf0 2024-09-17T03:40:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.317+0000 7f3ad6800640 1 -- 172.21.15.121:0/2204812038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad00b41b0 con 0x7f3ad015dbf0 2024-09-17T03:40:56.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.318+0000 7f3ac7e00640 1 -- 172.21.15.121:0/2204812038 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ab801a070 con 0x7f3ad015dbf0 2024-09-17T03:40:56.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.319+0000 7f3ac7e00640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3aac078b90 0x7f3aac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.319+0000 7f3ac7e00640 1 -- 172.21.15.121:0/2204812038 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f3ab809aff0 con 0x7f3ad015dbf0 2024-09-17T03:40:56.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.320+0000 7f3acf400640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3aac078b90 0x7f3aac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:56.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.321+0000 7f3acf400640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3aac078b90 0x7f3aac07b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00709c0 tx=0x7f3ac0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:56.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.324+0000 7f3ac7e00640 1 -- 172.21.15.121:0/2204812038 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ab8062bf0 con 0x7f3ad015dbf0 2024-09-17T03:40:56.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.541+0000 7f3ad6800640 1 -- 172.21.15.121:0/2204812038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ad00d0ee0 con 0x7f3ad015dbf0 2024-09-17T03:40:56.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.541+0000 7f3ac7e00640 1 -- 172.21.15.121:0/2204812038 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5255 (secure 0 0 0) 0x7f3ab8067620 con 0x7f3ad015dbf0 2024-09-17T03:40:56.541 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:40:56.541 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":87,"btime":"2024-09-17T03:40:55:170561+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2875035597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2875035597},{"type":"v1","addr":"172.21.15.121:6835","nonce":2875035597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2294887057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2294887057},{"type":"v1","addr":"172.21.15.176:6835","nonce":2294887057}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:55.170545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7332,"mds_1":6946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6946":{"gid":6946,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/762503506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":762503506},{"type":"v1","addr":"172.21.15.176:6837","nonce":762503506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7332":{"gid":7332,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6834/1935597076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1935597076},{"type":"v1","addr":"172.21.15.121:6834","nonce":1935597076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7332,"qdb_cluster":[6946,7332]},"id":8}]} 2024-09-17T03:40:56.542 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 87 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 -- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3aac078b90 msgr2=0x7f3aac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3aac078b90 0x7f3aac07b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00709c0 tx=0x7f3ac0009040 comp rx=0 tx=0).stop 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 -- 172.21.15.121:0/2204812038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ad015dbf0 msgr2=0x7f3ad0158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ad015dbf0 0x7f3ad0158b20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800d770 tx=0x7f3ab800dc30 comp rx=0 tx=0).stop 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 -- 172.21.15.121:0/2204812038 shutdown_connections 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ad015a300 0x7f3ad0159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3aac078b90 0x7f3aac07b0a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ad015dbf0 0x7f3ad0158b20 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 --2- 172.21.15.121:0/2204812038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ad00af6d0 0x7f3ad0098c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 -- 172.21.15.121:0/2204812038 >> 172.21.15.121:0/2204812038 conn(0x7f3ad006d4c0 msgr2=0x7f3ad015b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 -- 172.21.15.121:0/2204812038 shutdown_connections 2024-09-17T03:40:56.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:56.544+0000 7f3ad6800640 1 -- 172.21.15.121:0/2204812038 wait complete. 2024-09-17T03:40:56.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:40:25.564895+0000', 'modified': '2024-09-17T03:40:55.170545+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7332, 'mds_1': 6946}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6946': {'gid': 6946, 'name': 'b', 'rank': 1, 'incarnation': 86, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.176:6837/762503506', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6836', 'nonce': 762503506}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 762503506}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7332': {'gid': 7332, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.121:6834/1935597076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 1935597076}, {'type': 'v1', 'addr': '172.21.15.121:6834', 'nonce': 1935597076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7332, 'qdb_cluster': [6946, 7332]} 2024-09-17T03:40:56.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-09-17T03:40:56.974 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T03:40:57.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.197+0000 7f265c000640 1 -- 172.21.15.121:0/954883891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f263c005150 msgr2=0x7f263c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.197+0000 7f265c000640 1 --2- 172.21.15.121:0/954883891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f263c005150 0x7f263c00b9c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f26540d0c10 tx=0x7f263c005830 comp rx=0 tx=0).stop 2024-09-17T03:40:57.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.197+0000 7f265a000640 1 -- 172.21.15.121:0/954883891 reap_dead start 2024-09-17T03:40:57.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.197+0000 7f265c000640 1 -- 172.21.15.121:0/954883891 shutdown_connections 2024-09-17T03:40:57.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.197+0000 7f265c000640 1 -- 172.21.15.121:0/954883891 >> 172.21.15.121:0/954883891 conn(0x7f265406d4c0 msgr2=0x7f26540d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.197+0000 7f265c000640 1 -- 172.21.15.121:0/954883891 shutdown_connections 2024-09-17T03:40:57.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.197+0000 7f265c000640 1 -- 172.21.15.121:0/954883891 wait complete. 2024-09-17T03:40:57.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.200+0000 7f265c000640 1 Processor -- start 2024-09-17T03:40:57.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.200+0000 7f265c000640 1 -- start start 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.201+0000 7f265c000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f263c005150 0x7f26541ea450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.201+0000 7f265c000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26541f6df0 0x7f2654153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.201+0000 7f265c000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2654155f00 0x7f26540b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.201+0000 7f265c000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f26540b4a80 con 0x7f2654155f00 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.201+0000 7f265c000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f26540b4900 con 0x7f26541f6df0 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.201+0000 7f265c000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f26540b4c00 con 0x7f263c005150 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.201+0000 7f265a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2654155f00 0x7f26540b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.201+0000 7f265a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2654155f00 0x7f26540b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38322/0 (socket says 172.21.15.121:38322) 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.201+0000 7f265a000640 1 -- 172.21.15.121:0/2877360474 learned_addr learned my addr 172.21.15.121:0/2877360474 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.202+0000 7f2658c00640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26541f6df0 0x7f2654153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.202+0000 7f2659600640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f263c005150 0x7f26541ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.202+0000 7f265a000640 1 -- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f263c005150 msgr2=0x7f26541ea450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.202+0000 7f265a000640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f263c005150 0x7f26541ea450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.202+0000 7f265a000640 1 -- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26541f6df0 msgr2=0x7f2654153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.202+0000 7f265a000640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26541f6df0 0x7f2654153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.202+0000 7f265a000640 1 -- 172.21.15.121:0/2877360474 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2654154740 con 0x7f2654155f00 2024-09-17T03:40:57.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.202+0000 7f265a000640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2654155f00 0x7f26540b1ad0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f264c00e490 tx=0x7f264c033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.202+0000 7f2651600640 1 -- 172.21.15.121:0/2877360474 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c038070 con 0x7f2654155f00 2024-09-17T03:40:57.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.203+0000 7f265c000640 1 -- 172.21.15.121:0/2877360474 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2654154a20 con 0x7f2654155f00 2024-09-17T03:40:57.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.203+0000 7f2651600640 1 -- 172.21.15.121:0/2877360474 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f264c039040 con 0x7f2654155f00 2024-09-17T03:40:57.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.203+0000 7f2651600640 1 -- 172.21.15.121:0/2877360474 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c009200 con 0x7f2654155f00 2024-09-17T03:40:57.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.203+0000 7f265c000640 1 -- 172.21.15.121:0/2877360474 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26541f5f40 con 0x7f2654155f00 2024-09-17T03:40:57.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.206+0000 7f2651600640 1 -- 172.21.15.121:0/2877360474 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f264c005020 con 0x7f2654155f00 2024-09-17T03:40:57.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.207+0000 7f2651600640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2634078b90 0x7f263407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.207+0000 7f2651600640 1 -- 172.21.15.121:0/2877360474 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f264c0bb860 con 0x7f2654155f00 2024-09-17T03:40:57.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.207+0000 7f2663066740 1 Processor -- start 2024-09-17T03:40:57.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.207+0000 7f2663066740 1 -- start start 2024-09-17T03:40:57.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.207+0000 7f2659600640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2634078b90 0x7f263407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.208+0000 7f2659600640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2634078b90 0x7f263407b0a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2654072aa0 tx=0x7f2648005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f2663066740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e83a3270 0x5643e8773970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f2663066740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e837a3b0 0x5643e8773eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f2663066740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e8743f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f2663066740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5643e86cd430 con 0x5643e8382590 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f2663066740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5643e86bd5d0 con 0x5643e83a3270 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f2663066740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5643e86aca00 con 0x5643e837a3b0 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f265a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e8743f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f265a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e8743f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38334/0 (socket says 172.21.15.121:38334) 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f265a000640 1 -- 172.21.15.121:0/4218528120 learned_addr learned my addr 172.21.15.121:0/4218528120 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f2659600640 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e83a3270 0x5643e8773970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f2658c00640 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e837a3b0 0x5643e8773eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f265a000640 1 -- 172.21.15.121:0/4218528120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e837a3b0 msgr2=0x5643e8773eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f265a000640 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e837a3b0 0x5643e8773eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f265a000640 1 -- 172.21.15.121:0/4218528120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e83a3270 msgr2=0x5643e8773970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f265a000640 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e83a3270 0x5643e8773970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f265a000640 1 -- 172.21.15.121:0/4218528120 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e8675520 con 0x5643e8382590 2024-09-17T03:40:57.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f2659600640 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e83a3270 0x5643e8773970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:57.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.209+0000 7f2658c00640 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e837a3b0 0x5643e8773eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:57.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.210+0000 7f265a000640 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e8743f60 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f264c0833a0 tx=0x7f264c082b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa2e695a116e278 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.210+0000 7f2645c00640 1 -- 172.21.15.121:0/4218528120 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c087e40 con 0x5643e8382590 2024-09-17T03:40:57.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.210+0000 7f2645c00640 1 -- 172.21.15.121:0/4218528120 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f264c08ccf0 con 0x5643e8382590 2024-09-17T03:40:57.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.210+0000 7f2645c00640 1 -- 172.21.15.121:0/4218528120 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c07f680 con 0x5643e8382590 2024-09-17T03:40:57.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.211+0000 7f2663066740 1 -- 172.21.15.121:0/4218528120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 msgr2=0x5643e8743f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.211+0000 7f2663066740 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e8743f60 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f264c0833a0 tx=0x7f264c082b80 comp rx=0 tx=0).stop 2024-09-17T03:40:57.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.211+0000 7f2663066740 1 -- 172.21.15.121:0/4218528120 shutdown_connections 2024-09-17T03:40:57.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.211+0000 7f2663066740 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e8743f60 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.211+0000 7f2663066740 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e837a3b0 0x5643e8773eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.211+0000 7f2663066740 1 --2- 172.21.15.121:0/4218528120 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e83a3270 0x5643e8773970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.211+0000 7f2663066740 1 -- 172.21.15.121:0/4218528120 >> 172.21.15.121:0/4218528120 conn(0x5643e83973c0 msgr2=0x5643e8749970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.211+0000 7f2663066740 1 -- 172.21.15.121:0/4218528120 shutdown_connections 2024-09-17T03:40:57.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.211+0000 7f2663066740 1 -- 172.21.15.121:0/4218528120 wait complete. 2024-09-17T03:40:57.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.212+0000 7f2663066740 1 -- start start 2024-09-17T03:40:57.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.212+0000 7f2663066740 1 Processor -- start 2024-09-17T03:40:57.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2663066740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e837a3b0 0x5643e87a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2663066740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e8382590 0x5643e8788d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2663066740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 0x5643e87a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2663066740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5643e8653330 con 0x5643e837a3b0 2024-09-17T03:40:57.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2663066740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5643e86b0810 con 0x5643e8382590 2024-09-17T03:40:57.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2663066740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5643e841d620 con 0x5643e83a3270 2024-09-17T03:40:57.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2663066740 10 client.0 _ll_register_callbacks cb 0x5643e8658420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:57.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2659600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e837a3b0 0x5643e87a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2659600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e837a3b0 0x5643e87a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38346/0 (socket says 172.21.15.121:38346) 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2659600640 1 -- 172.21.15.121:0/2125470330 learned_addr learned my addr 172.21.15.121:0/2125470330 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f265a000640 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 0x5643e87a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2658c00640 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e8382590 0x5643e8788d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2659600640 1 -- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 msgr2=0x5643e87a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2659600640 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 0x5643e87a10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2659600640 1 -- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e8382590 msgr2=0x5643e8788d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2659600640 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e8382590 0x5643e8788d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.214+0000 7f2659600640 1 -- 172.21.15.121:0/2125470330 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e840e850 con 0x5643e837a3b0 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.215+0000 7f2659600640 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e837a3b0 0x5643e87a0a20 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2648009710 tx=0x7f2648004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def6cbfcbdbce354 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.215+0000 7f263a000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.215+0000 7f263a000640 1 -- 172.21.15.121:0/2125470330 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648009c80 con 0x5643e837a3b0 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.215+0000 7f263a000640 1 -- 172.21.15.121:0/2125470330 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f2648018030 con 0x5643e837a3b0 2024-09-17T03:40:57.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.215+0000 7f2663066740 1 -- 172.21.15.121:0/2125470330 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f264c08ccf0 con 0x5643e837a3b0 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.215+0000 7f263a000640 1 -- 172.21.15.121:0/2125470330 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f2648009e20 con 0x5643e837a3b0 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.215+0000 7f2663066740 10 client.7446 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.215+0000 7f2663066740 1 -- 172.21.15.121:0/2125470330 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5643e84856b0 con 0x5643e837a3b0 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.215+0000 7f263a000640 1 -- 172.21.15.121:0/2125470330 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f264c08ccf0 con 0x5643e837a3b0 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.216+0000 7f263a000640 1 -- 172.21.15.121:0/2125470330 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 87) ==== 3522+0+0 (secure 0 0 0) 0x7f2648031050 con 0x5643e837a3b0 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.216+0000 7f2663066740 10 client.7446 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.216+0000 7f2663066740 10 client.7446 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.216+0000 7f2663066740 20 client.7446 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.216+0000 7f2663066740 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:6836/762503506,v1:172.21.15.176:6837/762503506] conn(0x5643e8361e40 0x5643e879dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.216+0000 7f2663066740 4 client.7446 mds_command: new command op to 6946 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.216+0000 7f2663066740 1 -- 172.21.15.121:0/2125470330 --> [v2:172.21.15.176:6836/762503506,v1:172.21.15.176:6837/762503506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643e86bf520 con 0x5643e8361e40 2024-09-17T03:40:57.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.216+0000 7f2658c00640 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:6836/762503506,v1:172.21.15.176:6837/762503506] conn(0x5643e8361e40 0x5643e879dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.217+0000 7f2658c00640 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:6836/762503506,v1:172.21.15.176:6837/762503506] conn(0x5643e8361e40 0x5643e879dbb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f8f9308d7bfe6b1 server_cookie=61017ad8cc4bf7d4 in_seq=0 out_seq=0 2024-09-17T03:40:57.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.217+0000 7f263a000640 10 client.7446 ms_handle_connect on v2:172.21.15.176:6836/762503506 2024-09-17T03:40:57.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.218+0000 7f263a000640 1 -- 172.21.15.121:0/2125470330 <== mds.1 v2:172.21.15.176:6836/762503506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643e86bf520 con 0x5643e8361e40 2024-09-17T03:40:57.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.218+0000 7f263a000640 10 client.7446 handle_command_reply: tid=0 2024-09-17T03:40:57.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.218+0000 7f2663066740 1 client.7446 shutdown 2024-09-17T03:40:57.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.218+0000 7f2663066740 1 -- 172.21.15.121:0/2125470330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e837a3b0 msgr2=0x5643e87a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.218+0000 7f2663066740 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e837a3b0 0x5643e87a0a20 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2648009710 tx=0x7f2648004730 comp rx=0 tx=0).stop 2024-09-17T03:40:57.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.219+0000 7f2663066740 1 -- 172.21.15.121:0/2125470330 shutdown_connections 2024-09-17T03:40:57.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.219+0000 7f2663066740 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 0x5643e87a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.219+0000 7f2663066740 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e8382590 0x5643e8788d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.219+0000 7f2663066740 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.176:6836/762503506,v1:172.21.15.176:6837/762503506] conn(0x5643e8361e40 0x5643e879dbb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.219+0000 7f2663066740 1 --2- 172.21.15.121:0/2125470330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e837a3b0 0x5643e87a0a20 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.219+0000 7f2663066740 1 -- 172.21.15.121:0/2125470330 >> 172.21.15.121:0/2125470330 conn(0x5643e83973c0 msgr2=0x5643e87908c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.219+0000 7f263a000640 0 client.7446 ms_handle_reset on v2:172.21.15.176:6836/762503506 2024-09-17T03:40:57.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.219+0000 7f2663066740 1 -- 172.21.15.121:0/2125470330 shutdown_connections 2024-09-17T03:40:57.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.219+0000 7f2663066740 1 -- 172.21.15.121:0/2125470330 wait complete. 2024-09-17T03:40:57.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.219+0000 7f2663066740 20 client.7446 trim_cache size 0 max 16384 2024-09-17T03:40:57.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.238+0000 7f2663066740 1 Processor -- start 2024-09-17T03:40:57.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.238+0000 7f2663066740 1 -- start start 2024-09-17T03:40:57.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.239+0000 7f2663066740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 0x5643e8745820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.239+0000 7f2663066740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e8382590 0x5643e876aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.239+0000 7f2663066740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e83a3270 0x5643e876b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.239+0000 7f2663066740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2654202c40 con 0x5643e83a3270 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.239+0000 7f2663066740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f26541f9ca0 con 0x5643e837a3b0 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.239+0000 7f2663066740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2654201650 con 0x5643e8382590 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.239+0000 7f265a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e83a3270 0x5643e876b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.239+0000 7f265a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e83a3270 0x5643e876b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38356/0 (socket says 172.21.15.121:38356) 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f265a000640 1 -- 172.21.15.121:0/2681815456 learned_addr learned my addr 172.21.15.121:0/2681815456 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f2659600640 1 --2- 172.21.15.121:0/2681815456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 0x5643e8745820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f2658c00640 1 --2- 172.21.15.121:0/2681815456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e8382590 0x5643e876aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f265a000640 1 -- 172.21.15.121:0/2681815456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e8382590 msgr2=0x5643e876aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f265a000640 1 --2- 172.21.15.121:0/2681815456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e8382590 0x5643e876aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f265a000640 1 -- 172.21.15.121:0/2681815456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 msgr2=0x5643e8745820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f265a000640 1 --2- 172.21.15.121:0/2681815456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 0x5643e8745820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f265a000640 1 -- 172.21.15.121:0/2681815456 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e876a460 con 0x5643e83a3270 2024-09-17T03:40:57.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f265a000640 1 --2- 172.21.15.121:0/2681815456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e83a3270 0x5643e876b3f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f264c009fd0 tx=0x7f264c0b9a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e15cd2bda4d406b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f2645200640 1 -- 172.21.15.121:0/2681815456 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c08ccf0 con 0x5643e83a3270 2024-09-17T03:40:57.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f2645200640 1 -- 172.21.15.121:0/2681815456 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f264c087e40 con 0x5643e83a3270 2024-09-17T03:40:57.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.240+0000 7f2645200640 1 -- 172.21.15.121:0/2681815456 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c07f680 con 0x5643e83a3270 2024-09-17T03:40:57.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.241+0000 7f2663066740 1 -- 172.21.15.121:0/2681815456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e83a3270 msgr2=0x5643e876b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.241+0000 7f2663066740 1 --2- 172.21.15.121:0/2681815456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e83a3270 0x5643e876b3f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f264c009fd0 tx=0x7f264c0b9a10 comp rx=0 tx=0).stop 2024-09-17T03:40:57.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.241+0000 7f2663066740 1 -- 172.21.15.121:0/2681815456 shutdown_connections 2024-09-17T03:40:57.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.241+0000 7f2663066740 1 --2- 172.21.15.121:0/2681815456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e83a3270 0x5643e876b3f0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.241+0000 7f2663066740 1 --2- 172.21.15.121:0/2681815456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e8382590 0x5643e876aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.241+0000 7f2663066740 1 --2- 172.21.15.121:0/2681815456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 0x5643e8745820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.241+0000 7f2663066740 1 -- 172.21.15.121:0/2681815456 >> 172.21.15.121:0/2681815456 conn(0x5643e83973c0 msgr2=0x5643e8769d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.241+0000 7f2663066740 1 -- 172.21.15.121:0/2681815456 shutdown_connections 2024-09-17T03:40:57.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.241+0000 7f2663066740 1 -- 172.21.15.121:0/2681815456 wait complete. 2024-09-17T03:40:57.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.242+0000 7f2663066740 1 -- start start 2024-09-17T03:40:57.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.242+0000 7f2663066740 1 Processor -- start 2024-09-17T03:40:57.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2663066740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 0x5643e880e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2663066740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e880e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2663066740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 0x5643e8771500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2663066740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5643e876e240 con 0x5643e8382590 2024-09-17T03:40:57.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2663066740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5643e876dc30 con 0x5643e837a3b0 2024-09-17T03:40:57.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2663066740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5643e879f150 con 0x5643e83a3270 2024-09-17T03:40:57.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2663066740 10 client.0 _ll_register_callbacks cb 0x7f264801f8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:57.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2658c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e880e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2658c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e880e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38358/0 (socket says 172.21.15.121:38358) 2024-09-17T03:40:57.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2658c00640 1 -- 172.21.15.121:0/782586268 learned_addr learned my addr 172.21.15.121:0/782586268 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:57.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f265a000640 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 0x5643e8771500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2659600640 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 0x5643e880e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2658c00640 1 -- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 msgr2=0x5643e8771500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2658c00640 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 0x5643e8771500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2658c00640 1 -- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 msgr2=0x5643e880e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2658c00640 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 0x5643e880e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2658c00640 1 -- 172.21.15.121:0/782586268 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e8790e00 con 0x5643e8382590 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f265a000640 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 0x5643e8771500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.244+0000 7f2659600640 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 0x5643e880e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.245+0000 7f2658c00640 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e880e9e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f26541f6d50 tx=0x7f2640006550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4623e8f726990af1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.245+0000 7f263a000640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.245+0000 7f263a000640 1 -- 172.21.15.121:0/782586268 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640011640 con 0x5643e8382590 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.245+0000 7f263a000640 1 -- 172.21.15.121:0/782586268 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f2640013d30 con 0x5643e8382590 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.245+0000 7f2663066740 1 -- 172.21.15.121:0/782586268 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5643e8748fb0 con 0x5643e8382590 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.245+0000 7f263a000640 1 -- 172.21.15.121:0/782586268 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f264002b050 con 0x5643e8382590 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.245+0000 7f2663066740 10 client.7452 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.245+0000 7f2663066740 1 -- 172.21.15.121:0/782586268 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5643e880ef40 con 0x5643e8382590 2024-09-17T03:40:57.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.245+0000 7f263a000640 1 -- 172.21.15.121:0/782586268 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5643e8748fb0 con 0x5643e8382590 2024-09-17T03:40:57.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.246+0000 7f263a000640 1 -- 172.21.15.121:0/782586268 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 87) ==== 3522+0+0 (secure 0 0 0) 0x7f26400117e0 con 0x5643e8382590 2024-09-17T03:40:57.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.246+0000 7f2663066740 10 client.7452 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:57.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.246+0000 7f2663066740 10 client.7452 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:40:57.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.246+0000 7f2663066740 20 client.7452 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:57.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.246+0000 7f2663066740 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:6836/762503506,v1:172.21.15.176:6837/762503506] conn(0x5643e8789680 0x5643e879da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.246+0000 7f2663066740 4 client.7452 mds_command: new command op to 6946 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:40:57.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.246+0000 7f2663066740 1 -- 172.21.15.121:0/782586268 --> [v2:172.21.15.176:6836/762503506,v1:172.21.15.176:6837/762503506] -- command(tid 0: {"prefix": "status"}) -- 0x5643e878ad00 con 0x5643e8789680 2024-09-17T03:40:57.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.246+0000 7f2659600640 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:6836/762503506,v1:172.21.15.176:6837/762503506] conn(0x5643e8789680 0x5643e879da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2659600640 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:6836/762503506,v1:172.21.15.176:6837/762503506] conn(0x5643e8789680 0x5643e879da50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb6702d4823cf00e server_cookie=74a596e074143e4a in_seq=0 out_seq=0 2024-09-17T03:40:57.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f263a000640 10 client.7452 ms_handle_connect on v2:172.21.15.176:6836/762503506 2024-09-17T03:40:57.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f263a000640 1 -- 172.21.15.121:0/782586268 <== mds.1 v2:172.21.15.176:6836/762503506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5643e878ad00 con 0x5643e8789680 2024-09-17T03:40:57.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f263a000640 10 client.7452 handle_command_reply: tid=0 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2663066740 1 client.7452 shutdown 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2663066740 1 -- 172.21.15.121:0/782586268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 msgr2=0x5643e880e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2663066740 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e880e9e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f26541f6d50 tx=0x7f2640006550 comp rx=0 tx=0).stop 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2663066740 1 -- 172.21.15.121:0/782586268 shutdown_connections 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2663066740 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5643e83a3270 0x5643e8771500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2663066740 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:6836/762503506,v1:172.21.15.176:6837/762503506] conn(0x5643e8789680 0x5643e879da50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2663066740 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5643e8382590 0x5643e880e9e0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2663066740 1 --2- 172.21.15.121:0/782586268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5643e837a3b0 0x5643e880e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f263a000640 0 client.7452 ms_handle_reset on v2:172.21.15.176:6836/762503506 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2663066740 1 -- 172.21.15.121:0/782586268 >> 172.21.15.121:0/782586268 conn(0x5643e83973c0 msgr2=0x5643e8769b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.247+0000 7f2663066740 1 -- 172.21.15.121:0/782586268 shutdown_connections 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f2663066740 1 -- 172.21.15.121:0/782586268 wait complete. 2024-09-17T03:40:57.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f2663066740 20 client.7452 trim_cache size 0 max 16384 2024-09-17T03:40:57.252 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:40:57.252 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:40:57.252 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 1, 2024-09-17T03:40:57.252 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 6946, 2024-09-17T03:40:57.252 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:40:57.252 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:40:57.252 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:40:57.252 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 3.0758969270000001, 2024-09-17T03:40:57.253 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 87, 2024-09-17T03:40:57.253 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 114, 2024-09-17T03:40:57.253 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 114, 2024-09-17T03:40:57.253 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 12.490077203 2024-09-17T03:40:57.253 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 -- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2634078b90 msgr2=0x7f263407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2634078b90 0x7f263407b0a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2654072aa0 tx=0x7f2648005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 -- 172.21.15.121:0/2877360474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2654155f00 msgr2=0x7f26540b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2654155f00 0x7f26540b1ad0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f264c00e490 tx=0x7f264c033ce0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 -- 172.21.15.121:0/2877360474 shutdown_connections 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2634078b90 0x7f263407b0a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2654155f00 0x7f26540b1ad0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26541f6df0 0x7f2654153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 --2- 172.21.15.121:0/2877360474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f263c005150 0x7f26541ea450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 -- 172.21.15.121:0/2877360474 >> 172.21.15.121:0/2877360474 conn(0x7f265406d4c0 msgr2=0x7f26540afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 -- 172.21.15.121:0/2877360474 shutdown_connections 2024-09-17T03:40:57.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.248+0000 7f265c000640 1 -- 172.21.15.121:0/2877360474 wait complete. 2024-09-17T03:40:57.273 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:40:57.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.495+0000 7fe479800640 1 -- 172.21.15.121:0/234010785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4740ceee0 msgr2=0x7fe4740ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.495+0000 7fe479800640 1 --2- 172.21.15.121:0/234010785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4740ceee0 0x7fe4740ca6c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009830 tx=0x7fe45c02a510 comp rx=0 tx=0).stop 2024-09-17T03:40:57.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.495+0000 7fe479800640 1 -- 172.21.15.121:0/234010785 shutdown_connections 2024-09-17T03:40:57.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.495+0000 7fe479800640 1 --2- 172.21.15.121:0/234010785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4740cac00 0x7fe474160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.495+0000 7fe479800640 1 --2- 172.21.15.121:0/234010785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4740ceee0 0x7fe4740ca6c0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.495+0000 7fe479800640 1 -- 172.21.15.121:0/234010785 >> 172.21.15.121:0/234010785 conn(0x7fe47406d4a0 msgr2=0x7fe4740b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.495+0000 7fe479800640 1 -- 172.21.15.121:0/234010785 shutdown_connections 2024-09-17T03:40:57.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.495+0000 7fe479800640 1 -- 172.21.15.121:0/234010785 wait complete. 2024-09-17T03:40:57.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.497+0000 7fe479800640 1 Processor -- start 2024-09-17T03:40:57.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.498+0000 7fe479800640 1 -- start start 2024-09-17T03:40:57.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.499+0000 7fe479800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe474070190 0x7fe47415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.499+0000 7fe479800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4740cac00 0x7fe47415f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.499+0000 7fe479800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4740ceee0 0x7fe474154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.499+0000 7fe479800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4740ccc00 con 0x7fe4740cac00 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.499+0000 7fe479800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe4740cca80 con 0x7fe4740ceee0 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.499+0000 7fe479800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4740ccd80 con 0x7fe474070190 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.499+0000 7fe46b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4740cac00 0x7fe47415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.499+0000 7fe46b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4740cac00 0x7fe47415f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38378/0 (socket says 172.21.15.121:38378) 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.499+0000 7fe46b400640 1 -- 172.21.15.121:0/2331795738 learned_addr learned my addr 172.21.15.121:0/2331795738 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.500+0000 7fe478e00640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4740ceee0 0x7fe474154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.500+0000 7fe473e00640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe474070190 0x7fe47415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.500+0000 7fe46b400640 1 -- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe474070190 msgr2=0x7fe47415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.500+0000 7fe46b400640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe474070190 0x7fe47415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.500+0000 7fe46b400640 1 -- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4740ceee0 msgr2=0x7fe474154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.500+0000 7fe46b400640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4740ceee0 0x7fe474154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.500+0000 7fe46b400640 1 -- 172.21.15.121:0/2331795738 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47409bbe0 con 0x7fe4740cac00 2024-09-17T03:40:57.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.500+0000 7fe46b400640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4740cac00 0x7fe47415f270 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fe45c000c00 tx=0x7fe45c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.500+0000 7fe470c00640 1 -- 172.21.15.121:0/2331795738 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c031d60 con 0x7fe4740cac00 2024-09-17T03:40:57.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.501+0000 7fe470c00640 1 -- 172.21.15.121:0/2331795738 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe45c033e10 con 0x7fe4740cac00 2024-09-17T03:40:57.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.501+0000 7fe470c00640 1 -- 172.21.15.121:0/2331795738 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c033310 con 0x7fe4740cac00 2024-09-17T03:40:57.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.501+0000 7fe479800640 1 -- 172.21.15.121:0/2331795738 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47409bec0 con 0x7fe4740cac00 2024-09-17T03:40:57.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.501+0000 7fe479800640 1 -- 172.21.15.121:0/2331795738 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4741f5810 con 0x7fe4740cac00 2024-09-17T03:40:57.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.503+0000 7fe470c00640 1 -- 172.21.15.121:0/2331795738 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe45c0334b0 con 0x7fe4740cac00 2024-09-17T03:40:57.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.504+0000 7fe470c00640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe450078b90 0x7fe45007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.504+0000 7fe470c00640 1 -- 172.21.15.121:0/2331795738 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7fe45c0bbf20 con 0x7fe4740cac00 2024-09-17T03:40:57.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.504+0000 7fe473e00640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe450078b90 0x7fe45007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.505+0000 7fe481dc5740 1 Processor -- start 2024-09-17T03:40:57.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.505+0000 7fe481dc5740 1 -- start start 2024-09-17T03:40:57.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.505+0000 7fe473e00640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe450078b90 0x7fe45007b0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe464001720 tx=0x7fe464007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.506+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e4f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.506+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e0fe3b0 0x56450e4f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.506+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 0x56450e4c8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.506+0000 7fe481dc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56450e451430 con 0x56450e127270 2024-09-17T03:40:57.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.506+0000 7fe481dc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56450e4415d0 con 0x56450e0fe3b0 2024-09-17T03:40:57.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.506+0000 7fe481dc5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56450e430a00 con 0x56450e106590 2024-09-17T03:40:57.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.506+0000 7fe473e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e4f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.507+0000 7fe473e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e4f7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38382/0 (socket says 172.21.15.121:38382) 2024-09-17T03:40:57.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.507+0000 7fe473e00640 1 -- 172.21.15.121:0/3485689416 learned_addr learned my addr 172.21.15.121:0/3485689416 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:57.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.507+0000 7fe46b400640 1 --2- 172.21.15.121:0/3485689416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e0fe3b0 0x56450e4f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.507+0000 7fe478e00640 1 --2- 172.21.15.121:0/3485689416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 0x56450e4c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.507+0000 7fe473e00640 1 -- 172.21.15.121:0/3485689416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 msgr2=0x56450e4c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.507+0000 7fe473e00640 1 --2- 172.21.15.121:0/3485689416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 0x56450e4c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.507+0000 7fe473e00640 1 -- 172.21.15.121:0/3485689416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e0fe3b0 msgr2=0x56450e4f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.507+0000 7fe473e00640 1 --2- 172.21.15.121:0/3485689416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e0fe3b0 0x56450e4f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.507+0000 7fe473e00640 1 -- 172.21.15.121:0/3485689416 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56450e3f9520 con 0x56450e127270 2024-09-17T03:40:57.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.507+0000 7fe473e00640 1 --2- 172.21.15.121:0/3485689416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e4f7b60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fe46400fb20 tx=0x7fe464012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f2b0053c3b2350 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.508+0000 7fe468c00640 1 -- 172.21.15.121:0/3485689416 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46401b050 con 0x56450e127270 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.508+0000 7fe468c00640 1 -- 172.21.15.121:0/3485689416 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe464025070 con 0x56450e127270 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.508+0000 7fe468c00640 1 -- 172.21.15.121:0/3485689416 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464020440 con 0x56450e127270 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.508+0000 7fe481dc5740 1 -- 172.21.15.121:0/3485689416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 msgr2=0x56450e4f7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.508+0000 7fe481dc5740 1 --2- 172.21.15.121:0/3485689416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e4f7b60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fe46400fb20 tx=0x7fe464012000 comp rx=0 tx=0).stop 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.508+0000 7fe481dc5740 1 -- 172.21.15.121:0/3485689416 shutdown_connections 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.508+0000 7fe481dc5740 1 --2- 172.21.15.121:0/3485689416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 0x56450e4c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.508+0000 7fe481dc5740 1 --2- 172.21.15.121:0/3485689416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e0fe3b0 0x56450e4f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.508+0000 7fe481dc5740 1 --2- 172.21.15.121:0/3485689416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e4f7b60 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.508+0000 7fe481dc5740 1 -- 172.21.15.121:0/3485689416 >> 172.21.15.121:0/3485689416 conn(0x56450e11b3c0 msgr2=0x56450e4cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.509+0000 7fe481dc5740 1 -- 172.21.15.121:0/3485689416 shutdown_connections 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.509+0000 7fe481dc5740 1 -- 172.21.15.121:0/3485689416 wait complete. 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.510+0000 7fe481dc5740 1 -- start start 2024-09-17T03:40:57.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.510+0000 7fe481dc5740 1 Processor -- start 2024-09-17T03:40:57.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.511+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e0fe3b0 0x56450e50c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.511+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e106590 0x56450e521b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.511+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e513a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.513 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.511+0000 7fe481dc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56450e3d7330 con 0x56450e127270 2024-09-17T03:40:57.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.511+0000 7fe481dc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56450e434810 con 0x56450e106590 2024-09-17T03:40:57.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.511+0000 7fe481dc5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56450e1a1620 con 0x56450e0fe3b0 2024-09-17T03:40:57.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.511+0000 7fe481dc5740 10 client.0 _ll_register_callbacks cb 0x56450e3dc420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:57.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe478e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e513a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe478e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e513a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38398/0 (socket says 172.21.15.121:38398) 2024-09-17T03:40:57.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe478e00640 1 -- 172.21.15.121:0/1535161501 learned_addr learned my addr 172.21.15.121:0/1535161501 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:57.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe473e00640 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e0fe3b0 0x56450e50c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe46b400640 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e106590 0x56450e521b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe478e00640 1 -- 172.21.15.121:0/1535161501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e0fe3b0 msgr2=0x56450e50c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe478e00640 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e0fe3b0 0x56450e50c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe478e00640 1 -- 172.21.15.121:0/1535161501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e106590 msgr2=0x56450e521b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe478e00640 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e106590 0x56450e521b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe478e00640 1 -- 172.21.15.121:0/1535161501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56450e192850 con 0x56450e127270 2024-09-17T03:40:57.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe478e00640 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e513a10 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe46c011d40 tx=0x7fe46c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96bbf493c0ab322 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.512+0000 7fe461600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:57.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe461600640 1 -- 172.21.15.121:0/1535161501 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c004b20 con 0x56450e127270 2024-09-17T03:40:57.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe461600640 1 -- 172.21.15.121:0/1535161501 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7fe46c004cc0 con 0x56450e127270 2024-09-17T03:40:57.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe481dc5740 1 -- 172.21.15.121:0/1535161501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe464025070 con 0x56450e127270 2024-09-17T03:40:57.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe461600640 1 -- 172.21.15.121:0/1535161501 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fe46c023050 con 0x56450e127270 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe481dc5740 10 client.7467 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe481dc5740 1 -- 172.21.15.121:0/1535161501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x56450e2096b0 con 0x56450e127270 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe461600640 1 -- 172.21.15.121:0/1535161501 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe464025070 con 0x56450e127270 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe461600640 1 -- 172.21.15.121:0/1535161501 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 87) ==== 3522+0+0 (secure 0 0 0) 0x7fe46c026020 con 0x56450e127270 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe481dc5740 10 client.7467 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe481dc5740 10 client.7467 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe481dc5740 20 client.7467 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe481dc5740 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x56450e0e5e40 0x56450e525130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe481dc5740 4 client.7467 mds_command: new command op to 7332 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.513+0000 7fe481dc5740 1 -- 172.21.15.121:0/1535161501 --> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56450e443520 con 0x56450e0e5e40 2024-09-17T03:40:57.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.514+0000 7fe473e00640 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x56450e0e5e40 0x56450e525130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.514+0000 7fe473e00640 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x56450e0e5e40 0x56450e525130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e86f9062c725e487 server_cookie=3239105637dbb352 in_seq=0 out_seq=0 2024-09-17T03:40:57.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.514+0000 7fe461600640 10 client.7467 ms_handle_connect on v2:172.21.15.121:6832/1935597076 2024-09-17T03:40:57.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe461600640 1 -- 172.21.15.121:0/1535161501 <== mds.0 v2:172.21.15.121:6832/1935597076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56450e443520 con 0x56450e0e5e40 2024-09-17T03:40:57.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe461600640 10 client.7467 handle_command_reply: tid=0 2024-09-17T03:40:57.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 client.7467 shutdown 2024-09-17T03:40:57.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 -- 172.21.15.121:0/1535161501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 msgr2=0x56450e513a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e513a10 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe46c011d40 tx=0x7fe46c00f790 comp rx=0 tx=0).stop 2024-09-17T03:40:57.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 -- 172.21.15.121:0/1535161501 shutdown_connections 2024-09-17T03:40:57.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e513a10 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x56450e0e5e40 0x56450e525130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e106590 0x56450e521b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 --2- 172.21.15.121:0/1535161501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e0fe3b0 0x56450e50c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 -- 172.21.15.121:0/1535161501 >> 172.21.15.121:0/1535161501 conn(0x56450e11b3c0 msgr2=0x56450e4ef070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe461600640 0 client.7467 ms_handle_reset on v2:172.21.15.121:6832/1935597076 2024-09-17T03:40:57.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 -- 172.21.15.121:0/1535161501 shutdown_connections 2024-09-17T03:40:57.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.515+0000 7fe481dc5740 1 -- 172.21.15.121:0/1535161501 wait complete. 2024-09-17T03:40:57.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.516+0000 7fe481dc5740 20 client.7467 trim_cache size 0 max 16384 2024-09-17T03:40:57.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.534+0000 7fe481dc5740 1 Processor -- start 2024-09-17T03:40:57.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.535+0000 7fe481dc5740 1 -- start start 2024-09-17T03:40:57.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e0fe3b0 0x56450e50bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e106590 0x56450e515250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e127270 0x56450e515790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe481dc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe474202a50 con 0x56450e0fe3b0 2024-09-17T03:40:57.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe481dc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe4740b1ed0 con 0x56450e106590 2024-09-17T03:40:57.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe481dc5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe474201410 con 0x56450e127270 2024-09-17T03:40:57.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe473e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e0fe3b0 0x56450e50bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe473e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e0fe3b0 0x56450e50bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38408/0 (socket says 172.21.15.121:38408) 2024-09-17T03:40:57.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe473e00640 1 -- 172.21.15.121:0/2160457278 learned_addr learned my addr 172.21.15.121:0/2160457278 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:57.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe46b400640 1 --2- 172.21.15.121:0/2160457278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e106590 0x56450e515250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.536+0000 7fe478e00640 1 --2- 172.21.15.121:0/2160457278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e127270 0x56450e515790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.537+0000 7fe473e00640 1 -- 172.21.15.121:0/2160457278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e127270 msgr2=0x56450e515790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.537+0000 7fe473e00640 1 --2- 172.21.15.121:0/2160457278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e127270 0x56450e515790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.537+0000 7fe473e00640 1 -- 172.21.15.121:0/2160457278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e106590 msgr2=0x56450e515250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.537+0000 7fe473e00640 1 --2- 172.21.15.121:0/2160457278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e106590 0x56450e515250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.537+0000 7fe473e00640 1 -- 172.21.15.121:0/2160457278 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56450e4f2b10 con 0x56450e0fe3b0 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.537+0000 7fe473e00640 1 --2- 172.21.15.121:0/2160457278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e0fe3b0 0x56450e50bb80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe464022040 tx=0x7fe464000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d763b5a648cc71f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.537+0000 7fe463e00640 1 -- 172.21.15.121:0/2160457278 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46401b040 con 0x56450e0fe3b0 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.537+0000 7fe463e00640 1 -- 172.21.15.121:0/2160457278 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe464025040 con 0x56450e0fe3b0 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.537+0000 7fe463e00640 1 -- 172.21.15.121:0/2160457278 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464006e00 con 0x56450e0fe3b0 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.538+0000 7fe481dc5740 1 -- 172.21.15.121:0/2160457278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e0fe3b0 msgr2=0x56450e50bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.538+0000 7fe481dc5740 1 --2- 172.21.15.121:0/2160457278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e0fe3b0 0x56450e50bb80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe464022040 tx=0x7fe464000bc0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.538+0000 7fe481dc5740 1 -- 172.21.15.121:0/2160457278 shutdown_connections 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.538+0000 7fe481dc5740 1 --2- 172.21.15.121:0/2160457278 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e127270 0x56450e515790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.538+0000 7fe481dc5740 1 --2- 172.21.15.121:0/2160457278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e106590 0x56450e515250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.538+0000 7fe481dc5740 1 --2- 172.21.15.121:0/2160457278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e0fe3b0 0x56450e50bb80 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.538+0000 7fe481dc5740 1 -- 172.21.15.121:0/2160457278 >> 172.21.15.121:0/2160457278 conn(0x56450e11b3c0 msgr2=0x56450e5217e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.538+0000 7fe481dc5740 1 -- 172.21.15.121:0/2160457278 shutdown_connections 2024-09-17T03:40:57.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.538+0000 7fe481dc5740 1 -- 172.21.15.121:0/2160457278 wait complete. 2024-09-17T03:40:57.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.539+0000 7fe481dc5740 1 -- start start 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.539+0000 7fe481dc5740 1 Processor -- start 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e0fe3b0 0x56450e5963b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 0x56450e534e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe481dc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e58c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe481dc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56450e514090 con 0x56450e127270 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe481dc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56450e4f33c0 con 0x56450e0fe3b0 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe481dc5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56450e4f28f0 con 0x56450e106590 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe481dc5740 10 client.0 _ll_register_callbacks cb 0x7fe46c011920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe478e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e58c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe478e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e58c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38414/0 (socket says 172.21.15.121:38414) 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe478e00640 1 -- 172.21.15.121:0/471163291 learned_addr learned my addr 172.21.15.121:0/471163291 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:40:57.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe473e00640 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e0fe3b0 0x56450e5963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe46b400640 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 0x56450e534e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe478e00640 1 -- 172.21.15.121:0/471163291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 msgr2=0x56450e534e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe478e00640 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 0x56450e534e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe478e00640 1 -- 172.21.15.121:0/471163291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e0fe3b0 msgr2=0x56450e5963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe478e00640 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e0fe3b0 0x56450e5963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe478e00640 1 -- 172.21.15.121:0/471163291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56450e5353a0 con 0x56450e127270 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.541+0000 7fe46b400640 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 0x56450e534e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.542+0000 7fe478e00640 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e58c160 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fe46c003990 tx=0x7fe46c009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd7774e38592b9f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.542+0000 7fe461600640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.542+0000 7fe461600640 1 -- 172.21.15.121:0/471163291 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c027700 con 0x56450e127270 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.542+0000 7fe461600640 1 -- 172.21.15.121:0/471163291 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7fe46c0278a0 con 0x56450e127270 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.542+0000 7fe481dc5740 1 -- 172.21.15.121:0/471163291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe464025040 con 0x56450e127270 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.542+0000 7fe461600640 1 -- 172.21.15.121:0/471163291 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fe46c035050 con 0x56450e127270 2024-09-17T03:40:57.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.542+0000 7fe481dc5740 10 client.7473 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:57.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.542+0000 7fe481dc5740 1 -- 172.21.15.121:0/471163291 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x56450e50d0d0 con 0x56450e127270 2024-09-17T03:40:57.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.543+0000 7fe461600640 1 -- 172.21.15.121:0/471163291 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe464025040 con 0x56450e127270 2024-09-17T03:40:57.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.543+0000 7fe461600640 1 -- 172.21.15.121:0/471163291 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 87) ==== 3522+0+0 (secure 0 0 0) 0x7fe46c038020 con 0x56450e127270 2024-09-17T03:40:57.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.543+0000 7fe481dc5740 10 client.7473 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:57.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.543+0000 7fe481dc5740 10 client.7473 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:40:57.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.543+0000 7fe481dc5740 20 client.7473 populate_metadata read hostname 'smithi121' 2024-09-17T03:40:57.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.543+0000 7fe481dc5740 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x56450e4edf50 0x56450e515e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.543+0000 7fe481dc5740 4 client.7473 mds_command: new command op to 7332 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:40:57.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.543+0000 7fe481dc5740 1 -- 172.21.15.121:0/471163291 --> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] -- command(tid 0: {"prefix": "status"}) -- 0x56450e4cd1a0 con 0x56450e4edf50 2024-09-17T03:40:57.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.543+0000 7fe473e00640 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x56450e4edf50 0x56450e515e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe473e00640 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x56450e4edf50 0x56450e515e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdfe729ac03593f2 server_cookie=8dd901d00caa532b in_seq=0 out_seq=0 2024-09-17T03:40:57.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe461600640 10 client.7473 ms_handle_connect on v2:172.21.15.121:6832/1935597076 2024-09-17T03:40:57.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe461600640 1 -- 172.21.15.121:0/471163291 <== mds.0 v2:172.21.15.121:6832/1935597076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x56450e4cd1a0 con 0x56450e4edf50 2024-09-17T03:40:57.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe461600640 10 client.7473 handle_command_reply: tid=0 2024-09-17T03:40:57.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 client.7473 shutdown 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 -- 172.21.15.121:0/471163291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 msgr2=0x56450e58c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e58c160 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fe46c003990 tx=0x7fe46c009570 comp rx=0 tx=0).stop 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 -- 172.21.15.121:0/471163291 shutdown_connections 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56450e127270 0x56450e58c160 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56450e106590 0x56450e534e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.121:6832/1935597076,v1:172.21.15.121:6834/1935597076] conn(0x56450e4edf50 0x56450e515e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 --2- 172.21.15.121:0/471163291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56450e0fe3b0 0x56450e5963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe461600640 0 client.7473 ms_handle_reset on v2:172.21.15.121:6832/1935597076 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 -- 172.21.15.121:0/471163291 >> 172.21.15.121:0/471163291 conn(0x56450e11b3c0 msgr2=0x56450e50d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 -- 172.21.15.121:0/471163291 shutdown_connections 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.544+0000 7fe481dc5740 1 -- 172.21.15.121:0/471163291 wait complete. 2024-09-17T03:40:57.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe481dc5740 20 client.7473 trim_cache size 0 max 16384 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "f24b1682-8755-41b1-8124-cbd8f88939a2", 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 7332, 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 13.022717201000001, 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 87, 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 114, 2024-09-17T03:40:57.549 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 114, 2024-09-17T03:40:57.550 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 13.753068282999999 2024-09-17T03:40:57.550 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:40:57.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 -- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe450078b90 msgr2=0x7fe45007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe450078b90 0x7fe45007b0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe464001720 tx=0x7fe464007e90 comp rx=0 tx=0).stop 2024-09-17T03:40:57.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 -- 172.21.15.121:0/2331795738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4740cac00 msgr2=0x7fe47415f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4740cac00 0x7fe47415f270 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fe45c000c00 tx=0x7fe45c033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:57.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 -- 172.21.15.121:0/2331795738 shutdown_connections 2024-09-17T03:40:57.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4740ceee0 0x7fe474154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fe450078b90 0x7fe45007b0a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4740cac00 0x7fe47415f270 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 --2- 172.21.15.121:0/2331795738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe474070190 0x7fe47415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 -- 172.21.15.121:0/2331795738 >> 172.21.15.121:0/2331795738 conn(0x7fe47406d4a0 msgr2=0x7fe4740b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 -- 172.21.15.121:0/2331795738 shutdown_connections 2024-09-17T03:40:57.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:40:57.545+0000 7fe479800640 1 -- 172.21.15.121:0/2331795738 wait complete. 2024-09-17T03:40:57.570 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-17T03:40:57.820 INFO:teuthology.orchestra.run.smithi176.stdout:{"message":"","return_code":0} 2024-09-17T03:40:57.821 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T03:40:57.821 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump objecter 2024-09-17T03:40:58.061 INFO:teuthology.orchestra.run.smithi176.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":39,"op_send_bytes":11472,"op_resend":27,"op_reply":39,"op_latency":{"avgcount":39,"sum":0.296996878,"avgtime":0.007615304},"op_inflight":0,"oplen_avg":{"avgcount":39,"sum":61},"op":39,"op_r":0,"op_w":39,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1}} 2024-09-17T03:40:58.062 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 39, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 39, "avgtime": 0.007615304, "sum": 0.296996878 }, "op_pg": 0, "op_r": 0, "op_reply": 39, "op_resend": 27, "op_rmw": 0, "op_send": 39, "op_send_bytes": 11472, "op_w": 39, "oplen_avg": { "avgcount": 39, "sum": 61 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-17T03:40:58.062 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json export dir /bravo 1 2024-09-17T03:40:58.307 INFO:teuthology.orchestra.run.smithi121.stdout:{"return_code":0} 2024-09-17T03:40:58.307 DEBUG:tasks.cephfs.filesystem:_json_asok output { "return_code": 0 } 2024-09-17T03:40:58.308 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump objecter 2024-09-17T03:40:58.545 INFO:teuthology.orchestra.run.smithi176.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":39,"op_send_bytes":11472,"op_resend":27,"op_reply":39,"op_latency":{"avgcount":39,"sum":0.296996878,"avgtime":0.007615304},"op_inflight":0,"oplen_avg":{"avgcount":39,"sum":61},"op":39,"op_r":0,"op_w":39,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":2,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":15,"omap_rd":0,"omap_del":1}} 2024-09-17T03:40:58.545 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 15, "op": 39, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 39, "avgtime": 0.007615304, "sum": 0.296996878 }, "op_pg": 0, "op_r": 0, "op_reply": 39, "op_resend": 27, "op_rmw": 0, "op_send": 39, "op_send_bytes": 11472, "op_w": 39, "oplen_avg": { "avgcount": 39, "sum": 61 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-17T03:40:58.545 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-17T03:41:03.546 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump objecter 2024-09-17T03:41:03.796 INFO:teuthology.orchestra.run.smithi176.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":43,"op_send_bytes":15128,"op_resend":27,"op_reply":43,"op_latency":{"avgcount":43,"sum":0.307996761,"avgtime":0.007162715},"op_inflight":0,"oplen_avg":{"avgcount":43,"sum":67},"op":43,"op_r":0,"op_w":43,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":10,"osdop_read":0,"osdop_write":4,"osdop_writefull":7,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":20,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":19,"omap_rd":0,"omap_del":1}} 2024-09-17T03:41:03.796 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 1, "omap_rd": 0, "omap_wr": 19, "op": 43, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 43, "avgtime": 0.007162715, "sum": 0.307996761 }, "op_pg": 0, "op_r": 0, "op_reply": 43, "op_resend": 27, "op_rmw": 0, "op_send": 43, "op_send_bytes": 15128, "op_w": 43, "oplen_avg": { "avgcount": 43, "sum": 67 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 10, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 20, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 7, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-09-17T03:41:03.797 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-17T03:41:03.797 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:41:03.797 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:03.837 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:41:03.837 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:03.917 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:41:04.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.181+0000 7f0516000640 1 -- 172.21.15.121:0/2104713015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051015ec60 msgr2=0x7f0510072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.181+0000 7f0516000640 1 --2- 172.21.15.121:0/2104713015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051015ec60 0x7f0510072ff0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f0500005fd0 tx=0x7f050002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.181+0000 7f0516000640 1 -- 172.21.15.121:0/2104713015 shutdown_connections 2024-09-17T03:41:04.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.181+0000 7f0516000640 1 --2- 172.21.15.121:0/2104713015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0510073530 0x7f05101627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.181+0000 7f0516000640 1 --2- 172.21.15.121:0/2104713015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051015ec60 0x7f0510072ff0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.181+0000 7f0516000640 1 -- 172.21.15.121:0/2104713015 >> 172.21.15.121:0/2104713015 conn(0x7f051006d4c0 msgr2=0x7f05100d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:04.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.181+0000 7f0516000640 1 -- 172.21.15.121:0/2104713015 shutdown_connections 2024-09-17T03:41:04.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.181+0000 7f0516000640 1 -- 172.21.15.121:0/2104713015 wait complete. 2024-09-17T03:41:04.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.183+0000 7f0516000640 1 Processor -- start 2024-09-17T03:41:04.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.183+0000 7f0516000640 1 -- start start 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f0516000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0510073530 0x7f051015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f0516000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051015ec60 0x7f05101f9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f0516000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0510162ce0 0x7f05101f9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f0516000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f05100cf470 con 0x7f051015ec60 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f0516000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0510070340 con 0x7f0510073530 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f0516000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f05100cf5f0 con 0x7f0510162ce0 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f050ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051015ec60 0x7f05101f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f050ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051015ec60 0x7f05101f9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44476/0 (socket says 172.21.15.121:44476) 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f050ea00640 1 -- 172.21.15.121:0/1203318494 learned_addr learned my addr 172.21.15.121:0/1203318494 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f050fe00640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0510162ce0 0x7f05101f9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f050f400640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0510073530 0x7f051015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f050ea00640 1 -- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0510162ce0 msgr2=0x7f05101f9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f050ea00640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0510162ce0 0x7f05101f9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f050ea00640 1 -- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0510073530 msgr2=0x7f051015c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f050ea00640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0510073530 0x7f051015c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.185+0000 7f050ea00640 1 -- 172.21.15.121:0/1203318494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05101e85f0 con 0x7f051015ec60 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.186+0000 7f050ea00640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051015ec60 0x7f05101f9120 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00d6d0 tx=0x7f04fc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.186+0000 7f0507400640 1 -- 172.21.15.121:0/1203318494 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc017070 con 0x7f051015ec60 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.186+0000 7f0507400640 1 -- 172.21.15.121:0/1203318494 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04fc005330 con 0x7f051015ec60 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.186+0000 7f0516000640 1 -- 172.21.15.121:0/1203318494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05101f9ea0 con 0x7f051015ec60 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.186+0000 7f0507400640 1 -- 172.21.15.121:0/1203318494 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc009820 con 0x7f051015ec60 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.186+0000 7f0516000640 1 -- 172.21.15.121:0/1203318494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05101e8b70 con 0x7f051015ec60 2024-09-17T03:41:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.187+0000 7f0516000640 1 -- 172.21.15.121:0/1203318494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05100cfa80 con 0x7f051015ec60 2024-09-17T03:41:04.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.189+0000 7f0507400640 1 -- 172.21.15.121:0/1203318494 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f04fc009bd0 con 0x7f051015ec60 2024-09-17T03:41:04.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.189+0000 7f0507400640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f04f0078b90 0x7f04f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.190+0000 7f0507400640 1 -- 172.21.15.121:0/1203318494 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f04fc09b270 con 0x7f051015ec60 2024-09-17T03:41:04.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.190+0000 7f050f400640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f04f0078b90 0x7f04f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.191+0000 7f050f400640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f04f0078b90 0x7f04f007b0a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0500033000 tx=0x7f0500004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:04.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.194+0000 7f0507400640 1 -- 172.21.15.121:0/1203318494 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f04fc062d80 con 0x7f051015ec60 2024-09-17T03:41:04.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.388+0000 7f0516000640 1 -- 172.21.15.121:0/1203318494 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f051015e5f0 con 0x7f051015ec60 2024-09-17T03:41:04.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.388+0000 7f0507400640 1 -- 172.21.15.121:0/1203318494 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v114) ==== 80+0+246 (secure 0 0 0) 0x7f04fc0677b0 con 0x7f051015ec60 2024-09-17T03:41:04.388 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.176:6836/2166412005 2024-09-18T03:40:44.508573+0000 2024-09-17T03:41:04.388 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.176:6834/2166412005 2024-09-18T03:40:44.508573+0000 2024-09-17T03:41:04.388 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6835/697305237 2024-09-18T03:40:43.506671+0000 2024-09-17T03:41:04.388 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6834/697305237 2024-09-18T03:40:43.506671+0000 2024-09-17T03:41:04.389 INFO:teuthology.orchestra.run.smithi121.stderr:listed 4 entries 2024-09-17T03:41:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 -- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f04f0078b90 msgr2=0x7f04f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f04f0078b90 0x7f04f007b0a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0500033000 tx=0x7f0500004730 comp rx=0 tx=0).stop 2024-09-17T03:41:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 -- 172.21.15.121:0/1203318494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051015ec60 msgr2=0x7f05101f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051015ec60 0x7f05101f9120 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00d6d0 tx=0x7f04fc00db90 comp rx=0 tx=0).stop 2024-09-17T03:41:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 -- 172.21.15.121:0/1203318494 shutdown_connections 2024-09-17T03:41:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0510162ce0 0x7f05101f9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f04f0078b90 0x7f04f007b0a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051015ec60 0x7f05101f9120 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 --2- 172.21.15.121:0/1203318494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0510073530 0x7f051015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 -- 172.21.15.121:0/1203318494 >> 172.21.15.121:0/1203318494 conn(0x7f051006d4c0 msgr2=0x7f05100705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.390+0000 7f0516000640 1 -- 172.21.15.121:0/1203318494 shutdown_connections 2024-09-17T03:41:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.391+0000 7f0516000640 1 -- 172.21.15.121:0/1203318494 wait complete. 2024-09-17T03:41:04.413 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:41:04.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:04.413 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:41:04.507 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:41:04.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:04.507 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:41:04.558 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:41:04.558 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:04.596 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:41:04.596 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:04.671 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:41:04.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.893+0000 7f3a2f600640 1 -- 172.21.15.121:0/3274200428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a28161060 msgr2=0x7f3a280cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.893+0000 7f3a2f600640 1 --2- 172.21.15.121:0/3274200428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a28161060 0x7f3a280cf3e0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f3a20005fd0 tx=0x7f3a2002a940 comp rx=0 tx=0).stop 2024-09-17T03:41:04.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.893+0000 7f3a2f600640 1 -- 172.21.15.121:0/3274200428 shutdown_connections 2024-09-17T03:41:04.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.893+0000 7f3a2f600640 1 --2- 172.21.15.121:0/3274200428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a28161060 0x7f3a280cf3e0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.893+0000 7f3a2f600640 1 -- 172.21.15.121:0/3274200428 >> 172.21.15.121:0/3274200428 conn(0x7f3a2806d4c0 msgr2=0x7f3a280d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:04.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.893+0000 7f3a2f600640 1 -- 172.21.15.121:0/3274200428 shutdown_connections 2024-09-17T03:41:04.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.893+0000 7f3a2f600640 1 -- 172.21.15.121:0/3274200428 wait complete. 2024-09-17T03:41:04.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.895+0000 7f3a2f600640 1 Processor -- start 2024-09-17T03:41:04.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.895+0000 7f3a2f600640 1 -- start start 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a2f600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a2815dbf0 0x7f3a281f9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a2f600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a28161060 0x7f3a28074780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a2f600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a281608c0 0x7f3a28074cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a2f600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3a280b4c50 con 0x7f3a28161060 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a2f600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3a280b4ad0 con 0x7f3a281608c0 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a2f600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3a280b4dd0 con 0x7f3a2815dbf0 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a27e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a28161060 0x7f3a28074780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a27e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a28161060 0x7f3a28074780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44492/0 (socket says 172.21.15.121:44492) 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a27e00640 1 -- 172.21.15.121:0/2283289934 learned_addr learned my addr 172.21.15.121:0/2283289934 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a2d600640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a281608c0 0x7f3a28074cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.897+0000 7f3a2cc00640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a2815dbf0 0x7f3a281f9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a27e00640 1 -- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a2815dbf0 msgr2=0x7f3a281f9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a27e00640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a2815dbf0 0x7f3a281f9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a27e00640 1 -- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a281608c0 msgr2=0x7f3a28074cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a27e00640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a281608c0 0x7f3a28074cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a27e00640 1 -- 172.21.15.121:0/2283289934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a280afd80 con 0x7f3a28161060 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a27e00640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a28161060 0x7f3a28074780 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c400 tx=0x7f3a1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a24c00640 1 -- 172.21.15.121:0/2283289934 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14017070 con 0x7f3a28161060 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a24c00640 1 -- 172.21.15.121:0/2283289934 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a140053c0 con 0x7f3a28161060 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a24c00640 1 -- 172.21.15.121:0/2283289934 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14003850 con 0x7f3a28161060 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a2f600640 1 -- 172.21.15.121:0/2283289934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a280b0060 con 0x7f3a28161060 2024-09-17T03:41:04.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.898+0000 7f3a2f600640 1 -- 172.21.15.121:0/2283289934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a280b0340 con 0x7f3a28161060 2024-09-17T03:41:04.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.899+0000 7f3a2f600640 1 -- 172.21.15.121:0/2283289934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a280cf3e0 con 0x7f3a28161060 2024-09-17T03:41:04.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.901+0000 7f3a24c00640 1 -- 172.21.15.121:0/2283289934 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a1401a070 con 0x7f3a28161060 2024-09-17T03:41:04.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.902+0000 7f3a24c00640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3a08078bc0 0x7f3a0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.902+0000 7f3a24c00640 1 -- 172.21.15.121:0/2283289934 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f3a1409a250 con 0x7f3a28161060 2024-09-17T03:41:04.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.902+0000 7f3a2cc00640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3a08078bc0 0x7f3a0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.903+0000 7f3a2cc00640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3a08078bc0 0x7f3a0807b0d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c000f60 tx=0x7f3a1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:04.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:04.907+0000 7f3a24c00640 1 -- 172.21.15.121:0/2283289934 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a14061df0 con 0x7f3a28161060 2024-09-17T03:41:05.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.102+0000 7f3a2f600640 1 -- 172.21.15.121:0/2283289934 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3a280d0ee0 con 0x7f3a28161060 2024-09-17T03:41:05.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.102+0000 7f3a24c00640 1 -- 172.21.15.121:0/2283289934 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v114) ==== 80+0+246 (secure 0 0 0) 0x7f3a14066820 con 0x7f3a28161060 2024-09-17T03:41:05.102 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.176:6836/2166412005 2024-09-18T03:40:44.508573+0000 2024-09-17T03:41:05.102 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.176:6834/2166412005 2024-09-18T03:40:44.508573+0000 2024-09-17T03:41:05.102 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6835/697305237 2024-09-18T03:40:43.506671+0000 2024-09-17T03:41:05.102 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6834/697305237 2024-09-18T03:40:43.506671+0000 2024-09-17T03:41:05.102 INFO:teuthology.orchestra.run.smithi121.stderr:listed 4 entries 2024-09-17T03:41:05.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.104+0000 7f3a2f600640 1 -- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3a08078bc0 msgr2=0x7f3a0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.104+0000 7f3a2f600640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3a08078bc0 0x7f3a0807b0d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c000f60 tx=0x7f3a1c009040 comp rx=0 tx=0).stop 2024-09-17T03:41:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.104+0000 7f3a2f600640 1 -- 172.21.15.121:0/2283289934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a28161060 msgr2=0x7f3a28074780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.104+0000 7f3a2f600640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a28161060 0x7f3a28074780 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c400 tx=0x7f3a1400c8c0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.105+0000 7f3a2f600640 1 -- 172.21.15.121:0/2283289934 shutdown_connections 2024-09-17T03:41:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.105+0000 7f3a2f600640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a281608c0 0x7f3a28074cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.105+0000 7f3a2f600640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3a08078bc0 0x7f3a0807b0d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.105+0000 7f3a2f600640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a28161060 0x7f3a28074780 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.105+0000 7f3a2f600640 1 --2- 172.21.15.121:0/2283289934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a2815dbf0 0x7f3a281f9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.105+0000 7f3a2f600640 1 -- 172.21.15.121:0/2283289934 >> 172.21.15.121:0/2283289934 conn(0x7f3a2806d4c0 msgr2=0x7f3a2806f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.105+0000 7f3a2f600640 1 -- 172.21.15.121:0/2283289934 shutdown_connections 2024-09-17T03:41:05.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.105+0000 7f3a2f600640 1 -- 172.21.15.121:0/2283289934 wait complete. 2024-09-17T03:41:05.128 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:41:05.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:05.128 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:41:05.194 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:41:05.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:05.194 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:41:05.230 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T03:41:05.470 INFO:teuthology.orchestra.run.smithi121.stdout:[] 2024-09-17T03:41:05.470 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-17T03:41:05.471 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-17T03:41:05.715 INFO:teuthology.orchestra.run.smithi121.stdout:{"message":"","return_code":0} 2024-09-17T03:41:05.716 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T03:41:05.716 DEBUG:teuthology.orchestra.run.smithi121:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show session 2024-09-17T03:41:05.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.853+0000 7f7f8111c280 1 -- start start 2024-09-17T03:41:05.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.853+0000 7f7f8111c280 1 Processor -- start 2024-09-17T03:41:05.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.854+0000 7f7f8111c280 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5d2a3a80 0x55ca5dee2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.854+0000 7f7f8111c280 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5d2a3180 0x55ca5dee2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.854+0000 7f7f8111c280 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea000 0x55ca5dee2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.854+0000 7f7f8111c280 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ca5d1fc180 con 0x55ca5dfea000 2024-09-17T03:41:05.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.854+0000 7f7f8111c280 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ca5d173800 con 0x55ca5d2a3a80 2024-09-17T03:41:05.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.854+0000 7f7f8111c280 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ca5d173380 con 0x55ca5d2a3180 2024-09-17T03:41:05.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.854+0000 7f7f7f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea000 0x55ca5dee2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7f400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea000 0x55ca5dee2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44504/0 (socket says 172.21.15.121:44504) 2024-09-17T03:41:05.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7f400640 1 -- 172.21.15.121:0/923735432 learned_addr learned my addr 172.21.15.121:0/923735432 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:05.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7e000640 1 --2- 172.21.15.121:0/923735432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5d2a3180 0x55ca5dee2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7ea00640 1 --2- 172.21.15.121:0/923735432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5d2a3a80 0x55ca5dee2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7f400640 1 -- 172.21.15.121:0/923735432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5d2a3180 msgr2=0x55ca5dee2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7f400640 1 --2- 172.21.15.121:0/923735432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5d2a3180 0x55ca5dee2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7f400640 1 -- 172.21.15.121:0/923735432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5d2a3a80 msgr2=0x55ca5dee2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7f400640 1 --2- 172.21.15.121:0/923735432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5d2a3a80 0x55ca5dee2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7f400640 1 -- 172.21.15.121:0/923735432 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca59118780 con 0x55ca5dfea000 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7f400640 1 --2- 172.21.15.121:0/923735432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea000 0x55ca5dee2b00 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x55ca5df41890 tx=0x55ca5d20f080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb9d8355d5fb44f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7b800640 1 -- 172.21.15.121:0/923735432 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ca59106ea0 con 0x55ca5dfea000 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7b800640 1 -- 172.21.15.121:0/923735432 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ca5910c540 con 0x55ca5dfea000 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f7b800640 1 -- 172.21.15.121:0/923735432 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ca59107380 con 0x55ca5dfea000 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.855+0000 7f7f8111c280 1 -- 172.21.15.121:0/923735432 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca591194a0 con 0x55ca5dfea000 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.856+0000 7f7f8111c280 1 -- 172.21.15.121:0/923735432 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55ca59118000 con 0x55ca5dfea000 2024-09-17T03:41:05.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.856+0000 7f7f8111c280 4 waiting for MDS map... 2024-09-17T03:41:05.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.856+0000 7f7f7b800640 1 -- 172.21.15.121:0/923735432 <== mon.0 v2:172.21.15.121:3300/0 4 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x55ca5e002600 con 0x55ca5dfea000 2024-09-17T03:41:05.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.856+0000 7f7f7b800640 1 -- 172.21.15.121:0/923735432 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 88) ==== 3526+0+0 (secure 0 0 0) 0x55ca5d16b180 con 0x55ca5dfea000 2024-09-17T03:41:05.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.856+0000 7f7f8111c280 4 Got MDS map 88 2024-09-17T03:41:05.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.856+0000 7f7f8111c280 10 main: main 2024-09-17T03:41:05.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.856+0000 7f7f8111c280 4 main: connecting to RADOS... 2024-09-17T03:41:05.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.857+0000 7f7f8111c280 1 Processor -- start 2024-09-17T03:41:05.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.857+0000 7f7f8111c280 1 -- start start 2024-09-17T03:41:05.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.858+0000 7f7f8111c280 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5dfea900 0x55ca5dee3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.858+0000 7f7f8111c280 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfead80 0x55ca5dee3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.858+0000 7f7f8111c280 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5dfeb200 0x55ca5dee3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.860 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.858+0000 7f7f8111c280 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ca5d173980 con 0x55ca5dfead80 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.858+0000 7f7f8111c280 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ca5d1fd500 con 0x55ca5dfea900 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f8111c280 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ca5d1fd380 con 0x55ca5dfeb200 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfead80 0x55ca5dee3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfead80 0x55ca5dee3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44518/0 (socket says 172.21.15.121:44518) 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7ea00640 1 -- 172.21.15.121:0/398779712 learned_addr learned my addr 172.21.15.121:0/398779712 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7e000640 1 --2- 172.21.15.121:0/398779712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5dfeb200 0x55ca5dee3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7e000640 1 --2- 172.21.15.121:0/398779712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5dfea900 0x55ca5dee3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7ea00640 1 -- 172.21.15.121:0/398779712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5dfeb200 msgr2=0x55ca5dee3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7ea00640 1 --2- 172.21.15.121:0/398779712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5dfeb200 0x55ca5dee3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7ea00640 1 -- 172.21.15.121:0/398779712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5dfea900 msgr2=0x55ca5dee3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7ea00640 1 --2- 172.21.15.121:0/398779712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5dfea900 0x55ca5dee3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7ea00640 1 -- 172.21.15.121:0/398779712 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca591183c0 con 0x55ca5dfead80 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.859+0000 7f7f7ea00640 1 --2- 172.21.15.121:0/398779712 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfead80 0x55ca5dee3600 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x55ca5dff8ba0 tx=0x55ca5e01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3765032ab71edb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:05.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f79000640 1 -- 172.21.15.121:0/398779712 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ca59106340 con 0x55ca5dfead80 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f79000640 1 -- 172.21.15.121:0/398779712 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ca5910d180 con 0x55ca5dfead80 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f79000640 1 -- 172.21.15.121:0/398779712 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ca59106ea0 con 0x55ca5dfead80 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f8111c280 1 -- 172.21.15.121:0/398779712 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfead80 msgr2=0x55ca5dee3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f8111c280 1 --2- 172.21.15.121:0/398779712 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfead80 0x55ca5dee3600 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x55ca5dff8ba0 tx=0x55ca5e01ad20 comp rx=0 tx=0).stop 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f8111c280 1 -- 172.21.15.121:0/398779712 shutdown_connections 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f8111c280 1 --2- 172.21.15.121:0/398779712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5dfeb200 0x55ca5dee3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f8111c280 1 --2- 172.21.15.121:0/398779712 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfead80 0x55ca5dee3600 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f8111c280 1 --2- 172.21.15.121:0/398779712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5dfea900 0x55ca5dee3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f8111c280 1 -- 172.21.15.121:0/398779712 >> 172.21.15.121:0/398779712 conn(0x55ca5dfea480 msgr2=0x55ca5d251800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f8111c280 1 -- 172.21.15.121:0/398779712 shutdown_connections 2024-09-17T03:41:05.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.860+0000 7f7f8111c280 1 -- 172.21.15.121:0/398779712 wait complete. 2024-09-17T03:41:05.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.861+0000 7f7f8111c280 1 Processor -- start 2024-09-17T03:41:05.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.862+0000 7f7f8111c280 1 -- start start 2024-09-17T03:41:05.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f8111c280 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea900 0x55ca5dee3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f8111c280 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5dfead80 0x55ca5dee3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f8111c280 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5dfeb200 0x55ca5dee3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f8111c280 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ca5d1fc780 con 0x55ca5dfea900 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f8111c280 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ca5d1fc900 con 0x55ca5dfeb200 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f8111c280 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ca5d1fc600 con 0x55ca5dfead80 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f7e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea900 0x55ca5dee3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f7e000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea900 0x55ca5dee3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44528/0 (socket says 172.21.15.121:44528) 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f7e000640 1 -- 172.21.15.121:0/557039904 learned_addr learned my addr 172.21.15.121:0/557039904 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f7ea00640 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5dfead80 0x55ca5dee3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f7e000640 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5dfeb200 0x55ca5dee3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f7e000640 1 -- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5dfead80 msgr2=0x55ca5dee3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f7e000640 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5dfead80 0x55ca5dee3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f7e000640 1 -- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5dfeb200 msgr2=0x55ca5dee3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f7e000640 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5dfeb200 0x55ca5dee3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.863+0000 7f7f7e000640 1 -- 172.21.15.121:0/557039904 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca59118780 con 0x55ca5dfea900 2024-09-17T03:41:05.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.864+0000 7f7f7e000640 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea900 0x55ca5dee3080 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x55ca5dff99b0 tx=0x55ca5e01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:05.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.864+0000 7f7f77200640 1 -- 172.21.15.121:0/557039904 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ca59106340 con 0x55ca5dfea900 2024-09-17T03:41:05.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.864+0000 7f7f77200640 1 -- 172.21.15.121:0/557039904 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ca5910c380 con 0x55ca5dfea900 2024-09-17T03:41:05.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.864+0000 7f7f77200640 1 -- 172.21.15.121:0/557039904 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ca59106ea0 con 0x55ca5dfea900 2024-09-17T03:41:05.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.864+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca591194a0 con 0x55ca5dfea900 2024-09-17T03:41:05.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.864+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca59118960 con 0x55ca5dfea900 2024-09-17T03:41:05.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.864+0000 7f7f8111c280 4 main: resolving pool 17 2024-09-17T03:41:05.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.866+0000 7f7f77200640 1 -- 172.21.15.121:0/557039904 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x55ca5def0c00 con 0x55ca5dfea900 2024-09-17T03:41:05.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.867+0000 7f7f77200640 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x55ca5dfeda80 0x55ca5dee4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.867+0000 7f7f77200640 1 -- 172.21.15.121:0/557039904 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x55ca5df1c600 con 0x55ca5dfea900 2024-09-17T03:41:05.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.867+0000 7f7f8111c280 4 main: creating IoCtx.. 2024-09-17T03:41:05.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.867+0000 7f7f8111c280 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x55ca5dfeb680 0x55ca5dee4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.867+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 --> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] -- osd_op(unknown.0.0:1 17.b 17:d0630e4c:::mds0_sessionmap:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) -- 0x55ca5df1e800 con 0x55ca5dfeb680 2024-09-17T03:41:05.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.867+0000 7f7f7ea00640 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x55ca5dfeda80 0x55ca5dee4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.867+0000 7f7f7e000640 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x55ca5dfeb680 0x55ca5dee4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.868+0000 7f7f7ea00640 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x55ca5dfeda80 0x55ca5dee4100 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x55ca5dff8ba0 tx=0x55ca5d20cd20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:05.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.868+0000 7f7f7e000640 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x55ca5dfeb680 0x55ca5dee4680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:05.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.868+0000 7f7f7e000640 1 -- 172.21.15.121:0/557039904 <== osd.6 v2:172.21.15.176:6810/1810611479 1 ==== osd_op_reply(1 mds0_sessionmap [omap-get-header out=14b] v0'0 uv10 ondisk = 0) ==== 159+0+14 (crc 0 0 0) 0x55ca5d20a000 con 0x55ca5dfeb680 2024-09-17T03:41:05.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.868+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 --> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] -- osd_op(unknown.0.0:2 17.b 17:d0630e4c:::mds0_sessionmap:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) -- 0x55ca5df1ec00 con 0x55ca5dfeb680 2024-09-17T03:41:05.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.868+0000 7f7f7e000640 1 -- 172.21.15.121:0/557039904 <== osd.6 v2:172.21.15.176:6810/1810611479 2 ==== osd_op_reply(2 mds0_sessionmap [omap-get-vals out=5b] v0'0 uv10 ondisk = 0) ==== 159+0+5 (crc 0 0 0) 0x55ca5d20a000 con 0x55ca5dfeb680 2024-09-17T03:41:05.869 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:41:05.869 INFO:teuthology.orchestra.run.smithi121.stdout: "0": { 2024-09-17T03:41:05.869 INFO:teuthology.orchestra.run.smithi121.stdout: "data": { 2024-09-17T03:41:05.870 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [] 2024-09-17T03:41:05.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-17T03:41:05.870 INFO:teuthology.orchestra.run.smithi121.stdout: "result": 0 2024-09-17T03:41:05.870 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-17T03:41:05.870 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:41:05.870 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:05.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.868+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x55ca5dfeb680 msgr2=0x55ca5dee4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.868+0000 7f7f8111c280 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x55ca5dfeb680 0x55ca5dee4680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x55ca5dfeda80 msgr2=0x55ca5dee4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x55ca5dfeda80 0x55ca5dee4100 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x55ca5dff8ba0 tx=0x55ca5d20cd20 comp rx=0 tx=0).stop 2024-09-17T03:41:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea900 msgr2=0x55ca5dee3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 --2- 172.21.15.121:0/557039904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea900 0x55ca5dee3080 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x55ca5dff99b0 tx=0x55ca5e01acc0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f7ea00640 1 -- 172.21.15.121:0/557039904 reap_dead start 2024-09-17T03:41:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 shutdown_connections 2024-09-17T03:41:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 >> 172.21.15.121:0/557039904 conn(0x55ca5dfea480 msgr2=0x55ca5d251800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 shutdown_connections 2024-09-17T03:41:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/557039904 wait complete. 2024-09-17T03:41:05.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/923735432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea000 msgr2=0x55ca5dee2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 --2- 172.21.15.121:0/923735432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea000 0x55ca5dee2b00 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x55ca5df41890 tx=0x55ca5d20f080 comp rx=0 tx=0).stop 2024-09-17T03:41:05.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/923735432 shutdown_connections 2024-09-17T03:41:05.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 --2- 172.21.15.121:0/923735432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ca5dfea000 0x55ca5dee2b00 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 --2- 172.21.15.121:0/923735432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca5d2a3180 0x55ca5dee2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 --2- 172.21.15.121:0/923735432 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca5d2a3a80 0x55ca5dee2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/923735432 >> 172.21.15.121:0/923735432 conn(0x55ca5d2a3600 msgr2=0x55ca5d251000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:05.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/923735432 shutdown_connections 2024-09-17T03:41:05.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:05.869+0000 7f7f8111c280 1 -- 172.21.15.121:0/923735432 wait complete. 2024-09-17T03:41:05.881 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'session'] in time 0:00:00.165261, result: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-17T03:41:05.881 INFO:tasks.cephfs.test_sessionmap:SessionMap: { "0": { "data": { "sessions": [] }, "result": 0 } } 2024-09-17T03:41:05.882 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:41:05.882 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:41:05.979 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:41:06.070 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:41:06.070 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:41:06.070 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:41:06.071 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:06.109 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:41:06.109 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:41:06.109 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:41:06.109 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:06.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:41:06.144 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:41:06.145 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:41:06.145 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:06.183 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:41:06.184 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:41:06.184 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:41:06.184 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:06.220 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:41:06.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.442+0000 7f490f000640 1 -- 172.21.15.121:0/2741409867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f490815dbf0 msgr2=0x7f49080cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.442+0000 7f490f000640 1 --2- 172.21.15.121:0/2741409867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f490815dbf0 0x7f49080cf3e0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f49080cd9b0 tx=0x7f48f802a560 comp rx=0 tx=0).stop 2024-09-17T03:41:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.442+0000 7f490f000640 1 -- 172.21.15.121:0/2741409867 shutdown_connections 2024-09-17T03:41:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.442+0000 7f490f000640 1 --2- 172.21.15.121:0/2741409867 >> v2:172.21.15.176:3300/0 conn(0x7f49080cd210 0x7f49080ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.442+0000 7f490f000640 1 --2- 172.21.15.121:0/2741409867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49080af6d0 0x7f49080cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.442+0000 7f490f000640 1 --2- 172.21.15.121:0/2741409867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f490815dbf0 0x7f49080cf3e0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.442+0000 7f490f000640 1 -- 172.21.15.121:0/2741409867 >> 172.21.15.121:0/2741409867 conn(0x7f490806d4c0 msgr2=0x7f49080d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.442+0000 7f490f000640 1 -- 172.21.15.121:0/2741409867 shutdown_connections 2024-09-17T03:41:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.442+0000 7f490f000640 1 -- 172.21.15.121:0/2741409867 wait complete. 2024-09-17T03:41:06.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.445+0000 7f490f000640 1 Processor -- start 2024-09-17T03:41:06.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.445+0000 7f490f000640 1 -- start start 2024-09-17T03:41:06.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.446+0000 7f490f000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49080af6d0 0x7f490814a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.446+0000 7f490f000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49080cd210 0x7f49081f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.446+0000 7f490f000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f490815dbf0 0x7f49081f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.446+0000 7f490f000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f49080cece0 con 0x7f490815dbf0 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.446+0000 7f490f000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f49080ceb60 con 0x7f49080af6d0 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.446+0000 7f490f000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f49080cee60 con 0x7f49080cd210 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f490d000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f490815dbf0 0x7f49081f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f490d000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f490815dbf0 0x7f49081f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44558/0 (socket says 172.21.15.121:44558) 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f490d000640 1 -- 172.21.15.121:0/1146629434 learned_addr learned my addr 172.21.15.121:0/1146629434 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f4907400640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49080cd210 0x7f49081f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f4907e00640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49080af6d0 0x7f490814a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f490d000640 1 -- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49080cd210 msgr2=0x7f49081f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f490d000640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49080cd210 0x7f49081f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f490d000640 1 -- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49080af6d0 msgr2=0x7f490814a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f490d000640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49080af6d0 0x7f490814a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f490d000640 1 -- 172.21.15.121:0/1146629434 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490814a8f0 con 0x7f490815dbf0 2024-09-17T03:41:06.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.447+0000 7f490d000640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f490815dbf0 0x7f49081f0df0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f490000ea40 tx=0x7f490000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:06.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.448+0000 7f48ffe00640 1 -- 172.21.15.121:0/1146629434 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490000ce40 con 0x7f490815dbf0 2024-09-17T03:41:06.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.448+0000 7f48ffe00640 1 -- 172.21.15.121:0/1146629434 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4900004c10 con 0x7f490815dbf0 2024-09-17T03:41:06.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.448+0000 7f48ffe00640 1 -- 172.21.15.121:0/1146629434 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900005020 con 0x7f490815dbf0 2024-09-17T03:41:06.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.448+0000 7f490f000640 1 -- 172.21.15.121:0/1146629434 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4908153e20 con 0x7f490815dbf0 2024-09-17T03:41:06.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.448+0000 7f490f000640 1 -- 172.21.15.121:0/1146629434 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49081f3ba0 con 0x7f490815dbf0 2024-09-17T03:41:06.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.449+0000 7f490f000640 1 -- 172.21.15.121:0/1146629434 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49080694e0 con 0x7f490815dbf0 2024-09-17T03:41:06.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.450+0000 7f48ffe00640 1 -- 172.21.15.121:0/1146629434 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49000051c0 con 0x7f490815dbf0 2024-09-17T03:41:06.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.451+0000 7f48ffe00640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48e8078bc0 0x7f48e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.451+0000 7f48ffe00640 1 -- 172.21.15.121:0/1146629434 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f490009bc20 con 0x7f490815dbf0 2024-09-17T03:41:06.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.451+0000 7f4907e00640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48e8078bc0 0x7f48e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.452+0000 7f4907e00640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48e8078bc0 0x7f48e807b0d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f48f8033000 tx=0x7f48f8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:06.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.455+0000 7f48ffe00640 1 -- 172.21.15.121:0/1146629434 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f49080694e0 con 0x7f490815dbf0 2024-09-17T03:41:06.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.672+0000 7f490f000640 1 -- 172.21.15.121:0/1146629434 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49080ce1c0 con 0x7f490815dbf0 2024-09-17T03:41:06.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.673+0000 7f48ffe00640 1 -- 172.21.15.121:0/1146629434 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5256 (secure 0 0 0) 0x7f490814a8f0 con 0x7f490815dbf0 2024-09-17T03:41:06.673 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:06.673 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":88,"btime":"2024-09-17T03:40:59:566341+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2875035597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2875035597},{"type":"v1","addr":"172.21.15.121:6835","nonce":2875035597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2294887057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2294887057},{"type":"v1","addr":"172.21.15.176:6835","nonce":2294887057}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:58.795535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7332,"mds_1":6946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6946":{"gid":6946,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/762503506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":762503506},{"type":"v1","addr":"172.21.15.176:6837","nonce":762503506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7332":{"gid":7332,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6834/1935597076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1935597076},{"type":"v1","addr":"172.21.15.121:6834","nonce":1935597076}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7332,"qdb_cluster":[7332,6946]},"id":8}]} 2024-09-17T03:41:06.673 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 88 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.675+0000 7f490f000640 1 -- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48e8078bc0 msgr2=0x7f48e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.675+0000 7f490f000640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48e8078bc0 0x7f48e807b0d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f48f8033000 tx=0x7f48f8004730 comp rx=0 tx=0).stop 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.675+0000 7f490f000640 1 -- 172.21.15.121:0/1146629434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f490815dbf0 msgr2=0x7f49081f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.675+0000 7f490f000640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f490815dbf0 0x7f49081f0df0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f490000ea40 tx=0x7f490000ef00 comp rx=0 tx=0).stop 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.676+0000 7f490f000640 1 -- 172.21.15.121:0/1146629434 shutdown_connections 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.676+0000 7f490f000640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f48e8078bc0 0x7f48e807b0d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.676+0000 7f490f000640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f490815dbf0 0x7f49081f0df0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.676+0000 7f490f000640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49080cd210 0x7f49081f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.676+0000 7f490f000640 1 --2- 172.21.15.121:0/1146629434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49080af6d0 0x7f490814a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.676+0000 7f490f000640 1 -- 172.21.15.121:0/1146629434 >> 172.21.15.121:0/1146629434 conn(0x7f490806d4c0 msgr2=0x7f49080aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.676+0000 7f490f000640 1 -- 172.21.15.121:0/1146629434 shutdown_connections 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.676+0000 7f490f000640 1 -- 172.21.15.121:0/1146629434 wait complete. 2024-09-17T03:41:06.698 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.920+0000 7ff10a000640 1 -- 172.21.15.121:0/3439986231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1040af6d0 msgr2=0x7ff1040b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.920+0000 7ff10a000640 1 --2- 172.21.15.121:0/3439986231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1040af6d0 0x7ff1040b41b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff10415e000 tx=0x7ff0fc02aa30 comp rx=0 tx=0).stop 2024-09-17T03:41:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.920+0000 7ff10a000640 1 -- 172.21.15.121:0/3439986231 shutdown_connections 2024-09-17T03:41:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.920+0000 7ff10a000640 1 --2- 172.21.15.121:0/3439986231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1040af6d0 0x7ff1040b41b0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.920+0000 7ff10a000640 1 --2- 172.21.15.121:0/3439986231 >> v2:172.21.15.176:3300/0 conn(0x7ff1040cd3e0 0x7ff1040cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.920+0000 7ff10a000640 1 -- 172.21.15.121:0/3439986231 >> 172.21.15.121:0/3439986231 conn(0x7ff10406d4c0 msgr2=0x7ff1040d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.920+0000 7ff10a000640 1 -- 172.21.15.121:0/3439986231 shutdown_connections 2024-09-17T03:41:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.920+0000 7ff10a000640 1 -- 172.21.15.121:0/3439986231 wait complete. 2024-09-17T03:41:06.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.922+0000 7ff10a000640 1 Processor -- start 2024-09-17T03:41:06.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.922+0000 7ff10a000640 1 -- start start 2024-09-17T03:41:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff10a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1040af6d0 0x7ff104099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff10a000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff10415dbf0 0x7ff1040c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff10a000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1041567c0 0x7ff1040c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff10a000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff1040b4e40 con 0x7ff10415dbf0 2024-09-17T03:41:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff10a000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1040b4cc0 con 0x7ff1041567c0 2024-09-17T03:41:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff10a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1040b4fc0 con 0x7ff1040af6d0 2024-09-17T03:41:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff0fbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff10415dbf0 0x7ff1040c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff0fbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff10415dbf0 0x7ff1040c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44578/0 (socket says 172.21.15.121:44578) 2024-09-17T03:41:06.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff0fbe00640 1 -- 172.21.15.121:0/2334643646 learned_addr learned my addr 172.21.15.121:0/2334643646 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:06.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff103400640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1040af6d0 0x7ff104099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff103e00640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1041567c0 0x7ff1040c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff0fbe00640 1 -- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1040af6d0 msgr2=0x7ff104099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff0fbe00640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1040af6d0 0x7ff104099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff0fbe00640 1 -- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1041567c0 msgr2=0x7ff1040c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff0fbe00640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1041567c0 0x7ff1040c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.924+0000 7ff0fbe00640 1 -- 172.21.15.121:0/2334643646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1041575d0 con 0x7ff10415dbf0 2024-09-17T03:41:06.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.925+0000 7ff0fbe00640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff10415dbf0 0x7ff1040c5fc0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00d740 tx=0x7ff0ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:06.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.925+0000 7ff0fb400640 1 -- 172.21.15.121:0/2334643646 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec017070 con 0x7ff10415dbf0 2024-09-17T03:41:06.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.925+0000 7ff0fb400640 1 -- 172.21.15.121:0/2334643646 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0ec009cc0 con 0x7ff10415dbf0 2024-09-17T03:41:06.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.925+0000 7ff0fb400640 1 -- 172.21.15.121:0/2334643646 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0106c0 con 0x7ff10415dbf0 2024-09-17T03:41:06.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.925+0000 7ff10a000640 1 -- 172.21.15.121:0/2334643646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1041f6c90 con 0x7ff10415dbf0 2024-09-17T03:41:06.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.925+0000 7ff10a000640 1 -- 172.21.15.121:0/2334643646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1041590b0 con 0x7ff10415dbf0 2024-09-17T03:41:06.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.926+0000 7ff10a000640 1 -- 172.21.15.121:0/2334643646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1040b41b0 con 0x7ff10415dbf0 2024-09-17T03:41:06.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.927+0000 7ff0fb400640 1 -- 172.21.15.121:0/2334643646 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0ec01a070 con 0x7ff10415dbf0 2024-09-17T03:41:06.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.929+0000 7ff0fb400640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e0078bc0 0x7ff0e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.929+0000 7ff0fb400640 1 -- 172.21.15.121:0/2334643646 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7ff0ec09b0a0 con 0x7ff10415dbf0 2024-09-17T03:41:06.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.929+0000 7ff103400640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e0078bc0 0x7ff0e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.930+0000 7ff103400640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e0078bc0 0x7ff0e007b0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4006fd0 tx=0x7ff0f4009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:06.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:06.934+0000 7ff0fb400640 1 -- 172.21.15.121:0/2334643646 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff0ec062bc0 con 0x7ff10415dbf0 2024-09-17T03:41:07.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.152+0000 7ff10a000640 1 -- 172.21.15.121:0/2334643646 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff10415f860 con 0x7ff10415dbf0 2024-09-17T03:41:07.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.152+0000 7ff0fb400640 1 -- 172.21.15.121:0/2334643646 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5256 (secure 0 0 0) 0x7ff0ec0675f0 con 0x7ff10415dbf0 2024-09-17T03:41:07.152 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:07.153 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":88,"btime":"2024-09-17T03:40:59:566341+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2875035597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2875035597},{"type":"v1","addr":"172.21.15.121:6835","nonce":2875035597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2294887057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2294887057},{"type":"v1","addr":"172.21.15.176:6835","nonce":2294887057}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:58.795535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7332,"mds_1":6946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6946":{"gid":6946,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/762503506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":762503506},{"type":"v1","addr":"172.21.15.176:6837","nonce":762503506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7332":{"gid":7332,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6834/1935597076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1935597076},{"type":"v1","addr":"172.21.15.121:6834","nonce":1935597076}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7332,"qdb_cluster":[7332,6946]},"id":8}]} 2024-09-17T03:41:07.153 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 88 2024-09-17T03:41:07.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 -- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e0078bc0 msgr2=0x7ff0e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e0078bc0 0x7ff0e007b0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4006fd0 tx=0x7ff0f4009060 comp rx=0 tx=0).stop 2024-09-17T03:41:07.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 -- 172.21.15.121:0/2334643646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff10415dbf0 msgr2=0x7ff1040c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff10415dbf0 0x7ff1040c5fc0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00d740 tx=0x7ff0ec00dc00 comp rx=0 tx=0).stop 2024-09-17T03:41:07.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 -- 172.21.15.121:0/2334643646 shutdown_connections 2024-09-17T03:41:07.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1041567c0 0x7ff1040c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff0e0078bc0 0x7ff0e007b0d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff10415dbf0 0x7ff1040c5fc0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 --2- 172.21.15.121:0/2334643646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1040af6d0 0x7ff104099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 -- 172.21.15.121:0/2334643646 >> 172.21.15.121:0/2334643646 conn(0x7ff10406d4c0 msgr2=0x7ff10406f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:07.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 -- 172.21.15.121:0/2334643646 shutdown_connections 2024-09-17T03:41:07.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.155+0000 7ff10a000640 1 -- 172.21.15.121:0/2334643646 wait complete. 2024-09-17T03:41:07.176 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:07.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.396+0000 7fad94c00640 1 -- 172.21.15.121:0/3318621258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad900b35b0 msgr2=0x7fad900b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.396+0000 7fad94c00640 1 --2- 172.21.15.121:0/3318621258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad900b35b0 0x7fad900b39c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fad90071f20 tx=0x7fad8802aac0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.397+0000 7fad94c00640 1 -- 172.21.15.121:0/3318621258 shutdown_connections 2024-09-17T03:41:07.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.397+0000 7fad94c00640 1 --2- 172.21.15.121:0/3318621258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad900b35b0 0x7fad900b39c0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.397+0000 7fad94c00640 1 --2- 172.21.15.121:0/3318621258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad900cc450 0x7fad900cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.397+0000 7fad94c00640 1 --2- 172.21.15.121:0/3318621258 >> v2:172.21.15.176:3300/0 conn(0x7fad900d0fc0 0x7fad9015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.397+0000 7fad94c00640 1 -- 172.21.15.121:0/3318621258 >> 172.21.15.121:0/3318621258 conn(0x7fad9006d4c0 msgr2=0x7fad900d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:07.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.397+0000 7fad94c00640 1 -- 172.21.15.121:0/3318621258 shutdown_connections 2024-09-17T03:41:07.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.397+0000 7fad94c00640 1 -- 172.21.15.121:0/3318621258 wait complete. 2024-09-17T03:41:07.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.399+0000 7fad94c00640 1 Processor -- start 2024-09-17T03:41:07.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.399+0000 7fad94c00640 1 -- start start 2024-09-17T03:41:07.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.400+0000 7fad94c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad900b35b0 0x7fad900999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.400+0000 7fad94c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad900cc450 0x7fad90155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.400+0000 7fad94c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad900d0fc0 0x7fad9006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad94c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fad9006f920 con 0x7fad900b35b0 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad94c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad9006f7a0 con 0x7fad900cc450 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad94c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad9006faa0 con 0x7fad900d0fc0 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad900b35b0 0x7fad900999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8de00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad900b35b0 0x7fad900999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44600/0 (socket says 172.21.15.121:44600) 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8de00640 1 -- 172.21.15.121:0/3825780930 learned_addr learned my addr 172.21.15.121:0/3825780930 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8e800640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad900d0fc0 0x7fad9006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8d400640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad900cc450 0x7fad90155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8de00640 1 -- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad900d0fc0 msgr2=0x7fad9006ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8de00640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad900d0fc0 0x7fad9006ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8de00640 1 -- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad900cc450 msgr2=0x7fad90155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8de00640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad900cc450 0x7fad90155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8de00640 1 -- 172.21.15.121:0/3825780930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad901f71c0 con 0x7fad900b35b0 2024-09-17T03:41:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.401+0000 7fad8d400640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad900cc450 0x7fad90155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.402+0000 7fad8de00640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad900b35b0 0x7fad900999c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fad8000e7c0 tx=0x7fad8000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.402+0000 7fad86000640 1 -- 172.21.15.121:0/3825780930 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8000ccc0 con 0x7fad900b35b0 2024-09-17T03:41:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.402+0000 7fad86000640 1 -- 172.21.15.121:0/3825780930 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad80010430 con 0x7fad900b35b0 2024-09-17T03:41:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.402+0000 7fad86000640 1 -- 172.21.15.121:0/3825780930 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80010860 con 0x7fad900b35b0 2024-09-17T03:41:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.402+0000 7fad94c00640 1 -- 172.21.15.121:0/3825780930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad901f74a0 con 0x7fad900b35b0 2024-09-17T03:41:07.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.402+0000 7fad94c00640 1 -- 172.21.15.121:0/3825780930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad901548e0 con 0x7fad900b35b0 2024-09-17T03:41:07.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.403+0000 7fad94c00640 1 -- 172.21.15.121:0/3825780930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad90154b40 con 0x7fad900b35b0 2024-09-17T03:41:07.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.404+0000 7fad86000640 1 -- 172.21.15.121:0/3825780930 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad80010a00 con 0x7fad900b35b0 2024-09-17T03:41:07.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.405+0000 7fad86000640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fad70078bc0 0x7fad7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.405+0000 7fad86000640 1 -- 172.21.15.121:0/3825780930 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7fad8009b9b0 con 0x7fad900b35b0 2024-09-17T03:41:07.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.405+0000 7fad8d400640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fad70078bc0 0x7fad7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.406+0000 7fad8d400640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fad70078bc0 0x7fad7007b0d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fad901f6ed0 tx=0x7fad7c005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:07.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.410+0000 7fad86000640 1 -- 172.21.15.121:0/3825780930 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fad800634c0 con 0x7fad900b35b0 2024-09-17T03:41:07.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.594+0000 7fad94c00640 1 -- 172.21.15.121:0/3825780930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad900cfc20 con 0x7fad900b35b0 2024-09-17T03:41:07.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.595+0000 7fad86000640 1 -- 172.21.15.121:0/3825780930 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+17337 (secure 0 0 0) 0x7fad80067ef0 con 0x7fad900b35b0 2024-09-17T03:41:07.595 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:07.595 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":114,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:40:44.508600+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:40:23.482553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-17T03:40:24.531215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6836/2166412005":"2024-09-18T03:40:44.508573+0000","172.21.15.176:6834/2166412005":"2024-09-18T03:40:44.508573+0000","172.21.15.121:6835/697305237":"2024-09-18T03:40:43.506671+0000","172.21.15.121:6834/697305237":"2024-09-18T03:40:43.506671+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 -- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fad70078bc0 msgr2=0x7fad7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fad70078bc0 0x7fad7007b0d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fad901f6ed0 tx=0x7fad7c005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 -- 172.21.15.121:0/3825780930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad900b35b0 msgr2=0x7fad900999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad900b35b0 0x7fad900999c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fad8000e7c0 tx=0x7fad8000ec80 comp rx=0 tx=0).stop 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 -- 172.21.15.121:0/3825780930 shutdown_connections 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad900d0fc0 0x7fad9006ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad900cc450 0x7fad90155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fad70078bc0 0x7fad7007b0d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 --2- 172.21.15.121:0/3825780930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad900b35b0 0x7fad900999c0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 -- 172.21.15.121:0/3825780930 >> 172.21.15.121:0/3825780930 conn(0x7fad9006d4c0 msgr2=0x7fad900ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:07.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 -- 172.21.15.121:0/3825780930 shutdown_connections 2024-09-17T03:41:07.599 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.598+0000 7fad94c00640 1 -- 172.21.15.121:0/3825780930 wait complete. 2024-09-17T03:41:07.619 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:41:07.619 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:07.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.840+0000 7f3b59c00640 1 -- 172.21.15.121:0/980762396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b38003a50 msgr2=0x7f3b38003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.840+0000 7f3b59c00640 1 --2- 172.21.15.121:0/980762396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b38003a50 0x7f3b38003ec0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400c310 tx=0x7f3b38005830 comp rx=0 tx=0).stop 2024-09-17T03:41:07.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.840+0000 7f3b59c00640 1 -- 172.21.15.121:0/980762396 shutdown_connections 2024-09-17T03:41:07.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.840+0000 7f3b59c00640 1 --2- 172.21.15.121:0/980762396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b38003a50 0x7f3b38003ec0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.840+0000 7f3b59c00640 1 -- 172.21.15.121:0/980762396 >> 172.21.15.121:0/980762396 conn(0x7f3b540d13d0 msgr2=0x7f3b540d17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:07.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.840+0000 7f3b59c00640 1 -- 172.21.15.121:0/980762396 shutdown_connections 2024-09-17T03:41:07.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.840+0000 7f3b59c00640 1 -- 172.21.15.121:0/980762396 wait complete. 2024-09-17T03:41:07.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.842+0000 7f3b59c00640 1 Processor -- start 2024-09-17T03:41:07.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.842+0000 7f3b59c00640 1 -- start start 2024-09-17T03:41:07.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b59c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b38003a50 0x7f3b541f9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b59c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b541f5710 0x7f3b5409e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b59c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b540b5380 0x7f3b540b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b59c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b540cd210 con 0x7f3b540b5380 2024-09-17T03:41:07.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b59c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b540cd090 con 0x7f3b38003a50 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b59c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b540cd390 con 0x7f3b541f5710 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b53400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b540b5380 0x7f3b540b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b53400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b540b5380 0x7f3b540b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44624/0 (socket says 172.21.15.121:44624) 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b53400640 1 -- 172.21.15.121:0/3683239673 learned_addr learned my addr 172.21.15.121:0/3683239673 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b52a00640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b38003a50 0x7f3b541f9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.844+0000 7f3b4a000640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b541f5710 0x7f3b5409e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b53400640 1 -- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b541f5710 msgr2=0x7f3b5409e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b53400640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b541f5710 0x7f3b5409e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b53400640 1 -- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b38003a50 msgr2=0x7f3b541f9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b53400640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b38003a50 0x7f3b541f9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b53400640 1 -- 172.21.15.121:0/3683239673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b540b5cd0 con 0x7f3b540b5380 2024-09-17T03:41:07.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b53400640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b540b5380 0x7f3b540b5790 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f3b5406fc40 tx=0x7f3b4c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:07.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b4b400640 1 -- 172.21.15.121:0/3683239673 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c003d80 con 0x7f3b540b5380 2024-09-17T03:41:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b4b400640 1 -- 172.21.15.121:0/3683239673 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b4c004b20 con 0x7f3b540b5380 2024-09-17T03:41:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b59c00640 1 -- 172.21.15.121:0/3683239673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5415d070 con 0x7f3b540b5380 2024-09-17T03:41:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b4b400640 1 -- 172.21.15.121:0/3683239673 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c004030 con 0x7f3b540b5380 2024-09-17T03:41:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.845+0000 7f3b59c00640 1 -- 172.21.15.121:0/3683239673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b541f6140 con 0x7f3b540b5380 2024-09-17T03:41:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.846+0000 7f3b59c00640 1 -- 172.21.15.121:0/3683239673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b541f5bd0 con 0x7f3b540b5380 2024-09-17T03:41:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.847+0000 7f3b4b400640 1 -- 172.21.15.121:0/3683239673 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b4c0041d0 con 0x7f3b540b5380 2024-09-17T03:41:07.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.848+0000 7f3b4b400640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3b30078b90 0x7f3b3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.849+0000 7f3b4b400640 1 -- 172.21.15.121:0/3683239673 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f3b4c09bd30 con 0x7f3b540b5380 2024-09-17T03:41:07.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.849+0000 7f3b52a00640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3b30078b90 0x7f3b3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.850+0000 7f3b52a00640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3b30078b90 0x7f3b3007b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3b44033000 tx=0x7f3b540b6b00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:07.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:07.853+0000 7f3b4b400640 1 -- 172.21.15.121:0/3683239673 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3b540b5cd0 con 0x7f3b540b5380 2024-09-17T03:41:08.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.069+0000 7f3b59c00640 1 -- 172.21.15.121:0/3683239673 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b540b2080 con 0x7f3b540b5380 2024-09-17T03:41:08.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.069+0000 7f3b4b400640 1 -- 172.21.15.121:0/3683239673 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5256 (secure 0 0 0) 0x7f3b4c0638d0 con 0x7f3b540b5380 2024-09-17T03:41:08.382 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:08.382 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":88,"btime":"2024-09-17T03:40:59:566341+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2875035597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2875035597},{"type":"v1","addr":"172.21.15.121:6835","nonce":2875035597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2294887057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2294887057},{"type":"v1","addr":"172.21.15.176:6835","nonce":2294887057}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:58.795535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7332,"mds_1":6946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6946":{"gid":6946,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/762503506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":762503506},{"type":"v1","addr":"172.21.15.176:6837","nonce":762503506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7332":{"gid":7332,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6834/1935597076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1935597076},{"type":"v1","addr":"172.21.15.121:6834","nonce":1935597076}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7332,"qdb_cluster":[7332,6946]},"id":8}]} 2024-09-17T03:41:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 88 2024-09-17T03:41:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 -- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3b30078b90 msgr2=0x7f3b3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3b30078b90 0x7f3b3007b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3b44033000 tx=0x7f3b540b6b00 comp rx=0 tx=0).stop 2024-09-17T03:41:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 -- 172.21.15.121:0/3683239673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b540b5380 msgr2=0x7f3b540b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b540b5380 0x7f3b540b5790 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f3b5406fc40 tx=0x7f3b4c00f790 comp rx=0 tx=0).stop 2024-09-17T03:41:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 -- 172.21.15.121:0/3683239673 shutdown_connections 2024-09-17T03:41:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3b30078b90 0x7f3b3007b0a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b540b5380 0x7f3b540b5790 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b541f5710 0x7f3b5409e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 --2- 172.21.15.121:0/3683239673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b38003a50 0x7f3b541f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 -- 172.21.15.121:0/3683239673 >> 172.21.15.121:0/3683239673 conn(0x7f3b540d13d0 msgr2=0x7f3b54160630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:08.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 -- 172.21.15.121:0/3683239673 shutdown_connections 2024-09-17T03:41:08.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.072+0000 7f3b59c00640 1 -- 172.21.15.121:0/3683239673 wait complete. 2024-09-17T03:41:08.386 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:08.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.606+0000 7f648fe00640 1 -- 172.21.15.121:0/1063631091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6490162300 msgr2=0x7f649015ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.606+0000 7f648fe00640 1 --2- 172.21.15.121:0/1063631091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6490162300 0x7f649015ed10 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6490162240 tx=0x7f648002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.606+0000 7f648fe00640 1 -- 172.21.15.121:0/1063631091 shutdown_connections 2024-09-17T03:41:08.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.606+0000 7f648fe00640 1 --2- 172.21.15.121:0/1063631091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64900d0c60 0x7f64900d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.606+0000 7f648fe00640 1 --2- 172.21.15.121:0/1063631091 >> v2:172.21.15.176:3300/0 conn(0x7f649015c280 0x7f64900ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.606+0000 7f648fe00640 1 --2- 172.21.15.121:0/1063631091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6490162300 0x7f649015ed10 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.606+0000 7f648fe00640 1 -- 172.21.15.121:0/1063631091 >> 172.21.15.121:0/1063631091 conn(0x7f649006ddc0 msgr2=0x7f649006e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:08.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.606+0000 7f648fe00640 1 -- 172.21.15.121:0/1063631091 shutdown_connections 2024-09-17T03:41:08.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.606+0000 7f648fe00640 1 -- 172.21.15.121:0/1063631091 wait complete. 2024-09-17T03:41:08.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.608+0000 7f648fe00640 1 Processor -- start 2024-09-17T03:41:08.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.608+0000 7f648fe00640 1 -- start start 2024-09-17T03:41:08.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648fe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64900d0c60 0x7f649015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f649015c280 0x7f64901508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6490162300 0x7f64901605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648fe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f64900d3460 con 0x7f64900d0c60 2024-09-17T03:41:08.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f64900cf2a0 con 0x7f649015c280 2024-09-17T03:41:08.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f64900d35e0 con 0x7f6490162300 2024-09-17T03:41:08.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64900d0c60 0x7f649015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648ea00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64900d0c60 0x7f649015a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44638/0 (socket says 172.21.15.121:44638) 2024-09-17T03:41:08.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648ea00640 1 -- 172.21.15.121:0/883178014 learned_addr learned my addr 172.21.15.121:0/883178014 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:08.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648e000640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f649015c280 0x7f64901508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.610+0000 7f648f400640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6490162300 0x7f64901605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f648ea00640 1 -- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6490162300 msgr2=0x7f64901605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f648ea00640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6490162300 0x7f64901605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f648ea00640 1 -- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f649015c280 msgr2=0x7f64901508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f648ea00640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f649015c280 0x7f64901508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f648ea00640 1 -- 172.21.15.121:0/883178014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64900b6e20 con 0x7f64900d0c60 2024-09-17T03:41:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f648ea00640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64900d0c60 0x7f649015a0c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6480034040 tx=0x7f6480003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f6486a00640 1 -- 172.21.15.121:0/883178014 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648003e030 con 0x7f64900d0c60 2024-09-17T03:41:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f6486a00640 1 -- 172.21.15.121:0/883178014 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6480003e00 con 0x7f64900d0c60 2024-09-17T03:41:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f648fe00640 1 -- 172.21.15.121:0/883178014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64900b6580 con 0x7f64900d0c60 2024-09-17T03:41:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f6486a00640 1 -- 172.21.15.121:0/883178014 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480035040 con 0x7f64900d0c60 2024-09-17T03:41:08.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.611+0000 7f648fe00640 1 -- 172.21.15.121:0/883178014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64900b6b40 con 0x7f64900d0c60 2024-09-17T03:41:08.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.612+0000 7f648fe00640 1 -- 172.21.15.121:0/883178014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6490159ea0 con 0x7f64900d0c60 2024-09-17T03:41:08.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.613+0000 7f6486a00640 1 -- 172.21.15.121:0/883178014 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6480041030 con 0x7f64900d0c60 2024-09-17T03:41:08.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.614+0000 7f6486a00640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6470078b90 0x7f647007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.615+0000 7f6486a00640 1 -- 172.21.15.121:0/883178014 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f64800bb760 con 0x7f64900d0c60 2024-09-17T03:41:08.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.615+0000 7f648e000640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6470078b90 0x7f647007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.616+0000 7f648e000640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6470078b90 0x7f647007b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f64900c7f40 tx=0x7f647c00b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:08.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.619+0000 7f6486a00640 1 -- 172.21.15.121:0/883178014 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6490159ea0 con 0x7f64900d0c60 2024-09-17T03:41:08.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.835+0000 7f648fe00640 1 -- 172.21.15.121:0/883178014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64901619f0 con 0x7f64900d0c60 2024-09-17T03:41:08.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.836+0000 7f6486a00640 1 -- 172.21.15.121:0/883178014 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5256 (secure 0 0 0) 0x7f6480083300 con 0x7f64900d0c60 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":88,"btime":"2024-09-17T03:40:59:566341+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2875035597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2875035597},{"type":"v1","addr":"172.21.15.121:6835","nonce":2875035597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2294887057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2294887057},{"type":"v1","addr":"172.21.15.176:6835","nonce":2294887057}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:25.564895+0000","modified":"2024-09-17T03:40:58.795535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7332,"mds_1":6946},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6946":{"gid":6946,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6837/762503506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":762503506},{"type":"v1","addr":"172.21.15.176:6837","nonce":762503506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7332":{"gid":7332,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6834/1935597076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1935597076},{"type":"v1","addr":"172.21.15.121:6834","nonce":1935597076}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7332,"qdb_cluster":[7332,6946]},"id":8}]} 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 88 2024-09-17T03:41:08.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 -- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6470078b90 msgr2=0x7f647007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6470078b90 0x7f647007b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f64900c7f40 tx=0x7f647c00b390 comp rx=0 tx=0).stop 2024-09-17T03:41:08.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 -- 172.21.15.121:0/883178014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64900d0c60 msgr2=0x7f649015a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64900d0c60 0x7f649015a0c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6480034040 tx=0x7f6480003910 comp rx=0 tx=0).stop 2024-09-17T03:41:08.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 -- 172.21.15.121:0/883178014 shutdown_connections 2024-09-17T03:41:08.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6490162300 0x7f64901605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f649015c280 0x7f64901508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f6470078b90 0x7f647007b0a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 --2- 172.21.15.121:0/883178014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64900d0c60 0x7f649015a0c0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 -- 172.21.15.121:0/883178014 >> 172.21.15.121:0/883178014 conn(0x7f649006ddc0 msgr2=0x7f64900b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:08.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.838+0000 7f648fe00640 1 -- 172.21.15.121:0/883178014 shutdown_connections 2024-09-17T03:41:08.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:08.839+0000 7f648fe00640 1 -- 172.21.15.121:0/883178014 wait complete. 2024-09-17T03:41:08.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:09.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.083+0000 7f7c72c00640 1 -- 172.21.15.121:0/3228181512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0cc450 msgr2=0x7f7c6c0cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.083+0000 7f7c72c00640 1 --2- 172.21.15.121:0/3228181512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0cc450 0x7f7c6c0cfc20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009830 tx=0x7f7c5802a530 comp rx=0 tx=0).stop 2024-09-17T03:41:09.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.083+0000 7f7c72c00640 1 -- 172.21.15.121:0/3228181512 shutdown_connections 2024-09-17T03:41:09.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.083+0000 7f7c72c00640 1 --2- 172.21.15.121:0/3228181512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0cc450 0x7f7c6c0cfc20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.083+0000 7f7c72c00640 1 --2- 172.21.15.121:0/3228181512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0d0fc0 0x7f7c6c15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.083+0000 7f7c72c00640 1 -- 172.21.15.121:0/3228181512 >> 172.21.15.121:0/3228181512 conn(0x7f7c6c06d4c0 msgr2=0x7f7c6c0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:09.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.083+0000 7f7c72c00640 1 -- 172.21.15.121:0/3228181512 shutdown_connections 2024-09-17T03:41:09.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.083+0000 7f7c72c00640 1 -- 172.21.15.121:0/3228181512 wait complete. 2024-09-17T03:41:09.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.085+0000 7f7c72c00640 1 Processor -- start 2024-09-17T03:41:09.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.086+0000 7f7c72c00640 1 -- start start 2024-09-17T03:41:09.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c72c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c6c0b35b0 0x7f7c6c1f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c72c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0cc450 0x7f7c6c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c72c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0d0fc0 0x7f7c6c1f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c72c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c06f6c0 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c72c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c06f540 con 0x7f7c6c0cc450 2024-09-17T03:41:09.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c72c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6c06f840 con 0x7f7c6c0d0fc0 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c6be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c6c0b35b0 0x7f7c6c1f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c6be00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c6c0b35b0 0x7f7c6c1f54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44652/0 (socket says 172.21.15.121:44652) 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c6be00640 1 -- 172.21.15.121:0/358954006 learned_addr learned my addr 172.21.15.121:0/358954006 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c6b400640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0cc450 0x7f7c6c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.087+0000 7f7c70c00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0d0fc0 0x7f7c6c1f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c6be00640 1 -- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0d0fc0 msgr2=0x7f7c6c1f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c6be00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0d0fc0 0x7f7c6c1f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c6be00640 1 -- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0cc450 msgr2=0x7f7c6c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c6be00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0cc450 0x7f7c6c0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c6be00640 1 -- 172.21.15.121:0/358954006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6c0b2400 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c6be00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c6c0b35b0 0x7f7c6c1f54c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00e7c0 tx=0x7f7c5c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c63e00640 1 -- 172.21.15.121:0/358954006 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00ccc0 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c63e00640 1 -- 172.21.15.121:0/358954006 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c5c010430 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c72c00640 1 -- 172.21.15.121:0/358954006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6c0b26e0 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c63e00640 1 -- 172.21.15.121:0/358954006 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c010860 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.088+0000 7f7c72c00640 1 -- 172.21.15.121:0/358954006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6c15e790 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.089+0000 7f7c72c00640 1 -- 172.21.15.121:0/358954006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c6c06fcf0 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.091+0000 7f7c63e00640 1 -- 172.21.15.121:0/358954006 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c5c010a00 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.092+0000 7f7c63e00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7c4c078bc0 0x7f7c4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.092+0000 7f7c63e00640 1 -- 172.21.15.121:0/358954006 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f7c5c09b940 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.092+0000 7f7c6b400640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7c4c078bc0 0x7f7c4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.093+0000 7f7c6b400640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7c4c078bc0 0x7f7c4c07b0d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7c58034000 tx=0x7f7c58033040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:09.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.096+0000 7f7c63e00640 1 -- 172.21.15.121:0/358954006 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7c5c063b40 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.280+0000 7f7c72c00640 1 -- 172.21.15.121:0/358954006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c6c15d050 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.281+0000 7f7c63e00640 1 -- 172.21.15.121:0/358954006 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+17337 (secure 0 0 0) 0x7f7c5c063440 con 0x7f7c6c0b35b0 2024-09-17T03:41:09.281 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:09.282 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":114,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:40:44.508600+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:40:23.482553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-17T03:40:24.531215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6836/2166412005":"2024-09-18T03:40:44.508573+0000","172.21.15.176:6834/2166412005":"2024-09-18T03:40:44.508573+0000","172.21.15.121:6835/697305237":"2024-09-18T03:40:43.506671+0000","172.21.15.121:6834/697305237":"2024-09-18T03:40:43.506671+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:09.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 -- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7c4c078bc0 msgr2=0x7f7c4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7c4c078bc0 0x7f7c4c07b0d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7c58034000 tx=0x7f7c58033040 comp rx=0 tx=0).stop 2024-09-17T03:41:09.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 -- 172.21.15.121:0/358954006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c6c0b35b0 msgr2=0x7f7c6c1f54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c6c0b35b0 0x7f7c6c1f54c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00e7c0 tx=0x7f7c5c00ec80 comp rx=0 tx=0).stop 2024-09-17T03:41:09.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 -- 172.21.15.121:0/358954006 shutdown_connections 2024-09-17T03:41:09.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0d0fc0 0x7f7c6c1f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0cc450 0x7f7c6c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7c4c078bc0 0x7f7c4c07b0d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 --2- 172.21.15.121:0/358954006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c6c0b35b0 0x7f7c6c1f54c0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 -- 172.21.15.121:0/358954006 >> 172.21.15.121:0/358954006 conn(0x7f7c6c06d4c0 msgr2=0x7f7c6c0ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:09.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 -- 172.21.15.121:0/358954006 shutdown_connections 2024-09-17T03:41:09.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.284+0000 7f7c72c00640 1 -- 172.21.15.121:0/358954006 wait complete. 2024-09-17T03:41:09.309 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:41:09.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.530+0000 7f770d200640 1 -- 172.21.15.121:0/2185299699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77080d0c60 msgr2=0x7f77080d1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.530+0000 7f770d200640 1 --2- 172.21.15.121:0/2185299699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77080d0c60 0x7f77080d1070 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f77080cb4f0 tx=0x7f770002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.530+0000 7f770d200640 1 -- 172.21.15.121:0/2185299699 shutdown_connections 2024-09-17T03:41:09.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.530+0000 7f770d200640 1 --2- 172.21.15.121:0/2185299699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77080d0c60 0x7f77080d1070 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.530+0000 7f770d200640 1 --2- 172.21.15.121:0/2185299699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770815c280 0x7f77080ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.530+0000 7f770d200640 1 --2- 172.21.15.121:0/2185299699 >> v2:172.21.15.176:3300/0 conn(0x7f7708162300 0x7f770815ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.530+0000 7f770d200640 1 -- 172.21.15.121:0/2185299699 >> 172.21.15.121:0/2185299699 conn(0x7f770806ddc0 msgr2=0x7f770806e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:09.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.530+0000 7f770d200640 1 -- 172.21.15.121:0/2185299699 shutdown_connections 2024-09-17T03:41:09.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.530+0000 7f770d200640 1 -- 172.21.15.121:0/2185299699 wait complete. 2024-09-17T03:41:09.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.532+0000 7f770d200640 1 Processor -- start 2024-09-17T03:41:09.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.533+0000 7f770d200640 1 -- start start 2024-09-17T03:41:09.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.534+0000 7f770d200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77080d0c60 0x7f7708155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.534+0000 7f770d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770815c280 0x7f7708157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.534+0000 7f770d200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7708162300 0x7f77080c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.534+0000 7f770d200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77080d3460 con 0x7f77080d0c60 2024-09-17T03:41:09.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.534+0000 7f770d200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f77080cf2a0 con 0x7f7708162300 2024-09-17T03:41:09.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.534+0000 7f770d200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f77080d35e0 con 0x7f770815c280 2024-09-17T03:41:09.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.534+0000 7f7707400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77080d0c60 0x7f7708155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.534+0000 7f7707400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77080d0c60 0x7f7708155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44656/0 (socket says 172.21.15.121:44656) 2024-09-17T03:41:09.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.534+0000 7f7707400640 1 -- 172.21.15.121:0/1860508703 learned_addr learned my addr 172.21.15.121:0/1860508703 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:09.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.534+0000 7f7706a00640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770815c280 0x7f7708157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f7707e00640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7708162300 0x7f77080c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f7707400640 1 -- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770815c280 msgr2=0x7f7708157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f7707400640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770815c280 0x7f7708157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f7707400640 1 -- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7708162300 msgr2=0x7f77080c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f7707400640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7708162300 0x7f77080c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f7707400640 1 -- 172.21.15.121:0/1860508703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77081582e0 con 0x7f77080d0c60 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f7707e00640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7708162300 0x7f77080c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f7707400640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77080d0c60 0x7f7708155390 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f76f800ea20 tx=0x7f76f800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f76ff400640 1 -- 172.21.15.121:0/1860508703 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f800cd80 con 0x7f77080d0c60 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f76ff400640 1 -- 172.21.15.121:0/1860508703 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76f8011560 con 0x7f77080d0c60 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f76ff400640 1 -- 172.21.15.121:0/1860508703 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8011990 con 0x7f77080d0c60 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f770d200640 1 -- 172.21.15.121:0/1860508703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77081585c0 con 0x7f77080d0c60 2024-09-17T03:41:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.535+0000 7f770d200640 1 -- 172.21.15.121:0/1860508703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7708158b80 con 0x7f77080d0c60 2024-09-17T03:41:09.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.536+0000 7f770d200640 1 -- 172.21.15.121:0/1860508703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77080ced60 con 0x7f77080d0c60 2024-09-17T03:41:09.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.538+0000 7f76ff400640 1 -- 172.21.15.121:0/1860508703 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f76f8011b30 con 0x7f77080d0c60 2024-09-17T03:41:09.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.539+0000 7f76ff400640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f76e8078bc0 0x7f76e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.539+0000 7f76ff400640 1 -- 172.21.15.121:0/1860508703 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6273+0+0 (secure 0 0 0) 0x7f76f809ba00 con 0x7f77080d0c60 2024-09-17T03:41:09.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.539+0000 7f7706a00640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f76e8078bc0 0x7f76e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.540+0000 7f7706a00640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f76e8078bc0 0x7f76e807b0d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f77080cfd40 tx=0x7f76f400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:09.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.544+0000 7f76ff400640 1 -- 172.21.15.121:0/1860508703 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f76f8016030 con 0x7f77080d0c60 2024-09-17T03:41:09.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.765+0000 7f770d200640 1 -- 172.21.15.121:0/1860508703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f770806f200 con 0x7f77080d0c60 2024-09-17T03:41:09.765 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-17T03:41:09.766+0000 7f1def400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:41:09.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.768+0000 7f76ff400640 1 -- 172.21.15.121:0/1860508703 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) ==== 161+0+0 (secure 0 0 0) 0x7f76f8011e20 con 0x7f77080d0c60 2024-09-17T03:41:09.768 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:41:09.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.771+0000 7f770d200640 1 -- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f76e8078bc0 msgr2=0x7f76e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.771+0000 7f770d200640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f76e8078bc0 0x7f76e807b0d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f77080cfd40 tx=0x7f76f400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.771+0000 7f770d200640 1 -- 172.21.15.121:0/1860508703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77080d0c60 msgr2=0x7f7708155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.771+0000 7f770d200640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77080d0c60 0x7f7708155390 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f76f800ea20 tx=0x7f76f800eee0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.771+0000 7f770d200640 1 -- 172.21.15.121:0/1860508703 shutdown_connections 2024-09-17T03:41:09.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.771+0000 7f770d200640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7708162300 0x7f77080c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.771+0000 7f770d200640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f770815c280 0x7f7708157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.771+0000 7f770d200640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f76e8078bc0 0x7f76e807b0d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.771+0000 7f770d200640 1 --2- 172.21.15.121:0/1860508703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77080d0c60 0x7f7708155390 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.771+0000 7f770d200640 1 -- 172.21.15.121:0/1860508703 >> 172.21.15.121:0/1860508703 conn(0x7f770806ddc0 msgr2=0x7f770815fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:09.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.772+0000 7f770d200640 1 -- 172.21.15.121:0/1860508703 shutdown_connections 2024-09-17T03:41:09.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:09.772+0000 7f770d200640 1 -- 172.21.15.121:0/1860508703 wait complete. 2024-09-17T03:41:09.782 INFO:tasks.ceph.mds.a.smithi121.stderr: -5496> 2024-09-17T03:40:50.522+0000 7f9c7d800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:41:09.786 INFO:tasks.ceph.mds.a.smithi121.stderr: -3254> 2024-09-17T03:40:55.522+0000 7f9c7d800640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-17T03:41:09.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:41:09.895 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-17T03:41:09.908 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-17T03:41:10.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.027+0000 7f4430200640 1 -- 172.21.15.121:0/2270597293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44280cd3e0 msgr2=0x7f44280cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:10.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.027+0000 7f4430200640 1 --2- 172.21.15.121:0/2270597293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44280cd3e0 0x7f44280cf3e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4414009830 tx=0x7f441402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.027+0000 7f4430200640 1 -- 172.21.15.121:0/2270597293 shutdown_connections 2024-09-17T03:41:10.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.027+0000 7f4430200640 1 --2- 172.21.15.121:0/2270597293 >> v2:172.21.15.176:3300/0 conn(0x7f44280af6d0 0x7f44280b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.027+0000 7f4430200640 1 --2- 172.21.15.121:0/2270597293 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44280cd3e0 0x7f44280cf3e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.027+0000 7f4430200640 1 -- 172.21.15.121:0/2270597293 >> 172.21.15.121:0/2270597293 conn(0x7f442806d4c0 msgr2=0x7f44280d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:10.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.027+0000 7f4430200640 1 -- 172.21.15.121:0/2270597293 shutdown_connections 2024-09-17T03:41:10.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.027+0000 7f4430200640 1 -- 172.21.15.121:0/2270597293 wait complete. 2024-09-17T03:41:10.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.029+0000 7f4430200640 1 Processor -- start 2024-09-17T03:41:10.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.029+0000 7f4430200640 1 -- start start 2024-09-17T03:41:10.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f4430200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44280af6d0 0x7f44280b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:10.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f4430200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442815dbf0 0x7f44281f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:10.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f4430200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44281534f0 0x7f44280caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:10.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f4430200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44280b4ec0 con 0x7f442815dbf0 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f4430200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44280b4d40 con 0x7f44280af6d0 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f4430200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44280b5040 con 0x7f44281534f0 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f442ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442815dbf0 0x7f44281f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f442ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442815dbf0 0x7f44281f5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44670/0 (socket says 172.21.15.121:44670) 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f442ce00640 1 -- 172.21.15.121:0/2432555391 learned_addr learned my addr 172.21.15.121:0/2432555391 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f442d800640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44280af6d0 0x7f44280b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f442e200640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44281534f0 0x7f44280caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f442ce00640 1 -- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44281534f0 msgr2=0x7f44280caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f442ce00640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44281534f0 0x7f44280caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f442ce00640 1 -- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44280af6d0 msgr2=0x7f44280b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:10.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f442ce00640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44280af6d0 0x7f44280b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.031+0000 7f442ce00640 1 -- 172.21.15.121:0/2432555391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44280b0d70 con 0x7f442815dbf0 2024-09-17T03:41:10.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.032+0000 7f442e200640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44281534f0 0x7f44280caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:10.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.032+0000 7f442d800640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44280af6d0 0x7f44280b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:10.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.032+0000 7f442ce00640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442815dbf0 0x7f44281f5730 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f4414009950 tx=0x7f4414003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:10.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.032+0000 7f4425600640 1 -- 172.21.15.121:0/2432555391 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414005c90 con 0x7f442815dbf0 2024-09-17T03:41:10.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.032+0000 7f4425600640 1 -- 172.21.15.121:0/2432555391 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4414005020 con 0x7f442815dbf0 2024-09-17T03:41:10.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.032+0000 7f4430200640 1 -- 172.21.15.121:0/2432555391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44280b1270 con 0x7f442815dbf0 2024-09-17T03:41:10.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.032+0000 7f4425600640 1 -- 172.21.15.121:0/2432555391 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414005450 con 0x7f442815dbf0 2024-09-17T03:41:10.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.032+0000 7f4430200640 1 -- 172.21.15.121:0/2432555391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44280b1830 con 0x7f442815dbf0 2024-09-17T03:41:10.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.033+0000 7f4430200640 1 -- 172.21.15.121:0/2432555391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44280cf3e0 con 0x7f442815dbf0 2024-09-17T03:41:10.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.034+0000 7f4425600640 1 -- 172.21.15.121:0/2432555391 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44140317c0 con 0x7f442815dbf0 2024-09-17T03:41:10.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.035+0000 7f4425600640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4408078bc0 0x7f440807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:10.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.035+0000 7f4425600640 1 -- 172.21.15.121:0/2432555391 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6445+0+0 (secure 0 0 0) 0x7f44140bc090 con 0x7f442815dbf0 2024-09-17T03:41:10.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.036+0000 7f442d800640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4408078bc0 0x7f440807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:10.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.037+0000 7f442d800640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4408078bc0 0x7f440807b0d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f44280709c0 tx=0x7f441c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:10.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.040+0000 7f4425600640 1 -- 172.21.15.121:0/2432555391 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f44280cf3e0 con 0x7f442815dbf0 2024-09-17T03:41:10.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.258+0000 7f4430200640 1 -- 172.21.15.121:0/2432555391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f44280b41b0 con 0x7f442815dbf0 2024-09-17T03:41:10.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.771+0000 7f4425600640 1 -- 172.21.15.121:0/2432555391 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v90) ==== 104+0+0 (secure 0 0 0) 0x7f441403f030 con 0x7f442815dbf0 2024-09-17T03:41:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 -- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4408078bc0 msgr2=0x7f440807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4408078bc0 0x7f440807b0d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f44280709c0 tx=0x7f441c009040 comp rx=0 tx=0).stop 2024-09-17T03:41:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 -- 172.21.15.121:0/2432555391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442815dbf0 msgr2=0x7f44281f5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442815dbf0 0x7f44281f5730 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f4414009950 tx=0x7f4414003c10 comp rx=0 tx=0).stop 2024-09-17T03:41:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 -- 172.21.15.121:0/2432555391 shutdown_connections 2024-09-17T03:41:10.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44281534f0 0x7f44280caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4408078bc0 0x7f440807b0d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442815dbf0 0x7f44281f5730 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 --2- 172.21.15.121:0/2432555391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44280af6d0 0x7f44280b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 -- 172.21.15.121:0/2432555391 >> 172.21.15.121:0/2432555391 conn(0x7f442806d4c0 msgr2=0x7f44280ad0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:10.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 -- 172.21.15.121:0/2432555391 shutdown_connections 2024-09-17T03:41:10.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:10.774+0000 7f4430200640 1 -- 172.21.15.121:0/2432555391 wait complete. 2024-09-17T03:41:10.797 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:41:11.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.023+0000 7f07cfe00640 1 -- 172.21.15.121:0/2961141579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07b0004d40 msgr2=0x7f07b0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:11.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.023+0000 7f07cfe00640 1 --2- 172.21.15.121:0/2961141579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07b0004d40 0x7f07b0005150 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f07c0005fd0 tx=0x7f07b0005830 comp rx=0 tx=0).stop 2024-09-17T03:41:11.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.023+0000 7f07cde00640 1 -- 172.21.15.121:0/2961141579 reap_dead start 2024-09-17T03:41:11.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.023+0000 7f07cfe00640 1 -- 172.21.15.121:0/2961141579 shutdown_connections 2024-09-17T03:41:11.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.023+0000 7f07cfe00640 1 -- 172.21.15.121:0/2961141579 >> 172.21.15.121:0/2961141579 conn(0x7f07c806d7d0 msgr2=0x7f07c80b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:11.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.023+0000 7f07cfe00640 1 -- 172.21.15.121:0/2961141579 shutdown_connections 2024-09-17T03:41:11.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.023+0000 7f07cfe00640 1 -- 172.21.15.121:0/2961141579 wait complete. 2024-09-17T03:41:11.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.025+0000 7f07cfe00640 1 Processor -- start 2024-09-17T03:41:11.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.025+0000 7f07cfe00640 1 -- start start 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.026+0000 7f07cfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07b0004d40 0x7f07c81445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07c814c800 0x7f07c814efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c814f510 0x7f07c81f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cfe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f07c815f710 con 0x7f07b0004d40 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cfe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f07c815f590 con 0x7f07c814f510 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cfe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f07c8152510 con 0x7f07c814c800 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cd400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07b0004d40 0x7f07c81445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cd400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07b0004d40 0x7f07c81445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44690/0 (socket says 172.21.15.121:44690) 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cd400640 1 -- 172.21.15.121:0/760625378 learned_addr learned my addr 172.21.15.121:0/760625378 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cca00640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07c814c800 0x7f07c814efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:11.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cde00640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c814f510 0x7f07c81f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:11.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cd400640 1 -- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07c814c800 msgr2=0x7f07c814efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:11.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cd400640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07c814c800 0x7f07c814efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:11.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cd400640 1 -- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c814f510 msgr2=0x7f07c81f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:11.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cd400640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c814f510 0x7f07c81f6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:11.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cd400640 1 -- 172.21.15.121:0/760625378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c814f920 con 0x7f07b0004d40 2024-09-17T03:41:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.027+0000 7f07cd400640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07b0004d40 0x7f07c81445d0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f07bc001940 tx=0x7f07bc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.028+0000 7f07c5600640 1 -- 172.21.15.121:0/760625378 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc015070 con 0x7f07b0004d40 2024-09-17T03:41:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.028+0000 7f07c5600640 1 -- 172.21.15.121:0/760625378 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07bc00f960 con 0x7f07b0004d40 2024-09-17T03:41:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.028+0000 7f07c5600640 1 -- 172.21.15.121:0/760625378 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc00fdb0 con 0x7f07b0004d40 2024-09-17T03:41:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.028+0000 7f07cfe00640 1 -- 172.21.15.121:0/760625378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c814d410 con 0x7f07b0004d40 2024-09-17T03:41:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.028+0000 7f07cfe00640 1 -- 172.21.15.121:0/760625378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c814e360 con 0x7f07b0004d40 2024-09-17T03:41:11.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.029+0000 7f07cfe00640 1 -- 172.21.15.121:0/760625378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c8152a00 con 0x7f07b0004d40 2024-09-17T03:41:11.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.030+0000 7f07c5600640 1 -- 172.21.15.121:0/760625378 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07bc011430 con 0x7f07b0004d40 2024-09-17T03:41:11.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.031+0000 7f07c5600640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f07a8078b90 0x7f07a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:11.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.031+0000 7f07c5600640 1 -- 172.21.15.121:0/760625378 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 6445+0+0 (secure 0 0 0) 0x7f07bc09be00 con 0x7f07b0004d40 2024-09-17T03:41:11.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.032+0000 7f07cca00640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f07a8078b90 0x7f07a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:11.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.032+0000 7f07cca00640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f07a8078b90 0x7f07a807b0a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f07c81562c0 tx=0x7f07b4005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:11.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.036+0000 7f07c5600640 1 -- 172.21.15.121:0/760625378 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f07c814f920 con 0x7f07b0004d40 2024-09-17T03:41:11.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.220+0000 7f07cfe00640 1 -- 172.21.15.121:0/760625378 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f07c80b4b40 con 0x7f07b0004d40 2024-09-17T03:41:11.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.779+0000 7f07c5600640 1 -- 172.21.15.121:0/760625378 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) ==== 181+0+0 (secure 0 0 0) 0x7f07c815fcd0 con 0x7f07b0004d40 2024-09-17T03:41:11.780 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:41:11.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 -- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f07a8078b90 msgr2=0x7f07a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:11.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f07a8078b90 0x7f07a807b0a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f07c81562c0 tx=0x7f07b4005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:11.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 -- 172.21.15.121:0/760625378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07b0004d40 msgr2=0x7f07c81445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:11.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07b0004d40 0x7f07c81445d0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f07bc001940 tx=0x7f07bc0039c0 comp rx=0 tx=0).stop 2024-09-17T03:41:11.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 -- 172.21.15.121:0/760625378 shutdown_connections 2024-09-17T03:41:11.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07c814f510 0x7f07c81f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:11.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f07c814c800 0x7f07c814efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:11.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f07a8078b90 0x7f07a807b0a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:11.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 --2- 172.21.15.121:0/760625378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07b0004d40 0x7f07c81445d0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:11.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 -- 172.21.15.121:0/760625378 >> 172.21.15.121:0/760625378 conn(0x7f07c806d7d0 msgr2=0x7f07c806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:11.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 -- 172.21.15.121:0/760625378 shutdown_connections 2024-09-17T03:41:11.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:11.782+0000 7f07cfe00640 1 -- 172.21.15.121:0/760625378 wait complete. 2024-09-17T03:41:11.807 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:41:12.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.035+0000 7feaebc00640 1 -- 172.21.15.121:0/3426105271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae40ad100 msgr2=0x7feae4160b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:12.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.035+0000 7feaebc00640 1 --2- 172.21.15.121:0/3426105271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae40ad100 0x7feae4160b80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7feacc009830 tx=0x7feacc02a510 comp rx=0 tx=0).stop 2024-09-17T03:41:12.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.035+0000 7feaebc00640 1 -- 172.21.15.121:0/3426105271 shutdown_connections 2024-09-17T03:41:12.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.035+0000 7feaebc00640 1 --2- 172.21.15.121:0/3426105271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae415c820 0x7feae40b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:12.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.035+0000 7feaebc00640 1 --2- 172.21.15.121:0/3426105271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae40ad100 0x7feae4160b80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:12.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.035+0000 7feaebc00640 1 -- 172.21.15.121:0/3426105271 >> 172.21.15.121:0/3426105271 conn(0x7feae406d7d0 msgr2=0x7feae40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:12.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.036+0000 7feaebc00640 1 -- 172.21.15.121:0/3426105271 shutdown_connections 2024-09-17T03:41:12.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.036+0000 7feaebc00640 1 -- 172.21.15.121:0/3426105271 wait complete. 2024-09-17T03:41:12.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.038+0000 7feaebc00640 1 Processor -- start 2024-09-17T03:41:12.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.038+0000 7feaebc00640 1 -- start start 2024-09-17T03:41:12.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.039+0000 7feaebc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feae40ad100 0x7feae4073d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:12.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.039+0000 7feaebc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae40ada70 0x7feae414e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:12.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.039+0000 7feaebc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae415c820 0x7feae41f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:12.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.039+0000 7feaebc00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feae40b4490 con 0x7feae40ad100 2024-09-17T03:41:12.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.039+0000 7feaebc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feae40b4310 con 0x7feae40ada70 2024-09-17T03:41:12.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.039+0000 7feaebc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feae40b4610 con 0x7feae415c820 2024-09-17T03:41:12.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.040+0000 7feae9200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feae40ad100 0x7feae4073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.040+0000 7feae9200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feae40ad100 0x7feae4073d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36050/0 (socket says 172.21.15.121:36050) 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.040+0000 7feae9200640 1 -- 172.21.15.121:0/4082883236 learned_addr learned my addr 172.21.15.121:0/4082883236 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.040+0000 7feadbe00640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae40ada70 0x7feae414e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.040+0000 7feae9c00640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae415c820 0x7feae41f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.040+0000 7feae9200640 1 -- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae415c820 msgr2=0x7feae41f5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.040+0000 7feae9200640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae415c820 0x7feae41f5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.040+0000 7feae9200640 1 -- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae40ada70 msgr2=0x7feae414e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.040+0000 7feae9200640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae40ada70 0x7feae414e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.040+0000 7feae9200640 1 -- 172.21.15.121:0/4082883236 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae4073020 con 0x7feae40ad100 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.041+0000 7feae9200640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feae40ad100 0x7feae4073d70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fead400c460 tx=0x7fead400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.041+0000 7feae1600640 1 -- 172.21.15.121:0/4082883236 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4011790 con 0x7feae40ad100 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.041+0000 7feae1600640 1 -- 172.21.15.121:0/4082883236 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fead4017070 con 0x7feae40ad100 2024-09-17T03:41:12.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.041+0000 7feaebc00640 1 -- 172.21.15.121:0/4082883236 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae4073290 con 0x7feae40ad100 2024-09-17T03:41:12.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.041+0000 7feae1600640 1 -- 172.21.15.121:0/4082883236 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4011ce0 con 0x7feae40ad100 2024-09-17T03:41:12.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.041+0000 7feaebc00640 1 -- 172.21.15.121:0/4082883236 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae414fb70 con 0x7feae40ad100 2024-09-17T03:41:12.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.042+0000 7feaebc00640 1 -- 172.21.15.121:0/4082883236 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae40b4b30 con 0x7feae40ad100 2024-09-17T03:41:12.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.043+0000 7feae1600640 1 -- 172.21.15.121:0/4082883236 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fead401c460 con 0x7feae40ad100 2024-09-17T03:41:12.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.045+0000 7feae1600640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feac0078b90 0x7feac007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:12.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.045+0000 7feae1600640 1 -- 172.21.15.121:0/4082883236 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6007+0+0 (secure 0 0 0) 0x7fead409aaf0 con 0x7feae40ad100 2024-09-17T03:41:12.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.045+0000 7feadbe00640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feac0078b90 0x7feac007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:12.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.046+0000 7feadbe00640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feac0078b90 0x7feac007b0a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7feacc034000 tx=0x7feacc004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:12.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.049+0000 7feae1600640 1 -- 172.21.15.121:0/4082883236 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fead4062e90 con 0x7feae40ad100 2024-09-17T03:41:12.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.233+0000 7feaebc00640 1 -- 172.21.15.121:0/4082883236 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7feae41601e0 con 0x7feae40ad100 2024-09-17T03:41:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.786+0000 7feae1600640 1 -- 172.21.15.121:0/4082883236 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v117) ==== 169+0+0 (secure 0 0 0) 0x7fead4062790 con 0x7feae40ad100 2024-09-17T03:41:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-17T03:41:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 -- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feac0078b90 msgr2=0x7feac007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feac0078b90 0x7feac007b0a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7feacc034000 tx=0x7feacc004730 comp rx=0 tx=0).stop 2024-09-17T03:41:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 -- 172.21.15.121:0/4082883236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feae40ad100 msgr2=0x7feae4073d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feae40ad100 0x7feae4073d70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fead400c460 tx=0x7fead400c860 comp rx=0 tx=0).stop 2024-09-17T03:41:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 -- 172.21.15.121:0/4082883236 shutdown_connections 2024-09-17T03:41:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feae415c820 0x7feae41f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:12.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feae40ada70 0x7feae414e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:12.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7feac0078b90 0x7feac007b0a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:12.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 --2- 172.21.15.121:0/4082883236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feae40ad100 0x7feae4073d70 secure :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fead400c460 tx=0x7fead400c860 comp rx=0 tx=0).stop 2024-09-17T03:41:12.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 -- 172.21.15.121:0/4082883236 >> 172.21.15.121:0/4082883236 conn(0x7feae406d7d0 msgr2=0x7feae415dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:12.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 -- 172.21.15.121:0/4082883236 shutdown_connections 2024-09-17T03:41:12.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:12.790+0000 7feaebc00640 1 -- 172.21.15.121:0/4082883236 wait complete. 2024-09-17T03:41:12.818 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:41:12.822 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:41:12.916 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-09-17T03:41:12.916 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-09-17T03:41:12.916 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:41:12.916 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-09-17T03:41:12.916 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-09-17T03:41:12.917 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:41:12.918 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.121,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-17T03:41:12.919 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on skipped message = False 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = f24b1682-8755-41b1-8124-cbd8f88939a2 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.920 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:41:12.921 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 20 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 20 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 10 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:41:12.922 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-09-17T03:41:12.923 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:41:12.924 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: mon down mkfs grace = 300 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-09-17T03:41:12.925 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = "" 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout: client reconnect stale = True 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-09-17T03:41:12.926 INFO:teuthology.orchestra.run.smithi121.stdout:[mds] 2024-09-17T03:41:12.927 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-17T03:41:12.927 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-17T03:41:12.927 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:41:12.927 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-17T03:41:12.927 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.927 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-17T03:41:12.927 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.927 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-17T03:41:12.927 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.927 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-17T03:41:12.928 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.929 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.121,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = f24b1682-8755-41b1-8124-cbd8f88939a2 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.930 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-17T03:41:12.931 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-17T03:41:12.932 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 20 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 20 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 10 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:41:12.933 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-17T03:41:12.934 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:41:12.935 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout: mon down mkfs grace = 300 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout: client reconnect stale = True 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-09-17T03:41:12.936 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-09-17T03:41:12.937 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-17T03:41:12.937 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-17T03:41:12.937 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-17T03:41:12.937 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-17T03:41:12.937 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2024-09-17T03:41:12.948 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:41:13.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.202+0000 7f4eef800640 1 -- 172.21.15.121:0/3595253445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee80ce230 msgr2=0x7f4ee806ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.202+0000 7f4eef800640 1 --2- 172.21.15.121:0/3595253445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee80ce230 0x7f4ee806ec50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f4ee806f810 tx=0x7f4ee002aa30 comp rx=0 tx=0).stop 2024-09-17T03:41:13.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.202+0000 7f4eef800640 1 -- 172.21.15.121:0/3595253445 shutdown_connections 2024-09-17T03:41:13.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.202+0000 7f4eef800640 1 --2- 172.21.15.121:0/3595253445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee80ce230 0x7f4ee806ec50 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.202+0000 7f4eef800640 1 --2- 172.21.15.121:0/3595253445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ee806db20 0x7f4ee80cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.202+0000 7f4eef800640 1 --2- 172.21.15.121:0/3595253445 >> v2:172.21.15.176:3300/0 conn(0x7f4ee80cae60 0x7f4ee806d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.202+0000 7f4eef800640 1 -- 172.21.15.121:0/3595253445 >> 172.21.15.121:0/3595253445 conn(0x7f4ee80d0300 msgr2=0x7f4ee80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:13.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.202+0000 7f4eef800640 1 -- 172.21.15.121:0/3595253445 shutdown_connections 2024-09-17T03:41:13.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.203+0000 7f4eef800640 1 -- 172.21.15.121:0/3595253445 wait complete. 2024-09-17T03:41:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.205+0000 7f4eef800640 1 Processor -- start 2024-09-17T03:41:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.205+0000 7f4eef800640 1 -- start start 2024-09-17T03:41:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.206+0000 7f4eef800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee806db20 0x7f4ee8203b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.206+0000 7f4eef800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ee80cae60 0x7f4ee80c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.206+0000 7f4eef800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ee80ce230 0x7f4ee8209da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.206+0000 7f4eef800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee806f520 con 0x7f4ee806db20 2024-09-17T03:41:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.206+0000 7f4eef800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee806f3a0 con 0x7f4ee80ce230 2024-09-17T03:41:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.206+0000 7f4eef800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee816bea0 con 0x7f4ee80cae60 2024-09-17T03:41:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eece00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee806db20 0x7f4ee8203b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eece00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee806db20 0x7f4ee8203b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36064/0 (socket says 172.21.15.121:36064) 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eece00640 1 -- 172.21.15.121:0/366827862 learned_addr learned my addr 172.21.15.121:0/366827862 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4ee7e00640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ee80cae60 0x7f4ee80c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eed800640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ee80ce230 0x7f4ee8209da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eece00640 1 -- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ee80cae60 msgr2=0x7f4ee80c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eece00640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ee80cae60 0x7f4ee80c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eece00640 1 -- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ee80ce230 msgr2=0x7f4ee8209da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eece00640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ee80ce230 0x7f4ee8209da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eece00640 1 -- 172.21.15.121:0/366827862 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee80c9bb0 con 0x7f4ee806db20 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eed800640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ee80ce230 0x7f4ee8209da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.207+0000 7f4eece00640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee806db20 0x7f4ee8203b90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00abb0 tx=0x7f4edc007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.208+0000 7f4ee4c00640 1 -- 172.21.15.121:0/366827862 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc019070 con 0x7f4ee806db20 2024-09-17T03:41:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.208+0000 7f4ee4c00640 1 -- 172.21.15.121:0/366827862 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4edc007ca0 con 0x7f4ee806db20 2024-09-17T03:41:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.208+0000 7f4ee4c00640 1 -- 172.21.15.121:0/366827862 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc014670 con 0x7f4ee806db20 2024-09-17T03:41:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.208+0000 7f4eef800640 1 -- 172.21.15.121:0/366827862 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee80c9e90 con 0x7f4ee806db20 2024-09-17T03:41:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.208+0000 7f4eef800640 1 -- 172.21.15.121:0/366827862 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee80b3ac0 con 0x7f4ee806db20 2024-09-17T03:41:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.209+0000 7f4eef800640 1 -- 172.21.15.121:0/366827862 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee80c38f0 con 0x7f4ee806db20 2024-09-17T03:41:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.211+0000 7f4ee4c00640 1 -- 172.21.15.121:0/366827862 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4edc01c070 con 0x7f4ee806db20 2024-09-17T03:41:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.212+0000 7f4ee4c00640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ec8078b90 0x7f4ec807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.212+0000 7f4ee4c00640 1 -- 172.21.15.121:0/366827862 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f4edc09a650 con 0x7f4ee806db20 2024-09-17T03:41:13.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.212+0000 7f4ee7e00640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ec8078b90 0x7f4ec807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.213+0000 7f4ee7e00640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ec8078b90 0x7f4ec807b0a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80ca450 tx=0x7f4ed4005b50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:13.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.216+0000 7f4ee4c00640 1 -- 172.21.15.121:0/366827862 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4edc0625d0 con 0x7f4ee806db20 2024-09-17T03:41:13.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.409+0000 7f4eef800640 1 -- 172.21.15.121:0/366827862 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f4ee806d5e0 con 0x7f4ee806db20 2024-09-17T03:41:13.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.413+0000 7f4ee4c00640 1 -- 172.21.15.121:0/366827862 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v48) ==== 71+0+0 (secure 0 0 0) 0x7f4edc067000 con 0x7f4ee806db20 2024-09-17T03:41:13.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 -- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ec8078b90 msgr2=0x7f4ec807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ec8078b90 0x7f4ec807b0a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80ca450 tx=0x7f4ed4005b50 comp rx=0 tx=0).stop 2024-09-17T03:41:13.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 -- 172.21.15.121:0/366827862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee806db20 msgr2=0x7f4ee8203b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee806db20 0x7f4ee8203b90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00abb0 tx=0x7f4edc007590 comp rx=0 tx=0).stop 2024-09-17T03:41:13.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 -- 172.21.15.121:0/366827862 shutdown_connections 2024-09-17T03:41:13.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ee80ce230 0x7f4ee8209da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ee80cae60 0x7f4ee80c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f4ec8078b90 0x7f4ec807b0a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 --2- 172.21.15.121:0/366827862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee806db20 0x7f4ee8203b90 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 -- 172.21.15.121:0/366827862 >> 172.21.15.121:0/366827862 conn(0x7f4ee80d0300 msgr2=0x7f4ee80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:13.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 -- 172.21.15.121:0/366827862 shutdown_connections 2024-09-17T03:41:13.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.416+0000 7f4eef800640 1 -- 172.21.15.121:0/366827862 wait complete. 2024-09-17T03:41:13.438 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting' 2024-09-17T03:41:13.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.659+0000 7f1bc0a00640 1 -- 172.21.15.121:0/290220182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0cadf0 msgr2=0x7f1bbc0cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.659+0000 7f1bc0a00640 1 --2- 172.21.15.121:0/290220182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0cadf0 0x7f1bbc0cdc60 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc06e7f0 tx=0x7f1bb402a530 comp rx=0 tx=0).stop 2024-09-17T03:41:13.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.659+0000 7f1bc0a00640 1 -- 172.21.15.121:0/290220182 shutdown_connections 2024-09-17T03:41:13.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.659+0000 7f1bc0a00640 1 --2- 172.21.15.121:0/290220182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0cadf0 0x7f1bbc0cdc60 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.659+0000 7f1bc0a00640 1 --2- 172.21.15.121:0/290220182 >> v2:172.21.15.176:3300/0 conn(0x7f1bbc06cf50 0x7f1bbc15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.659+0000 7f1bc0a00640 1 -- 172.21.15.121:0/290220182 >> 172.21.15.121:0/290220182 conn(0x7f1bbc0d0090 msgr2=0x7f1bbc0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:13.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.659+0000 7f1bc0a00640 1 -- 172.21.15.121:0/290220182 shutdown_connections 2024-09-17T03:41:13.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.659+0000 7f1bc0a00640 1 -- 172.21.15.121:0/290220182 wait complete. 2024-09-17T03:41:13.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.662+0000 7f1bc0a00640 1 Processor -- start 2024-09-17T03:41:13.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.662+0000 7f1bc0a00640 1 -- start start 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.663+0000 7f1bc0a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bbc06cf50 0x7f1bbc1f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.663+0000 7f1bc0a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0cf9b0 0x7f1bbc1f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.663+0000 7f1bc0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bbc146fa0 0x7f1bbc1f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.663+0000 7f1bc0a00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc0ce530 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.663+0000 7f1bc0a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc0ce3b0 con 0x7f1bbc06cf50 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.663+0000 7f1bc0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1bbc0ce6b0 con 0x7f1bbc146fa0 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.663+0000 7f1bb2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0cf9b0 0x7f1bbc1f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.663+0000 7f1bb2a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0cf9b0 0x7f1bbc1f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36090/0 (socket says 172.21.15.121:36090) 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.663+0000 7f1bb2a00640 1 -- 172.21.15.121:0/3471193734 learned_addr learned my addr 172.21.15.121:0/3471193734 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.663+0000 7f1bbb400640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bbc06cf50 0x7f1bbc1f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bbbe00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bbc146fa0 0x7f1bbc1f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bb2a00640 1 -- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bbc146fa0 msgr2=0x7f1bbc1f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bb2a00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bbc146fa0 0x7f1bbc1f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bb2a00640 1 -- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bbc06cf50 msgr2=0x7f1bbc1f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bb2a00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bbc06cf50 0x7f1bbc1f1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bb2a00640 1 -- 172.21.15.121:0/3471193734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc0b4030 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bb2a00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0cf9b0 0x7f1bbc1f22b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400c460 tx=0x7f1ba400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:13.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bb3e00640 1 -- 172.21.15.121:0/3471193734 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4016020 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bb3e00640 1 -- 172.21.15.121:0/3471193734 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ba4012940 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bc0a00640 1 -- 172.21.15.121:0/3471193734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bbc0b42d0 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.664+0000 7f1bb3e00640 1 -- 172.21.15.121:0/3471193734 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4012d90 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.665+0000 7f1bc0a00640 1 -- 172.21.15.121:0/3471193734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bbc0b4890 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.666+0000 7f1bc0a00640 1 -- 172.21.15.121:0/3471193734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bbc0cebd0 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.667+0000 7f1bb3e00640 1 -- 172.21.15.121:0/3471193734 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ba4019020 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.668+0000 7f1bb3e00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b98078b90 0x7f1b9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.668+0000 7f1bb3e00640 1 -- 172.21.15.121:0/3471193734 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f1ba409a570 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.669+0000 7f1bbb400640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b98078b90 0x7f1b9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.670+0000 7f1bbb400640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b98078b90 0x7f1b9807b0a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1bac005fd0 tx=0x7f1bac009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:13.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.673+0000 7f1bb3e00640 1 -- 172.21.15.121:0/3471193734 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ba4020070 con 0x7f1bbc0cf9b0 2024-09-17T03:41:13.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:13.923+0000 7f1bc0a00640 1 -- 172.21.15.121:0/3471193734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]} v 0) -- 0x7f1bbc1f5af0 con 0x7f1bbc0cf9b0 2024-09-17T03:41:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.795+0000 7f1bb3e00640 1 -- 172.21.15.121:0/3471193734 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_sessionmap.TestSessionMap.test_version_splitting"]}]=0 v325) ==== 145+0+0 (secure 0 0 0) 0x7f1ba40623c0 con 0x7f1bbc0cf9b0 2024-09-17T03:41:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.797+0000 7f1bc0a00640 1 -- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b98078b90 msgr2=0x7f1b9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.797+0000 7f1bc0a00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b98078b90 0x7f1b9807b0a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1bac005fd0 tx=0x7f1bac009500 comp rx=0 tx=0).stop 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.797+0000 7f1bc0a00640 1 -- 172.21.15.121:0/3471193734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0cf9b0 msgr2=0x7f1bbc1f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.797+0000 7f1bc0a00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0cf9b0 0x7f1bbc1f22b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400c460 tx=0x7f1ba400c920 comp rx=0 tx=0).stop 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.798+0000 7f1bc0a00640 1 -- 172.21.15.121:0/3471193734 shutdown_connections 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.798+0000 7f1bc0a00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1bbc146fa0 0x7f1bbc1f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.798+0000 7f1bc0a00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f1b98078b90 0x7f1b9807b0a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.798+0000 7f1bc0a00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0cf9b0 0x7f1bbc1f22b0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.798+0000 7f1bc0a00640 1 --2- 172.21.15.121:0/3471193734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1bbc06cf50 0x7f1bbc1f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.798+0000 7f1bc0a00640 1 -- 172.21.15.121:0/3471193734 >> 172.21.15.121:0/3471193734 conn(0x7f1bbc0d0090 msgr2=0x7f1bbc157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.798+0000 7f1bc0a00640 1 -- 172.21.15.121:0/3471193734 shutdown_connections 2024-09-17T03:41:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:14.798+0000 7f1bc0a00640 1 -- 172.21.15.121:0/3471193734 wait complete. 2024-09-17T03:41:14.822 INFO:tasks.cephfs_test_runner:That when many sessions are updated, they are correctly ... ok 2024-09-17T03:41:14.823 INFO:tasks.cephfs_test_runner: 2024-09-17T03:41:14.823 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T03:41:14.823 INFO:tasks.cephfs_test_runner:Ran 7 tests in 293.824s 2024-09-17T03:41:14.823 INFO:tasks.cephfs_test_runner: 2024-09-17T03:41:14.823 INFO:tasks.cephfs_test_runner:OK (skipped=2) 2024-09-17T03:41:14.823 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T03:41:14.847 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T03:41:14.865 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T03:41:14.866 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:41:14.866 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:14.902 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:41:14.903 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-17T03:41:14.903 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:14.977 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052587,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248952k,nr_inodes=812238,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497908k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:41:14.978 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:41:14.978 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:15.018 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:41:15.018 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-17T03:41:15.018 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:15.096 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:41:15.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.097 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:41:15.132 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:41:15.132 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:41:15.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.133 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:41:15.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.230 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:41:15.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.494 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-09-17T03:41:15.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.791 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-17T03:41:15.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.828 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-09-17T03:41:15.928 INFO:teuthology.orchestra.run.smithi121.stderr:Cannot find device "ceph-brx" 2024-09-17T03:41:15.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:41:15.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.931 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:41:15.971 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:41:15.972 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:41:15.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.972 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:41:16.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:16.073 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:41:16.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:16.339 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-17T03:41:16.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:16.648 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-17T03:41:16.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:16.684 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-17T03:41:16.783 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-17T03:41:16.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:41:16.786 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T03:41:16.795 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:41:16.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:41:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.020+0000 7f7961600640 1 -- 172.21.15.121:0/750050305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c1654c0 msgr2=0x7f795c1678e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.020+0000 7f7961600640 1 --2- 172.21.15.121:0/750050305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c1654c0 0x7f795c1678e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7954005fd0 tx=0x7f795402a840 comp rx=0 tx=0).stop 2024-09-17T03:41:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.020+0000 7f7961600640 1 -- 172.21.15.121:0/750050305 shutdown_connections 2024-09-17T03:41:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.020+0000 7f7961600640 1 --2- 172.21.15.121:0/750050305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c1654c0 0x7f795c1678e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.020+0000 7f7961600640 1 -- 172.21.15.121:0/750050305 >> 172.21.15.121:0/750050305 conn(0x7f795c0b1c10 msgr2=0x7f795c0b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.020+0000 7f7961600640 1 -- 172.21.15.121:0/750050305 shutdown_connections 2024-09-17T03:41:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.020+0000 7f7961600640 1 -- 172.21.15.121:0/750050305 wait complete. 2024-09-17T03:41:17.022 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.022+0000 7f7961600640 1 Processor -- start 2024-09-17T03:41:17.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.022+0000 7f7961600640 1 -- start start 2024-09-17T03:41:17.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f7961600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f795c0cc550 0x7f795c1f9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f7961600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c15fdf0 0x7f795c0b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f7961600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f795c1654c0 0x7f795c0c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f7961600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f795c0b3890 con 0x7f795c1654c0 2024-09-17T03:41:17.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f7961600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f795c074f70 con 0x7f795c15fdf0 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f7961600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f795c167e20 con 0x7f795c0cc550 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f795b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f795c1654c0 0x7f795c0c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f795b400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f795c1654c0 0x7f795c0c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36092/0 (socket says 172.21.15.121:36092) 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f795b400640 1 -- 172.21.15.121:0/1179266497 learned_addr learned my addr 172.21.15.121:0/1179266497 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f795aa00640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f795c0cc550 0x7f795c1f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f7953e00640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c15fdf0 0x7f795c0b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f795b400640 1 -- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f795c0cc550 msgr2=0x7f795c1f9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f795b400640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f795c0cc550 0x7f795c1f9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f795b400640 1 -- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c15fdf0 msgr2=0x7f795c0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f795b400640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c15fdf0 0x7f795c0b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.024+0000 7f795b400640 1 -- 172.21.15.121:0/1179266497 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c1f9b20 con 0x7f795c1654c0 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.025+0000 7f795b400640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f795c1654c0 0x7f795c0c4af0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f7954034040 tx=0x7f7954032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:17.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.025+0000 7f7952a00640 1 -- 172.21.15.121:0/1179266497 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7954040070 con 0x7f795c1654c0 2024-09-17T03:41:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.025+0000 7f7952a00640 1 -- 172.21.15.121:0/1179266497 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7954004540 con 0x7f795c1654c0 2024-09-17T03:41:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.025+0000 7f7961600640 1 -- 172.21.15.121:0/1179266497 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795c1f9e00 con 0x7f795c1654c0 2024-09-17T03:41:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.025+0000 7f7952a00640 1 -- 172.21.15.121:0/1179266497 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795403c420 con 0x7f795c1654c0 2024-09-17T03:41:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.025+0000 7f7961600640 1 -- 172.21.15.121:0/1179266497 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795c0b4950 con 0x7f795c1654c0 2024-09-17T03:41:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.026+0000 7f7961600640 1 -- 172.21.15.121:0/1179266497 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795c167c40 con 0x7f795c1654c0 2024-09-17T03:41:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.027+0000 7f7952a00640 1 -- 172.21.15.121:0/1179266497 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7954043070 con 0x7f795c1654c0 2024-09-17T03:41:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.028+0000 7f7952a00640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7938078b90 0x7f793807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.028+0000 7f7952a00640 1 -- 172.21.15.121:0/1179266497 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f79540bbf20 con 0x7f795c1654c0 2024-09-17T03:41:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.029+0000 7f795aa00640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7938078b90 0x7f793807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.030+0000 7f795aa00640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7938078b90 0x7f793807b0a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f794c001860 tx=0x7f794c001690 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.033+0000 7f7952a00640 1 -- 172.21.15.121:0/1179266497 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f795c167c40 con 0x7f795c1654c0 2024-09-17T03:41:17.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.216+0000 7f7961600640 1 -- 172.21.15.121:0/1179266497 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f795c1f98b0 con 0x7f7938078b90 2024-09-17T03:41:17.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.217+0000 7f7952a00640 1 -- 172.21.15.121:0/1179266497 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13436 (secure 0 0 0) 0x7f795c1f98b0 con 0x7f7938078b90 2024-09-17T03:41:17.217 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:17.218 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:41:17.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 -- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7938078b90 msgr2=0x7f793807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7938078b90 0x7f793807b0a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f794c001860 tx=0x7f794c001690 comp rx=0 tx=0).stop 2024-09-17T03:41:17.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 -- 172.21.15.121:0/1179266497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f795c1654c0 msgr2=0x7f795c0c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f795c1654c0 0x7f795c0c4af0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f7954034040 tx=0x7f7954032cf0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 -- 172.21.15.121:0/1179266497 shutdown_connections 2024-09-17T03:41:17.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7938078b90 0x7f793807b0a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f795c1654c0 0x7f795c0c4af0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f795c15fdf0 0x7f795c0b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 --2- 172.21.15.121:0/1179266497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f795c0cc550 0x7f795c1f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 -- 172.21.15.121:0/1179266497 >> 172.21.15.121:0/1179266497 conn(0x7f795c0b1c10 msgr2=0x7f795c0cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:17.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 -- 172.21.15.121:0/1179266497 shutdown_connections 2024-09-17T03:41:17.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.219+0000 7f7961600640 1 -- 172.21.15.121:0/1179266497 wait complete. 2024-09-17T03:41:17.245 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-17T03:41:15.368956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261872,"kb_used_data":12388,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712848,"statfs":{"total":773094113280,"available":772825956352,"internally_reserved":0,"allocated":12685312,"data_stored":6476475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-22844,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-92,"num_read_kb":-87,"num_write":-156,"num_write_kb":-78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001689"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":283,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T03:40:44.548971+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:40:44.548971+0000","last_peered":"2024-09-17T03:40:44.548971+0000","last_clean":"2024-09-17T03:40:44.548971+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:40:44.548971+0000","last_undegraded":"2024-09-17T03:40:44.548971+0000","last_fullsized":"2024-09-17T03:40:44.548971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509514,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":659867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1429504,"data_stored":659658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509512,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33172,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338668,"statfs":{"total":96636764160,"available":96602796032,"internally_reserved":0,"allocated":2035712,"data_stored":1261089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509514,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":660359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509513,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1462272,"data_stored":678210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33156,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338684,"statfs":{"total":96636764160,"available":96602812416,"internally_reserved":0,"allocated":2019328,"data_stored":1243929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509515,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1429504,"data_stored":653543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1441792,"data_stored":659820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:41:17.247 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:41:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.467+0000 7f31dbe00640 1 -- 172.21.15.121:0/2549394015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31dc0b48a0 msgr2=0x7f31dc0d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.467+0000 7f31dbe00640 1 --2- 172.21.15.121:0/2549394015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31dc0b48a0 0x7f31dc0d1d40 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009830 tx=0x7f31c402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.467+0000 7f31dbe00640 1 -- 172.21.15.121:0/2549394015 shutdown_connections 2024-09-17T03:41:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.467+0000 7f31dbe00640 1 --2- 172.21.15.121:0/2549394015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31dc0b48a0 0x7f31dc0d1d40 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.467+0000 7f31dbe00640 1 -- 172.21.15.121:0/2549394015 >> 172.21.15.121:0/2549394015 conn(0x7f31dc0d2510 msgr2=0x7f31dc0d2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.467+0000 7f31dbe00640 1 -- 172.21.15.121:0/2549394015 shutdown_connections 2024-09-17T03:41:17.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.467+0000 7f31dbe00640 1 -- 172.21.15.121:0/2549394015 wait complete. 2024-09-17T03:41:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.469+0000 7f31dbe00640 1 Processor -- start 2024-09-17T03:41:17.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.469+0000 7f31dbe00640 1 -- start start 2024-09-17T03:41:17.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31dbe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31dc0ccb00 0x7f31dc15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31dbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31dc15c7e0 0x7f31dc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31dbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31dc15a630 0x7f31dc151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31dbe00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0d1540 con 0x7f31dc0ccb00 2024-09-17T03:41:17.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31dbe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0d13c0 con 0x7f31dc15c7e0 2024-09-17T03:41:17.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31dbe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc0d16c0 con 0x7f31dc15a630 2024-09-17T03:41:17.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31daa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31dc0ccb00 0x7f31dc15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31daa00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31dc0ccb00 0x7f31dc15a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36110/0 (socket says 172.21.15.121:36110) 2024-09-17T03:41:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31daa00640 1 -- 172.21.15.121:0/3969337031 learned_addr learned my addr 172.21.15.121:0/3969337031 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31d2000640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31dc15c7e0 0x7f31dc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31db400640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31dc15a630 0x7f31dc151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31daa00640 1 -- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31dc15a630 msgr2=0x7f31dc151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31daa00640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31dc15a630 0x7f31dc151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31daa00640 1 -- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31dc15c7e0 msgr2=0x7f31dc06fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31daa00640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31dc15c7e0 0x7f31dc06fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.471+0000 7f31daa00640 1 -- 172.21.15.121:0/3969337031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc06f660 con 0x7f31dc0ccb00 2024-09-17T03:41:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.472+0000 7f31daa00640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31dc0ccb00 0x7f31dc15a0f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00c430 tx=0x7f31cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.472+0000 7f31d3400640 1 -- 172.21.15.121:0/3969337031 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc011790 con 0x7f31dc0ccb00 2024-09-17T03:41:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.472+0000 7f31d3400640 1 -- 172.21.15.121:0/3969337031 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31cc017070 con 0x7f31dc0ccb00 2024-09-17T03:41:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.472+0000 7f31dbe00640 1 -- 172.21.15.121:0/3969337031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc06e8a0 con 0x7f31dc0ccb00 2024-09-17T03:41:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.472+0000 7f31d3400640 1 -- 172.21.15.121:0/3969337031 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc011ce0 con 0x7f31dc0ccb00 2024-09-17T03:41:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.472+0000 7f31dbe00640 1 -- 172.21.15.121:0/3969337031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc06ee60 con 0x7f31dc0ccb00 2024-09-17T03:41:17.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.473+0000 7f31dbe00640 1 -- 172.21.15.121:0/3969337031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31dc0d1d40 con 0x7f31dc0ccb00 2024-09-17T03:41:17.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.474+0000 7f31d3400640 1 -- 172.21.15.121:0/3969337031 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31cc01c460 con 0x7f31dc0ccb00 2024-09-17T03:41:17.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.475+0000 7f31d3400640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f31b8078b90 0x7f31b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.475+0000 7f31d3400640 1 -- 172.21.15.121:0/3969337031 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f31cc09aa90 con 0x7f31dc0ccb00 2024-09-17T03:41:17.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.476+0000 7f31d2000640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f31b8078b90 0x7f31b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.476+0000 7f31d2000640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f31b8078b90 0x7f31b807b0a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f31c4034000 tx=0x7f31c4004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:17.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.480+0000 7f31d3400640 1 -- 172.21.15.121:0/3969337031 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f31cc062fc0 con 0x7f31dc0ccb00 2024-09-17T03:41:17.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.660+0000 7f31dbe00640 1 -- 172.21.15.121:0/3969337031 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31dc0d04e0 con 0x7f31b8078b90 2024-09-17T03:41:17.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.661+0000 7f31d3400640 1 -- 172.21.15.121:0/3969337031 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13495 (secure 0 0 0) 0x7f31dc0d04e0 con 0x7f31b8078b90 2024-09-17T03:41:17.662 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:17.663 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 -- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f31b8078b90 msgr2=0x7f31b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f31b8078b90 0x7f31b807b0a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f31c4034000 tx=0x7f31c4004730 comp rx=0 tx=0).stop 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 -- 172.21.15.121:0/3969337031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31dc0ccb00 msgr2=0x7f31dc15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31dc0ccb00 0x7f31dc15a0f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00c430 tx=0x7f31cc00c8f0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 -- 172.21.15.121:0/3969337031 shutdown_connections 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31dc15a630 0x7f31dc151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31dc15c7e0 0x7f31dc06fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f31b8078b90 0x7f31b807b0a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 --2- 172.21.15.121:0/3969337031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31dc0ccb00 0x7f31dc15a0f0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 -- 172.21.15.121:0/3969337031 >> 172.21.15.121:0/3969337031 conn(0x7f31dc0d2510 msgr2=0x7f31dc0b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 -- 172.21.15.121:0/3969337031 shutdown_connections 2024-09-17T03:41:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.664+0000 7f31dbe00640 1 -- 172.21.15.121:0/3969337031 wait complete. 2024-09-17T03:41:17.690 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-17T03:41:17.369385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":262076,"kb_used_data":12536,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712644,"statfs":{"total":773094113280,"available":772825747456,"internally_reserved":0,"allocated":12836864,"data_stored":6548084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-22844,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-92,"num_read_kb":-87,"num_write":-156,"num_write_kb":-78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.595793"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:41:12.790431+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:41:12.790431+0000","last_peered":"2024-09-17T03:41:12.790431+0000","last_clean":"2024-09-17T03:41:12.790431+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:41:12.790431+0000","last_undegraded":"2024-09-17T03:41:12.790431+0000","last_fullsized":"2024-09-17T03:41:12.790431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509513,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2052096,"data_stored":1262872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2052096,"data_stored":1262872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1441792,"data_stored":659820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:41:17.691 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:41:17.691 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:41:17.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.912+0000 7f9200600640 1 -- 172.21.15.121:0/2057099389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f8159380 msgr2=0x7f91f815c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.912+0000 7f9200600640 1 --2- 172.21.15.121:0/2057099389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f8159380 0x7f91f815c1b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005fd0 tx=0x7f91e402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.912+0000 7f9200600640 1 -- 172.21.15.121:0/2057099389 shutdown_connections 2024-09-17T03:41:17.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.912+0000 7f9200600640 1 --2- 172.21.15.121:0/2057099389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f8159380 0x7f91f815c1b0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.912+0000 7f9200600640 1 --2- 172.21.15.121:0/2057099389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91f8073c10 0x7f91f815bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.912+0000 7f9200600640 1 -- 172.21.15.121:0/2057099389 >> 172.21.15.121:0/2057099389 conn(0x7f91f80b1c10 msgr2=0x7f91f80b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:17.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.912+0000 7f9200600640 1 -- 172.21.15.121:0/2057099389 shutdown_connections 2024-09-17T03:41:17.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.912+0000 7f9200600640 1 -- 172.21.15.121:0/2057099389 wait complete. 2024-09-17T03:41:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.915+0000 7f9200600640 1 Processor -- start 2024-09-17T03:41:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.915+0000 7f9200600640 1 -- start start 2024-09-17T03:41:17.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f9200600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f8073c10 0x7f91f80b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f9200600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91f8159380 0x7f91f81f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f9200600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91f815c6f0 0x7f91f81f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f9200600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f91f815f970 con 0x7f91f8073c10 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f9200600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f91f806d2c0 con 0x7f91f815c6f0 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f9200600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91f815faf0 con 0x7f91f8159380 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f91fdc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f8073c10 0x7f91f80b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f91fdc00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f8073c10 0x7f91f80b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36124/0 (socket says 172.21.15.121:36124) 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f91fdc00640 1 -- 172.21.15.121:0/3208891985 learned_addr learned my addr 172.21.15.121:0/3208891985 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f91fd200640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91f8159380 0x7f91f81f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.916+0000 7f91fe600640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91f815c6f0 0x7f91f81f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.917+0000 7f91fdc00640 1 -- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91f8159380 msgr2=0x7f91f81f7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.917+0000 7f91fdc00640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91f8159380 0x7f91f81f7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.917+0000 7f91fdc00640 1 -- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91f815c6f0 msgr2=0x7f91f81f78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:17.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.917+0000 7f91fdc00640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91f815c6f0 0x7f91f81f78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:17.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.917+0000 7f91fdc00640 1 -- 172.21.15.121:0/3208891985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f81f4550 con 0x7f91f8073c10 2024-09-17T03:41:17.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.917+0000 7f91fdc00640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f8073c10 0x7f91f80b5a80 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00b410 tx=0x7f91ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:17.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.917+0000 7f91f5600640 1 -- 172.21.15.121:0/3208891985 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec015020 con 0x7f91f8073c10 2024-09-17T03:41:17.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.917+0000 7f91f5600640 1 -- 172.21.15.121:0/3208891985 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91ec011940 con 0x7f91f8073c10 2024-09-17T03:41:17.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.917+0000 7f9200600640 1 -- 172.21.15.121:0/3208891985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f81f4830 con 0x7f91f8073c10 2024-09-17T03:41:17.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.917+0000 7f91f5600640 1 -- 172.21.15.121:0/3208891985 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec011d90 con 0x7f91f8073c10 2024-09-17T03:41:17.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.918+0000 7f9200600640 1 -- 172.21.15.121:0/3208891985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f80c6430 con 0x7f91f8073c10 2024-09-17T03:41:17.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.918+0000 7f9200600640 1 -- 172.21.15.121:0/3208891985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91f80c4c80 con 0x7f91f8073c10 2024-09-17T03:41:17.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.920+0000 7f91f5600640 1 -- 172.21.15.121:0/3208891985 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f91ec018020 con 0x7f91f8073c10 2024-09-17T03:41:17.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.921+0000 7f91f5600640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91d8078b90 0x7f91d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:17.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.921+0000 7f91f5600640 1 -- 172.21.15.121:0/3208891985 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f91ec09ab90 con 0x7f91f8073c10 2024-09-17T03:41:17.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.922+0000 7f91fd200640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91d8078b90 0x7f91d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:17.923 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.922+0000 7f91fd200640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91d8078b90 0x7f91d807b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f91e4033000 tx=0x7f91e4004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:17.926 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:17.926+0000 7f91f5600640 1 -- 172.21.15.121:0/3208891985 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f91ec01f020 con 0x7f91f8073c10 2024-09-17T03:41:18.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.107+0000 7f9200600640 1 -- 172.21.15.121:0/3208891985 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91f8160070 con 0x7f91d8078b90 2024-09-17T03:41:18.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.109+0000 7f91f5600640 1 -- 172.21.15.121:0/3208891985 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13495 (secure 0 0 0) 0x7f91f8160070 con 0x7f91d8078b90 2024-09-17T03:41:18.109 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:18.110 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:41:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 -- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91d8078b90 msgr2=0x7f91d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91d8078b90 0x7f91d807b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f91e4033000 tx=0x7f91e4004730 comp rx=0 tx=0).stop 2024-09-17T03:41:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 -- 172.21.15.121:0/3208891985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f8073c10 msgr2=0x7f91f80b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f8073c10 0x7f91f80b5a80 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00b410 tx=0x7f91ec00b8d0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 -- 172.21.15.121:0/3208891985 shutdown_connections 2024-09-17T03:41:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91f815c6f0 0x7f91f81f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91f8159380 0x7f91f81f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f91d8078b90 0x7f91d807b0a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 --2- 172.21.15.121:0/3208891985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91f8073c10 0x7f91f80b5a80 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 -- 172.21.15.121:0/3208891985 >> 172.21.15.121:0/3208891985 conn(0x7f91f80b1c10 msgr2=0x7f91f8157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:18.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 -- 172.21.15.121:0/3208891985 shutdown_connections 2024-09-17T03:41:18.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.111+0000 7f9200600640 1 -- 172.21.15.121:0/3208891985 wait complete. 2024-09-17T03:41:18.134 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-17T03:41:17.369385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":262076,"kb_used_data":12536,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712644,"statfs":{"total":773094113280,"available":772825747456,"internally_reserved":0,"allocated":12836864,"data_stored":6548084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-22844,"num_objects":-42,"num_object_clones":0,"num_object_copies":-84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-42,"num_whiteouts":0,"num_read":-92,"num_read_kb":-87,"num_write":-156,"num_write_kb":-78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.595793"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:41:12.790431+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:41:12.790431+0000","last_peered":"2024-09-17T03:41:12.790431+0000","last_clean":"2024-09-17T03:41:12.790431+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:41:12.790431+0000","last_undegraded":"2024-09-17T03:41:12.790431+0000","last_fullsized":"2024-09-17T03:41:12.790431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509513,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2052096,"data_stored":1262872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2052096,"data_stored":1262872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1441792,"data_stored":659820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:41:18.134 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.354+0000 7f7199600640 1 -- 172.21.15.121:0/902426774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71941654c0 msgr2=0x7f71941678e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.354+0000 7f7199600640 1 --2- 172.21.15.121:0/902426774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71941654c0 0x7f71941678e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f718c009830 tx=0x7f718c02a530 comp rx=0 tx=0).stop 2024-09-17T03:41:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.355+0000 7f7199600640 1 -- 172.21.15.121:0/902426774 shutdown_connections 2024-09-17T03:41:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.355+0000 7f7199600640 1 --2- 172.21.15.121:0/902426774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71941654c0 0x7f71941678e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.355+0000 7f7199600640 1 -- 172.21.15.121:0/902426774 >> 172.21.15.121:0/902426774 conn(0x7f71940b1c10 msgr2=0x7f71940b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.355+0000 7f7199600640 1 -- 172.21.15.121:0/902426774 shutdown_connections 2024-09-17T03:41:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.355+0000 7f7199600640 1 -- 172.21.15.121:0/902426774 wait complete. 2024-09-17T03:41:18.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.357+0000 7f7199600640 1 Processor -- start 2024-09-17T03:41:18.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.357+0000 7f7199600640 1 -- start start 2024-09-17T03:41:18.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.358+0000 7f7199600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71940cc550 0x7f71941f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:18.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.358+0000 7f7199600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719415fdf0 0x7f7194158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:18.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.358+0000 7f7199600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71941654c0 0x7f71941593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:18.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.358+0000 7f7199600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71940b3890 con 0x7f71940cc550 2024-09-17T03:41:18.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.358+0000 7f7199600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7194074f70 con 0x7f719415fdf0 2024-09-17T03:41:18.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.358+0000 7f7199600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7194167e20 con 0x7f71941654c0 2024-09-17T03:41:18.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7192a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71940cc550 0x7f71941f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:18.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7192a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71940cc550 0x7f71941f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36134/0 (socket says 172.21.15.121:36134) 2024-09-17T03:41:18.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7192a00640 1 -- 172.21.15.121:0/3371740703 learned_addr learned my addr 172.21.15.121:0/3371740703 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7193400640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71941654c0 0x7f71941593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f718a000640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719415fdf0 0x7f7194158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7192a00640 1 -- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71941654c0 msgr2=0x7f71941593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7192a00640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71941654c0 0x7f71941593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7192a00640 1 -- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719415fdf0 msgr2=0x7f7194158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7192a00640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719415fdf0 0x7f7194158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7192a00640 1 -- 172.21.15.121:0/3371740703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71941f9310 con 0x7f71940cc550 2024-09-17T03:41:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7193400640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71941654c0 0x7f71941593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.359+0000 7f7192a00640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71940cc550 0x7f71941f62b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f718400cba0 tx=0x7f718400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:18.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.360+0000 7f718b400640 1 -- 172.21.15.121:0/3371740703 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184016020 con 0x7f71940cc550 2024-09-17T03:41:18.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.360+0000 7f7199600640 1 -- 172.21.15.121:0/3371740703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71941f95f0 con 0x7f71940cc550 2024-09-17T03:41:18.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.360+0000 7f718b400640 1 -- 172.21.15.121:0/3371740703 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f718400ae50 con 0x7f71940cc550 2024-09-17T03:41:18.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.360+0000 7f718b400640 1 -- 172.21.15.121:0/3371740703 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184012680 con 0x7f71940cc550 2024-09-17T03:41:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.360+0000 7f7199600640 1 -- 172.21.15.121:0/3371740703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7194158940 con 0x7f71940cc550 2024-09-17T03:41:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.361+0000 7f7199600640 1 -- 172.21.15.121:0/3371740703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719406de80 con 0x7f71940cc550 2024-09-17T03:41:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.362+0000 7f718b400640 1 -- 172.21.15.121:0/3371740703 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7184019020 con 0x7f71940cc550 2024-09-17T03:41:18.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.363+0000 7f718b400640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7170078bc0 0x7f717007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:18.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.363+0000 7f718b400640 1 -- 172.21.15.121:0/3371740703 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f718409b300 con 0x7f71940cc550 2024-09-17T03:41:18.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.363+0000 7f718a000640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7170078bc0 0x7f717007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:18.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.364+0000 7f718a000640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7170078bc0 0x7f717007b0d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f719415d570 tx=0x7f717c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:18.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.367+0000 7f718b400640 1 -- 172.21.15.121:0/3371740703 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7184020020 con 0x7f71940cc550 2024-09-17T03:41:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.553+0000 7f7199600640 1 -- 172.21.15.121:0/3371740703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71940cb270 con 0x7f71940cc550 2024-09-17T03:41:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.553+0000 7f718b400640 1 -- 172.21.15.121:0/3371740703 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+13769 (secure 0 0 0) 0x7f7184063720 con 0x7f71940cc550 2024-09-17T03:41:18.554 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:18.554 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":117,"fsid":"f24b1682-8755-41b1-8124-cbd8f88939a2","created":"2024-09-17T03:35:04.142871+0000","modified":"2024-09-17T03:41:12.781556+0000","last_up_change":"2024-09-17T03:35:20.376623+0000","last_in_change":"2024-09-17T03:35:09.800632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:35:21.303701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4f6be23-7adc-4e1d-ba61-0e3d7e9d8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6817","nonce":519637471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6819","nonce":519637471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6823","nonce":519637471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":519637471},{"type":"v1","addr":"172.21.15.121:6821","nonce":519637471}]},"public_addr":"172.21.15.121:6817/519637471","cluster_addr":"172.21.15.121:6819/519637471","heartbeat_back_addr":"172.21.15.121:6823/519637471","heartbeat_front_addr":"172.21.15.121:6821/519637471","state":["exists","up"]},{"osd":1,"uuid":"e2d49e14-74ce-4e74-a18d-45269ee48a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6825","nonce":1986765065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6827","nonce":1986765065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6831","nonce":1986765065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1986765065},{"type":"v1","addr":"172.21.15.121:6829","nonce":1986765065}]},"public_addr":"172.21.15.121:6825/1986765065","cluster_addr":"172.21.15.121:6827/1986765065","heartbeat_back_addr":"172.21.15.121:6831/1986765065","heartbeat_front_addr":"172.21.15.121:6829/1986765065","state":["exists","up"]},{"osd":2,"uuid":"d41decb9-527a-4210-a5e1-4dc306c86f92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6801","nonce":3957619612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6803","nonce":3957619612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6807","nonce":3957619612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3957619612},{"type":"v1","addr":"172.21.15.121:6805","nonce":3957619612}]},"public_addr":"172.21.15.121:6801/3957619612","cluster_addr":"172.21.15.121:6803/3957619612","heartbeat_back_addr":"172.21.15.121:6807/3957619612","heartbeat_front_addr":"172.21.15.121:6805/3957619612","state":["exists","up"]},{"osd":3,"uuid":"9c0e6583-17d1-4b41-86da-1ddee08c995e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6809","nonce":1711221515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6811","nonce":1711221515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6815","nonce":1711221515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1711221515},{"type":"v1","addr":"172.21.15.121:6813","nonce":1711221515}]},"public_addr":"172.21.15.121:6809/1711221515","cluster_addr":"172.21.15.121:6811/1711221515","heartbeat_back_addr":"172.21.15.121:6815/1711221515","heartbeat_front_addr":"172.21.15.121:6813/1711221515","state":["exists","up"]},{"osd":4,"uuid":"3ae2d4c6-e00f-4132-8f96-f661be564aee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6819","nonce":3274370689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6821","nonce":3274370689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6825","nonce":3274370689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3274370689},{"type":"v1","addr":"172.21.15.176:6823","nonce":3274370689}]},"public_addr":"172.21.15.176:6819/3274370689","cluster_addr":"172.21.15.176:6821/3274370689","heartbeat_back_addr":"172.21.15.176:6825/3274370689","heartbeat_front_addr":"172.21.15.176:6823/3274370689","state":["exists","up"]},{"osd":5,"uuid":"2e3aaa40-ae33-4c35-98a2-6e2d05510ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6827","nonce":3997922862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6829","nonce":3997922862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6833","nonce":3997922862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":3997922862},{"type":"v1","addr":"172.21.15.176:6831","nonce":3997922862}]},"public_addr":"172.21.15.176:6827/3997922862","cluster_addr":"172.21.15.176:6829/3997922862","heartbeat_back_addr":"172.21.15.176:6833/3997922862","heartbeat_front_addr":"172.21.15.176:6831/3997922862","state":["exists","up"]},{"osd":6,"uuid":"433bf660-0d98-4f4a-8c09-a3b499c5bb39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6811","nonce":1810611479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6813","nonce":1810611479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6817","nonce":1810611479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":1810611479},{"type":"v1","addr":"172.21.15.176:6815","nonce":1810611479}]},"public_addr":"172.21.15.176:6811/1810611479","cluster_addr":"172.21.15.176:6813/1810611479","heartbeat_back_addr":"172.21.15.176:6817/1810611479","heartbeat_front_addr":"172.21.15.176:6815/1810611479","state":["exists","up"]},{"osd":7,"uuid":"a74b57b4-309d-43a5-96fb-44bce8831eaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6803","nonce":2211533111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6805","nonce":2211533111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6809","nonce":2211533111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":2211533111},{"type":"v1","addr":"172.21.15.176:6807","nonce":2211533111}]},"public_addr":"172.21.15.176:6803/2211533111","cluster_addr":"172.21.15.176:6805/2211533111","heartbeat_back_addr":"172.21.15.176:6809/2211533111","heartbeat_front_addr":"172.21.15.176:6807/2211533111","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:17.234576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.974118+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.461887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.622882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.396149+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.711926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.496068+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:35:16.768600+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6837/762503506":"2024-09-18T03:41:09.766642+0000","172.21.15.176:6836/762503506":"2024-09-18T03:41:09.766642+0000","172.21.15.121:6834/1935597076":"2024-09-18T03:41:09.766675+0000","172.21.15.121:6832/1935597076":"2024-09-18T03:41:09.766675+0000","172.21.15.176:6836/2166412005":"2024-09-18T03:40:44.508573+0000","172.21.15.176:6834/2166412005":"2024-09-18T03:40:44.508573+0000","172.21.15.121:6835/697305237":"2024-09-18T03:40:43.506671+0000","172.21.15.121:6834/697305237":"2024-09-18T03:40:43.506671+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 -- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7170078bc0 msgr2=0x7f717007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7170078bc0 0x7f717007b0d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f719415d570 tx=0x7f717c009040 comp rx=0 tx=0).stop 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 -- 172.21.15.121:0/3371740703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71940cc550 msgr2=0x7f71941f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71940cc550 0x7f71941f62b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f718400cba0 tx=0x7f718400a430 comp rx=0 tx=0).stop 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 -- 172.21.15.121:0/3371740703 shutdown_connections 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71941654c0 0x7f71941593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f719415fdf0 0x7f7194158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7170078bc0 0x7f717007b0d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 --2- 172.21.15.121:0/3371740703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71940cc550 0x7f71941f62b0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 -- 172.21.15.121:0/3371740703 >> 172.21.15.121:0/3371740703 conn(0x7f71940b1c10 msgr2=0x7f71940cb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 -- 172.21.15.121:0/3371740703 shutdown_connections 2024-09-17T03:41:18.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:18.556+0000 7f7199600640 1 -- 172.21.15.121:0/3371740703 wait complete. 2024-09-17T03:41:19.583 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T03:41:19.583 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:41:19.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.814+0000 7f33c7200640 1 -- 172.21.15.121:0/1723132889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00d1630 msgr2=0x7f33c015ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:19.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.814+0000 7f33c7200640 1 --2- 172.21.15.121:0/1723132889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00d1630 0x7f33c015ea40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009820 tx=0x7f33b002a5a0 comp rx=0 tx=0).stop 2024-09-17T03:41:19.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.814+0000 7f33c7200640 1 -- 172.21.15.121:0/1723132889 shutdown_connections 2024-09-17T03:41:19.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.814+0000 7f33c7200640 1 --2- 172.21.15.121:0/1723132889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00d1630 0x7f33c015ea40 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:19.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.814+0000 7f33c7200640 1 -- 172.21.15.121:0/1723132889 >> 172.21.15.121:0/1723132889 conn(0x7f33c008bfe0 msgr2=0x7f33c009d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:19.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.814+0000 7f33c7200640 1 -- 172.21.15.121:0/1723132889 shutdown_connections 2024-09-17T03:41:19.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.814+0000 7f33c7200640 1 -- 172.21.15.121:0/1723132889 wait complete. 2024-09-17T03:41:19.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.816+0000 7f33c7200640 1 Processor -- start 2024-09-17T03:41:19.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.816+0000 7f33c7200640 1 -- start start 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33c7200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33c00b39f0 0x7f33c0155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33c7200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00d1630 0x7f33c01f9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33c7200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33c00d4b20 0x7f33c01f9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33c7200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33c00d2d20 con 0x7f33c00d1630 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33c7200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f33c00d2ba0 con 0x7f33c00d4b20 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33c7200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f33c00d2ea0 con 0x7f33c00b39f0 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00d1630 0x7f33c01f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33bf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00d1630 0x7f33c01f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36152/0 (socket says 172.21.15.121:36152) 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33bf400640 1 -- 172.21.15.121:0/2623473851 learned_addr learned my addr 172.21.15.121:0/2623473851 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33bfe00640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33c00b39f0 0x7f33c0155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:19.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.818+0000 7f33c5200640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33c00d4b20 0x7f33c01f9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33bf400640 1 -- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33c00b39f0 msgr2=0x7f33c0155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33bf400640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f33c00b39f0 0x7f33c0155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33bf400640 1 -- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33c00d4b20 msgr2=0x7f33c01f9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33bf400640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f33c00d4b20 0x7f33c01f9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33bf400640 1 -- 172.21.15.121:0/2623473851 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c01f6e90 con 0x7f33c00d1630 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33bf400640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00d1630 0x7f33c01f9140 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00c3a0 tx=0x7f33ac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33b7e00640 1 -- 172.21.15.121:0/2623473851 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac017070 con 0x7f33c00d1630 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33b7e00640 1 -- 172.21.15.121:0/2623473851 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33ac0053c0 con 0x7f33c00d1630 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c00cb660 con 0x7f33c00d1630 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33b7e00640 1 -- 172.21.15.121:0/2623473851 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac003850 con 0x7f33c00d1630 2024-09-17T03:41:19.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.819+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c00cbc20 con 0x7f33c00d1630 2024-09-17T03:41:19.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.820+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33c00cbe20 con 0x7f33c00d1630 2024-09-17T03:41:19.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.821+0000 7f33b7e00640 1 -- 172.21.15.121:0/2623473851 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f33ac01a070 con 0x7f33c00d1630 2024-09-17T03:41:19.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.822+0000 7f33b7e00640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f33a0078bc0 0x7f33a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:19.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.822+0000 7f33b7e00640 1 -- 172.21.15.121:0/2623473851 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f33ac099f30 con 0x7f33c00d1630 2024-09-17T03:41:19.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.823+0000 7f33b7e00640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] conn(0x7f33a007f290 0x7f33a0081720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:19.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.823+0000 7f33b7e00640 1 -- 172.21.15.121:0/2623473851 --> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33ac016ec0 con 0x7f33a007f290 2024-09-17T03:41:19.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.823+0000 7f33b7e00640 1 -- 172.21.15.121:0/2623473851 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f33ac09c550 con 0x7f33c00d1630 2024-09-17T03:41:19.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.823+0000 7f33c5200640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] conn(0x7f33a007f290 0x7f33a0081720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:19.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.823+0000 7f33bfe00640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f33a0078bc0 0x7f33a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:19.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.824+0000 7f33c5200640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] conn(0x7f33a007f290 0x7f33a0081720 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:19.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.824+0000 7f33bfe00640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f33a0078bc0 0x7f33a007b0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f33b0034000 tx=0x7f33b0004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:19.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.824+0000 7f33b7e00640 1 -- 172.21.15.121:0/2623473851 <== osd.0 v2:172.21.15.121:6816/519637471 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f33ac016ec0 con 0x7f33a007f290 2024-09-17T03:41:19.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.837+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 --> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f33c00cea60 con 0x7f33a007f290 2024-09-17T03:41:19.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.838+0000 7f33b7e00640 1 -- 172.21.15.121:0/2623473851 <== osd.0 v2:172.21.15.121:6816/519637471 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f33c00cea60 con 0x7f33a007f290 2024-09-17T03:41:19.839 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:41:19.839 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:41:19.839 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:41:19.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.838+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 >> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] conn(0x7f33a007f290 msgr2=0x7f33a0081720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.838+0000 7f33c7200640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.121:6816/519637471,v1:172.21.15.121:6817/519637471] conn(0x7f33a007f290 0x7f33a0081720 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.838+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f33a0078bc0 msgr2=0x7f33a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.838+0000 7f33c7200640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f33a0078bc0 0x7f33a007b0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f33b0034000 tx=0x7f33b0004730 comp rx=0 tx=0).stop 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.838+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00d1630 msgr2=0x7f33c01f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.838+0000 7f33c7200640 1 --2- 172.21.15.121:0/2623473851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00d1630 0x7f33c01f9140 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00c3a0 tx=0x7f33ac00c860 comp rx=0 tx=0).stop 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.838+0000 7f33c5200640 1 -- 172.21.15.121:0/2623473851 reap_dead start 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.838+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 shutdown_connections 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.839+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 >> 172.21.15.121:0/2623473851 conn(0x7f33c008bfe0 msgr2=0x7f33c00b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.839+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 shutdown_connections 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:19.839+0000 7f33c7200640 1 -- 172.21.15.121:0/2623473851 wait complete. 2024-09-17T03:41:19.860 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T03:41:20.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.081+0000 7f37a2200640 1 -- 172.21.15.121:0/1635411071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3780004800 msgr2=0x7f3780004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.081+0000 7f37a2200640 1 --2- 172.21.15.121:0/1635411071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3780004800 0x7f3780004c10 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f3784009b50 tx=0x7f3780005830 comp rx=0 tx=0).stop 2024-09-17T03:41:20.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.081+0000 7f379be00640 1 -- 172.21.15.121:0/1635411071 reap_dead start 2024-09-17T03:41:20.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.081+0000 7f37a2200640 1 -- 172.21.15.121:0/1635411071 shutdown_connections 2024-09-17T03:41:20.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.081+0000 7f37a2200640 1 -- 172.21.15.121:0/1635411071 >> 172.21.15.121:0/1635411071 conn(0x7f379c0b1c10 msgr2=0x7f379c0b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:20.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.081+0000 7f37a2200640 1 -- 172.21.15.121:0/1635411071 shutdown_connections 2024-09-17T03:41:20.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.081+0000 7f37a2200640 1 -- 172.21.15.121:0/1635411071 wait complete. 2024-09-17T03:41:20.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.083+0000 7f37a2200640 1 Processor -- start 2024-09-17T03:41:20.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.084+0000 7f37a2200640 1 -- start start 2024-09-17T03:41:20.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.085+0000 7f37a2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3780004800 0x7f379c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.085+0000 7f37a2200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379c1586a0 0x7f379c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.085+0000 7f37a2200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c0c7190 0x7f379c0b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.085+0000 7f37a2200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1604d0 con 0x7f379c1586a0 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.085+0000 7f37a2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f379c160350 con 0x7f3780004800 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.085+0000 7f37a2200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f379c160650 con 0x7f379c0c7190 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.085+0000 7f3792a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379c1586a0 0x7f379c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.085+0000 7f3792a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379c1586a0 0x7f379c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36172/0 (socket says 172.21.15.121:36172) 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.085+0000 7f3792a00640 1 -- 172.21.15.121:0/1386855370 learned_addr learned my addr 172.21.15.121:0/1386855370 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.085+0000 7f379b400640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3780004800 0x7f379c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f379be00640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c0c7190 0x7f379c0b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f3792a00640 1 -- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c0c7190 msgr2=0x7f379c0b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f3792a00640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c0c7190 0x7f379c0b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f3792a00640 1 -- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3780004800 msgr2=0x7f379c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f3792a00640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3780004800 0x7f379c157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f3792a00640 1 -- 172.21.15.121:0/1386855370 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c1f9610 con 0x7f379c1586a0 2024-09-17T03:41:20.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f3792a00640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379c1586a0 0x7f379c0b4ed0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3784036040 tx=0x7f3784033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:20.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f3793e00640 1 -- 172.21.15.121:0/1386855370 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784038040 con 0x7f379c1586a0 2024-09-17T03:41:20.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f3793e00640 1 -- 172.21.15.121:0/1386855370 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3784004020 con 0x7f379c1586a0 2024-09-17T03:41:20.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f37a2200640 1 -- 172.21.15.121:0/1386855370 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379c15ef60 con 0x7f379c1586a0 2024-09-17T03:41:20.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.086+0000 7f3793e00640 1 -- 172.21.15.121:0/1386855370 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784004470 con 0x7f379c1586a0 2024-09-17T03:41:20.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.087+0000 7f37a2200640 1 -- 172.21.15.121:0/1386855370 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379c1f98f0 con 0x7f379c1586a0 2024-09-17T03:41:20.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.088+0000 7f37a2200640 1 -- 172.21.15.121:0/1386855370 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f379c0b2f70 con 0x7f379c1586a0 2024-09-17T03:41:20.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.089+0000 7f3793e00640 1 -- 172.21.15.121:0/1386855370 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3784045020 con 0x7f379c1586a0 2024-09-17T03:41:20.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.090+0000 7f3793e00640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3778078bc0 0x7f377807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.090+0000 7f3793e00640 1 -- 172.21.15.121:0/1386855370 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f37840bb670 con 0x7f379c1586a0 2024-09-17T03:41:20.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.090+0000 7f379b400640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3778078bc0 0x7f377807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.091+0000 7f379b400640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3778078bc0 0x7f377807b0d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f378c001860 tx=0x7f378c006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:20.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.095+0000 7f3793e00640 1 -- 172.21.15.121:0/1386855370 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3784083550 con 0x7f379c1586a0 2024-09-17T03:41:20.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.277+0000 7f37a2200640 1 -- 172.21.15.121:0/1386855370 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f379c15b4c0 con 0x7f3778078bc0 2024-09-17T03:41:20.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.277+0000 7f3793e00640 1 -- 172.21.15.121:0/1386855370 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f379c15b4c0 con 0x7f3778078bc0 2024-09-17T03:41:20.278 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T03:41:20.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 -- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3778078bc0 msgr2=0x7f377807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3778078bc0 0x7f377807b0d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f378c001860 tx=0x7f378c006040 comp rx=0 tx=0).stop 2024-09-17T03:41:20.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 -- 172.21.15.121:0/1386855370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379c1586a0 msgr2=0x7f379c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379c1586a0 0x7f379c0b4ed0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3784036040 tx=0x7f3784033670 comp rx=0 tx=0).stop 2024-09-17T03:41:20.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 -- 172.21.15.121:0/1386855370 shutdown_connections 2024-09-17T03:41:20.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c0c7190 0x7f379c0b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3778078bc0 0x7f377807b0d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f379c1586a0 0x7f379c0b4ed0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 --2- 172.21.15.121:0/1386855370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3780004800 0x7f379c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 -- 172.21.15.121:0/1386855370 >> 172.21.15.121:0/1386855370 conn(0x7f379c0b1c10 msgr2=0x7f379c0b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:20.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 -- 172.21.15.121:0/1386855370 shutdown_connections 2024-09-17T03:41:20.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.280+0000 7f37a2200640 1 -- 172.21.15.121:0/1386855370 wait complete. 2024-09-17T03:41:20.303 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T03:41:20.303 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:41:20.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.526+0000 7fae5ae00640 1 -- 172.21.15.121:0/2139214605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae38004d90 msgr2=0x7fae38005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.526+0000 7fae5ae00640 1 --2- 172.21.15.121:0/2139214605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae38004d90 0x7fae38005220 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fae4c006f40 tx=0x7fae38005830 comp rx=0 tx=0).stop 2024-09-17T03:41:20.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.526+0000 7fae58e00640 1 -- 172.21.15.121:0/2139214605 reap_dead start 2024-09-17T03:41:20.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.526+0000 7fae5ae00640 1 -- 172.21.15.121:0/2139214605 shutdown_connections 2024-09-17T03:41:20.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.526+0000 7fae5ae00640 1 -- 172.21.15.121:0/2139214605 >> 172.21.15.121:0/2139214605 conn(0x7fae540b2a10 msgr2=0x7fae540b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:20.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.526+0000 7fae5ae00640 1 -- 172.21.15.121:0/2139214605 shutdown_connections 2024-09-17T03:41:20.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.526+0000 7fae5ae00640 1 -- 172.21.15.121:0/2139214605 wait complete. 2024-09-17T03:41:20.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.528+0000 7fae5ae00640 1 Processor -- start 2024-09-17T03:41:20.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.528+0000 7fae5ae00640 1 -- start start 2024-09-17T03:41:20.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae5ae00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae38004d90 0x7fae5414fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae5ae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae541f9840 0x7fae54162290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae5ae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae54158d90 0x7fae541627d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae5ae00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae54071be0 con 0x7fae38004d90 2024-09-17T03:41:20.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae5ae00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae54071a60 con 0x7fae541f9840 2024-09-17T03:41:20.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae5ae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae540cc380 con 0x7fae54158d90 2024-09-17T03:41:20.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae53e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae38004d90 0x7fae5414fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae53e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae38004d90 0x7fae5414fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36190/0 (socket says 172.21.15.121:36190) 2024-09-17T03:41:20.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae53e00640 1 -- 172.21.15.121:0/2886508141 learned_addr learned my addr 172.21.15.121:0/2886508141 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:20.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae53e00640 1 -- 172.21.15.121:0/2886508141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae54158d90 msgr2=0x7fae541627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae53e00640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae54158d90 0x7fae541627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae53e00640 1 -- 172.21.15.121:0/2886508141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae541f9840 msgr2=0x7fae54162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae53e00640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae541f9840 0x7fae54162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae53e00640 1 -- 172.21.15.121:0/2886508141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae540b1170 con 0x7fae38004d90 2024-09-17T03:41:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.530+0000 7fae53e00640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae38004d90 0x7fae5414fdd0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fae44011d90 tx=0x7fae4400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.531+0000 7fae4be00640 1 -- 172.21.15.121:0/2886508141 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44004d20 con 0x7fae38004d90 2024-09-17T03:41:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.531+0000 7fae4be00640 1 -- 172.21.15.121:0/2886508141 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae44003970 con 0x7fae38004d90 2024-09-17T03:41:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.531+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae540b1450 con 0x7fae38004d90 2024-09-17T03:41:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.531+0000 7fae4be00640 1 -- 172.21.15.121:0/2886508141 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44003d60 con 0x7fae38004d90 2024-09-17T03:41:20.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.531+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae540b5120 con 0x7fae38004d90 2024-09-17T03:41:20.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.532+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae540cc8e0 con 0x7fae38004d90 2024-09-17T03:41:20.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.533+0000 7fae4be00640 1 -- 172.21.15.121:0/2886508141 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae44004260 con 0x7fae38004d90 2024-09-17T03:41:20.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.534+0000 7fae4be00640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae30078b90 0x7fae3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.534+0000 7fae4be00640 1 -- 172.21.15.121:0/2886508141 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7fae4409bf10 con 0x7fae38004d90 2024-09-17T03:41:20.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.534+0000 7fae4be00640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] conn(0x7fae3007f260 0x7fae300816f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.534+0000 7fae4be00640 1 -- 172.21.15.121:0/2886508141 --> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae4401fe50 con 0x7fae3007f260 2024-09-17T03:41:20.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.534+0000 7fae4be00640 1 -- 172.21.15.121:0/2886508141 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fae4409e530 con 0x7fae38004d90 2024-09-17T03:41:20.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.534+0000 7fae53400640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae30078b90 0x7fae3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.535+0000 7fae58e00640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] conn(0x7fae3007f260 0x7fae300816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.535+0000 7fae58e00640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] conn(0x7fae3007f260 0x7fae300816f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:20.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.535+0000 7fae53400640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae30078b90 0x7fae3007b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fae540cbf20 tx=0x7fae3c006060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:20.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.536+0000 7fae4be00640 1 -- 172.21.15.121:0/2886508141 <== osd.1 v2:172.21.15.121:6824/1986765065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae4401fe50 con 0x7fae3007f260 2024-09-17T03:41:20.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.549+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 --> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fae540b53c0 con 0x7fae3007f260 2024-09-17T03:41:20.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.549+0000 7fae4be00640 1 -- 172.21.15.121:0/2886508141 <== osd.1 v2:172.21.15.121:6824/1986765065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fae540b53c0 con 0x7fae3007f260 2024-09-17T03:41:20.550 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:41:20.550 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:41:20.550 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:41:20.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 >> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] conn(0x7fae3007f260 msgr2=0x7fae300816f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae5ae00640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.121:6824/1986765065,v1:172.21.15.121:6825/1986765065] conn(0x7fae3007f260 0x7fae300816f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae30078b90 msgr2=0x7fae3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae5ae00640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fae30078b90 0x7fae3007b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fae540cbf20 tx=0x7fae3c006060 comp rx=0 tx=0).stop 2024-09-17T03:41:20.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae38004d90 msgr2=0x7fae5414fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae5ae00640 1 --2- 172.21.15.121:0/2886508141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae38004d90 0x7fae5414fdd0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fae44011d90 tx=0x7fae4400f790 comp rx=0 tx=0).stop 2024-09-17T03:41:20.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae58e00640 1 -- 172.21.15.121:0/2886508141 reap_dead start 2024-09-17T03:41:20.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 shutdown_connections 2024-09-17T03:41:20.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 >> 172.21.15.121:0/2886508141 conn(0x7fae540b2a10 msgr2=0x7fae54160450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:20.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 shutdown_connections 2024-09-17T03:41:20.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.550+0000 7fae5ae00640 1 -- 172.21.15.121:0/2886508141 wait complete. 2024-09-17T03:41:20.574 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T03:41:20.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.794+0000 7efff5000640 1 -- 172.21.15.121:0/2332274917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff006e3c0 msgr2=0x7efff00b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.794+0000 7efff5000640 1 --2- 172.21.15.121:0/2332274917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff006e3c0 0x7efff00b2f70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7effd8009830 tx=0x7effd802a410 comp rx=0 tx=0).stop 2024-09-17T03:41:20.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.794+0000 7efff5000640 1 -- 172.21.15.121:0/2332274917 shutdown_connections 2024-09-17T03:41:20.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.794+0000 7efff5000640 1 --2- 172.21.15.121:0/2332274917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff006e3c0 0x7efff00b2f70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.794+0000 7efff5000640 1 --2- 172.21.15.121:0/2332274917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00cc550 0x7efff006de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.794+0000 7efff5000640 1 -- 172.21.15.121:0/2332274917 >> 172.21.15.121:0/2332274917 conn(0x7efff00b1c10 msgr2=0x7efff00b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:20.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.794+0000 7efff5000640 1 -- 172.21.15.121:0/2332274917 shutdown_connections 2024-09-17T03:41:20.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.794+0000 7efff5000640 1 -- 172.21.15.121:0/2332274917 wait complete. 2024-09-17T03:41:20.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.796+0000 7efff5000640 1 Processor -- start 2024-09-17T03:41:20.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.796+0000 7efff5000640 1 -- start start 2024-09-17T03:41:20.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7efff5000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efff006e3c0 0x7efff015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7efff5000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00cc550 0x7efff01f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7efff5000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015fdf0 0x7efff01f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7efff5000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efff00cb2d0 con 0x7efff006e3c0 2024-09-17T03:41:20.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7efff5000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efff00b37d0 con 0x7efff015fdf0 2024-09-17T03:41:20.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7efff5000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efff00cb450 con 0x7efff00cc550 2024-09-17T03:41:20.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7effede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efff006e3c0 0x7efff015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7effede00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efff006e3c0 0x7efff015a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36202/0 (socket says 172.21.15.121:36202) 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7effede00640 1 -- 172.21.15.121:0/3379167407 learned_addr learned my addr 172.21.15.121:0/3379167407 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7effe5400640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00cc550 0x7efff01f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.798+0000 7effee800640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015fdf0 0x7efff01f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7effede00640 1 -- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00cc550 msgr2=0x7efff01f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7effede00640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00cc550 0x7efff01f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7effede00640 1 -- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015fdf0 msgr2=0x7efff01f8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7effede00640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015fdf0 0x7efff01f8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7effede00640 1 -- 172.21.15.121:0/3379167407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff01f9520 con 0x7efff006e3c0 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7effee800640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015fdf0 0x7efff01f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7effede00640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efff006e3c0 0x7efff015a160 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7effe000e7c0 tx=0x7effe000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:20.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7effe6a00640 1 -- 172.21.15.121:0/3379167407 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe000cc60 con 0x7efff006e3c0 2024-09-17T03:41:20.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7effe6a00640 1 -- 172.21.15.121:0/3379167407 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effe0010430 con 0x7efff006e3c0 2024-09-17T03:41:20.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7efff5000640 1 -- 172.21.15.121:0/3379167407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff00ce700 con 0x7efff006e3c0 2024-09-17T03:41:20.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7effe6a00640 1 -- 172.21.15.121:0/3379167407 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0010860 con 0x7efff006e3c0 2024-09-17T03:41:20.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.799+0000 7efff5000640 1 -- 172.21.15.121:0/3379167407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff00ce140 con 0x7efff006e3c0 2024-09-17T03:41:20.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.800+0000 7efff5000640 1 -- 172.21.15.121:0/3379167407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff00cb900 con 0x7efff006e3c0 2024-09-17T03:41:20.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.802+0000 7effe6a00640 1 -- 172.21.15.121:0/3379167407 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7effe0010a00 con 0x7efff006e3c0 2024-09-17T03:41:20.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.803+0000 7effe6a00640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7effcc078b90 0x7effcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:20.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.804+0000 7effe6a00640 1 -- 172.21.15.121:0/3379167407 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7effe009bf20 con 0x7efff006e3c0 2024-09-17T03:41:20.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.804+0000 7effe5400640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7effcc078b90 0x7effcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:20.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.805+0000 7effe5400640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7effcc078b90 0x7effcc07b0a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7effd8034000 tx=0x7effd8004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:20.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.807+0000 7effe6a00640 1 -- 172.21.15.121:0/3379167407 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7effe0064440 con 0x7efff006e3c0 2024-09-17T03:41:20.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.989+0000 7efff5000640 1 -- 172.21.15.121:0/3379167407 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7efff0075a50 con 0x7effcc078b90 2024-09-17T03:41:20.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.990+0000 7effe6a00640 1 -- 172.21.15.121:0/3379167407 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efff0075a50 con 0x7effcc078b90 2024-09-17T03:41:20.991 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T03:41:20.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.992+0000 7efff5000640 1 -- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7effcc078b90 msgr2=0x7effcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.992+0000 7efff5000640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7effcc078b90 0x7effcc07b0a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7effd8034000 tx=0x7effd8004730 comp rx=0 tx=0).stop 2024-09-17T03:41:20.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.992+0000 7efff5000640 1 -- 172.21.15.121:0/3379167407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efff006e3c0 msgr2=0x7efff015a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:20.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.993+0000 7efff5000640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efff006e3c0 0x7efff015a160 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7effe000e7c0 tx=0x7effe000ec80 comp rx=0 tx=0).stop 2024-09-17T03:41:20.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.993+0000 7efff5000640 1 -- 172.21.15.121:0/3379167407 shutdown_connections 2024-09-17T03:41:20.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.993+0000 7efff5000640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efff015fdf0 0x7efff01f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.993+0000 7efff5000640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efff00cc550 0x7efff01f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.993+0000 7efff5000640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7effcc078b90 0x7effcc07b0a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.993+0000 7efff5000640 1 --2- 172.21.15.121:0/3379167407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efff006e3c0 0x7efff015a160 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:20.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.993+0000 7efff5000640 1 -- 172.21.15.121:0/3379167407 >> 172.21.15.121:0/3379167407 conn(0x7efff00b1c10 msgr2=0x7efff00b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:20.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.993+0000 7efff5000640 1 -- 172.21.15.121:0/3379167407 shutdown_connections 2024-09-17T03:41:20.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:20.993+0000 7efff5000640 1 -- 172.21.15.121:0/3379167407 wait complete. 2024-09-17T03:41:21.017 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T03:41:21.017 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:41:21.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.244+0000 7ff97e400640 1 -- 172.21.15.121:0/188842118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff95c004d40 msgr2=0x7ff95c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.244+0000 7ff97e400640 1 --2- 172.21.15.121:0/188842118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff95c004d40 0x7ff95c005150 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff97000c770 tx=0x7ff95c005830 comp rx=0 tx=0).stop 2024-09-17T03:41:21.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.244+0000 7ff97da00640 1 -- 172.21.15.121:0/188842118 reap_dead start 2024-09-17T03:41:21.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.244+0000 7ff97e400640 1 -- 172.21.15.121:0/188842118 shutdown_connections 2024-09-17T03:41:21.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.244+0000 7ff97e400640 1 -- 172.21.15.121:0/188842118 >> 172.21.15.121:0/188842118 conn(0x7ff97806ed50 msgr2=0x7ff97806f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:21.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.244+0000 7ff97e400640 1 -- 172.21.15.121:0/188842118 shutdown_connections 2024-09-17T03:41:21.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.244+0000 7ff97e400640 1 -- 172.21.15.121:0/188842118 wait complete. 2024-09-17T03:41:21.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.246+0000 7ff97e400640 1 Processor -- start 2024-09-17T03:41:21.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.247+0000 7ff97e400640 1 -- start start 2024-09-17T03:41:21.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.248+0000 7ff97e400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff978156860 0x7ff978158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.248+0000 7ff97e400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff978154e30 0x7ff978159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.248+0000 7ff97e400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9781f8d60 0x7ff9781f9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.248+0000 7ff97e400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff97806fd40 con 0x7ff9781f8d60 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.248+0000 7ff97e400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780b3f50 con 0x7ff978156860 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.248+0000 7ff97e400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff97806fec0 con 0x7ff978154e30 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.248+0000 7ff97da00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9781f8d60 0x7ff9781f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.248+0000 7ff97da00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9781f8d60 0x7ff9781f9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36234/0 (socket says 172.21.15.121:36234) 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.248+0000 7ff97da00640 1 -- 172.21.15.121:0/4089177894 learned_addr learned my addr 172.21.15.121:0/4089177894 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff97d000640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff978156860 0x7ff978158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff96fe00640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff978154e30 0x7ff978159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff97da00640 1 -- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff978154e30 msgr2=0x7ff978159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff97da00640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff978154e30 0x7ff978159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff97da00640 1 -- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff978156860 msgr2=0x7ff978158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff97da00640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff978156860 0x7ff978158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff97da00640 1 -- 172.21.15.121:0/4089177894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9781565c0 con 0x7ff9781f8d60 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff97da00640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9781f8d60 0x7ff9781f9170 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ff97002b680 tx=0x7ff970001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:21.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff975600640 1 -- 172.21.15.121:0/4089177894 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97000c3c0 con 0x7ff9781f8d60 2024-09-17T03:41:21.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff975600640 1 -- 172.21.15.121:0/4089177894 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff97002b9d0 con 0x7ff9781f8d60 2024-09-17T03:41:21.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff975600640 1 -- 172.21.15.121:0/4089177894 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97002bdc0 con 0x7ff9781f8d60 2024-09-17T03:41:21.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.249+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9781553a0 con 0x7ff9781f8d60 2024-09-17T03:41:21.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.250+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9781e76c0 con 0x7ff9781f8d60 2024-09-17T03:41:21.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.251+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff97806dd50 con 0x7ff9781f8d60 2024-09-17T03:41:21.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.252+0000 7ff975600640 1 -- 172.21.15.121:0/4089177894 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9700060e0 con 0x7ff9781f8d60 2024-09-17T03:41:21.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.253+0000 7ff975600640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff954078b90 0x7ff95407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.253+0000 7ff975600640 1 -- 172.21.15.121:0/4089177894 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7ff9700bad20 con 0x7ff9781f8d60 2024-09-17T03:41:21.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.253+0000 7ff975600640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] conn(0x7ff95407f260 0x7ff9540816f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.253+0000 7ff975600640 1 -- 172.21.15.121:0/4089177894 --> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff97003ae50 con 0x7ff95407f260 2024-09-17T03:41:21.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.253+0000 7ff975600640 1 -- 172.21.15.121:0/4089177894 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7ff9700bb0d0 con 0x7ff9781f8d60 2024-09-17T03:41:21.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.253+0000 7ff97d000640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff954078b90 0x7ff95407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.253+0000 7ff96fe00640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] conn(0x7ff95407f260 0x7ff9540816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.254+0000 7ff97d000640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff954078b90 0x7ff95407b0a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff978159d70 tx=0x7ff968005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:21.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.254+0000 7ff96fe00640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] conn(0x7ff95407f260 0x7ff9540816f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:21.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.255+0000 7ff975600640 1 -- 172.21.15.121:0/4089177894 <== osd.2 v2:172.21.15.121:6800/3957619612 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff97003ae50 con 0x7ff95407f260 2024-09-17T03:41:21.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.268+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 --> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff9781f9900 con 0x7ff95407f260 2024-09-17T03:41:21.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.268+0000 7ff975600640 1 -- 172.21.15.121:0/4089177894 <== osd.2 v2:172.21.15.121:6800/3957619612 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff9781f9900 con 0x7ff95407f260 2024-09-17T03:41:21.269 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:41:21.269 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:41:21.270 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:41:21.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 >> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] conn(0x7ff95407f260 msgr2=0x7ff9540816f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97e400640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.121:6800/3957619612,v1:172.21.15.121:6801/3957619612] conn(0x7ff95407f260 0x7ff9540816f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff954078b90 msgr2=0x7ff95407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97e400640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7ff954078b90 0x7ff95407b0a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff978159d70 tx=0x7ff968005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9781f8d60 msgr2=0x7ff9781f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97e400640 1 --2- 172.21.15.121:0/4089177894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9781f8d60 0x7ff9781f9170 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ff97002b680 tx=0x7ff970001630 comp rx=0 tx=0).stop 2024-09-17T03:41:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97da00640 1 -- 172.21.15.121:0/4089177894 reap_dead start 2024-09-17T03:41:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 shutdown_connections 2024-09-17T03:41:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 >> 172.21.15.121:0/4089177894 conn(0x7ff97806ed50 msgr2=0x7ff9780b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 shutdown_connections 2024-09-17T03:41:21.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.269+0000 7ff97e400640 1 -- 172.21.15.121:0/4089177894 wait complete. 2024-09-17T03:41:21.294 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T03:41:21.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.522+0000 7f59d8e00640 1 -- 172.21.15.121:0/3514138186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59d415fdf0 msgr2=0x7f59d4160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.522+0000 7f59d8e00640 1 --2- 172.21.15.121:0/3514138186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59d415fdf0 0x7f59d4160350 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f59cc005fd0 tx=0x7f59cc02a820 comp rx=0 tx=0).stop 2024-09-17T03:41:21.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.522+0000 7f59d8e00640 1 -- 172.21.15.121:0/3514138186 shutdown_connections 2024-09-17T03:41:21.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.522+0000 7f59d8e00640 1 --2- 172.21.15.121:0/3514138186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59d415fdf0 0x7f59d4160350 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.522+0000 7f59d8e00640 1 --2- 172.21.15.121:0/3514138186 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59d40cc550 0x7f59d406de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.522+0000 7f59d8e00640 1 -- 172.21.15.121:0/3514138186 >> 172.21.15.121:0/3514138186 conn(0x7f59d40b1c10 msgr2=0x7f59d40b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:21.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.522+0000 7f59d8e00640 1 -- 172.21.15.121:0/3514138186 shutdown_connections 2024-09-17T03:41:21.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.522+0000 7f59d8e00640 1 -- 172.21.15.121:0/3514138186 wait complete. 2024-09-17T03:41:21.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.524+0000 7f59d8e00640 1 Processor -- start 2024-09-17T03:41:21.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.524+0000 7f59d8e00640 1 -- start start 2024-09-17T03:41:21.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d8e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59d406e3c0 0x7f59d415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d8e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59d40cc550 0x7f59d4150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d8e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59d415fdf0 0x7f59d40b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d8e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f59d4160a10 con 0x7f59d406e3c0 2024-09-17T03:41:21.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d8e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f59d4160890 con 0x7f59d40cc550 2024-09-17T03:41:21.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d8e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f59d4160b90 con 0x7f59d415fdf0 2024-09-17T03:41:21.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d1e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59d406e3c0 0x7f59d415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d1e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59d406e3c0 0x7f59d415e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36248/0 (socket says 172.21.15.121:36248) 2024-09-17T03:41:21.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d1e00640 1 -- 172.21.15.121:0/2381049844 learned_addr learned my addr 172.21.15.121:0/2381049844 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:21.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d2800640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59d415fdf0 0x7f59d40b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.526+0000 7f59d1400640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59d40cc550 0x7f59d4150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.527+0000 7f59d1e00640 1 -- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59d415fdf0 msgr2=0x7f59d40b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.527+0000 7f59d1e00640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59d415fdf0 0x7f59d40b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.527+0000 7f59d1e00640 1 -- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59d40cc550 msgr2=0x7f59d4150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.527+0000 7f59d1e00640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59d40cc550 0x7f59d4150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.527+0000 7f59d1e00640 1 -- 172.21.15.121:0/2381049844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d415b5a0 con 0x7f59d406e3c0 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.527+0000 7f59d1e00640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59d406e3c0 0x7f59d415e9f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f59c400e790 tx=0x7f59c400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.527+0000 7f59ca000640 1 -- 172.21.15.121:0/2381049844 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c400eea0 con 0x7f59d406e3c0 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.527+0000 7f59d8e00640 1 -- 172.21.15.121:0/2381049844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d41f8d40 con 0x7f59d406e3c0 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.527+0000 7f59ca000640 1 -- 172.21.15.121:0/2381049844 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59c400cdb0 con 0x7f59d406e3c0 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.527+0000 7f59ca000640 1 -- 172.21.15.121:0/2381049844 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4010690 con 0x7f59d406e3c0 2024-09-17T03:41:21.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.528+0000 7f59d8e00640 1 -- 172.21.15.121:0/2381049844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d41f9300 con 0x7f59d406e3c0 2024-09-17T03:41:21.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.529+0000 7f59d8e00640 1 -- 172.21.15.121:0/2381049844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d4161040 con 0x7f59d406e3c0 2024-09-17T03:41:21.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.530+0000 7f59ca000640 1 -- 172.21.15.121:0/2381049844 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59c4010830 con 0x7f59d406e3c0 2024-09-17T03:41:21.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.531+0000 7f59ca000640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59b4078bc0 0x7f59b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.531+0000 7f59ca000640 1 -- 172.21.15.121:0/2381049844 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f59c409b740 con 0x7f59d406e3c0 2024-09-17T03:41:21.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.531+0000 7f59d1400640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59b4078bc0 0x7f59b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.532+0000 7f59d1400640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59b4078bc0 0x7f59b407b0d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f59c0007fd0 tx=0x7f59c0001390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:21.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.540+0000 7f59ca000640 1 -- 172.21.15.121:0/2381049844 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59c4063480 con 0x7f59d406e3c0 2024-09-17T03:41:21.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.731+0000 7f59d8e00640 1 -- 172.21.15.121:0/2381049844 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f59d40b3230 con 0x7f59b4078bc0 2024-09-17T03:41:21.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.732+0000 7f59ca000640 1 -- 172.21.15.121:0/2381049844 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f59d40b3230 con 0x7f59b4078bc0 2024-09-17T03:41:21.733 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T03:41:21.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 -- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59b4078bc0 msgr2=0x7f59b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59b4078bc0 0x7f59b407b0d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f59c0007fd0 tx=0x7f59c0001390 comp rx=0 tx=0).stop 2024-09-17T03:41:21.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 -- 172.21.15.121:0/2381049844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59d406e3c0 msgr2=0x7f59d415e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59d406e3c0 0x7f59d415e9f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f59c400e790 tx=0x7f59c400ec50 comp rx=0 tx=0).stop 2024-09-17T03:41:21.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 -- 172.21.15.121:0/2381049844 shutdown_connections 2024-09-17T03:41:21.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59d415fdf0 0x7f59d40b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59d40cc550 0x7f59d4150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f59b4078bc0 0x7f59b407b0d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 --2- 172.21.15.121:0/2381049844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59d406e3c0 0x7f59d415e9f0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 -- 172.21.15.121:0/2381049844 >> 172.21.15.121:0/2381049844 conn(0x7f59d40b1c10 msgr2=0x7f59d40afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:21.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.734+0000 7f59d8e00640 1 -- 172.21.15.121:0/2381049844 shutdown_connections 2024-09-17T03:41:21.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.735+0000 7f59d8e00640 1 -- 172.21.15.121:0/2381049844 wait complete. 2024-09-17T03:41:21.757 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T03:41:21.757 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:41:21.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.990+0000 7fdb87e00640 1 -- 172.21.15.121:0/673453631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb880d0620 msgr2=0x7fdb880d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.990+0000 7fdb87e00640 1 --2- 172.21.15.121:0/673453631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb880d0620 0x7fdb880d2fd0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fdb8808d2c0 tx=0x7fdb7402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.991+0000 7fdb87e00640 1 -- 172.21.15.121:0/673453631 shutdown_connections 2024-09-17T03:41:21.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.991+0000 7fdb87e00640 1 --2- 172.21.15.121:0/673453631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb880d3510 0x7fdb8806d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.991+0000 7fdb87e00640 1 --2- 172.21.15.121:0/673453631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb880d0620 0x7fdb880d2fd0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.991+0000 7fdb87e00640 1 --2- 172.21.15.121:0/673453631 >> v2:172.21.15.176:3300/0 conn(0x7fdb8815e9a0 0x7fdb880b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.991+0000 7fdb87e00640 1 -- 172.21.15.121:0/673453631 >> 172.21.15.121:0/673453631 conn(0x7fdb880d4a20 msgr2=0x7fdb880b5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:21.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.991+0000 7fdb87e00640 1 -- 172.21.15.121:0/673453631 shutdown_connections 2024-09-17T03:41:21.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.991+0000 7fdb87e00640 1 -- 172.21.15.121:0/673453631 wait complete. 2024-09-17T03:41:21.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.993+0000 7fdb87e00640 1 Processor -- start 2024-09-17T03:41:21.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.993+0000 7fdb87e00640 1 -- start start 2024-09-17T03:41:21.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.994+0000 7fdb87e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb880d0620 0x7fdb880cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.994+0000 7fdb87e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb880d3510 0x7fdb880cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.994+0000 7fdb87e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb8815e9a0 0x7fdb880cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:21.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.994+0000 7fdb87e00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdb880d0bb0 con 0x7fdb8815e9a0 2024-09-17T03:41:21.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.994+0000 7fdb87e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb880d0a30 con 0x7fdb880d3510 2024-09-17T03:41:21.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.994+0000 7fdb87e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8806d5f0 con 0x7fdb880d0620 2024-09-17T03:41:21.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb87400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb8815e9a0 0x7fdb880cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb87400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb8815e9a0 0x7fdb880cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55310/0 (socket says 172.21.15.121:55310) 2024-09-17T03:41:21.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb87400640 1 -- 172.21.15.121:0/3319865327 learned_addr learned my addr 172.21.15.121:0/3319865327 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:21.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb86a00640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb880d0620 0x7fdb880cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb86000640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb880d3510 0x7fdb880cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:21.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb87400640 1 -- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb880d0620 msgr2=0x7fdb880cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb87400640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb880d0620 0x7fdb880cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb87400640 1 -- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb880d3510 msgr2=0x7fdb880cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:21.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb87400640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb880d3510 0x7fdb880cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:21.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb87400640 1 -- 172.21.15.121:0/3319865327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb881ea9c0 con 0x7fdb8815e9a0 2024-09-17T03:41:21.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.995+0000 7fdb86000640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb880d3510 0x7fdb880cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:21.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.996+0000 7fdb87400640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb8815e9a0 0x7fdb880cdbd0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000e990 tx=0x7fdb8000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:21.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.996+0000 7fdb7ea00640 1 -- 172.21.15.121:0/3319865327 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80004d20 con 0x7fdb8815e9a0 2024-09-17T03:41:21.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.996+0000 7fdb7ea00640 1 -- 172.21.15.121:0/3319865327 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb8000caa0 con 0x7fdb8815e9a0 2024-09-17T03:41:21.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.996+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb881eaca0 con 0x7fdb8815e9a0 2024-09-17T03:41:21.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.996+0000 7fdb7ea00640 1 -- 172.21.15.121:0/3319865327 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80005020 con 0x7fdb8815e9a0 2024-09-17T03:41:21.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.996+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb881eb260 con 0x7fdb8815e9a0 2024-09-17T03:41:21.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.997+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb8806db00 con 0x7fdb8815e9a0 2024-09-17T03:41:21.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.998+0000 7fdb7ea00640 1 -- 172.21.15.121:0/3319865327 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb800051c0 con 0x7fdb8815e9a0 2024-09-17T03:41:22.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.999+0000 7fdb7ea00640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdb68078b90 0x7fdb6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.999+0000 7fdb7ea00640 1 -- 172.21.15.121:0/3319865327 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7fdb8009b550 con 0x7fdb8815e9a0 2024-09-17T03:41:22.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:21.999+0000 7fdb7ea00640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] conn(0x7fdb6807f260 0x7fdb680816f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.000+0000 7fdb7ea00640 1 -- 172.21.15.121:0/3319865327 --> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb80009050 con 0x7fdb6807f260 2024-09-17T03:41:22.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.000+0000 7fdb7ea00640 1 -- 172.21.15.121:0/3319865327 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fdb800a2050 con 0x7fdb8815e9a0 2024-09-17T03:41:22.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.000+0000 7fdb86a00640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdb68078b90 0x7fdb6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.000+0000 7fdb86000640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] conn(0x7fdb6807f260 0x7fdb680816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.000+0000 7fdb86a00640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdb68078b90 0x7fdb6807b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800bb30 tx=0x7fdb7800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:22.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.000+0000 7fdb86000640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] conn(0x7fdb6807f260 0x7fdb680816f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:22.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.001+0000 7fdb7ea00640 1 -- 172.21.15.121:0/3319865327 <== osd.3 v2:172.21.15.121:6808/1711221515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb80009050 con 0x7fdb6807f260 2024-09-17T03:41:22.023 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:41:22.027 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:41:22.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.028+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 --> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdb881ea770 con 0x7fdb6807f260 2024-09-17T03:41:22.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.029+0000 7fdb7ea00640 1 -- 172.21.15.121:0/3319865327 <== osd.3 v2:172.21.15.121:6808/1711221515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdb881ea770 con 0x7fdb6807f260 2024-09-17T03:41:22.029 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:41:22.030 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:41:22.030 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.029+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 >> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] conn(0x7fdb6807f260 msgr2=0x7fdb680816f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.029+0000 7fdb87e00640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.121:6808/1711221515,v1:172.21.15.121:6809/1711221515] conn(0x7fdb6807f260 0x7fdb680816f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.029+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdb68078b90 msgr2=0x7fdb6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.029+0000 7fdb87e00640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fdb68078b90 0x7fdb6807b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800bb30 tx=0x7fdb7800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.029+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb8815e9a0 msgr2=0x7fdb880cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.029+0000 7fdb87e00640 1 --2- 172.21.15.121:0/3319865327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb8815e9a0 0x7fdb880cdbd0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000e990 tx=0x7fdb8000ee50 comp rx=0 tx=0).stop 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.029+0000 7fdb87400640 1 -- 172.21.15.121:0/3319865327 reap_dead start 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.029+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 shutdown_connections 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.029+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 >> 172.21.15.121:0/3319865327 conn(0x7fdb880d4a20 msgr2=0x7fdb880b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.030+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 shutdown_connections 2024-09-17T03:41:22.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.030+0000 7fdb87e00640 1 -- 172.21.15.121:0/3319865327 wait complete. 2024-09-17T03:41:22.054 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T03:41:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.322+0000 7f038ce00640 1 -- 172.21.15.121:0/2430150887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038806cd40 msgr2=0x7f0388162e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.322+0000 7f038ce00640 1 --2- 172.21.15.121:0/2430150887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038806cd40 0x7f0388162e20 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f03880b74a0 tx=0x7f037802a540 comp rx=0 tx=0).stop 2024-09-17T03:41:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.322+0000 7f038ce00640 1 -- 172.21.15.121:0/2430150887 shutdown_connections 2024-09-17T03:41:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.322+0000 7f038ce00640 1 --2- 172.21.15.121:0/2430150887 >> v2:172.21.15.176:3300/0 conn(0x7f038815ffe0 0x7f03880b9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.322+0000 7f038ce00640 1 --2- 172.21.15.121:0/2430150887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038806cd40 0x7f0388162e20 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.322+0000 7f038ce00640 1 -- 172.21.15.121:0/2430150887 >> 172.21.15.121:0/2430150887 conn(0x7f03880d1670 msgr2=0x7f03880b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.322+0000 7f038ce00640 1 -- 172.21.15.121:0/2430150887 shutdown_connections 2024-09-17T03:41:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.322+0000 7f038ce00640 1 -- 172.21.15.121:0/2430150887 wait complete. 2024-09-17T03:41:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.324+0000 7f038ce00640 1 Processor -- start 2024-09-17T03:41:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.324+0000 7f038ce00640 1 -- start start 2024-09-17T03:41:22.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f038ce00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038806cd40 0x7f03881f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f038ce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038815ffe0 0x7f03880cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f038ce00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03881603f0 0x7f0388157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f038ce00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f03880ba220 con 0x7f03881603f0 2024-09-17T03:41:22.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f038ce00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f03880ba0a0 con 0x7f038815ffe0 2024-09-17T03:41:22.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f038ce00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f03880ba3a0 con 0x7f038806cd40 2024-09-17T03:41:22.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f0387e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03881603f0 0x7f0388157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f0387e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03881603f0 0x7f0388157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55318/0 (socket says 172.21.15.121:55318) 2024-09-17T03:41:22.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f0387e00640 1 -- 172.21.15.121:0/3098754781 learned_addr learned my addr 172.21.15.121:0/3098754781 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:22.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f0387400640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038806cd40 0x7f03881f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f037fe00640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038815ffe0 0x7f03880cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.326+0000 7f0387e00640 1 -- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038806cd40 msgr2=0x7f03881f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.327+0000 7f0387e00640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038806cd40 0x7f03881f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.327+0000 7f0387e00640 1 -- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038815ffe0 msgr2=0x7f03880cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.327+0000 7f0387e00640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038815ffe0 0x7f03880cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.327+0000 7f0387e00640 1 -- 172.21.15.121:0/3098754781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0388155010 con 0x7f03881603f0 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.327+0000 7f0387e00640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03881603f0 0x7f0388157980 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f038000cb40 tx=0x7f038000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.327+0000 7f037f400640 1 -- 172.21.15.121:0/3098754781 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380016020 con 0x7f03881603f0 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.327+0000 7f037f400640 1 -- 172.21.15.121:0/3098754781 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f038000ad30 con 0x7f03881603f0 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.327+0000 7f037f400640 1 -- 172.21.15.121:0/3098754781 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380012680 con 0x7f03881603f0 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.327+0000 7f038ce00640 1 -- 172.21.15.121:0/3098754781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03880b50d0 con 0x7f03881603f0 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.327+0000 7f038ce00640 1 -- 172.21.15.121:0/3098754781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03881f5600 con 0x7f03881603f0 2024-09-17T03:41:22.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.328+0000 7f038ce00640 1 -- 172.21.15.121:0/3098754781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0388162e20 con 0x7f03881603f0 2024-09-17T03:41:22.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.330+0000 7f037f400640 1 -- 172.21.15.121:0/3098754781 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0380019020 con 0x7f03881603f0 2024-09-17T03:41:22.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.331+0000 7f037f400640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0364078bc0 0x7f036407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.331+0000 7f037f400640 1 -- 172.21.15.121:0/3098754781 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f038009b2c0 con 0x7f03881603f0 2024-09-17T03:41:22.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.332+0000 7f0387400640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0364078bc0 0x7f036407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.333+0000 7f0387400640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0364078bc0 0x7f036407b0d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0378034000 tx=0x7f0378004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:22.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.335+0000 7f037f400640 1 -- 172.21.15.121:0/3098754781 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0380020020 con 0x7f03881603f0 2024-09-17T03:41:22.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.525+0000 7f038ce00640 1 -- 172.21.15.121:0/3098754781 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f03880b52a0 con 0x7f0364078bc0 2024-09-17T03:41:22.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.526+0000 7f037f400640 1 -- 172.21.15.121:0/3098754781 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f03880b52a0 con 0x7f0364078bc0 2024-09-17T03:41:22.527 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T03:41:22.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 -- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0364078bc0 msgr2=0x7f036407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0364078bc0 0x7f036407b0d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0378034000 tx=0x7f0378004730 comp rx=0 tx=0).stop 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 -- 172.21.15.121:0/3098754781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03881603f0 msgr2=0x7f0388157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03881603f0 0x7f0388157980 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f038000cb40 tx=0x7f038000a060 comp rx=0 tx=0).stop 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 -- 172.21.15.121:0/3098754781 shutdown_connections 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f0364078bc0 0x7f036407b0d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03881603f0 0x7f0388157980 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f038815ffe0 0x7f03880cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 --2- 172.21.15.121:0/3098754781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f038806cd40 0x7f03881f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 -- 172.21.15.121:0/3098754781 >> 172.21.15.121:0/3098754781 conn(0x7f03880d1670 msgr2=0x7f03880b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 -- 172.21.15.121:0/3098754781 shutdown_connections 2024-09-17T03:41:22.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.529+0000 7f038ce00640 1 -- 172.21.15.121:0/3098754781 wait complete. 2024-09-17T03:41:22.552 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T03:41:22.553 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:41:22.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.782+0000 7f5a41800640 1 -- 172.21.15.121:0/2949723767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c0d36e0 msgr2=0x7f5a3c06d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.782+0000 7f5a41800640 1 --2- 172.21.15.121:0/2949723767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c0d36e0 0x7f5a3c06d0b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5a34005fd0 tx=0x7f5a3402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.782+0000 7f5a41800640 1 -- 172.21.15.121:0/2949723767 shutdown_connections 2024-09-17T03:41:22.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.782+0000 7f5a41800640 1 --2- 172.21.15.121:0/2949723767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c0d36e0 0x7f5a3c06d0b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.782+0000 7f5a41800640 1 -- 172.21.15.121:0/2949723767 >> 172.21.15.121:0/2949723767 conn(0x7f5a3c0d4a20 msgr2=0x7f5a3c0b5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:22.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.782+0000 7f5a41800640 1 -- 172.21.15.121:0/2949723767 shutdown_connections 2024-09-17T03:41:22.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.782+0000 7f5a41800640 1 -- 172.21.15.121:0/2949723767 wait complete. 2024-09-17T03:41:22.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.785+0000 7f5a41800640 1 Processor -- start 2024-09-17T03:41:22.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.785+0000 7f5a41800640 1 -- start start 2024-09-17T03:41:22.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.786+0000 7f5a41800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0b7900 0x7f5a3c1f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.786+0000 7f5a41800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c15e9a0 0x7f5a3c158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.786+0000 7f5a41800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a3c1f4f30 0x7f5a3c156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.786+0000 7f5a41800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c06d9c0 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.786+0000 7f5a41800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c06d840 con 0x7f5a3c15e9a0 2024-09-17T03:41:22.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.786+0000 7f5a41800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c06db40 con 0x7f5a3c0b7900 2024-09-17T03:41:22.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.786+0000 7f5a40e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a3c1f4f30 0x7f5a3c156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.787+0000 7f5a40e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a3c1f4f30 0x7f5a3c156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55322/0 (socket says 172.21.15.121:55322) 2024-09-17T03:41:22.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.787+0000 7f5a40e00640 1 -- 172.21.15.121:0/2230641903 learned_addr learned my addr 172.21.15.121:0/2230641903 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:22.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.787+0000 7f5a33e00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c15e9a0 0x7f5a3c158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.787+0000 7f5a3be00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0b7900 0x7f5a3c1f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.787+0000 7f5a40e00640 1 -- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0b7900 msgr2=0x7f5a3c1f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.787+0000 7f5a40e00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a3c0b7900 0x7f5a3c1f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.787+0000 7f5a40e00640 1 -- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c15e9a0 msgr2=0x7f5a3c158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.787+0000 7f5a40e00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a3c15e9a0 0x7f5a3c158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.787+0000 7f5a40e00640 1 -- 172.21.15.121:0/2230641903 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c1f28b0 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.787+0000 7f5a40e00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a3c1f4f30 0x7f5a3c156ff0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f5a3402aea0 tx=0x7f5a340316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:22.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.788+0000 7f5a38c00640 1 -- 172.21.15.121:0/2230641903 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34031990 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.788+0000 7f5a38c00640 1 -- 172.21.15.121:0/2230641903 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a34031c40 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.788+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3c156530 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.788+0000 7f5a38c00640 1 -- 172.21.15.121:0/2230641903 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a340332d0 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.788+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3c1f5d40 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.789+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a3c06d0b0 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.790+0000 7f5a38c00640 1 -- 172.21.15.121:0/2230641903 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a34033470 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.791+0000 7f5a38c00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a18078bc0 0x7f5a1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.791+0000 7f5a38c00640 1 -- 172.21.15.121:0/2230641903 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f5a340bc4e0 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.791+0000 7f5a38c00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] conn(0x7f5a1807f290 0x7f5a18081720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:22.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.792+0000 7f5a38c00640 1 -- 172.21.15.121:0/2230641903 --> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a34030ec0 con 0x7f5a1807f290 2024-09-17T03:41:22.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.792+0000 7f5a38c00640 1 -- 172.21.15.121:0/2230641903 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f5a340bc890 con 0x7f5a3c1f4f30 2024-09-17T03:41:22.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.792+0000 7f5a3be00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a18078bc0 0x7f5a1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.792+0000 7f5a33e00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] conn(0x7f5a1807f290 0x7f5a18081720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:22.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.793+0000 7f5a3be00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a18078bc0 0x7f5a1807b0d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c001090 tx=0x7f5a2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:22.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.793+0000 7f5a33e00640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] conn(0x7f5a1807f290 0x7f5a18081720 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:22.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.794+0000 7f5a38c00640 1 -- 172.21.15.121:0/2230641903 <== osd.4 v2:172.21.15.176:6818/3274370689 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a34030ec0 con 0x7f5a1807f290 2024-09-17T03:41:22.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.807+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 --> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5a3c1f57f0 con 0x7f5a1807f290 2024-09-17T03:41:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a38c00640 1 -- 172.21.15.121:0/2230641903 <== osd.4 v2:172.21.15.176:6818/3274370689 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5a3c1f57f0 con 0x7f5a1807f290 2024-09-17T03:41:22.810 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:41:22.810 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:41:22.810 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:41:22.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] conn(0x7f5a1807f290 msgr2=0x7f5a18081720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a41800640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:6818/3274370689,v1:172.21.15.176:6819/3274370689] conn(0x7f5a1807f290 0x7f5a18081720 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a18078bc0 msgr2=0x7f5a1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a41800640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5a18078bc0 0x7f5a1807b0d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c001090 tx=0x7f5a2c009040 comp rx=0 tx=0).stop 2024-09-17T03:41:22.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a3c1f4f30 msgr2=0x7f5a3c156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:22.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a41800640 1 --2- 172.21.15.121:0/2230641903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a3c1f4f30 0x7f5a3c156ff0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f5a3402aea0 tx=0x7f5a340316f0 comp rx=0 tx=0).stop 2024-09-17T03:41:22.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a40e00640 1 -- 172.21.15.121:0/2230641903 reap_dead start 2024-09-17T03:41:22.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 shutdown_connections 2024-09-17T03:41:22.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 >> 172.21.15.121:0/2230641903 conn(0x7f5a3c0d4a20 msgr2=0x7f5a3c0b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:22.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 shutdown_connections 2024-09-17T03:41:22.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:22.808+0000 7f5a41800640 1 -- 172.21.15.121:0/2230641903 wait complete. 2024-09-17T03:41:22.829 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T03:41:23.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.049+0000 7f5bcf600640 1 -- 172.21.15.121:0/3542196750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bc815fdf0 msgr2=0x7f5bc8160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.049+0000 7f5bcf600640 1 --2- 172.21.15.121:0/3542196750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bc815fdf0 0x7f5bc8160350 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8071b40 tx=0x7f5bc002a980 comp rx=0 tx=0).stop 2024-09-17T03:41:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.050+0000 7f5bcf600640 1 -- 172.21.15.121:0/3542196750 shutdown_connections 2024-09-17T03:41:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.050+0000 7f5bcf600640 1 --2- 172.21.15.121:0/3542196750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bc815fdf0 0x7f5bc8160350 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.050+0000 7f5bcf600640 1 --2- 172.21.15.121:0/3542196750 >> v2:172.21.15.176:3300/0 conn(0x7f5bc80cc550 0x7f5bc806de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.050+0000 7f5bcf600640 1 -- 172.21.15.121:0/3542196750 >> 172.21.15.121:0/3542196750 conn(0x7f5bc80b1c10 msgr2=0x7f5bc80b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.050+0000 7f5bcf600640 1 -- 172.21.15.121:0/3542196750 shutdown_connections 2024-09-17T03:41:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.050+0000 7f5bcf600640 1 -- 172.21.15.121:0/3542196750 wait complete. 2024-09-17T03:41:23.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.052+0000 7f5bcf600640 1 Processor -- start 2024-09-17T03:41:23.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.052+0000 7f5bcf600640 1 -- start start 2024-09-17T03:41:23.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.053+0000 7f5bcf600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5bc806e3c0 0x7f5bc81563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.053+0000 7f5bcf600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5bc80cc550 0x7f5bc8158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.053+0000 7f5bcf600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bc815fdf0 0x7f5bc80c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.053+0000 7f5bcf600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc8160a10 con 0x7f5bc815fdf0 2024-09-17T03:41:23.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.053+0000 7f5bcf600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc8160890 con 0x7f5bc80cc550 2024-09-17T03:41:23.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.053+0000 7f5bcf600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc8160b90 con 0x7f5bc806e3c0 2024-09-17T03:41:23.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bcd600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bc815fdf0 0x7f5bc80c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bcd600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bc815fdf0 0x7f5bc80c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55328/0 (socket says 172.21.15.121:55328) 2024-09-17T03:41:23.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bcd600640 1 -- 172.21.15.121:0/297412669 learned_addr learned my addr 172.21.15.121:0/297412669 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:23.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bc7e00640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5bc80cc550 0x7f5bc8158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bcd600640 1 -- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5bc806e3c0 msgr2=0x7f5bc81563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bcd600640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5bc806e3c0 0x7f5bc81563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bcd600640 1 -- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5bc80cc550 msgr2=0x7f5bc8158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bcd600640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5bc80cc550 0x7f5bc8158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bcd600640 1 -- 172.21.15.121:0/297412669 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc8156c10 con 0x7f5bc815fdf0 2024-09-17T03:41:23.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bc7e00640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5bc80cc550 0x7f5bc8158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:23.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.054+0000 7f5bcd600640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bc815fdf0 0x7f5bc80c4fc0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009d60 tx=0x7f5bc0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:23.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.055+0000 7f5bc4c00640 1 -- 172.21.15.121:0/297412669 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0034040 con 0x7f5bc815fdf0 2024-09-17T03:41:23.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.055+0000 7f5bc4c00640 1 -- 172.21.15.121:0/297412669 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bc0004540 con 0x7f5bc815fdf0 2024-09-17T03:41:23.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.055+0000 7f5bc4c00640 1 -- 172.21.15.121:0/297412669 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0045480 con 0x7f5bc815fdf0 2024-09-17T03:41:23.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.055+0000 7f5bcf600640 1 -- 172.21.15.121:0/297412669 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc81f68f0 con 0x7f5bc815fdf0 2024-09-17T03:41:23.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.055+0000 7f5bcf600640 1 -- 172.21.15.121:0/297412669 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc81f6e70 con 0x7f5bc815fdf0 2024-09-17T03:41:23.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.056+0000 7f5bcf600640 1 -- 172.21.15.121:0/297412669 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc8161040 con 0x7f5bc815fdf0 2024-09-17T03:41:23.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.057+0000 7f5bc4c00640 1 -- 172.21.15.121:0/297412669 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5bc0037020 con 0x7f5bc815fdf0 2024-09-17T03:41:23.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.058+0000 7f5bc4c00640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ba8078b90 0x7f5ba807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.058+0000 7f5bc4c00640 1 -- 172.21.15.121:0/297412669 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f5bc00bc630 con 0x7f5bc815fdf0 2024-09-17T03:41:23.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.058+0000 7f5bccc00640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ba8078b90 0x7f5ba807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.059+0000 7f5bccc00640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ba8078b90 0x7f5ba807b0a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0058c0 tx=0x7f5bbc005850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:23.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.062+0000 7f5bc4c00640 1 -- 172.21.15.121:0/297412669 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5bc0084490 con 0x7f5bc815fdf0 2024-09-17T03:41:23.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.244+0000 7f5bcf600640 1 -- 172.21.15.121:0/297412669 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5bc80b31a0 con 0x7f5ba8078b90 2024-09-17T03:41:23.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.245+0000 7f5bc4c00640 1 -- 172.21.15.121:0/297412669 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5bc80b31a0 con 0x7f5ba8078b90 2024-09-17T03:41:23.246 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T03:41:23.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 -- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ba8078b90 msgr2=0x7f5ba807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ba8078b90 0x7f5ba807b0a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0058c0 tx=0x7f5bbc005850 comp rx=0 tx=0).stop 2024-09-17T03:41:23.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 -- 172.21.15.121:0/297412669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bc815fdf0 msgr2=0x7f5bc80c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bc815fdf0 0x7f5bc80c4fc0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009d60 tx=0x7f5bc0003f90 comp rx=0 tx=0).stop 2024-09-17T03:41:23.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 -- 172.21.15.121:0/297412669 shutdown_connections 2024-09-17T03:41:23.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f5ba8078b90 0x7f5ba807b0a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bc815fdf0 0x7f5bc80c4fc0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5bc80cc550 0x7f5bc8158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 --2- 172.21.15.121:0/297412669 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5bc806e3c0 0x7f5bc81563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 -- 172.21.15.121:0/297412669 >> 172.21.15.121:0/297412669 conn(0x7f5bc80b1c10 msgr2=0x7f5bc80b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:23.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 -- 172.21.15.121:0/297412669 shutdown_connections 2024-09-17T03:41:23.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.248+0000 7f5bcf600640 1 -- 172.21.15.121:0/297412669 wait complete. 2024-09-17T03:41:23.273 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T03:41:23.273 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:41:23.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.499+0000 7fa04b000640 1 -- 172.21.15.121:0/2376846671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028004d40 msgr2=0x7fa0280051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.499+0000 7fa04b000640 1 --2- 172.21.15.121:0/2376846671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028004d40 0x7fa0280051f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fa03c001d90 tx=0x7fa028005830 comp rx=0 tx=0).stop 2024-09-17T03:41:23.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.499+0000 7fa049000640 1 -- 172.21.15.121:0/2376846671 reap_dead start 2024-09-17T03:41:23.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.499+0000 7fa04b000640 1 -- 172.21.15.121:0/2376846671 shutdown_connections 2024-09-17T03:41:23.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.499+0000 7fa04b000640 1 -- 172.21.15.121:0/2376846671 >> 172.21.15.121:0/2376846671 conn(0x7fa0440d1c30 msgr2=0x7fa0440cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:23.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.499+0000 7fa04b000640 1 -- 172.21.15.121:0/2376846671 shutdown_connections 2024-09-17T03:41:23.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.499+0000 7fa04b000640 1 -- 172.21.15.121:0/2376846671 wait complete. 2024-09-17T03:41:23.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.501+0000 7fa04b000640 1 Processor -- start 2024-09-17T03:41:23.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.501+0000 7fa04b000640 1 -- start start 2024-09-17T03:41:23.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa04b000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028004d40 0x7fa044158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa04b000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa04406f410 0x7fa0440b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa04b000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa04406f820 0x7fa0440b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa04b000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa044071120 con 0x7fa028004d40 2024-09-17T03:41:23.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa04b000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0440ccc40 con 0x7fa04406f820 2024-09-17T03:41:23.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa04b000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa044161130 con 0x7fa04406f410 2024-09-17T03:41:23.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa043e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028004d40 0x7fa044158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa043e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028004d40 0x7fa044158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55352/0 (socket says 172.21.15.121:55352) 2024-09-17T03:41:23.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa043e00640 1 -- 172.21.15.121:0/296216371 learned_addr learned my addr 172.21.15.121:0/296216371 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:23.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa043400640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa04406f410 0x7fa0440b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa049000640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa04406f820 0x7fa0440b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa043e00640 1 -- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa04406f410 msgr2=0x7fa0440b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa043e00640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa04406f410 0x7fa0440b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa043e00640 1 -- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa04406f820 msgr2=0x7fa0440b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa043e00640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa04406f820 0x7fa0440b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa043e00640 1 -- 172.21.15.121:0/296216371 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0440cf120 con 0x7fa028004d40 2024-09-17T03:41:23.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa043400640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa04406f410 0x7fa0440b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:23.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.503+0000 7fa049000640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa04406f820 0x7fa0440b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:23.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.504+0000 7fa043e00640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028004d40 0x7fa044158590 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa034011ae0 tx=0x7fa034009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:23.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.504+0000 7fa03be00640 1 -- 172.21.15.121:0/296216371 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03401e070 con 0x7fa028004d40 2024-09-17T03:41:23.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.504+0000 7fa03be00640 1 -- 172.21.15.121:0/296216371 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa03400fc10 con 0x7fa028004d40 2024-09-17T03:41:23.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.504+0000 7fa03be00640 1 -- 172.21.15.121:0/296216371 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034019410 con 0x7fa028004d40 2024-09-17T03:41:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.504+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0440cf400 con 0x7fa028004d40 2024-09-17T03:41:23.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.504+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0440cf9c0 con 0x7fa028004d40 2024-09-17T03:41:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.505+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0441603a0 con 0x7fa028004d40 2024-09-17T03:41:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.507+0000 7fa03be00640 1 -- 172.21.15.121:0/296216371 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa034021070 con 0x7fa028004d40 2024-09-17T03:41:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.507+0000 7fa03be00640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa024078b90 0x7fa02407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.508+0000 7fa03be00640 1 -- 172.21.15.121:0/296216371 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7fa03409b570 con 0x7fa028004d40 2024-09-17T03:41:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.508+0000 7fa03be00640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] conn(0x7fa02407f260 0x7fa0240816f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.508+0000 7fa03be00640 1 -- 172.21.15.121:0/296216371 --> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa034017ec0 con 0x7fa02407f260 2024-09-17T03:41:23.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.508+0000 7fa03be00640 1 -- 172.21.15.121:0/296216371 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7fa0340a2050 con 0x7fa028004d40 2024-09-17T03:41:23.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.508+0000 7fa043400640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa024078b90 0x7fa02407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.508+0000 7fa049000640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] conn(0x7fa02407f260 0x7fa0240816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.509+0000 7fa043400640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa024078b90 0x7fa02407b0a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa030000fd0 tx=0x7fa0300067d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:23.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.509+0000 7fa049000640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] conn(0x7fa02407f260 0x7fa0240816f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:23.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.510+0000 7fa03be00640 1 -- 172.21.15.121:0/296216371 <== osd.5 v2:172.21.15.176:6826/3997922862 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa034017ec0 con 0x7fa02407f260 2024-09-17T03:41:23.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.523+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 --> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa04415c5f0 con 0x7fa02407f260 2024-09-17T03:41:23.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa03be00640 1 -- 172.21.15.121:0/296216371 <== osd.5 v2:172.21.15.176:6826/3997922862 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa04415c5f0 con 0x7fa02407f260 2024-09-17T03:41:23.524 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:41:23.524 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:41:23.525 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:41:23.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] conn(0x7fa02407f260 msgr2=0x7fa0240816f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa04b000640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:6826/3997922862,v1:172.21.15.176:6827/3997922862] conn(0x7fa02407f260 0x7fa0240816f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa024078b90 msgr2=0x7fa02407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa04b000640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7fa024078b90 0x7fa02407b0a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa030000fd0 tx=0x7fa0300067d0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028004d40 msgr2=0x7fa044158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa04b000640 1 --2- 172.21.15.121:0/296216371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa028004d40 0x7fa044158590 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa034011ae0 tx=0x7fa034009e60 comp rx=0 tx=0).stop 2024-09-17T03:41:23.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa049000640 1 -- 172.21.15.121:0/296216371 reap_dead start 2024-09-17T03:41:23.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 shutdown_connections 2024-09-17T03:41:23.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 >> 172.21.15.121:0/296216371 conn(0x7fa0440d1c30 msgr2=0x7fa0440b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:23.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 shutdown_connections 2024-09-17T03:41:23.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.524+0000 7fa04b000640 1 -- 172.21.15.121:0/296216371 wait complete. 2024-09-17T03:41:23.545 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T03:41:23.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.767+0000 7faa66200640 1 -- 172.21.15.121:0/157366866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600d05d0 msgr2=0x7faa600cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.767+0000 7faa66200640 1 --2- 172.21.15.121:0/157366866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600d05d0 0x7faa600cd930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa48009830 tx=0x7faa4802a510 comp rx=0 tx=0).stop 2024-09-17T03:41:23.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.767+0000 7faa66200640 1 -- 172.21.15.121:0/157366866 shutdown_connections 2024-09-17T03:41:23.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.767+0000 7faa66200640 1 --2- 172.21.15.121:0/157366866 >> v2:172.21.15.176:3300/0 conn(0x7faa600d09e0 0x7faa601604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.767+0000 7faa66200640 1 --2- 172.21.15.121:0/157366866 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600d05d0 0x7faa600cd930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.767+0000 7faa66200640 1 -- 172.21.15.121:0/157366866 >> 172.21.15.121:0/157366866 conn(0x7faa600b54b0 msgr2=0x7faa600b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:23.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.767+0000 7faa66200640 1 -- 172.21.15.121:0/157366866 shutdown_connections 2024-09-17T03:41:23.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.767+0000 7faa66200640 1 -- 172.21.15.121:0/157366866 wait complete. 2024-09-17T03:41:23.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.770+0000 7faa66200640 1 Processor -- start 2024-09-17T03:41:23.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.770+0000 7faa66200640 1 -- start start 2024-09-17T03:41:23.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.771+0000 7faa66200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600d05d0 0x7faa60070340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.771+0000 7faa66200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa600d09e0 0x7faa60099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.771+0000 7faa66200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa601610d0 0x7faa601f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.771+0000 7faa66200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa600cae50 con 0x7faa600d09e0 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.771+0000 7faa66200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faa600cacd0 con 0x7faa601610d0 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.771+0000 7faa66200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faa600cafd0 con 0x7faa600d05d0 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa56a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa600d09e0 0x7faa60099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa56a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa600d09e0 0x7faa60099870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55366/0 (socket says 172.21.15.121:55366) 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa56a00640 1 -- 172.21.15.121:0/1950512389 learned_addr learned my addr 172.21.15.121:0/1950512389 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa5f400640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600d05d0 0x7faa60070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa5fe00640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa601610d0 0x7faa601f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa56a00640 1 -- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600d05d0 msgr2=0x7faa60070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa56a00640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600d05d0 0x7faa60070340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa56a00640 1 -- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa601610d0 msgr2=0x7faa601f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa56a00640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa601610d0 0x7faa601f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa56a00640 1 -- 172.21.15.121:0/1950512389 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6008cd60 con 0x7faa600d09e0 2024-09-17T03:41:23.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.772+0000 7faa56a00640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa600d09e0 0x7faa60099870 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7faa4802ab00 tx=0x7faa48033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:23.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.773+0000 7faa57e00640 1 -- 172.21.15.121:0/1950512389 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48005c90 con 0x7faa600d09e0 2024-09-17T03:41:23.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.773+0000 7faa57e00640 1 -- 172.21.15.121:0/1950512389 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa48031e50 con 0x7faa600d09e0 2024-09-17T03:41:23.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.773+0000 7faa66200640 1 -- 172.21.15.121:0/1950512389 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6008d040 con 0x7faa600d09e0 2024-09-17T03:41:23.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.773+0000 7faa57e00640 1 -- 172.21.15.121:0/1950512389 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48005260 con 0x7faa600d09e0 2024-09-17T03:41:23.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.773+0000 7faa66200640 1 -- 172.21.15.121:0/1950512389 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6008d600 con 0x7faa600d09e0 2024-09-17T03:41:23.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.774+0000 7faa66200640 1 -- 172.21.15.121:0/1950512389 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6008cad0 con 0x7faa600d09e0 2024-09-17T03:41:23.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.775+0000 7faa57e00640 1 -- 172.21.15.121:0/1950512389 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faa48005400 con 0x7faa600d09e0 2024-09-17T03:41:23.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.776+0000 7faa57e00640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa3c078b90 0x7faa3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:23.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.776+0000 7faa57e00640 1 -- 172.21.15.121:0/1950512389 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7faa480bbdd0 con 0x7faa600d09e0 2024-09-17T03:41:23.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.777+0000 7faa5f400640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa3c078b90 0x7faa3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:23.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.777+0000 7faa5f400640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa3c078b90 0x7faa3c07b0a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faa50001c60 tx=0x7faa50001bf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:23.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.781+0000 7faa57e00640 1 -- 172.21.15.121:0/1950512389 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faa4803f030 con 0x7faa600d09e0 2024-09-17T03:41:23.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.968+0000 7faa66200640 1 -- 172.21.15.121:0/1950512389 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7faa600cb480 con 0x7faa3c078b90 2024-09-17T03:41:23.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.969+0000 7faa57e00640 1 -- 172.21.15.121:0/1950512389 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faa600cb480 con 0x7faa3c078b90 2024-09-17T03:41:23.970 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.971+0000 7faa66200640 1 -- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa3c078b90 msgr2=0x7faa3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.971+0000 7faa66200640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa3c078b90 0x7faa3c07b0a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faa50001c60 tx=0x7faa50001bf0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.971+0000 7faa66200640 1 -- 172.21.15.121:0/1950512389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa600d09e0 msgr2=0x7faa60099870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.971+0000 7faa66200640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa600d09e0 0x7faa60099870 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7faa4802ab00 tx=0x7faa48033c20 comp rx=0 tx=0).stop 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.972+0000 7faa66200640 1 -- 172.21.15.121:0/1950512389 shutdown_connections 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.972+0000 7faa66200640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa601610d0 0x7faa601f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.972+0000 7faa66200640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7faa3c078b90 0x7faa3c07b0a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.972+0000 7faa66200640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa600d09e0 0x7faa60099870 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.972+0000 7faa66200640 1 --2- 172.21.15.121:0/1950512389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600d05d0 0x7faa60070340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.972+0000 7faa66200640 1 -- 172.21.15.121:0/1950512389 >> 172.21.15.121:0/1950512389 conn(0x7faa600b54b0 msgr2=0x7faa600c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:23.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.972+0000 7faa66200640 1 -- 172.21.15.121:0/1950512389 shutdown_connections 2024-09-17T03:41:23.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:23.972+0000 7faa66200640 1 -- 172.21.15.121:0/1950512389 wait complete. 2024-09-17T03:41:24.004 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T03:41:24.004 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:41:24.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.228+0000 7f90e5200640 1 -- 172.21.15.121:0/3095164982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e00b4030 msgr2=0x7f90e00cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.228+0000 7f90e5200640 1 --2- 172.21.15.121:0/3095164982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e00b4030 0x7f90e00cbd70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009be0 tx=0x7f90d802a900 comp rx=0 tx=0).stop 2024-09-17T03:41:24.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.228+0000 7f90e5200640 1 -- 172.21.15.121:0/3095164982 shutdown_connections 2024-09-17T03:41:24.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.228+0000 7f90e5200640 1 --2- 172.21.15.121:0/3095164982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e00b4030 0x7f90e00cbd70 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.228+0000 7f90e5200640 1 --2- 172.21.15.121:0/3095164982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e00d0350 0x7f90e015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.228+0000 7f90e5200640 1 -- 172.21.15.121:0/3095164982 >> 172.21.15.121:0/3095164982 conn(0x7f90e0073c70 msgr2=0x7f90e0074080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:24.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.228+0000 7f90e5200640 1 -- 172.21.15.121:0/3095164982 shutdown_connections 2024-09-17T03:41:24.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.228+0000 7f90e5200640 1 -- 172.21.15.121:0/3095164982 wait complete. 2024-09-17T03:41:24.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.230+0000 7f90e5200640 1 Processor -- start 2024-09-17T03:41:24.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.231+0000 7f90e5200640 1 -- start start 2024-09-17T03:41:24.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.232+0000 7f90e5200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90e00b4030 0x7f90e01f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.232+0000 7f90e5200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e00b5380 0x7f90e0157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.232+0000 7f90e5200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e0070030 0x7f90e0154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.232+0000 7f90e5200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f90e00cc910 con 0x7f90e0070030 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.232+0000 7f90e5200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f90e00cc790 con 0x7f90e00b4030 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.232+0000 7f90e5200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f90e00cca90 con 0x7f90e00b5380 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.232+0000 7f90dfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e0070030 0x7f90e0154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.232+0000 7f90dfe00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e0070030 0x7f90e0154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55384/0 (socket says 172.21.15.121:55384) 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.232+0000 7f90dfe00640 1 -- 172.21.15.121:0/438254712 learned_addr learned my addr 172.21.15.121:0/438254712 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.233+0000 7f90df400640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90e00b4030 0x7f90e01f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.233+0000 7f90d6a00640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e00b5380 0x7f90e0157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.233+0000 7f90dfe00640 1 -- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e00b5380 msgr2=0x7f90e0157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.233+0000 7f90dfe00640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e00b5380 0x7f90e0157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.233+0000 7f90dfe00640 1 -- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90e00b4030 msgr2=0x7f90e01f52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.233+0000 7f90dfe00640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90e00b4030 0x7f90e01f52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.233+0000 7f90dfe00640 1 -- 172.21.15.121:0/438254712 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e01f5ab0 con 0x7f90e0070030 2024-09-17T03:41:24.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.233+0000 7f90d6a00640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90e00b5380 0x7f90e0157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:24.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.233+0000 7f90dfe00640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e0070030 0x7f90e0154750 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009be0 tx=0x7f90d8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:24.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.233+0000 7f90d7e00640 1 -- 172.21.15.121:0/438254712 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8031db0 con 0x7f90e0070030 2024-09-17T03:41:24.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.234+0000 7f90d7e00640 1 -- 172.21.15.121:0/438254712 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90d80330d0 con 0x7f90e0070030 2024-09-17T03:41:24.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.234+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e01f5d90 con 0x7f90e0070030 2024-09-17T03:41:24.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.234+0000 7f90d7e00640 1 -- 172.21.15.121:0/438254712 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8033520 con 0x7f90e0070030 2024-09-17T03:41:24.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.234+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e0154c90 con 0x7f90e0070030 2024-09-17T03:41:24.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.234+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90e006e6e0 con 0x7f90e0070030 2024-09-17T03:41:24.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.236+0000 7f90d7e00640 1 -- 172.21.15.121:0/438254712 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90d80336c0 con 0x7f90e0070030 2024-09-17T03:41:24.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.237+0000 7f90d7e00640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90bc078b90 0x7f90bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.237+0000 7f90d7e00640 1 -- 172.21.15.121:0/438254712 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f90d80bcd20 con 0x7f90e0070030 2024-09-17T03:41:24.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.237+0000 7f90d7e00640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x7f90bc07f260 0x7f90bc0816f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.237+0000 7f90d7e00640 1 -- 172.21.15.121:0/438254712 --> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90d8039e90 con 0x7f90bc07f260 2024-09-17T03:41:24.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.237+0000 7f90d7e00640 1 -- 172.21.15.121:0/438254712 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f90d80bd0d0 con 0x7f90e0070030 2024-09-17T03:41:24.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.237+0000 7f90df400640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90bc078b90 0x7f90bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.237+0000 7f90d6a00640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x7f90bc07f260 0x7f90bc0816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.238+0000 7f90df400640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90bc078b90 0x7f90bc07b0a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f90d0000f60 tx=0x7f90d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:24.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.238+0000 7f90d6a00640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x7f90bc07f260 0x7f90bc0816f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:24.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.239+0000 7f90d7e00640 1 -- 172.21.15.121:0/438254712 <== osd.6 v2:172.21.15.176:6810/1810611479 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90d8039e90 con 0x7f90bc07f260 2024-09-17T03:41:24.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.252+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 --> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f90e01f5840 con 0x7f90bc07f260 2024-09-17T03:41:24.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.253+0000 7f90d7e00640 1 -- 172.21.15.121:0/438254712 <== osd.6 v2:172.21.15.176:6810/1810611479 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f90e01f5840 con 0x7f90bc07f260 2024-09-17T03:41:24.254 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:41:24.254 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:41:24.254 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:41:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.253+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x7f90bc07f260 msgr2=0x7f90bc0816f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.253+0000 7f90e5200640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:6810/1810611479,v1:172.21.15.176:6811/1810611479] conn(0x7f90bc07f260 0x7f90bc0816f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.254+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90bc078b90 msgr2=0x7f90bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.254+0000 7f90e5200640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f90bc078b90 0x7f90bc07b0a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f90d0000f60 tx=0x7f90d0009040 comp rx=0 tx=0).stop 2024-09-17T03:41:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.254+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e0070030 msgr2=0x7f90e0154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.254+0000 7f90e5200640 1 --2- 172.21.15.121:0/438254712 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90e0070030 0x7f90e0154750 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009be0 tx=0x7f90d8003ce0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.254+0000 7f90dfe00640 1 -- 172.21.15.121:0/438254712 reap_dead start 2024-09-17T03:41:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.254+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 shutdown_connections 2024-09-17T03:41:24.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.254+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 >> 172.21.15.121:0/438254712 conn(0x7f90e0073c70 msgr2=0x7f90e0071600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.254+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 shutdown_connections 2024-09-17T03:41:24.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.254+0000 7f90e5200640 1 -- 172.21.15.121:0/438254712 wait complete. 2024-09-17T03:41:24.277 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T03:41:24.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.497+0000 7f8ade000640 1 -- 172.21.15.121:0/1192912799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad8071820 msgr2=0x7f8ad8071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.497+0000 7f8ade000640 1 --2- 172.21.15.121:0/1192912799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad8071820 0x7f8ad8071c30 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80b5950 tx=0x7f8ad002a420 comp rx=0 tx=0).stop 2024-09-17T03:41:24.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.497+0000 7f8ade000640 1 -- 172.21.15.121:0/1192912799 shutdown_connections 2024-09-17T03:41:24.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.497+0000 7f8ade000640 1 --2- 172.21.15.121:0/1192912799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad8071820 0x7f8ad8071c30 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.497+0000 7f8ade000640 1 --2- 172.21.15.121:0/1192912799 >> v2:172.21.15.176:3300/0 conn(0x7f8ad8162b10 0x7f8ad815fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.497+0000 7f8ade000640 1 -- 172.21.15.121:0/1192912799 >> 172.21.15.121:0/1192912799 conn(0x7f8ad8073d30 msgr2=0x7f8ad8074140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:24.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.497+0000 7f8ade000640 1 -- 172.21.15.121:0/1192912799 shutdown_connections 2024-09-17T03:41:24.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.497+0000 7f8ade000640 1 -- 172.21.15.121:0/1192912799 wait complete. 2024-09-17T03:41:24.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.499+0000 7f8ade000640 1 Processor -- start 2024-09-17T03:41:24.500 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.499+0000 7f8ade000640 1 -- start start 2024-09-17T03:41:24.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.500+0000 7f8ade000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ad8071820 0x7f8ad81f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.500+0000 7f8ade000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ad80b46c0 0x7f8ad81f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.500+0000 7f8ade000640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad8162b10 0x7f8ad81f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.502 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.500+0000 7f8ade000640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80b6440 con 0x7f8ad8162b10 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.500+0000 7f8ade000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80b62c0 con 0x7f8ad8071820 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.500+0000 7f8ade000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad80b65c0 con 0x7f8ad80b46c0 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad8162b10 0x7f8ad81f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad7e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad8162b10 0x7f8ad81f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55406/0 (socket says 172.21.15.121:55406) 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad7e00640 1 -- 172.21.15.121:0/2755051214 learned_addr learned my addr 172.21.15.121:0/2755051214 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad7400640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ad8071820 0x7f8ad81f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad6a00640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ad80b46c0 0x7f8ad81f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad7e00640 1 -- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ad80b46c0 msgr2=0x7f8ad81f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad7e00640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ad80b46c0 0x7f8ad81f8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad7e00640 1 -- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ad8071820 msgr2=0x7f8ad81f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad7e00640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ad8071820 0x7f8ad81f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad7e00640 1 -- 172.21.15.121:0/2755051214 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad81f6150 con 0x7f8ad8162b10 2024-09-17T03:41:24.503 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.501+0000 7f8ad7e00640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad8162b10 0x7f8ad81f8f50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009920 tx=0x7f8ad0033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:24.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.502+0000 7f8acf400640 1 -- 172.21.15.121:0/2755051214 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0031b50 con 0x7f8ad8162b10 2024-09-17T03:41:24.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.502+0000 7f8acf400640 1 -- 172.21.15.121:0/2755051214 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ad0031e00 con 0x7f8ad8162b10 2024-09-17T03:41:24.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.502+0000 7f8acf400640 1 -- 172.21.15.121:0/2755051214 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0005280 con 0x7f8ad8162b10 2024-09-17T03:41:24.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.502+0000 7f8ade000640 1 -- 172.21.15.121:0/2755051214 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad8154330 con 0x7f8ad8162b10 2024-09-17T03:41:24.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.502+0000 7f8ade000640 1 -- 172.21.15.121:0/2755051214 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad80c4ad0 con 0x7f8ad8162b10 2024-09-17T03:41:24.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.503+0000 7f8ade000640 1 -- 172.21.15.121:0/2755051214 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad81f5ec0 con 0x7f8ad8162b10 2024-09-17T03:41:24.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.504+0000 7f8acf400640 1 -- 172.21.15.121:0/2755051214 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ad0005420 con 0x7f8ad8162b10 2024-09-17T03:41:24.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.505+0000 7f8acf400640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8ab8078b90 0x7f8ab807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.505+0000 7f8acf400640 1 -- 172.21.15.121:0/2755051214 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f8ad00bbed0 con 0x7f8ad8162b10 2024-09-17T03:41:24.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.506+0000 7f8ad7400640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8ab8078b90 0x7f8ab807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.506+0000 7f8ad7400640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8ab8078b90 0x7f8ab807b0a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8007fd0 tx=0x7f8ac8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:24.510 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.510+0000 7f8acf400640 1 -- 172.21.15.121:0/2755051214 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8ad003f030 con 0x7f8ad8162b10 2024-09-17T03:41:24.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.694+0000 7f8ade000640 1 -- 172.21.15.121:0/2755051214 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f8ad80b6ae0 con 0x7f8ab8078b90 2024-09-17T03:41:24.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.696+0000 7f8acf400640 1 -- 172.21.15.121:0/2755051214 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8ad80b6ae0 con 0x7f8ab8078b90 2024-09-17T03:41:24.696 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 -- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8ab8078b90 msgr2=0x7f8ab807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8ab8078b90 0x7f8ab807b0a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8007fd0 tx=0x7f8ac8009040 comp rx=0 tx=0).stop 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 -- 172.21.15.121:0/2755051214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad8162b10 msgr2=0x7f8ad81f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad8162b10 0x7f8ad81f8f50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009920 tx=0x7f8ad0033ba0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 -- 172.21.15.121:0/2755051214 shutdown_connections 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f8ab8078b90 0x7f8ab807b0a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ad8162b10 0x7f8ad81f8f50 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8ad80b46c0 0x7f8ad81f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 --2- 172.21.15.121:0/2755051214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ad8071820 0x7f8ad81f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 -- 172.21.15.121:0/2755051214 >> 172.21.15.121:0/2755051214 conn(0x7f8ad8073d30 msgr2=0x7f8ad81588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:24.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 -- 172.21.15.121:0/2755051214 shutdown_connections 2024-09-17T03:41:24.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.698+0000 7f8ade000640 1 -- 172.21.15.121:0/2755051214 wait complete. 2024-09-17T03:41:24.720 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T03:41:24.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:41:24.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.944+0000 7f2dade00640 1 -- 172.21.15.121:0/3794344624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2da80cc450 msgr2=0x7f2da806dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.944+0000 7f2dade00640 1 --2- 172.21.15.121:0/3794344624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2da80cc450 0x7f2da806dd50 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f2da806e880 tx=0x7f2d9002a530 comp rx=0 tx=0).stop 2024-09-17T03:41:24.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.944+0000 7f2dade00640 1 -- 172.21.15.121:0/3794344624 shutdown_connections 2024-09-17T03:41:24.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.944+0000 7f2dade00640 1 --2- 172.21.15.121:0/3794344624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2da80cc450 0x7f2da806dd50 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.944+0000 7f2dade00640 1 --2- 172.21.15.121:0/3794344624 >> v2:172.21.15.176:3300/0 conn(0x7f2da815cbe0 0x7f2da80cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.944+0000 7f2dade00640 1 -- 172.21.15.121:0/3794344624 >> 172.21.15.121:0/3794344624 conn(0x7f2da80b1cc0 msgr2=0x7f2da80b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:24.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.944+0000 7f2dade00640 1 -- 172.21.15.121:0/3794344624 shutdown_connections 2024-09-17T03:41:24.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.944+0000 7f2dade00640 1 -- 172.21.15.121:0/3794344624 wait complete. 2024-09-17T03:41:24.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.946+0000 7f2dade00640 1 Processor -- start 2024-09-17T03:41:24.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.946+0000 7f2dade00640 1 -- start start 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2dade00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2da806e290 0x7f2da8159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2dade00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da80cc450 0x7f2da815b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2dade00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da815cbe0 0x7f2da80b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2dade00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2da80746a0 con 0x7f2da806e290 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2dade00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2da8074820 con 0x7f2da80cc450 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2dade00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2da80749a0 con 0x7f2da815cbe0 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2da6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2da806e290 0x7f2da8159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2da6a00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2da806e290 0x7f2da8159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55428/0 (socket says 172.21.15.121:55428) 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2da6a00640 1 -- 172.21.15.121:0/3490308533 learned_addr learned my addr 172.21.15.121:0/3490308533 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2d9e000640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da80cc450 0x7f2da815b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.948+0000 7f2da7400640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da815cbe0 0x7f2da80b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2da6a00640 1 -- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da815cbe0 msgr2=0x7f2da80b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2da6a00640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da815cbe0 0x7f2da80b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2da6a00640 1 -- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da80cc450 msgr2=0x7f2da815b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2da6a00640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da80cc450 0x7f2da815b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2da6a00640 1 -- 172.21.15.121:0/3490308533 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da80c7660 con 0x7f2da806e290 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2da7400640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da815cbe0 0x7f2da80b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2da6a00640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2da806e290 0x7f2da8159bb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800d770 tx=0x7f2d9800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2d9fe00640 1 -- 172.21.15.121:0/3490308533 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98017070 con 0x7f2da806e290 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2d9fe00640 1 -- 172.21.15.121:0/3490308533 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d98009d20 con 0x7f2da806e290 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da81f3a00 con 0x7f2da806e290 2024-09-17T03:41:24.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2d9fe00640 1 -- 172.21.15.121:0/3490308533 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d980106c0 con 0x7f2da806e290 2024-09-17T03:41:24.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.949+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da81f3fc0 con 0x7f2da806e290 2024-09-17T03:41:24.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.950+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2da806dd50 con 0x7f2da806e290 2024-09-17T03:41:24.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.952+0000 7f2d9fe00640 1 -- 172.21.15.121:0/3490308533 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2d9801a070 con 0x7f2da806e290 2024-09-17T03:41:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.952+0000 7f2d9fe00640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2d84078b90 0x7f2d8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.953+0000 7f2d9fe00640 1 -- 172.21.15.121:0/3490308533 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f2d9809b350 con 0x7f2da806e290 2024-09-17T03:41:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.953+0000 7f2d9fe00640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] conn(0x7f2d8407f260 0x7f2d840816f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.953+0000 7f2d9fe00640 1 -- 172.21.15.121:0/3490308533 --> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d98026e50 con 0x7f2d8407f260 2024-09-17T03:41:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.953+0000 7f2d9fe00640 1 -- 172.21.15.121:0/3490308533 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=117) ==== 24+0+0 (secure 0 0 0) 0x7f2d9809b700 con 0x7f2da806e290 2024-09-17T03:41:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.953+0000 7f2d9e000640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2d84078b90 0x7f2d8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.953+0000 7f2da7400640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] conn(0x7f2d8407f260 0x7f2d840816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:24.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.954+0000 7f2d9e000640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2d84078b90 0x7f2d8407b0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2d90034000 tx=0x7f2d90004730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:24.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.954+0000 7f2da7400640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] conn(0x7f2d8407f260 0x7f2d840816f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:24.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.955+0000 7f2d9fe00640 1 -- 172.21.15.121:0/3490308533 <== osd.7 v2:172.21.15.176:6802/2211533111 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d98026e50 con 0x7f2d8407f260 2024-09-17T03:41:24.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.968+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 --> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2da80b1a20 con 0x7f2d8407f260 2024-09-17T03:41:24.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2d9fe00640 1 -- 172.21.15.121:0/3490308533 <== osd.7 v2:172.21.15.176:6802/2211533111 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2da80b1a20 con 0x7f2d8407f260 2024-09-17T03:41:24.969 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-17T03:41:24.970 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:41:24.970 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] conn(0x7f2d8407f260 msgr2=0x7f2d840816f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2dade00640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:6802/2211533111,v1:172.21.15.176:6803/2211533111] conn(0x7f2d8407f260 0x7f2d840816f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2d84078b90 msgr2=0x7f2d8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2dade00640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2d84078b90 0x7f2d8407b0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2d90034000 tx=0x7f2d90004730 comp rx=0 tx=0).stop 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2da806e290 msgr2=0x7f2da8159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2dade00640 1 --2- 172.21.15.121:0/3490308533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2da806e290 0x7f2da8159bb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800d770 tx=0x7f2d9800dc30 comp rx=0 tx=0).stop 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2da7400640 1 -- 172.21.15.121:0/3490308533 reap_dead start 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 shutdown_connections 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 >> 172.21.15.121:0/3490308533 conn(0x7f2da80b1cc0 msgr2=0x7f2da80c3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 shutdown_connections 2024-09-17T03:41:24.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:24.969+0000 7f2dade00640 1 -- 172.21.15.121:0/3490308533 wait complete. 2024-09-17T03:41:24.993 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T03:41:25.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.213+0000 7f75df200640 1 -- 172.21.15.121:0/3170650426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d806e3c0 msgr2=0x7f75d80b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:25.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.213+0000 7f75df200640 1 --2- 172.21.15.121:0/3170650426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d806e3c0 0x7f75d80b2f70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f75d806eb20 tx=0x7f75c402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.213+0000 7f75df200640 1 -- 172.21.15.121:0/3170650426 shutdown_connections 2024-09-17T03:41:25.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.213+0000 7f75df200640 1 --2- 172.21.15.121:0/3170650426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d806e3c0 0x7f75d80b2f70 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.213+0000 7f75df200640 1 --2- 172.21.15.121:0/3170650426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d80cc550 0x7f75d806de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.213+0000 7f75df200640 1 -- 172.21.15.121:0/3170650426 >> 172.21.15.121:0/3170650426 conn(0x7f75d80b1c10 msgr2=0x7f75d80b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:25.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.213+0000 7f75df200640 1 -- 172.21.15.121:0/3170650426 shutdown_connections 2024-09-17T03:41:25.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.213+0000 7f75df200640 1 -- 172.21.15.121:0/3170650426 wait complete. 2024-09-17T03:41:25.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.215+0000 7f75df200640 1 Processor -- start 2024-09-17T03:41:25.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.215+0000 7f75df200640 1 -- start start 2024-09-17T03:41:25.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.216+0000 7f75df200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d806e3c0 0x7f75d81e6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:25.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.216+0000 7f75df200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d80cc550 0x7f75d80c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:25.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.216+0000 7f75df200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d815fdf0 0x7f75d814e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:25.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.216+0000 7f75df200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f75d80cb2d0 con 0x7f75d815fdf0 2024-09-17T03:41:25.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.216+0000 7f75df200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75d80b3800 con 0x7f75d806e3c0 2024-09-17T03:41:25.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.216+0000 7f75df200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75d80cb450 con 0x7f75d80cc550 2024-09-17T03:41:25.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.217+0000 7f75dd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d815fdf0 0x7f75d814e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:25.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.217+0000 7f75d7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d80cc550 0x7f75d80c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:25.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.217+0000 7f75dd200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d815fdf0 0x7f75d814e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55438/0 (socket says 172.21.15.121:55438) 2024-09-17T03:41:25.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.217+0000 7f75d7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d806e3c0 0x7f75d81e6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:25.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.217+0000 7f75dd200640 1 -- 172.21.15.121:0/845874082 learned_addr learned my addr 172.21.15.121:0/845874082 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:25.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.217+0000 7f75dd200640 1 -- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d80cc550 msgr2=0x7f75d80c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:25.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.217+0000 7f75dd200640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d80cc550 0x7f75d80c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.217+0000 7f75dd200640 1 -- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d806e3c0 msgr2=0x7f75d81e6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:25.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.217+0000 7f75dd200640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d806e3c0 0x7f75d81e6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.217+0000 7f75dd200640 1 -- 172.21.15.121:0/845874082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d815be60 con 0x7f75d815fdf0 2024-09-17T03:41:25.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.218+0000 7f75dd200640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d815fdf0 0x7f75d814e790 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f75d000b440 tx=0x7f75d000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:25.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.218+0000 7f75cfe00640 1 -- 172.21.15.121:0/845874082 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d0015020 con 0x7f75d815fdf0 2024-09-17T03:41:25.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.218+0000 7f75cfe00640 1 -- 172.21.15.121:0/845874082 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75d0011940 con 0x7f75d815fdf0 2024-09-17T03:41:25.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.218+0000 7f75cfe00640 1 -- 172.21.15.121:0/845874082 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d0011d90 con 0x7f75d815fdf0 2024-09-17T03:41:25.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.218+0000 7f75df200640 1 -- 172.21.15.121:0/845874082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d814ecd0 con 0x7f75d815fdf0 2024-09-17T03:41:25.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.218+0000 7f75df200640 1 -- 172.21.15.121:0/845874082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d80c88e0 con 0x7f75d815fdf0 2024-09-17T03:41:25.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.219+0000 7f75df200640 1 -- 172.21.15.121:0/845874082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d81f7090 con 0x7f75d815fdf0 2024-09-17T03:41:25.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.220+0000 7f75cfe00640 1 -- 172.21.15.121:0/845874082 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75d0018020 con 0x7f75d815fdf0 2024-09-17T03:41:25.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.221+0000 7f75cfe00640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 0x7f75b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:25.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.221+0000 7f75cfe00640 1 -- 172.21.15.121:0/845874082 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f75d009a430 con 0x7f75d815fdf0 2024-09-17T03:41:25.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.222+0000 7f75d7e00640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 0x7f75b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:25.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.222+0000 7f75d7e00640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 0x7f75b807b0d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f75c800a400 tx=0x7f75c800d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:25.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.226+0000 7f75cfe00640 1 -- 172.21.15.121:0/845874082 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75d001f070 con 0x7f75d815fdf0 2024-09-17T03:41:25.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.408+0000 7f75df200640 1 -- 172.21.15.121:0/845874082 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f75d80cb960 con 0x7f75b8078bc0 2024-09-17T03:41:25.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.409+0000 7f75cfe00640 1 -- 172.21.15.121:0/845874082 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f75d80cb960 con 0x7f75b8078bc0 2024-09-17T03:41:25.409 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T03:41:25.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 -- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 msgr2=0x7f75b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:25.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 0x7f75b807b0d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f75c800a400 tx=0x7f75c800d040 comp rx=0 tx=0).stop 2024-09-17T03:41:25.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 -- 172.21.15.121:0/845874082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d815fdf0 msgr2=0x7f75d814e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:25.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d815fdf0 0x7f75d814e790 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f75d000b440 tx=0x7f75d000b900 comp rx=0 tx=0).stop 2024-09-17T03:41:25.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 -- 172.21.15.121:0/845874082 shutdown_connections 2024-09-17T03:41:25.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f75b8078bc0 0x7f75b807b0d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75d815fdf0 0x7f75d814e790 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75d80cc550 0x7f75d80c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 --2- 172.21.15.121:0/845874082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75d806e3c0 0x7f75d81e6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 -- 172.21.15.121:0/845874082 >> 172.21.15.121:0/845874082 conn(0x7f75d80b1c10 msgr2=0x7f75d80b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:25.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 -- 172.21.15.121:0/845874082 shutdown_connections 2024-09-17T03:41:25.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.411+0000 7f75df200640 1 -- 172.21.15.121:0/845874082 wait complete. 2024-09-17T03:41:25.436 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:41:25.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.653+0000 7f7aed400640 1 -- 172.21.15.121:0/4078707610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ae815fdf0 msgr2=0x7f7ae8160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:25.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.653+0000 7f7aed400640 1 --2- 172.21.15.121:0/4078707610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ae815fdf0 0x7f7ae8160350 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0005fd0 tx=0x7f7ae002a840 comp rx=0 tx=0).stop 2024-09-17T03:41:25.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.653+0000 7f7aed400640 1 -- 172.21.15.121:0/4078707610 shutdown_connections 2024-09-17T03:41:25.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.653+0000 7f7aed400640 1 --2- 172.21.15.121:0/4078707610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ae815fdf0 0x7f7ae8160350 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.653+0000 7f7aed400640 1 --2- 172.21.15.121:0/4078707610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae80cc550 0x7f7ae806de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.653+0000 7f7aed400640 1 -- 172.21.15.121:0/4078707610 >> 172.21.15.121:0/4078707610 conn(0x7f7ae80b1c10 msgr2=0x7f7ae80b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:25.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.654+0000 7f7aed400640 1 -- 172.21.15.121:0/4078707610 shutdown_connections 2024-09-17T03:41:25.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.654+0000 7f7aed400640 1 -- 172.21.15.121:0/4078707610 wait complete. 2024-09-17T03:41:25.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.656+0000 7f7aed400640 1 Processor -- start 2024-09-17T03:41:25.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.656+0000 7f7aed400640 1 -- start start 2024-09-17T03:41:25.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.657+0000 7f7aed400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae806e3c0 0x7f7ae81507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:25.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.657+0000 7f7aed400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae80cc550 0x7f7ae80b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:25.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.657+0000 7f7aed400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ae815fdf0 0x7f7ae80cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:25.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.657+0000 7f7aed400640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae8160a10 con 0x7f7ae815fdf0 2024-09-17T03:41:25.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.657+0000 7f7aed400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae8160890 con 0x7f7ae806e3c0 2024-09-17T03:41:25.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.657+0000 7f7aed400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae8160b90 con 0x7f7ae80cc550 2024-09-17T03:41:25.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae7200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ae815fdf0 0x7f7ae80cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:25.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae7200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ae815fdf0 0x7f7ae80cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55464/0 (socket says 172.21.15.121:55464) 2024-09-17T03:41:25.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae7200640 1 -- 172.21.15.121:0/1130796088 learned_addr learned my addr 172.21.15.121:0/1130796088 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:25.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae6800640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae806e3c0 0x7f7ae81507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:25.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae5e00640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae80cc550 0x7f7ae80b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:25.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae7200640 1 -- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae80cc550 msgr2=0x7f7ae80b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:25.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae7200640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae80cc550 0x7f7ae80b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae7200640 1 -- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae806e3c0 msgr2=0x7f7ae81507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:25.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae7200640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae806e3c0 0x7f7ae81507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae7200640 1 -- 172.21.15.121:0/1130796088 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae8150cf0 con 0x7f7ae815fdf0 2024-09-17T03:41:25.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.658+0000 7f7ae7200640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ae815fdf0 0x7f7ae80cabc0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009b30 tx=0x7f7ae0032b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:25.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.659+0000 7f7adea00640 1 -- 172.21.15.121:0/1130796088 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0037050 con 0x7f7ae815fdf0 2024-09-17T03:41:25.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.659+0000 7f7adea00640 1 -- 172.21.15.121:0/1130796088 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ae0043070 con 0x7f7ae815fdf0 2024-09-17T03:41:25.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.659+0000 7f7aed400640 1 -- 172.21.15.121:0/1130796088 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae80b5690 con 0x7f7ae815fdf0 2024-09-17T03:41:25.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.659+0000 7f7adea00640 1 -- 172.21.15.121:0/1130796088 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00045d0 con 0x7f7ae815fdf0 2024-09-17T03:41:25.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.659+0000 7f7aed400640 1 -- 172.21.15.121:0/1130796088 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae81f8f80 con 0x7f7ae815fdf0 2024-09-17T03:41:25.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.660+0000 7f7aed400640 1 -- 172.21.15.121:0/1130796088 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae80c73b0 con 0x7f7ae815fdf0 2024-09-17T03:41:25.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.661+0000 7f7adea00640 1 -- 172.21.15.121:0/1130796088 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ae003e450 con 0x7f7ae815fdf0 2024-09-17T03:41:25.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.662+0000 7f7adea00640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7ac8078b90 0x7f7ac807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:25.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.662+0000 7f7adea00640 1 -- 172.21.15.121:0/1130796088 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f7ae00bbdc0 con 0x7f7ae815fdf0 2024-09-17T03:41:25.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.662+0000 7f7ae6800640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7ac8078b90 0x7f7ac807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:25.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.663+0000 7f7ae6800640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7ac8078b90 0x7f7ac807b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009ac0 tx=0x7f7ad8005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:25.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.666+0000 7f7adea00640 1 -- 172.21.15.121:0/1130796088 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ae00841d0 con 0x7f7ae815fdf0 2024-09-17T03:41:25.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.848+0000 7f7aed400640 1 -- 172.21.15.121:0/1130796088 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ae8160ff0 con 0x7f7ac8078b90 2024-09-17T03:41:25.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.849+0000 7f7adea00640 1 -- 172.21.15.121:0/1130796088 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13357 (secure 0 0 0) 0x7f7ae8160ff0 con 0x7f7ac8078b90 2024-09-17T03:41:25.850 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:25.850 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.851+0000 7f7aed400640 1 -- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7ac8078b90 msgr2=0x7f7ac807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.851+0000 7f7aed400640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7ac8078b90 0x7f7ac807b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009ac0 tx=0x7f7ad8005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.851+0000 7f7aed400640 1 -- 172.21.15.121:0/1130796088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ae815fdf0 msgr2=0x7f7ae80cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.851+0000 7f7aed400640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ae815fdf0 0x7f7ae80cabc0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009b30 tx=0x7f7ae0032b40 comp rx=0 tx=0).stop 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.852+0000 7f7aed400640 1 -- 172.21.15.121:0/1130796088 shutdown_connections 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.852+0000 7f7aed400640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f7ac8078b90 0x7f7ac807b0a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.852+0000 7f7aed400640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ae815fdf0 0x7f7ae80cabc0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.852+0000 7f7aed400640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae80cc550 0x7f7ae80b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.852+0000 7f7aed400640 1 --2- 172.21.15.121:0/1130796088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae806e3c0 0x7f7ae81507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.852+0000 7f7aed400640 1 -- 172.21.15.121:0/1130796088 >> 172.21.15.121:0/1130796088 conn(0x7f7ae80b1c10 msgr2=0x7f7ae80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.852+0000 7f7aed400640 1 -- 172.21.15.121:0/1130796088 shutdown_connections 2024-09-17T03:41:25.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:25.852+0000 7f7aed400640 1 -- 172.21.15.121:0/1130796088 wait complete. 2024-09-17T03:41:25.877 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-09-17T03:41:25.371250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262092,"kb_used_data":12552,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712628,"statfs":{"total":773094113280,"available":772825731072,"internally_reserved":0,"allocated":12853248,"data_stored":6560768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002807"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":289,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:41:12.790431+0000","last_change":"2024-09-17T03:35:22.743431+0000","last_active":"2024-09-17T03:41:12.790431+0000","last_peered":"2024-09-17T03:41:12.790431+0000","last_clean":"2024-09-17T03:41:12.790431+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:41:12.790431+0000","last_undegraded":"2024-09-17T03:41:12.790431+0000","last_fullsized":"2024-09-17T03:41:12.790431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:21.378915+0000","last_clean_scrub_stamp":"2024-09-17T03:35:21.378915+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:18.382509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509514,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2052096,"data_stored":1262872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2052096,"data_stored":1262872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:41:25.881 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T03:35:21.378915+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=3, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=3, tm_min=41, tm_sec=18, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T03:41:25.881 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T03:41:45.882 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:41:46.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.112+0000 7f2cc0c00640 1 -- 172.21.15.121:0/3329124104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca0003a30 msgr2=0x7f2ca0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.112+0000 7f2cc0c00640 1 --2- 172.21.15.121:0/3329124104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ca0003a30 0x7f2ca0003ea0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0016c0 tx=0x7f2ca0005830 comp rx=0 tx=0).stop 2024-09-17T03:41:46.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.112+0000 7f2cba800640 1 -- 172.21.15.121:0/3329124104 reap_dead start 2024-09-17T03:41:46.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.112+0000 7f2cc0c00640 1 -- 172.21.15.121:0/3329124104 shutdown_connections 2024-09-17T03:41:46.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.112+0000 7f2cc0c00640 1 -- 172.21.15.121:0/3329124104 >> 172.21.15.121:0/3329124104 conn(0x7f2cbc0b1c10 msgr2=0x7f2cbc0b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:46.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.112+0000 7f2cc0c00640 1 -- 172.21.15.121:0/3329124104 shutdown_connections 2024-09-17T03:41:46.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.112+0000 7f2cc0c00640 1 -- 172.21.15.121:0/3329124104 wait complete. 2024-09-17T03:41:46.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.115+0000 7f2cc0c00640 1 Processor -- start 2024-09-17T03:41:46.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.115+0000 7f2cc0c00640 1 -- start start 2024-09-17T03:41:46.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.116+0000 7f2cc0c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca0003a30 0x7f2cbc151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.116+0000 7f2cc0c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cbc0c4000 0x7f2cbc15e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.116+0000 7f2cc0c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cbc0c4410 0x7f2cbc15ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.116+0000 7f2cc0c00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc0b3300 con 0x7f2cbc0c4000 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.116+0000 7f2cc0c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc0b3180 con 0x7f2cbc0c4410 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.116+0000 7f2cc0c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2cbc074ef0 con 0x7f2ca0003a30 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cbc0c4000 0x7f2cbc15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cbc0c4000 0x7f2cbc15e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48780/0 (socket says 172.21.15.121:48780) 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9400640 1 -- 172.21.15.121:0/1924341786 learned_addr learned my addr 172.21.15.121:0/1924341786 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9e00640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca0003a30 0x7f2cbc151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cba800640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cbc0c4410 0x7f2cbc15ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9400640 1 -- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca0003a30 msgr2=0x7f2cbc151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9400640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca0003a30 0x7f2cbc151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9400640 1 -- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cbc0c4410 msgr2=0x7f2cbc15ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9400640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cbc0c4410 0x7f2cbc15ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9400640 1 -- 172.21.15.121:0/1924341786 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cbc0c4aa0 con 0x7f2cbc0c4000 2024-09-17T03:41:46.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9e00640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca0003a30 0x7f2cbc151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:46.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb9400640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cbc0c4000 0x7f2cbc15e510 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8011890 tx=0x7f2ca8011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:46.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.117+0000 7f2cb2000640 1 -- 172.21.15.121:0/1924341786 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800f9a0 con 0x7f2cbc0c4000 2024-09-17T03:41:46.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.118+0000 7f2cb2000640 1 -- 172.21.15.121:0/1924341786 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ca800fb40 con 0x7f2cbc0c4000 2024-09-17T03:41:46.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.118+0000 7f2cc0c00640 1 -- 172.21.15.121:0/1924341786 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cbc0c61a0 con 0x7f2cbc0c4000 2024-09-17T03:41:46.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.118+0000 7f2cb2000640 1 -- 172.21.15.121:0/1924341786 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8005020 con 0x7f2cbc0c4000 2024-09-17T03:41:46.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.118+0000 7f2cc0c00640 1 -- 172.21.15.121:0/1924341786 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cbc0c6760 con 0x7f2cbc0c4000 2024-09-17T03:41:46.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.119+0000 7f2cc0c00640 1 -- 172.21.15.121:0/1924341786 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cbc160de0 con 0x7f2cbc0c4000 2024-09-17T03:41:46.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.120+0000 7f2cb2000640 1 -- 172.21.15.121:0/1924341786 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ca80051c0 con 0x7f2cbc0c4000 2024-09-17T03:41:46.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.121+0000 7f2cb2000640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c9c078b90 0x7f2c9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.121+0000 7f2cb2000640 1 -- 172.21.15.121:0/1924341786 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f2ca809b8f0 con 0x7f2cbc0c4000 2024-09-17T03:41:46.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.121+0000 7f2cb9e00640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c9c078b90 0x7f2c9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.122+0000 7f2cb9e00640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c9c078b90 0x7f2c9c07b0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2cac032000 tx=0x7f2cac001190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:46.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.125+0000 7f2cb2000640 1 -- 172.21.15.121:0/1924341786 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2ca8063d90 con 0x7f2cbc0c4000 2024-09-17T03:41:46.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.307+0000 7f2cc0c00640 1 -- 172.21.15.121:0/1924341786 --> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2cbc151840 con 0x7f2c9c078b90 2024-09-17T03:41:46.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.309+0000 7f2cb2000640 1 -- 172.21.15.121:0/1924341786 <== mgr.4106 v2:172.21.15.176:6800/1198724406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13364 (secure 0 0 0) 0x7f2cac0063b0 con 0x7f2c9c078b90 2024-09-17T03:41:46.308 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:46.309 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-17T03:41:46.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 -- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c9c078b90 msgr2=0x7f2c9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c9c078b90 0x7f2c9c07b0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2cac032000 tx=0x7f2cac001190 comp rx=0 tx=0).stop 2024-09-17T03:41:46.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 -- 172.21.15.121:0/1924341786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cbc0c4000 msgr2=0x7f2cbc15e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cbc0c4000 0x7f2cbc15e510 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8011890 tx=0x7f2ca8011d50 comp rx=0 tx=0).stop 2024-09-17T03:41:46.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 -- 172.21.15.121:0/1924341786 shutdown_connections 2024-09-17T03:41:46.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cbc0c4410 0x7f2cbc15ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f2c9c078b90 0x7f2c9c07b0a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cbc0c4000 0x7f2cbc15e510 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 --2- 172.21.15.121:0/1924341786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca0003a30 0x7f2cbc151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 -- 172.21.15.121:0/1924341786 >> 172.21.15.121:0/1924341786 conn(0x7f2cbc0b1c10 msgr2=0x7f2cbc072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:46.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 -- 172.21.15.121:0/1924341786 shutdown_connections 2024-09-17T03:41:46.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.311+0000 7f2cc0c00640 1 -- 172.21.15.121:0/1924341786 wait complete. 2024-09-17T03:41:46.336 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-17T03:41:45.375660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262068,"kb_used_data":12552,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712652,"statfs":{"total":773094113280,"available":772825755648,"internally_reserved":0,"allocated":12853248,"data_stored":6560768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002668"},"pg_stats":[{"pgid":"1.0","version":"117'74","reported_seq":300,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:41:21.067666+0000","last_change":"2024-09-17T03:41:21.067570+0000","last_active":"2024-09-17T03:41:21.067666+0000","last_peered":"2024-09-17T03:41:21.067666+0000","last_clean":"2024-09-17T03:41:21.067666+0000","last_became_active":"2024-09-17T03:35:22.742337+0000","last_became_peered":"2024-09-17T03:35:22.742337+0000","last_unstale":"2024-09-17T03:41:21.067666+0000","last_undegraded":"2024-09-17T03:41:21.067666+0000","last_fullsized":"2024-09-17T03:41:21.067666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'74","last_scrub_stamp":"2024-09-17T03:41:21.067485+0000","last_deep_scrub":"117'74","last_deep_scrub_stamp":"2024-09-17T03:41:21.067485+0000","last_clean_scrub_stamp":"2024-09-17T03:41:21.067485+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:56.052365+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2052096,"data_stored":1262872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2052096,"data_stored":1262872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509521,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:41:46.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T03:41:46.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.554+0000 7f35d6800640 1 -- 172.21.15.121:0/1530162384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4003a50 msgr2=0x7f35b4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.554+0000 7f35d6800640 1 --2- 172.21.15.121:0/1530162384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4003a50 0x7f35b4003ec0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f35c0001710 tx=0x7f35b4005830 comp rx=0 tx=0).stop 2024-09-17T03:41:46.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.554+0000 7f35d6800640 1 -- 172.21.15.121:0/1530162384 shutdown_connections 2024-09-17T03:41:46.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.554+0000 7f35d6800640 1 --2- 172.21.15.121:0/1530162384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4003a50 0x7f35b4003ec0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.554+0000 7f35d6800640 1 -- 172.21.15.121:0/1530162384 >> 172.21.15.121:0/1530162384 conn(0x7f35d00b33b0 msgr2=0x7f35d00b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:46.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.554+0000 7f35d6800640 1 -- 172.21.15.121:0/1530162384 shutdown_connections 2024-09-17T03:41:46.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.554+0000 7f35d6800640 1 -- 172.21.15.121:0/1530162384 wait complete. 2024-09-17T03:41:46.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.556+0000 7f35d6800640 1 Processor -- start 2024-09-17T03:41:46.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.557+0000 7f35d6800640 1 -- start start 2024-09-17T03:41:46.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.558+0000 7f35d6800640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4003a50 0x7f35d0158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.558+0000 7f35d6800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35d01f8de0 0x7f35d01f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.558+0000 7f35d6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35d01599d0 0x7f35d0159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.558+0000 7f35d6800640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f35d00d0cb0 con 0x7f35b4003a50 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.558+0000 7f35d6800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35d00d0b30 con 0x7f35d01599d0 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.558+0000 7f35d6800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f35d00d0e30 con 0x7f35d01f8de0 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.558+0000 7f35cf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4003a50 0x7f35d0158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.558+0000 7f35cf400640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4003a50 0x7f35d0158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48810/0 (socket says 172.21.15.121:48810) 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.558+0000 7f35cf400640 1 -- 172.21.15.121:0/1421268063 learned_addr learned my addr 172.21.15.121:0/1421268063 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35cea00640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35d01f8de0 0x7f35d01f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35cf400640 1 -- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35d01f8de0 msgr2=0x7f35d01f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35cfe00640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35d01599d0 0x7f35d0159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35cf400640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35d01f8de0 0x7f35d01f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35cf400640 1 -- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35d01599d0 msgr2=0x7f35d0159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35cf400640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35d01599d0 0x7f35d0159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35cf400640 1 -- 172.21.15.121:0/1421268063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d015a320 con 0x7f35b4003a50 2024-09-17T03:41:46.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35cea00640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35d01f8de0 0x7f35d01f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:46.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35cfe00640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35d01599d0 0x7f35d0159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:46.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35cf400640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4003a50 0x7f35d0158ef0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f35c0001830 tx=0x7f35c00062f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:46.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35c7400640 1 -- 172.21.15.121:0/1421268063 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0042070 con 0x7f35b4003a50 2024-09-17T03:41:46.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35d6800640 1 -- 172.21.15.121:0/1421268063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d01f9b50 con 0x7f35b4003a50 2024-09-17T03:41:46.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35c7400640 1 -- 172.21.15.121:0/1421268063 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35c0039070 con 0x7f35b4003a50 2024-09-17T03:41:46.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35c7400640 1 -- 172.21.15.121:0/1421268063 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0003bd0 con 0x7f35b4003a50 2024-09-17T03:41:46.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.559+0000 7f35d6800640 1 -- 172.21.15.121:0/1421268063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d01f5d20 con 0x7f35b4003a50 2024-09-17T03:41:46.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.560+0000 7f35d6800640 1 -- 172.21.15.121:0/1421268063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d0070130 con 0x7f35b4003a50 2024-09-17T03:41:46.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.562+0000 7f35c7400640 1 -- 172.21.15.121:0/1421268063 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f35c003b070 con 0x7f35b4003a50 2024-09-17T03:41:46.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.563+0000 7f35c7400640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f35b0078b90 0x7f35b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.563+0000 7f35c7400640 1 -- 172.21.15.121:0/1421268063 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f35c00ba340 con 0x7f35b4003a50 2024-09-17T03:41:46.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.563+0000 7f35cea00640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f35b0078b90 0x7f35b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.564+0000 7f35cea00640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f35b0078b90 0x7f35b007b0a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f35d0163240 tx=0x7f35bc0067a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:46.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.567+0000 7f35c7400640 1 -- 172.21.15.121:0/1421268063 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f35d015a320 con 0x7f35b4003a50 2024-09-17T03:41:46.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.748+0000 7f35d6800640 1 -- 172.21.15.121:0/1421268063 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f35d006d400 con 0x7f35b4003a50 2024-09-17T03:41:46.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.752+0000 7f35c7400640 1 -- 172.21.15.121:0/1421268063 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v49)=0 v49) ==== 123+0+0 (secure 0 0 0) 0x7f35c0082760 con 0x7f35b4003a50 2024-09-17T03:41:46.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.753+0000 7f35c7400640 1 -- 172.21.15.121:0/1421268063 <== mon.0 v2:172.21.15.121:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f35c0081b70 con 0x7f35b4003a50 2024-09-17T03:41:46.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.755+0000 7f35d6800640 1 -- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f35b0078b90 msgr2=0x7f35b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.755+0000 7f35d6800640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f35b0078b90 0x7f35b007b0a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f35d0163240 tx=0x7f35bc0067a0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.755+0000 7f35d6800640 1 -- 172.21.15.121:0/1421268063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4003a50 msgr2=0x7f35d0158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.755+0000 7f35d6800640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4003a50 0x7f35d0158ef0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f35c0001830 tx=0x7f35c00062f0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.756+0000 7f35d6800640 1 -- 172.21.15.121:0/1421268063 shutdown_connections 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.756+0000 7f35d6800640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35d01599d0 0x7f35d0159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.756+0000 7f35d6800640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35d01f8de0 0x7f35d01f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.756+0000 7f35d6800640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f35b0078b90 0x7f35b007b0a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.756+0000 7f35d6800640 1 --2- 172.21.15.121:0/1421268063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4003a50 0x7f35d0158ef0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.756+0000 7f35d6800640 1 -- 172.21.15.121:0/1421268063 >> 172.21.15.121:0/1421268063 conn(0x7f35d00b33b0 msgr2=0x7f35d006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.756+0000 7f35d6800640 1 -- 172.21.15.121:0/1421268063 shutdown_connections 2024-09-17T03:41:46.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:46.756+0000 7f35d6800640 1 -- 172.21.15.121:0/1421268063 wait complete. 2024-09-17T03:41:46.780 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:41:46.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:47.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.003+0000 7f3d2a600640 1 -- 172.21.15.121:0/3808409535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2406e3c0 msgr2=0x7f3d240b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:47.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.003+0000 7f3d2a600640 1 --2- 172.21.15.121:0/3808409535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2406e3c0 0x7f3d240b2f70 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009830 tx=0x7f3d0c02a480 comp rx=0 tx=0).stop 2024-09-17T03:41:47.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.003+0000 7f3d2a600640 1 -- 172.21.15.121:0/3808409535 shutdown_connections 2024-09-17T03:41:47.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.003+0000 7f3d2a600640 1 --2- 172.21.15.121:0/3808409535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2406e3c0 0x7f3d240b2f70 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.003+0000 7f3d2a600640 1 --2- 172.21.15.121:0/3808409535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d240cc550 0x7f3d2406de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.003+0000 7f3d2a600640 1 -- 172.21.15.121:0/3808409535 >> 172.21.15.121:0/3808409535 conn(0x7f3d240b1c10 msgr2=0x7f3d240b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:47.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.003+0000 7f3d2a600640 1 -- 172.21.15.121:0/3808409535 shutdown_connections 2024-09-17T03:41:47.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.003+0000 7f3d2a600640 1 -- 172.21.15.121:0/3808409535 wait complete. 2024-09-17T03:41:47.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.006+0000 7f3d2a600640 1 Processor -- start 2024-09-17T03:41:47.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.006+0000 7f3d2a600640 1 -- start start 2024-09-17T03:41:47.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.007+0000 7f3d2a600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d2406e3c0 0x7f3d240c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:47.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.007+0000 7f3d2a600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d240cc550 0x7f3d240c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:47.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.007+0000 7f3d2a600640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2415fdf0 0x7f3d241f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:47.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.007+0000 7f3d2a600640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d240cb2d0 con 0x7f3d2415fdf0 2024-09-17T03:41:47.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.007+0000 7f3d2a600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d240b38b0 con 0x7f3d240cc550 2024-09-17T03:41:47.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.007+0000 7f3d2a600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3d240cb450 con 0x7f3d2406e3c0 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.007+0000 7f3d23e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2415fdf0 0x7f3d241f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.007+0000 7f3d23e00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2415fdf0 0x7f3d241f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:48830/0 (socket says 172.21.15.121:48830) 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.007+0000 7f3d23e00640 1 -- 172.21.15.121:0/1405799743 learned_addr learned my addr 172.21.15.121:0/1405799743 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d23400640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d2406e3c0 0x7f3d240c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d1aa00640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d240cc550 0x7f3d240c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d23e00640 1 -- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d2406e3c0 msgr2=0x7f3d240c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d23e00640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d2406e3c0 0x7f3d240c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d23e00640 1 -- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d240cc550 msgr2=0x7f3d240c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d23e00640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d240cc550 0x7f3d240c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d23e00640 1 -- 172.21.15.121:0/1405799743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d240a9a80 con 0x7f3d2415fdf0 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d23e00640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2415fdf0 0x7f3d241f6a10 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00caa0 tx=0x7f3d1c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d1be00640 1 -- 172.21.15.121:0/1405799743 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c016020 con 0x7f3d2415fdf0 2024-09-17T03:41:47.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d1be00640 1 -- 172.21.15.121:0/1405799743 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f3d1c00aba0 con 0x7f3d2415fdf0 2024-09-17T03:41:47.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d2a600640 1 -- 172.21.15.121:0/1405799743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d240a9d60 con 0x7f3d2415fdf0 2024-09-17T03:41:47.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.008+0000 7f3d1be00640 1 -- 172.21.15.121:0/1405799743 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c012420 con 0x7f3d2415fdf0 2024-09-17T03:41:47.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.009+0000 7f3d2a600640 1 -- 172.21.15.121:0/1405799743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d240aa320 con 0x7f3d2415fdf0 2024-09-17T03:41:47.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.009+0000 7f3d2a600640 1 -- 172.21.15.121:0/1405799743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d240b2f70 con 0x7f3d2415fdf0 2024-09-17T03:41:47.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.011+0000 7f3d1be00640 1 -- 172.21.15.121:0/1405799743 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d1c019020 con 0x7f3d2415fdf0 2024-09-17T03:41:47.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.012+0000 7f3d1be00640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d00078b90 0x7f3d0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:47.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.012+0000 7f3d1be00640 1 -- 172.21.15.121:0/1405799743 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5593+0+0 (secure 0 0 0) 0x7f3d1c09afd0 con 0x7f3d2415fdf0 2024-09-17T03:41:47.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.012+0000 7f3d23400640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d00078b90 0x7f3d0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:47.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.013+0000 7f3d23400640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d00078b90 0x7f3d0007b0a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3d14005fd0 tx=0x7f3d14005850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:47.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.016+0000 7f3d1be00640 1 -- 172.21.15.121:0/1405799743 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3d1c020030 con 0x7f3d2415fdf0 2024-09-17T03:41:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.232+0000 7f3d2a600640 1 -- 172.21.15.121:0/1405799743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d24072ec0 con 0x7f3d2415fdf0 2024-09-17T03:41:47.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.233+0000 7f3d1be00640 1 -- 172.21.15.121:0/1405799743 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+3917 (secure 0 0 0) 0x7f3d1c063470 con 0x7f3d2415fdf0 2024-09-17T03:41:47.233 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-17T03:41:47.233 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":90,"btime":"2024-09-17T03:41:10:768968+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2875035597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6833","nonce":2875035597},{"type":"v1","addr":"172.21.15.121:6835","nonce":2875035597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/2294887057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2294887057},{"type":"v1","addr":"172.21.15.176:6835","nonce":2294887057}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3889006859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":3889006859},{"type":"v1","addr":"172.21.15.176:6837","nonce":3889006859}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":7554,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6834/32386667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":32386667},{"type":"v1","addr":"172.21.15.121:6834","nonce":32386667}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[]} 2024-09-17T03:41:47.233 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 90 2024-09-17T03:41:47.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 -- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d00078b90 msgr2=0x7f3d0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:47.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d00078b90 0x7f3d0007b0a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3d14005fd0 tx=0x7f3d14005850 comp rx=0 tx=0).stop 2024-09-17T03:41:47.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 -- 172.21.15.121:0/1405799743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2415fdf0 msgr2=0x7f3d241f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:47.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2415fdf0 0x7f3d241f6a10 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00caa0 tx=0x7f3d1c00cf60 comp rx=0 tx=0).stop 2024-09-17T03:41:47.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 -- 172.21.15.121:0/1405799743 shutdown_connections 2024-09-17T03:41:47.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:6800/1198724406,v1:172.21.15.176:6801/1198724406] conn(0x7f3d00078b90 0x7f3d0007b0a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d2415fdf0 0x7f3d241f6a10 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d240cc550 0x7f3d240c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 --2- 172.21.15.121:0/1405799743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d2406e3c0 0x7f3d240c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 -- 172.21.15.121:0/1405799743 >> 172.21.15.121:0/1405799743 conn(0x7f3d240b1c10 msgr2=0x7f3d240cabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:47.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 -- 172.21.15.121:0/1405799743 shutdown_connections 2024-09-17T03:41:47.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-17T03:41:47.235+0000 7f3d2a600640 1 -- 172.21.15.121:0/1405799743 wait complete. 2024-09-17T03:41:47.259 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T03:41:47.259 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T03:41:47.260 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:41:47.260 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.284 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:41:47.284 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:41:47.285 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.347 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:41:47.348 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:41:47.348 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.372 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:41:47.373 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:41:47.373 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.439 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:41:47.439 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T03:41:47.439 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T03:41:47.439 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.484 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T03:41:47.484 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T03:41:47.484 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.536 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T03:41:47.536 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T03:41:47.536 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.595 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T03:41:47.595 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T03:41:47.595 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.644 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T03:41:47.644 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T03:41:47.645 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.696 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T03:41:47.696 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T03:41:47.696 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.759 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T03:41:47.760 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T03:41:47.760 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.818 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T03:41:47.818 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T03:41:47.818 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.887 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T03:41:47.888 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T03:41:47.889 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T03:41:47.889 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:47.963 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T03:41:47.963 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T03:41:47.963 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:48.037 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T03:41:48.037 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T03:41:48.038 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T03:41:48.038 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:48.067 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T03:41:48.068 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T03:41:48.068 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:48.094 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T03:41:48.094 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T03:41:48.094 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:48.162 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T03:41:48.162 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T03:41:48.163 DEBUG:teuthology.orchestra.run.smithi121:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'client session with non-allowable root' | head -n 1 2024-09-17T03:41:48.242 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:41:48.242 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T03:41:48.506 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:41:48.506 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T03:41:48.611 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:41:48.611 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T03:41:48.717 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:41:48.717 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T03:41:48.818 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:41:48.818 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T03:41:48.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:41:48.995 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T03:41:49.094 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:41:49.094 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T03:41:49.191 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:41:49.191 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T03:41:49.314 INFO:tasks.ceph:Archiving mon data... 2024-09-17T03:41:49.316 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451/data/mon.a.tgz 2024-09-17T03:41:49.316 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-09-17T03:41:49.352 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.t8sJSkiQMY 2024-09-17T03:41:49.352 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.t8sJSkiQMY 2024-09-17T03:41:49.570 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.t8sJSkiQMY 2024-09-17T03:41:49.666 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.t8sJSkiQMY is 570KB 2024-09-17T03:41:50.391 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.t8sJSkiQMY 2024-09-17T03:41:50.430 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451/data/mon.b.tgz 2024-09-17T03:41:50.430 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-17T03:41:50.470 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.HCcNNxAPIC 2024-09-17T03:41:50.470 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HCcNNxAPIC 2024-09-17T03:41:50.738 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.HCcNNxAPIC 2024-09-17T03:41:50.831 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.HCcNNxAPIC is 731KB 2024-09-17T03:41:50.927 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.HCcNNxAPIC 2024-09-17T03:41:50.962 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451/data/mon.c.tgz 2024-09-17T03:41:50.962 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-17T03:41:51.037 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.xzQ6JW2gvP 2024-09-17T03:41:51.037 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.xzQ6JW2gvP 2024-09-17T03:41:51.283 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.xzQ6JW2gvP 2024-09-17T03:41:51.376 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.xzQ6JW2gvP is 731KB 2024-09-17T03:41:51.470 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.xzQ6JW2gvP 2024-09-17T03:41:51.504 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T03:41:51.504 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T03:41:51.508 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T03:41:51.637 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T03:41:51.671 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T03:41:51.671 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T03:41:51.673 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451/remote/smithi121/crash 2024-09-17T03:41:51.673 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T03:41:51.734 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451/remote/smithi176/crash 2024-09-17T03:41:51.735 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T03:41:51.789 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T03:41:51.789 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:41:51.793 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:41:51.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T03:41:51.934 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T03:41:51.989 INFO:tasks.ceph:Compressing logs... 2024-09-17T03:41:51.990 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T03:41:51.994 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T03:41:52.043 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T03:41:52.044 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67448.log 2024-09-17T03:41:52.045 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66507.log 2024-09-17T03:41:52.046 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.67448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57931.log 2024-09-17T03:41:52.046 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67448.log.gz 2024-09-17T03:41:52.047 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36266.log 2024-09-17T03:41:52.047 INFO:teuthology.orchestra.run.smithi121.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.66507.log.gz 2024-09-17T03:41:52.047 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41298.log 2024-09-17T03:41:52.048 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53762.log 2024-09-17T03:41:52.048 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57931.log.gz 2024-09-17T03:41:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36266.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36266.log.gz 2024-09-17T03:41:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57032.log 2024-09-17T03:41:52.050 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59606.log 2024-09-17T03:41:52.050 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53762.log.gz 2024-09-17T03:41:52.051 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41317.log 2024-09-17T03:41:52.051 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.41298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42332.log 2024-09-17T03:41:52.051 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41298.log.gz 2024-09-17T03:41:52.051 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.41317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41317.log.gz 2024-09-17T03:41:52.051 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44698.log 2024-09-17T03:41:52.051 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.42332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42332.log.gz 2024-09-17T03:41:52.051 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45209.log 2024-09-17T03:41:52.053 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.44698.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T03:41:52.053 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44698.log.gz 2024-09-17T03:41:52.053 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.45209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45209.log.gz 2024-09-17T03:41:52.053 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45750.log 2024-09-17T03:41:52.053 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35772.log 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60226.log 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57032.log.gz 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59522.log 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59606.log.gz 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57553.log 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60226.log.gz 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59522.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59522.log.gz 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63425.log 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56089.log 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57553.log.gz 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52672.log 2024-09-17T03:41:52.055 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63425.log.gz 2024-09-17T03:41:52.059 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52714.log 2024-09-17T03:41:52.059 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56089.log.gz 2024-09-17T03:41:52.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52672.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52672.log.gz 2024-09-17T03:41:52.060 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2024-09-17T03:41:52.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54266.log 2024-09-17T03:41:52.060 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52714.log.gz 2024-09-17T03:41:52.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58965.log 2024-09-17T03:41:52.060 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2024-09-17T03:41:52.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50980.log 2024-09-17T03:41:52.060 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54266.log.gz 2024-09-17T03:41:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.45750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45750.log.gz 2024-09-17T03:41:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T03:41:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.35772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42825.log 2024-09-17T03:41:52.062 INFO:teuthology.orchestra.run.smithi176.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35772.log.gz 2024-09-17T03:41:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42829.log 2024-09-17T03:41:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.42825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42825.log.gz 2024-09-17T03:41:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44694.log 2024-09-17T03:41:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.42829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42829.log.gz 2024-09-17T03:41:52.062 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41712.log 2024-09-17T03:41:52.063 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.44694.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.1.44694.log.gz --verbose 2024-09-17T03:41:52.063 INFO:teuthology.orchestra.run.smithi176.stderr: -- /var/log/ceph/ceph-osd.4.log 2024-09-17T03:41:52.063 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.3.41712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41712.log.gz 2024-09-17T03:41:52.063 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43650.log 2024-09-17T03:41:52.063 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T03:41:52.063 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.43650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43650.log.gz 2024-09-17T03:41:52.063 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44217.log 2024-09-17T03:41:52.063 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43306.log 2024-09-17T03:41:52.065 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47073.log 2024-09-17T03:41:52.065 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58965.log.gz 2024-09-17T03:41:52.065 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53552.log 2024-09-17T03:41:52.065 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50980.log.gz 2024-09-17T03:41:52.065 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51331.log 2024-09-17T03:41:52.065 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47073.log.gz 2024-09-17T03:41:52.065 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41867.log 2024-09-17T03:41:52.065 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53552.log.gz 2024-09-17T03:41:52.066 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44068.log 2024-09-17T03:41:52.066 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51331.log.gz 2024-09-17T03:41:52.066 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.41867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63047.log 2024-09-17T03:41:52.066 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41867.log.gz 2024-09-17T03:41:52.066 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44068.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44068.log.gz 2024-09-17T03:41:52.066 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54690.log 2024-09-17T03:41:52.070 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65880.log 2024-09-17T03:41:52.070 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63047.log.gz 2024-09-17T03:41:52.070 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60714.log 2024-09-17T03:41:52.071 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54690.log.gz 2024-09-17T03:41:52.071 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66915.log 2024-09-17T03:41:52.071 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65880.log.gz 2024-09-17T03:41:52.071 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60714.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60714.log.gz 2024-09-17T03:41:52.071 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43593.log 2024-09-17T03:41:52.071 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62963.log 2024-09-17T03:41:52.071 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66915.log.gz 2024-09-17T03:41:52.071 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46465.log 2024-09-17T03:41:52.071 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43593.log.gz 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.44217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44217.log.gz 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36132.log 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.43306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43306.log.gz 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43310.log 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36132.log.gz 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35892.log 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.43310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43310.log.gz 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45205.log 2024-09-17T03:41:52.073 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.35892.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35892.log.gz 2024-09-17T03:41:52.074 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45746.log 2024-09-17T03:41:52.074 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.45205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45205.log.gz 2024-09-17T03:41:52.074 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46169.log 2024-09-17T03:41:52.074 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.45746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45746.log.gz 2024-09-17T03:41:52.074 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T03:41:52.074 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.46169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46169.log.gz 2024-09-17T03:41:52.074 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44213.log 2024-09-17T03:41:52.075 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60672.log 2024-09-17T03:41:52.075 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62963.log.gz 2024-09-17T03:41:52.075 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46465.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46465.log.gz 2024-09-17T03:41:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2024-09-17T03:41:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44741.log 2024-09-17T03:41:52.076 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60672.log.gz 2024-09-17T03:41:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57849.log 2024-09-17T03:41:52.076 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2024-09-17T03:41:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58726.log 2024-09-17T03:41:52.076 INFO:teuthology.orchestra.run.smithi121.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44741.log.gz 2024-09-17T03:41:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.57849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57849.log.gz 2024-09-17T03:41:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66976.log 2024-09-17T03:41:52.082 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T03:41:52.083 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.44213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44213.log.gz 2024-09-17T03:41:52.083 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T03:41:52.083 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43646.log 2024-09-17T03:41:52.083 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.1.43646.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T03:41:52.083 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T03:41:52.083 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T03:41:52.083 INFO:teuthology.orchestra.run.smithi176.stderr: -- replaced with /var/log/ceph/ceph-client.1.43646.log.gz 2024-09-17T03:41:52.085 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42328.log 2024-09-17T03:41:52.085 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35972.log 2024-09-17T03:41:52.086 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64665.log 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58726.log.gz 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47409.log 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.66976.log.gz 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63131.log 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64665.log.gz 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53240.log 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47409.log.gz 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59045.log 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63131.log.gz 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59840.log 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53240.log.gz 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60152.log 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59045.log.gz 2024-09-17T03:41:52.087 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59840.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59840.log.gz 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49970.log 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51625.log 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60152.log.gz 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45063.log 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49970.log.gz 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59168.log 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51625.log.gz 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.45063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63173.log 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45063.log.gz 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66098.log 2024-09-17T03:41:52.088 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59168.log.gz 2024-09-17T03:41:52.089 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.35972.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35972.log.gz 2024-09-17T03:41:52.090 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T03:41:52.091 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64857.log 2024-09-17T03:41:52.091 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63173.log.gz 2024-09-17T03:41:52.091 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66098.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T03:41:52.091 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66098.log.gz 2024-09-17T03:41:52.091 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.64857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64857.log.gz 2024-09-17T03:41:52.091 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68066.log 2024-09-17T03:41:52.091 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64515.log 2024-09-17T03:41:52.092 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.68066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55963.log 2024-09-17T03:41:52.092 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68066.log.gz 2024-09-17T03:41:52.092 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64515.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64515.log.gz 2024-09-17T03:41:52.093 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.1.42328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42328.log.gz 2024-09-17T03:41:52.093 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41716.log 2024-09-17T03:41:52.094 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61596.log 2024-09-17T03:41:52.094 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60798.log 2024-09-17T03:41:52.094 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55963.log.gz 2024-09-17T03:41:52.094 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61596.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.61596.log.gz 2024-09-17T03:41:52.094 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60943.log 2024-09-17T03:41:52.096 INFO:teuthology.orchestra.run.smithi176.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46165.log 2024-09-17T03:41:52.096 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.3.41716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41716.log.gz 2024-09-17T03:41:52.097 INFO:teuthology.orchestra.run.smithi176.stderr: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T03:41:52.097 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61768.log 2024-09-17T03:41:52.097 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60798.log.gz 2024-09-17T03:41:52.097 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60943.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60943.log.gz 2024-09-17T03:41:52.097 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51415.log 2024-09-17T03:41:52.098 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60110.log 2024-09-17T03:41:52.098 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61768.log.gz 2024-09-17T03:41:52.098 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51415.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.51415.log.gz --verbose 2024-09-17T03:41:52.098 INFO:teuthology.orchestra.run.smithi121.stderr: -- /var/log/ceph/ceph-client.admin.50451.log 2024-09-17T03:41:52.100 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41771.log 2024-09-17T03:41:52.100 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60110.log.gz 2024-09-17T03:41:52.100 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50451.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50451.log.gz 2024-09-17T03:41:52.100 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62483.log 2024-09-17T03:41:52.101 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.46165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35812.log 2024-09-17T03:41:52.101 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35932.log 2024-09-17T03:41:52.101 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0%/var/log/ceph/ceph-client.admin.35812.log: -- replaced with /var/log/ceph/ceph-client.1.46165.log.gz 2024-09-17T03:41:52.103 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36012.log 2024-09-17T03:41:52.104 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.41771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47325.log 2024-09-17T03:41:52.104 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41771.log.gz 2024-09-17T03:41:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62483.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62483.log.gz 2024-09-17T03:41:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60546.log 2024-09-17T03:41:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48386.log 2024-09-17T03:41:52.105 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47325.log.gz 2024-09-17T03:41:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60546.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60546.log.gz 2024-09-17T03:41:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66366.log 2024-09-17T03:41:52.105 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47695.log 2024-09-17T03:41:52.105 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48386.log.gz 2024-09-17T03:41:52.108 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.35932.log: /var/log/ceph/ceph-client.admin.36012.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36012.log.gz 2024-09-17T03:41:52.108 INFO:teuthology.orchestra.run.smithi176.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35932.log.gz 2024-09-17T03:41:52.108 INFO:teuthology.orchestra.run.smithi176.stderr: 86.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.35812.log.gz 2024-09-17T03:41:52.108 INFO:teuthology.orchestra.run.smithi176.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35852.log 2024-09-17T03:41:52.109 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66366.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66366.log.gz 2024-09-17T03:41:52.109 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48698.log 2024-09-17T03:41:52.109 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44069.log 2024-09-17T03:41:52.109 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47695.log.gz 2024-09-17T03:41:52.109 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48698.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48698.log.gz 2024-09-17T03:41:52.109 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2024-09-17T03:41:52.109 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67130.log 2024-09-17T03:41:52.109 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44069.log.gz 2024-09-17T03:41:52.109 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50672.log 2024-09-17T03:41:52.109 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2024-09-17T03:41:52.110 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.35852.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35852.log.gz 2024-09-17T03:41:52.111 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57853.log 2024-09-17T03:41:52.111 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67130.log.gz 2024-09-17T03:41:52.111 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50672.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50672.log.gz 2024-09-17T03:41:52.111 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66444.log 2024-09-17T03:41:52.112 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.57853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57853.log.gz 2024-09-17T03:41:52.112 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53327.log 2024-09-17T03:41:52.112 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66444.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66444.log.gz 2024-09-17T03:41:52.112 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2024-09-17T03:41:52.113 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53327.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53327.log.gz 2024-09-17T03:41:52.113 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60840.log 2024-09-17T03:41:52.114 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47781.log 2024-09-17T03:41:52.114 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2024-09-17T03:41:52.115 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64179.log 2024-09-17T03:41:52.115 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60840.log.gz 2024-09-17T03:41:52.116 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47781.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47781.log.gz 2024-09-17T03:41:52.116 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63509.log 2024-09-17T03:41:52.117 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64179.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.48428.log 2024-09-17T03:41:52.117 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64179.log.gz 2024-09-17T03:41:52.118 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63509.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63509.log.gz 2024-09-17T03:41:52.118 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49928.log 2024-09-17T03:41:52.119 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54959.log 2024-09-17T03:41:52.119 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48428.log.gz 2024-09-17T03:41:52.119 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49928.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49928.log.gz 2024-09-17T03:41:52.119 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58600.log 2024-09-17T03:41:52.120 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44372.log 2024-09-17T03:41:52.120 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54959.log.gz 2024-09-17T03:41:52.121 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58600.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58600.log.gz 2024-09-17T03:41:52.122 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44672.log 2024-09-17T03:41:52.122 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64431.log 2024-09-17T03:41:52.123 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44372.log.gz 2024-09-17T03:41:52.123 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61027.log 2024-09-17T03:41:52.123 INFO:teuthology.orchestra.run.smithi121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44672.log.gz 2024-09-17T03:41:52.124 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64137.log 2024-09-17T03:41:52.124 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64431.log.gz 2024-09-17T03:41:52.125 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61027.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61027.log.gz 2024-09-17T03:41:52.125 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57595.log 2024-09-17T03:41:52.126 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50409.log 2024-09-17T03:41:52.126 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64137.log.gz 2024-09-17T03:41:52.127 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47157.log 2024-09-17T03:41:52.127 INFO:teuthology.orchestra.run.smithi176.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T03:41:52.128 INFO:teuthology.orchestra.run.smithi121.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.57595.log.gz 2024-09-17T03:41:52.128 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55905.log 2024-09-17T03:41:52.128 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50409.log.gz 2024-09-17T03:41:52.129 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47157.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47157.log.gz 2024-09-17T03:41:52.129 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45189.log 2024-09-17T03:41:52.130 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65199.log 2024-09-17T03:41:52.130 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55905.log.gz 2024-09-17T03:41:52.131 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.45189.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45189.log.gz 2024-09-17T03:41:52.131 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64389.log 2024-09-17T03:41:52.132 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57259.log 2024-09-17T03:41:52.132 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65199.log.gz 2024-09-17T03:41:52.132 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64389.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64389.log.gz 2024-09-17T03:41:52.133 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47615.log 2024-09-17T03:41:52.133 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58103.log 2024-09-17T03:41:52.134 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57259.log.gz 2024-09-17T03:41:52.134 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63089.log 2024-09-17T03:41:52.134 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47615.log.gz 2024-09-17T03:41:52.135 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65009.log 2024-09-17T03:41:52.135 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58103.log.gz 2024-09-17T03:41:52.136 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63089.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63089.log.gz 2024-09-17T03:41:52.137 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55698.log 2024-09-17T03:41:52.137 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67898.log 2024-09-17T03:41:52.137 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65009.log.gz 2024-09-17T03:41:52.138 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.55698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55698.log.gz 2024-09-17T03:41:52.138 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58810.log 2024-09-17T03:41:52.139 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53422.log 2024-09-17T03:41:52.139 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.67898.log.gz 2024-09-17T03:41:52.140 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58810.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58810.log.gz -5 2024-09-17T03:41:52.140 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62105.log 2024-09-17T03:41:52.141 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45396.log 2024-09-17T03:41:52.141 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53422.log.gz 2024-09-17T03:41:52.142 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62105.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62105.log.gz 2024-09-17T03:41:52.142 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61512.log 2024-09-17T03:41:52.143 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.45396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36258.log 2024-09-17T03:41:52.143 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45396.log.gz 2024-09-17T03:41:52.144 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61512.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.61512.log.gz 2024-09-17T03:41:52.144 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68108.log 2024-09-17T03:41:52.144 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64853.log 2024-09-17T03:41:52.145 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36258.log.gz 2024-09-17T03:41:52.145 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.68108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57076.log 2024-09-17T03:41:52.146 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68108.log.gz 2024-09-17T03:41:52.146 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.64853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64853.log.gz 2024-09-17T03:41:52.146 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63467.log 2024-09-17T03:41:52.147 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57076.log: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.57076.log.gz 2024-09-17T03:41:52.147 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63215.log 2024-09-17T03:41:52.148 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57385.log 2024-09-17T03:41:52.148 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63467.log.gz 2024-09-17T03:41:52.149 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44725.log 2024-09-17T03:41:52.149 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.63215.log.gz 2024-09-17T03:41:52.150 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51499.log 2024-09-17T03:41:52.150 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57385.log.gz 2024-09-17T03:41:52.151 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44725.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.44725.log.gz 2024-09-17T03:41:52.151 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62837.log 2024-09-17T03:41:52.152 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68236.log 2024-09-17T03:41:52.152 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51499.log.gz 2024-09-17T03:41:52.153 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62837.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.62837.log.gz 2024-09-17T03:41:52.153 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42205.log 2024-09-17T03:41:52.154 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.68236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63299.log 2024-09-17T03:41:52.154 INFO:teuthology.orchestra.run.smithi121.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.68236.log.gz 2024-09-17T03:41:52.154 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42543.log 2024-09-17T03:41:52.155 INFO:teuthology.orchestra.run.smithi121.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42205.log.gz 2024-09-17T03:41:52.156 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63299.log: gzip -5 --verbose 87.5% -- /var/log/ceph/ceph-client.admin.51247.log -- replaced with /var/log/ceph/ceph-client.admin.63299.log.gz 2024-09-17T03:41:52.156 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-17T03:41:52.156 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51925.log 2024-09-17T03:41:52.157 INFO:teuthology.orchestra.run.smithi121.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42543.log.gz 2024-09-17T03:41:52.157 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51247.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51247.log.gz 2024-09-17T03:41:52.158 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43509.log 2024-09-17T03:41:52.158 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.51925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51925.log.gz 2024-09-17T03:41:52.158 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55506.log 2024-09-17T03:41:52.159 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47199.log 2024-09-17T03:41:52.159 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43509.log.gz 2024-09-17T03:41:52.160 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52317.log 2024-09-17T03:41:52.160 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55506.log.gz 2024-09-17T03:41:52.161 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54224.log 2024-09-17T03:41:52.161 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47199.log.gz 2024-09-17T03:41:52.162 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52317.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.52317.log.gz --verbose 2024-09-17T03:41:52.162 INFO:teuthology.orchestra.run.smithi121.stderr: -- /var/log/ceph/ceph-client.admin.50283.log 2024-09-17T03:41:52.163 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42121.log 2024-09-17T03:41:52.163 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54224.log.gz 2024-09-17T03:41:52.164 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50283.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50283.log.gz 2024-09-17T03:41:52.164 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59126.log 2024-09-17T03:41:52.165 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60588.log 2024-09-17T03:41:52.165 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42121.log.gz 2024-09-17T03:41:52.166 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59392.log 2024-09-17T03:41:52.166 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59126.log.gz 2024-09-17T03:41:52.167 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58852.log 2024-09-17T03:41:52.167 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60588.log.gz 2024-09-17T03:41:52.168 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59392.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.59392.log.gz --verbose 2024-09-17T03:41:52.168 INFO:teuthology.orchestra.run.smithi121.stderr: -- /var/log/ceph/ceph-client.admin.52175.log 2024-09-17T03:41:52.169 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44363.log 2024-09-17T03:41:52.169 INFO:teuthology.orchestra.run.smithi121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58852.log.gz 2024-09-17T03:41:52.169 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52175.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52175.log.gz 2024-09-17T03:41:52.170 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66789.log 2024-09-17T03:41:52.170 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44363.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44363.log.gz 2024-09-17T03:41:52.171 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46423.log 2024-09-17T03:41:52.171 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42459.log 2024-09-17T03:41:52.171 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66789.log.gz 2024-09-17T03:41:52.172 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46423.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.58642.log -- replaced with /var/log/ceph/ceph-client.admin.46423.log.gz 2024-09-17T03:41:52.172 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-17T03:41:52.173 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60028.log 2024-09-17T03:41:52.173 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42459.log.gz 2024-09-17T03:41:52.174 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47283.log 2024-09-17T03:41:52.174 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58642.log.gz 2024-09-17T03:41:52.175 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.60028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60028.log.gz 2024-09-17T03:41:52.175 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46184.log 2024-09-17T03:41:52.176 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53117.log 2024-09-17T03:41:52.176 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47283.log.gz 2024-09-17T03:41:52.177 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.2.46184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46184.log.gz 2024-09-17T03:41:52.177 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50367.log 2024-09-17T03:41:52.178 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61852.log 2024-09-17T03:41:52.178 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53117.log.gz 2024-09-17T03:41:52.179 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50367.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50367.log.gzgzip 2024-09-17T03:41:52.179 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68192.log 2024-09-17T03:41:52.179 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36263.log 2024-09-17T03:41:52.180 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61852.log.gz 2024-09-17T03:41:52.180 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.68192.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68192.log.gz 2024-09-17T03:41:52.180 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42077.log 2024-09-17T03:41:52.181 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36263.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36263.log.gz 2024-09-17T03:41:52.181 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47535.log 2024-09-17T03:41:52.182 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42077.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42077.log.gz 2024-09-17T03:41:52.182 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2024-09-17T03:41:52.183 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42033.log 2024-09-17T03:41:52.183 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47535.log.gz 2024-09-17T03:41:52.184 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48172.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2024-09-17T03:41:52.184 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36930.log 2024-09-17T03:41:52.185 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46591.log 2024-09-17T03:41:52.185 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42033.log.gz 2024-09-17T03:41:52.186 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36930.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.36930.log.gz /var/log/ceph/ceph-client.admin.47991.log 2024-09-17T03:41:52.186 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-17T03:41:52.186 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60345.log 2024-09-17T03:41:52.187 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46591.log.gz 2024-09-17T03:41:52.188 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47991.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47991.log.gz 2024-09-17T03:41:52.188 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46633.log 2024-09-17T03:41:52.188 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51541.log 2024-09-17T03:41:52.189 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60345.log.gz 2024-09-17T03:41:52.189 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46633.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46633.log.gz 2024-09-17T03:41:52.189 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50180.log 2024-09-17T03:41:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58684.log 2024-09-17T03:41:52.190 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51541.log.gz 2024-09-17T03:41:52.191 INFO:teuthology.orchestra.run.smithi176.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T03:41:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50180.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.50180.log.gz 2024-09-17T03:41:52.192 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51159.log 2024-09-17T03:41:52.192 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64599.log 2024-09-17T03:41:52.192 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58684.log.gz 2024-09-17T03:41:52.193 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51159.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51159.log.gz 2024-09-17T03:41:52.193 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44404.log 2024-09-17T03:41:52.194 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54596.log 2024-09-17T03:41:52.195 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64599.log.gz 2024-09-17T03:41:52.195 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44404.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44404.log.gz -5 2024-09-17T03:41:52.195 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T03:41:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57343.log 2024-09-17T03:41:52.196 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54596.log.gz 2024-09-17T03:41:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45021.log 2024-09-17T03:41:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57343.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57343.log.gz 2024-09-17T03:41:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62063.log 2024-09-17T03:41:52.199 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.45021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52359.log 2024-09-17T03:41:52.199 INFO:teuthology.orchestra.run.smithi121.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T03:41:52.199 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45021.log.gz 2024-09-17T03:41:52.200 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59434.log 2024-09-17T03:41:52.200 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62063.log.gz 2024-09-17T03:41:52.201 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42501.log 2024-09-17T03:41:52.201 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52359.log.gz 2024-09-17T03:41:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59434.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59434.log.gz 2024-09-17T03:41:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50852.log 2024-09-17T03:41:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44061.log 2024-09-17T03:41:52.203 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42501.log.gz 2024-09-17T03:41:52.204 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50852.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50852.log.gzgzip 2024-09-17T03:41:52.204 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53720.log 2024-09-17T03:41:52.205 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48344.log 2024-09-17T03:41:52.205 INFO:teuthology.orchestra.run.smithi121.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44061.log.gz 2024-09-17T03:41:52.205 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60032.log 2024-09-17T03:41:52.206 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53720.log.gz 2024-09-17T03:41:52.206 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49353.log 2024-09-17T03:41:52.206 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48344.log.gz 2024-09-17T03:41:52.207 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.60032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60032.log.gz 2024-09-17T03:41:52.207 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52443.log 2024-09-17T03:41:52.208 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63825.log 2024-09-17T03:41:52.208 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49353.log.gz 2024-09-17T03:41:52.209 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52443.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52443.log.gz 2024-09-17T03:41:52.209 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64347.log 2024-09-17T03:41:52.210 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58371.log 2024-09-17T03:41:52.210 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63825.log.gz 2024-09-17T03:41:52.211 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64347.log: gzip 86.6% -- replaced with /var/log/ceph/ceph-client.admin.64347.log.gz 2024-09-17T03:41:52.211 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53510.log 2024-09-17T03:41:52.212 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54317.log 2024-09-17T03:41:52.212 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58371.log.gz 2024-09-17T03:41:52.213 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63868.log 2024-09-17T03:41:52.213 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53510.log.gz 2024-09-17T03:41:52.214 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54317.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54317.log.gz 2024-09-17T03:41:52.214 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35982.log 2024-09-17T03:41:52.217 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63868.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63868.log.gzgzip 2024-09-17T03:41:52.218 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61153.log 2024-09-17T03:41:52.218 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35982.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.35982.log.gz 2024-09-17T03:41:52.218 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43551.log 2024-09-17T03:41:52.218 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41539.log 2024-09-17T03:41:52.218 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61153.log.gz 2024-09-17T03:41:52.218 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43551.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.43551.log.gz 2024-09-17T03:41:52.218 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49415.log 2024-09-17T03:41:52.219 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.41539.log: gzip -5 --verbose 87.5% -- -- replaced with /var/log/ceph/ceph-client.admin.41539.log.gz 2024-09-17T03:41:52.219 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.0.62401.log 2024-09-17T03:41:52.219 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60756.log 2024-09-17T03:41:52.219 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49415.log.gz 2024-09-17T03:41:52.220 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.62401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62401.log.gz 2024-09-17T03:41:52.220 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67532.log 2024-09-17T03:41:52.221 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60756.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60756.log.gz 2024-09-17T03:41:52.221 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48656.log 2024-09-17T03:41:52.222 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67532.log: 87.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.67532.log.gz 2024-09-17T03:41:52.222 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62879.log 2024-09-17T03:41:52.223 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48656.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48656.log.gz 2024-09-17T03:41:52.223 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65413.log 2024-09-17T03:41:52.224 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62879.log: gzip -5 --verbose -- 87.1% /var/log/ceph/ceph-client.admin.43845.log -- replaced with /var/log/ceph/ceph-client.admin.62879.log.gz 2024-09-17T03:41:52.224 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-17T03:41:52.225 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65413.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65413.log.gz -5 2024-09-17T03:41:52.225 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65501.log 2024-09-17T03:41:52.226 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67940.log 2024-09-17T03:41:52.226 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz 2024-09-17T03:41:52.227 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42375.log 2024-09-17T03:41:52.227 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65501.log.gz 2024-09-17T03:41:52.228 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43260.log 2024-09-17T03:41:52.228 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67940.log.gz 2024-09-17T03:41:52.228 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42375.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42375.log.gz 2024-09-17T03:41:52.228 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47451.log 2024-09-17T03:41:52.229 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43260.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.43260.log.gz 2024-09-17T03:41:52.229 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46363.log 2024-09-17T03:41:52.230 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47451.log: gzip -5 87.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.47451.log.gz -- 2024-09-17T03:41:52.230 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.admin.48302.log 2024-09-17T03:41:52.231 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60985.log 2024-09-17T03:41:52.231 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46363.log.gz 2024-09-17T03:41:52.232 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48302.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48302.log.gz -5 2024-09-17T03:41:52.232 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42417.log 2024-09-17T03:41:52.233 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60985.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60985.log.gz 2024-09-17T03:41:52.233 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44057.log 2024-09-17T03:41:52.233 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42417.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42417.log.gz 2024-09-17T03:41:52.233 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35859.log 2024-09-17T03:41:52.234 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44057.log: gzip -5 --verbose 87.2% -- -- replaced with /var/log/ceph/ceph-client.admin.44057.log.gz /var/log/ceph/ceph-client.0.45736.log 2024-09-17T03:41:52.234 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-17T03:41:52.235 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35859.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.35859.log.gz 2024-09-17T03:41:52.235 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56257.log 2024-09-17T03:41:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.45736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45736.log.gz 2024-09-17T03:41:52.236 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53198.log 2024-09-17T03:41:52.237 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56257.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.56257.log.gz 2024-09-17T03:41:52.237 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.admin.64049.log 2024-09-17T03:41:52.238 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47115.log 2024-09-17T03:41:52.238 INFO:teuthology.orchestra.run.smithi121.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53198.log.gz 2024-09-17T03:41:52.239 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64049.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.64049.log.gz 2024-09-17T03:41:52.239 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36164.log 2024-09-17T03:41:52.240 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45231.log 87.5% 2024-09-17T03:41:52.240 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47115.log.gz 2024-09-17T03:41:52.241 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36164.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36164.log.gzgzip 2024-09-17T03:41:52.241 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35820.log 2024-09-17T03:41:52.242 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.45231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41949.log 2024-09-17T03:41:52.242 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45231.log.gz 2024-09-17T03:41:52.243 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35820.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35820.log.gz 2024-09-17T03:41:52.243 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67701.log 2024-09-17T03:41:52.243 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.41949.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41949.log.gz 2024-09-17T03:41:52.243 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50577.log 2024-09-17T03:41:52.244 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67701.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67701.log.gz 2024-09-17T03:41:52.244 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59255.log 2024-09-17T03:41:52.245 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50577.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50577.log.gz 2024-09-17T03:41:52.245 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36256.log 2024-09-17T03:41:52.246 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59255.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59255.log.gz 2024-09-17T03:41:52.246 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59480.log 2024-09-17T03:41:52.247 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36256.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36256.log.gz 2024-09-17T03:41:52.247 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52233.log 2024-09-17T03:41:52.248 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48470.log 87.4% 2024-09-17T03:41:52.248 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59480.log.gz 2024-09-17T03:41:52.249 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52233.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52233.log.gz 2024-09-17T03:41:52.249 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2024-09-17T03:41:52.250 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48470.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2024-09-17T03:41:52.250 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68318.log 2024-09-17T03:41:52.251 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56946.log 2024-09-17T03:41:52.251 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2024-09-17T03:41:52.252 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.68318.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.52761.log -- replaced with /var/log/ceph/ceph-client.admin.68318.log.gz 2024-09-17T03:41:52.252 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-17T03:41:52.253 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56946.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56946.log.gzgzip 2024-09-17T03:41:52.253 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2024-09-17T03:41:52.253 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52761.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52761.log.gz 2024-09-17T03:41:52.254 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56547.log 2024-09-17T03:41:52.254 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35779.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2024-09-17T03:41:52.254 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65609.log 2024-09-17T03:41:52.255 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56547.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56547.log.gz 2024-09-17T03:41:52.255 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59564.log 2024-09-17T03:41:52.256 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65609.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65609.log.gzgzip 2024-09-17T03:41:52.256 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56649.log 2024-09-17T03:41:52.257 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59564.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.59564.log.gz 2024-09-17T03:41:52.257 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63341.log 2024-09-17T03:41:52.258 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56649.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56649.log.gzgzip 2024-09-17T03:41:52.258 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56379.log 2024-09-17T03:41:52.259 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63341.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.63341.log.gz 2024-09-17T03:41:52.259 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.admin.62147.log 2024-09-17T03:41:52.260 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56379.log: gzip 87.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.56379.log.gz --verbose 2024-09-17T03:41:52.260 INFO:teuthology.orchestra.run.smithi121.stderr: -- /var/log/ceph/ceph-client.admin.54182.log 2024-09-17T03:41:52.261 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61895.log 2024-09-17T03:41:52.261 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.62147.log.gz 2024-09-17T03:41:52.262 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54182.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54182.log.gz 2024-09-17T03:41:52.262 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61726.log 2024-09-17T03:41:52.262 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36274.log 2024-09-17T03:41:52.262 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61895.log.gz 2024-09-17T03:41:52.264 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61726.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.61726.log.gz --verbose 2024-09-17T03:41:52.264 INFO:teuthology.orchestra.run.smithi121.stderr: -- /var/log/ceph/ceph-client.admin.44979.log 2024-09-17T03:41:52.264 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36274.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36274.log.gz 2024-09-17T03:41:52.264 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65801.log 2024-09-17T03:41:52.266 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44979.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44979.log.gz 2024-09-17T03:41:52.266 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67855.log 2024-09-17T03:41:52.266 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.65801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65801.log.gz 2024-09-17T03:41:52.266 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43719.log 2024-09-17T03:41:52.267 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67855.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67855.log.gz 2024-09-17T03:41:52.267 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56463.log 2024-09-17T03:41:52.268 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36084.log 87.4% 2024-09-17T03:41:52.268 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43719.log.gz 2024-09-17T03:41:52.269 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63257.log 2024-09-17T03:41:52.269 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56463.log.gz 2024-09-17T03:41:52.270 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51117.log 2024-09-17T03:41:52.270 INFO:teuthology.orchestra.run.smithi121.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36084.log.gz 2024-09-17T03:41:52.271 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56337.log 2024-09-17T03:41:52.271 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63257.log.gz 2024-09-17T03:41:52.272 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51117.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T03:41:52.272 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51117.log.gz 2024-09-17T03:41:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56337.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56337.log.gz 2024-09-17T03:41:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62676.log 2024-09-17T03:41:52.273 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2024-09-17T03:41:52.275 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62676.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62676.log.gz 2024-09-17T03:41:52.275 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56988.log 2024-09-17T03:41:52.276 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48740.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29619.log 2024-09-17T03:41:52.276 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2024-09-17T03:41:52.277 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56988.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56988.log.gz 2024-09-17T03:41:52.277 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48512.log 2024-09-17T03:41:52.278 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.tmp-client.admin.29619.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29619.log.gz 2024-09-17T03:41:52.278 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59299.log 2024-09-17T03:41:52.279 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56005.log 2024-09-17T03:41:52.280 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48512.log.gz 2024-09-17T03:41:52.281 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36206.log 2024-09-17T03:41:52.281 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59299.log.gz 2024-09-17T03:41:52.282 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56005.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56005.log.gz 2024-09-17T03:41:52.282 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47865.log 2024-09-17T03:41:52.282 INFO:teuthology.orchestra.run.smithi176.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T03:41:52.283 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66621.log 2024-09-17T03:41:52.283 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36206.log.gz 2024-09-17T03:41:52.284 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47865.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47865.log.gz 2024-09-17T03:41:52.284 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61195.log 2024-09-17T03:41:52.285 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53912.log 2024-09-17T03:41:52.285 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66621.log.gz 2024-09-17T03:41:52.286 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61195.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61195.log.gz 2024-09-17T03:41:52.286 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51373.log 2024-09-17T03:41:52.287 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43803.log 2024-09-17T03:41:52.288 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53912.log.gz 2024-09-17T03:41:52.288 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51373.log: gzip -5 --verbose -- 87.1% /var/log/ceph/ceph-client.admin.43467.log 2024-09-17T03:41:52.289 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51373.log.gz 2024-09-17T03:41:52.290 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64091.log 2024-09-17T03:41:52.290 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43803.log.gz 2024-09-17T03:41:52.291 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53678.log 87.6% 2024-09-17T03:41:52.291 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43467.log.gz 2024-09-17T03:41:52.292 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35872.log 2024-09-17T03:41:52.292 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64091.log.gz 2024-09-17T03:41:52.293 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53678.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53678.log.gz 2024-09-17T03:41:52.293 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53804.log 2024-09-17T03:41:52.294 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35872.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35872.log.gz 2024-09-17T03:41:52.294 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43040.log 2024-09-17T03:41:52.295 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64557.log 2024-09-17T03:41:52.296 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53804.log.gz 2024-09-17T03:41:52.296 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66747.log 2024-09-17T03:41:52.297 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50894.log 2024-09-17T03:41:52.298 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64557.log.gz 2024-09-17T03:41:52.298 INFO:teuthology.orchestra.run.smithi121.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.43040.log.gz 2024-09-17T03:41:52.298 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36835.log 2024-09-17T03:41:52.299 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66747.log.gz 2024-09-17T03:41:52.300 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50894.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50894.log.gz 2024-09-17T03:41:52.300 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49311.log 2024-09-17T03:41:52.301 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36080.log 2024-09-17T03:41:52.301 INFO:teuthology.orchestra.run.smithi121.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36835.log.gz 2024-09-17T03:41:52.302 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49311.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49311.log.gz 2024-09-17T03:41:52.302 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48077.log 2024-09-17T03:41:52.303 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52401.log 2024-09-17T03:41:52.304 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36080.log.gz 2024-09-17T03:41:52.304 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48077.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48077.log.gz 2024-09-17T03:41:52.304 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48596.log 2024-09-17T03:41:52.306 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35735.log 2024-09-17T03:41:52.306 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52401.log.gz 2024-09-17T03:41:52.307 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48596.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.48596.log.gz 2024-09-17T03:41:52.307 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47737.log 2024-09-17T03:41:52.308 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49234.log 2024-09-17T03:41:52.308 INFO:teuthology.orchestra.run.smithi121.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.35735.log.gz 2024-09-17T03:41:52.309 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47737.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47737.log.gz 2024-09-17T03:41:52.309 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46828.log 2024-09-17T03:41:52.310 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52858.log 2024-09-17T03:41:52.310 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49234.log.gz 2024-09-17T03:41:52.311 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46828.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46828.log.gz 2024-09-17T03:41:52.311 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36268.log 2024-09-17T03:41:52.312 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61069.log 2024-09-17T03:41:52.313 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52858.log.gz 2024-09-17T03:41:52.313 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36268.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36268.log.gz 2024-09-17T03:41:52.313 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66182.log 2024-09-17T03:41:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50790.log 2024-09-17T03:41:52.315 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61069.log.gz 2024-09-17T03:41:52.316 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50054.log 2024-09-17T03:41:52.316 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66182.log.gz 2024-09-17T03:41:52.317 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51921.log 2024-09-17T03:41:52.317 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50790.log.gz 2024-09-17T03:41:52.318 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50054.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50054.log.gz 2024-09-17T03:41:52.318 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51667.log 2024-09-17T03:41:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.51921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51921.log.gz 2024-09-17T03:41:52.319 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36594.log 2024-09-17T03:41:52.320 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50012.log 2024-09-17T03:41:52.321 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36594.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51667.log.gz 2024-09-17T03:41:52.322 INFO:teuthology.orchestra.run.smithi121.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36594.log.gz 2024-09-17T03:41:52.322 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36005.log 2024-09-17T03:41:52.323 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54470.log 2024-09-17T03:41:52.323 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50012.log.gz 2024-09-17T03:41:52.324 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36005.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36005.log.gz 2024-09-17T03:41:52.324 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61554.log 2024-09-17T03:41:52.325 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43761.log 2024-09-17T03:41:52.326 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61554.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54470.log.gz 2024-09-17T03:41:52.326 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61554.log.gz 2024-09-17T03:41:52.326 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64263.log 2024-09-17T03:41:52.327 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44739.log 2024-09-17T03:41:52.327 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43761.log.gz 2024-09-17T03:41:52.328 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64263.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64263.log.gz 2024-09-17T03:41:52.329 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60407.log 2024-09-17T03:41:52.329 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66663.log 2024-09-17T03:41:52.330 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44739.log.gz 2024-09-17T03:41:52.331 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53636.log 2024-09-17T03:41:52.331 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60407.log.gz 2024-09-17T03:41:52.332 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66663.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66663.log.gz 2024-09-17T03:41:52.332 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44405.log 2024-09-17T03:41:52.333 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63783.log 2024-09-17T03:41:52.333 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44405.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53636.log.gz 2024-09-17T03:41:52.334 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35701.log 87.7% 2024-09-17T03:41:52.334 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44405.log.gz 2024-09-17T03:41:52.335 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63783.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63783.log.gz 2024-09-17T03:41:52.335 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T03:41:52.336 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67088.log 2024-09-17T03:41:52.336 INFO:teuthology.orchestra.run.smithi121.stderr: 74.7% -- replaced with /var/log/ceph/ceph-client.admin.35701.log.gz 2024-09-17T03:41:52.337 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52485.log 2024-09-17T03:41:52.338 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58287.log 2024-09-17T03:41:52.339 INFO:teuthology.orchestra.run.smithi121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67088.log.gz 2024-09-17T03:41:52.339 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46549.log 2024-09-17T03:41:52.340 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52485.log.gz 2024-09-17T03:41:52.341 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65197.log 2024-09-17T03:41:52.341 INFO:teuthology.orchestra.run.smithi176.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T03:41:52.341 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58287.log.gz 2024-09-17T03:41:52.342 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57469.log 2024-09-17T03:41:52.342 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46549.log.gz 2024-09-17T03:41:52.343 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56786.log 2024-09-17T03:41:52.344 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65197.log.gz 2024-09-17T03:41:52.344 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57213.log 2024-09-17T03:41:52.345 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57469.log.gz 2024-09-17T03:41:52.345 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44668.log 2024-09-17T03:41:52.346 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56786.log.gz 2024-09-17T03:41:52.347 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67811.log 2024-09-17T03:41:52.347 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57213.log.gz 2024-09-17T03:41:52.348 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44060.log 2024-09-17T03:41:52.348 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44668.log.gz 2024-09-17T03:41:52.349 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46188.log 2024-09-17T03:41:52.349 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67811.log.gz 2024-09-17T03:41:52.351 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57661.log 2024-09-17T03:41:52.351 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.44060.log.gz 2024-09-17T03:41:52.351 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.2.46188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46188.log.gz 2024-09-17T03:41:52.352 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51205.log 2024-09-17T03:41:52.353 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55694.log 2024-09-17T03:41:52.353 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57661.log.gz 2024-09-17T03:41:52.354 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67364.log 2024-09-17T03:41:52.354 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51205.log.gz 2024-09-17T03:41:52.355 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.55694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55694.log.gz 2024-09-17T03:41:52.355 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44342.log 2024-09-17T03:41:52.356 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54100.log 2024-09-17T03:41:52.356 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67364.log.gz 2024-09-17T03:41:52.358 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60901.log 2024-09-17T03:41:52.358 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44342.log.gz 2024-09-17T03:41:52.358 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.54100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54100.log.gz 2024-09-17T03:41:52.359 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64305.log 2024-09-17T03:41:52.360 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52003.log 2024-09-17T03:41:52.360 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60901.log.gz 2024-09-17T03:41:52.361 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50241.log 2024-09-17T03:41:52.361 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64305.log.gz 2024-09-17T03:41:52.362 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52003.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T03:41:52.363 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52003.log.gz 2024-09-17T03:41:52.364 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48848.log 2024-09-17T03:41:52.364 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50241.log.gz 2024-09-17T03:41:52.365 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59690.log 2024-09-17T03:41:52.366 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48848.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48848.log.gz 2024-09-17T03:41:52.366 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63383.log 2024-09-17T03:41:52.368 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44063.log 2024-09-17T03:41:52.368 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59690.log.gz 2024-09-17T03:41:52.369 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43318.log 2024-09-17T03:41:52.369 INFO:teuthology.orchestra.run.smithi121.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63383.log.gz 2024-09-17T03:41:52.370 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68276.log 2024-09-17T03:41:52.370 INFO:teuthology.orchestra.run.smithi121.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44063.log.gz 2024-09-17T03:41:52.371 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53283.log 2024-09-17T03:41:52.372 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43318.log.gz 2024-09-17T03:41:52.372 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.68276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52527.log 2024-09-17T03:41:52.373 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68276.log.gz 2024-09-17T03:41:52.373 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53283.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53283.log.gz 2024-09-17T03:41:52.374 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54104.log 2024-09-17T03:41:52.375 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52527.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52527.log.gz 2024-09-17T03:41:52.375 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51457.log 2024-09-17T03:41:52.376 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.54104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54104.log.gz 2024-09-17T03:41:52.377 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67746.log 2024-09-17T03:41:52.378 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58026.log 2024-09-17T03:41:52.378 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51457.log.gz 2024-09-17T03:41:52.380 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49736.log 2024-09-17T03:41:52.381 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67746.log.gz 2024-09-17T03:41:52.381 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43677.log 2024-09-17T03:41:52.381 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58026.log.gz 2024-09-17T03:41:52.382 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62213.log 2024-09-17T03:41:52.382 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49736.log.gz 2024-09-17T03:41:52.383 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66248.log 2024-09-17T03:41:52.383 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43677.log.gz 2024-09-17T03:41:52.384 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62213.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62213.log.gz 2024-09-17T03:41:52.384 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56421.log 2024-09-17T03:41:52.389 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66248.log: /var/log/ceph/ceph-client.admin.56421.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66248.log.gz 2024-09-17T03:41:52.389 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45105.log 2024-09-17T03:41:52.389 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56421.log.gz 2024-09-17T03:41:52.389 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61979.log 2024-09-17T03:41:52.389 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.45105.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45105.log.gz 2024-09-17T03:41:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61979.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61979.log.gz 2024-09-17T03:41:52.391 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65086.log 2024-09-17T03:41:52.392 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67490.log 2024-09-17T03:41:52.394 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65086.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T03:41:52.394 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65086.log.gz 2024-09-17T03:41:52.394 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55828.log 2024-09-17T03:41:52.395 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67490.log.gz 2024-09-17T03:41:52.396 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45877.log 2024-09-17T03:41:52.397 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55828.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55828.log.gz 2024-09-17T03:41:52.401 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45877.log: -- /var/log/ceph/ceph-client.admin.61111.log 2024-09-17T03:41:52.401 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45877.log.gz 2024-09-17T03:41:52.401 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41991.log 2024-09-17T03:41:52.401 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61111.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61111.log.gz 2024-09-17T03:41:52.401 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55001.log 2024-09-17T03:41:52.405 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.41991.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41991.log.gz 2024-09-17T03:41:52.405 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65216.log 2024-09-17T03:41:52.405 INFO:teuthology.orchestra.run.smithi121.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T03:41:52.405 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55001.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55001.log.gz 2024-09-17T03:41:52.405 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56866.log 2024-09-17T03:41:52.406 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49886.log 2024-09-17T03:41:52.406 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65216.log.gz 2024-09-17T03:41:52.407 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63956.log 2024-09-17T03:41:52.407 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56866.log.gz 2024-09-17T03:41:52.408 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36634.log 2024-09-17T03:41:52.408 INFO:teuthology.orchestra.run.smithi121.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49886.log.gz 2024-09-17T03:41:52.409 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63956.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T03:41:52.409 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63956.log.gz 2024-09-17T03:41:52.411 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.36634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63005.log 2024-09-17T03:41:52.411 INFO:teuthology.orchestra.run.smithi121.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36634.log.gz 2024-09-17T03:41:52.412 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49118.log 2024-09-17T03:41:52.413 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63005.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63005.log.gz 2024-09-17T03:41:52.414 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62405.log 2024-09-17T03:41:52.414 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49118.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T03:41:52.414 INFO:teuthology.orchestra.run.smithi121.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49118.log.gz 2024-09-17T03:41:52.415 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44067.log 2024-09-17T03:41:52.416 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.62405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62405.log.gz 2024-09-17T03:41:52.416 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61640.log 2024-09-17T03:41:52.417 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59732.log 2024-09-17T03:41:52.418 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.44067.log.gz 2024-09-17T03:41:52.418 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61640.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.61640.log.gz 2024-09-17T03:41:52.421 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67018.log 2024-09-17T03:41:52.421 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59732.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59732.log.gz 2024-09-17T03:41:52.421 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47367.log 2024-09-17T03:41:52.422 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66873.log 2024-09-17T03:41:52.422 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67018.log.gz 2024-09-17T03:41:52.424 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47367.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47367.log.gz 2024-09-17T03:41:52.425 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51583.log 2024-09-17T03:41:52.425 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66873.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66873.log.gz 2024-09-17T03:41:52.425 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53464.log 2024-09-17T03:41:52.428 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52942.log 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51583.log.gz 2024-09-17T03:41:52.428 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-17T03:41:52.428 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53464.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53464.log.gz 2024-09-17T03:41:52.428 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50138.log 2024-09-17T03:41:52.429 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56131.log 2024-09-17T03:41:52.429 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52942.log.gz 2024-09-17T03:41:52.430 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50138.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50138.log.gz 2024-09-17T03:41:52.431 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52098.log 2024-09-17T03:41:52.431 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65455.log 2024-09-17T03:41:52.432 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56131.log.gz 2024-09-17T03:41:52.433 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62718.log 2024-09-17T03:41:52.433 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52098.log.gz 2024-09-17T03:41:52.434 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65455.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65455.log.gz 2024-09-17T03:41:52.435 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42609.log 2024-09-17T03:41:52.436 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57120.log 2024-09-17T03:41:52.436 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.62718.log.gz 2024-09-17T03:41:52.438 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42609.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42609.log.gz 2024-09-17T03:41:52.438 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.admin.52900.log 2024-09-17T03:41:52.438 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57120.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57120.log.gz 2024-09-17T03:41:52.439 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45147.log 2024-09-17T03:41:52.440 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59774.log 2024-09-17T03:41:52.440 INFO:teuthology.orchestra.run.smithi121.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52900.log.gz 2024-09-17T03:41:52.442 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.45147.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45147.log.gz 2024-09-17T03:41:52.443 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46507.log 2024-09-17T03:41:52.443 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59774.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T03:41:52.443 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66831.log 2024-09-17T03:41:52.443 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59774.log.gz 2024-09-17T03:41:52.444 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58455.log 2024-09-17T03:41:52.444 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46507.log.gz 2024-09-17T03:41:52.445 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66831.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66831.log.gz 2024-09-17T03:41:52.445 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56047.log 2024-09-17T03:41:52.446 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66056.log 2024-09-17T03:41:52.446 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58455.log.gz 2024-09-17T03:41:52.447 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42333.log 2024-09-17T03:41:52.447 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56047.log.gz 2024-09-17T03:41:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66056.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66056.log.gz 2024-09-17T03:41:52.448 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62634.log 2024-09-17T03:41:52.449 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63912.log 2024-09-17T03:41:52.449 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42333.log.gz 2024-09-17T03:41:52.450 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35653.log 2024-09-17T03:41:52.450 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62634.log.gz 2024-09-17T03:41:52.451 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63912.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63912.log.gz 2024-09-17T03:41:52.451 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47949.log 2024-09-17T03:41:52.453 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62021.log 2024-09-17T03:41:52.453 INFO:teuthology.orchestra.run.smithi121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35653.log.gz 2024-09-17T03:41:52.454 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47949.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47949.log.gz 2024-09-17T03:41:52.454 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49160.log 2024-09-17T03:41:52.454 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52275.log 2024-09-17T03:41:52.456 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62021.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.62021.log.gz 2024-09-17T03:41:52.456 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49160.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49160.log.gz 2024-09-17T03:41:52.456 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36240.log 2024-09-17T03:41:52.457 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48256.log 2024-09-17T03:41:52.458 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52275.log: 87.5%/var/log/ceph/ceph-client.admin.36240.log: -- replaced with /var/log/ceph/ceph-client.admin.52275.log.gz 2024-09-17T03:41:52.458 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36240.log.gz 2024-09-17T03:41:52.458 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55428.log 2024-09-17T03:41:52.458 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60630.log/var/log/ceph/ceph-client.admin.48256.log: 2024-09-17T03:41:52.460 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48256.log.gz 2024-09-17T03:41:52.460 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55428.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55428.log.gz 2024-09-17T03:41:52.460 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44374.log 2024-09-17T03:41:52.461 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51024.log 2024-09-17T03:41:52.461 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60630.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60630.log.gz 2024-09-17T03:41:52.461 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44374.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44374.log.gz 2024-09-17T03:41:52.462 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44727.log 2024-09-17T03:41:52.463 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42163.log 2024-09-17T03:41:52.463 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51024.log.gz 2024-09-17T03:41:52.464 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44727.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.44727.log.gz 2024-09-17T03:41:52.464 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58413.log 2024-09-17T03:41:52.465 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67616.log 2024-09-17T03:41:52.466 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42163.log.gz 2024-09-17T03:41:52.466 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46996.log 2024-09-17T03:41:52.466 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58413.log.gz 2024-09-17T03:41:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67616.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67616.log.gz 2024-09-17T03:41:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44052.log 2024-09-17T03:41:52.468 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35672.log 2024-09-17T03:41:52.469 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46996.log.gz 2024-09-17T03:41:52.469 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44052.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44052.log.gz 2024-09-17T03:41:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67574.log 2024-09-17T03:41:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2024-09-17T03:41:52.471 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35672.log.gz 2024-09-17T03:41:52.472 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51075.log 2024-09-17T03:41:52.472 INFO:teuthology.orchestra.run.smithi121.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.67574.log.gz 2024-09-17T03:41:52.473 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62921.log 2024-09-17T03:41:52.473 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2024-09-17T03:41:52.473 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64935.log 2024-09-17T03:41:52.474 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51075.log.gz 2024-09-17T03:41:52.475 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46906.log 2024-09-17T03:41:52.475 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62921.log.gz 2024-09-17T03:41:52.476 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64935.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64935.log.gz 2024-09-17T03:41:52.476 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60303.log 2024-09-17T03:41:52.477 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52588.log 2024-09-17T03:41:52.478 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46906.log.gz 2024-09-17T03:41:52.478 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.60303.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60303.log.gz 2024-09-17T03:41:52.478 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42249.log 2024-09-17T03:41:52.479 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50096.log 2024-09-17T03:41:52.480 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52588.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52588.log.gz 2024-09-17T03:41:52.480 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42249.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42249.log.gz 2024-09-17T03:41:52.480 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44937.log 2024-09-17T03:41:52.481 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67322.log 2024-09-17T03:41:52.482 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50096.log.gz 2024-09-17T03:41:52.482 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44937.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44937.log.gz 2024-09-17T03:41:52.482 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64007.log 2024-09-17T03:41:52.483 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35947.log 2024-09-17T03:41:52.483 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67322.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67322.log.gz 2024-09-17T03:41:52.484 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59211.log 2024-09-17T03:41:52.485 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64007.log.gz 2024-09-17T03:41:52.485 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44356.log 2024-09-17T03:41:52.486 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35947.log.gz 2024-09-17T03:41:52.486 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58245.log 2024-09-17T03:41:52.486 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59211.log.gz 2024-09-17T03:41:52.487 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44666.log 2024-09-17T03:41:52.488 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44356.log.gz 2024-09-17T03:41:52.489 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58245.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58245.log.gz 2024-09-17T03:41:52.489 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43635.log 2024-09-17T03:41:52.490 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63684.log 2024-09-17T03:41:52.490 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44666.log.gz 2024-09-17T03:41:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43635.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43635.log.gz 2024-09-17T03:41:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45716.log 2024-09-17T03:41:52.492 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58161.log 2024-09-17T03:41:52.492 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63684.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63684.log.gz 2024-09-17T03:41:52.492 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.45716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45716.log.gz 2024-09-17T03:41:52.493 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59648.log 2024-09-17T03:41:52.494 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49607.log 2024-09-17T03:41:52.495 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59648.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58161.log.gz 2024-09-17T03:41:52.495 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59648.log.gz 2024-09-17T03:41:52.495 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59350.log 2024-09-17T03:41:52.496 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.49607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54882.log 2024-09-17T03:41:52.496 INFO:teuthology.orchestra.run.smithi121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49607.log.gz 2024-09-17T03:41:52.497 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59350.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59350.log.gz 2024-09-17T03:41:52.497 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66705.log 2024-09-17T03:41:52.498 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.54882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43887.log 2024-09-17T03:41:52.498 INFO:teuthology.orchestra.run.smithi121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54882.log.gz 2024-09-17T03:41:52.499 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66705.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66705.log.gz 2024-09-17T03:41:52.499 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54878.log 2024-09-17T03:41:52.500 INFO:teuthology.orchestra.run.smithi121.stderr:gzip/var/log/ceph/ceph-client.admin.43887.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61684.log 2024-09-17T03:41:52.500 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7%/var/log/ceph/ceph-client.0.54878.log: -- replaced with /var/log/ceph/ceph-client.admin.43887.log.gz 2024-09-17T03:41:52.501 INFO:teuthology.orchestra.run.smithi121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54878.log.gz 2024-09-17T03:41:52.501 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44402.log 2024-09-17T03:41:52.502 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61332.log 2024-09-17T03:41:52.502 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61684.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61684.log.gz 2024-09-17T03:41:52.503 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44402.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44402.log.gz 2024-09-17T03:41:52.503 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47823.log 2024-09-17T03:41:52.505 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53846.log 2024-09-17T03:41:52.505 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61332.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61332.log.gz 2024-09-17T03:41:52.506 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47823.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47823.log.gz 2024-09-17T03:41:52.506 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64473.log 2024-09-17T03:41:52.506 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61432.log 2024-09-17T03:41:52.507 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64473.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53846.log.gz 2024-09-17T03:41:52.508 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64473.log.gz 2024-09-17T03:41:52.508 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68150.log 2024-09-17T03:41:52.508 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54404.log 2024-09-17T03:41:52.509 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61432.log.gz 2024-09-17T03:41:52.510 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.68150.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68150.log.gz 2024-09-17T03:41:52.510 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51289.log 2024-09-17T03:41:52.511 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54404.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58329.log 2024-09-17T03:41:52.511 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54404.log.gz 2024-09-17T03:41:52.512 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58516.log 2024-09-17T03:41:52.513 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51289.log.gz 2024-09-17T03:41:52.513 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50535.log 2024-09-17T03:41:52.513 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58329.log.gz 2024-09-17T03:41:52.515 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51733.log 2024-09-17T03:41:52.515 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58516.log.gz 2024-09-17T03:41:52.516 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50535.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50535.log.gz 2024-09-17T03:41:52.516 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52630.log 2024-09-17T03:41:52.517 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56215.log 2024-09-17T03:41:52.518 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51733.log.gz 2024-09-17T03:41:52.518 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52630.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52630.log.gz 2024-09-17T03:41:52.518 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67658.log 2024-09-17T03:41:52.519 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56505.log 2024-09-17T03:41:52.520 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56215.log: /var/log/ceph/ceph-client.admin.67658.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56215.log.gz 2024-09-17T03:41:52.520 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67658.log.gz 2024-09-17T03:41:52.520 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54362.log 2024-09-17T03:41:52.521 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67406.log 2024-09-17T03:41:52.522 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56505.log.gz/var/log/ceph/ceph-client.admin.54362.log: 2024-09-17T03:41:52.522 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54362.log.gz 2024-09-17T03:41:52.522 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66140.log 2024-09-17T03:41:52.523 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68024.log 2024-09-17T03:41:52.523 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.67406.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67406.log.gz 2024-09-17T03:41:52.524 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.66140.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66140.log.gz 2024-09-17T03:41:52.524 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62557.log 2024-09-17T03:41:52.525 INFO:teuthology.orchestra.run.smithi121.stderr:gzip/var/log/ceph/ceph-client.admin.68024.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64221.log 2024-09-17T03:41:52.525 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68024.log.gz 2024-09-17T03:41:52.526 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.62557.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2024-09-17T03:41:52.526 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62557.log.gz 2024-09-17T03:41:52.527 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.64221.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64221.log.gz 2024-09-17T03:41:52.527 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58203.log 2024-09-17T03:41:52.528 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58768.log 2024-09-17T03:41:52.528 INFO:teuthology.orchestra.run.smithi121.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2024-09-17T03:41:52.529 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57171.log 2024-09-17T03:41:52.529 INFO:teuthology.orchestra.run.smithi121.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58203.log.gz 2024-09-17T03:41:52.530 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58768.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.58768.log.gz 2024-09-17T03:41:52.530 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65961.log 2024-09-17T03:41:52.531 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50936.log 2024-09-17T03:41:52.532 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57171.log.gz 2024-09-17T03:41:52.533 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48554.log 2024-09-17T03:41:52.533 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.65961.log.gz 2024-09-17T03:41:52.534 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50936.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50936.log.gz 2024-09-17T03:41:52.534 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49036.log 2024-09-17T03:41:52.535 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53594.log 2024-09-17T03:41:52.536 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48554.log.gz 2024-09-17T03:41:52.536 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.49036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49036.log.gz 2024-09-17T03:41:52.536 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57427.log 2024-09-17T03:41:52.537 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53594.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53594.log.gz 2024-09-17T03:41:52.537 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61810.log 2024-09-17T03:41:52.538 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53371.log 2024-09-17T03:41:52.539 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57427.log.gz 2024-09-17T03:41:52.540 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50493.log 2024-09-17T03:41:52.540 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61810.log.gz 2024-09-17T03:41:52.541 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53371.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65203.log 2024-09-17T03:41:52.541 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53371.log.gz 2024-09-17T03:41:52.542 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48214.log 2024-09-17T03:41:52.542 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50493.log.gz 2024-09-17T03:41:52.543 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52816.log 2024-09-17T03:41:52.543 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65203.log.gz 2024-09-17T03:41:52.544 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48214.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48214.log.gz 2024-09-17T03:41:52.544 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49603.log 2024-09-17T03:41:52.545 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52816.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T03:41:52.546 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52816.log.gz 2024-09-17T03:41:52.546 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.49603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49603.log.gz 2024-09-17T03:41:52.546 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58558.log 2024-09-17T03:41:52.547 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T03:41:52.549 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57511.log 2024-09-17T03:41:52.549 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58558.log.gz 2024-09-17T03:41:52.550 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61937.log 2024-09-17T03:41:52.551 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50325.log 2024-09-17T03:41:52.551 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57511.log.gz 2024-09-17T03:41:52.553 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61937.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61937.log.gz 2024-09-17T03:41:52.554 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50325.log: -- /var/log/ceph/ceph-client.admin.63604.log 2024-09-17T03:41:52.555 INFO:teuthology.orchestra.run.smithi121.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50325.log.gz 2024-09-17T03:41:52.555 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56691.log 2024-09-17T03:41:52.557 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.63604.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63604.log.gz 2024-09-17T03:41:52.558 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61237.log 2024-09-17T03:41:52.559 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56691.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56691.log.gz 2024-09-17T03:41:52.559 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2024-09-17T03:41:52.560 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.61237.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61237.log.gz 2024-09-17T03:41:52.561 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48121.log 2024-09-17T03:41:52.562 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47493.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2024-09-17T03:41:52.562 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46675.log 2024-09-17T03:41:52.564 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48121.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48121.log.gz 2024-09-17T03:41:52.564 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56173.log 2024-09-17T03:41:52.565 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46675.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46675.log.gz 2024-09-17T03:41:52.566 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65797.log 2024-09-17T03:41:52.568 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56173.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56173.log.gz 2024-09-17T03:41:52.570 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.65797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65797.log.gz 2024-09-17T03:41:52.571 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46321.log 2024-09-17T03:41:52.573 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56607.log 2024-09-17T03:41:52.575 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57301.log 2024-09-17T03:41:52.576 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46321.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56607.log.gz 2024-09-17T03:41:52.577 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46321.log.gz 2024-09-17T03:41:52.578 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67982.log 2024-09-17T03:41:52.581 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57301.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.57301.log.gz 2024-09-17T03:41:52.582 INFO:teuthology.orchestra.run.smithi121.stderr:gzip/var/log/ceph/ceph-client.admin.67982.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67982.log.gz 2024-09-17T03:41:52.583 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65543.log 2024-09-17T03:41:52.585 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.65543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44676.log 2024-09-17T03:41:52.588 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49040.log 2024-09-17T03:41:52.588 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65543.log.gz 2024-09-17T03:41:52.589 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44676.log.gz 2024-09-17T03:41:52.589 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53037.log 2024-09-17T03:41:52.592 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.49040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49040.log.gz 2024-09-17T03:41:52.592 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53037.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53037.log.gz 2024-09-17T03:41:52.676 INFO:teuthology.orchestra.run.smithi121.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T03:41:52.858 INFO:teuthology.orchestra.run.smithi121.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T03:41:53.214 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T03:41:53.303 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T03:41:53.306 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T03:41:53.314 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T03:41:53.317 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-17T03:41:53.317 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m1.291s 2024-09-17T03:41:53.318 INFO:teuthology.orchestra.run.smithi176.stderr:user 0m5.063s 2024-09-17T03:41:53.318 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m0.565s 2024-09-17T03:41:53.334 INFO:teuthology.orchestra.run.smithi121.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T03:41:53.346 INFO:teuthology.orchestra.run.smithi121.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T03:41:53.689 INFO:teuthology.orchestra.run.smithi121.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T03:41:53.707 INFO:teuthology.orchestra.run.smithi121.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T03:41:53.711 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-17T03:41:53.711 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m1.688s 2024-09-17T03:41:53.711 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m5.534s 2024-09-17T03:41:53.711 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m1.600s 2024-09-17T03:41:53.711 INFO:tasks.ceph:Archiving logs... 2024-09-17T03:41:53.711 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451/remote/smithi121/log 2024-09-17T03:41:53.712 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T03:41:54.863 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451/remote/smithi176/log 2024-09-17T03:41:54.864 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T03:41:55.632 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T03:41:55.641 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T03:41:55.641 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T03:41:55.646 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T03:41:55.771 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T03:41:55.779 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T03:41:55.779 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:41:55.783 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:41:55.814 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:41:55.817 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:41:55.821 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:41:55.821 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-17T03:41:55.822 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +1699us[+1715us] +/- 42ms 2024-09-17T03:41:55.822 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -372us[ -372us] +/- 73ms 2024-09-17T03:41:55.822 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -3148us[-3148us] +/- 80ms 2024-09-17T03:41:55.822 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:41:55.823 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:41:55.824 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-17T03:41:55.824 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 +1801us[+1766us] +/- 43ms 2024-09-17T03:41:55.824 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 -275us[ -309us] +/- 73ms 2024-09-17T03:41:55.824 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -3061us[-3061us] +/- 80ms 2024-09-17T03:41:55.824 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:41:55.825 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T03:41:55.834 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T03:41:55.834 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T03:41:55.842 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T03:41:55.996 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T03:41:56.113 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:41:56.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:41:56.175 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:41:56.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:41:56.235 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T03:41:56.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T03:41:56.264 INFO:teuthology.task.internal:Duration was 849.836264 seconds 2024-09-17T03:41:56.265 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T03:41:56.275 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T03:41:56.275 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T03:41:56.280 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T03:41:56.363 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:41:56.366 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:41:56.708 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T03:41:56.709 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-09-17T03:41:56.709 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T03:41:56.759 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-09-17T03:41:56.760 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T03:41:56.811 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T03:41:56.811 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T03:41:56.816 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T03:41:56.876 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T03:41:56.876 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T03:41:56.880 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T03:41:57.041 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T03:41:57.051 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T03:41:57.051 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T03:41:57.108 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T03:41:57.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T03:41:57.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:41:57.178 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:41:57.244 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-09-17T03:41:57.248 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-09-17T03:41:57.278 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:41:57.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:41:57.311 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:41:57.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:41:57.345 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T03:41:57.355 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T03:41:57.356 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451/remote/smithi121 2024-09-17T03:41:57.356 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T03:41:57.422 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908451/remote/smithi176 2024-09-17T03:41:57.422 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T03:41:57.486 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T03:41:57.486 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T03:41:57.491 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T03:41:57.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T03:41:57.536 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T03:41:57.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T03:41:57.546 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T03:41:57.546 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T03:41:57.566 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T03:41:57.597 INFO:teuthology.orchestra.run.smithi121.stdout: 393660 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 03:41 /home/ubuntu/cephtest 2024-09-17T03:41:57.600 INFO:teuthology.orchestra.run.smithi176.stdout: 393849 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 03:41 /home/ubuntu/cephtest 2024-09-17T03:41:57.602 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T03:41:57.613 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T03:41:57.634 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/sessionmap} duration: 849.836264371872 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T03:41:57.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T03:41:57.720 INFO:teuthology.run:pass